-- Logs begin at Wed 2022-11-02 12:26:15 UTC, end at Wed 2022-11-02 15:18:09 UTC. -- Nov 02 13:02:33.902479 n-d-858384-19 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 13:02:33.916225 n-d-858384-19 devstack@n-api.service[105040]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 13:02:33 2022] *** Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: nodename: n-d-858384-19 Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: machine: x86_64 Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: clock source: unix Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: pcre jit disabled Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: detected number of CPU cores: 4 Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: current working directory: / Nov 02 13:02:33.918157 n-d-858384-19 devstack@n-api.service[105040]: detected binary path: /usr/bin/uwsgi-core Nov 02 13:02:33.918865 n-d-858384-19 devstack@n-api.service[105040]: your processes number limit is 47680 Nov 02 13:02:33.918865 n-d-858384-19 devstack@n-api.service[105040]: your memory page size is 4096 bytes Nov 02 13:02:33.918865 n-d-858384-19 devstack@n-api.service[105040]: detected max file descriptor number: 2048 Nov 02 13:02:33.918865 n-d-858384-19 devstack@n-api.service[105040]: lock engine: pthread robust mutexes Nov 02 13:02:33.918865 n-d-858384-19 devstack@n-api.service[105040]: thunder lock: enabled Nov 02 13:02:33.918865 n-d-858384-19 devstack@n-api.service[105040]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 13:02:33.918865 n-d-858384-19 devstack@n-api.service[105040]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 13:02:33.957332 n-d-858384-19 devstack@n-api.service[105040]: Python main interpreter initialized at 0x560f011849c0 Nov 02 13:02:33.957332 n-d-858384-19 devstack@n-api.service[105040]: python threads support enabled Nov 02 13:02:33.957332 n-d-858384-19 devstack@n-api.service[105040]: your server socket listen backlog is limited to 100 connections Nov 02 13:02:33.957332 n-d-858384-19 devstack@n-api.service[105040]: your mercy for graceful operations on workers is 90 seconds Nov 02 13:02:33.957738 n-d-858384-19 devstack@n-api.service[105040]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 13:02:33.957738 n-d-858384-19 devstack@n-api.service[105040]: *** Operational MODE: preforking *** Nov 02 13:02:33.958013 n-d-858384-19 devstack@n-api.service[105040]: *** uWSGI is running in multiple interpreter mode *** Nov 02 13:02:33.958013 n-d-858384-19 devstack@n-api.service[105040]: spawned uWSGI master process (pid: 105040) Nov 02 13:02:33.958260 n-d-858384-19 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 13:02:33.959175 n-d-858384-19 devstack@n-api.service[105040]: spawned uWSGI worker 1 (pid: 105041, cores: 1) Nov 02 13:02:33.959175 n-d-858384-19 devstack@n-api.service[105040]: spawned uWSGI worker 2 (pid: 105042, cores: 1) Nov 02 13:02:33.959362 n-d-858384-19 devstack@n-api.service[105040]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 13:02:34.622161 n-d-858384-19 devstack@n-api.service[105041]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 13:02:34.637268 n-d-858384-19 devstack@n-api.service[105042]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 13:02:35.712882 n-d-858384-19 devstack@n-api.service[105041]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:02:35.712882 n-d-858384-19 devstack@n-api.service[105041]: from cryptography.utils import int_from_bytes Nov 02 13:02:35.713485 n-d-858384-19 devstack@n-api.service[105041]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:02:35.713485 n-d-858384-19 devstack@n-api.service[105041]: from cryptography.utils import int_from_bytes Nov 02 13:02:35.715924 n-d-858384-19 devstack@n-api.service[105042]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:02:35.715924 n-d-858384-19 devstack@n-api.service[105042]: from cryptography.utils import int_from_bytes Nov 02 13:02:35.716359 n-d-858384-19 devstack@n-api.service[105042]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:02:35.716359 n-d-858384-19 devstack@n-api.service[105042]: from cryptography.utils import int_from_bytes Nov 02 13:02:38.279449 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 13:02:38.280035 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 13:02:38.280130 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 13:02:38.280491 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 13:02:38.280579 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 13:02:38.280659 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 13:02:38.280833 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 13:02:38.280970 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 13:02:38.281195 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 13:02:38.281304 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.281456 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 13:02:38.281564 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.281833 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.281928 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.282149 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.282243 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.282470 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.282565 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.282778 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.282871 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.283097 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.283219 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.283450 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.283535 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.283769 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.283853 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.284028 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.284112 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.284343 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.284428 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.284654 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.284739 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-19 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.284970 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.285053 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.285272 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.285363 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-19 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.285580 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.285665 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.285901 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.285997 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.286197 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.286313 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.286512 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.286603 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.286813 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.286905 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.287168 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.287345 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.287515 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.287781 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.288133 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.288255 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.288482 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.288602 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.288927 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.289077 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.289161 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.289282 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.289417 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.289565 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.289727 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.289924 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.290047 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.290242 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.290346 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.290567 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.290671 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.290878 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.290984 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.291287 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.291493 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-19 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.291631 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.291776 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-19 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.291929 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.292017 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.292240 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.292324 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.292590 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.292682 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.292954 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.293048 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.293262 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.293355 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.293582 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.293669 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.293905 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.294006 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.294209 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.294296 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.294524 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.294614 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.294840 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.294986 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.295178 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.295267 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.295499 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.295594 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.295803 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.295897 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.296108 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.296192 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.296462 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.296550 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.296785 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.296880 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.297090 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.297176 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.297393 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.297477 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.297641 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.297734 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.297938 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.298032 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.298249 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.298335 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.298568 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.298652 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.298887 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.298985 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.299156 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.299260 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.299409 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.299519 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.299714 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.299828 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.300031 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.300140 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.300339 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.300426 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.300645 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.300730 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.300947 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.301033 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.301251 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.301352 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.301556 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.301648 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.301859 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.302005 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.302158 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.302245 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.302461 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.302543 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.302766 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.302853 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.303076 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.303190 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.303424 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.303526 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.303772 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.304071 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.304171 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.304459 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.304559 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.113 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.304710 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.113 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.304808 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.305017 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.305170 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.113 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.305389 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.305528 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.113 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.305689 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.305784 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.305995 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.306195 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.306330 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.306438 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.306612 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.306709 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.306918 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.307004 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.307253 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.307345 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.307559 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.307648 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.307867 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.307951 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.308175 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.308260 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.308483 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.308568 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.308732 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.308818 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.309030 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.309124 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.309332 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.309424 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.309629 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.309732 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.309939 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.310041 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.310223 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.310310 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.310523 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.310607 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.310901 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.311013 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.311136 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.311219 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.311432 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.311517 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.311733 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.311830 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.312115 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.312214 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.312336 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.312427 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.312634 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.312726 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.312934 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.313020 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.313235 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.313320 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.313536 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.313622 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.313857 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.313946 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.314187 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.314292 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.314491 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.314598 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.314788 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.314879 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.315090 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.315240 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.315415 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.315501 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.315719 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.315850 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.316022 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.316107 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.316324 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.316455 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.316624 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.316710 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.316930 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.317022 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.317227 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.317311 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.317527 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.317622 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.317835 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.317930 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.318137 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.318221 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.318441 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.318525 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.318745 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.318828 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.319042 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.319669 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.319934 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.320071 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.320237 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.320331 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.320542 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.320625 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.320844 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.320928 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.321144 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.321243 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.321443 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.321547 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.321745 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.321836 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.322042 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.322184 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.322339 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.322424 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.322640 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.322725 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.322935 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.323029 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.323272 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.323361 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.323574 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.323657 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.323885 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.323979 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.324194 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.324278 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.324495 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.324590 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.324800 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.324884 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.325106 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.325199 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.325426 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:02:38.325518 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.325764 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.325850 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.326079 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.326162 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.326410 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.326546 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.326733 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.326818 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.327066 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.327170 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.327450 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.327559 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.327734 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.327821 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.328061 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.328155 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.328372 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.328465 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.328678 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.328762 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.328988 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.329074 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.329295 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.329397 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.329607 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.329716 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.329924 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.330058 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.330237 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.330334 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.330551 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.330638 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.330866 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.330967 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.331197 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.331304 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.331516 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.331622 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.331829 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.331974 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.332147 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.332286 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.332456 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.332591 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.332783 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.332924 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.333095 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.333225 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.333426 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.333524 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.333752 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.333890 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.334073 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.334204 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.334385 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.334516 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.334720 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.334905 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.335095 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.335234 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.335428 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.335568 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.335746 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.335877 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.336088 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.336200 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.336400 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.336488 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.336716 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.336824 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.337034 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.337122 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.337347 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.337435 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.337672 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.337774 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.338477 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.338575 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.338784 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.338871 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.339094 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.339217 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.339426 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.339512 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.339736 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.339825 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.340073 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.340187 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.340377 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.340473 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.340685 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.340781 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.341001 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.341098 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.341312 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.341406 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.341623 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.341709 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.341932 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.342021 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.342236 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.342338 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.342542 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.342636 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.342846 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.342934 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.343171 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.343262 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.343476 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.343562 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.343783 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.343875 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.344088 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.344182 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.344403 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.344491 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.344728 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.344832 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.345031 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.345118 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.345339 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.345439 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.345647 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.345734 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.345955 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.346041 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.346260 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.346369 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.346566 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.346653 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.346874 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.346981 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.347201 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.347304 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.347511 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.347597 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.347818 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.347904 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.348121 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.348216 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.348442 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.348539 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.348744 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.348830 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.349049 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.349138 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.349355 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.349440 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.349661 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.349747 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.349971 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.350065 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.350279 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.350364 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.350633 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.350832 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.350959 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.351200 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.351305 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.351521 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.351609 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.351854 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.351990 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.352169 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.352323 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.352539 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.352695 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.352844 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.352985 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.353116 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.353246 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.353424 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.353555 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.353727 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.353858 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.354036 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.354177 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.354344 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.354495 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.354653 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.354787 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.354919 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.355048 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.355252 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.355385 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.355556 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.355647 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.355860 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.355990 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.356160 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.356299 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.356462 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.356594 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.356777 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.356926 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.357069 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.357207 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.357342 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.357476 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.357650 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.357790 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.357951 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.358097 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.358253 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.358388 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.358559 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.358692 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.358863 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.359003 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.359190 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.359324 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.359535 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.359669 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.359840 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.359990 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.360164 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.360313 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.360476 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.360566 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.360792 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.360879 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.361100 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.361192 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.361410 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.361503 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.361719 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.361807 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.362028 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.362115 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.362348 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.362433 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.362658 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.362745 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.362969 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.363054 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.363300 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.363401 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.363615 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.363700 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.363922 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.364006 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.364231 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.364325 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.364538 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.364630 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.364851 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.364941 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.365170 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.365265 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.365479 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.365571 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.365795 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.365880 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.366163 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.366263 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.366479 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.366577 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.366794 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.367005 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.367191 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.367355 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.367457 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.367659 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.367743 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.367977 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.368062 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.368289 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.368365 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.368601 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.368676 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.368964 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.369146 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.369242 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.369318 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.369519 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.369655 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.369826 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.369925 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.370143 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.370218 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.370447 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.370521 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.370756 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.370840 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.371098 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.371321 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.371453 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.371589 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.371823 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.371905 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.372033 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.372200 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.372333 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.372462 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.372646 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.372777 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.373059 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.373271 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.373476 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.373619 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.373794 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.373935 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.374135 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.374591 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.374774 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.374923 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.375069 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.375218 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.375353 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.375484 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.375665 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.375855 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.375989 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.376119 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.376249 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.376379 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.376509 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.376674 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.376833 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.376977 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.377127 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.377258 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.377454 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.377612 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.377779 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.377912 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.378067 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.378198 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.378386 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.378528 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.378674 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.378805 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.378976 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.379175 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.379310 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.379455 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.379601 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.379733 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.379907 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.380038 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.380210 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.380342 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.380511 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.380652 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.380854 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.380987 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.381161 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.381315 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.381466 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.381620 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.382292 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.382466 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.382618 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.382874 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.383018 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.383265 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.383429 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.383573 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.383771 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.383909 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.383994 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.384169 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.384293 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.384484 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.384575 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.384792 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.384883 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.385102 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.385198 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.385413 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.385510 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.385722 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.385807 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.386031 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.386123 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.386351 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.386444 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.386660 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.386781 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.386969 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.387055 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.387304 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.387391 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.387608 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.387693 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.387919 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.388015 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.388230 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.388314 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.388559 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.388814 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.388899 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.389148 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.389238 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.389467 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.389552 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.389773 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.389857 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.390123 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.390225 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.390436 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.390537 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.390767 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.391013 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.391100 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.391375 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.391466 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.391693 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.391782 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.392011 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.392095 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.392318 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.392404 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.392623 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.392762 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.392931 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.393018 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.393237 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.393332 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.393540 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.393626 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.393845 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.393930 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.394157 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.394252 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.394460 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.394545 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.394762 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.394855 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.395061 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.395216 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.395394 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.395478 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.395701 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.395786 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.396003 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.396114 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.396316 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.396468 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.396598 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.396683 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.396907 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.396995 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.397240 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.397898 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.398079 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.398293 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.398391 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.398673 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.398791 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.399014 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.399181 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.399358 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.399471 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.399669 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.399813 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.399998 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.400145 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.400310 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.400489 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.400624 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.400798 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.400930 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.401106 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.401237 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.401431 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.401580 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.401738 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.401887 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.402043 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.402229 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.402349 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.402558 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.402643 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.402902 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.402997 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.403232 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.403320 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.403546 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.403691 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.403862 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.403961 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.404168 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.404253 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.404474 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.404592 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.404777 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.404875 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.405084 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.405167 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.405390 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.405489 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.405694 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.405784 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.405999 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.406087 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.406301 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.406397 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.406604 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.406693 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.406911 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.407028 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.407238 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.407327 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.407541 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.407630 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.407848 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.407936 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.408149 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.408280 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.408460 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.408548 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.408762 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.408848 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.409067 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.409163 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.409369 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.409456 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.409675 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.409761 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.409977 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.410073 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.410281 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.410370 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.410589 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.410675 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.410898 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.410994 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.411226 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.411329 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.411530 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.411616 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.411835 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.411937 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.412136 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.412235 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.412439 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.412569 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.412742 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.412869 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.413648 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.413786 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.413964 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.414152 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.414322 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.414562 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.414659 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.414889 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.415061 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.415188 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.415286 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.415492 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.415583 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.415804 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.415893 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.416186 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.416297 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.416448 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.416534 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.416808 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.416916 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.417055 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.417180 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.417358 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.417442 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.417658 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.417745 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.417962 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.418048 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.418269 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.418354 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.418573 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.418667 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.418872 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.418982 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.419195 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.419287 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.419502 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.419598 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.419808 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.419895 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.420132 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.420217 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.420444 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.420540 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.420750 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.420837 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.421056 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.421142 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.421362 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.421456 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.421669 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.421762 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.421982 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.422069 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.422286 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.422381 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.422600 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.422716 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.422909 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.423033 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.423245 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.423381 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.423551 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.423695 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.423854 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.424008 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.424175 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.424324 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.424490 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.424630 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.424802 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.424946 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.425123 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.425256 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.425549 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.425757 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.425844 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.425922 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.426064 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.426152 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.426372 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.426457 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.426679 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.426763 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.426989 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.427217 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.427350 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.427488 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.427696 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.427822 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.427920 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.428009 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.428219 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.428306 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.428601 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.429322 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.429561 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.429654 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.429885 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.429970 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.430194 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.430293 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.430504 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.430591 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.430814 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.430899 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.431134 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.431237 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.431467 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.431615 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.431796 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.431891 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.432103 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.432200 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.432413 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.432499 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.432717 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.432806 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.433028 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.433121 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.433330 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.433415 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.433657 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.433771 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.433969 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.434080 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.434374 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.434531 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.434841 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.434990 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.435102 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.435260 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.435347 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.435428 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.435506 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.435614 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.435922 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.436067 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.436204 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.436333 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.436537 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.436688 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.436821 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.436952 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.437248 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.437493 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.437649 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.437814 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.437962 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.438078 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.438163 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.438253 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.438334 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.438428 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.438688 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.438777 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.438993 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.439080 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.439323 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.439428 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.439628 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.439716 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.439947 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.440041 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.440247 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.440335 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.440562 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.440649 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.440885 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.440972 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.441190 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.441280 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.441495 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.441583 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.441802 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.441954 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.442125 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.442262 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.442429 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.442568 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.442753 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.442888 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.443303 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.443404 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.443512 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.443627 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.443821 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.443977 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.444205 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.444303 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.444537 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.444682 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.444856 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.444983 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.445179 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.445321 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.445490 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.445605 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.445801 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.445941 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.446119 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.446216 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.446435 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.446538 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.446746 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.446825 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.447075 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.447196 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.447439 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.447568 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.447764 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.447997 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.448214 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.448399 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.448539 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.448673 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.448765 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.448890 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.449031 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.449194 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.449328 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.449500 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.449648 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.449807 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.449972 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.450107 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.450297 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.450430 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.450614 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.450746 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.450937 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.451076 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.451288 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.451378 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.451597 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.451684 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.451905 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.451996 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.452209 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.452309 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.452512 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.452609 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.452810 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.452897 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.453130 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.453230 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.453429 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.453527 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.453737 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.453824 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.454045 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.454137 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.454353 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.454452 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.454663 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.454758 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.454965 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.455061 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.455310 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.455459 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.455603 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.455760 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.455908 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.456043 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.456181 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.456269 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.456478 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.456567 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.456822 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.456925 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.457122 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.457249 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.457444 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.457541 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.457749 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.457848 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.458056 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.458155 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.458361 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.458455 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.458665 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.458942 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.459081 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.459234 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.459333 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.459416 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.459644 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.459787 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.460032 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.460129 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.460369 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.460500 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.460684 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.460786 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.461006 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.461095 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.461312 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.461407 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.461619 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.461721 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.461926 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.462061 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.462227 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.462322 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.462533 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.462636 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.462836 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.462927 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.463154 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.463249 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.463461 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.463553 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.463764 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.463882 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.464068 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.464176 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.464374 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.464473 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.464680 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.464769 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.464981 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.465078 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.465278 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.465393 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.465578 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.465677 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.465897 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.466005 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.466207 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.466351 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.466525 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.466615 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.466829 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.466972 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.467145 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.467249 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.467454 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.467550 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.467756 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.467856 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.468087 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.468237 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.468373 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.468510 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.468697 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.468840 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.469004 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.469139 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.469315 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.469402 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.469621 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.469719 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.469934 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.470029 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.470246 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.470333 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.470561 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.470649 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.470873 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.471154 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.471258 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.471491 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.471590 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.471806 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.471894 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.472119 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.472214 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.472431 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.472531 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.472740 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.472826 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.473051 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.473303 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.473557 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.473641 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.473711 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.473934 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.474096 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.474241 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.474411 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.474555 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.474642 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.474869 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.474968 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.475206 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.475313 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.476608 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.476898 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477023 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477095 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477194 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477194 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477369 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477439 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477505 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477633 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477724 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.477947 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.478043 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.478261 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.478364 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.478568 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.478657 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.478884 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.478971 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.479227 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.479323 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.479536 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.479628 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.479846 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.479943 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.480159 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.480247 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.480470 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.480561 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.480780 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.480870 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.481088 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.481185 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.481399 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.481494 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.481709 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.481797 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.482023 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.482202 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.482335 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.482431 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.482653 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.482742 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.482963 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.483058 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.483299 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.483387 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.483613 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.483701 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.483929 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.484165 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.484254 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.484477 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.484565 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.484812 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.484929 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.485141 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.485229 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.485465 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.485553 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.485781 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.485879 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.486099 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.486197 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.486477 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.486654 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.486743 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.486972 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.487064 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.487334 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.487423 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.487641 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.487745 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.487944 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.488032 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.488279 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.488398 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.488580 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.488688 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.488881 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.488984 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.489197 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.489296 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.489606 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.489724 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.489811 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.490077 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.490182 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.490405 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.490495 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.490727 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.490817 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.491672 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.492442 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.492573 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.492659 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.492731 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.492808 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.492808 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.492941 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.493014 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.493242 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.493355 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.493582 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.493671 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.493901 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.493999 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.494210 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.494309 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.494515 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.494612 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.494836 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.494928 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.495154 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.495249 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.495468 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.495556 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.495773 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.495881 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.496081 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.496181 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.496419 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.496526 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.496695 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.496887 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.497009 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.497172 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.497337 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.497484 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.497626 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.497829 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.497923 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.498145 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.498291 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.498484 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.498615 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.498776 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.498954 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.499414 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.499686 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.499792 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.499958 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.500048 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.500265 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.500353 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.500568 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.500671 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.500877 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.500997 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.501197 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.501351 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.501496 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.501607 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.501792 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.501883 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.502100 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.502189 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.502411 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.502562 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.502733 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.502880 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.503029 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.503212 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.503404 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.503505 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.503632 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.503721 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.503945 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.504043 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.504258 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.504424 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.504607 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.504760 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.504905 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.505054 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.505212 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.505492 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.505662 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.505806 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.505897 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.506118 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.506289 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.506457 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.506633 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.506774 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.506904 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.507099 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.507300 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.507499 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.507635 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.507723 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.507803 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.508044 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.508144 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.508355 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.508628 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.508716 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.508960 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.509050 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.509269 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.509364 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.509580 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.509675 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.509891 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.509992 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.510200 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.510287 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.510507 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.510606 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.510816 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.510912 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.511136 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.511227 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.511454 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.511541 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.511761 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.511866 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.512069 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.512156 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.512377 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.512463 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.512685 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.512859 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.512999 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.513087 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.513312 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.513409 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.513624 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.513724 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.513933 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.514022 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.514243 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.514329 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.514551 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.514638 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.514857 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.514946 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.515188 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.515281 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.515499 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.515591 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.515817 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.515974 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.516147 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.516313 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.516454 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.516547 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.516751 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.516853 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.517072 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.517391 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.517569 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.517719 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.517864 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.518010 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.518159 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.518321 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.518444 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.518599 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.518688 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.518915 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.519053 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.519270 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.519411 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.519594 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.519749 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.519893 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.520050 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.520336 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.520600 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.520759 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.520917 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.521049 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.521226 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.521317 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.521548 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.521636 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.521865 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.521976 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.522187 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.522321 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.522592 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.522739 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.522958 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.523064 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.523372 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.523473 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.523620 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.523959 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.524082 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.524302 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.524396 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.524646 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.524750 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.524966 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.525279 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.525414 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.525585 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.525676 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.525895 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.525989 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.526205 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.526297 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.526526 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.526612 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.526837 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.526962 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.527251 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.527363 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.527475 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.527617 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.527785 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.527901 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.528200 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.528356 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.528659 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.528787 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.528976 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.529168 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.529301 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.529669 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.529901 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.530073 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.530205 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.530358 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.530488 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.530616 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.531162 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.531310 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.531438 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.531527 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.531599 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.531676 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.531745 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.532024 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.532135 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.532292 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.532453 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.532596 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.532740 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.532906 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.533094 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.533231 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.533359 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.533520 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.533608 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.533818 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.533941 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.534208 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.534346 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.534479 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.534629 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.534740 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.534858 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.535099 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.535289 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.535431 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.535591 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.535734 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.535869 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.535990 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.536111 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.536302 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.536458 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.536648 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.536781 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.536930 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.537081 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.537231 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.537374 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.537527 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.537664 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.537796 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.538602 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.539614 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.539770 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.539946 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.540101 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.540234 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.540386 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.540535 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.540702 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.540857 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.541008 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.541160 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.541327 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.541479 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.541656 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.541806 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.541959 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.542134 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.542297 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.542457 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.542629 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.542780 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.542928 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.543077 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.543252 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.543422 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.543575 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.543724 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.543874 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.544026 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.544178 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.544443 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.544608 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.544765 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.544913 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.545066 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.545215 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.545375 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.545519 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.545665 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.545811 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.545969 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.546118 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.546273 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.546402 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.546495 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.546578 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.546659 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.546780 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.546925 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.547070 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.547230 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.547353 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.547474 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.547474 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.547722 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.547854 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.547854 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 13:02:38.548083 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.548083 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.548532 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.549110 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.549762 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.550137 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.550621 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:02:38.550880 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 13:02:38.703651 n-d-858384-19 devstack@n-api.service[105041]: INFO dbcounter [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Registered counter for database nova_api Nov 02 13:02:38.708248 n-d-858384-19 devstack@n-api.service[105042]: INFO dbcounter [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Registered counter for database nova_api Nov 02 13:02:38.727286 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_db.sqlalchemy.engines [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:02:38.730746 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:02:38.734277 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writer thread running {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:02:38.738427 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writer thread running {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:02:38.792652 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.context [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) {{(pid=105041) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 13:02:38.796774 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:38.797107 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:38.798138 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.context [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) {{(pid=105042) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 13:02:38.798749 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:38.799518 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:38.799961 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:38.802014 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:38.802198 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_concurrency.lockutils [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:38.802763 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_concurrency.lockutils [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:38.804467 n-d-858384-19 devstack@n-api.service[105041]: INFO dbcounter [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Registered counter for database nova_cell0 Nov 02 13:02:38.805338 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_concurrency.lockutils [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:38.806188 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_concurrency.lockutils [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:38.806728 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_concurrency.lockutils [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:38.809437 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_concurrency.lockutils [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105042) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:38.809706 n-d-858384-19 devstack@n-api.service[105041]: INFO dbcounter [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Registered counter for database nova_cell1 Nov 02 13:02:38.811764 n-d-858384-19 devstack@n-api.service[105042]: INFO dbcounter [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Registered counter for database nova_cell0 Nov 02 13:02:38.818141 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_db.sqlalchemy.engines [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:02:38.818905 n-d-858384-19 devstack@n-api.service[105042]: INFO dbcounter [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Registered counter for database nova_cell1 Nov 02 13:02:38.821460 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_db.sqlalchemy.engines [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:02:38.824484 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writer thread running {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:02:38.829270 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:02:38.837503 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writer thread running {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:02:38.838264 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:02:38.966691 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writer thread running {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:02:38.977437 n-d-858384-19 devstack@n-api.service[105041]: INFO dbcounter [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Registered counter for database nova_cell0 Nov 02 13:02:38.983677 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writer thread running {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:02:38.985914 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_db.sqlalchemy.engines [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:02:38.992842 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writer thread running {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:02:38.993776 n-d-858384-19 devstack@n-api.service[105042]: INFO dbcounter [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Registered counter for database nova_cell0 Nov 02 13:02:39.003940 n-d-858384-19 devstack@n-api.service[105042]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:02:39.012065 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writer thread running {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:02:39.345187 n-d-858384-19 devstack@n-api.service[105041]: WARNING keystonemiddleware.auth_token [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:02:39.353210 n-d-858384-19 devstack@n-api.service[105041]: WARNING keystonemiddleware.auth_token [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:02:39.358482 n-d-858384-19 devstack@n-api.service[105042]: WARNING keystonemiddleware.auth_token [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:02:39.365838 n-d-858384-19 devstack@n-api.service[105042]: WARNING keystonemiddleware.auth_token [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:02:39.696502 n-d-858384-19 devstack@n-api.service[105041]: WARNING keystonemiddleware.auth_token [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:02:39.702558 n-d-858384-19 devstack@n-api.service[105041]: WARNING keystonemiddleware.auth_token [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:02:39.707784 n-d-858384-19 devstack@n-api.service[105041]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560f011849c0 pid: 105041 (default app) Nov 02 13:02:39.710508 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:39.711738 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] 10.222.0.113 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.002437 Nov 02 13:02:39.712157 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 1/1] 10.222.0.113 () {50 vars in 793 bytes} [Wed Nov 2 13:02:39 2022] GET /compute/v2.1/ => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:39.723681 n-d-858384-19 devstack@n-api.service[105042]: WARNING keystonemiddleware.auth_token [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:02:39.730502 n-d-858384-19 devstack@n-api.service[105042]: WARNING keystonemiddleware.auth_token [None req-2aa0acfe-2529-4c7c-b61e-6062375b8ca2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:02:39.735793 n-d-858384-19 devstack@n-api.service[105042]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560f011849c0 pid: 105042 (default app) Nov 02 13:04:06.776281 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:06.777298 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001440 Nov 02 13:04:06.777880 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 2/2] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:06 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:06.791179 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writing DB stats nova_api:SELECT=3 {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:06.792131 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writing DB stats nova_cell0:SELECT=3 {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:06.793172 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writing DB stats nova_cell1:SELECT=3 {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:06.793897 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writing DB stats nova_cell0:SELECT=3 {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:07.760719 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-be23a7ef-0c7b-4164-aa1e-6a0dc9ff37c6 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:07.794278 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-be23a7ef-0c7b-4164-aa1e-6a0dc9ff37c6 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.009154 Nov 02 13:04:07.795289 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 1/3] 10.222.0.113 () {60 vars in 1297 bytes} [Wed Nov 2 13:04:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:10.568928 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:10.570033 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-1ee279a5-5aa2-4d48-8dfc-84ce0b702298 None None] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002223 Nov 02 13:04:10.570674 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 3/4] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:11.133363 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-732c34d2-52f7-49b5-8cf4-b9b73ce819dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:11.187985 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-732c34d2-52f7-49b5-8cf4-b9b73ce819dd admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.610911 Nov 02 13:04:11.191270 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 2/5] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:04:11.204093 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writing DB stats nova_api:SELECT=3 {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:11.205218 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writing DB stats nova_cell1:SELECT=3 {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:11.207210 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writing DB stats nova_cell0:SELECT=3 {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:11.209011 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:11.420671 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-49202f62-b63f-4f2e-bce2-2432de07f389 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:11.498058 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-49202f62-b63f-4f2e-bce2-2432de07f389 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.299881 Nov 02 13:04:11.499053 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 4/6] 10.222.0.113 () {64 vars in 1341 bytes} [Wed Nov 2 13:04:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:14.414402 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-732c34d2-52f7-49b5-8cf4-b9b73ce819dd admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:14.415392 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-732c34d2-52f7-49b5-8cf4-b9b73ce819dd admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001472 Nov 02 13:04:14.415791 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 3/7] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:14 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:04:15.377800 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-4df17811-6639-4643-966f-f42b5f3102b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M"}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:15.432736 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-4df17811-6639-4643-966f-f42b5f3102b1 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.010169 Nov 02 13:04:15.434453 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 5/8] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:04:15.449214 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-afb98fcf-229e-417d-a3a3-97ff102a5a87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:15.506613 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-afb98fcf-229e-417d-a3a3-97ff102a5a87 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061908 Nov 02 13:04:15.507523 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 4/9] 10.222.0.113 () {64 vars in 1341 bytes} [Wed Nov 2 13:04:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:18.465110 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-4df17811-6639-4643-966f-f42b5f3102b1 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:18.466238 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-4df17811-6639-4643-966f-f42b5f3102b1 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001601 Nov 02 13:04:18.471994 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 6/10] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:18 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:18.978347 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-85e80d54-f349-48bf-a68e-209f7585367e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:18.999105 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-85e80d54-f349-48bf-a68e-209f7585367e admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.525297 Nov 02 13:04:19.001067 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 5/11] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:04:19.013702 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-bef274a6-8ab3-409b-8aae-ea227b37ce01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:19.041584 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-bef274a6-8ab3-409b-8aae-ea227b37ce01 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031455 Nov 02 13:04:19.055726 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 7/12] 10.222.0.113 () {64 vars in 1341 bytes} [Wed Nov 2 13:04:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:21.806014 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-85e80d54-f349-48bf-a68e-209f7585367e admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:21.807654 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-85e80d54-f349-48bf-a68e-209f7585367e admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002121 Nov 02 13:04:21.808573 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 6/13] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:21 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:22.303956 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-e0aa3009-3927-4209-8812-827ab06a60df admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:22.327667 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-e0aa3009-3927-4209-8812-827ab06a60df admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.504488 Nov 02 13:04:22.328223 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 8/14] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:04:22.340583 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-2e614a85-b400-43e5-b993-b9a17299ecae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:22.378000 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-2e614a85-b400-43e5-b993-b9a17299ecae admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041085 Nov 02 13:04:22.378993 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 7/15] 10.222.0.113 () {64 vars in 1341 bytes} [Wed Nov 2 13:04:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:25.158935 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-e0aa3009-3927-4209-8812-827ab06a60df admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:25.160762 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-e0aa3009-3927-4209-8812-827ab06a60df admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002279 Nov 02 13:04:25.179182 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 9/16] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:25 2022] GET /compute/v2.1 => generated 389 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:25.812470 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-6996178c-e428-48c1-81e5-3437173d2b75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:25.838184 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-6996178c-e428-48c1-81e5-3437173d2b75 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.669797 Nov 02 13:04:25.840041 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 8/17] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:04:25.851771 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-bd3bf7ac-1eae-4717-b21c-9f43c033ab56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:25.884419 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-bd3bf7ac-1eae-4717-b21c-9f43c033ab56 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036315 Nov 02 13:04:25.885376 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 10/18] 10.222.0.113 () {64 vars in 1341 bytes} [Wed Nov 2 13:04:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:28.590482 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-6996178c-e428-48c1-81e5-3437173d2b75 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:28.591542 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-6996178c-e428-48c1-81e5-3437173d2b75 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 Nov 02 13:04:28.591953 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 9/19] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:28 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:29.066404 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-765cebaa-2968-4b45-85a6-90301c28dcb4 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:29.092890 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-765cebaa-2968-4b45-85a6-90301c28dcb4 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.494179 Nov 02 13:04:29.093718 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 11/20] 10.222.0.113 () {60 vars in 1297 bytes} [Wed Nov 2 13:04:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:04:31.761001 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-6996178c-e428-48c1-81e5-3437173d2b75 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:31.762555 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-6996178c-e428-48c1-81e5-3437173d2b75 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002367 Nov 02 13:04:31.763446 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 10/21] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:31 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:32.238311 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-d91cd622-f6ee-45e2-a1d1-fd6c1cf8c093 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny"}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:32.265705 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-d91cd622-f6ee-45e2-a1d1-fd6c1cf8c093 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496198 Nov 02 13:04:32.266367 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 12/22] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:04:32.281261 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-a5a165cf-e2ed-4799-a3a3-1630893dd426 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:32.310771 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-a5a165cf-e2ed-4799-a3a3-1630893dd426 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033248 Nov 02 13:04:32.311397 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 11/23] 10.222.0.113 () {64 vars in 1338 bytes} [Wed Nov 2 13:04:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:35.073395 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-d91cd622-f6ee-45e2-a1d1-fd6c1cf8c093 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:35.074348 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-d91cd622-f6ee-45e2-a1d1-fd6c1cf8c093 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001530 Nov 02 13:04:35.074764 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 13/24] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:35 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:35.502118 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-98ab0c52-c8df-4945-a48e-ef49734ea3cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:35.523158 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-98ab0c52-c8df-4945-a48e-ef49734ea3cf admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.441206 Nov 02 13:04:35.523883 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 12/25] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:04:35.536258 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-9f5fee87-3ec4-4cfa-8484-e766f804a600 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:35.561233 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-9f5fee87-3ec4-4cfa-8484-e766f804a600 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028601 Nov 02 13:04:35.561822 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 14/26] 10.222.0.113 () {64 vars in 1338 bytes} [Wed Nov 2 13:04:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:04:38.292212 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-98ab0c52-c8df-4945-a48e-ef49734ea3cf admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:38.293222 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-98ab0c52-c8df-4945-a48e-ef49734ea3cf admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001420 Nov 02 13:04:38.293632 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 13/27] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:38 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:04:38.689321 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-21788400-585c-4a95-ab46-075394a0bfe8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:38.710492 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-21788400-585c-4a95-ab46-075394a0bfe8 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.410301 Nov 02 13:04:38.711055 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 15/28] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:04:38.725042 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-96356a56-b1d3-4fe1-9747-65fa1f3b71ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:38.731383 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:38.752656 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-96356a56-b1d3-4fe1-9747-65fa1f3b71ea admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032484 Nov 02 13:04:38.753401 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 14/29] 10.222.0.113 () {64 vars in 1338 bytes} [Wed Nov 2 13:04:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:41.467379 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-21788400-585c-4a95-ab46-075394a0bfe8 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:41.468389 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-21788400-585c-4a95-ab46-075394a0bfe8 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001505 Nov 02 13:04:41.468801 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 16/30] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:41 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:41.956482 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-ed801b23-d318-4fd5-b651-5d17a7137aa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "swap": 0, "name": "m1.large"}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:41.978840 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-ed801b23-d318-4fd5-b651-5d17a7137aa7 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.501532 Nov 02 13:04:41.979528 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 15/31] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:04:41.992519 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-2a9b0bff-ea04-4442-91de-ed98cdfa4bdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:41.997888 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:42.022050 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-2a9b0bff-ea04-4442-91de-ed98cdfa4bdf admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033941 Nov 02 13:04:42.022778 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 17/32] 10.222.0.113 () {64 vars in 1338 bytes} [Wed Nov 2 13:04:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:04:44.715075 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-ed801b23-d318-4fd5-b651-5d17a7137aa7 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:44.716747 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-ed801b23-d318-4fd5-b651-5d17a7137aa7 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002117 Nov 02 13:04:44.717311 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 16/33] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:04:44 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:45.259693 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-da02d451-4e1e-49a1-a567-1635c0453c35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5"}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:45.282881 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-da02d451-4e1e-49a1-a567-1635c0453c35 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.558120 Nov 02 13:04:45.283477 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 18/34] 10.222.0.113 () {64 vars in 1288 bytes} [Wed Nov 2 13:04:44 2022] POST /compute/v2.1/flavors => generated 410 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:04:45.295786 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-1bc1160a-7c53-4e36-96c6-e1b8fed280d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:45.328414 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-1bc1160a-7c53-4e36-96c6-e1b8fed280d8 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036407 Nov 02 13:04:45.331276 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 17/35] 10.222.0.113 () {64 vars in 1338 bytes} [Wed Nov 2 13:04:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:06.688486 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-da02d451-4e1e-49a1-a567-1635c0453c35 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:06.689485 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-da02d451-4e1e-49a1-a567-1635c0453c35 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001459 Nov 02 13:05:06.689880 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 19/36] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:05:06 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:06.700994 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:07.100608 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-0810e995-df04-4014-a93e-271519710a89 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:07.121744 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-0810e995-df04-4014-a93e-271519710a89 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.425075 Nov 02 13:05:07.122202 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 18/37] 10.222.0.113 () {60 vars in 1297 bytes} [Wed Nov 2 13:05:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:08.459826 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-da02d451-4e1e-49a1-a567-1635c0453c35 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:08.460963 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-da02d451-4e1e-49a1-a567-1635c0453c35 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001689 Nov 02 13:05:08.461440 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 20/38] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:05:08 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:05:09.043349 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-f41447fe-a905-46cf-a894-80518fc538a7 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:09.048671 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.wsgi [None req-f41447fe-a905-46cf-a894-80518fc538a7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-f41447fe-a905-46cf-a894-80518fc538a7 admin admin] Request method failure captured: Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: Accept: application/json Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: Accept-Encoding: gzip, deflate Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: Connection: keep-alive Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: Content-Length: 0 Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: Host: 10.222.0.113 Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: Openstack-Api-Version: compute 2.92 Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: Openstack-System-Scope: None Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: User-Agent: python-novaclient Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Auth-Token: gAAAAABjYmsEubOd2y59Ta16LtKfSUvkIIc5xyFc4pkveAou32bf4mX0WtIiweUYHSf40lMufVh5TsdxgtPdOG8c9X8aISlxV347FB3tMcznCoiMGo-Crs2V8HX4dDwUSyz-5u7y_sK5Pa4ujGv1wpyFFVwFnxWQfIC4Su4D3ZW2fcvN1jJfK5U Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Domain-Id: None Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Domain-Name: None Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Identity-Status: Confirmed Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Is-Admin-Project: True Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Domain-Id: default Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Domain-Name: Default Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Name: admin Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Role: member,reader,admin Nov 02 13:05:09.052157 n-d-858384-19 devstack@n-api.service[105042]: X-Roles: member,reader,admin Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: X-Tenant: admin Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: X-Tenant-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: X-Tenant-Name: admin Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: X-User: admin Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: X-User-Domain-Id: default Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: X-User-Domain-Name: Default Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: X-User-Id: 5220221f89ae4ef58c72c2b93a76aa2b Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: X-User-Name: admin Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: method: > Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: exception: Flavor 42 could not be found. Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: action_args: {'id': '42'} Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:09.053965 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:09.055060 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.056569 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-f41447fe-a905-46cf-a894-80518fc538a7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:09.057912 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-f41447fe-a905-46cf-a894-80518fc538a7 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.406399 Nov 02 13:05:09.057912 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 19/39] 10.222.0.113 () {60 vars in 1195 bytes} [Wed Nov 2 13:05:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:09.063636 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-6b5ea7d2-8b30-445c-95de-8606797c2430 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:09.068027 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:09.088066 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-6b5ea7d2-8b30-445c-95de-8606797c2430 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.92 time: 0.027902 Nov 02 13:05:09.088641 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 21/40] 10.222.0.113 () {60 vars in 1215 bytes} [Wed Nov 2 13:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:09.107349 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-a3e4b5fd-0b5c-4192-b284-cf44ce139ef2 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:09.130708 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-a3e4b5fd-0b5c-4192-b284-cf44ce139ef2 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.92 time: 0.027848 Nov 02 13:05:09.131291 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 20/41] 10.222.0.113 () {60 vars in 1215 bytes} [Wed Nov 2 13:05:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:09.141142 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-c4567762-3c23-4283-bb6b-bb04df51a914 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:09.149025 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.wsgi [None req-c4567762-3c23-4283-bb6b-bb04df51a914 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-c4567762-3c23-4283-bb6b-bb04df51a914 admin admin] Request method failure captured: Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: Accept: application/json Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: Accept-Encoding: gzip, deflate Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: Connection: keep-alive Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: Content-Length: 0 Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: Host: 10.222.0.113 Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: Openstack-Api-Version: compute 2.92 Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: Openstack-System-Scope: None Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: User-Agent: python-novaclient Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Auth-Token: gAAAAABjYmsEubOd2y59Ta16LtKfSUvkIIc5xyFc4pkveAou32bf4mX0WtIiweUYHSf40lMufVh5TsdxgtPdOG8c9X8aISlxV347FB3tMcznCoiMGo-Crs2V8HX4dDwUSyz-5u7y_sK5Pa4ujGv1wpyFFVwFnxWQfIC4Su4D3ZW2fcvN1jJfK5U Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Domain-Id: None Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Domain-Name: None Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Identity-Status: Confirmed Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Is-Admin-Project: True Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Domain-Id: default Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Domain-Name: Default Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Name: admin Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Role: member,reader,admin Nov 02 13:05:09.151451 n-d-858384-19 devstack@n-api.service[105041]: X-Roles: member,reader,admin Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: X-Tenant: admin Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: X-Tenant-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: X-Tenant-Name: admin Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: X-User: admin Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: X-User-Domain-Id: default Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: X-User-Domain-Name: Default Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: X-User-Id: 5220221f89ae4ef58c72c2b93a76aa2b Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: X-User-Name: admin Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: method: > Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: exception: Flavor 42 could not be found. Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: action_args: {'id': '42'} Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:09.153810 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:09.154812 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.156253 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-c4567762-3c23-4283-bb6b-bb04df51a914 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:09.157691 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-c4567762-3c23-4283-bb6b-bb04df51a914 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015343 Nov 02 13:05:09.157691 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 22/42] 10.222.0.113 () {60 vars in 1195 bytes} [Wed Nov 2 13:05:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:10.385489 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-a3e4b5fd-0b5c-4192-b284-cf44ce139ef2 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:10.386503 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-a3e4b5fd-0b5c-4192-b284-cf44ce139ef2 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001441 Nov 02 13:05:10.386905 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 21/43] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:05:10 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:10.934938 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-835036cc-5fc2-476a-9191-dfb5b1f9c410 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:10.940085 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.wsgi [None req-835036cc-5fc2-476a-9191-dfb5b1f9c410 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-835036cc-5fc2-476a-9191-dfb5b1f9c410 admin admin] Request method failure captured: Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: Accept: application/json Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: Accept-Encoding: gzip, deflate Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: Connection: keep-alive Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: Content-Length: 0 Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: Host: 10.222.0.113 Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: Openstack-Api-Version: compute 2.92 Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: Openstack-System-Scope: None Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: User-Agent: python-novaclient Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Auth-Token: gAAAAABjYmsGWtx5LZn8icqnx4OggzjTL27UYeOiTKUPvlqLW0qCFIKLB9rtRy_Qp3CpnXHNW0344E8YjyYKx4MnCsC-P4jNXedsW90JxIHMUroL3L9bYiQXQ1toQV0ccjt0rt0G_yNYX4lj6Zn5zy20KXqEhs3n6PMmS-80hoQXwPb3OXu87ls Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Domain-Id: None Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Domain-Name: None Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Identity-Status: Confirmed Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Is-Admin-Project: True Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Domain-Id: default Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Domain-Name: Default Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Name: admin Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Role: member,reader,admin Nov 02 13:05:10.941838 n-d-858384-19 devstack@n-api.service[105041]: X-Roles: member,reader,admin Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: X-Tenant: admin Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: X-Tenant-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: X-Tenant-Name: admin Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: X-User: admin Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: X-User-Domain-Id: default Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: X-User-Domain-Name: Default Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: X-User-Id: 5220221f89ae4ef58c72c2b93a76aa2b Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: X-User-Name: admin Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: method: > Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: exception: Flavor 84 could not be found. Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: action_args: {'id': '84'} Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:10.943284 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:10.944108 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:10.945427 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-835036cc-5fc2-476a-9191-dfb5b1f9c410 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:10.946681 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-835036cc-5fc2-476a-9191-dfb5b1f9c410 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.412840 Nov 02 13:05:10.946681 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 23/44] 10.222.0.113 () {60 vars in 1195 bytes} [Wed Nov 2 13:05:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:10.952944 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-5313334b-1a94-4462-ae22-b32229d05867 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:10.967842 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-5313334b-1a94-4462-ae22-b32229d05867 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.92 time: 0.018481 Nov 02 13:05:10.968375 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 22/45] 10.222.0.113 () {60 vars in 1215 bytes} [Wed Nov 2 13:05:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:05:10.978914 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-50c17bc5-7719-4f7e-a727-7096913888d0 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:10.994889 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-50c17bc5-7719-4f7e-a727-7096913888d0 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.92 time: 0.019567 Nov 02 13:05:10.995532 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 24/46] 10.222.0.113 () {60 vars in 1215 bytes} [Wed Nov 2 13:05:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:11.005765 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-5afc463d-d3ab-4b9d-a587-f3c1eea6076e admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:11.010961 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.wsgi [None req-5afc463d-d3ab-4b9d-a587-f3c1eea6076e admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-5afc463d-d3ab-4b9d-a587-f3c1eea6076e admin admin] Request method failure captured: Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: Accept: application/json Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: Accept-Encoding: gzip, deflate Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: Connection: keep-alive Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: Content-Length: 0 Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: Host: 10.222.0.113 Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: Openstack-Api-Version: compute 2.92 Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: Openstack-System-Scope: None Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: User-Agent: python-novaclient Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Auth-Token: gAAAAABjYmsGWtx5LZn8icqnx4OggzjTL27UYeOiTKUPvlqLW0qCFIKLB9rtRy_Qp3CpnXHNW0344E8YjyYKx4MnCsC-P4jNXedsW90JxIHMUroL3L9bYiQXQ1toQV0ccjt0rt0G_yNYX4lj6Zn5zy20KXqEhs3n6PMmS-80hoQXwPb3OXu87ls Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Domain-Id: None Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Domain-Name: None Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Identity-Status: Confirmed Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Is-Admin-Project: True Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Domain-Id: default Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Domain-Name: Default Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Name: admin Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Role: member,reader,admin Nov 02 13:05:11.012539 n-d-858384-19 devstack@n-api.service[105042]: X-Roles: member,reader,admin Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: X-Tenant: admin Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: X-Tenant-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: X-Tenant-Name: admin Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: X-User: admin Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: X-User-Domain-Id: default Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: X-User-Domain-Name: Default Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: X-User-Id: 5220221f89ae4ef58c72c2b93a76aa2b Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: X-User-Name: admin Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: method: > Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: exception: Flavor 84 could not be found. Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: action_args: {'id': '84'} Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:11.014109 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:11.015397 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:11.016718 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-5afc463d-d3ab-4b9d-a587-f3c1eea6076e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:11.018098 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-5afc463d-d3ab-4b9d-a587-f3c1eea6076e admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012381 Nov 02 13:05:11.018098 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 23/47] 10.222.0.113 () {60 vars in 1195 bytes} [Wed Nov 2 13:05:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:12.235879 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-50c17bc5-7719-4f7e-a727-7096913888d0 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:12.236914 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-50c17bc5-7719-4f7e-a727-7096913888d0 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001480 Nov 02 13:05:12.237311 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 25/48] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:05:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:12.775919 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-49613d14-16fe-4f90-b335-1082190e3120 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:12.782128 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.wsgi [None req-49613d14-16fe-4f90-b335-1082190e3120 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-49613d14-16fe-4f90-b335-1082190e3120 admin admin] Request method failure captured: Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: Accept: application/json Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: Accept-Encoding: gzip, deflate Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: Connection: keep-alive Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: Content-Length: 0 Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: Host: 10.222.0.113 Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: Openstack-Api-Version: compute 2.92 Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: Openstack-System-Scope: None Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: User-Agent: python-novaclient Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Auth-Token: gAAAAABjYmsIkvYrNI_ZGNvXbgSbyJ4U3MqQnXnzGzvWnJew7GO2AgGyzttIq2B5YMr9wZ5Aexj-Gd5K4C8K71NXfGagRJoHObPVb72R4Q0moRKQwJP93XBNsxYrp2MgTfqDjf1rswHTjIzBt65_nZ3bjf2BiwQGLXyvhPehtZ1PaYTggjjyf0s Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Domain-Id: None Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Domain-Name: None Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Identity-Status: Confirmed Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Is-Admin-Project: True Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Domain-Id: default Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Domain-Name: Default Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Project-Name: admin Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Role: member,reader,admin Nov 02 13:05:12.783688 n-d-858384-19 devstack@n-api.service[105042]: X-Roles: member,reader,admin Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: X-Tenant: admin Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: X-Tenant-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: X-Tenant-Name: admin Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: X-User: admin Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: X-User-Domain-Id: default Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: X-User-Domain-Name: Default Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: X-User-Id: 5220221f89ae4ef58c72c2b93a76aa2b Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: X-User-Name: admin Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: method: > Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: exception: Flavor 451 could not be found. Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: action_args: {'id': '451'} Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:12.786208 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:12.787534 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.789201 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-49613d14-16fe-4f90-b335-1082190e3120 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105042) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:12.790453 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-49613d14-16fe-4f90-b335-1082190e3120 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.409255 Nov 02 13:05:12.790453 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 24/49] 10.222.0.113 () {60 vars in 1198 bytes} [Wed Nov 2 13:05:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:12.796795 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-4d45df8b-6967-4684-a5d7-35af812d8681 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:12.822528 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-4d45df8b-6967-4684-a5d7-35af812d8681 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.92 time: 0.029406 Nov 02 13:05:12.823091 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 26/50] 10.222.0.113 () {60 vars in 1215 bytes} [Wed Nov 2 13:05:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:12.833378 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:12.849091 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.92 time: 0.019875 Nov 02 13:05:12.849667 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 25/51] 10.222.0.113 () {60 vars in 1215 bytes} [Wed Nov 2 13:05:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:05:12.859235 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-465ca543-ea74-4f63-8707-f79c443149c2 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:12.864584 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.wsgi [None req-465ca543-ea74-4f63-8707-f79c443149c2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-465ca543-ea74-4f63-8707-f79c443149c2 admin admin] Request method failure captured: Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: Accept: application/json Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: Accept-Encoding: gzip, deflate Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: Connection: keep-alive Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: Content-Length: 0 Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: Host: 10.222.0.113 Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: Openstack-Api-Version: compute 2.92 Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: Openstack-System-Scope: None Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: User-Agent: python-novaclient Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Auth-Token: gAAAAABjYmsIkvYrNI_ZGNvXbgSbyJ4U3MqQnXnzGzvWnJew7GO2AgGyzttIq2B5YMr9wZ5Aexj-Gd5K4C8K71NXfGagRJoHObPVb72R4Q0moRKQwJP93XBNsxYrp2MgTfqDjf1rswHTjIzBt65_nZ3bjf2BiwQGLXyvhPehtZ1PaYTggjjyf0s Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Domain-Id: None Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Domain-Name: None Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Identity-Status: Confirmed Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Is-Admin-Project: True Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Domain-Id: default Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Domain-Name: Default Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Project-Name: admin Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Role: member,reader,admin Nov 02 13:05:12.866100 n-d-858384-19 devstack@n-api.service[105041]: X-Roles: member,reader,admin Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b0881ce9cd5d48939b01a71a7d64277c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: X-Tenant: admin Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: X-Tenant-Id: b0881ce9cd5d48939b01a71a7d64277c Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: X-Tenant-Name: admin Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: X-User: admin Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: X-User-Domain-Id: default Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: X-User-Domain-Name: Default Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: X-User-Id: 5220221f89ae4ef58c72c2b93a76aa2b Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: X-User-Name: admin Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: method: > Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: exception: Flavor 451 could not be found. Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: action_args: {'id': '451'} Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:12.867758 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:12.868761 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: ERROR nova.api.openstack.wsgi Nov 02 13:05:12.869896 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-465ca543-ea74-4f63-8707-f79c443149c2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:12.871817 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-465ca543-ea74-4f63-8707-f79c443149c2 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011967 Nov 02 13:05:12.871817 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 27/52] 10.222.0.113 () {60 vars in 1198 bytes} [Wed Nov 2 13:05:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:14.111859 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:14.112746 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001482 Nov 02 13:05:14.113044 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 26/53] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:05:14 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:14.664074 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-7a23ecc2-fab8-4753-a260-3f3fb2ee8e7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:14.684719 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-7a23ecc2-fab8-4753-a260-3f3fb2ee8e7b admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.92 time: 0.432633 Nov 02 13:05:14.685276 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 28/54] 10.222.0.113 () {64 vars in 1240 bytes} [Wed Nov 2 13:05:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:05:15.955381 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:15.956126 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001452 Nov 02 13:05:15.956524 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 27/55] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:05:15 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:16.544966 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-219101c0-3447-44dc-b36a-27eac5138663 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:16.571685 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-219101c0-3447-44dc-b36a-27eac5138663 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.464072 Nov 02 13:05:16.572235 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 29/56] 10.222.0.113 () {64 vars in 1240 bytes} [Wed Nov 2 13:05:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:05:17.812146 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:17.813157 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Nov 02 13:05:17.813623 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 28/57] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:05:17 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:18.362652 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-d795b419-308b-4c6f-bc9b-de211eed721a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:18.382194 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-d795b419-308b-4c6f-bc9b-de211eed721a admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.425456 Nov 02 13:05:18.382661 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 30/58] 10.222.0.113 () {64 vars in 1240 bytes} [Wed Nov 2 13:05:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:05:19.615606 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:19.616601 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001452 Nov 02 13:05:19.616989 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 29/59] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:05:19 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:20.157054 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-9daf8341-c7ff-4d8e-b7b3-d1ee05e24f31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:20.177032 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-9daf8341-c7ff-4d8e-b7b3-d1ee05e24f31 admin admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.92 time: 0.421453 Nov 02 13:05:20.177654 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 31/60] 10.222.0.113 () {64 vars in 1240 bytes} [Wed Nov 2 13:05:19 2022] POST /compute/v2.1/flavors => generated 411 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:05:21.431718 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:21.432719 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001515 Nov 02 13:05:21.433133 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 30/61] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:05:21 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:21.973037 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-cace4b20-31a1-4087-8ba4-2f6db111e650 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:21.993935 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-cace4b20-31a1-4087-8ba4-2f6db111e650 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.92 time: 0.422929 Nov 02 13:05:21.994488 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 32/62] 10.222.0.113 () {60 vars in 1207 bytes} [Wed Nov 2 13:05:21 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:06:20.843391 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:20.844413 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-3180a078-de13-46c1-bf52-c92c6b0c0020 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001562 Nov 02 13:06:20.844813 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 31/63] 10.222.0.113 () {54 vars in 936 bytes} [Wed Nov 2 13:06:20 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:06:20.856329 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:21.254228 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-a6b7ac03-671a-4bbe-9834-f7e9e3d8da9c admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:21.275327 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-a6b7ac03-671a-4bbe-9834-f7e9e3d8da9c admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.423447 Nov 02 13:06:21.275871 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 33/64] 10.222.0.113 () {60 vars in 1297 bytes} [Wed Nov 2 13:06:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:06:21.298000 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writing DB stats nova_api:SELECT=14 {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:21.301901 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-e82a3c66-d04c-4523-bacd-6f4a59ad0934 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:21.309353 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-e82a3c66-d04c-4523-bacd-6f4a59ad0934 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012722 Nov 02 13:06:21.309904 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 32/65] 10.222.0.113 () {60 vars in 1288 bytes} [Wed Nov 2 13:06:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:21.322520 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-17c7b9f4-bd50-4a72-8888-1b142efcaedd admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:21.330411 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-17c7b9f4-bd50-4a72-8888-1b142efcaedd admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010938 Nov 02 13:06:21.330949 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 34/66] 10.222.0.113 () {60 vars in 1291 bytes} [Wed Nov 2 13:06:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:21.342614 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-ed9fdcee-49fd-44c8-b2a5-e626f99c7104 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:21.350058 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-ed9fdcee-49fd-44c8-b2a5-e626f99c7104 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010987 Nov 02 13:06:21.350528 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 33/67] 10.222.0.113 () {60 vars in 1291 bytes} [Wed Nov 2 13:06:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:06:21.362314 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-3e0f1a6d-1a79-49b5-95be-b9e0da249f70 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:21.369787 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-3e0f1a6d-1a79-49b5-95be-b9e0da249f70 admin admin] 10.222.0.113 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011335 Nov 02 13:06:21.370333 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 35/68] 10.222.0.113 () {60 vars in 1288 bytes} [Wed Nov 2 13:06:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:51.626356 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-ed9fdcee-49fd-44c8-b2a5-e626f99c7104 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:51.628088 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-ed9fdcee-49fd-44c8-b2a5-e626f99c7104 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002145 Nov 02 13:11:51.628478 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 34/69] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:11:51 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:11:51.773245 n-d-858384-19 devstack@n-api.service[105041]: DEBUG dbcounter [-] [105041] Writing DB stats nova_api:SELECT=6 {{(pid=105041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:51.917525 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-63483c9e-6c3e-407f-a03f-3cc088abab1e admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:51.922263 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-63483c9e-6c3e-407f-a03f-3cc088abab1e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:51.922744 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-63483c9e-6c3e-407f-a03f-3cc088abab1e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:51.923266 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-63483c9e-6c3e-407f-a03f-3cc088abab1e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:51.925316 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-63483c9e-6c3e-407f-a03f-3cc088abab1e admin admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:51.925773 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-63483c9e-6c3e-407f-a03f-3cc088abab1e admin admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:51.926197 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-63483c9e-6c3e-407f-a03f-3cc088abab1e admin admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:51.965742 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-63483c9e-6c3e-407f-a03f-3cc088abab1e admin admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.193671 Nov 02 13:11:51.966310 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 36/70] 10.222.0.113 () {60 vars in 1198 bytes} [Wed Nov 2 13:11:51 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:11:53.049869 n-d-858384-19 devstack@n-api.service[105042]: DEBUG nova.api.openstack.wsgi [None req-ed9fdcee-49fd-44c8-b2a5-e626f99c7104 admin admin] Calling method '>' {{(pid=105042) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:53.051226 n-d-858384-19 devstack@n-api.service[105042]: INFO nova.api.openstack.requestlog [None req-ed9fdcee-49fd-44c8-b2a5-e626f99c7104 admin admin] 10.222.0.113 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002419 Nov 02 13:11:53.051641 n-d-858384-19 devstack@n-api.service[105042]: [pid: 105042|app: 0|req: 35/71] 10.222.0.113 () {56 vars in 1079 bytes} [Wed Nov 2 13:11:53 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:11:53.246341 n-d-858384-19 devstack@n-api.service[105041]: DEBUG nova.api.openstack.wsgi [None req-c85b69e9-a01c-4f24-a3f5-df9ad9132283 admin admin] Calling method '>' {{(pid=105041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:53.250122 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-c85b69e9-a01c-4f24-a3f5-df9ad9132283 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:53.250599 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-c85b69e9-a01c-4f24-a3f5-df9ad9132283 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:53.251026 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-c85b69e9-a01c-4f24-a3f5-df9ad9132283 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:53.252305 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-c85b69e9-a01c-4f24-a3f5-df9ad9132283 admin admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:53.252751 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-c85b69e9-a01c-4f24-a3f5-df9ad9132283 admin admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:53.253171 n-d-858384-19 devstack@n-api.service[105041]: DEBUG oslo_concurrency.lockutils [None req-c85b69e9-a01c-4f24-a3f5-df9ad9132283 admin admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:53.276401 n-d-858384-19 devstack@n-api.service[105041]: INFO nova.api.openstack.requestlog [None req-c85b69e9-a01c-4f24-a3f5-df9ad9132283 admin admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.084781 Nov 02 13:11:53.276970 n-d-858384-19 devstack@n-api.service[105041]: [pid: 105041|app: 0|req: 37/72] 10.222.0.113 () {60 vars in 1198 bytes} [Wed Nov 2 13:11:53 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:12:41.577192 n-d-858384-19 devstack@n-api.service[105040]: Wed Nov 2 13:12:41 2022 - graceful shutdown triggered... Nov 02 13:12:41.577751 n-d-858384-19 devstack@n-api.service[105042]: Gracefully killing worker 2 (pid: 105042)... Nov 02 13:12:41.578290 n-d-858384-19 devstack@n-api.service[105041]: Gracefully killing worker 1 (pid: 105041)... Nov 02 13:12:41.580160 n-d-858384-19 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 13:12:41.705306 n-d-858384-19 devstack@n-api.service[105042]: DEBUG dbcounter [-] [105042] Writing DB stats nova_api:SELECT=4 {{(pid=105042) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:42.578338 n-d-858384-19 devstack@n-api.service[105040]: worker 1 buried after 1 seconds Nov 02 13:12:42.579089 n-d-858384-19 devstack@n-api.service[105040]: worker 2 buried after 1 seconds Nov 02 13:12:42.579089 n-d-858384-19 devstack@n-api.service[105040]: goodbye to uWSGI. Nov 02 13:12:42.580413 n-d-858384-19 systemd[1]: devstack@n-api.service: Succeeded. Nov 02 13:12:42.581007 n-d-858384-19 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 13:12:42.583943 n-d-858384-19 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 13:12:42.602160 n-d-858384-19 devstack@n-api.service[120913]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 13:12:42 2022] *** Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: nodename: n-d-858384-19 Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: machine: x86_64 Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: clock source: unix Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: pcre jit disabled Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: detected number of CPU cores: 4 Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: current working directory: / Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: detected binary path: /usr/bin/uwsgi-core Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: your processes number limit is 47680 Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: your memory page size is 4096 bytes Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: detected max file descriptor number: 2048 Nov 02 13:12:42.630742 n-d-858384-19 devstack@n-api.service[120913]: lock engine: pthread robust mutexes Nov 02 13:12:42.632207 n-d-858384-19 devstack@n-api.service[120913]: thunder lock: enabled Nov 02 13:12:42.632207 n-d-858384-19 devstack@n-api.service[120913]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 13:12:42.632207 n-d-858384-19 devstack@n-api.service[120913]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 13:12:42.673269 n-d-858384-19 devstack@n-api.service[120913]: Python main interpreter initialized at 0x5560f10869c0 Nov 02 13:12:42.673269 n-d-858384-19 devstack@n-api.service[120913]: python threads support enabled Nov 02 13:12:42.673269 n-d-858384-19 devstack@n-api.service[120913]: your server socket listen backlog is limited to 100 connections Nov 02 13:12:42.673269 n-d-858384-19 devstack@n-api.service[120913]: your mercy for graceful operations on workers is 90 seconds Nov 02 13:12:42.673728 n-d-858384-19 devstack@n-api.service[120913]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 13:12:42.673728 n-d-858384-19 devstack@n-api.service[120913]: *** Operational MODE: preforking *** Nov 02 13:12:42.673972 n-d-858384-19 devstack@n-api.service[120913]: *** uWSGI is running in multiple interpreter mode *** Nov 02 13:12:42.673972 n-d-858384-19 devstack@n-api.service[120913]: spawned uWSGI master process (pid: 120913) Nov 02 13:12:42.674188 n-d-858384-19 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 13:12:42.674754 n-d-858384-19 devstack@n-api.service[120913]: spawned uWSGI worker 1 (pid: 120928, cores: 1) Nov 02 13:12:42.675308 n-d-858384-19 devstack@n-api.service[120913]: spawned uWSGI worker 2 (pid: 120929, cores: 1) Nov 02 13:12:42.675678 n-d-858384-19 devstack@n-api.service[120913]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 13:12:43.338187 n-d-858384-19 devstack@n-api.service[120928]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 13:12:43.342636 n-d-858384-19 devstack@n-api.service[120929]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 13:12:44.583705 n-d-858384-19 devstack@n-api.service[120928]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:12:44.583705 n-d-858384-19 devstack@n-api.service[120928]: from cryptography.utils import int_from_bytes Nov 02 13:12:44.584317 n-d-858384-19 devstack@n-api.service[120928]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:12:44.584317 n-d-858384-19 devstack@n-api.service[120928]: from cryptography.utils import int_from_bytes Nov 02 13:12:44.597498 n-d-858384-19 devstack@n-api.service[120929]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:12:44.597498 n-d-858384-19 devstack@n-api.service[120929]: from cryptography.utils import int_from_bytes Nov 02 13:12:44.598028 n-d-858384-19 devstack@n-api.service[120929]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 13:12:44.598028 n-d-858384-19 devstack@n-api.service[120929]: from cryptography.utils import int_from_bytes Nov 02 13:12:47.025570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 13:12:47.026142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 13:12:47.026344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 13:12:47.026715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 13:12:47.026955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 13:12:47.027377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.027697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.028022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.028337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.028666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.028975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.029291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.029607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.029953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.030197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.030502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.030826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-19 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.031717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.032143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.032535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.032915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.033224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.033548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.033855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.034351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.034791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.035104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.035585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.035784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.036098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.036406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.036725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.037036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.037361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.037671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.038067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-19 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.038383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.038694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.039003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.039441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.039754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.040064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.040384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.040717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.041027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.041348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.041666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.041977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.042302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.042605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.042912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.043241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.043560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.043865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.044169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.044420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.044726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.045044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.045363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.045687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.045939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.046191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.046506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.047460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.048065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.048065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.048379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.048687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.048992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.049297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.050031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.050031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.050215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.050507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.050836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.051142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.051462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.051852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.113 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.052099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.113 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.052408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.052748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.053066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.053373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.053690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.054008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.054327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.054621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.054927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.055709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.055709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.056488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.056488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.056488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.056697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.057016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.057325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.057634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.057942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.058255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.058540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.058913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.059159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.059451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 13:12:47.060269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.060424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 13:12:47.060900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.060900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.061239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 13:12:47.061398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.061574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 13:12:47.061753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.061916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 13:12:47.062106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.062264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.062476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.063260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.063453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.063621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.063821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.063971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.064129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.064129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.064419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.064580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.064758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.064758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.065053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.065053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.065385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.065534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.065700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.065885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.066067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.066243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.066401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.066556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.066716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-19 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.066864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.067039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.067309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.067534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.068109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.068272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.068442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.068442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.068745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.068894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.069041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.069187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.069374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.070470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.070656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.070810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.070810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.071106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.071328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.071478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.071967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.072129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.072279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.072433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.072618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.072786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.072942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.072942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.073230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.073384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.074761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.074934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.075093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.075280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.075439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.075589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.075736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.075893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.076048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.076208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.076371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-19 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.076523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.076686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.076879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.077030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.077185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.077342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.077566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.077740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.077931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.078119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.078839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.079041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.079812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.079986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.080151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.080310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.080461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.080616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.080782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.080782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.081159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.081314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.081471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.081630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.081817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.081968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.082114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.082279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.082433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.082600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.082747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.082902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.083056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.083240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.083424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.083593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.083742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.083889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.084043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.084043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.084339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.084504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.084653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.084653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.084930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.085123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.085288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.085436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.085583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.085735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.085888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.086055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.086247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.086411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.086559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.086715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.086883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.087046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.087295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.087448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.087850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.088012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.088168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.088449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.088613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.088763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.088908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.089054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.089200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.089386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.089801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.089968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.090118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.090265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.090453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.090619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.090786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.090943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.090943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.093492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.094327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.094900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.095080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.095322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.095485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.095643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.113 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.095802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.095968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.113 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.096118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.096276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.096423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.096571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.096728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.096875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.097021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.097169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.097361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.097849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.098032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.098191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.098339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.098494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.098664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.098813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.098971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.099155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.099321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.099469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.099635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.100047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.100207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.100356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.100504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.100650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.100804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.100972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.101120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.101274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.101454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.101606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.101752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.101908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.102055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.102209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.102364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.102518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.102672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.102847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.103002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.103184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.103347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.103503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.103660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.103808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.103956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.104118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.104274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.104430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.104578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.104732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.104898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.105056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.105204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.105357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.105539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.105701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.105860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.106016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.106171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.106325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.106474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.106635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.106783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.106940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.107094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.107276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.107434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.107831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.107992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.108140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.108296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.108453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.108608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.108763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.108916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.109072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.109271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.110681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.110926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.111094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.111322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.111484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.111640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.111798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.111956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.112104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.112252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.112414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.112575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.112730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.112878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.113033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.113180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.113342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.113491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.113637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.113783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.113932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.114115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.114282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.114431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.114596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.114751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.114899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.115057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.115241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.115391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.115391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.115671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.115671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.115959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.116116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.116263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.116410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.116567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.116567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.116859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.117013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.117170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.117317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.117465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.117625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.117786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.117934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.118088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.118235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.118389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 13:12:47.118556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.118704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.118860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.119007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.119212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.119366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.119524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.119680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.119827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.119981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.120129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.120373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.120644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.120878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.121039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.121195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.121345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.121506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.121664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.121812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.121959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.122106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.122303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.122461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.122861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.123029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.123215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.123368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.123526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.123689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.123844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.123991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.124146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.124293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.124441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.125134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.125312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.125554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.125805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.125965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.126114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.126332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.126558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.126771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.126987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.127233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.127406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.127570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.127725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.127917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.128164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.128374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.128613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.128831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.128995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.129152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.129314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.129469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.129632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.129787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.129941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.130089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.130273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.130529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.130699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.130869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.131101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.131293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.131450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.131450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.131753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.131910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.132065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.132065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.132343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.132343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.132646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.132803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.132958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.133105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.133252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.133412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.133800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.133965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.134114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.134270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.134424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.134585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.134781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.134955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.135104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.135315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.135463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.135626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.135780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.135935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.136090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.136247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.136408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.136557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.136703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.136849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.137007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.137154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.137310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.137476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.137634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.137788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.137935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.138083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.138238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.138419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.138566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.138713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.138877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.139025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.139212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.139374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.139522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.139677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.139823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.139983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.140133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.140286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.140458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.140458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.141389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.141574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.141731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.141731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.142890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.143784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.143949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.144098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.144244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.144402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.144550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.144712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.144868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.145020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.145183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.145347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.145510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.145664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.145828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.145989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.146142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.146310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.146501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.146666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.146828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.146981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.147157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.147338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.147495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.147659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.147825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.147978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.148142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.148304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.148458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.148612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.148772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.148933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.149101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.149255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.149255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.149548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.149708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.149872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.150039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.150193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.150353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.150523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.150679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.150833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.150996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.151200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.151381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.151691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.151865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.152028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.152199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.152353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.152507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.152675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.152830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.152991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.153152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.153313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.153474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.153983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.154152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.154308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.154462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.154626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.154799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.154963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.155156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.155325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.155481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.155710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.155906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.156070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.156759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.156924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.157586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.157765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.157932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.158096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.158265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.158423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.158577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.158731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.158894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.159050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.159345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.159511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.159666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.159830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.159996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.160158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.160320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.160481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.160635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.160803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.160803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.161106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.161106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.161437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.161437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.161774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.161774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.162078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.162234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.162387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.162574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.162741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.162908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.163070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.163253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.163418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.163418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.163722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.163881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.164034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.164198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.164353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.164515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.164676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.164839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.164992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.165153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.165314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.165477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.165631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.165784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.165938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.166108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.166268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.166436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.166596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.166750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.166902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.167055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.167270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.167436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.167590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.167743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.167903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.168918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.169937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.170972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.171065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.171211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.171316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.171462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.171612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.171851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.172009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.172670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.172790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.172880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.172880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.173981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.174953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.175903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.176983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.177092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.177168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.177252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.177337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.177427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.178973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.179975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.180962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.181964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.182947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.183970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.184926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.185982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.186954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.187146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.187416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.187563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.187725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.188256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.188407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.188555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.188701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.188792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.188873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.188959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.189043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.189133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.189306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.189518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.189613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.189698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.189783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.189876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.189972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.190999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.191973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.192956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.193938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.194958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.195934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.196997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.197905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.198012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.198391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.198494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.198581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.198680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.198806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.198937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.199027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.199134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.199233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.199329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.199417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.199601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.199698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.199931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.200033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.200246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.200355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.200568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.200661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.200891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.201000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.201218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.201317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.201544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.201643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.201853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.201956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.202167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.202267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.202485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.202579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.202797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.202913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.203161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.203303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.203490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.203621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.203807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.203914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.204143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.204245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.204400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.204512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.204711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.204806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.205015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.205107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.205321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.205426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.205626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.205729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.205933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.206034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.206235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.206329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.206538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.206638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.206841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.206942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.207191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.207289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.207497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.207599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.207813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.207904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.208121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.208228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.208583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.208726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.208861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.208960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.209057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.209144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.209335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.209441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.209641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.209748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.209950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.210050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.210264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.210357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.210574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.210684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.210884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.210978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.211221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.211331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.211540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.211644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.211848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.211941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.212159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.212251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.212467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.212570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.212778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.212874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.213088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.213189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.213405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.213719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.213810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.214036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.214136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.214404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.214573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.214725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.214905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.215050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.215245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.215391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.215561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.215715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.215870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.216040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.216186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.216357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.216497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.216784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.216891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.217105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.217207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.217413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.217517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.217724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.217823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.218031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.218194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.218344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.219271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.219370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.219446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.219537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.219613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.219890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.219983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.220206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.220299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.220518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.220629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.220830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.220924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.221149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.221249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.221479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.221627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.221783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.221903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.222096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.222222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.222409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.222535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.222721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.222959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.223062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.223312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.223423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.223632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.223735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.223953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.224047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.224266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.224375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.224576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.224677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.224887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.224981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.225199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.225306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.225519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.225648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.225850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.225968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.226168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.226276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.226480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.226585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.226792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.226897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.227100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.227236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.227452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.227638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.227780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.227956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.228086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.228290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.228413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.228717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.228835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.228924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.229146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.229265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.229465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.229579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.229793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.229897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.230126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.230227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.230439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.230548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.230750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.230856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.231058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.231182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.231399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.231510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.231710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.231814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.232022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.232117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.232326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.232431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.232642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.232744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.232948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.233041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.233268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.233470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.233580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.233876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.233995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.234132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.234236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.235075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.235273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.235423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.235644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.235779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.235979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.236088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.236315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.236419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.236633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.236734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.236939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.237044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.237253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.237349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.237564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.237665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.237871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.237980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.238174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.238275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.238484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.238576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.238831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.238949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.239087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.239261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.239428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.239549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.239733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.239854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.240055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.240150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.240360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.240453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.240662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.240771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.240964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.241066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.241273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.241367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.241575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.241677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.241877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.241979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.242181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.242309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.242482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.242622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.242790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.242940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.243090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.243282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.243423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.243595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.243728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.243908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.244039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.244220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.244394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.244535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.244703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.244844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.245006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.245154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.245327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.245465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.245632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.245789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.245936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.246093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.246251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.246422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.246561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.246739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.246882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.247051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.247232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.247388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.247794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.247955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.248150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.248305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.248465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.248617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.248955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.249068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.249272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.249425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.249602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.249688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.249981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.250097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.250314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.250485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.250624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.250820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.250913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.251167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.251285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.251496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.251599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.251823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.251968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.252146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.252282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.252456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.252599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.252766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.252869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.253075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.253171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.253384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.253478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.253693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.253934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.254043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.254272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.254367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.254591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.254683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.254897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.255004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.255251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.255360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.255576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.255678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.255889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.255986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.256199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.256293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.256513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.256614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.256831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.256933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.257145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.257275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.257458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.257589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.257780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.257885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.258569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.258684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.258781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.258867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.258962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.259053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.259159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.259250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.259355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.259456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.259631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.259766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.259949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.260049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.260256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.260365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.260641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.260735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.260961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.261064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.261277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.261378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.261592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.261684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.261899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.262013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.262214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.262377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.262531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.262678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.262842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.262944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.263176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.263276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.263487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.263579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.263802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.263913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.264120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.264214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.264448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.264540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.264770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.264873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.265273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.265388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.265465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.265573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.265708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.265806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.266017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.266101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.266333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.266642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.266744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.266947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.267043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.267271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.267368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.267585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.267735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.267889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.268116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.268263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.268364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.268478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.268582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.268780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.268881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.269087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.269218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.269386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.269490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.269693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.269825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.270070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.270189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.270288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.270376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.270584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.270685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.270885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.270980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.271215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.271332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.271518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.271613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.271820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.271915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.272123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.272424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.272518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.272725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.272819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.273052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.273156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.273383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.273495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.273696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.273905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.274094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.274182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.274328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.274438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.274636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.274731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.274943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.275046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.275292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.275401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.275612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.275706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.275926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.276021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.276234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.276367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.276544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.276645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.276860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.276956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.277168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.277261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.277477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.277585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.277785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.277879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.278091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.278186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.278396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.278509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.278721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.278814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.279030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.279180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.279360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.279535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.279676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.279795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.279988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.280085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.280297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.280403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.280614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.280777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.280916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.281010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.281771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.281883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.282090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.282263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.282427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.282562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.282688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.282785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.283000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.283094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.283336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.283435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.283653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.283748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.283962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.284055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.284272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.284381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.284589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.284683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.284900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.285000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.285222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.285325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.285541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.285634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.285852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.285945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.286172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.286278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.286493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.286598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.286835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.286935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.287180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.287307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.287567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.287729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.287894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.288067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.288213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.288393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.288524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.288733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.288834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.289058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 13:12:47.289160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.289373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.289685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.289998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.290328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.290644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.290964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.291304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.291622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.291938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.292253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.292575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.292892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.293209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.293526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.293842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.294157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.294472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.294784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.295102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.295471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.295799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.296124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.297269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.297269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.297269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.297670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.297792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.298113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.298441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.298780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.299103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.299438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.299866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.300188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.300515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.300846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.301163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.301491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.301819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.302138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.302470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.302787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.303158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.303489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.303824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.304152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.304464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.304777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.305088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.305403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.305728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.306045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.306354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.306662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.306977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.307312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.307623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.307933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.308241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.308554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.308862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.309171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.309481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.309790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.310099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.310407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.310721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.311028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.311364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.311675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.311986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.312300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.313177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.313835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.314015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.314352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.314674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.315004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.315347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.315678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.316008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.316333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.316651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.316994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.317312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.317630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.317949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.318266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.318584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.318902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.319260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.319601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.319909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.320247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.320570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.320900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.321224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.321542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.321876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.322195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.322518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.322834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.323175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.323496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.323818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.324136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.324453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.324777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.325098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.325430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.325761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.326078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.326409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.326743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.327096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.327437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.327787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.328704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.329189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.329490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.329801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 13:12:47.330056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 13:12:47.351645 n-d-858384-19 devstack@n-api.service[120928]: INFO dbcounter [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Registered counter for database nova_api Nov 02 13:12:47.372087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_db.sqlalchemy.engines [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:12:47.379696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writer thread running {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:12:47.394737 n-d-858384-19 devstack@n-api.service[120929]: INFO dbcounter [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Registered counter for database nova_api Nov 02 13:12:47.415257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_db.sqlalchemy.engines [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:12:47.423686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writer thread running {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:12:47.435900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.context [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) {{(pid=120928) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 13:12:47.440960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:47.441429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:47.443020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:47.443771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:47.444222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:47.446211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:47.448244 n-d-858384-19 devstack@n-api.service[120928]: INFO dbcounter [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Registered counter for database nova_cell0 Nov 02 13:12:47.452438 n-d-858384-19 devstack@n-api.service[120928]: INFO dbcounter [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Registered counter for database nova_cell1 Nov 02 13:12:47.460044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_db.sqlalchemy.engines [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:12:47.461421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_db.sqlalchemy.engines [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:12:47.468061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writer thread running {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:12:47.469410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writer thread running {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:12:47.481849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.context [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) {{(pid=120929) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 13:12:47.486461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:47.486939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:47.488573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:47.489311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:47.489772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:47.491812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:47.493883 n-d-858384-19 devstack@n-api.service[120929]: INFO dbcounter [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Registered counter for database nova_cell0 Nov 02 13:12:47.498384 n-d-858384-19 devstack@n-api.service[120929]: INFO dbcounter [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Registered counter for database nova_cell1 Nov 02 13:12:47.506672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_db.sqlalchemy.engines [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:12:47.510397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_db.sqlalchemy.engines [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:12:47.517021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writer thread running {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:12:47.519678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writer thread running {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:12:47.617925 n-d-858384-19 devstack@n-api.service[120928]: INFO dbcounter [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Registered counter for database nova_cell0 Nov 02 13:12:47.626132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_db.sqlalchemy.engines [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:12:47.630935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writer thread running {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:12:47.669817 n-d-858384-19 devstack@n-api.service[120929]: INFO dbcounter [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Registered counter for database nova_cell0 Nov 02 13:12:47.677088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_db.sqlalchemy.engines [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 13:12:47.681936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writer thread running {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 13:12:47.950785 n-d-858384-19 devstack@n-api.service[120928]: WARNING keystonemiddleware.auth_token [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:12:47.958873 n-d-858384-19 devstack@n-api.service[120928]: WARNING keystonemiddleware.auth_token [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:12:48.007590 n-d-858384-19 devstack@n-api.service[120929]: WARNING keystonemiddleware.auth_token [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:12:48.014910 n-d-858384-19 devstack@n-api.service[120929]: WARNING keystonemiddleware.auth_token [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:12:48.308728 n-d-858384-19 devstack@n-api.service[120928]: WARNING keystonemiddleware.auth_token [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:12:48.314981 n-d-858384-19 devstack@n-api.service[120928]: WARNING keystonemiddleware.auth_token [None req-4e498956-12cb-43d2-9970-8c71a3f288dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:12:48.320295 n-d-858384-19 devstack@n-api.service[120928]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560f10869c0 pid: 120928 (default app) Nov 02 13:12:48.362901 n-d-858384-19 devstack@n-api.service[120929]: WARNING keystonemiddleware.auth_token [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 13:12:48.368921 n-d-858384-19 devstack@n-api.service[120929]: WARNING keystonemiddleware.auth_token [None req-652b5a28-7384-4a3f-9fbf-aaad64a72bfe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 13:12:48.374517 n-d-858384-19 devstack@n-api.service[120929]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560f10869c0 pid: 120929 (default app) Nov 02 13:13:29.441789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:29.442636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:29.443428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:29.444334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:30.394841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:30.396405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:30.397385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:30.398458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:30.799098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '.version_select at 0x7fe78d203f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:30.806085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) {{(pid=120928) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 13:13:30.806823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:30.807376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:30.807812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:30.847012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:30.847777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:30.848217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:30.863585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:30.864072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:30.864513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:30.871614 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e6e0434-2f44-49d5-8c4a-d5f084fa673a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.436919 Nov 02 13:13:30.875323 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1/1] 10.222.0.113 () {58 vars in 1172 bytes} [Wed Nov 2 13:13:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:31.199956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Calling method '.version_select at 0x7fe78d14a280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:31.201999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.202466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.203046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.216607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.217713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.218070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.228519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.229006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.229424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.236532 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3140ef6-fcba-4381-920f-2e3474acbeac tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.359971 Nov 02 13:13:31.237105 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2/2] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:31.243154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce71a81b-9249-4584-af1a-636ea46db2d0 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2146988503", "name": "tempest-test_aggregate-906960048"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:31.284453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-ce71a81b-9249-4584-af1a-636ea46db2d0 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Generated uuid 56019c00-3f24-449b-98de-2ebabf294b24 for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:13:31.358542 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce71a81b-9249-4584-af1a-636ea46db2d0 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.119406 Nov 02 13:13:31.359533 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3/3] 10.222.0.113 () {60 vars in 1170 bytes} [Wed Nov 2 13:13:31 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:31.483493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac394111-3a7e-4715-9611-c569f03508f1 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:31.485184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac394111-3a7e-4715-9611-c569f03508f1 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.485676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac394111-3a7e-4715-9611-c569f03508f1 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.486117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac394111-3a7e-4715-9611-c569f03508f1 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.487002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac394111-3a7e-4715-9611-c569f03508f1 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.487767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac394111-3a7e-4715-9611-c569f03508f1 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.488348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac394111-3a7e-4715-9611-c569f03508f1 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.536191 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ac394111-3a7e-4715-9611-c569f03508f1 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] 10.222.0.113 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.175059 Nov 02 13:13:31.537214 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4/4] 10.222.0.113 () {58 vars in 1169 bytes} [Wed Nov 2 13:13:31 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:13:31.670933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Calling method '.version_select at 0x7fe78d124f70>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:31.680799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) {{(pid=120929) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 13:13:31.681749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.682227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.682658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.709912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.710713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.710809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.724945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.725485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.725926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.729226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15c5c4d3-5576-4ac6-a5ee-301ffd12a034 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:31.732215 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-54b50358-aef2-4d79-b9d2-5bda54a9c762 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.343065 Nov 02 13:13:31.733124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15c5c4d3-5576-4ac6-a5ee-301ffd12a034 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.739198 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1/5] 10.222.0.113 () {60 vars in 1213 bytes} [Wed Nov 2 13:13:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:13:31.739333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15c5c4d3-5576-4ac6-a5ee-301ffd12a034 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.739333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15c5c4d3-5576-4ac6-a5ee-301ffd12a034 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.739333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15c5c4d3-5576-4ac6-a5ee-301ffd12a034 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.739573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15c5c4d3-5576-4ac6-a5ee-301ffd12a034 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.739573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15c5c4d3-5576-4ac6-a5ee-301ffd12a034 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.761217 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15c5c4d3-5576-4ac6-a5ee-301ffd12a034 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.222847 Nov 02 13:13:31.761818 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 5/6] 10.222.0.113 () {58 vars in 1181 bytes} [Wed Nov 2 13:13:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:31.767662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Calling method '.version_select at 0x7fe78cf7b3a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:31.770344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.770839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.771320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.790645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.791141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.791594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.833008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.833664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.834112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.840151 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-04d61712-d5e8-4a09-bc26-a075848c0ef5 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/n-h2-858384-19/servers" status: 200 len: 105 microversion: 2.1 time: 0.077180 Nov 02 13:13:31.840706 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 6/7] 10.222.0.113 () {58 vars in 1220 bytes} [Wed Nov 2 13:13:31 2022] GET /compute/v2.1/os-hypervisors/n-h2-858384-19/servers => generated 105 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:31.892753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f391156d-e681-4fbc-9cdf-87edd8435419 tempest-AZAdminNegativeTestJSON-608808015 tempest-AZAdminNegativeTestJSON-608808015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:31.894332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f391156d-e681-4fbc-9cdf-87edd8435419 tempest-AZAdminNegativeTestJSON-608808015 tempest-AZAdminNegativeTestJSON-608808015-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'd449cbbd4767488bb98d417b7c62ceef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707268c978014475b87f30b04be276c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f391156d-e681-4fbc-9cdf-87edd8435419 tempest-AZAdminNegativeTestJSON-608808015 tempest-AZAdminNegativeTestJSON-608808015-project] Request method failure captured: Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYmz4uSBpMd6YTrqeVz5DAgmHmBZ6gx3R0NIbQt1X-z0At_TqjUHfstCXL5TWc-og9GgkG5Akbmi1-ErovvZqxNGh5zeDNmvQZM_76kQXHHS3sfLPMeb4U31moAsTcYvNyHnu9ziVJ3G4wZ5dIRoMSnKGmLcWPDirFCIr3vKRZKFDEtE Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 707268c978014475b87f30b04be276c9 Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AZAdminNegativeTestJSON-608808015 Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:13:31.897990 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/707268c978014475b87f30b04be276c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/707268c978014475b87f30b04be276c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_707268c978014475b87f30b04be276c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/707268c978014475b87f30b04be276c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AZAdminNegativeTestJSON-608808015 Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 707268c978014475b87f30b04be276c9 Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-608808015 Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AZAdminNegativeTestJSON-608808015-project Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: d449cbbd4767488bb98d417b7c62ceef Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AZAdminNegativeTestJSON-608808015-project Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 13:13:31.899282 n-d-858384-19 devstack@n-api.service[120929]: action_args: {} Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:13:31.900004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:31.901050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f391156d-e681-4fbc-9cdf-87edd8435419 tempest-AZAdminNegativeTestJSON-608808015 tempest-AZAdminNegativeTestJSON-608808015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:31.901979 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f391156d-e681-4fbc-9cdf-87edd8435419 tempest-AZAdminNegativeTestJSON-608808015 tempest-AZAdminNegativeTestJSON-608808015-project] 10.222.0.113 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.164732 Nov 02 13:13:31.903610 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2/8] 10.222.0.113 () {58 vars in 1190 bytes} [Wed Nov 2 13:13:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:13:31.908931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8cfbf730-3bec-422d-af16-9136cf861c24 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:31.925958 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8cfbf730-3bec-422d-af16-9136cf861c24 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.020837 Nov 02 13:13:31.927072 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3/9] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:13:31 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:31.932427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2cd6e119-8370-4bf9-99ce-0a2ef14971d4 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:31.937083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cd6e119-8370-4bf9-99ce-0a2ef14971d4 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.937861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cd6e119-8370-4bf9-99ce-0a2ef14971d4 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.938558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cd6e119-8370-4bf9-99ce-0a2ef14971d4 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.939643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cd6e119-8370-4bf9-99ce-0a2ef14971d4 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.940298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cd6e119-8370-4bf9-99ce-0a2ef14971d4 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.941214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cd6e119-8370-4bf9-99ce-0a2ef14971d4 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:31.984619 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2cd6e119-8370-4bf9-99ce-0a2ef14971d4 tempest-AZAdminV2TestJSON-1725038654 tempest-AZAdminV2TestJSON-1725038654-project-admin] 10.222.0.113 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.056068 Nov 02 13:13:31.985530 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4/10] 10.222.0.113 () {58 vars in 1190 bytes} [Wed Nov 2 13:13:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:31.990156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Calling method '.version_select at 0x7fe78cf8fa60>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:31.992124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:31.992704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:31.993381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:32.013183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:32.014206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:32.015357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:32.028130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:32.029017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:32.029981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:32.037126 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-29e6fb09-8f4e-45a7-a689-4e9fa1575eeb tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.050364 Nov 02 13:13:32.037903 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 5/11] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:32.048008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38ab67d8-44a0-4cb4-ac96-baeceebca158 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:32.080439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38ab67d8-44a0-4cb4-ac96-baeceebca158 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:32.080923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38ab67d8-44a0-4cb4-ac96-baeceebca158 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:32.081394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38ab67d8-44a0-4cb4-ac96-baeceebca158 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:32.108586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-843331483", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:32.874847 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38ab67d8-44a0-4cb4-ac96-baeceebca158 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.835208 Nov 02 13:13:32.875613 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 6/12] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:13:32 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:32.878207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:13:32.883166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-751aa6d2-882d-4391-b69d-b748bd575772 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Calling method '.version_select at 0x7fe78c69fee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:32.886487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-751aa6d2-882d-4391-b69d-b748bd575772 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:32.887192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-751aa6d2-882d-4391-b69d-b748bd575772 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:32.889394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-751aa6d2-882d-4391-b69d-b748bd575772 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:32.918893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-751aa6d2-882d-4391-b69d-b748bd575772 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:32.921977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-751aa6d2-882d-4391-b69d-b748bd575772 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:32.922871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-751aa6d2-882d-4391-b69d-b748bd575772 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:32.932238 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-751aa6d2-882d-4391-b69d-b748bd575772 tempest-HypervisorAdminUnderV252Test-1774208847 tempest-HypervisorAdminUnderV252Test-1774208847-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/n-h2-858384-19/search" status: 200 len: 105 microversion: 2.1 time: 0.054754 Nov 02 13:13:32.933432 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 7/13] 10.222.0.113 () {58 vars in 1217 bytes} [Wed Nov 2 13:13:32 2022] GET /compute/v2.1/os-hypervisors/n-h2-858384-19/search => generated 105 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:33.230909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:13:33.231479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:13:33.232072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:13:33.232758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:13:33.233529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:13:33.253081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:33.253683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:33.254230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:33.255088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:33.257118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:33.258564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:33.311385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Getting quotas for project da2ee1225f444a6b9aa4b072f71b72ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:13:33.322385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Getting quotas for user 908d4af5549b42d983c53229ad84e588 and project da2ee1225f444a6b9aa4b072f71b72ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:13:33.342796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:13:33.347503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:13:33.387676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f86c2045-2891-4551-a42f-ff8ad9e75d84 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-881436995", "id": 350500439, "os-flavor-access:is_public": "False"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:33.412813 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b4c2824-d570-4012-8b98-7d8d131d5357 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.570797 Nov 02 13:13:33.413814 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 7/14] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:31 2022] POST /compute/v2.1/servers => generated 382 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:13:33.473734 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f86c2045-2891-4551-a42f-ff8ad9e75d84 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.454593 Nov 02 13:13:33.474983 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 8/15] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:33 2022] POST /compute/v2.1/flavors => generated 429 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:33.480081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9885296e-91ac-4f83-8b7a-88b96a31c92e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:33.480812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9885296e-91ac-4f83-8b7a-88b96a31c92e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:33.880214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1329469574", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "availability_zone": "tempest-test_az-2146988503"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:33.896129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:33.896735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:33.897370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:33.898598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:33.899341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:33.900021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:33.983019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:13:34.339275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:13:34.339984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:13:34.340794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:13:34.341407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:13:34.342001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:13:34.357721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:34.358523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:34.359689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:34.361675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:34.363129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:34.366822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:34.389568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Getting quotas for project 060da8c8e0ef485bac2056ad1de33e97. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:13:34.394496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Getting quotas for user 3f05bd7be4364470b47f8de48a29636a and project 060da8c8e0ef485bac2056ad1de33e97. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:13:34.407827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:13:34.413324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:13:34.473418 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89d9ffa6-2256-4df5-8c06-3aaef9be8bbf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.058047 Nov 02 13:13:34.475257 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 8/16] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:33 2022] POST /compute/v2.1/servers => generated 382 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:13:34.476144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9885296e-91ac-4f83-8b7a-88b96a31c92e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:34.500308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93dd004f-82cd-429f-b06c-81c87998d175 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "df1d9641b24f489cb9d3bc04e3b50932"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:34.516719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9885296e-91ac-4f83-8b7a-88b96a31c92e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1223 microversion: 2.1 time: 1.039631 Nov 02 13:13:34.518273 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 9/17] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:33 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1223 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:34.525327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04cba1fe-1933-4239-836c-f4b945648bf1 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:34.531705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04cba1fe-1933-4239-836c-f4b945648bf1 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:34.649936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04cba1fe-1933-4239-836c-f4b945648bf1 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:34.659413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04cba1fe-1933-4239-836c-f4b945648bf1 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1247 microversion: 2.1 time: 0.139665 Nov 02 13:13:34.662870 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 10/18] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:34 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1247 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:35.058533 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93dd004f-82cd-429f-b06c-81c87998d175 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/350500439/action" status: 200 len: 96 microversion: 2.1 time: 0.581844 Nov 02 13:13:35.059989 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 9/19] 10.222.0.113 () {60 vars in 1202 bytes} [Wed Nov 2 13:13:34 2022] POST /compute/v2.1/flavors/350500439/action => generated 96 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:13:35.434984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0391dcde-adca-4936-867f-c293f9fa5673 tempest-FlavorsAccessTestJSON-2090305909 tempest-FlavorsAccessTestJSON-2090305909-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:35.532405 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0391dcde-adca-4936-867f-c293f9fa5673 tempest-FlavorsAccessTestJSON-2090305909 tempest-FlavorsAccessTestJSON-2090305909-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5438 microversion: 2.1 time: 0.465662 Nov 02 13:13:35.536356 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 11/20] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:35 2022] GET /compute/v2.1/flavors/detail => generated 5438 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:35.561866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0803c909-19fd-4561-876c-8d112a0ebce3 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "df1d9641b24f489cb9d3bc04e3b50932"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:35.562853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:35.563367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:35.579721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:35.580347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:35.580886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:35.581689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:35.582223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:35.582728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:35.930322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:35.960860 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-520d91ce-afad-44f4-8cdf-2f5a55c52232 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1297 microversion: 2.1 time: 0.424323 Nov 02 13:13:35.962596 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 10/21] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:35 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1297 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:35.969187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:35.970141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:35.977651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:35.978462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:35.978855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:35.979773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:35.980330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:35.980895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:36.044720 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0803c909-19fd-4561-876c-8d112a0ebce3 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/350500439/action" status: 200 len: 21 microversion: 2.1 time: 0.489091 Nov 02 13:13:36.051036 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 12/22] 10.222.0.113 () {60 vars in 1202 bytes} [Wed Nov 2 13:13:35 2022] POST /compute/v2.1/flavors/350500439/action => generated 21 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:13:36.057129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0d2b347-7b2f-44b2-b349-9aa411678917 tempest-FlavorsAccessTestJSON-2090305909 tempest-FlavorsAccessTestJSON-2090305909-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:36.063603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:36.076016 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b24f7785-13f5-4229-b7e4-cc4edaeddfde tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1247 microversion: 2.1 time: 0.111492 Nov 02 13:13:36.078240 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 11/23] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:35 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1247 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:36.128325 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0d2b347-7b2f-44b2-b349-9aa411678917 tempest-FlavorsAccessTestJSON-2090305909 tempest-FlavorsAccessTestJSON-2090305909-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.075546 Nov 02 13:13:36.131155 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 13/24] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:36 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:36.149808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-711cbd7d-c742-4bfe-aafe-c8faa9e2f238 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:36.179683 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-711cbd7d-c742-4bfe-aafe-c8faa9e2f238 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/350500439" status: 202 len: 0 microversion: 2.1 time: 0.033647 Nov 02 13:13:36.183378 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 12/25] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:13:36 2022] DELETE /compute/v2.1/flavors/350500439 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:36.190829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20ca0f64-d815-47eb-ad03-3fa526304258 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:36.230309 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20ca0f64-d815-47eb-ad03-3fa526304258 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.044295 Nov 02 13:13:36.243609 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 14/26] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:36 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:36.260672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca66a2be-f77c-4ab1-bafc-ced63ea79065 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-549900961", "id": 1204000504, "os-flavor-access:is_public": "False"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:36.301772 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca66a2be-f77c-4ab1-bafc-ced63ea79065 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.048748 Nov 02 13:13:36.303861 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 13/27] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:36 2022] POST /compute/v2.1/flavors => generated 432 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:36.317958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-78f4c6c6-7429-4b3b-8938-3056ed9d06db tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:36.359348 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-78f4c6c6-7429-4b3b-8938-3056ed9d06db tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/1204000504/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.047098 Nov 02 13:13:36.360254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 15/28] 10.222.0.113 () {58 vars in 1214 bytes} [Wed Nov 2 13:13:36 2022] GET /compute/v2.1/flavors/1204000504/os-flavor-access => generated 21 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:13:36.370113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-56dbf819-793b-49da-ac91-66fb251e3c8a tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:36.409510 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-56dbf819-793b-49da-ac91-66fb251e3c8a tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1204000504" status: 202 len: 0 microversion: 2.1 time: 0.042849 Nov 02 13:13:36.410801 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 14/29] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:13:36 2022] DELETE /compute/v2.1/flavors/1204000504 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:36.419258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6be1391-46f4-4a01-b818-9b2429ab1277 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:36.467939 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6be1391-46f4-4a01-b818-9b2429ab1277 tempest-FlavorsAccessTestJSON-2128935114 tempest-FlavorsAccessTestJSON-2128935114-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.051861 Nov 02 13:13:36.468919 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 16/30] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:36 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:36.992023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:36.992865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:37.006861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:37.007724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:37.008700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:37.010030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:37.012100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:37.012723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:37.100995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:37.102355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:37.111722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:37.116363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:37.117691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:37.119176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:37.120170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:37.121574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:37.181269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:37.198548 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45f901bb-8be4-4172-b60e-54175c318f72 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1303 microversion: 2.1 time: 0.216253 Nov 02 13:13:37.204285 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 15/31] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:36 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1303 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:37.405580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:37.421760 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-28dbd709-ca47-408d-bba6-4ca9d4695b7d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1301 microversion: 2.1 time: 0.324651 Nov 02 13:13:37.422939 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 17/32] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:37 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1301 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:38.230179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:38.230860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:38.245044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:38.246346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:38.249109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:38.251578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:38.252496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:38.254791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:38.559538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:38.578346 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60777570-a307-42fe-a057-812dc150d7bb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1303 microversion: 2.1 time: 0.352556 Nov 02 13:13:38.579348 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 18/33] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:38 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1303 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:38.585257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:38.586742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:38.605038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:38.606762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:38.617554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:38.620301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:38.620793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:38.622552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:38.695816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96b40965-ef28-46d9-ab00-67f85470b58b tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-811072906", "id": 1907767884, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:38.736701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=11,nova_api:DELETE=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:38.748766 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-96b40965-ef28-46d9-ab00-67f85470b58b tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.615694 Nov 02 13:13:38.752621 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 16/34] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:38 2022] POST /compute/v2.1/flavors => generated 431 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:38.770367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b25655e4-3543-4446-994a-a8e7536e7b10 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:38.810118 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b25655e4-3543-4446-994a-a8e7536e7b10 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1907767884" status: 202 len: 0 microversion: 2.1 time: 0.046177 Nov 02 13:13:38.812902 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 17/35] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:13:38 2022] DELETE /compute/v2.1/flavors/1907767884 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:38.820755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d9c1f6b9-1cee-44d5-985d-d4d4db79303c tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:38.876288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:38.897966 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d9c1f6b9-1cee-44d5-985d-d4d4db79303c tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.080921 Nov 02 13:13:38.906270 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-722fe3f1-04df-41e9-a763-ee14bd94ea3a tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1301 microversion: 2.1 time: 0.321319 Nov 02 13:13:38.907379 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 18/36] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:38 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:38.912227 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 19/37] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:38 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1301 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:38.929885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-427c3a96-1397-45e8-b80e-1ebbef55d58f tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-982768866", "id": 942651161, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:38.976800 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-427c3a96-1397-45e8-b80e-1ebbef55d58f tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.051277 Nov 02 13:13:38.978974 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 19/38] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:38 2022] POST /compute/v2.1/flavors => generated 415 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:38.992511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44f5253d-8996-4e4f-85bd-97ea4cf818db tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.037792 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-44f5253d-8996-4e4f-85bd-97ea4cf818db tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5424 microversion: 2.1 time: 0.049166 Nov 02 13:13:39.054446 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 20/39] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:38 2022] GET /compute/v2.1/flavors/detail => generated 5424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:39.063487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a627ab41-57bb-4c68-85a5-fcb015383cc5 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.101807 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a627ab41-57bb-4c68-85a5-fcb015383cc5 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/942651161" status: 202 len: 0 microversion: 2.1 time: 0.042808 Nov 02 13:13:39.104593 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 20/40] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:13:39 2022] DELETE /compute/v2.1/flavors/942651161 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:39.114497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f85f4ea-6de7-45ca-926c-edf262f4f00c tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.160148 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f85f4ea-6de7-45ca-926c-edf262f4f00c tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.047439 Nov 02 13:13:39.173782 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 21/41] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:39 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:39.187404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c7d52f9e-be5b-4232-92bc-202923467a2d tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-805043506", "id": 2011417469, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:39.227292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c7d52f9e-be5b-4232-92bc-202923467a2d tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.044723 Nov 02 13:13:39.228256 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 21/42] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:39 2022] POST /compute/v2.1/flavors => generated 430 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:39.248171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-800fc05b-6f87-43d8-94c7-d214f0ded95b tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.301664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-800fc05b-6f87-43d8-94c7-d214f0ded95b tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/2011417469" status: 202 len: 0 microversion: 2.1 time: 0.063326 Nov 02 13:13:39.302430 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 22/43] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:13:39 2022] DELETE /compute/v2.1/flavors/2011417469 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:39.311544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d2dedbf-7957-40a5-8186-9f5423541f43 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.369420 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d2dedbf-7957-40a5-8186-9f5423541f43 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.061194 Nov 02 13:13:39.374830 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 23/44] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:39 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:39.416985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d5b5bdf-58f3-4e8e-9899-29df44784b46 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-174596124", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:39.491524 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d5b5bdf-58f3-4e8e-9899-29df44784b46 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 508 microversion: 2.1 time: 0.091232 Nov 02 13:13:39.496301 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 24/45] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:39 2022] POST /compute/v2.1/flavors => generated 508 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:39.520314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfee09fd-48e9-4d36-bd21-ce43db85e74e tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.558319 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfee09fd-48e9-4d36-bd21-ce43db85e74e tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/a52fa999-566f-4ea9-bf24-e9febe4c425b" status: 202 len: 0 microversion: 2.1 time: 0.050986 Nov 02 13:13:39.559383 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 25/46] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:13:39 2022] DELETE /compute/v2.1/flavors/a52fa999-566f-4ea9-bf24-e9febe4c425b => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:39.569376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-573cf1b7-cdf4-48ae-bf70-d700e8005119 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.621861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-573cf1b7-cdf4-48ae-bf70-d700e8005119 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.055763 Nov 02 13:13:39.626709 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 26/47] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:39 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:39.649145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:39.649794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:39.673712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:39.676478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:39.678167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:39.679684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:39.680848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:39.682980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:39.833089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6067adaf-2074-464c-b866-4218f6a3e6cc tempest-FlavorsV261TestJSON-1944046125 tempest-FlavorsV261TestJSON-1944046125-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1310390135", "id": 1162603432, "os-flavor-access:is_public": "True"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:39.892119 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6067adaf-2074-464c-b866-4218f6a3e6cc tempest-FlavorsV261TestJSON-1944046125 tempest-FlavorsV261TestJSON-1944046125-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.61 time: 0.687474 Nov 02 13:13:39.894115 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 22/48] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:13:39 2022] POST /compute/v2.1/flavors => generated 470 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:13:39.901793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1e0e424d-18b4-4017-9bb9-718e6065e272 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-187014477", "id": "e6178b29-3f95-4561-9c1e-8211c87c91d4", "os-flavor-access:is_public": "True"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:39.933157 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1e0e424d-18b4-4017-9bb9-718e6065e272 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 508 microversion: 2.1 time: 0.036099 Nov 02 13:13:39.945457 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 23/49] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:39 2022] POST /compute/v2.1/flavors => generated 508 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:40.409562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:40.414645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e06841cc-f076-46f5-aab9-a1ed05ff8b29 tempest-FlavorsV261TestJSON-735078232 tempest-FlavorsV261TestJSON-735078232-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:40.425811 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0684bd2-a447-44b9-b790-1722d2b1169d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.797560 Nov 02 13:13:40.463259 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 27/50] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:39 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:40.492939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:40.495733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:40.502564 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e06841cc-f076-46f5-aab9-a1ed05ff8b29 tempest-FlavorsV261TestJSON-735078232 tempest-FlavorsV261TestJSON-735078232-project] 10.222.0.113 "GET /compute/v2.1/flavors/1162603432" status: 200 len: 470 microversion: 2.61 time: 0.555078 Nov 02 13:13:40.504211 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 24/51] 10.222.0.113 () {60 vars in 1204 bytes} [Wed Nov 2 13:13:39 2022] GET /compute/v2.1/flavors/1162603432 => generated 470 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:13:40.522344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:40.523142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:40.530362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:40.531421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:40.533588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:40.534229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:40.534874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4e42005c-cbac-411b-87a5-ede8c1a3e2ae tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:40.596900 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4e42005c-cbac-411b-87a5-ede8c1a3e2ae tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/e6178b29-3f95-4561-9c1e-8211c87c91d4" status: 202 len: 0 microversion: 2.1 time: 0.087649 Nov 02 13:13:40.598690 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 25/52] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:13:40 2022] DELETE /compute/v2.1/flavors/e6178b29-3f95-4561-9c1e-8211c87c91d4 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:40.617860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6be07e7f-9d05-4a1f-8680-cb3c11b6cdf2 tempest-FlavorsV261TestJSON-1944046125 tempest-FlavorsV261TestJSON-1944046125-project-admin] Action: 'update', calling method: .version_select at 0x7fe78d4f6b80>, body: {"flavor": {"description": "new"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:40.825167 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6be07e7f-9d05-4a1f-8680-cb3c11b6cdf2 tempest-FlavorsV261TestJSON-1944046125 tempest-FlavorsV261TestJSON-1944046125-project-admin] 10.222.0.113 "PUT /compute/v2.1/flavors/1162603432" status: 200 len: 471 microversion: 2.61 time: 0.221735 Nov 02 13:13:40.828144 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 26/53] 10.222.0.113 () {62 vars in 1224 bytes} [Wed Nov 2 13:13:40 2022] PUT /compute/v2.1/flavors/1162603432 => generated 471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:13:40.847299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-262f6419-0be3-4130-b67b-cd872b208b6f tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:40.906391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-262f6419-0be3-4130-b67b-cd872b208b6f tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5439 microversion: 2.1 time: 0.076339 Nov 02 13:13:40.909450 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 27/54] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:40 2022] GET /compute/v2.1/flavors/detail => generated 5439 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:40.925439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c28c986a-9430-4d4b-978f-e67499ad2a59 tempest-FlavorsV261TestJSON-735078232 tempest-FlavorsV261TestJSON-735078232-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:40.944947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:40.957471 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-722d1ff5-20d1-4b7b-aa60-7d194fad0355 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.492740 Nov 02 13:13:40.970189 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 28/55] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:40 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:40.977749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ded50f29-f16e-4441-ad9c-9230c9c43841 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-29324270", "id": 894265511, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:41.024828 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c28c986a-9430-4d4b-978f-e67499ad2a59 tempest-FlavorsV261TestJSON-735078232 tempest-FlavorsV261TestJSON-735078232-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 6280 microversion: 2.61 time: 0.114242 Nov 02 13:13:41.031734 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 28/56] 10.222.0.113 () {60 vars in 1192 bytes} [Wed Nov 2 13:13:40 2022] GET /compute/v2.1/flavors/detail => generated 6280 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:13:41.037585 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ded50f29-f16e-4441-ad9c-9230c9c43841 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.066038 Nov 02 13:13:41.042475 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 29/57] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:40 2022] POST /compute/v2.1/flavors => generated 411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:41.071906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6b675c0-72a8-4a6c-9a7a-2c731d921173 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:41.083578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-73bc5fb1-1521-4b19-b66d-d69f364008b1 tempest-FlavorsV261TestJSON-735078232 tempest-FlavorsV261TestJSON-735078232-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:41.091143 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6b675c0-72a8-4a6c-9a7a-2c731d921173 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/894265511" status: 200 len: 411 microversion: 2.1 time: 0.035816 Nov 02 13:13:41.097940 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 29/58] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:13:41 2022] GET /compute/v2.1/flavors/894265511 => generated 411 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:41.160002 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-73bc5fb1-1521-4b19-b66d-d69f364008b1 tempest-FlavorsV261TestJSON-735078232 tempest-FlavorsV261TestJSON-735078232-project] 10.222.0.113 "GET /compute/v2.1/flavors" status: 200 len: 3438 microversion: 2.61 time: 0.080741 Nov 02 13:13:41.164057 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 30/59] 10.222.0.113 () {60 vars in 1171 bytes} [Wed Nov 2 13:13:41 2022] GET /compute/v2.1/flavors => generated 3438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:13:41.208770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ed3b725-5883-4543-bd3e-a50135c3d466 tempest-FlavorsV261TestJSON-1944046125 tempest-FlavorsV261TestJSON-1944046125-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:41.236646 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1ed3b725-5883-4543-bd3e-a50135c3d466 tempest-FlavorsV261TestJSON-1944046125 tempest-FlavorsV261TestJSON-1944046125-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1162603432" status: 202 len: 0 microversion: 2.61 time: 0.031431 Nov 02 13:13:41.237828 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 31/60] 10.222.0.113 () {60 vars in 1207 bytes} [Wed Nov 2 13:13:41 2022] DELETE /compute/v2.1/flavors/1162603432 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:13:41.265501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-881eb7b3-db31-44c3-9f59-700c6e93ef41 tempest-FlavorsV261TestJSON-1944046125 tempest-FlavorsV261TestJSON-1944046125-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:41.321921 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-881eb7b3-db31-44c3-9f59-700c6e93ef41 tempest-FlavorsV261TestJSON-1944046125 tempest-FlavorsV261TestJSON-1944046125-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 6260 microversion: 2.61 time: 0.077737 Nov 02 13:13:41.322520 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 32/61] 10.222.0.113 () {60 vars in 1192 bytes} [Wed Nov 2 13:13:41 2022] GET /compute/v2.1/flavors/detail => generated 6260 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:13:41.455403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:41.457424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:41.475082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:41.476150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:41.476823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:41.480343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:41.481051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:41.487408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:41.834253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b97b2ae7-44b8-4032-963a-33d3026806ef tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:41.845525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:41.931375 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b97b2ae7-44b8-4032-963a-33d3026806ef tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5420 microversion: 2.1 time: 0.823468 Nov 02 13:13:41.932583 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 30/62] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:41 2022] GET /compute/v2.1/flavors/detail => generated 5420 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:41.961168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:42.354796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:42.364308 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-891c9c86-423a-446a-aacd-cd440eb7995b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.913840 Nov 02 13:13:42.371684 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 33/63] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:41 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:42.402050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82710b2e-bffd-4a95-a54b-7264ddd1804a tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:42.444867 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82710b2e-bffd-4a95-a54b-7264ddd1804a tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/894265511" status: 202 len: 0 microversion: 2.1 time: 0.071685 Nov 02 13:13:42.451722 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 34/64] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:13:42 2022] DELETE /compute/v2.1/flavors/894265511 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:42.469187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:42.470510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:42.489597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:42.494075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:42.494728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:42.495629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:42.497150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:42.505105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:42.719718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e7650e0c-eff2-44a7-8830-8cfd7e321a42 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:42.722988 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e7650e0c-eff2-44a7-8830-8cfd7e321a42 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e7650e0c-eff2-44a7-8830-8cfd7e321a42 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865-project-admin] Request method failure captured: Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0FOL4zZy9jDGyloU9I2e1bhDlJgeZXuaT-O6dC8HvjFuBCEo2Xe1D6xzWqsLHVHMaDecvNKwgc4UqYpanzXBxJTKtGmSiEwCvsvHdLnXbROe43F5jHCC9BFM0iFJ3yezamU1w7DzrMD_9snXQ7PJlbjqp-rB6SfzRnQ93IViBw-LA Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 6db67a2271c540a59ff699e660ffb0e9 Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-209763865 Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:13:42.748796 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6db67a2271c540a59ff699e660ffb0e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6db67a2271c540a59ff699e660ffb0e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_6db67a2271c540a59ff699e660ffb0e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/6db67a2271c540a59ff699e660ffb0e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-209763865 Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 6db67a2271c540a59ff699e660ffb0e9 Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-209763865 Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-209763865-project-admin Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: bd85271959e048d8abf1580dc35487ac Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-209763865-project-admin Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:13:42.750238 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid timestamp for date invalid_time Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'invalid_time'} Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:42.750972 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Nov 02 13:13:42.752302 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:42.754457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e7650e0c-eff2-44a7-8830-8cfd7e321a42 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:42.755501 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e7650e0c-eff2-44a7-8830-8cfd7e321a42 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865 tempest-InstanceUsageAuditLogNegativeTestJSON-209763865-project-admin] 10.222.0.113 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.816885 Nov 02 13:13:42.756485 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 31/65] 10.222.0.113 () {58 vars in 1229 bytes} [Wed Nov 2 13:13:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 823 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:42.761217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bb2f5150-8108-4ca8-a6cc-746686968d09 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:42.813233 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bb2f5150-8108-4ca8-a6cc-746686968d09 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.055467 Nov 02 13:13:42.820345 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 32/66] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:42 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:42.870962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:42.882987 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8bfc1f1b-9769-43da-9e35-01001305f15b tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.429871 Nov 02 13:13:42.885125 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 35/67] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:42 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:42.896465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1f71752b-52a9-4033-adae-a8b26561f369 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-477524645", "id": 357841772, "os-flavor-access:is_public": "False"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:42.929407 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1f71752b-52a9-4033-adae-a8b26561f369 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.037928 Nov 02 13:13:42.933850 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 36/68] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:42 2022] POST /compute/v2.1/flavors => generated 428 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:42.956353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6b5c8985-8d9a-49e2-b0c7-a1276a16fb10 tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "357841772"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:43.001776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6b5c8985-8d9a-49e2-b0c7-a1276a16fb10 tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] HTTP exception thrown: Flavor 357841772 could not be found. Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6b5c8985-8d9a-49e2-b0c7-a1276a16fb10 tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] Request method failure captured: Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 106 Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0Ar_3tzxfrsjWtstbnTerYmovMIbgxAX-54NcFOUtyo-rgb-3JqABQmXisRCc5dapsJA77pPLiCfYdH55FloN5-U6i73nXePCKKiXihTHa9KzFHgT1a3WwYVjbB_rf9bTVmqguiN1UJo2TCkvvhX-QJY2hjoRBfuHD_bodkqWDA0A Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 90597fef3d6d4d4aa4ae5d2c96fd79dd Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FlavorsAdminTestJSON-377104181 Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:13:43.016962 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90597fef3d6d4d4aa4ae5d2c96fd79dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90597fef3d6d4d4aa4ae5d2c96fd79dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_90597fef3d6d4d4aa4ae5d2c96fd79dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/90597fef3d6d4d4aa4ae5d2c96fd79dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FlavorsAdminTestJSON-377104181 Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 90597fef3d6d4d4aa4ae5d2c96fd79dd Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-377104181 Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FlavorsAdminTestJSON-377104181-project Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 7e14d8bd125f43bfb619211680a6613f Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FlavorsAdminTestJSON-377104181-project Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "test", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "357841772"}} Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:13:43.018271 n-d-858384-19 devstack@n-api.service[120928]: exception: Flavor 357841772 could not be found. Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '357841772'}}} Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 357841772 could not be found. Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.019384 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 357841772 could not be found. Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:43.020378 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:43.021413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:43.021413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:13:43.021413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:13:43.021413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 357841772 could not be found. Nov 02 13:13:43.021413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.021413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6b5c8985-8d9a-49e2-b0c7-a1276a16fb10 tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] Returning 400 to user: Flavor 357841772 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:43.021413 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6b5c8985-8d9a-49e2-b0c7-a1276a16fb10 tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.075249 Nov 02 13:13:43.021413 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 37/69] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:42 2022] POST /compute/v2.1/servers => generated 80 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:43.034749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e875026d-5a2f-4834-922c-b2a5d7b61e22 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.087402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e875026d-5a2f-4834-922c-b2a5d7b61e22 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/357841772" status: 202 len: 0 microversion: 2.1 time: 0.061533 Nov 02 13:13:43.088286 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 38/70] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:13:43 2022] DELETE /compute/v2.1/flavors/357841772 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:43.098698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eeaed022-e443-4802-9051-3b8bbd3d04a6 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.134121 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eeaed022-e443-4802-9051-3b8bbd3d04a6 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.040634 Nov 02 13:13:43.158077 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 39/71] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:43.163911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5fdb294-4067-4f25-b0ce-31e3ca8277e9 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.166771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e5fdb294-4067-4f25-b0ce-31e3ca8277e9 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '081cac273ff040dfb52783f1aa8e7420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca5305d615942b4b992f0216d0ae351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5fdb294-4067-4f25-b0ce-31e3ca8277e9 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] Request method failure captured: Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0CtS9iGe6ef7_k7_ob1u-LVQM1u7Jm5NOwGY62Ddr1F35DvSGLkwrzHRW8zDHOl4dMDsjfiqqk_W8J2kl9QQFMh12j7KR0h4fuT6poKCpvcJui8nOWL8T1oAKcWa789XjAlkt9fE2kMQXghNQbfFMpDSSv9_Xo8C-ORE1gS0xs3bM Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8ca5305d615942b4b992f0216d0ae351 Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:13:43.168588 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8ca5305d615942b4b992f0216d0ae351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8ca5305d615942b4b992f0216d0ae351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8ca5305d615942b4b992f0216d0ae351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8ca5305d615942b4b992f0216d0ae351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8ca5305d615942b4b992f0216d0ae351 Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 081cac273ff040dfb52783f1aa8e7420 Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project Nov 02 13:13:43.169765 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: action_args: {} Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:13:43.170305 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 13:13:43.171581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.172407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed832959-449f-4f02-8249-bb92600f616a tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1745344677", "id": 1939190554, "os-flavor-access:is_public": "False"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:43.176049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5fdb294-4067-4f25-b0ce-31e3ca8277e9 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:43.178522 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e5fdb294-4067-4f25-b0ce-31e3ca8277e9 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] 10.222.0.113 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.356879 Nov 02 13:13:43.179316 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 33/72] 10.222.0.113 () {58 vars in 1190 bytes} [Wed Nov 2 13:13:42 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 358 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:13:43.195025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3eac9455-5d7a-4586-896a-74f00d975094 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.201912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3eac9455-5d7a-4586-896a-74f00d975094 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '081cac273ff040dfb52783f1aa8e7420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca5305d615942b4b992f0216d0ae351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3eac9455-5d7a-4586-896a-74f00d975094 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] Request method failure captured: Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2013:13:43 HTTP/1.1 Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0CtS9iGe6ef7_k7_ob1u-LVQM1u7Jm5NOwGY62Ddr1F35DvSGLkwrzHRW8zDHOl4dMDsjfiqqk_W8J2kl9QQFMh12j7KR0h4fuT6poKCpvcJui8nOWL8T1oAKcWa789XjAlkt9fE2kMQXghNQbfFMpDSSv9_Xo8C-ORE1gS0xs3bM Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8ca5305d615942b4b992f0216d0ae351 Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:13:43.207572 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8ca5305d615942b4b992f0216d0ae351"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8ca5305d615942b4b992f0216d0ae351"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8ca5305d615942b4b992f0216d0ae351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8ca5305d615942b4b992f0216d0ae351"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8ca5305d615942b4b992f0216d0ae351 Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 081cac273ff040dfb52783f1aa8e7420 Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project Nov 02 13:13:43.208736 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '2022-11-02 13:13:43'} Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:13:43.209329 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 13:13:43.210304 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:43.213332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3eac9455-5d7a-4586-896a-74f00d975094 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:43.214049 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed832959-449f-4f02-8249-bb92600f616a tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.054504 Nov 02 13:13:43.216756 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3eac9455-5d7a-4586-896a-74f00d975094 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147 tempest-InstanceUsageAuditLogNegativeTestJSON-1772942147-project] 10.222.0.113 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 13:13:43" status: 403 len: 128 microversion: 2.1 time: 0.031794 Nov 02 13:13:43.220086 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 34/73] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2013%3A13%3A43 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:13:43.227793 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 40/74] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:43 2022] POST /compute/v2.1/flavors => generated 417 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:43.234684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57a40672-c201-4b05-a203-3dcf8e154d46 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-555393099", "id": 1289823878, "os-flavor-access:is_public": "True"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:43.290288 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57a40672-c201-4b05-a203-3dcf8e154d46 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.060243 Nov 02 13:13:43.305803 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 35/75] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:43 2022] POST /compute/v2.1/flavors => generated 415 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:43.319323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4aa6135a-7b97-492b-ab7a-07e86e9ae060 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.366150 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4aa6135a-7b97-492b-ab7a-07e86e9ae060 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 420 microversion: 2.1 time: 0.050780 Nov 02 13:13:43.376548 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 41/76] 10.222.0.113 () {58 vars in 1174 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 420 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:43.382095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17f11a93-a7a1-4f11-a4f3-79bda56bac59 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.400892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.401808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:43.432160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:43.433414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:43.437489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:43.438617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:43.439268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:43.439871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:43.446805 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17f11a93-a7a1-4f11-a4f3-79bda56bac59 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 420 microversion: 2.1 time: 0.069937 Nov 02 13:13:43.461387 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 36/77] 10.222.0.113 () {58 vars in 1182 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 420 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:43.478887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40ab533a-72c4-454f-873a-f7894d5a5c23 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.510083 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40ab533a-72c4-454f-873a-f7894d5a5c23 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 420 microversion: 2.1 time: 0.036909 Nov 02 13:13:43.511016 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 37/78] 10.222.0.113 () {58 vars in 1176 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 420 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:43.525011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-140c38f6-27e8-49d3-98c6-4e7afe1c51e0 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.562188 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-140c38f6-27e8-49d3-98c6-4e7afe1c51e0 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 420 microversion: 2.1 time: 0.041063 Nov 02 13:13:43.567976 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 38/79] 10.222.0.113 () {58 vars in 1174 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 420 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:13:43.585598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4eba4790-7d4c-4472-b32e-b74858c59218 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.646543 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4eba4790-7d4c-4472-b32e-b74858c59218 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5424 microversion: 2.1 time: 0.067541 Nov 02 13:13:43.648592 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 39/80] 10.222.0.113 () {58 vars in 1174 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:43.667186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94dbf001-92a5-4a95-93fa-00be126bdbfd tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.716833 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94dbf001-92a5-4a95-93fa-00be126bdbfd tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5424 microversion: 2.1 time: 0.053357 Nov 02 13:13:43.724000 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 40/81] 10.222.0.113 () {58 vars in 1180 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:43.743665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d117e36-6ce4-44a8-850d-cfecf1049c27 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.755653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:43.782587 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59e322b4-7ba3-4724-a2f1-c97ba9f97a31 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.389100 Nov 02 13:13:43.785233 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 42/82] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:43.802621 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d117e36-6ce4-44a8-850d-cfecf1049c27 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5424 microversion: 2.1 time: 0.064602 Nov 02 13:13:43.817326 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 41/83] 10.222.0.113 () {58 vars in 1178 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5424 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:43.830640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a681c256-61e3-49b7-8ac5-cd6c6ef017c2 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.836684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=21,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:43.878726 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a681c256-61e3-49b7-8ac5-cd6c6ef017c2 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5424 microversion: 2.1 time: 0.050384 Nov 02 13:13:43.887242 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 43/84] 10.222.0.113 () {58 vars in 1174 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:43.920179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5e2effc-1841-47d2-92f5-13cfb9bd591f tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.924297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:43.924986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:43.940167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:43.940900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:43.941513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:43.942427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:43.944048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:43.944761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:44.031061 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c5e2effc-1841-47d2-92f5-13cfb9bd591f tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1289823878" status: 202 len: 0 microversion: 2.1 time: 0.129236 Nov 02 13:13:44.031695 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 42/85] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:13:43 2022] DELETE /compute/v2.1/flavors/1289823878 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:44.048448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d42f5a7e-7284-42f4-93fe-5a178ce788e8 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:44.100106 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d42f5a7e-7284-42f4-93fe-5a178ce788e8 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.063205 Nov 02 13:13:44.101031 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 43/86] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:44 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:44.132592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-79b0df24-b2de-4963-89f0-c4f4dd4ca859 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:44.180805 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-79b0df24-b2de-4963-89f0-c4f4dd4ca859 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1939190554" status: 202 len: 0 microversion: 2.1 time: 0.062788 Nov 02 13:13:44.183104 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 44/87] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:13:44 2022] DELETE /compute/v2.1/flavors/1939190554 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:13:44.194943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6c5dd44-3340-4247-ad78-912cf1114fb7 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:44.286979 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6c5dd44-3340-4247-ad78-912cf1114fb7 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.096719 Nov 02 13:13:44.287666 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 45/88] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:44 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:44.338626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5c58d67f-e84e-488b-b3ce-910b7de2c6f9 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-495318225", "id": 336612290, "os-flavor-access:is_public": "False"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:44.378939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:44.393426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5c58d67f-e84e-488b-b3ce-910b7de2c6f9 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.056457 Nov 02 13:13:44.395805 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 46/89] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:44 2022] POST /compute/v2.1/flavors => generated 413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:44.401893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:44.418612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f29df0bc-8856-43f8-a7f9-160635a6f616 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:44.461982 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f29df0bc-8856-43f8-a7f9-160635a6f616 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.046515 Nov 02 13:13:44.463024 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 47/90] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:44 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:44.490694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e41e2e24-ffae-4997-944a-93fc008885cf tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:44.581389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e41e2e24-ffae-4997-944a-93fc008885cf tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.095991 Nov 02 13:13:44.582904 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 48/91] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:44 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:44.605051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d10f964-d661-45f4-9709-4f063eac4ede tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:44.657040 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d10f964-d661-45f4-9709-4f063eac4ede tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/336612290" status: 202 len: 0 microversion: 2.1 time: 0.056274 Nov 02 13:13:44.657819 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 49/92] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:13:44 2022] DELETE /compute/v2.1/flavors/336612290 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:13:44.671040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5ff6c919-c5a4-4afd-8d27-0fbefe351579 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:44.675793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:44.783406 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5ff6c919-c5a4-4afd-8d27-0fbefe351579 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.115190 Nov 02 13:13:44.803351 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 50/93] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:44 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:44.814946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba6089ed-9614-4441-98a2-5a7720ee8c9a tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-938871177", "id": 411471333, "os-flavor-access:is_public": "True"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:44.876135 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba6089ed-9614-4441-98a2-5a7720ee8c9a tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.070798 Nov 02 13:13:44.885867 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 51/94] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:44 2022] POST /compute/v2.1/flavors => generated 412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:44.902284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:44.905064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:44.912854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:44.913600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:44.914237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:44.916356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:44.917405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:44.918189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:45.002782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:45.018595 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-806fb872-eee0-4f17-9507-d4d07dad8232 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 1.107709 Nov 02 13:13:45.018595 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 44/95] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:43 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:45.358985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e4950ac6-99ea-4e11-8a20-777c406587df req-3145394f-263e-49c9-87be-7e267d2ca946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "342f003f-a39c-4185-878f-26cf14c103e0", "tag": "8a22b512-6909-482b-adf4-db703a91c0e6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:45.396289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e4950ac6-99ea-4e11-8a20-777c406587df req-3145394f-263e-49c9-87be-7e267d2ca946 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:45.397138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e4950ac6-99ea-4e11-8a20-777c406587df req-3145394f-263e-49c9-87be-7e267d2ca946 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:45.398127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e4950ac6-99ea-4e11-8a20-777c406587df req-3145394f-263e-49c9-87be-7e267d2ca946 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:45.474815 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e4950ac6-99ea-4e11-8a20-777c406587df req-3145394f-263e-49c9-87be-7e267d2ca946 service nova] Creating event network-changed:8a22b512-6909-482b-adf4-db703a91c0e6 for instance 342f003f-a39c-4185-878f-26cf14c103e0 on n-h2-858384-19 Nov 02 13:13:45.478391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e4950ac6-99ea-4e11-8a20-777c406587df req-3145394f-263e-49c9-87be-7e267d2ca946 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:13:45.479050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e4950ac6-99ea-4e11-8a20-777c406587df req-3145394f-263e-49c9-87be-7e267d2ca946 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:13:45.483368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6020f6a8-409a-404d-94ab-f0e44769410f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:45.484676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6020f6a8-409a-404d-94ab-f0e44769410f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:45.486760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6020f6a8-409a-404d-94ab-f0e44769410f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:45.488536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6020f6a8-409a-404d-94ab-f0e44769410f None None] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:45.490904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6020f6a8-409a-404d-94ab-f0e44769410f None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:45.492593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6020f6a8-409a-404d-94ab-f0e44769410f None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:45.521706 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.compute.rpcapi [None req-6020f6a8-409a-404d-94ab-f0e44769410f None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Nov 02 13:13:45.524187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6020f6a8-409a-404d-94ab-f0e44769410f None None] Releasing lock "compute-rpcapi-router" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:13:45.543451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:45.555493 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c06e8174-260e-436f-9341-059e46cf93c4 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.668129 Nov 02 13:13:45.557526 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 52/96] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:44 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:45.559435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6020f6a8-409a-404d-94ab-f0e44769410f None None] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.510664 Nov 02 13:13:45.561004 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 45/97] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:45.569116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-00e8a0a2-925d-4d95-aaea-1e669fc94b65 tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:45.620545 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-00e8a0a2-925d-4d95-aaea-1e669fc94b65 tempest-FlavorsAdminTestJSON-377104181 tempest-FlavorsAdminTestJSON-377104181-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5421 microversion: 2.1 time: 0.061734 Nov 02 13:13:45.631180 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 53/98] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:45 2022] GET /compute/v2.1/flavors/detail => generated 5421 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:45.651716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-640d56e5-d645-49ec-b136-df10a9a33199 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:45.707273 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-640d56e5-d645-49ec-b136-df10a9a33199 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/411471333" status: 202 len: 0 microversion: 2.1 time: 0.066682 Nov 02 13:13:45.708694 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 54/99] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:13:45 2022] DELETE /compute/v2.1/flavors/411471333 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:45.727806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1ad594fd-3fad-4a31-a741-6306d0ca57c6 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:45.799289 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1ad594fd-3fad-4a31-a741-6306d0ca57c6 tempest-FlavorsAdminTestJSON-558199488 tempest-FlavorsAdminTestJSON-558199488-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.085801 Nov 02 13:13:45.807031 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 55/100] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:45 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:46.050268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:46.051436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:46.068668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:46.076618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:46.081175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:46.088754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:46.088754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:46.088754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:46.271569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a85ded9b-17be-4ab6-851b-df2688889008 req-46198b06-14db-403f-ac67-948573639018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f064c9b8-b625-48ff-8f68-3558f114b880", "tag": "3a492517-0fec-4dbf-97c0-c2da2452ac56"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:46.307786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a85ded9b-17be-4ab6-851b-df2688889008 req-46198b06-14db-403f-ac67-948573639018 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:46.308848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a85ded9b-17be-4ab6-851b-df2688889008 req-46198b06-14db-403f-ac67-948573639018 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:46.310746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a85ded9b-17be-4ab6-851b-df2688889008 req-46198b06-14db-403f-ac67-948573639018 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:46.335437 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a85ded9b-17be-4ab6-851b-df2688889008 req-46198b06-14db-403f-ac67-948573639018 service nova] Creating event network-changed:3a492517-0fec-4dbf-97c0-c2da2452ac56 for instance f064c9b8-b625-48ff-8f68-3558f114b880 on n-h2-858384-19 Nov 02 13:13:46.341197 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a85ded9b-17be-4ab6-851b-df2688889008 req-46198b06-14db-403f-ac67-948573639018 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.776782 Nov 02 13:13:46.342909 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 46/101] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:46.371478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:46.390164 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8ae64321-6d1b-44ce-828f-f05a0070e827 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.345434 Nov 02 13:13:46.404573 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 56/102] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:46 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:46.584334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:46.585383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:46.604554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:46.605556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:46.606271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:46.607408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:46.608986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:46.609695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:47.387826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:47.398555 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2a72da6-69b4-4b39-91b4-eb1fbe6d12a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.818573 Nov 02 13:13:47.400119 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 47/103] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:46 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:47.418411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:47.420453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:47.427996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:47.428696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:47.429618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:47.430915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:47.431570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:47.432218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:47.884497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:47.897411 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f88fce55-e780-4eb3-b4c5-8bef1ede5586 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.483727 Nov 02 13:13:47.898227 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 57/104] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:47 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:48.434035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:48.436031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:48.456571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:48.457763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:48.458885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:48.461195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:48.461835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:48.462862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:48.727628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:48.732974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:48.741283 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f974e25f-f34f-4413-adfa-494b62fb0f4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.314039 Nov 02 13:13:48.742734 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 48/105] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:48 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:48.925665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:48.926628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:48.934793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:48.935520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:48.936087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:48.937577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:48.938625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:48.939064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:49.057677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d43c47e4-db1f-43bb-a5d1-1ad0376201fa tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-429285025", "id": 1806986246, "os-flavor-access:is_public": "False"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:49.079613 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d43c47e4-db1f-43bb-a5d1-1ad0376201fa tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 440 microversion: 2.1 time: 0.351361 Nov 02 13:13:49.080407 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 58/106] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:48 2022] POST /compute/v2.1/flavors => generated 440 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:13:49.092179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:49.093538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a20e627-656a-4847-9144-a5e86e15ec46 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:49.102413 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6cf3339e-ba5d-4983-90a6-3ba64fb425a8 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.180477 Nov 02 13:13:49.102997 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 49/107] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:48 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:49.515681 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a20e627-656a-4847-9144-a5e86e15ec46 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/1806986246/action" status: 200 len: 97 microversion: 2.1 time: 0.426527 Nov 02 13:13:49.516974 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 59/108] 10.222.0.113 () {60 vars in 1205 bytes} [Wed Nov 2 13:13:49 2022] POST /compute/v2.1/flavors/1806986246/action => generated 97 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:13:49.527175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45acc623-8754-4a88-94b1-2c191ff0c36e tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:49.771719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:49.772351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:49.779144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:49.779821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:49.780264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:49.781431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:49.782337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:49.782770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:49.927886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:49.937323 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3e572844-fb33-49d8-80cb-12806b907219 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.175006 Nov 02 13:13:49.941465 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 60/109] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:49 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:50.035244 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-45acc623-8754-4a88-94b1-2c191ff0c36e tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project afa13a99a7e14339a3cf54d5a57b2f0a combination. Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45acc623-8754-4a88-94b1-2c191ff0c36e tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Request method failure captured: Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/flavors/1806986246/action HTTP/1.1 Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 67 Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0Lm-umAT6OmKta9vSJPeJx5o88my_8ELRHaPcDBtBHHqLluPeU1TFvvLKZco2T6imgWsbjfHnztZ2A0BV0la9J86PH3lU0aUTF2ATT-GocSYbTOCe7By7psVQpepm-bcmuo0D8WyfNhQ78JtXj-WTfcJFDIayKDx8ALTS2B-lvJNQ Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 35bd289024314d7caaa885e26a8b1ae8 Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-499107292 Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:13:50.062738 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-499107292 Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 35bd289024314d7caaa885e26a8b1ae8 Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-499107292 Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 29ea4ec82b36480ab9aee2cb6a6dbb93 Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: {"addTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} Nov 02 13:13:50.064225 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: exception: Flavor access already exists for flavor 29 and project afa13a99a7e14339a3cf54d5a57b2f0a combination. Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '1806986246', 'body': {'addTenantAccess': {'tenant': 'afa13a99a7e14339a3cf54d5a57b2f0a'}}} Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:13:50.065068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-afa13a99a7e14339a3cf54d5a57b2f0a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi project.save(context.session) Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 13:13:50.066050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 13:13:50.067771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:13:50.069973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-afa13a99a7e14339a3cf54d5a57b2f0a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 13, 13, 50, 29767), 'updated_at': None, 'flavor_id': 29, 'project_id': 'afa13a99a7e14339a3cf54d5a57b2f0a'}] Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:50.072171 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project afa13a99a7e14339a3cf54d5a57b2f0a combination. Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:50.074741 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project afa13a99a7e14339a3cf54d5a57b2f0a combination. Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:13:50.077950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:13:50.080394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project afa13a99a7e14339a3cf54d5a57b2f0a combination. Nov 02 13:13:50.080394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.080394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45acc623-8754-4a88-94b1-2c191ff0c36e tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project afa13a99a7e14339a3cf54d5a57b2f0a combination. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:50.080394 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45acc623-8754-4a88-94b1-2c191ff0c36e tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/1806986246/action" status: 409 len: 152 microversion: 2.1 time: 0.541400 Nov 02 13:13:50.080394 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 50/110] 10.222.0.113 () {60 vars in 1205 bytes} [Wed Nov 2 13:13:49 2022] POST /compute/v2.1/flavors/1806986246/action => generated 152 bytes in 543 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:13:50.081154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0c7087e-8135-4acf-85cb-4a5ae639ef9d tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:50.128587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:50.129880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:50.136375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.136849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.137681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.139224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.139852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.140527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.280849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:50.289015 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-76dd013c-3d13-4a6e-9672-7001abec399d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.167206 Nov 02 13:13:50.289585 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 51/111] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:50 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:50.505929 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f0c7087e-8135-4acf-85cb-4a5ae639ef9d tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/1806986246/action" status: 200 len: 21 microversion: 2.1 time: 0.436147 Nov 02 13:13:50.512191 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 61/112] 10.222.0.113 () {60 vars in 1205 bytes} [Wed Nov 2 13:13:50 2022] POST /compute/v2.1/flavors/1806986246/action => generated 21 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:13:50.518272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72b7d7c0-78a8-4372-badb-b3541aa219c9 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:50.537585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:DELETE=16 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:50.545614 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-72b7d7c0-78a8-4372-badb-b3541aa219c9 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1806986246" status: 202 len: 0 microversion: 2.1 time: 0.032220 Nov 02 13:13:50.546419 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 62/113] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:13:50 2022] DELETE /compute/v2.1/flavors/1806986246 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:50.559167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a9b00d5-541e-4668-adc7-62a9e95afc0e tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:50.581257 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a9b00d5-541e-4668-adc7-62a9e95afc0e tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.030347 Nov 02 13:13:50.582475 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 63/114] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:50 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:50.605360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-791fb6ce-39e2-4742-b1c7-56b1d57a8d82 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-476024311", "id": 813677926, "os-flavor-access:is_public": "True"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:50.626903 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-791fb6ce-39e2-4742-b1c7-56b1d57a8d82 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.025246 Nov 02 13:13:50.631512 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 64/115] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:50 2022] POST /compute/v2.1/flavors => generated 436 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:13:50.643026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c575368e-e958-4e56-bfab-155d32849caa tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:50.652913 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c575368e-e958-4e56-bfab-155d32849caa tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c575368e-e958-4e56-bfab-155d32849caa tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Request method failure captured: Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/flavors/813677926/os-flavor-access HTTP/1.1 Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0Lm-umAT6OmKta9vSJPeJx5o88my_8ELRHaPcDBtBHHqLluPeU1TFvvLKZco2T6imgWsbjfHnztZ2A0BV0la9J86PH3lU0aUTF2ATT-GocSYbTOCe7By7psVQpepm-bcmuo0D8WyfNhQ78JtXj-WTfcJFDIayKDx8ALTS2B-lvJNQ Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 35bd289024314d7caaa885e26a8b1ae8 Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-499107292 Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:13:50.655440 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-499107292 Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 35bd289024314d7caaa885e26a8b1ae8 Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-499107292 Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 29ea4ec82b36480ab9aee2cb6a6dbb93 Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: exception: Access list not available for public flavors. Nov 02 13:13:50.656806 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'flavor_id': '813677926'} Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Nov 02 13:13:50.657671 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:50.658996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c575368e-e958-4e56-bfab-155d32849caa tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:50.658996 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c575368e-e958-4e56-bfab-155d32849caa tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/813677926/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.021528 Nov 02 13:13:50.658996 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 65/116] 10.222.0.113 () {58 vars in 1211 bytes} [Wed Nov 2 13:13:50 2022] GET /compute/v2.1/flavors/813677926/os-flavor-access => generated 91 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:13:50.670823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ca9f05a8-6fa3-4320-b6a5-578f7d201c80 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:50.696961 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ca9f05a8-6fa3-4320-b6a5-578f7d201c80 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/813677926" status: 202 len: 0 microversion: 2.1 time: 0.033604 Nov 02 13:13:50.703417 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 66/117] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:13:50 2022] DELETE /compute/v2.1/flavors/813677926 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:13:50.709834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed66b20c-e561-468c-b7ed-f8188dfe41e6 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:50.735555 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed66b20c-e561-468c-b7ed-f8188dfe41e6 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.030397 Nov 02 13:13:50.737147 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 67/118] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:50 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:50.747057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Calling method '.version_select at 0x7fe78c22f820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:50.751607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.752197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.752644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.757500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b495cb51-1461-401a-8a3c-c83b1beb09a6 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1070118809", "id": 1874196166, "os-flavor-access:is_public": "False"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:50.780272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.780897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.781509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.789320 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b495cb51-1461-401a-8a3c-c83b1beb09a6 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 441 microversion: 2.1 time: 0.035898 Nov 02 13:13:50.789863 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 68/119] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:50 2022] POST /compute/v2.1/flavors => generated 441 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:13:50.811653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.812752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.813372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.840333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.841332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.842126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.861726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.862571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.863214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.871460 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f668b172-e51b-418e-966e-286aa7906b03 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1747 microversion: 2.53 time: 0.405950 Nov 02 13:13:50.884151 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 52/120] 10.222.0.113 () {60 vars in 1248 bytes} [Wed Nov 2 13:13:50 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1747 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:13:50.894227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Calling method '.version_select at 0x7fe78c23a160>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:50.903252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.904773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.905355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.931643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.932360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.934972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:50.986336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:50.989867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:50.990331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.020420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.021547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.022146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.042046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.043832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.045909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.052865 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0e0a0146-3d44-4caf-9eae-6efa653fa231 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 438 microversion: 2.53 time: 0.164468 Nov 02 13:13:51.054190 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 53/121] 10.222.0.113 () {60 vars in 1227 bytes} [Wed Nov 2 13:13:50 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 438 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:13:51.059458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:51.060516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:51.067735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.068226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.068665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.069369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.069825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.070249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.090967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92bf595d-d43c-49e4-86df-b7c46e75c94a tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:51.097211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-92bf595d-d43c-49e4-86df-b7c46e75c94a tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '38eefcc13ead443fb5926567f63ca0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa13a99a7e14339a3cf54d5a57b2f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92bf595d-d43c-49e4-86df-b7c46e75c94a tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] Request method failure captured: Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/flavors/1874196166/action HTTP/1.1 Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 67 Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0IprG8wvwodQ1AtmuEY099eLEKdKteycC82zcBLxSEE0pXUgi73nsyueKecXrj1WEs2s3MpGibJcz64zxTKu7HWX2vBwmrhXvwwGCZgsNUbpi6klQP0aWwBb2KVs4YtJPokNnOTMZVP4JYFiEF6HeC37-wqF-85p4cyvaWa4_AWbs Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: afa13a99a7e14339a3cf54d5a57b2f0a Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-346166018 Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:13:51.099885 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/afa13a99a7e14339a3cf54d5a57b2f0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/afa13a99a7e14339a3cf54d5a57b2f0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_afa13a99a7e14339a3cf54d5a57b2f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/afa13a99a7e14339a3cf54d5a57b2f0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-346166018 Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: afa13a99a7e14339a3cf54d5a57b2f0a Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-346166018 Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FlavorsAccessNegativeTestJSON-346166018-project Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 38eefcc13ead443fb5926567f63ca0de Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-346166018-project Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: {"addTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} Nov 02 13:13:51.101092 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '1874196166', 'body': {'addTenantAccess': {'tenant': 'afa13a99a7e14339a3cf54d5a57b2f0a'}}} Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:13:51.101740 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 13:13:51.102735 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:51.107096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92bf595d-d43c-49e4-86df-b7c46e75c94a tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:51.107825 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-92bf595d-d43c-49e4-86df-b7c46e75c94a tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] 10.222.0.113 "POST /compute/v2.1/flavors/1874196166/action" status: 403 len: 130 microversion: 2.1 time: 0.308887 Nov 02 13:13:51.109021 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 69/122] 10.222.0.113 () {60 vars in 1205 bytes} [Wed Nov 2 13:13:50 2022] POST /compute/v2.1/flavors/1874196166/action => generated 130 bytes in 311 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:13:51.114036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a7930f2-9df1-40b1-b9ad-63fbd8a60163 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Calling method '.version_select at 0x7fe78c52a430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:51.118941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7930f2-9df1-40b1-b9ad-63fbd8a60163 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.119577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7930f2-9df1-40b1-b9ad-63fbd8a60163 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.120088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7930f2-9df1-40b1-b9ad-63fbd8a60163 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.136339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7930f2-9df1-40b1-b9ad-63fbd8a60163 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.136825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7930f2-9df1-40b1-b9ad-63fbd8a60163 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.137262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7930f2-9df1-40b1-b9ad-63fbd8a60163 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.144645 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a7930f2-9df1-40b1-b9ad-63fbd8a60163 tempest-HypervisorAdminV253TestBase-177917659 tempest-HypervisorAdminV253TestBase-177917659-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/ff33b665-66a5-4503-941c-a7b2a93bab37" status: 200 len: 794 microversion: 2.53 time: 0.034295 Nov 02 13:13:51.145275 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 70/123] 10.222.0.113 () {60 vars in 1303 bytes} [Wed Nov 2 13:13:51 2022] GET /compute/v2.1/os-hypervisors/ff33b665-66a5-4503-941c-a7b2a93bab37 => generated 794 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:13:51.152199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5be60bd5-88bf-4896-b762-edf20fb2c4e4 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:51.174603 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5be60bd5-88bf-4896-b762-edf20fb2c4e4 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1874196166" status: 202 len: 0 microversion: 2.1 time: 0.028262 Nov 02 13:13:51.175345 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 71/124] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:13:51 2022] DELETE /compute/v2.1/flavors/1874196166 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:51.184688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6e8fcac6-75e9-4ed3-b4d5-d645a1412245 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:51.210486 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6e8fcac6-75e9-4ed3-b4d5-d645a1412245 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.029857 Nov 02 13:13:51.212274 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 72/125] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:51 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:51.233413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f1aceaf8-d489-42ad-88d5-0a1eeb265d80 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1036571066", "id": 2049033056, "os-flavor-access:is_public": "False"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:51.254437 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f1aceaf8-d489-42ad-88d5-0a1eeb265d80 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 441 microversion: 2.1 time: 0.026306 Nov 02 13:13:51.255480 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 73/126] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:51 2022] POST /compute/v2.1/flavors => generated 441 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:51.268156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3926e3a5-5354-4969-9287-b93fac85220d tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:51.391569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:51.400318 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1848a0a-072a-455f-b825-011ddc0d3741 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.344119 Nov 02 13:13:51.404372 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 54/127] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:51 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:51.420178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:51.420801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:51.440440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.446859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.447148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.447962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:51.448957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:51.449394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:51.552438 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3926e3a5-5354-4969-9287-b93fac85220d tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/2049033056/action" status: 200 len: 97 microversion: 2.1 time: 0.288359 Nov 02 13:13:51.558217 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 74/128] 10.222.0.113 () {60 vars in 1205 bytes} [Wed Nov 2 13:13:51 2022] POST /compute/v2.1/flavors/2049033056/action => generated 97 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:13:51.570623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f5dd5c7-8f93-4e1b-b2b1-0fdfc8584113 tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:51.574919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f5dd5c7-8f93-4e1b-b2b1-0fdfc8584113 tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '38eefcc13ead443fb5926567f63ca0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa13a99a7e14339a3cf54d5a57b2f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f5dd5c7-8f93-4e1b-b2b1-0fdfc8584113 tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] Request method failure captured: Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/flavors/2049033056/action HTTP/1.1 Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 70 Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0IprG8wvwodQ1AtmuEY099eLEKdKteycC82zcBLxSEE0pXUgi73nsyueKecXrj1WEs2s3MpGibJcz64zxTKu7HWX2vBwmrhXvwwGCZgsNUbpi6klQP0aWwBb2KVs4YtJPokNnOTMZVP4JYFiEF6HeC37-wqF-85p4cyvaWa4_AWbs Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: afa13a99a7e14339a3cf54d5a57b2f0a Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-346166018 Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:13:51.580434 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/afa13a99a7e14339a3cf54d5a57b2f0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/afa13a99a7e14339a3cf54d5a57b2f0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_afa13a99a7e14339a3cf54d5a57b2f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/afa13a99a7e14339a3cf54d5a57b2f0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-346166018 Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: afa13a99a7e14339a3cf54d5a57b2f0a Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-346166018 Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FlavorsAccessNegativeTestJSON-346166018-project Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 38eefcc13ead443fb5926567f63ca0de Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-346166018-project Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: {"removeTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} Nov 02 13:13:51.581755 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '2049033056', 'body': {'removeTenantAccess': {'tenant': 'afa13a99a7e14339a3cf54d5a57b2f0a'}}} Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can( Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:13:51.582372 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 13:13:51.583443 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:13:51.585252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f5dd5c7-8f93-4e1b-b2b1-0fdfc8584113 tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:51.585252 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f5dd5c7-8f93-4e1b-b2b1-0fdfc8584113 tempest-FlavorsAccessNegativeTestJSON-346166018 tempest-FlavorsAccessNegativeTestJSON-346166018-project] 10.222.0.113 "POST /compute/v2.1/flavors/2049033056/action" status: 403 len: 133 microversion: 2.1 time: 0.016918 Nov 02 13:13:51.585252 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 75/129] 10.222.0.113 () {60 vars in 1205 bytes} [Wed Nov 2 13:13:51 2022] POST /compute/v2.1/flavors/2049033056/action => generated 133 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:13:51.594049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7e0a057-ac5f-41bf-aa58-17aa11a1f344 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "afa13a99a7e14339a3cf54d5a57b2f0a"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:51.768451 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7e0a057-ac5f-41bf-aa58-17aa11a1f344 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/2049033056/action" status: 200 len: 21 microversion: 2.1 time: 0.179130 Nov 02 13:13:51.770386 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 76/130] 10.222.0.113 () {60 vars in 1205 bytes} [Wed Nov 2 13:13:51 2022] POST /compute/v2.1/flavors/2049033056/action => generated 21 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:13:51.780884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:51.791661 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d7b41c8-207b-431b-bf24-c4fc0ec5f142 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.383866 Nov 02 13:13:51.792656 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 55/131] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:51 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:51.793910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f863642-eb4b-48e2-ae92-ef29f6827eff tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:51.814010 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f863642-eb4b-48e2-ae92-ef29f6827eff tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/2049033056" status: 202 len: 0 microversion: 2.1 time: 0.037609 Nov 02 13:13:51.814596 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 77/132] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:13:51 2022] DELETE /compute/v2.1/flavors/2049033056 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:13:51.823554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca89f8ee-cb34-4f52-91f8-55aeb20d51fe tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:51.850196 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca89f8ee-cb34-4f52-91f8-55aeb20d51fe tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.030732 Nov 02 13:13:51.851185 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 56/133] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:51 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:51.876079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6cc3ec38-a462-493b-858e-649ba7793c44 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1805330973", "id": 152882287, "os-flavor-access:is_public": "False"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:51.912119 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6cc3ec38-a462-493b-858e-649ba7793c44 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.042426 Nov 02 13:13:51.913326 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 78/134] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:51 2022] POST /compute/v2.1/flavors => generated 438 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:13:51.926457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f388a77-b075-4190-84c6-b32cb7666373 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "03024272f0474c57b5f0dfcae862db54"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:52.034419 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-9f388a77-b075-4190-84c6-b32cb7666373 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] HTTP exception thrown: Flavor access not found for 33 / 03024272f0474c57b5f0dfcae862db54 combination. Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f388a77-b075-4190-84c6-b32cb7666373 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Request method failure captured: Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/flavors/152882287/action HTTP/1.1 Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 70 Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0Lm-umAT6OmKta9vSJPeJx5o88my_8ELRHaPcDBtBHHqLluPeU1TFvvLKZco2T6imgWsbjfHnztZ2A0BV0la9J86PH3lU0aUTF2ATT-GocSYbTOCe7By7psVQpepm-bcmuo0D8WyfNhQ78JtXj-WTfcJFDIayKDx8ALTS2B-lvJNQ Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 35bd289024314d7caaa885e26a8b1ae8 Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-499107292 Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:13:52.039460 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/35bd289024314d7caaa885e26a8b1ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-499107292 Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 35bd289024314d7caaa885e26a8b1ae8 Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-499107292 Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 29ea4ec82b36480ab9aee2cb6a6dbb93 Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: {"removeTenantAccess": {"tenant": "03024272f0474c57b5f0dfcae862db54"}} Nov 02 13:13:52.040856 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: exception: Flavor access not found for 33 / 03024272f0474c57b5f0dfcae862db54 combination. Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '152882287', 'body': {'removeTenantAccess': {'tenant': '03024272f0474c57b5f0dfcae862db54'}}} Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Nov 02 13:13:52.041612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / 03024272f0474c57b5f0dfcae862db54 combination. Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / 03024272f0474c57b5f0dfcae862db54 combination. Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:52.042818 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:52.044675 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:52.044675 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:52.044675 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:13:52.044675 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:13:52.044675 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / 03024272f0474c57b5f0dfcae862db54 combination. Nov 02 13:13:52.044675 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:13:52.047578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f388a77-b075-4190-84c6-b32cb7666373 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Returning 404 to user: Flavor access not found for 33 / 03024272f0474c57b5f0dfcae862db54 combination. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:52.049601 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f388a77-b075-4190-84c6-b32cb7666373 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/152882287/action" status: 404 len: 124 microversion: 2.1 time: 0.126923 Nov 02 13:13:52.051077 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 57/135] 10.222.0.113 () {60 vars in 1202 bytes} [Wed Nov 2 13:13:51 2022] POST /compute/v2.1/flavors/152882287/action => generated 124 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:13:52.062960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0231bed0-f002-47fc-a8a9-27cc0549cb9b tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:52.098318 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0231bed0-f002-47fc-a8a9-27cc0549cb9b tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/152882287" status: 202 len: 0 microversion: 2.1 time: 0.042093 Nov 02 13:13:52.102244 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 79/136] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:13:52 2022] DELETE /compute/v2.1/flavors/152882287 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Nov 02 13:13:52.148890 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: ERROR sqlalchemy.pool.impl.QueuePool Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: Exception ignored in: . at 0x7fe78c243040> Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: Traceback (most recent call last): Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: and _finalize_fairy(None, rec, pool, ref, echo, True), Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: connection_record.checkin() Nov 02 13:13:52.150250 n-d-858384-19 devstack@n-api.service[120928]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Nov 02 13:13:52.151672 n-d-858384-19 devstack@n-api.service[120928]: pool.dispatch.checkin(connection, self) Nov 02 13:13:52.151672 n-d-858384-19 devstack@n-api.service[120928]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Nov 02 13:13:52.156239 n-d-858384-19 devstack@n-api.service[120928]: fn(*args, **kw) Nov 02 13:13:52.156239 n-d-858384-19 devstack@n-api.service[120928]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Nov 02 13:13:52.156475 n-d-858384-19 devstack@n-api.service[120928]: time.sleep(0) Nov 02 13:13:52.156475 n-d-858384-19 devstack@n-api.service[120928]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Nov 02 13:13:52.166061 n-d-858384-19 devstack@n-api.service[120928]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Nov 02 13:13:52.166061 n-d-858384-19 devstack@n-api.service[120928]: AssertionError: do not call blocking functions from the mainloop Nov 02 13:13:52.171686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4fa219f8-5e6e-417a-89be-1f1c286bf8f2 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:52.219251 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4fa219f8-5e6e-417a-89be-1f1c286bf8f2 tempest-FlavorsAccessNegativeTestJSON-499107292 tempest-FlavorsAccessNegativeTestJSON-499107292-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.115877 Nov 02 13:13:52.220677 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 58/137] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:13:52 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:52.433765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:52.435440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:52.470084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:52.471045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:52.471860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:52.475035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:52.475911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:52.476676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:52.817027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:52.817772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:52.827889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:52.828596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:52.829264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:52.834714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:52.835370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:52.836872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:53.060781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:53.072490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aa54463c-66e1-4661-92c0-b6ae7fccf9d6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.647446 Nov 02 13:13:53.073140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 80/138] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:52 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:53.489243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:53.503274 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-70b743d8-0746-4475-94ff-3e739a43546d tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.690594 Nov 02 13:13:53.504348 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 59/139] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:52 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:54.104271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:54.104895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:54.134438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:54.135278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:54.139568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:54.140601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:54.141881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:54.142477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:54.526275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:54.526894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:54.540025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:54.565543 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75e74af9-b63a-4c41-926a-6eb24ad1a237 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.468815 Nov 02 13:13:54.566628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:54.568400 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 81/140] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:54 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:54.583190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:54.583190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:54.583190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:54.583190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:54.583865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:55.051724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:55.068967 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-346dbfab-9244-4bf1-8102-0d02527588b2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.546437 Nov 02 13:13:55.078008 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 60/141] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:54 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:55.603888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:55.604610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:55.617562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:55.618282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:55.619673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:55.620598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:55.621217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:55.622943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:55.984867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:56.000323 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d070433f-b657-4396-91aa-483049e9a168 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.407412 Nov 02 13:13:56.002807 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 82/142] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:55 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:56.098500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:56.104700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:56.109057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:56.132740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:56.135755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:56.136406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:56.142767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:56.146504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:56.148079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:56.771918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:56.781852 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c2eacdb-cb9e-430a-b232-69cb221c32eb tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.687064 Nov 02 13:13:56.788059 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 61/143] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:56 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:57.027150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:57.027831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:57.040482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:57.040971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:57.041408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:57.042615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:57.043071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:57.047419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:57.391445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:57.406278 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e5b12964-e550-4e59-8b4d-e0e8a869bfaa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.377300 Nov 02 13:13:57.407128 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 83/144] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:57 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:57.739133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-730759700", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:57.806255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:57.812650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:57.826893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:13:57.832391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:57.832551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:57.832992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:57.835362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:57.835852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:57.839924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:58.255361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:58.267476 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-78a33918-bba2-492e-a73b-82cc1230aa92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.461013 Nov 02 13:13:58.270383 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 84/145] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:57 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:58.285561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:13:58.285993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:13:58.286536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:13:58.286842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:13:58.287297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:13:58.304666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:58.305153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:58.305585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:58.306310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:58.306771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:58.307211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:58.355099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Getting quotas for project 40d6720a9e154953b426a39100429327. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:13:58.364572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Getting quotas for user 0195abc2f8b24f46895a27d5ee2e8f7f and project 40d6720a9e154953b426a39100429327. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:13:58.389904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:13:58.392716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:13:58.430447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:58.431055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:58.446242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:58.446851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:58.447252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:58.448145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:58.448578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:58.451882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:58.462739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:58.492005 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d3b966b-7082-4311-99cf-09aaf70af41b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.006245 Nov 02 13:13:58.495659 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 62/146] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:13:57 2022] POST /compute/v2.1/servers => generated 382 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:13:58.507962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-14c6bfab-1239-4018-83ed-a157e68250cb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:58.508874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-14c6bfab-1239-4018-83ed-a157e68250cb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:58.738324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-14c6bfab-1239-4018-83ed-a157e68250cb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:58.773744 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-14c6bfab-1239-4018-83ed-a157e68250cb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1222 microversion: 2.1 time: 0.268524 Nov 02 13:13:58.775751 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 63/147] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:58 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1222 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:58.921100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:58.931990 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-37c8913d-9399-4b89-949f-2f8496c8f3ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.505631 Nov 02 13:13:58.933462 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 85/148] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:58 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:13:59.292275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:59.293364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:59.307456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:59.307961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:59.308564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:59.310029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:59.312118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:59.315532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:59.802752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:59.804124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:59.809217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:13:59.824167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:59.826921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:59.827573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:59.829009 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-233050e8-9e35-4496-9c30-cfc7178e68e4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.535906 Nov 02 13:13:59.829336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:59.831587 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 64/149] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:59 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:13:59.834054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:59.834672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:13:59.973304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:13:59.976452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:13:59.993064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:13:59.998465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:13:59.999278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:00.000235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:00.004615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:00.005567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:00.164778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:00.217819 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-61a1c590-769b-4f4d-8175-a4ab1477e26e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1218 microversion: 2.1 time: 0.422398 Nov 02 13:14:00.226460 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 86/150] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:59 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1218 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:00.656000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:00.679532 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aec98c3c-af0f-498e-a876-c128836df209 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.720414 Nov 02 13:14:00.681601 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 65/151] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:13:59 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:00.866142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:00.866766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:00.884629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:00.885265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:00.886954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:00.887834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:00.893479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:00.893875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:01.204733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:01.225459 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d583e9af-ac9f-4aea-978b-c9b778bd6c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.368785 Nov 02 13:14:01.229392 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 87/152] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:00 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:01.254256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:01.278084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:01.299671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:01.300598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:01.301832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:01.302967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:01.304033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:01.304636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:01.460284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:01.477598 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e89c7f17-51b3-42ec-b67a-b8e848e898ed tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1280 microversion: 2.1 time: 0.233449 Nov 02 13:14:01.478254 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 66/153] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:01 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1280 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:01.709939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:01.710688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:01.725164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:01.727999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:01.728525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:01.729283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:01.729739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:01.730174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:02.016011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c0240444-6825-43f1-8bb3-6e724879e236 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1450956124", "ram": 512, "vcpus": 1, "disk": 10, "id": 735712268, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:02.070442 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c0240444-6825-43f1-8bb3-6e724879e236 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.765595 Nov 02 13:14:02.071004 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 88/154] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:14:01 2022] POST /compute/v2.1/flavors => generated 415 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:02.145475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:02.158630 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c67a95b2-8fa3-4af7-a24a-02ebae33785b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.455733 Nov 02 13:14:02.175158 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 67/155] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:01 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:02.256712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:02.258299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:02.268897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:02.269968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:02.291977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:02.292949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:02.293562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:02.294877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:02.328110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5f028a5-3158-4f29-bf5f-ee50a203a373 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:02.345257 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e5f028a5-3158-4f29-bf5f-ee50a203a373 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] HTTP exception thrown: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5f028a5-3158-4f29-bf5f-ee50a203a373 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Request method failure captured: Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/flavors/735712268/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0XrazLFytmrbemr8lIq_FPWB1E34xNA9YURtdBnqewWyBrjkePUMO69rIqIyEG0FiiT5qLDLYX4dISSa-3SCeSxvXW8sqJ0ZwnN3fZHzQr2xL_5xeE-LCUy5sy20C4bP0tDOslcAHaCDje7u7XOeRcpzp1TmH8OywfjoGa2Fd6zoI Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8eff4976feb8435dbd487a9e82bb0b4b Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:14:02.347436 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8eff4976feb8435dbd487a9e82bb0b4b Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: de97c88e849846b3b01d80c26268aba0 Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:14:02.348775 n-d-858384-19 devstack@n-api.service[120929]: exception: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'flavor_id': '735712268', 'id': 'hw:cpu_thread_policy'} Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.349454 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.350655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.350655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.350655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.350655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:02.350655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:02.350655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:14:02.350655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.360332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5f028a5-3158-4f29-bf5f-ee50a203a373 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Returning 404 to user: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:02.361873 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e5f028a5-3158-4f29-bf5f-ee50a203a373 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] 10.222.0.113 "GET /compute/v2.1/flavors/735712268/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.280097 Nov 02 13:14:02.363755 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 89/156] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:14:02 2022] GET /compute/v2.1/flavors/735712268/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:02.378575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51ff2b8f-afd8-4146-92b5-22901739bc11 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:02.393534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51ff2b8f-afd8-4146-92b5-22901739bc11 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'de97c88e849846b3b01d80c26268aba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eff4976feb8435dbd487a9e82bb0b4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51ff2b8f-afd8-4146-92b5-22901739bc11 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Request method failure captured: Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/flavors/735712268/os-extra_specs HTTP/1.1 Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 66 Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0XrazLFytmrbemr8lIq_FPWB1E34xNA9YURtdBnqewWyBrjkePUMO69rIqIyEG0FiiT5qLDLYX4dISSa-3SCeSxvXW8sqJ0ZwnN3fZHzQr2xL_5xeE-LCUy5sy20C4bP0tDOslcAHaCDje7u7XOeRcpzp1TmH8OywfjoGa2Fd6zoI Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8eff4976feb8435dbd487a9e82bb0b4b Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:14:02.399226 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8eff4976feb8435dbd487a9e82bb0b4b Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: de97c88e849846b3b01d80c26268aba0 Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Nov 02 13:14:02.400475 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'flavor_id': '735712268', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:02.401172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 13:14:02.402404 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.403753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51ff2b8f-afd8-4146-92b5-22901739bc11 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:02.404690 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51ff2b8f-afd8-4146-92b5-22901739bc11 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] 10.222.0.113 "POST /compute/v2.1/flavors/735712268/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.035573 Nov 02 13:14:02.408618 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 90/157] 10.222.0.113 () {60 vars in 1226 bytes} [Wed Nov 2 13:14:02 2022] POST /compute/v2.1/flavors/735712268/os-extra_specs => generated 124 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:14:02.424727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf1c0488-c416-4e28-88b7-4d6af3c7fadd tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:02.499105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=8,nova_api:DELETE=13,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:02.514174 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf1c0488-c416-4e28-88b7-4d6af3c7fadd tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/735712268/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.097456 Nov 02 13:14:02.523460 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 91/158] 10.222.0.113 () {60 vars in 1226 bytes} [Wed Nov 2 13:14:02 2022] POST /compute/v2.1/flavors/735712268/os-extra_specs => generated 66 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:14:02.535920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:02.536851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:02.551011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:02.553354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:02.555679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:02.557238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:02.557609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:02.558049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:02.581128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:02.616084 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af2eda7d-51d9-4c51-80ab-e65208f2af77 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.365181 Nov 02 13:14:02.616516 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 68/159] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:02 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:02.627479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f31a67b-2024-4ef3-b84d-57c33be85421 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:02.638726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f31a67b-2024-4ef3-b84d-57c33be85421 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'de97c88e849846b3b01d80c26268aba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eff4976feb8435dbd487a9e82bb0b4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f31a67b-2024-4ef3-b84d-57c33be85421 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Request method failure captured: Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0XrazLFytmrbemr8lIq_FPWB1E34xNA9YURtdBnqewWyBrjkePUMO69rIqIyEG0FiiT5qLDLYX4dISSa-3SCeSxvXW8sqJ0ZwnN3fZHzQr2xL_5xeE-LCUy5sy20C4bP0tDOslcAHaCDje7u7XOeRcpzp1TmH8OywfjoGa2Fd6zoI Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8eff4976feb8435dbd487a9e82bb0b4b Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:02.645887 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8eff4976feb8435dbd487a9e82bb0b4b Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: de97c88e849846b3b01d80c26268aba0 Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:02.647589 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'flavor_id': '735712268', 'id': 'hw:numa_nodes'} Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:02.648206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.654305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f31a67b-2024-4ef3-b84d-57c33be85421 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:02.655325 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8f31a67b-2024-4ef3-b84d-57c33be85421 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] 10.222.0.113 "DELETE /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.029773 Nov 02 13:14:02.655325 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 69/160] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:14:02 2022] DELETE /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes => generated 124 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:02.662426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34611970-5459-49ae-adc6-defa60624490 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:02.680066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:02.690636 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4053dd1c-3a08-4e9c-82ce-8ee2c8298261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1280 microversion: 2.1 time: 0.165982 Nov 02 13:14:02.691690 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 92/161] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:02 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1280 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:02.716701 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34611970-5459-49ae-adc6-defa60624490 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/735712268/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059423 Nov 02 13:14:02.722055 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 70/162] 10.222.0.113 () {60 vars in 1226 bytes} [Wed Nov 2 13:14:02 2022] POST /compute/v2.1/flavors/735712268/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:14:02.728954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a3b43a9e-0644-4c7b-9da7-f5aab1a432a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:02.736769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a3b43a9e-0644-4c7b-9da7-f5aab1a432a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'de97c88e849846b3b01d80c26268aba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eff4976feb8435dbd487a9e82bb0b4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a3b43a9e-0644-4c7b-9da7-f5aab1a432a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Request method failure captured: Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: request: PUT /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 22 Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0XrazLFytmrbemr8lIq_FPWB1E34xNA9YURtdBnqewWyBrjkePUMO69rIqIyEG0FiiT5qLDLYX4dISSa-3SCeSxvXW8sqJ0ZwnN3fZHzQr2xL_5xeE-LCUy5sy20C4bP0tDOslcAHaCDje7u7XOeRcpzp1TmH8OywfjoGa2Fd6zoI Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8eff4976feb8435dbd487a9e82bb0b4b Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:14:02.739843 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8eff4976feb8435dbd487a9e82bb0b4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8eff4976feb8435dbd487a9e82bb0b4b Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: de97c88e849846b3b01d80c26268aba0 Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: {"hw:numa_nodes": "1"} Nov 02 13:14:02.741312 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'flavor_id': '735712268', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:02.742082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 13:14:02.743387 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.744900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a3b43a9e-0644-4c7b-9da7-f5aab1a432a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:02.746089 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a3b43a9e-0644-4c7b-9da7-f5aab1a432a0 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400 tempest-FlavorsExtraSpecsNegativeTestJSON-1698912400-project] 10.222.0.113 "PUT /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022531 Nov 02 13:14:02.754373 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 93/163] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:14:02 2022] PUT /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:02.763324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8945c8a0-f1ae-4c1f-9e29-4dca4546e9c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:02.805352 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-8945c8a0-f1ae-4c1f-9e29-4dca4546e9c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] HTTP exception thrown: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8945c8a0-f1ae-4c1f-9e29-4dca4546e9c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Request method failure captured: Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/flavors/735712268/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0ZI_z6v9lnZIEsjvpYtogFWHbt47RB0He_NhO8OyncTdK9gAY5_HLpdyKC-etDdFEt-TXICrsfAjkkdvBqTVqnTH7GLp3d-y0jIbDGd6RL1CZdNTmdcDDzxlDlO3lnHF_RdbcBWGovDx8zTxxCk8qDO0RfI-f4alrgMrM_HG5pQPg Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 93801db7bc2745f2867d43af287f73a8 Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:02.806789 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/93801db7bc2745f2867d43af287f73a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/93801db7bc2745f2867d43af287f73a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_93801db7bc2745f2867d43af287f73a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/93801db7bc2745f2867d43af287f73a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 93801db7bc2745f2867d43af287f73a8 Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: bce064e594084e1d9e251cc5c4f68bb6 Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:02.808161 n-d-858384-19 devstack@n-api.service[120928]: exception: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'flavor_id': '735712268', 'id': 'hw:cpu_thread_policy'} Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.808900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.811184 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.811184 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.811184 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.811184 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:02.811184 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:02.811184 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. Nov 02 13:14:02.811184 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.811184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8945c8a0-f1ae-4c1f-9e29-4dca4546e9c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Returning 404 to user: Flavor 735712268 has no extra specs with key hw:cpu_thread_policy. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:02.811184 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8945c8a0-f1ae-4c1f-9e29-4dca4546e9c3 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/735712268/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.054690 Nov 02 13:14:02.818858 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 71/164] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:14:02 2022] DELETE /compute/v2.1/flavors/735712268/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:02.832772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b8f3fdc-5120-4cb5-acc0-6336061e1324 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:02.847349 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-1b8f3fdc-5120-4cb5-acc0-6336061e1324 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b8f3fdc-5120-4cb5-acc0-6336061e1324 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Request method failure captured: Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 27 Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0ZI_z6v9lnZIEsjvpYtogFWHbt47RB0He_NhO8OyncTdK9gAY5_HLpdyKC-etDdFEt-TXICrsfAjkkdvBqTVqnTH7GLp3d-y0jIbDGd6RL1CZdNTmdcDDzxlDlO3lnHF_RdbcBWGovDx8zTxxCk8qDO0RfI-f4alrgMrM_HG5pQPg Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 93801db7bc2745f2867d43af287f73a8 Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:02.848749 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/93801db7bc2745f2867d43af287f73a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/93801db7bc2745f2867d43af287f73a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_93801db7bc2745f2867d43af287f73a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/93801db7bc2745f2867d43af287f73a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 93801db7bc2745f2867d43af287f73a8 Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: bce064e594084e1d9e251cc5c4f68bb6 Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: {"hw:cpu_policy": "shared"} Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:02.850122 n-d-858384-19 devstack@n-api.service[120928]: exception: Request body and URI mismatch Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'flavor_id': '735712268', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.850936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.852229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:02.852229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:02.852229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Nov 02 13:14:02.852229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.852229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b8f3fdc-5120-4cb5-acc0-6336061e1324 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:02.852229 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b8f3fdc-5120-4cb5-acc0-6336061e1324 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] 10.222.0.113 "PUT /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.028693 Nov 02 13:14:02.852229 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 72/165] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:14:02 2022] PUT /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes => generated 73 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:14:02.865908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c40bace-b7c2-4048-955c-cd570ec2b27f tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c40bace-b7c2-4048-955c-cd570ec2b27f tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Request method failure captured: Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 49 Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0ZI_z6v9lnZIEsjvpYtogFWHbt47RB0He_NhO8OyncTdK9gAY5_HLpdyKC-etDdFEt-TXICrsfAjkkdvBqTVqnTH7GLp3d-y0jIbDGd6RL1CZdNTmdcDDzxlDlO3lnHF_RdbcBWGovDx8zTxxCk8qDO0RfI-f4alrgMrM_HG5pQPg Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 93801db7bc2745f2867d43af287f73a8 Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:02.876940 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/93801db7bc2745f2867d43af287f73a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/93801db7bc2745f2867d43af287f73a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_93801db7bc2745f2867d43af287f73a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/93801db7bc2745f2867d43af287f73a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 93801db7bc2745f2867d43af287f73a8 Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: bce064e594084e1d9e251cc5c4f68bb6 Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Nov 02 13:14:02.878419 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'flavor_id': '735712268', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': ['string', Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'number']}}, Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance: Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Nov 02 13:14:02.879421 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.880782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:02.881902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:02.881902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:02.881902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:14:02.881902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:14:02.881902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 13:14:02.881902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:02.881902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c40bace-b7c2-4048-955c-cd570ec2b27f tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:02.881902 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3c40bace-b7c2-4048-955c-cd570ec2b27f tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] 10.222.0.113 "PUT /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017407 Nov 02 13:14:02.881902 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 73/166] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:14:02 2022] PUT /compute/v2.1/flavors/735712268/os-extra_specs/hw:numa_nodes => generated 117 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:14:02.919937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b59bbc1-f804-472d-8421-cf81b96e6544 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:02.943714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:02.955296 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b59bbc1-f804-472d-8421-cf81b96e6544 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/735712268" status: 202 len: 0 microversion: 2.1 time: 0.066671 Nov 02 13:14:02.959070 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 74/167] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:14:02 2022] DELETE /compute/v2.1/flavors/735712268 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:02.976862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8f76291-a6c3-44a9-995e-f823cf23ded0 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:02.984917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6936c671-d54e-4ad8-81bc-f75a196d5a46 req-14a05116-2afa-4c28-9117-5c07c126218b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f064c9b8-b625-48ff-8f68-3558f114b880", "name": "network-vif-plugged", "status": "completed", "tag": "3a492517-0fec-4dbf-97c0-c2da2452ac56"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:03.014036 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b8f76291-a6c3-44a9-995e-f823cf23ded0 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768 tempest-FlavorsExtraSpecsNegativeTestJSON-1226865768-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.047812 Nov 02 13:14:03.015466 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 75/168] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:14:02 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:03.048627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6936c671-d54e-4ad8-81bc-f75a196d5a46 req-14a05116-2afa-4c28-9117-5c07c126218b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:03.049690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6936c671-d54e-4ad8-81bc-f75a196d5a46 req-14a05116-2afa-4c28-9117-5c07c126218b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:03.050283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6936c671-d54e-4ad8-81bc-f75a196d5a46 req-14a05116-2afa-4c28-9117-5c07c126218b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:03.078435 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6936c671-d54e-4ad8-81bc-f75a196d5a46 req-14a05116-2afa-4c28-9117-5c07c126218b service nova] Creating event network-vif-plugged:3a492517-0fec-4dbf-97c0-c2da2452ac56 for instance f064c9b8-b625-48ff-8f68-3558f114b880 on n-h2-858384-19 Nov 02 13:14:03.079261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6936c671-d54e-4ad8-81bc-f75a196d5a46 req-14a05116-2afa-4c28-9117-5c07c126218b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:14:03.079811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6936c671-d54e-4ad8-81bc-f75a196d5a46 req-14a05116-2afa-4c28-9117-5c07c126218b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:14:03.081097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a9f594-a855-4993-ae6f-1aad38d46011 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:03.081783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a9f594-a855-4993-ae6f-1aad38d46011 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:03.096778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a9f594-a855-4993-ae6f-1aad38d46011 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:03.101791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a9f594-a855-4993-ae6f-1aad38d46011 None None] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:03.102378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a9f594-a855-4993-ae6f-1aad38d46011 None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:03.102891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a9f594-a855-4993-ae6f-1aad38d46011 None None] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:03.124415 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.rpcapi [None req-68a9f594-a855-4993-ae6f-1aad38d46011 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Nov 02 13:14:03.125778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a9f594-a855-4993-ae6f-1aad38d46011 None None] Releasing lock "compute-rpcapi-router" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:14:03.143436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-68a9f594-a855-4993-ae6f-1aad38d46011 None None] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340375 Nov 02 13:14:03.144158 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 94/169] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:03.186280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:03.187922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:03.197403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:03.198705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:03.199806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:03.201316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:03.201955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:03.202546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:03.208946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:03.643856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:03.644769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:03.655014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:03.655879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:03.656471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:03.680462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:03.681907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:03.683878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:04.228434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:04.245457 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-970e276e-f6c4-4379-af74-1fba5e2c17a3 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 1.064699 Nov 02 13:14:04.265504 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 76/170] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:03 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:04.279959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:04.294343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:04.300810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:04.301301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:04.301757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:04.302473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:04.302926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:04.303378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:04.468756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:04.486290 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da07346a-ab31-4b97-a877-274caa5071d8 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1280 microversion: 2.1 time: 0.213246 Nov 02 13:14:04.487018 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 77/171] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:04 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:04.500825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:04.521462 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f3407e0e-06f0-43a5-91ae-8e4ac5f66c79 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.886118 Nov 02 13:14:04.522393 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 95/172] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:03 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:05.167601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3f7b8110-b581-435a-8ac9-4253ecab2478 req-0e191043-5f3f-4ae6-8d55-752a19cb2bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342f003f-a39c-4185-878f-26cf14c103e0", "name": "network-vif-plugged", "status": "completed", "tag": "8a22b512-6909-482b-adf4-db703a91c0e6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:05.189624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3f7b8110-b581-435a-8ac9-4253ecab2478 req-0e191043-5f3f-4ae6-8d55-752a19cb2bad service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:05.190088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3f7b8110-b581-435a-8ac9-4253ecab2478 req-0e191043-5f3f-4ae6-8d55-752a19cb2bad service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:05.190445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3f7b8110-b581-435a-8ac9-4253ecab2478 req-0e191043-5f3f-4ae6-8d55-752a19cb2bad service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:05.207787 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3f7b8110-b581-435a-8ac9-4253ecab2478 req-0e191043-5f3f-4ae6-8d55-752a19cb2bad service nova] Creating event network-vif-plugged:8a22b512-6909-482b-adf4-db703a91c0e6 for instance 342f003f-a39c-4185-878f-26cf14c103e0 on n-h2-858384-19 Nov 02 13:14:05.216968 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3f7b8110-b581-435a-8ac9-4253ecab2478 req-0e191043-5f3f-4ae6-8d55-752a19cb2bad service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054094 Nov 02 13:14:05.224087 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 78/173] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:05.272537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:05.272995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:05.284969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:05.285587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:05.285986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:05.286591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:05.287040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:05.287505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:05.511442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:05.513077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:05.522421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:05.523175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:05.523384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:05.524471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:05.524936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:05.525370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:05.709372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:05.719492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94d5e410-8eeb-4c8e-b4a9-08d3c87d018c tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.451534 Nov 02 13:14:05.731546 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 96/174] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:05 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:05.741089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:05.741873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:05.755293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:05.755803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:05.756468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:05.757310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:05.757867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:05.758371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:05.941992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:05.969544 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8b70b6f0-1b6e-4d2e-aa7e-01ef2155ab5d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1280 microversion: 2.1 time: 0.461366 Nov 02 13:14:05.977288 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 79/175] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:05 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1280 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:06.117649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:06.130260 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e7290b2-c5b9-43df-855e-363a93d545bf tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.395865 Nov 02 13:14:06.134521 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 97/176] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:05 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:06.751144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:06.752612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:06.767436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:06.768178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:06.769730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:06.781968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:06.782736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:06.783371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:06.992721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:06.993332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:07.000326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:07.001187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:07.001796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:07.002643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:07.003316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:07.003886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:07.100443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:07.126002 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-28598435-b13d-43cf-9aa4-62c0d9e5c6dd tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1280 microversion: 2.1 time: 0.135584 Nov 02 13:14:07.127019 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 98/177] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:06 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:07.134568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:07.146489 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5f0786d9-b99a-4822-ab57-341e68886a24 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1345 microversion: 2.1 time: 0.403069 Nov 02 13:14:07.147761 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 80/178] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:06 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1345 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:07.159816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:07.161273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:07.170913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:07.174884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:07.175811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:07.176860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:07.177639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:07.178305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:07.510474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:07.540599 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9886dcad-373b-47e9-a42d-b6915fe4263c tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1343 microversion: 2.1 time: 0.385576 Nov 02 13:14:07.542817 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 99/179] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:07 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1343 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:08.155726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:08.160219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:08.177869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:08.178505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:08.198209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:08.198945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:08.199393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:08.200457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:08.200902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:08.201631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:08.202081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:08.202505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:08.204896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:08.205623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:08.206089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:08.206516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:08.336888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:08.379599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:08.388868 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-073695e1-9c71-442d-9c7b-c61713cf098b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1280 microversion: 2.1 time: 0.240859 Nov 02 13:14:08.393215 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 81/180] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:08 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:08.569533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:08.570491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:08.582466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:08.583269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:08.584594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:08.586158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:08.588908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:08.589511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:08.759240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:09.393207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:09.417298 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fae5e3e2-f35c-4205-83f6-b5bb5d8ff17e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1494 microversion: 2.1 time: 1.246629 Nov 02 13:14:09.440661 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 100/181] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:08 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1494 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:09.461958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:09.463476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:09.525003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:09.525510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:09.525967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:09.526668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:09.527156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:09.527585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:09.614460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:09.628442 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1f18c75-b472-423e-85ee-fb4c0475e848 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1492 microversion: 2.1 time: 1.059829 Nov 02 13:14:09.643851 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 82/182] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:08 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1492 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:09.694482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:09.705362 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-917f16c4-d68a-435f-b19d-0eb515b5f99e tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1280 microversion: 2.1 time: 0.261122 Nov 02 13:14:09.706743 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 101/183] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:09 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1280 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:09.713758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5059a0bc-2d83-400c-9246-debee66d52dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:09.718969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5059a0bc-2d83-400c-9246-debee66d52dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:09.750601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5059a0bc-2d83-400c-9246-debee66d52dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:09.751105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5059a0bc-2d83-400c-9246-debee66d52dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:09.751597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5059a0bc-2d83-400c-9246-debee66d52dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:09.752709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5059a0bc-2d83-400c-9246-debee66d52dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:09.752815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5059a0bc-2d83-400c-9246-debee66d52dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:09.753175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5059a0bc-2d83-400c-9246-debee66d52dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:10.254423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:10.254923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:10.265557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:10.266062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:10.266509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:10.267276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:10.272900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:10.273499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:10.758756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:14:11.045482 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-047b9247-514b-4ca2-bbcd-55556773e03a tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] 10.222.0.113 "DELETE /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 204 len: 0 microversion: 2.1 time: 1.399950 Nov 02 13:14:11.046044 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 83/184] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:14:09 2022] DELETE /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 0 bytes in 1401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:14:11.100894 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5059a0bc-2d83-400c-9246-debee66d52dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1645 microversion: 2.1 time: 1.392885 Nov 02 13:14:11.109248 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 102/185] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:09 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1645 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:11.120363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:11.125103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:11.142584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:11.143338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:11.144154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:11.147394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:11.148018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:11.148786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:11.172134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e05458b-8bec-4303-ba62-4f6fa960ac34 tempest-QuotaClassesAdmin257Test-110445344 tempest-QuotaClassesAdmin257Test-110445344-project-admin] Calling method '.version_select at 0x7fe78c1164c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:11.193275 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5e05458b-8bec-4303-ba62-4f6fa960ac34 tempest-QuotaClassesAdmin257Test-110445344 tempest-QuotaClassesAdmin257Test-110445344-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.145534 Nov 02 13:14:11.202132 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 84/186] 10.222.0.113 () {60 vars in 1231 bytes} [Wed Nov 2 13:14:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:11.208027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:11.209034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:11.216787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:11.217393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:11.218510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:11.218622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:11.219208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:11.219695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:11.343433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:11.352155 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0737612b-8aa5-4395-8ede-04e0857ff1b6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1280 microversion: 2.1 time: 0.241714 Nov 02 13:14:11.359927 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 103/187] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:11 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1280 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:11.365006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:11.367768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:11.384881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:11.388867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:11.393615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:11.394404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:11.394865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:11.395344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:11.459930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:14:11.699205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:11.710218 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce0dd216-ee9c-4b52-9e54-707f2b4a276b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1500 microversion: 2.1 time: 0.506609 Nov 02 13:14:11.734027 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 85/188] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:11 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1500 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:11.748636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3780ed47-6d26-4876-acc8-16534d4ca765 tempest-QuotaClassesAdmin257Test-110445344 tempest-QuotaClassesAdmin257Test-110445344-project-admin] Action: 'update', calling method: .version_select at 0x7fe78c1168b0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:12.120941 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6f6bca2-d3e4-4917-b06c-71c2564fb0de tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 204 len: 0 microversion: 2.1 time: 0.758648 Nov 02 13:14:12.126565 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 104/189] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:14:11 2022] DELETE /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:14:12.153564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:12.167021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:12.197668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:12.198980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:12.200261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:12.202739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:12.203487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:12.206021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:12.247583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:12.259926 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3780ed47-6d26-4876-acc8-16534d4ca765 tempest-QuotaClassesAdmin257Test-110445344 tempest-QuotaClassesAdmin257Test-110445344-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.523858 Nov 02 13:14:12.263376 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 86/190] 10.222.0.113 () {62 vars in 1252 bytes} [Wed Nov 2 13:14:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:12.279326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3179f31f-3941-4c66-a96a-0c8de09ec922 tempest-QuotaClassesAdmin257Test-110445344 tempest-QuotaClassesAdmin257Test-110445344-project-admin] Calling method '.version_select at 0x7fe78c0e43a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:12.303497 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3179f31f-3941-4c66-a96a-0c8de09ec922 tempest-QuotaClassesAdmin257Test-110445344 tempest-QuotaClassesAdmin257Test-110445344-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.032692 Nov 02 13:14:12.317142 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 87/191] 10.222.0.113 () {60 vars in 1231 bytes} [Wed Nov 2 13:14:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:12.322003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4fa3427c-656f-4f37-b1c4-6bc4ac9f901d tempest-QuotaClassesAdmin257Test-110445344 tempest-QuotaClassesAdmin257Test-110445344-project-admin] Action: 'update', calling method: .version_select at 0x7fe78c0cc790>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:12.461794 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4fa3427c-656f-4f37-b1c4-6bc4ac9f901d tempest-QuotaClassesAdmin257Test-110445344 tempest-QuotaClassesAdmin257Test-110445344-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.143211 Nov 02 13:14:12.462469 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 88/192] 10.222.0.113 () {62 vars in 1252 bytes} [Wed Nov 2 13:14:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:12.475754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:12.476475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:12.493017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:12.495665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:12.496103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:12.498975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:12.499825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:12.500763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:12.626369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:12.640107 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-545e3627-b0fc-4d5c-a9e1-b4c8f30451ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1280 microversion: 2.1 time: 0.175754 Nov 02 13:14:12.640735 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 89/193] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:12 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:12.741283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:12.741926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:12.760833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:12.763634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:12.765746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:12.768202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:12.774186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:12.776698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:13.092452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:13.095503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:13.103431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2ea092ff-fdf0-48f7-83d1-a17ed191a3b4 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1498 microversion: 2.1 time: 0.975036 Nov 02 13:14:13.104015 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 105/194] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:12 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1498 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:13.104140 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5b7ec6ac-6cec-4190-aad3-808bb4715f0b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1500 microversion: 2.1 time: 0.369216 Nov 02 13:14:13.104731 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 90/195] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:12 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1500 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:13.404048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-764304557", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "d4fa706d-0b70-4668-8feb-3fb6d614d14b"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:13.521083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] validate_networks() for [('d4fa706d-0b70-4668-8feb-3fb6d614d14b', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:14:13.663961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:13.664576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:13.666426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:13.674947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:13.675551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:13.675907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:13.676606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:13.687899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:13.688590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:14.358093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:14.366943 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0af46f9-2fdb-4c59-abf8-c87ccbe6ee14 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.706854 Nov 02 13:14:14.381860 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 106/196] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:13 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:14.394964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:14.395829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:14.404589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:14.405311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:14.405905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:14.406778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:14.407436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:14.408011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:15.006276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:14:15.009989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:14:15.011256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:14:15.013769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:14:15.014562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:14:15.036387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:15.036797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:15.039134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:15.041817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:15.042486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:15.043071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:15.095646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:15.102005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for project d89e00efbe3c49019171062c5e914dc9. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:15.109192 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d759901f-4622-40f4-9ee3-f62c4f197c51 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1498 microversion: 2.1 time: 0.725525 Nov 02 13:14:15.110806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 107/197] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:14 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1498 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:15.129302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:15.130940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:15.145655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:15.145885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for user 4b987e6d2a814bc6b30b8191cfd5351d and project d89e00efbe3c49019171062c5e914dc9. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:15.146334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:15.146872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:15.149636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:15.150361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:15.150967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:15.175314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=15,nova_api:INSERT=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:15.186355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:14:15.189093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:14:15.341063 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01f80545-7b81-416f-8b10-2e1f81ff0372 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 2.234968 Nov 02 13:14:15.341836 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 91/198] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:14:13 2022] POST /compute/v2.1/servers => generated 382 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:14:15.354531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5c143009-669e-499d-8ea4-50a9468244dd req-fac6d18d-5d9d-4d5c-82df-1ca50dd25a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342f003f-a39c-4185-878f-26cf14c103e0", "name": "network-vif-deleted", "tag": "8a22b512-6909-482b-adf4-db703a91c0e6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:15.384611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5c143009-669e-499d-8ea4-50a9468244dd req-fac6d18d-5d9d-4d5c-82df-1ca50dd25a2b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:15.385981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5c143009-669e-499d-8ea4-50a9468244dd req-fac6d18d-5d9d-4d5c-82df-1ca50dd25a2b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:15.386592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5c143009-669e-499d-8ea4-50a9468244dd req-fac6d18d-5d9d-4d5c-82df-1ca50dd25a2b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:15.423688 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5c143009-669e-499d-8ea4-50a9468244dd req-fac6d18d-5d9d-4d5c-82df-1ca50dd25a2b service nova] Creating event network-vif-deleted:8a22b512-6909-482b-adf4-db703a91c0e6 for instance 342f003f-a39c-4185-878f-26cf14c103e0 on n-h2-858384-19 Nov 02 13:14:15.432935 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5c143009-669e-499d-8ea4-50a9468244dd req-fac6d18d-5d9d-4d5c-82df-1ca50dd25a2b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088855 Nov 02 13:14:15.434691 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 92/199] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:15.442127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d501ebe2-3c7a-4b82-b802-f9eb514c83b5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:15.443216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d501ebe2-3c7a-4b82-b802-f9eb514c83b5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:15.524995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d501ebe2-3c7a-4b82-b802-f9eb514c83b5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:15.536383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d501ebe2-3c7a-4b82-b802-f9eb514c83b5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:15.538716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d501ebe2-3c7a-4b82-b802-f9eb514c83b5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:15.540653 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d501ebe2-3c7a-4b82-b802-f9eb514c83b5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1265 microversion: 2.25 time: 0.104105 Nov 02 13:14:15.541630 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 93/200] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:15 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:15.542809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:15.548396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:15.549438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:15.558049 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3dcb6760-43bc-41e8-93b6-79803b964c4e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 200 len: 1458 microversion: 2.1 time: 0.446186 Nov 02 13:14:15.558462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:15.558628 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 108/201] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:15 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 1458 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:15.578551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:15.579898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:15.580988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:15.581808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:15.582540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:15.810468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:15.819498 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-212f5d7f-1c65-460c-8ead-44177ba4af0f tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.276527 Nov 02 13:14:15.823152 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 94/202] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:15 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:16.138503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:16.139185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:16.148863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:16.149348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:16.149778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:16.150475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:16.150922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:16.151374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:16.570569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:16.571790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:16.584628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:16.586328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:16.588596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:16.591303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:16.591805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:16.592240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:16.694449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:16.706092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:16.709709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:16.718118 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f33fcb49-71af-43c1-ba54-f73bc84b51b1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1261 microversion: 2.25 time: 0.151278 Nov 02 13:14:16.721543 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 95/203] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:16 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:16.732370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:16.736237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:16.753234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:16.756629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:16.758500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:16.759443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:16.762515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:16.765304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:16.806214 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] HTTP exception thrown: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Request method failure captured: Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 HTTP/1.1 Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4QLDM8r9-NilJbHTqr8DOvD7tDDiXeOyXzszo40EsY3_oZ7c9MMbnIezgpaGb8-csD0TuPU66_aKr3ZpLo2YcfGIX82OA_Zvt9n-LQy4MtXcATjlqyT4WfRFEHmSmtIVbE5k-fydqy8CcsXxfXTHluMlaY4q4oInRhVdKAbE0eaw Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:16.820099 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 908d4af5549b42d983c53229ad84e588 Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:16.821403 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '342f003f-a39c-4185-878f-26cf14c103e0'} Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:16.822146 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:16.823727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:16.826810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Returning 404 to user: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:16.831825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6912b7a0-5033-4219-a80c-0a0a0a1d1f5d tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 404 len: 111 microversion: 2.1 time: 0.109054 Nov 02 13:14:16.835572 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 96/204] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:16 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:16.851259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:16.852081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:16.864774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:16.867794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:16.868421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:16.870309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:16.870769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:16.873116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:17.174880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:17.186529 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-312237bc-05e4-4c59-a9d9-e9505de5523a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.344488 Nov 02 13:14:17.187172 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 97/205] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:16 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:17.210998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1538636477", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:17.228229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f05bd7be4364470b47f8de48a29636a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060da8c8e0ef485bac2056ad1de33e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:17.244834 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0619d07f-928e-43ee-97ac-5cee4b604980 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 200 len: 1456 microversion: 2.1 time: 1.109025 Nov 02 13:14:17.246162 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 109/206] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:16 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 1456 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:17.267151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3748af39-06ae-4ed6-baf5-2ba9b2a24742 req-cb823d42-0419-4da6-95e8-64970b4e274f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f064c9b8-b625-48ff-8f68-3558f114b880", "name": "network-vif-deleted", "tag": "3a492517-0fec-4dbf-97c0-c2da2452ac56"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:17.299097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3748af39-06ae-4ed6-baf5-2ba9b2a24742 req-cb823d42-0419-4da6-95e8-64970b4e274f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:17.303812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3748af39-06ae-4ed6-baf5-2ba9b2a24742 req-cb823d42-0419-4da6-95e8-64970b4e274f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:17.313721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3748af39-06ae-4ed6-baf5-2ba9b2a24742 req-cb823d42-0419-4da6-95e8-64970b4e274f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:17.336224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3748af39-06ae-4ed6-baf5-2ba9b2a24742 req-cb823d42-0419-4da6-95e8-64970b4e274f service nova] Creating event network-vif-deleted:3a492517-0fec-4dbf-97c0-c2da2452ac56 for instance f064c9b8-b625-48ff-8f68-3558f114b880 on n-h2-858384-19 Nov 02 13:14:17.341053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:14:17.344991 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3748af39-06ae-4ed6-baf5-2ba9b2a24742 req-cb823d42-0419-4da6-95e8-64970b4e274f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092679 Nov 02 13:14:17.349257 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 110/207] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:17.754678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:17.755533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:17.771087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:17.772835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:17.773451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:17.776214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:17.779230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:17.780129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:17.799163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:14:17.800596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:14:17.801236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:14:17.801841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:14:17.802406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:14:17.814810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:17.815650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:17.816244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:17.817139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:17.817840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:17.818425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:17.867018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Getting quotas for project da2ee1225f444a6b9aa4b072f71b72ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:17.875199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Getting quotas for user 908d4af5549b42d983c53229ad84e588 and project da2ee1225f444a6b9aa4b072f71b72ae. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:17.890657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:14:17.905938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:14:17.986879 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-281b252a-b5df-4cd5-acb7-b8f0858fb088 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.781098 Nov 02 13:14:17.988382 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 98/208] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:14:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:14:18.007339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8dbcfda-17fd-4dae-a45a-06c01f0543ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:18.007339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8dbcfda-17fd-4dae-a45a-06c01f0543ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:18.069780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:18.079619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:18.084838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:18.085962 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-27d79789-8802-410a-b7c4-ab569c0b7579 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1325 microversion: 2.25 time: 0.337001 Nov 02 13:14:18.092846 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 111/209] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:17 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1325 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:14:18.187848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8dbcfda-17fd-4dae-a45a-06c01f0543ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:18.209157 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8dbcfda-17fd-4dae-a45a-06c01f0543ec tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1224 microversion: 2.1 time: 0.213029 Nov 02 13:14:18.212111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:18.213421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:18.216606 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 99/210] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:17 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1224 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:18.223393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:18.226983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:18.227662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:18.228570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:18.229795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:18.232092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:18.275731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:18.276378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:18.295627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:18.296137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:18.296573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:18.297309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:18.297767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:18.298201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:18.338540 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] HTTP exception thrown: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Request method failure captured: Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 HTTP/1.1 Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz33vIZLxiFLL0JY_CAFPjY4dbVIGqN9Gkdkl7ieWPv17BEhD6RhASylT-xWDpyfmZhGVaJGtPUwuknVOhtNXurMakQ8oQW4nikL0JROyIA60uoSLnq5dHcb8y598WcWFA3ckJydcj5aU6IMUQInht4EweUyJHv-s8iUWX4QAWmC_8 Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 060da8c8e0ef485bac2056ad1de33e97 Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminTestJSON-299175072 Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:18.347416 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminTestJSON-299175072 Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 060da8c8e0ef485bac2056ad1de33e97 Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-299175072 Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminTestJSON-299175072-project Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3f05bd7be4364470b47f8de48a29636a Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminTestJSON-299175072-project Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:18.348662 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f064c9b8-b625-48ff-8f68-3558f114b880'} Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:18.349399 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:18.350431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:18.351424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Returning 404 to user: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:18.351424 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93211b04-1b06-48da-b1ec-d404fa04e3b9 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 404 len: 111 microversion: 2.1 time: 0.079832 Nov 02 13:14:18.356193 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 100/211] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:18 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:18.367202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d51f8a26-0d1c-4acb-831f-acd7b5d54cf8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:18.405068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d51f8a26-0d1c-4acb-831f-acd7b5d54cf8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:18.406686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d51f8a26-0d1c-4acb-831f-acd7b5d54cf8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:18.407192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d51f8a26-0d1c-4acb-831f-acd7b5d54cf8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:18.412610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:18.731174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:18.745263 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f848550-42ad-4b5d-86c3-95f55b780439 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.536669 Nov 02 13:14:18.747455 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 112/212] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:18 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:19.127586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:19.129054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:19.143575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:19.144372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:19.146226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:19.148675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:19.151158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:19.152634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:19.171896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d51f8a26-0d1c-4acb-831f-acd7b5d54cf8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.810651 Nov 02 13:14:19.176255 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 101/213] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:19.187767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-98a0bc53-7a2c-4cff-9921-7173cf8f62ed tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:19.236219 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-98a0bc53-7a2c-4cff-9921-7173cf8f62ed tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.053154 Nov 02 13:14:19.237350 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 102/214] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:19 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 13:14:19.247646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:19.248951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:19.265220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:19.266474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:19.267148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:19.268030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:19.268645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:19.269257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:19.411884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:19.420204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:19.435966 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4cc82227-352a-4963-8548-a5111dc38c8f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1242 microversion: 2.1 time: 0.197262 Nov 02 13:14:19.447738 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 103/215] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:19 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:19.448036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:19.448036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:19.448036 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad976fb6-b01e-4a8f-b8ee-7dcaedaf291d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1323 microversion: 2.25 time: 0.326535 Nov 02 13:14:19.454466 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 113/216] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:19 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:19.460787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17103614-4e77-4918-afcf-3e9868139f7a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1536178128"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:19.462250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-72a8a3f9-3f68-4162-9f0e-9fe018b76862 req-1a09f929-d8bc-4361-adaa-e8ba3a38c4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800fbdf2-d748-4d08-ae3b-c5a4d0401ab1", "tag": "ba1e40c1-88cc-4a22-992b-41cc1769803d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:19.469979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-17103614-4e77-4918-afcf-3e9868139f7a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Generated uuid d890e7e4-623b-4365-968c-db82edbea91e for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:19.490820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-72a8a3f9-3f68-4162-9f0e-9fe018b76862 req-1a09f929-d8bc-4361-adaa-e8ba3a38c4cd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:19.491317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-72a8a3f9-3f68-4162-9f0e-9fe018b76862 req-1a09f929-d8bc-4361-adaa-e8ba3a38c4cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:19.491926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-72a8a3f9-3f68-4162-9f0e-9fe018b76862 req-1a09f929-d8bc-4361-adaa-e8ba3a38c4cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:19.517529 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-72a8a3f9-3f68-4162-9f0e-9fe018b76862 req-1a09f929-d8bc-4361-adaa-e8ba3a38c4cd service nova] Creating event network-changed:ba1e40c1-88cc-4a22-992b-41cc1769803d for instance 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 on n-h1-858384-19 Nov 02 13:14:19.531676 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-72a8a3f9-3f68-4162-9f0e-9fe018b76862 req-1a09f929-d8bc-4361-adaa-e8ba3a38c4cd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075536 Nov 02 13:14:19.532874 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 114/217] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:19.550401 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17103614-4e77-4918-afcf-3e9868139f7a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.108923 Nov 02 13:14:19.562809 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 104/218] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:19.576957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f02b360f-1bc0-458d-9e44-e7505c709a09 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:19.607236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f02b360f-1bc0-458d-9e44-e7505c709a09 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:19.608058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f02b360f-1bc0-458d-9e44-e7505c709a09 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:19.612884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f02b360f-1bc0-458d-9e44-e7505c709a09 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:19.873535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-49766763", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "11ec4f6b-127c-44f1-a825-014c9ea38647"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:19.879709 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f02b360f-1bc0-458d-9e44-e7505c709a09 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.311094 Nov 02 13:14:19.881066 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 105/219] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:19 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:19.888750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:19.890506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:19.905974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:19.920493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:19.921204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:19.922101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:19.922984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:19.938628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:20.006313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] validate_networks() for [('11ec4f6b-127c-44f1-a825-014c9ea38647', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:14:20.327622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:20.337152 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-58352811-54ec-436c-99a7-298385151417 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.454562 Nov 02 13:14:20.347160 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 106/220] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:19 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:20.347160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3a565f8-96e5-4906-95a3-a73f9d4aa8c1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:20.354804 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e3a565f8-96e5-4906-95a3-a73f9d4aa8c1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.013874 Nov 02 13:14:20.355292 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 107/221] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:14:20 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:20.368187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c9f0272-1537-4b35-8c7c-f611cbbd3ba8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:20.390142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c9f0272-1537-4b35-8c7c-f611cbbd3ba8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:20.390382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c9f0272-1537-4b35-8c7c-f611cbbd3ba8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:20.390885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c9f0272-1537-4b35-8c7c-f611cbbd3ba8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:20.543145 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c9f0272-1537-4b35-8c7c-f611cbbd3ba8 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.179715 Nov 02 13:14:20.544923 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 108/222] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:20.786706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-041a6597-c803-43fb-8492-3334647816a3 tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] Action: 'create', calling method: .version_select at 0x7fe787f61af0>, body: {"security_group": {"name": "tempest-securitygroup-1883556372", "description": "tempest-description-1637945502"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:21.219589 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-041a6597-c803-43fb-8492-3334647816a3 tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.672773 Nov 02 13:14:21.220299 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 109/223] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:14:20 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:21.226893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:21.227937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:21.241135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:21.241729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:21.242237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:21.243022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:21.243662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:21.247331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:21.379213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:21.389360 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd819e44-9491-4faf-bfe4-6b03ca5e41a5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1282 microversion: 2.1 time: 0.167956 Nov 02 13:14:21.390150 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 110/224] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:21 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:21.396558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:21.398021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:21.407076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:21.407862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:21.408495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:21.409974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:21.410627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:21.411264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:21.565318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:21.575219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:21.576976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:21.579695 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d65262c9-99a2-4858-ba54-9b041df1422b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.188388 Nov 02 13:14:21.580625 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 111/225] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:21 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:21.586590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-199f11d5-8882-434d-803d-8d548f7852cd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:21.626448 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-199f11d5-8882-434d-803d-8d548f7852cd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.044258 Nov 02 13:14:21.628033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 112/226] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:21 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:21.638949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f19ac1d-fa59-4888-a168-0d10d3103e16 tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] Action: 'create', calling method: .version_select at 0x7fe787f61c10>, body: {"security_group": {"name": "tempest-securitygroup-1089865174", "description": "tempest-description-1512461016"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:21.854393 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f19ac1d-fa59-4888-a168-0d10d3103e16 tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.225075 Nov 02 13:14:21.863366 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 113/227] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:14:21 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:21.877757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:14:21.878270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:14:21.878695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:14:21.879214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:14:21.880553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:21.880716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:14:21.880821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:21.908663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:21.909494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:21.910246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:21.912182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:21.912818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:21.913490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:21.917169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:21.921674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:21.922372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:21.924431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:21.926633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:21.928735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:21.961217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:21.970718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for user 392d81e9a1c74430a325c9ecc1dcfb44 and project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:21.985128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:14:21.988239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:14:22.089683 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6a7261c-1718-4c68-b78e-fdde3e57c772 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.555386 Nov 02 13:14:22.108373 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 115/228] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:14:19 2022] POST /compute/v2.1/servers => generated 382 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:14:22.118498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-27c30f28-3779-4875-8832-1736d6de8dda tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1603318137"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:22.124169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.aggregate [None req-27c30f28-3779-4875-8832-1736d6de8dda tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Generated uuid 8df312b4-c640-4f87-9539-5792d86b6d9f for aggregate {{(pid=120929) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:22.127822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:22.136808 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-117b87d8-06a8-4c26-ab35-d486e1d5d01b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.279184 Nov 02 13:14:22.137409 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 114/229] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:21 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:22.159919 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-27c30f28-3779-4875-8832-1736d6de8dda tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.049969 Nov 02 13:14:22.161160 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 116/230] 10.222.0.113 () {62 vars in 1210 bytes} [Wed Nov 2 13:14:22 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:22.172908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc3b034c-8522-4718-992f-deaa5f795f54 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:22.173791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc3b034c-8522-4718-992f-deaa5f795f54 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:22.229499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec1df513-6a2d-4ae1-a336-169aaa618906 tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] Action: 'create', calling method: .version_select at 0x7fe787f61c10>, body: {"security_group": {"name": "tempest-securitygroup-263079101", "description": "tempest-description-1536741380"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:22.244789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc3b034c-8522-4718-992f-deaa5f795f54 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:22.253813 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc3b034c-8522-4718-992f-deaa5f795f54 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1213 microversion: 2.1 time: 0.091460 Nov 02 13:14:22.255938 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 117/231] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:22 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:22.275535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cdf8e386-8dee-4865-8101-9aeb7f3ee222 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-965972667"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:22.439009 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cdf8e386-8dee-4865-8101-9aeb7f3ee222 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.181155 Nov 02 13:14:22.439773 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 118/232] 10.222.0.113 () {62 vars in 1215 bytes} [Wed Nov 2 13:14:22 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:22.448230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:22.451758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:22.471964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:22.472375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:22.472817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:22.473540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:22.474081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:22.474515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:22.665083 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ec1df513-6a2d-4ae1-a336-169aaa618906 tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.526618 Nov 02 13:14:22.666069 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 115/233] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:14:22 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:22.673026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59fdc81f-f985-415d-aad2-063d584b7d2b tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:22.684061 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59fdc81f-f985-415d-aad2-063d584b7d2b tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.016774 Nov 02 13:14:22.684729 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 116/234] 10.222.0.113 () {60 vars in 1195 bytes} [Wed Nov 2 13:14:22 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:22.696374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:22.705232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:22.713557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:22.714020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:22.714455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:22.715728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:22.716499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:22.716924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:22.926634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:22.936040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:22.938436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:22.939778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69515948-43d2-4d2c-8c39-9e8d5ca42a54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.253960 Nov 02 13:14:22.940515 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 117/235] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:22 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:22.962915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d4ad6d6-0050-4b09-9f4e-86d25dd76c94 tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] Action: 'create', calling method: .version_select at 0x7fe787ed53a0>, body: {"security_group": {"name": "tempest-securitygroup-1166916082", "description": "tempest-description-1405055473"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:23.038065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:23.047768 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-56ac4441-865c-44b4-b897-35d93ef5a26e tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1324 microversion: 2.1 time: 0.606138 Nov 02 13:14:23.048354 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 119/236] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:22 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1324 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:23.068042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dbe2bd5f-120c-418d-82af-d3d5e53f72eb tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:23.101683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbe2bd5f-120c-418d-82af-d3d5e53f72eb tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.102206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbe2bd5f-120c-418d-82af-d3d5e53f72eb tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.107232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbe2bd5f-120c-418d-82af-d3d5e53f72eb tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.225396 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d4ad6d6-0050-4b09-9f4e-86d25dd76c94 tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.282171 Nov 02 13:14:23.226663 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 118/237] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:14:22 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:23.243672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:23.250509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:23.273379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.274288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.274870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.283185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.284233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.285142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.343716 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dbe2bd5f-120c-418d-82af-d3d5e53f72eb tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.290192 Nov 02 13:14:23.344566 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 120/238] 10.222.0.113 () {62 vars in 1237 bytes} [Wed Nov 2 13:14:23 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:23.349460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05caaa02-f547-476e-b47b-fcd4b07235ba tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] Calling method '.version_select at 0x7fe78c4acee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:23.514172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:23.522425 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-76ca75b1-7ce3-45bd-9118-72103867fb02 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.294404 Nov 02 13:14:23.523334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 119/239] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:23 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:23.530246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:23.530866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:23.533083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:23.538635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.539376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.539818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.540701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.541165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.541600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.612058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:23.620430 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8082a5a7-f599-4eef-be42-20830294670c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1265 microversion: 2.1 time: 0.095835 Nov 02 13:14:23.621949 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 120/240] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:23 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:23.626759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f9eb542-2f7a-48c3-b2c4-f9e143ba3ced tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:23.639485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f9eb542-2f7a-48c3-b2c4-f9e143ba3ced tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.640235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f9eb542-2f7a-48c3-b2c4-f9e143ba3ced tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.640836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f9eb542-2f7a-48c3-b2c4-f9e143ba3ced tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.790597 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f9eb542-2f7a-48c3-b2c4-f9e143ba3ced tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 0.167370 Nov 02 13:14:23.791564 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 121/241] 10.222.0.113 () {62 vars in 1237 bytes} [Wed Nov 2 13:14:23 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:23.804577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9c807448-6ca5-4e1e-9a52-853f65e038b8 req-e942e40f-3f7e-432c-8a1c-7c9708243b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a666ce7-0433-421b-a544-09993f3d8bb9", "tag": "057ba00a-d409-443a-8d37-16af8619f0fe"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:23.815224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c807448-6ca5-4e1e-9a52-853f65e038b8 req-e942e40f-3f7e-432c-8a1c-7c9708243b63 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:23.815705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c807448-6ca5-4e1e-9a52-853f65e038b8 req-e942e40f-3f7e-432c-8a1c-7c9708243b63 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:23.816135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c807448-6ca5-4e1e-9a52-853f65e038b8 req-e942e40f-3f7e-432c-8a1c-7c9708243b63 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:23.829329 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9c807448-6ca5-4e1e-9a52-853f65e038b8 req-e942e40f-3f7e-432c-8a1c-7c9708243b63 service nova] Creating event network-changed:057ba00a-d409-443a-8d37-16af8619f0fe for instance 4a666ce7-0433-421b-a544-09993f3d8bb9 on n-h2-858384-19 Nov 02 13:14:23.840917 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9c807448-6ca5-4e1e-9a52-853f65e038b8 req-e942e40f-3f7e-432c-8a1c-7c9708243b63 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040067 Nov 02 13:14:23.842339 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 122/242] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:23.849282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59b57843-7c13-4ed9-91b6-1ff1b6216506 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:23.877030 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59b57843-7c13-4ed9-91b6-1ff1b6216506 tempest-AggregatesAdminTestV241-579152941 tempest-AggregatesAdminTestV241-579152941-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.033302 Nov 02 13:14:23.877977 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 123/243] 10.222.0.113 () {60 vars in 1198 bytes} [Wed Nov 2 13:14:23 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:23.901252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ba8539c-566f-4f38-b110-3b9a870e5b80 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-730978583"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:23.912416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-3ba8539c-566f-4f38-b110-3b9a870e5b80 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Generated uuid fd2305ef-15a8-4e0f-bc5c-3ea73f8dd152 for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:23.970018 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ba8539c-566f-4f38-b110-3b9a870e5b80 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.077285 Nov 02 13:14:23.972606 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 124/244] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:23.984690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:23.992180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:24.007655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:24.008155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:24.008871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:24.009768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:24.010389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:24.012735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:24.314367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:24.330969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:24.333248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:24.334503 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be062446-46e0-4b06-bc9f-614378382ec8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.360162 Nov 02 13:14:24.335253 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 125/245] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:23 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:24.340828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd322eef-df14-49ed-9441-95770be22cf1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:24.360734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd322eef-df14-49ed-9441-95770be22cf1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:24.361384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd322eef-df14-49ed-9441-95770be22cf1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:24.362077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd322eef-df14-49ed-9441-95770be22cf1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:24.536361 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd322eef-df14-49ed-9441-95770be22cf1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.199539 Nov 02 13:14:24.537121 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 126/246] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:24 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:24.543719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:24.545282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:24.561519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:24.562627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:24.563506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:24.564382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:24.565175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:24.566878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:24.956347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:24.971999 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb089896-c6fd-445a-ae86-c100ad0d9b6a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1324 microversion: 2.1 time: 0.432594 Nov 02 13:14:24.981130 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 127/247] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:24 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:25.003646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:25.004896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:25.019224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:25.020095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:25.020879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:25.022611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:25.027690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:25.028613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:25.291864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:25.311095 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f90a2088-00b5-4d99-80a6-481e53b49b64 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.328426 Nov 02 13:14:25.316953 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 128/248] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:24 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:25.323093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-013db05a-1892-4682-8028-6673fccad890 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:25.337336 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-013db05a-1892-4682-8028-6673fccad890 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.018216 Nov 02 13:14:25.339058 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 129/249] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:14:25 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:25.352501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:25.353620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:25.364525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:25.365220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:25.365832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:25.366752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:25.367680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:25.368183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:25.578085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:25.587903 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c57a1db1-0103-4a3f-81fc-aef8ae0bb5f9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.246856 Nov 02 13:14:25.588490 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 130/250] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:25 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:25.594855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-831301c0-3822-4d0a-bdaf-f0846305face tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:25.610190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-831301c0-3822-4d0a-bdaf-f0846305face tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:25.611100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-831301c0-3822-4d0a-bdaf-f0846305face tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:25.611758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-831301c0-3822-4d0a-bdaf-f0846305face tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:25.754845 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-831301c0-3822-4d0a-bdaf-f0846305face tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.165153 Nov 02 13:14:25.755764 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 131/251] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:25 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:25.769475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:25.770193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:25.777847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:25.778725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:25.779602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:25.780597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:25.781239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:25.781703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:25.802131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:26.007014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:26.018507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:26.020053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:26.021181 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45ae3d4c-a737-4a25-a36d-10bd6d1fe4a2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.264240 Nov 02 13:14:26.021740 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 132/252] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:25 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:26.031500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea19a9c0-219e-4b95-ba70-57e3d9f9fcdf tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:26.066937 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ea19a9c0-219e-4b95-ba70-57e3d9f9fcdf tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.043980 Nov 02 13:14:26.068418 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 133/253] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:26 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:26.087860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-dec4d96f-17f9-42d7-9f59-ddd7fc259281 req-31d948c9-2755-4215-a5d0-4e335269dd7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d7e88a9-99ef-4852-9e10-1c55a1ded715", "tag": "88c1f69b-6cdf-4c29-8632-fbddd4fe544c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:26.103385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dec4d96f-17f9-42d7-9f59-ddd7fc259281 req-31d948c9-2755-4215-a5d0-4e335269dd7e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.103385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dec4d96f-17f9-42d7-9f59-ddd7fc259281 req-31d948c9-2755-4215-a5d0-4e335269dd7e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.103385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dec4d96f-17f9-42d7-9f59-ddd7fc259281 req-31d948c9-2755-4215-a5d0-4e335269dd7e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.115277 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-dec4d96f-17f9-42d7-9f59-ddd7fc259281 req-31d948c9-2755-4215-a5d0-4e335269dd7e service nova] Creating event network-changed:88c1f69b-6cdf-4c29-8632-fbddd4fe544c for instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 on n-h1-858384-19 Nov 02 13:14:26.120610 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-dec4d96f-17f9-42d7-9f59-ddd7fc259281 req-31d948c9-2755-4215-a5d0-4e335269dd7e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050387 Nov 02 13:14:26.122280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 134/254] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:26.127911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:26.128974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:26.135585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.136192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.137285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.138437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.139155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.139796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.310121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:26.318759 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-260aa8f4-2340-4b89-b1cc-4a8ae6078f0f tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1324 microversion: 2.1 time: 0.194722 Nov 02 13:14:26.318978 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 135/255] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:26 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1324 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:26.323511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a531434d-f212-4d0b-98a6-2f3b349654da tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-279581846"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:26.328385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-a531434d-f212-4d0b-98a6-2f3b349654da tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Generated uuid 7e275c73-b90b-4915-b8b6-27d82b4402a3 for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:26.354248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a531434d-f212-4d0b-98a6-2f3b349654da tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.034193 Nov 02 13:14:26.359265 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 136/256] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:26 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:26.364478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:26.365331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:26.373065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.373630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.374058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.374761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.375415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.375830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.575831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:26.585043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-155ba39e-ac57-4722-b28b-cb7d6d206181 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.224241 Nov 02 13:14:26.600177 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 137/257] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:26 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:26.600177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e026475-8231-4be8-b30e-4031410912f6 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:26.613923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e026475-8231-4be8-b30e-4031410912f6 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.614645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e026475-8231-4be8-b30e-4031410912f6 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.615237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e026475-8231-4be8-b30e-4031410912f6 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.786554 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e026475-8231-4be8-b30e-4031410912f6 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.199326 Nov 02 13:14:26.794641 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 138/258] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:26 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:26.796419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:26.797693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:26.805552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.805552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.806094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.806915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:26.807652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:26.808571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:26.984243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:26.992461 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-deaca513-dce1-4e52-9f88-a4da487e871b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.202529 Nov 02 13:14:26.993130 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 139/259] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:26 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:26.998819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88461b9b-8c9c-4df9-be6f-2acd9009a5ea tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:27.015439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88461b9b-8c9c-4df9-be6f-2acd9009a5ea tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:27.016059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88461b9b-8c9c-4df9-be6f-2acd9009a5ea tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:27.016360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88461b9b-8c9c-4df9-be6f-2acd9009a5ea tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:27.168823 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88461b9b-8c9c-4df9-be6f-2acd9009a5ea tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.174296 Nov 02 13:14:27.175489 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 140/260] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:26 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:27.180561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:27.181260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:27.188814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:27.189382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:27.189894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:27.190697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:27.191255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:27.191756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:27.194456 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05caaa02-f547-476e-b47b-fcd4b07235ba tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] 10.222.0.113 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9750 microversion: 2.1 time: 3.848587 Nov 02 13:14:27.195225 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 121/261] 10.222.0.113 () {58 vars in 1196 bytes} [Wed Nov 2 13:14:23 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9750 bytes in 3850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:27.212702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9608ec1f-db7f-4a06-988e-1442dafafd4b tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:27.236629 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9608ec1f-db7f-4a06-988e-1442dafafd4b tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.040117 Nov 02 13:14:27.237566 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 122/262] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:27 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:27.243073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-84fdc1f3-6419-4a6a-98f5-740424135971 tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] Calling method '.version_select at 0x7fe78c2cfe50>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:27.339636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:27.352998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:27.354651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:27.356901 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be77b2f3-8142-4f2f-938f-57a33135c1fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.179425 Nov 02 13:14:27.357133 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 141/263] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:27 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:27.376838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2aa19930-7f46-4c77-aade-f837faea18d0 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-522993971"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:27.381425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-2aa19930-7f46-4c77-aade-f837faea18d0 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Generated uuid 46295cd5-008d-4930-9434-2726907fe633 for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:27.415315 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2aa19930-7f46-4c77-aade-f837faea18d0 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047138 Nov 02 13:14:27.422708 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 142/264] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:27 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:27.422708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0771436f-76b0-4943-8d97-140423e52718 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2134623563"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:27.425935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-0771436f-76b0-4943-8d97-140423e52718 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Generated uuid fdd73fc1-0b45-4dd6-af2a-c073b7de7fcd for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:27.455353 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-84fdc1f3-6419-4a6a-98f5-740424135971 tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.216334 Nov 02 13:14:27.455955 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 123/265] 10.222.0.113 () {58 vars in 1196 bytes} [Wed Nov 2 13:14:27 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:27.461017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:27.461702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:27.466861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0771436f-76b0-4943-8d97-140423e52718 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048856 Nov 02 13:14:27.467906 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 143/266] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:27.472681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-acdfa852-f6df-4915-b93d-997dabb7e1dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:27.476151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:27.478516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:27.479170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:27.480881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:27.481518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:27.482110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:27.503681 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-acdfa852-f6df-4915-b93d-997dabb7e1dd tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.034582 Nov 02 13:14:27.504711 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 144/267] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:27 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:27.510923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fbd93441-9b30-4859-89cb-fe1526a1c380 tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] Calling method '.version_select at 0x7fe787f61b80>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:27.535808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:27.825524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:27.834655 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-450de5a5-1ad5-400b-8e9f-c7a5b1cf17a1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1324 microversion: 2.1 time: 0.377664 Nov 02 13:14:27.835521 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 124/268] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:27 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:27.840571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e0a311c2-982d-4c06-9222-5189b87791bf tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:27.850559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:27.857890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0a311c2-982d-4c06-9222-5189b87791bf tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:27.858448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0a311c2-982d-4c06-9222-5189b87791bf tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:27.858884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0a311c2-982d-4c06-9222-5189b87791bf tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:28.079059 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e0a311c2-982d-4c06-9222-5189b87791bf tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 243 microversion: 2.1 time: 0.242219 Nov 02 13:14:28.087795 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 125/269] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:27 2022] POST /compute/v2.1/os-aggregates/7/action => generated 243 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:28.093199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2293df68-7b85-4e31-b7ea-b26a0887c936 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:28.101124 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-2293df68-7b85-4e31-b7ea-b26a0887c936 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2293df68-7b85-4e31-b7ea-b26a0887c936 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Request method failure captured: Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYmz5yIZyJSV3rRmiFNCxDH2T0KoljprZbGXUV-7-Ws70bnR4sTR19bwDzA3AY-Px-iRm11gNm3yURBfMDBAkVlNy3tbAtYwgKabl146oK-o3SQ_wuseg48wKKQVXrrfnoTnW6qW2ODoenLNuCRWrNlWXuddEVGr3rUfJNHedqMjWvYA Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 507d5dec97e6453b96f31c3afbbf523f Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:14:28.107207 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 507d5dec97e6453b96f31c3afbbf523f Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AggregatesAdminTestJSON-1021793488-project-admin Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 465c8873b91e4379931ef794b8ad743b Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AggregatesAdminTestJSON-1021793488-project-admin Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: exception: Aggregate 6 could not be found. Nov 02 13:14:28.108540 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '6'} Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.109282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Nov 02 13:14:28.110400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.112162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2293df68-7b85-4e31-b7ea-b26a0887c936 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:28.113468 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2293df68-7b85-4e31-b7ea-b26a0887c936 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.023994 Nov 02 13:14:28.114969 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 126/270] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:14:28 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:14:28.119450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:28.120219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:28.129858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:28.130639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:28.131079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:28.132116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:28.132576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:28.132999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:28.197335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:28.223451 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fbd93441-9b30-4859-89cb-fe1526a1c380 tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/5fad3dff-4fbd-4bbd-9f29-b9415fc0f378" status: 202 len: 0 microversion: 2.1 time: 0.717073 Nov 02 13:14:28.224354 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 145/271] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:14:27 2022] DELETE /compute/v2.1/os-security-groups/5fad3dff-4fbd-4bbd-9f29-b9415fc0f378 => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:28.357932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:28.369490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a39ec83d-3750-405a-b20f-3136a41a7b9d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.254117 Nov 02 13:14:28.370511 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 127/272] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:28 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:28.391858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:28.392660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:28.404581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:28.406101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:28.406576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:28.407757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:28.408352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:28.409192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:28.449908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-48ff04fb-9001-4849-b4df-0386e6933562 tempest-FlavorMetadataValidation-1313820274 tempest-FlavorMetadataValidation-1313820274-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-827974568", "id": 550571231, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:28.459313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:28.476674 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-48ff04fb-9001-4849-b4df-0386e6933562 tempest-FlavorMetadataValidation-1313820274 tempest-FlavorMetadataValidation-1313820274-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 469 microversion: 2.86 time: 0.251092 Nov 02 13:14:28.477627 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 146/273] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:14:28 2022] POST /compute/v2.1/flavors => generated 469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:28.487005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3af1c54e-34cc-4b99-a106-e682735bb341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:28.501122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3af1c54e-34cc-4b99-a106-e682735bb341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:28.501781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3af1c54e-34cc-4b99-a106-e682735bb341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:28.502318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3af1c54e-34cc-4b99-a106-e682735bb341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:28.544780 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3af1c54e-34cc-4b99-a106-e682735bb341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-858384-19. Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3af1c54e-34cc-4b99-a106-e682735bb341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Request method failure captured: Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 40 Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz6-eHIdTCbGdx0nPdyfuOvFcK5ZbXajdU3DHt3gsvKm_1o8nebR8szOvTGB0qM_hCnoa50HFByH9O0ip_r5bbAvEzHCfKX0G1sdh6gardNaMnKQIBaJZhOA4YqqJcWCm_ztcU6-eki3vMnN1G6yr2YfQzK3bTUYdflHIptW2rkc_4 Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:28.549327 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4be137d468a74b06be4176d6e058e078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4be137d468a74b06be4176d6e058e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c9492eb69cd445609072e498c6d85fb7 Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: {"add_host": {"host": "n-h2-858384-19"}} Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:28.550533 n-d-858384-19 devstack@n-api.service[120928]: exception: Aggregate 7 already has host n-h2-858384-19. Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h2-858384-19'}}} Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:14:28.551309 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-858384-19-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 13:14:28.553568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 13:14:28.554690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:14:28.555739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-858384-19-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 13, 14, 28, 524379), 'updated_at': None, 'host': 'n-h2-858384-19', 'aggregate_id': 7}] Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.557922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6643, in add_host_to_aggregate Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h2-858384-19. Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.559757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h2-858384-19. Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:28.561101 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:28.562935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h2-858384-19. Nov 02 13:14:28.562935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.562935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3af1c54e-34cc-4b99-a106-e682735bb341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-858384-19. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:28.562935 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3af1c54e-34cc-4b99-a106-e682735bb341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 96 microversion: 2.1 time: 0.067593 Nov 02 13:14:28.562935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 147/274] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:28 2022] POST /compute/v2.1/os-aggregates/7/action => generated 96 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 02 13:14:28.563334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f98aeec-6500-4c2f-8a4c-09f13ebfbfb1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:28.580050 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4f98aeec-6500-4c2f-8a4c-09f13ebfbfb1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Nov 02 13:14:28.580515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f98aeec-6500-4c2f-8a4c-09f13ebfbfb1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Request method failure captured: Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz5yIZyJSV3rRmiFNCxDH2T0KoljprZbGXUV-7-Ws70bnR4sTR19bwDzA3AY-Px-iRm11gNm3yURBfMDBAkVlNy3tbAtYwgKabl146oK-o3SQ_wuseg48wKKQVXrrfnoTnW6qW2ODoenLNuCRWrNlWXuddEVGr3rUfJNHedqMjWvYA Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 507d5dec97e6453b96f31c3afbbf523f Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:28.581862 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 507d5dec97e6453b96f31c3afbbf523f Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminTestJSON-1021793488-project-admin Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 465c8873b91e4379931ef794b8ad743b Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminTestJSON-1021793488-project-admin Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: exception: Aggregate 6 could not be found. Nov 02 13:14:28.583143 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '6'} Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:14:28.583843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.584901 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:28.586531 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:28.586531 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:28.586531 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:28.586531 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:28.586531 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Nov 02 13:14:28.586531 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:28.586531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f98aeec-6500-4c2f-8a4c-09f13ebfbfb1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:28.586531 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f98aeec-6500-4c2f-8a4c-09f13ebfbfb1 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.026815 Nov 02 13:14:28.586531 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 148/275] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:28 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:14:28.593359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-790c3b5f-3634-40ee-b095-a96cd65d48da tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] Calling method '.version_select at 0x7fe787ed5c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:28.596397 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d50b577e-5e55-44f8-a04d-5349e48d4fc5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.223750 Nov 02 13:14:28.596990 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 128/276] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:28 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:28.601840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:28.602452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:28.609743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:28.610235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:28.610667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:28.611505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:28.611967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:28.612398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:28.782993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:28.795338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:28.797847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:28.799098 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d58e0c9-5095-4b58-acbf-9b147a67c324 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.201028 Nov 02 13:14:28.800262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 129/277] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:28 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:28.805954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd4227eb-1106-4f19-b5f0-9d8bf16720aa tempest-FlavorMetadataValidation-1313820274 tempest-FlavorMetadataValidation-1313820274-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:28.999292 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd4227eb-1106-4f19-b5f0-9d8bf16720aa tempest-FlavorMetadataValidation-1313820274 tempest-FlavorMetadataValidation-1313820274-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/550571231/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.197669 Nov 02 13:14:28.999982 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 130/278] 10.222.0.113 () {62 vars in 1267 bytes} [Wed Nov 2 13:14:28 2022] POST /compute/v2.1/flavors/550571231/os-extra_specs => generated 62 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:29.005365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8136cb14-c755-459b-89d2-78d3bddcc3ee tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-19"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:29.019769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8136cb14-c755-459b-89d2-78d3bddcc3ee tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:29.020172 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-790c3b5f-3634-40ee-b095-a96cd65d48da tempest-SecurityGroupsTestAdminJSON-748097691 tempest-SecurityGroupsTestAdminJSON-748097691-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/2cb6d220-9d01-4c00-8ec2-2ee59e5bd990" status: 202 len: 0 microversion: 2.1 time: 0.434134 Nov 02 13:14:29.020286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8136cb14-c755-459b-89d2-78d3bddcc3ee tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:29.020709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8136cb14-c755-459b-89d2-78d3bddcc3ee tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.020854 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 149/279] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:14:28 2022] DELETE /compute/v2.1/os-security-groups/2cb6d220-9d01-4c00-8ec2-2ee59e5bd990 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:29.026433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d209b974-9fcf-41cf-a48e-db07a105a7e3 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-834347396", "name": "tempest-test_aggregate-888303040"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:29.031469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-d209b974-9fcf-41cf-a48e-db07a105a7e3 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Generated uuid 86cf6e35-53c0-474f-b761-41fe9b684cfd for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:29.074622 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d209b974-9fcf-41cf-a48e-db07a105a7e3 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.051050 Nov 02 13:14:29.075316 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 150/280] 10.222.0.113 () {60 vars in 1170 bytes} [Wed Nov 2 13:14:29 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:29.081393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-125f7ab9-0eba-40a8-b704-73d1c8a14751 req-b4de99c1-26e0-4ecf-a71f-553e095c7870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca7fedf-baa0-4492-8c62-61a6452889a9", "tag": "0e82bbfc-811d-44dc-84ed-e4ab1baebc95"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:29.092119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-125f7ab9-0eba-40a8-b704-73d1c8a14751 req-b4de99c1-26e0-4ecf-a71f-553e095c7870 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:29.092868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-125f7ab9-0eba-40a8-b704-73d1c8a14751 req-b4de99c1-26e0-4ecf-a71f-553e095c7870 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:29.093512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-125f7ab9-0eba-40a8-b704-73d1c8a14751 req-b4de99c1-26e0-4ecf-a71f-553e095c7870 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.104853 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-125f7ab9-0eba-40a8-b704-73d1c8a14751 req-b4de99c1-26e0-4ecf-a71f-553e095c7870 service nova] Creating event network-changed:0e82bbfc-811d-44dc-84ed-e4ab1baebc95 for instance cca7fedf-baa0-4492-8c62-61a6452889a9 on n-h2-858384-19 Nov 02 13:14:29.110006 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-125f7ab9-0eba-40a8-b704-73d1c8a14751 req-b4de99c1-26e0-4ecf-a71f-553e095c7870 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032963 Nov 02 13:14:29.110659 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 151/281] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:29.115868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5791d833-03f3-4cd5-8b78-acce984d4afb req-6b58fc41-40d0-458e-82d9-625f388c30c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800fbdf2-d748-4d08-ae3b-c5a4d0401ab1", "name": "network-vif-plugged", "status": "completed", "tag": "ba1e40c1-88cc-4a22-992b-41cc1769803d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:29.125795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5791d833-03f3-4cd5-8b78-acce984d4afb req-6b58fc41-40d0-458e-82d9-625f388c30c9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:29.126267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5791d833-03f3-4cd5-8b78-acce984d4afb req-6b58fc41-40d0-458e-82d9-625f388c30c9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:29.126702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5791d833-03f3-4cd5-8b78-acce984d4afb req-6b58fc41-40d0-458e-82d9-625f388c30c9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.138409 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5791d833-03f3-4cd5-8b78-acce984d4afb req-6b58fc41-40d0-458e-82d9-625f388c30c9 service nova] Creating event network-vif-plugged:ba1e40c1-88cc-4a22-992b-41cc1769803d for instance 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 on n-h1-858384-19 Nov 02 13:14:29.143687 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5791d833-03f3-4cd5-8b78-acce984d4afb req-6b58fc41-40d0-458e-82d9-625f388c30c9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031195 Nov 02 13:14:29.144514 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 152/282] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:29.149968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.150654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:29.158481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:29.159063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:29.159531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.160273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:29.160778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:29.161199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.170619 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8136cb14-c755-459b-89d2-78d3bddcc3ee tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.169129 Nov 02 13:14:29.171640 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 131/283] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:28 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:29.176754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6943caf5-5cd3-4105-b75b-76df0bb1a98b tempest-FlavorMetadataValidation-1313820274 tempest-FlavorMetadataValidation-1313820274-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.199294 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6943caf5-5cd3-4105-b75b-76df0bb1a98b tempest-FlavorMetadataValidation-1313820274 tempest-FlavorMetadataValidation-1313820274-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/550571231" status: 202 len: 0 microversion: 2.86 time: 0.025637 Nov 02 13:14:29.200156 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 132/284] 10.222.0.113 () {60 vars in 1204 bytes} [Wed Nov 2 13:14:29 2022] DELETE /compute/v2.1/flavors/550571231 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:14:29.204986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be6a4d6b-bb36-4152-bb0b-737e51c94d67 tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] Calling method '.version_select at 0x7fe78c2c7430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.376140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:29.383997 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8547db41-dbc2-4a18-badf-73f4bf84b7ad tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1324 microversion: 2.1 time: 0.238173 Nov 02 13:14:29.384564 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 153/285] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:29 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1324 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:29.388498 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-be6a4d6b-bb36-4152-bb0b-737e51c94d67 tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/d2c22e19-03ab-4241-ba20-3dc44a74ef27" status: 202 len: 0 microversion: 2.1 time: 0.185363 Nov 02 13:14:29.388498 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 133/286] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:14:29 2022] DELETE /compute/v2.1/os-security-groups/d2c22e19-03ab-4241-ba20-3dc44a74ef27 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:29.392767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d46f572b-c008-4e09-895a-e9c917241c57 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.405947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-feae14cf-c320-446e-9aca-4a0f403ed5c3 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.431692 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d46f572b-c008-4e09-895a-e9c917241c57 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.042790 Nov 02 13:14:29.432884 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 134/287] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:29 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:29.435483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-feae14cf-c320-446e-9aca-4a0f403ed5c3 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.039415 Nov 02 13:14:29.436312 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 154/288] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:29 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:29.442288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b4d2244-fca0-4b82-a44d-e5350d169cf4 tempest-FlavorMetadataValidation-1313820274 tempest-FlavorMetadataValidation-1313820274-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.443009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.443645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:29.451071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:29.451589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:29.452030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.452731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:29.453187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:29.453650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.465389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7b4d2244-fca0-4b82-a44d-e5350d169cf4 tempest-FlavorMetadataValidation-1313820274 tempest-FlavorMetadataValidation-1313820274-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.86 time: 0.030156 Nov 02 13:14:29.465955 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 135/289] 10.222.0.113 () {60 vars in 1192 bytes} [Wed Nov 2 13:14:29 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:29.470639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1480e50-ddd6-4de3-9a41-5c159ed0ab2b tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] Calling method '.version_select at 0x7fe78c18b790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.664527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:29.675335 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-80cbe7d2-72d8-444a-8326-2a5f9f281469 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.236046 Nov 02 13:14:29.676455 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 155/290] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:29 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:29.682345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8092f52-2f98-4c99-be52-59f58ae6c5d9 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.693407 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-a8092f52-2f98-4c99-be52-59f58ae6c5d9 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8092f52-2f98-4c99-be52-59f58ae6c5d9 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Request method failure captured: Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz5yIZyJSV3rRmiFNCxDH2T0KoljprZbGXUV-7-Ws70bnR4sTR19bwDzA3AY-Px-iRm11gNm3yURBfMDBAkVlNy3tbAtYwgKabl146oK-o3SQ_wuseg48wKKQVXrrfnoTnW6qW2ODoenLNuCRWrNlWXuddEVGr3rUfJNHedqMjWvYA Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 507d5dec97e6453b96f31c3afbbf523f Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:29.695089 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 507d5dec97e6453b96f31c3afbbf523f Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminTestJSON-1021793488-project-admin Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 465c8873b91e4379931ef794b8ad743b Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminTestJSON-1021793488-project-admin Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: exception: Aggregate 8 could not be found. Nov 02 13:14:29.696344 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '8'} Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:29.697024 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Nov 02 13:14:29.698122 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.700510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8092f52-2f98-4c99-be52-59f58ae6c5d9 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:29.700510 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8092f52-2f98-4c99-be52-59f58ae6c5d9 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.018946 Nov 02 13:14:29.700510 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 156/291] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:14:29 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:14:29.702794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-347e1158-dd5b-469c-98e3-17c7d83962ad tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1238032780"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:29.706305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-347e1158-dd5b-469c-98e3-17c7d83962ad tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Generated uuid 161d8477-8218-4527-9910-9e31234c3e40 for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:29.735072 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-347e1158-dd5b-469c-98e3-17c7d83962ad tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036714 Nov 02 13:14:29.743032 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 157/292] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:29.748755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.749490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:29.757404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:29.758106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:29.758436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.759304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:29.759762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:29.760190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:29.933596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:29.940743 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1480e50-ddd6-4de3-9a41-5c159ed0ab2b tempest-SecurityGroupsTestAdminJSON-692047473 tempest-SecurityGroupsTestAdminJSON-692047473-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/2f179309-c5aa-4b59-921d-2f04ac72d0e2" status: 202 len: 0 microversion: 2.1 time: 0.473748 Nov 02 13:14:29.941320 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 136/293] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:14:29 2022] DELETE /compute/v2.1/os-security-groups/2f179309-c5aa-4b59-921d-2f04ac72d0e2 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:29.950221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-346add0e-ece6-40e0-b989-bd0a70fbb06f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:29.955100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b7c382ac-5eeb-485a-aeba-5524a80ddf15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.210867 Nov 02 13:14:29.955697 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 158/294] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:29 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:29.979571 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-346add0e-ece6-40e0-b989-bd0a70fbb06f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-346add0e-ece6-40e0-b989-bd0a70fbb06f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Request method failure captured: Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYmz5yIZyJSV3rRmiFNCxDH2T0KoljprZbGXUV-7-Ws70bnR4sTR19bwDzA3AY-Px-iRm11gNm3yURBfMDBAkVlNy3tbAtYwgKabl146oK-o3SQ_wuseg48wKKQVXrrfnoTnW6qW2ODoenLNuCRWrNlWXuddEVGr3rUfJNHedqMjWvYA Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 507d5dec97e6453b96f31c3afbbf523f Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:14:29.984554 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/507d5dec97e6453b96f31c3afbbf523f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 507d5dec97e6453b96f31c3afbbf523f Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1021793488 Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AggregatesAdminTestJSON-1021793488-project-admin Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 465c8873b91e4379931ef794b8ad743b Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AggregatesAdminTestJSON-1021793488-project-admin Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: exception: Aggregate 8 could not be found. Nov 02 13:14:29.985801 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '8'} Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:14:29.986455 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.987501 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:29.988624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:29.988624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:29.988624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:29.988624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:29.988624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Nov 02 13:14:29.988624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:29.988624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-346add0e-ece6-40e0-b989-bd0a70fbb06f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:29.989788 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-346add0e-ece6-40e0-b989-bd0a70fbb06f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.045623 Nov 02 13:14:29.991500 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 137/295] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:29 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:14:30.006673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:30.008545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:30.017486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:30.017980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:30.018849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:30.020285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:30.021505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:30.021948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:30.185443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:30.196369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:30.197935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:30.199822 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3b601eb6-8a7e-40ae-89e9-4836a10c2f76 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.201849 Nov 02 13:14:30.200784 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 138/296] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:29 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:30.205461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-56c1ec8d-75cf-4d32-9b78-6043f55f2abe tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1240672046"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:30.226435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.aggregate [None req-56c1ec8d-75cf-4d32-9b78-6043f55f2abe tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Generated uuid 81778e13-7b59-4ecc-8113-5dcc655974d8 for aggregate {{(pid=120929) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:30.260133 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-56c1ec8d-75cf-4d32-9b78-6043f55f2abe tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.058089 Nov 02 13:14:30.261234 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 139/297] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:30.274103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0f4dfae5-8755-40e5-951e-be35636187df tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:30.287872 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0f4dfae5-8755-40e5-951e-be35636187df tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 228 microversion: 2.1 time: 0.017587 Nov 02 13:14:30.289394 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 140/298] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:30 2022] GET /compute/v2.1/os-aggregates/10 => generated 228 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:30.302311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60be898e-20e0-498a-a61d-8ca9bced9397 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:30.337724 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60be898e-20e0-498a-a61d-8ca9bced9397 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 266 microversion: 2.1 time: 0.039071 Nov 02 13:14:30.338970 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 141/299] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 13:14:30 2022] POST /compute/v2.1/os-aggregates/10/action => generated 266 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:14:30.350845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-09779a41-e058-47c5-b40c-89ee5743fa88 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:30.360855 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-09779a41-e058-47c5-b40c-89ee5743fa88 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.013755 Nov 02 13:14:30.361744 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 142/300] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:30 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:14:30.374216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-296056ce-44a0-4a1d-a5fb-741e8c52fb27 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:30.408108 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-296056ce-44a0-4a1d-a5fb-741e8c52fb27 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.038929 Nov 02 13:14:30.409198 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 143/301] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:30 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:30.422424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:30.423746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:30.438295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:30.446601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:30.447537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:30.448546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:30.449904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:30.450338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:30.482351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:30.502754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c3b30674-4b53-43e9-8d78-691dc992e090 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:30.506641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c3b30674-4b53-43e9-8d78-691dc992e090 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '8e36ac58cc814ffeb0d23b43a147a9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21c59db5c1a4c67a8fa75fd07836aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c3b30674-4b53-43e9-8d78-691dc992e090 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Request method failure captured: Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 40 Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4L3DmkAOiA0xkFQdH7hj6LdT2MwQKpjYbDkOfUybny2j8Uryhi-QQcCHUJl1AR1r5fR4vL6p3DKrfOOkXcQtBY3lrOWkB_deOCLUFXApcQVyagxjxHXvQmXGoFKpjQ0unv0LbXTLVDi6TruiRbDGYw55wEv0Kng8PPubY0Cuws9U Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:30.508709 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 8e36ac58cc814ffeb0d23b43a147a9a2 Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: {"add_host": {"host": "n-h2-858384-19"}} Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:30.509983 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h2-858384-19'}}} Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:30.510701 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 13:14:30.512370 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.514939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c3b30674-4b53-43e9-8d78-691dc992e090 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:30.515801 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c3b30674-4b53-43e9-8d78-691dc992e090 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] 10.222.0.113 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.555856 Nov 02 13:14:30.516360 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 159/302] 10.222.0.113 () {60 vars in 1196 bytes} [Wed Nov 2 13:14:29 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 557 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:30.523046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-688c1baa-cf8a-445e-b837-774257b9416f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1212683460", "availability_zone": "tempest-test_az-1178086374"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:30.527676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-688c1baa-cf8a-445e-b837-774257b9416f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Generated uuid 779e73ff-bd0a-4f97-a534-eb6d1b64a6ed for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:30.571237 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-688c1baa-cf8a-445e-b837-774257b9416f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.053535 Nov 02 13:14:30.571849 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 160/303] 10.222.0.113 () {60 vars in 1170 bytes} [Wed Nov 2 13:14:30 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:30.577393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b536a92b-3d81-4ea9-9684-bdcaeb61d932 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:30.601043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b536a92b-3d81-4ea9-9684-bdcaeb61d932 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.027851 Nov 02 13:14:30.602031 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 161/304] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:30 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:30.606865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e374b63e-8bcb-4d33-a90f-466aaf37537f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1212683460_new", "availability_zone": "tempest-test_az-1178086374_new"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:30.725670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e374b63e-8bcb-4d33-a90f-466aaf37537f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:30.726868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e374b63e-8bcb-4d33-a90f-466aaf37537f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:30.727661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e374b63e-8bcb-4d33-a90f-466aaf37537f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:30.776104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:30.780089 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e374b63e-8bcb-4d33-a90f-466aaf37537f tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 337 microversion: 2.1 time: 0.176836 Nov 02 13:14:30.780988 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 162/305] 10.222.0.113 () {60 vars in 1178 bytes} [Wed Nov 2 13:14:30 2022] PUT /compute/v2.1/os-aggregates/11 => generated 337 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:30.795533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b7f99fb7-41a8-41da-8967-6d318c053975 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2028244280"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:30.801700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-b7f99fb7-41a8-41da-8967-6d318c053975 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Generated uuid a669570b-fb29-4b65-bc96-01da131a6f10 for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:30.803712 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-42f9d958-0a6e-497e-b81a-cbdced832f43 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1324 microversion: 2.1 time: 0.393306 Nov 02 13:14:30.819494 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 144/306] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:30 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:30.819494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:30.819494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:30.826156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:30.826644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:30.827169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:30.827775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:30.828235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:30.828633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:30.843679 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b7f99fb7-41a8-41da-8967-6d318c053975 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055246 Nov 02 13:14:30.844285 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 163/307] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:30.850716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06690bf8-0c9a-485c-b582-b58307cb1682 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:30.862519 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06690bf8-0c9a-485c-b582-b58307cb1682 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates" status: 200 len: 555 microversion: 2.1 time: 0.017189 Nov 02 13:14:30.865170 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 164/308] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:14:30 2022] GET /compute/v2.1/os-aggregates => generated 555 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:30.872422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-702806969"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:30.891686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:30.894350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:30.896135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:30.905877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:30.906354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:30.906787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:30.916961 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-702806969 could not be found. Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Request method failure captured: Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 57 Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz6-eHIdTCbGdx0nPdyfuOvFcK5ZbXajdU3DHt3gsvKm_1o8nebR8szOvTGB0qM_hCnoa50HFByH9O0ip_r5bbAvEzHCfKX0G1sdh6gardNaMnKQIBaJZhOA4YqqJcWCm_ztcU6-eki3vMnN1G6yr2YfQzK3bTUYdflHIptW2rkc_4 Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:30.921148 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4be137d468a74b06be4176d6e058e078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4be137d468a74b06be4176d6e058e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c9492eb69cd445609072e498c6d85fb7 Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: {"add_host": {"host": "tempest-nonexist_host-702806969"}} Nov 02 13:14:30.922429 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: exception: Compute host tempest-nonexist_host-702806969 could not be found. Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-702806969'}}} Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-702806969' is not mapped to any cell Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:30.923625 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6623, in add_host_to_aggregate Nov 02 13:14:30.925225 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-702806969 could not be found. Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-702806969 could not be found. Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:30.926532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-702806969 could not be found. Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-702806969 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ac50513b-c812-4c8e-b7fa-82fb7a6faaf4 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 110 microversion: 2.1 time: 0.056183 Nov 02 13:14:30.927950 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 165/309] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 13:14:30 2022] POST /compute/v2.1/os-aggregates/12/action => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:30.929630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77c65340-ec5b-4609-a281-6b4b86d66030 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:30.962360 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77c65340-ec5b-4609-a281-6b4b86d66030 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.037400 Nov 02 13:14:30.965322 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 166/310] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:30 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:30.972984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f4dea4d8-8b2b-457e-a466-eeef06d71341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.002367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f4dea4d8-8b2b-457e-a466-eeef06d71341 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.035749 Nov 02 13:14:31.003461 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 167/311] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:30 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:31.010857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-58b7fb00-90db-4a71-9555-6ee2b331c861 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1982087415"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:31.015236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-58b7fb00-90db-4a71-9555-6ee2b331c861 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Generated uuid be0e21a2-b13c-4850-8884-cb06ecf60a2c for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:31.016364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:31.026245 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0c0020d-abd0-48f7-8e9d-6a1bed7900be tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.218966 Nov 02 13:14:31.027343 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 145/312] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:30 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:31.032882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.033556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:31.043972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.044775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.045448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.046301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.046753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.047256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.056167 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-58b7fb00-90db-4a71-9555-6ee2b331c861 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051316 Nov 02 13:14:31.061069 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 168/313] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:31.066410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b37c1d80-95db-4d92-9b42-7ede1b185f7a tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b37c1d80-95db-4d92-9b42-7ede1b185f7a tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Request method failure captured: Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 283 Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz6-eHIdTCbGdx0nPdyfuOvFcK5ZbXajdU3DHt3gsvKm_1o8nebR8szOvTGB0qM_hCnoa50HFByH9O0ip_r5bbAvEzHCfKX0G1sdh6gardNaMnKQIBaJZhOA4YqqJcWCm_ztcU6-eki3vMnN1G6yr2YfQzK3bTUYdflHIptW2rkc_4 Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:31.072199 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4be137d468a74b06be4176d6e058e078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4be137d468a74b06be4176d6e058e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c9492eb69cd445609072e498c6d85fb7 Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:31.074773 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:14:31.075678 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:31.077432 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.078588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.081093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:14:31.081093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:14:31.081093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:14:31.081093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.081093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b37c1d80-95db-4d92-9b42-7ede1b185f7a tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:31.081702 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b37c1d80-95db-4d92-9b42-7ede1b185f7a tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.013890 Nov 02 13:14:31.081702 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 169/314] 10.222.0.113 () {60 vars in 1170 bytes} [Wed Nov 2 13:14:31 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:14:31.081702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-23b47b41-d83f-4827-b561-1a9e4da2449a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.090274 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-23b47b41-d83f-4827-b561-1a9e4da2449a tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.011490 Nov 02 13:14:31.091348 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 170/315] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:14:31 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:31.096003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-73c93fef-cf55-4f5c-a694-c40412ea498f tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-73c93fef-cf55-4f5c-a694-c40412ea498f tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Request method failure captured: Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 27 Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz6-eHIdTCbGdx0nPdyfuOvFcK5ZbXajdU3DHt3gsvKm_1o8nebR8szOvTGB0qM_hCnoa50HFByH9O0ip_r5bbAvEzHCfKX0G1sdh6gardNaMnKQIBaJZhOA4YqqJcWCm_ztcU6-eki3vMnN1G6yr2YfQzK3bTUYdflHIptW2rkc_4 Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:31.099539 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4be137d468a74b06be4176d6e058e078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4be137d468a74b06be4176d6e058e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c9492eb69cd445609072e498c6d85fb7 Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: {"aggregate": {"name": ""}} Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:31.100734 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'aggregate': {'name': ''}}} Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi '' Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:31.101467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:14:31.103303 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.104686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-73c93fef-cf55-4f5c-a694-c40412ea498f tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:31.104686 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-73c93fef-cf55-4f5c-a694-c40412ea498f tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.008598 Nov 02 13:14:31.104686 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 171/316] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:31 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:14:31.107751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41492ea9-acaf-45db-b839-571b0e6b47b9 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.131612 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41492ea9-acaf-45db-b839-571b0e6b47b9 tempest-AggregatesAdminTestJSON-1021793488 tempest-AggregatesAdminTestJSON-1021793488-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.029154 Nov 02 13:14:31.132287 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 172/317] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:31 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:31.137904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea2d8178-bab9-42fe-bdd8-eb62ea31c140 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-735091559"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:31.142159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ea2d8178-bab9-42fe-bdd8-eb62ea31c140 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '8e36ac58cc814ffeb0d23b43a147a9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21c59db5c1a4c67a8fa75fd07836aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea2d8178-bab9-42fe-bdd8-eb62ea31c140 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Request method failure captured: Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 59 Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4L3DmkAOiA0xkFQdH7hj6LdT2MwQKpjYbDkOfUybny2j8Uryhi-QQcCHUJl1AR1r5fR4vL6p3DKrfOOkXcQtBY3lrOWkB_deOCLUFXApcQVyagxjxHXvQmXGoFKpjQ0unv0LbXTLVDi6TruiRbDGYw55wEv0Kng8PPubY0Cuws9U Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:31.143839 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 8e36ac58cc814ffeb0d23b43a147a9a2 Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: {"aggregate": {"name": "tempest-test_aggregate-735091559"}} Nov 02 13:14:31.145307 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-735091559'}}} Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:31.146155 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:31.147561 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 13:14:31.151256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.151256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea2d8178-bab9-42fe-bdd8-eb62ea31c140 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:31.151256 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ea2d8178-bab9-42fe-bdd8-eb62ea31c140 tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011798 Nov 02 13:14:31.151256 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 173/318] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:31 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:31.151256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.151256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:31.153665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=79,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:31.159715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.160200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.160715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.161634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.162098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.162521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.179049 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] HTTP exception thrown: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Request method failure captured: Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 HTTP/1.1 Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz33vIZLxiFLL0JY_CAFPjY4dbVIGqN9Gkdkl7ieWPv17BEhD6RhASylT-xWDpyfmZhGVaJGtPUwuknVOhtNXurMakQ8oQW4nikL0JROyIA60uoSLnq5dHcb8y598WcWFA3ckJydcj5aU6IMUQInht4EweUyJHv-s8iUWX4QAWmC_8 Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 060da8c8e0ef485bac2056ad1de33e97 Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminTestJSON-299175072 Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:31.180556 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminTestJSON-299175072 Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 060da8c8e0ef485bac2056ad1de33e97 Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-299175072 Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminTestJSON-299175072-project Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3f05bd7be4364470b47f8de48a29636a Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminTestJSON-299175072-project Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.182070 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f064c9b8-b625-48ff-8f68-3558f114b880'} Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:31.182949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.184651 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.186142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Returning 404 to user: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:31.186142 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ab2b994d-f3a1-4b7c-9a56-91921dd75f92 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 404 len: 111 microversion: 2.1 time: 0.034963 Nov 02 13:14:31.186142 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 174/319] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:14:31 2022] DELETE /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:31.187240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2ab69327-ee06-4621-9725-24dc97a6e79e tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1183520418"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:31.190990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-2ab69327-ee06-4621-9725-24dc97a6e79e tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Generated uuid 946cfcad-f0bc-4d26-8d32-23530041b3ab for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:31.216594 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2ab69327-ee06-4621-9725-24dc97a6e79e tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.032964 Nov 02 13:14:31.217537 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 175/320] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:31.223061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.223987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] [instance: f064c9b8-b625-48ff-8f68-3558f114b880] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:31.232727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.233270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.233767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.234476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.234973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.235472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.253173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] HTTP exception thrown: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Request method failure captured: Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 HTTP/1.1 Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz33vIZLxiFLL0JY_CAFPjY4dbVIGqN9Gkdkl7ieWPv17BEhD6RhASylT-xWDpyfmZhGVaJGtPUwuknVOhtNXurMakQ8oQW4nikL0JROyIA60uoSLnq5dHcb8y598WcWFA3ckJydcj5aU6IMUQInht4EweUyJHv-s8iUWX4QAWmC_8 Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 060da8c8e0ef485bac2056ad1de33e97 Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminTestJSON-299175072 Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:31.255554 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/060da8c8e0ef485bac2056ad1de33e97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminTestJSON-299175072 Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 060da8c8e0ef485bac2056ad1de33e97 Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-299175072 Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminTestJSON-299175072-project Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3f05bd7be4364470b47f8de48a29636a Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminTestJSON-299175072-project Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.256801 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f064c9b8-b625-48ff-8f68-3558f114b880'} Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:31.257464 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. Nov 02 13:14:31.259426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.262343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] Returning 404 to user: Instance f064c9b8-b625-48ff-8f68-3558f114b880 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:31.262343 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cde33bb9-0957-43b3-a805-e676c998a8e2 tempest-AggregatesAdminTestJSON-299175072 tempest-AggregatesAdminTestJSON-299175072-project] 10.222.0.113 "GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880" status: 404 len: 111 microversion: 2.1 time: 0.038491 Nov 02 13:14:31.262343 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 176/321] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:31 2022] GET /compute/v2.1/servers/f064c9b8-b625-48ff-8f68-3558f114b880 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:31.270107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.270874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:31.277964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.278447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.278930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.279699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.280106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.280527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.564760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:31.575281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:31.583375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:31.584819 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d2975bb8-45ef-4347-b72b-11e3dd6ccbd6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.322034 Nov 02 13:14:31.586720 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 177/322] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:31 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:31.595205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c03fd73d-089b-435d-860c-7b42b5782463 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1183520418"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:31.599456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.aggregate [None req-c03fd73d-089b-435d-860c-7b42b5782463 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Generated uuid 07bb83b0-6674-4ad0-9b3e-648c0a039c31 for aggregate {{(pid=120928) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:31.627397 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-c03fd73d-089b-435d-860c-7b42b5782463 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1183520418 already exists. Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c03fd73d-089b-435d-860c-7b42b5782463 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Request method failure captured: Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 60 Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz6-eHIdTCbGdx0nPdyfuOvFcK5ZbXajdU3DHt3gsvKm_1o8nebR8szOvTGB0qM_hCnoa50HFByH9O0ip_r5bbAvEzHCfKX0G1sdh6gardNaMnKQIBaJZhOA4YqqJcWCm_ztcU6-eki3vMnN1G6yr2YfQzK3bTUYdflHIptW2rkc_4 Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:31.629155 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4be137d468a74b06be4176d6e058e078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4be137d468a74b06be4176d6e058e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c9492eb69cd445609072e498c6d85fb7 Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: {"aggregate": {"name": "tempest-test_aggregate-1183520418"}} Nov 02 13:14:31.630516 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: exception: Aggregate tempest-test_aggregate-1183520418 already exists. Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1183520418'}}} Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6460, in create_aggregate Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi aggregate.create() Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Nov 02 13:14:31.631293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1183520418 already exists. Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:31.632594 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1183520418 already exists. Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1183520418 already exists. Nov 02 13:14:31.634355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.635769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:31.637449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c03fd73d-089b-435d-860c-7b42b5782463 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1183520418 already exists. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:31.638729 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c03fd73d-089b-435d-860c-7b42b5782463 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.050636 Nov 02 13:14:31.639829 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 178/323] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:31 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:14:31.647803 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66d78440-2e9e-4031-ac26-8e5afb899a1d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.619411 Nov 02 13:14:31.648207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bafe1ec7-c86c-4af8-9a58-bb1d1299abb6 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.659570 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 146/324] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:31 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:31.687160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bafe1ec7-c86c-4af8-9a58-bb1d1299abb6 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.043116 Nov 02 13:14:31.688264 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 179/325] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:31 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:31.696781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-89873a42-0ef4-4f7e-8bec-0495a59a3523 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-101248093"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:31.701013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.aggregate [None req-89873a42-0ef4-4f7e-8bec-0495a59a3523 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Generated uuid b9ea4426-8c6d-425a-9efb-f433db47074a for aggregate {{(pid=120929) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:31.746731 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-89873a42-0ef4-4f7e-8bec-0495a59a3523 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053087 Nov 02 13:14:31.753735 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 147/326] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:31.758888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a6c6c43-032a-41d6-8f9c-06ffe0a0033b tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.760450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a6c6c43-032a-41d6-8f9c-06ffe0a0033b tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '8e36ac58cc814ffeb0d23b43a147a9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21c59db5c1a4c67a8fa75fd07836aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a6c6c43-032a-41d6-8f9c-06ffe0a0033b tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Request method failure captured: Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4L3DmkAOiA0xkFQdH7hj6LdT2MwQKpjYbDkOfUybny2j8Uryhi-QQcCHUJl1AR1r5fR4vL6p3DKrfOOkXcQtBY3lrOWkB_deOCLUFXApcQVyagxjxHXvQmXGoFKpjQ0unv0LbXTLVDi6TruiRbDGYw55wEv0Kng8PPubY0Cuws9U Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:31.762440 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 8e36ac58cc814ffeb0d23b43a147a9a2 Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 13:14:31.763931 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '15'} Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:31.764791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.765907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a6c6c43-032a-41d6-8f9c-06ffe0a0033b tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:31.771793 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a6c6c43-032a-41d6-8f9c-06ffe0a0033b tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.016474 Nov 02 13:14:31.772221 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 180/327] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:31 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:14:31.775938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b27154e1-d0e9-4d27-9a61-437ae45aa811 req-0805b902-488e-429f-bf40-2484f43a3f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a666ce7-0433-421b-a544-09993f3d8bb9", "name": "network-vif-plugged", "status": "completed", "tag": "057ba00a-d409-443a-8d37-16af8619f0fe"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:31.782706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6f4350f3-a829-466c-b644-ccd3cd41e9f3 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.799983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b27154e1-d0e9-4d27-9a61-437ae45aa811 req-0805b902-488e-429f-bf40-2484f43a3f70 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.803803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b27154e1-d0e9-4d27-9a61-437ae45aa811 req-0805b902-488e-429f-bf40-2484f43a3f70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.804386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b27154e1-d0e9-4d27-9a61-437ae45aa811 req-0805b902-488e-429f-bf40-2484f43a3f70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.818834 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b27154e1-d0e9-4d27-9a61-437ae45aa811 req-0805b902-488e-429f-bf40-2484f43a3f70 service nova] Creating event network-vif-plugged:057ba00a-d409-443a-8d37-16af8619f0fe for instance 4a666ce7-0433-421b-a544-09993f3d8bb9 on n-h2-858384-19 Nov 02 13:14:31.832554 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6f4350f3-a829-466c-b644-ccd3cd41e9f3 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.053482 Nov 02 13:14:31.837855 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 181/328] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:31 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:31.842206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b27154e1-d0e9-4d27-9a61-437ae45aa811 req-0805b902-488e-429f-bf40-2484f43a3f70 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075197 Nov 02 13:14:31.845090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.845712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:31.858004 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 148/329] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:31.865456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c302085-aa0c-4440-abf0-ebec3ed6b20c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:31.872345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.872829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.873274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.889088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:31.889687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:31.890705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:31.904237 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-1c302085-aa0c-4440-abf0-ebec3ed6b20c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c302085-aa0c-4440-abf0-ebec3ed6b20c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Request method failure captured: Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYmz6-eHIdTCbGdx0nPdyfuOvFcK5ZbXajdU3DHt3gsvKm_1o8nebR8szOvTGB0qM_hCnoa50HFByH9O0ip_r5bbAvEzHCfKX0G1sdh6gardNaMnKQIBaJZhOA4YqqJcWCm_ztcU6-eki3vMnN1G6yr2YfQzK3bTUYdflHIptW2rkc_4 Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:14:31.916893 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4be137d468a74b06be4176d6e058e078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4be137d468a74b06be4176d6e058e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: c9492eb69cd445609072e498c6d85fb7 Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: exception: Aggregate -1 could not be found. Nov 02 13:14:31.919459 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '-1'} Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:14:31.920164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.921265 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:31.922418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:31.922418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:31.922418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:31.922418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:31.922418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 13:14:31.922418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:31.925055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c302085-aa0c-4440-abf0-ebec3ed6b20c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:31.926156 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c302085-aa0c-4440-abf0-ebec3ed6b20c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.066987 Nov 02 13:14:31.931068 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 149/330] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:31 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:14:31.936874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42b6f5d4-80d4-418f-b134-7403d74a7474 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-352269097"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:31.947503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.aggregate [None req-42b6f5d4-80d4-418f-b134-7403d74a7474 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Generated uuid 1d0a5e4f-5346-4848-bd3d-b05cd1ca2b9e for aggregate {{(pid=120929) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:31.955859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:31.994537 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-42b6f5d4-80d4-418f-b134-7403d74a7474 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061252 Nov 02 13:14:31.996584 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 150/331] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:32.012296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-177ce012-4574-4016-a46f-b6a47faba7fc tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:32.014780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-177ce012-4574-4016-a46f-b6a47faba7fc tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '8e36ac58cc814ffeb0d23b43a147a9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21c59db5c1a4c67a8fa75fd07836aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-177ce012-4574-4016-a46f-b6a47faba7fc tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Request method failure captured: Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYmz4L3DmkAOiA0xkFQdH7hj6LdT2MwQKpjYbDkOfUybny2j8Uryhi-QQcCHUJl1AR1r5fR4vL6p3DKrfOOkXcQtBY3lrOWkB_deOCLUFXApcQVyagxjxHXvQmXGoFKpjQ0unv0LbXTLVDi6TruiRbDGYw55wEv0Kng8PPubY0Cuws9U Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:14:32.016554 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 8e36ac58cc814ffeb0d23b43a147a9a2 Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 13:14:32.017932 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '16'} Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:32.018605 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 13:14:32.019701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.022580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-177ce012-4574-4016-a46f-b6a47faba7fc tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:32.024327 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-177ce012-4574-4016-a46f-b6a47faba7fc tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] 10.222.0.113 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.020142 Nov 02 13:14:32.025501 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 151/332] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:32 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:32.035489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-def51286-0321-43b9-9215-d78378e012d1 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:32.107627 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-def51286-0321-43b9-9215-d78378e012d1 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.072960 Nov 02 13:14:32.119864 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 152/333] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:32 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:32.127787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:32.129169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:32.135377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:32.138039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:32.139390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:32.140780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:32.142565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:32.143037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:32.143540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:32.253266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:32.298644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:32.309753 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-509fa8a7-9e5d-4fdf-983a-ae1e6b75583b tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1322 microversion: 2.1 time: 0.186262 Nov 02 13:14:32.319299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:32.323104 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 153/334] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:32 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:32.330663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d7d2f97f-6ced-4b41-9c5e-f95bc71f3a45 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:32.334529 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e69cdc94-5701-4332-853c-a2a1c879b9eb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1324 microversion: 2.1 time: 0.495462 Nov 02 13:14:32.336227 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 182/335] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:31 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1324 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:32.356008 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d7d2f97f-6ced-4b41-9c5e-f95bc71f3a45 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d7d2f97f-6ced-4b41-9c5e-f95bc71f3a45 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Request method failure captured: Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYmz6-eHIdTCbGdx0nPdyfuOvFcK5ZbXajdU3DHt3gsvKm_1o8nebR8szOvTGB0qM_hCnoa50HFByH9O0ip_r5bbAvEzHCfKX0G1sdh6gardNaMnKQIBaJZhOA4YqqJcWCm_ztcU6-eki3vMnN1G6yr2YfQzK3bTUYdflHIptW2rkc_4 Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:14:32.360885 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4be137d468a74b06be4176d6e058e078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4be137d468a74b06be4176d6e058e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: c9492eb69cd445609072e498c6d85fb7 Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: exception: Aggregate -1 could not be found. Nov 02 13:14:32.362418 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '-1'} Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:32.363271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 13:14:32.364630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.366337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d7d2f97f-6ced-4b41-9c5e-f95bc71f3a45 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:32.367161 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d7d2f97f-6ced-4b41-9c5e-f95bc71f3a45 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042500 Nov 02 13:14:32.369934 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 154/336] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:32 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:14:32.384317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd76eaf7-1c24-4ac0-8b8d-bfda7926d17a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:32.389062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fd76eaf7-1c24-4ac0-8b8d-bfda7926d17a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '8e36ac58cc814ffeb0d23b43a147a9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21c59db5c1a4c67a8fa75fd07836aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd76eaf7-1c24-4ac0-8b8d-bfda7926d17a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Request method failure captured: Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4L3DmkAOiA0xkFQdH7hj6LdT2MwQKpjYbDkOfUybny2j8Uryhi-QQcCHUJl1AR1r5fR4vL6p3DKrfOOkXcQtBY3lrOWkB_deOCLUFXApcQVyagxjxHXvQmXGoFKpjQ0unv0LbXTLVDi6TruiRbDGYw55wEv0Kng8PPubY0Cuws9U Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:32.390869 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 8e36ac58cc814ffeb0d23b43a147a9a2 Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 13:14:32.392414 n-d-858384-19 devstack@n-api.service[120928]: action_args: {} Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:32.393793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 13:14:32.395443 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.398736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd76eaf7-1c24-4ac0-8b8d-bfda7926d17a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:32.399764 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd76eaf7-1c24-4ac0-8b8d-bfda7926d17a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] 10.222.0.113 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020487 Nov 02 13:14:32.406948 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 183/337] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:14:32 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:32.414837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8a4ce5c3-d2ff-4dfd-ae8b-dd77fcef1f30 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-172243442"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:32.422474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.aggregate [None req-8a4ce5c3-d2ff-4dfd-ae8b-dd77fcef1f30 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Generated uuid 3ba93fad-e8d7-4322-b56b-5200bb9b5594 for aggregate {{(pid=120929) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:32.474181 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8a4ce5c3-d2ff-4dfd-ae8b-dd77fcef1f30 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065667 Nov 02 13:14:32.484383 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 155/338] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:32.488026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4706efdf-2f3f-45be-827c-0c020996d844 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:32.508307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4706efdf-2f3f-45be-827c-0c020996d844 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:32.509022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4706efdf-2f3f-45be-827c-0c020996d844 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:32.509811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4706efdf-2f3f-45be-827c-0c020996d844 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:32.613609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:32.614735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:32.623367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:32.624214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:32.625006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:32.626186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:32.656919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:32.659002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:32.715676 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4706efdf-2f3f-45be-827c-0c020996d844 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.231589 Nov 02 13:14:32.717288 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 184/339] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 13:14:32 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:32.722714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:32.724281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:32.746738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:32.747731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:32.748527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:32.749563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:32.750018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:32.750524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:32.898011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:32.908820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:32.910514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:32.911995 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e8e96f4-c4bc-402b-892e-ec98955762e4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.303245 Nov 02 13:14:32.913326 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 156/340] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:32 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:32.919470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9056e82a-4e2b-4577-87ca-79eb1d63d35a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-19"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:32.923539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9056e82a-4e2b-4577-87ca-79eb1d63d35a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '8e36ac58cc814ffeb0d23b43a147a9a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21c59db5c1a4c67a8fa75fd07836aba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9056e82a-4e2b-4577-87ca-79eb1d63d35a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Request method failure captured: Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 43 Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYmz4L3DmkAOiA0xkFQdH7hj6LdT2MwQKpjYbDkOfUybny2j8Uryhi-QQcCHUJl1AR1r5fR4vL6p3DKrfOOkXcQtBY3lrOWkB_deOCLUFXApcQVyagxjxHXvQmXGoFKpjQ0unv0LbXTLVDi6TruiRbDGYw55wEv0Kng8PPubY0Cuws9U Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:14:32.925400 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b21c59db5c1a4c67a8fa75fd07836aba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b21c59db5c1a4c67a8fa75fd07836aba Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758 Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 8e36ac58cc814ffeb0d23b43a147a9a2 Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1932274758-project Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: {"remove_host": {"host": "n-h2-858384-19"}} Nov 02 13:14:32.926617 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-858384-19'}}} Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:32.927326 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 13:14:32.928420 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:32.930644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9056e82a-4e2b-4577-87ca-79eb1d63d35a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:32.931719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9056e82a-4e2b-4577-87ca-79eb1d63d35a tempest-AggregatesAdminNegativeTestJSON-1932274758 tempest-AggregatesAdminNegativeTestJSON-1932274758-project] 10.222.0.113 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.017137 Nov 02 13:14:32.936996 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 157/341] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 13:14:32 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:32.942239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e4c8536a-7739-4160-9b1f-c86684e22384 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-19"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:32.958685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4c8536a-7739-4160-9b1f-c86684e22384 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:32.960057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4c8536a-7739-4160-9b1f-c86684e22384 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:32.960716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4c8536a-7739-4160-9b1f-c86684e22384 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:32.987647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:32.999408 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44176365-0185-40bb-b3b8-34264b22963d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.279315 Nov 02 13:14:33.007338 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 185/342] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:32 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:33.107967 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e4c8536a-7739-4160-9b1f-c86684e22384 tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.169141 Nov 02 13:14:33.109675 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 158/343] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 13:14:32 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:33.121131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-732378a4-7c7c-4bf0-9aba-26fe2ba2ee2e tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:33.143970 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-732378a4-7c7c-4bf0-9aba-26fe2ba2ee2e tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.026998 Nov 02 13:14:33.144729 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 186/344] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:33 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:33.155545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c886bb1-a7a8-4192-b4df-85c198bfc6af tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-206586963"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:33.160717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.aggregate [None req-4c886bb1-a7a8-4192-b4df-85c198bfc6af tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Generated uuid 3faf8ca1-4fab-48e4-bd58-5c5315f1a88f for aggregate {{(pid=120929) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:14:33.189770 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c886bb1-a7a8-4192-b4df-85c198bfc6af tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039205 Nov 02 13:14:33.200755 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 159/345] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 13:14:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:33.205863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:33.224910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:33.227083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:33.227815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:33.238696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:33.239609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:33.240540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:33.258235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.compute.aggregates [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 13:14:33.262911 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Request method failure captured: Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 42 Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz6-eHIdTCbGdx0nPdyfuOvFcK5ZbXajdU3DHt3gsvKm_1o8nebR8szOvTGB0qM_hCnoa50HFByH9O0ip_r5bbAvEzHCfKX0G1sdh6gardNaMnKQIBaJZhOA4YqqJcWCm_ztcU6-eki3vMnN1G6yr2YfQzK3bTUYdflHIptW2rkc_4 Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:33.264934 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4be137d468a74b06be4176d6e058e078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4be137d468a74b06be4176d6e058e078"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4be137d468a74b06be4176d6e058e078"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4be137d468a74b06be4176d6e058e078 Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799 Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c9492eb69cd445609072e498c6d85fb7 Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: {"remove_host": {"host": "nonexist_host"}} Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:33.266332 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot remove host nonexist_host in aggregate 18 Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 13:14:33.267358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6685, in remove_host_from_aggregate Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Nov 02 13:14:33.269999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:33.272012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:33.273654 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:33.273654 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:33.273654 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:33.273654 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:33.273654 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Nov 02 13:14:33.273654 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:33.273654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:33.273654 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79409b8e-1f2a-4b29-a3c9-4f446cf9ef4c tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.067192 Nov 02 13:14:33.273654 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 187/346] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 13:14:33 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:14:33.283440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a716ed6-52b5-446f-9eb4-ea6a46a7346d tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:33.314865 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a716ed6-52b5-446f-9eb4-ea6a46a7346d tempest-AggregatesAdminNegativeTestJSON-1814605799 tempest-AggregatesAdminNegativeTestJSON-1814605799-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.037830 Nov 02 13:14:33.315682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 160/347] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:33 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:14:33.335350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:33.336108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:33.344332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:33.345125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:33.345792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:33.346715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:33.347416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:33.348041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:33.364332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:33.365472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:33.394832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:33.395357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:33.395800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:33.396520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:33.401441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:33.401965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:33.600429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:33.614719 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-965a6618-895e-4ab8-af33-77fed6337091 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1472 microversion: 2.1 time: 0.283565 Nov 02 13:14:33.615588 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 188/348] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:33 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:33.679579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:33.691567 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-52d5e530-b16e-4047-9daf-39fdaeacf227 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1324 microversion: 2.1 time: 0.333248 Nov 02 13:14:33.692461 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 161/349] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:33 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:33.945289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:33.946327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:33.956206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:33.957142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:33.959378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:33.961020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:33.962961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:33.964203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:34.127712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:34.134378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-631355766", "block_migration": true, "disk_over_commit": false}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:34.138912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:34.139710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:34.142831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:34.144121 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3182f6e0-55a8-459e-bfd1-3b7f6688f0cd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.204249 Nov 02 13:14:34.145080 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 162/350] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:33 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:34.149834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:34.150689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:34.158909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:34.159744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:34.160420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:34.162215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:34.163075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:34.164081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:34.167095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:34.168241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:34.168695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:34.169697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:34.170333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:34.170767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:34.207513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:34.265533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lazy-loading 'flavor' on Instance uuid 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:34.325846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Going to try to live migrate instance to tempest-host-631355766 {{(pid=120928) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:14:34.329752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:34.334256 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] HTTP exception thrown: Compute host tempest-host-631355766 could not be found. Nov 02 13:14:34.341112 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7fed7b8-c653-45d8-800b-46d967f0e7d2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.194602 Nov 02 13:14:34.342035 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 163/351] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:34 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Request method failure captured: Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1/action HTTP/1.1 Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 106 Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0VGSAiQDe9X-TpLnsBtpxV4Mu9aB90Ku-1-loZ7w4SWy2m06EqoF5afDJTWZBW8OVj0XSavdTPCw-aYc5HFEVHixz78WMUM8f2J3F83RfohQ6MyFwzHZHqAbNaenZmS_ajp9a7odrKfqMqnJccQ1P39MTGnS4WvFTmdI4jzBRVHfc Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 48fc3bac8edc4cceac3ec65bbad28d3f Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-LiveMigrationNegativeTest-653266951 Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:34.347255 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/48fc3bac8edc4cceac3ec65bbad28d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/48fc3bac8edc4cceac3ec65bbad28d3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_48fc3bac8edc4cceac3ec65bbad28d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/48fc3bac8edc4cceac3ec65bbad28d3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-LiveMigrationNegativeTest-653266951 Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 48fc3bac8edc4cceac3ec65bbad28d3f Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-653266951 Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-LiveMigrationNegativeTest-653266951-project-admin Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3a7ac80c0aaf48bea22aa763927a1b83 Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-LiveMigrationNegativeTest-653266951-project-admin Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: {"os-migrateLive": {"host": "tempest-host-631355766", "block_migration": true, "disk_over_commit": false}} Nov 02 13:14:34.348616 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: exception: Compute host tempest-host-631355766 could not be found. Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '800fbdf2-d748-4d08-ae3b-c5a4d0401ab1', 'body': {'os-migrateLive': {'host': 'tempest-host-631355766', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:14:34.349426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5489, in live_migrate Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-631355766 could not be found. Nov 02 13:14:34.350591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-631355766 could not be found. Nov 02 13:14:34.351900 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:34.353174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:34.353174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:34.353174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:34.353174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:34.353174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:34.353174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:34.353174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:34.353174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-631355766 could not be found. Nov 02 13:14:34.353174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:34.354811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Returning 400 to user: Compute host tempest-host-631355766 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:34.355974 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-121fcba4-4c65-4a56-a04b-3ce150979111 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1/action" status: 400 len: 99 microversion: 2.1 time: 0.709684 Nov 02 13:14:34.356819 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 189/352] 10.222.0.113 () {60 vars in 1284 bytes} [Wed Nov 2 13:14:33 2022] POST /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1/action => generated 99 bytes in 712 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 13:14:34.364912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:34.365736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:34.372524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:34.373282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:34.373993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:34.374851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:34.375561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:34.376152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:34.602775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:34.625625 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b8c3608-1652-4f9d-8256-ea376c23d566 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1472 microversion: 2.1 time: 0.264417 Nov 02 13:14:34.626604 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 164/353] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:34 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:34.715731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:34.716353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:34.728369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:34.729160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:34.731659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:34.732562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:34.744114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:34.744977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:34.950105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1958211306", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:34.987192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:35.001419 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de10a758-a6e9-4100-ac0c-f8ce49cea2b6 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1474 microversion: 2.1 time: 0.290389 Nov 02 13:14:35.003084 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 190/354] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:34 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1474 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:35.008248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-611cc7a6-17f8-463e-87df-f0be2b0f1dc8 req-a21aa1a9-0d14-42a6-bce2-7a26b151c699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7e88a9-99ef-4852-9e10-1c55a1ded715", "name": "network-vif-plugged", "status": "completed", "tag": "88c1f69b-6cdf-4c29-8632-fbddd4fe544c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:35.022963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-611cc7a6-17f8-463e-87df-f0be2b0f1dc8 req-a21aa1a9-0d14-42a6-bce2-7a26b151c699 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.023701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-611cc7a6-17f8-463e-87df-f0be2b0f1dc8 req-a21aa1a9-0d14-42a6-bce2-7a26b151c699 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.024395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-611cc7a6-17f8-463e-87df-f0be2b0f1dc8 req-a21aa1a9-0d14-42a6-bce2-7a26b151c699 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.053686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] validate_networks() for None {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:14:35.054550 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-611cc7a6-17f8-463e-87df-f0be2b0f1dc8 req-a21aa1a9-0d14-42a6-bce2-7a26b151c699 service nova] Creating event network-vif-plugged:88c1f69b-6cdf-4c29-8632-fbddd4fe544c for instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 on n-h1-858384-19 Nov 02 13:14:35.062029 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-611cc7a6-17f8-463e-87df-f0be2b0f1dc8 req-a21aa1a9-0d14-42a6-bce2-7a26b151c699 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057383 Nov 02 13:14:35.064323 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 191/355] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:35.070730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b6a5c57-99b6-427f-a84b-0074730e2965 tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:35.075204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b6a5c57-99b6-427f-a84b-0074730e2965 tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:35.087372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c57-99b6-427f-a84b-0074730e2965 tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.087939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c57-99b6-427f-a84b-0074730e2965 tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.088392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c57-99b6-427f-a84b-0074730e2965 tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.089549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c57-99b6-427f-a84b-0074730e2965 tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.090658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c57-99b6-427f-a84b-0074730e2965 tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.091929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c57-99b6-427f-a84b-0074730e2965 tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.237330 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b6a5c57-99b6-427f-a84b-0074730e2965 tempest-DeleteServersAdminTestJSON-880518945 tempest-DeleteServersAdminTestJSON-880518945-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9/action" status: 202 len: 0 microversion: 2.1 time: 0.169969 Nov 02 13:14:35.239720 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 192/356] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:14:35 2022] POST /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:35.249890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:35.251201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:35.261723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.262636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.264240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.265295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.266114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.266866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.417400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:14:35.417768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:14:35.418243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:14:35.418809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:14:35.419245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:14:35.429281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.429868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.430324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.431341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.431942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.432523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.446489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:35.451927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Getting quotas for project 40d6720a9e154953b426a39100429327. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:35.456996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Getting quotas for user 0195abc2f8b24f46895a27d5ee2e8f7f and project 40d6720a9e154953b426a39100429327. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:35.459061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:35.461199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:35.463552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8e338f9f-b469-428c-b1c5-a570b9373268 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.222555 Nov 02 13:14:35.465436 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 193/357] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:35 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:35.470986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:14:35.471442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:35.472074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:35.473770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:14:35.478447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.479207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.479571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.481042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.481620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.482047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.520649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.521035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.521519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.521963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lazy-loading 'fault' on Instance uuid 4a666ce7-0433-421b-a544-09993f3d8bb9 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:35.547916 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ca39d253-63b1-4616-8ee4-868a8e6283ea tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.599470 Nov 02 13:14:35.560040 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 165/358] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:14:34 2022] POST /compute/v2.1/servers => generated 382 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:14:35.573586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:35.579833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:35.609141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.610186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.610968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.611870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.612726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.613537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.765970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:35.788562 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a9ba323-3f1d-41b1-b8e5-f2da958ee7d5 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1457 microversion: 2.1 time: 0.311749 Nov 02 13:14:35.792731 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 194/359] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:35 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1457 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:35.803869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f1e525a-6c29-402c-bf7d-116b3ffa16ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:35.809619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f1e525a-6c29-402c-bf7d-116b3ffa16ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:35.820786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:35.832020 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-066d5959-5641-4642-8629-ad4ffd48aa09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.270457 Nov 02 13:14:35.832727 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 166/360] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:35 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:35.860821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:35.861328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:35.875617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.876323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.878067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.878820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:35.879323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:35.879763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:35.936882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:14:35.950907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f1e525a-6c29-402c-bf7d-116b3ffa16ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:35.968095 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f1e525a-6c29-402c-bf7d-116b3ffa16ff tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1223 microversion: 2.1 time: 0.174057 Nov 02 13:14:35.969249 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 195/361] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:35 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:36.131884 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-728fda12-1a09-4306-89ba-74a2731d6fbd tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "DELETE /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 204 len: 0 microversion: 2.1 time: 0.294111 Nov 02 13:14:36.133718 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 167/362] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:14:35 2022] DELETE /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:14:36.144093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:36.145024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:36.161464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:36.162056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:36.163183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:36.164068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:36.164647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:36.165426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:36.214221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:36.215450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:36.216108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:36.216805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lazy-loading 'fault' on Instance uuid 4a666ce7-0433-421b-a544-09993f3d8bb9 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:36.382173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1792795543", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": "none"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:36.420576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:36.431389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-db887182-ac45-4163-8f56-1031521b83aa tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1463 microversion: 2.1 time: 0.291255 Nov 02 13:14:36.432464 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 168/363] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:36 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1463 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:36.440885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:14:36.441305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:14:36.441770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:14:36.442334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:14:36.442896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:14:36.453947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:36.454585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:36.455102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:36.456389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:36.456925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:36.457390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:36.490544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:36.491572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:36.506518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Getting quotas for project 26aa825790e446d6babe2b0481cbdf01. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:36.513407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:36.513935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:36.514382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:36.515128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:36.515579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:36.516069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:36.521915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Getting quotas for user 65c3ea9c1eb84e038a1ea5c80d2bbac7 and project 26aa825790e446d6babe2b0481cbdf01. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:36.538800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:14:36.541440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:14:36.599609 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6566d45f-ba3b-475b-be11-d6f28d956cbd tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.91 time: 0.629274 Nov 02 13:14:36.600435 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 196/364] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:14:35 2022] POST /compute/v2.1/servers => generated 382 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:14:36.612450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4e79819-02e8-4c61-8df4-a718b85f77e6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:36.613147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4e79819-02e8-4c61-8df4-a718b85f77e6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:36.702619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4e79819-02e8-4c61-8df4-a718b85f77e6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:36.712075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4e79819-02e8-4c61-8df4-a718b85f77e6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:36.715208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4e79819-02e8-4c61-8df4-a718b85f77e6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:36.723397 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4e79819-02e8-4c61-8df4-a718b85f77e6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1457 microversion: 2.91 time: 0.115084 Nov 02 13:14:36.723985 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 197/365] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:36 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1457 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:14:36.746749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:36.763254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:36.765505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:36.766835 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74480dd1-4e0f-4f8f-97a2-f1ff9007e2c1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1365 microversion: 2.25 time: 0.280539 Nov 02 13:14:36.783137 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 169/366] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:36 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:14:36.864238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:36.864836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:36.872079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:36.872563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:36.873025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:36.873729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:36.874171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:36.874591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.154114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:37.164186 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d0a2a4a6-74e0-46a4-80df-3c86cd59028e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.303771 Nov 02 13:14:37.164672 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 198/367] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:36 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:37.169927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.170741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:37.185874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62f2690a-f050-4d9b-a38a-2835e8907e14 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Calling method '.version_select at 0x7fe78c18bca0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.186489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.187047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.189131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.189868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.190187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f2690a-f050-4d9b-a38a-2835e8907e14 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.190335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.190677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f2690a-f050-4d9b-a38a-2835e8907e14 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.190799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.191145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f2690a-f050-4d9b-a38a-2835e8907e14 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.194136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f2690a-f050-4d9b-a38a-2835e8907e14 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.194710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f2690a-f050-4d9b-a38a-2835e8907e14 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.195031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f2690a-f050-4d9b-a38a-2835e8907e14 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.253684 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62f2690a-f050-4d9b-a38a-2835e8907e14 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.381485 Nov 02 13:14:37.256627 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 170/368] 10.222.0.113 () {58 vars in 1133 bytes} [Wed Nov 2 13:14:36 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:37.262268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-64a10bf0-5f62-46c0-88b9-6b7ae4f10344 req-d522a7af-6736-430d-9bd4-38c120ee4aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca7fedf-baa0-4492-8c62-61a6452889a9", "name": "network-vif-plugged", "status": "completed", "tag": "0e82bbfc-811d-44dc-84ed-e4ab1baebc95"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:37.275168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-64a10bf0-5f62-46c0-88b9-6b7ae4f10344 req-d522a7af-6736-430d-9bd4-38c120ee4aee service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.276065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-64a10bf0-5f62-46c0-88b9-6b7ae4f10344 req-d522a7af-6736-430d-9bd4-38c120ee4aee service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.277160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-64a10bf0-5f62-46c0-88b9-6b7ae4f10344 req-d522a7af-6736-430d-9bd4-38c120ee4aee service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.283373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:37.293715 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-64a10bf0-5f62-46c0-88b9-6b7ae4f10344 req-d522a7af-6736-430d-9bd4-38c120ee4aee service nova] Creating event network-vif-plugged:0e82bbfc-811d-44dc-84ed-e4ab1baebc95 for instance cca7fedf-baa0-4492-8c62-61a6452889a9 on n-h2-858384-19 Nov 02 13:14:37.300338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-64a10bf0-5f62-46c0-88b9-6b7ae4f10344 req-d522a7af-6736-430d-9bd4-38c120ee4aee service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042069 Nov 02 13:14:37.301826 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 171/369] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:37.316355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bf3410b4-d9bc-4235-a43f-641c2262a67d tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Calling method '.version_select at 0x7fe78c2c0790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.321597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf3410b4-d9bc-4235-a43f-641c2262a67d tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.324344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf3410b4-d9bc-4235-a43f-641c2262a67d tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.325227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf3410b4-d9bc-4235-a43f-641c2262a67d tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.326322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf3410b4-d9bc-4235-a43f-641c2262a67d tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.326996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf3410b4-d9bc-4235-a43f-641c2262a67d tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.327663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf3410b4-d9bc-4235-a43f-641c2262a67d tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.350157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:37.364817 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-109f791e-d84f-4712-addd-b18e259af692 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1227 microversion: 2.1 time: 0.198691 Nov 02 13:14:37.366994 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 199/370] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1227 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:37.392434 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bf3410b4-d9bc-4235-a43f-641c2262a67d tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.086599 Nov 02 13:14:37.395076 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 172/371] 10.222.0.113 () {58 vars in 1144 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:37.406733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2c4c854a-cc5b-4cea-a6a4-72b1132a8536 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Calling method '.version_select at 0x7fe787ed5f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.412226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4c854a-cc5b-4cea-a6a4-72b1132a8536 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.412801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4c854a-cc5b-4cea-a6a4-72b1132a8536 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.413503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4c854a-cc5b-4cea-a6a4-72b1132a8536 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.414240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4c854a-cc5b-4cea-a6a4-72b1132a8536 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.414692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4c854a-cc5b-4cea-a6a4-72b1132a8536 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.415135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4c854a-cc5b-4cea-a6a4-72b1132a8536 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.454559 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2c4c854a-cc5b-4cea-a6a4-72b1132a8536 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.051463 Nov 02 13:14:37.460835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.461708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:37.462094 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 200/372] 10.222.0.113 () {58 vars in 1150 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:14:37.469241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d79029f4-8677-4567-b920-11812d162cc4 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Calling method '.version_select at 0x7fe787ed5a60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.470608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.471151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.471570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.472303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.473973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.474195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79029f4-8677-4567-b920-11812d162cc4 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.474421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.474557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79029f4-8677-4567-b920-11812d162cc4 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.474984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79029f4-8677-4567-b920-11812d162cc4 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.475930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79029f4-8677-4567-b920-11812d162cc4 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.476809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79029f4-8677-4567-b920-11812d162cc4 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.477382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79029f4-8677-4567-b920-11812d162cc4 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.504729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:37.520214 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d79029f4-8677-4567-b920-11812d162cc4 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.056078 Nov 02 13:14:37.528936 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 201/373] 10.222.0.113 () {58 vars in 1133 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:37.538632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1b3ca41-cb4a-4bb4-b59f-69f89b594743 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Calling method '.version_select at 0x7fe787ed5f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.553406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1b3ca41-cb4a-4bb4-b59f-69f89b594743 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.553406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1b3ca41-cb4a-4bb4-b59f-69f89b594743 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.553406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1b3ca41-cb4a-4bb4-b59f-69f89b594743 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.554392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1b3ca41-cb4a-4bb4-b59f-69f89b594743 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.554865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1b3ca41-cb4a-4bb4-b59f-69f89b594743 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.555345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1b3ca41-cb4a-4bb4-b59f-69f89b594743 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.561823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.562491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.563253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.563810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lazy-loading 'fault' on Instance uuid 4a666ce7-0433-421b-a544-09993f3d8bb9 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:37.601667 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1b3ca41-cb4a-4bb4-b59f-69f89b594743 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.071830 Nov 02 13:14:37.611464 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 202/374] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:37.616144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-770df7a3-ac22-4836-aaa4-663da0dbe589 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Calling method '.version_select at 0x7fe78c0ca1f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.619873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-770df7a3-ac22-4836-aaa4-663da0dbe589 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.620466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-770df7a3-ac22-4836-aaa4-663da0dbe589 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.621976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-770df7a3-ac22-4836-aaa4-663da0dbe589 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.622758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-770df7a3-ac22-4836-aaa4-663da0dbe589 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.623257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-770df7a3-ac22-4836-aaa4-663da0dbe589 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.623692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-770df7a3-ac22-4836-aaa4-663da0dbe589 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.651312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-770df7a3-ac22-4836-aaa4-663da0dbe589 tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.037579 Nov 02 13:14:37.654485 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 203/375] 10.222.0.113 () {58 vars in 1133 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:37.666842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90f49676-2a0f-4038-8ce4-afbd3a7442cb tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Calling method '.version_select at 0x7fe787cf7dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.680515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90f49676-2a0f-4038-8ce4-afbd3a7442cb tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.682260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90f49676-2a0f-4038-8ce4-afbd3a7442cb tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.682940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90f49676-2a0f-4038-8ce4-afbd3a7442cb tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.698745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90f49676-2a0f-4038-8ce4-afbd3a7442cb tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.699484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90f49676-2a0f-4038-8ce4-afbd3a7442cb tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.700108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90f49676-2a0f-4038-8ce4-afbd3a7442cb tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.726240 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90f49676-2a0f-4038-8ce4-afbd3a7442cb tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts/n-h2-858384-19" status: 200 len: 735 microversion: 2.1 time: 0.065420 Nov 02 13:14:37.727134 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 204/376] 10.222.0.113 () {58 vars in 1178 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/os-hosts/n-h2-858384-19 => generated 735 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:14:37.753881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44527c89-d7fc-4354-98d9-0b75b81df5bf tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Calling method '.version_select at 0x7fe787cf7670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.779054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44527c89-d7fc-4354-98d9-0b75b81df5bf tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.781292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44527c89-d7fc-4354-98d9-0b75b81df5bf tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.782717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44527c89-d7fc-4354-98d9-0b75b81df5bf tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.814457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44527c89-d7fc-4354-98d9-0b75b81df5bf tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.814924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44527c89-d7fc-4354-98d9-0b75b81df5bf tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.815474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44527c89-d7fc-4354-98d9-0b75b81df5bf tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.815997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:37.842344 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44527c89-d7fc-4354-98d9-0b75b81df5bf tempest-HostsAdminTestJSON-588402093 tempest-HostsAdminTestJSON-588402093-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts/n-h1-858384-19" status: 200 len: 603 microversion: 2.1 time: 0.108414 Nov 02 13:14:37.842496 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-61f4b248-5acf-4b1f-b266-d2892ca104c1 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1463 microversion: 2.1 time: 0.383946 Nov 02 13:14:37.845066 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 173/378] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1463 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:37.859967 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 205/378] 10.222.0.113 () {58 vars in 1178 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/os-hosts/n-h1-858384-19 => generated 603 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:37.862847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.863678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:37.873403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:37.875296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:37.876570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.877406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.878309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.879735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.880778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.881512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.892030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.892030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.893835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:37.894741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:37.900808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:37.903290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.070110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:38.084582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:38.086526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:38.097465 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de7290c0-c70b-4797-8129-a4aa0b97f354 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1453 microversion: 2.91 time: 0.251072 Nov 02 13:14:38.098303 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 174/379] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1453 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:38.229926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:38.239549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:38.241302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:38.242756 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77824441-ac1f-4e7e-adf3-29a5d1a6b304 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1562 microversion: 2.25 time: 0.381483 Nov 02 13:14:38.243953 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 206/380] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:37 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1562 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:38.249274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:38.250223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:38.257013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.257703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.258409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.259293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.260023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.260766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.387384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Calling method '.version_select at 0x7fe78c18b670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:38.390011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.390672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.391297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.406009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.406789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.407414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.418705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.419622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.420214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.427428 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-edde368b-e977-40d0-94c7-38f9f81afd56 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.327676 Nov 02 13:14:38.436996 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 175/381] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:14:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:38.600404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:38.601753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:38.610168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.610809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.611460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.612275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.612855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.613416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.741382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:38.752182 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9762617b-4523-4cfd-816a-f0bbec4dad7a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1313 microversion: 2.1 time: 0.506842 Nov 02 13:14:38.752773 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 207/382] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:38 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:38.777495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:38.778478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:38.788179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.789439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 8d7e88a9-99ef-4852-9e10-1c55a1ded715 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:38.790343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.791424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.792851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.794061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.794637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.849802 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5cccd036-d66a-4d74-b24b-a9cee0140b4f tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 2056 microversion: 2.25 time: 0.411265 Nov 02 13:14:38.864792 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 176/383] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:38 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 2056 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:38.880076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Calling method '.version_select at 0x7fe78c111820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:38.882000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.882486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.882927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.899358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.900214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.901092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.912171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:38.917015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.917625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.918148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.925777 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-358d6835-6a95-4ce9-8c27-205809ca0b4c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.059659 Nov 02 13:14:38.926396 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 177/384] 10.222.0.113 () {58 vars in 1172 bytes} [Wed Nov 2 13:14:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:38.931284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:38.932052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:38.940247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.940895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.941517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.942249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.942733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.943154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.987912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:38.989888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:38.990553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:38.991390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lazy-loading 'fault' on Instance uuid 4a666ce7-0433-421b-a544-09993f3d8bb9 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:39.083890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:39.089463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:39.099585 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6259c02f-32b0-4d79-ac7d-49f3ccce0404 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1275 microversion: 2.1 time: 0.333461 Nov 02 13:14:39.099751 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec136331-a8cd-4c4d-9d5e-f7f5accec8cb tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1421 microversion: 2.1 time: 0.172262 Nov 02 13:14:39.100259 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 178/385] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:38 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1421 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:39.104324 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 208/386] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:38 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:39.116334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Calling method '.version_select at 0x7fe787ebb8b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.122817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.124316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.124981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.131439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.135486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:39.145380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.146250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.147027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.147517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.148009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.148443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.149147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.149638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.150051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.160416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.161288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.161870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.165607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:39.174146 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c6ba6d0f-126b-4f1e-89df-e82153bb24bb tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.067672 Nov 02 13:14:39.175796 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 209/387] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:39.183255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-afedb147-9a65-41c5-9aa8-338320e73de7 req-33bc598c-629e-45aa-accc-c1f4e84341bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a666ce7-0433-421b-a544-09993f3d8bb9", "name": "network-vif-deleted", "tag": "057ba00a-d409-443a-8d37-16af8619f0fe"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:39.201324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-afedb147-9a65-41c5-9aa8-338320e73de7 req-33bc598c-629e-45aa-accc-c1f4e84341bb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.202509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-afedb147-9a65-41c5-9aa8-338320e73de7 req-33bc598c-629e-45aa-accc-c1f4e84341bb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.203294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-afedb147-9a65-41c5-9aa8-338320e73de7 req-33bc598c-629e-45aa-accc-c1f4e84341bb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.218229 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-afedb147-9a65-41c5-9aa8-338320e73de7 req-33bc598c-629e-45aa-accc-c1f4e84341bb service nova] Creating event network-vif-deleted:057ba00a-d409-443a-8d37-16af8619f0fe for instance 4a666ce7-0433-421b-a544-09993f3d8bb9 on n-h2-858384-19 Nov 02 13:14:39.228583 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-afedb147-9a65-41c5-9aa8-338320e73de7 req-33bc598c-629e-45aa-accc-c1f4e84341bb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050889 Nov 02 13:14:39.229420 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 210/388] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:39.238286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.239194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:39.252734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.253410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.255049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.256001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.256605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.257615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.339157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 8d7e88a9-99ef-4852-9e10-1c55a1ded715 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:39.364708 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cd5a1026-831d-4878-aa4d-06e407b6996e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 2056 microversion: 2.25 time: 0.260724 Nov 02 13:14:39.381066 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 179/389] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 2056 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:39.390976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91939e48-e666-4c44-8987-5c16b7460f6c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Calling method '.version_select at 0x7fe78c5405e0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.397235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91939e48-e666-4c44-8987-5c16b7460f6c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.397958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91939e48-e666-4c44-8987-5c16b7460f6c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.398599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91939e48-e666-4c44-8987-5c16b7460f6c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.424799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91939e48-e666-4c44-8987-5c16b7460f6c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.425298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91939e48-e666-4c44-8987-5c16b7460f6c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.425726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91939e48-e666-4c44-8987-5c16b7460f6c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.434216 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-91939e48-e666-4c44-8987-5c16b7460f6c tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.059031 Nov 02 13:14:39.435837 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 180/390] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:39.440386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:39.441526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d66728bc-6670-4a32-8a88-fa38742f3a44 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.445358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d66728bc-6670-4a32-8a88-fa38742f3a44 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.446067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d66728bc-6670-4a32-8a88-fa38742f3a44 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.446732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d66728bc-6670-4a32-8a88-fa38742f3a44 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.447867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d66728bc-6670-4a32-8a88-fa38742f3a44 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.449117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d66728bc-6670-4a32-8a88-fa38742f3a44 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.449907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d66728bc-6670-4a32-8a88-fa38742f3a44 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.452840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:39.455211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:39.468741 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1b003a4-9a32-4ba1-b613-d1eed26b0b93 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1509 microversion: 2.91 time: 0.237791 Nov 02 13:14:39.471013 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 211/391] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:39.477064 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d66728bc-6670-4a32-8a88-fa38742f3a44 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.039939 Nov 02 13:14:39.477742 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 181/392] 10.222.0.113 () {60 vars in 1222 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:39.483812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b409673a-09a7-4060-b88a-33260ef991c2 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Calling method '.version_select at 0x7fe787e12940>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.487163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b409673a-09a7-4060-b88a-33260ef991c2 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.491888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b409673a-09a7-4060-b88a-33260ef991c2 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.492374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b409673a-09a7-4060-b88a-33260ef991c2 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.510060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-19", "block_migration": "auto"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:39.516569 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b409673a-09a7-4060-b88a-33260ef991c2 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.041572 Nov 02 13:14:39.517126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:39.517541 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 212/393] 10.222.0.113 () {58 vars in 1184 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:39.530188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.531021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.531187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Calling method '.version_select at 0x7fe787cf7ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.531855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.532955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.533182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.533824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.533934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.535007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.535875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.561855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.562384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.563175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.583776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.584323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.584987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.594247 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf336a44-9b82-40cf-9dd3-1f03f6de2778 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.068339 Nov 02 13:14:39.595408 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 213/394] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:39.619354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-85d45eb4-136d-461a-b76b-f1105af7f864 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Calling method '.version_select at 0x7fe787cf7dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.626204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85d45eb4-136d-461a-b76b-f1105af7f864 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.628142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85d45eb4-136d-461a-b76b-f1105af7f864 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.628730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85d45eb4-136d-461a-b76b-f1105af7f864 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.658375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85d45eb4-136d-461a-b76b-f1105af7f864 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.659013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85d45eb4-136d-461a-b76b-f1105af7f864 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.659859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85d45eb4-136d-461a-b76b-f1105af7f864 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.669201 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-85d45eb4-136d-461a-b76b-f1105af7f864 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.067117 Nov 02 13:14:39.670017 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 214/395] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:39.684779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-164556ca-eded-4447-b5d6-7f3418e4cdb8 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Calling method '.version_select at 0x7fe787cf7820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.686720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-164556ca-eded-4447-b5d6-7f3418e4cdb8 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.687359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-164556ca-eded-4447-b5d6-7f3418e4cdb8 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.687868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-164556ca-eded-4447-b5d6-7f3418e4cdb8 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.703905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-164556ca-eded-4447-b5d6-7f3418e4cdb8 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.704578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-164556ca-eded-4447-b5d6-7f3418e4cdb8 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.705178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-164556ca-eded-4447-b5d6-7f3418e4cdb8 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.712981 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-164556ca-eded-4447-b5d6-7f3418e4cdb8 tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.032445 Nov 02 13:14:39.719607 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 215/396] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:39.736797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Calling method '.version_select at 0x7fe787cf75e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.741175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.744331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.744331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.753094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'flavor' on Instance uuid 8d7e88a9-99ef-4852-9e10-1c55a1ded715 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:39.783331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.784919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.788018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.818995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:39.819640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:39.820146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:39.867963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Going to try to live migrate instance to n-h2-858384-19 {{(pid=120929) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:14:39.982228 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f38ffa0-c711-459e-8151-6d094687f4ed tempest-HypervisorAdminTestJSON-2044322610 tempest-HypervisorAdminTestJSON-2044322610-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.256729 Nov 02 13:14:39.988871 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 216/397] 10.222.0.113 () {58 vars in 1178 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:14:39.988871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:39.991158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:40.008126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:40.009401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:40.012666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:40.013668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:40.014540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:40.014947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:40.375134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:40.384591 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f6c1f19c-ec7d-4490-8741-7c77077d76ef tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1495 microversion: 2.1 time: 0.400153 Nov 02 13:14:40.409563 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 217/398] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:39 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1495 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:40.414586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:40.420596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:40.440580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:40.441317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:40.441975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:40.445845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:40.446511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:40.447185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:40.556482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:40.556985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:40.557424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:40.558449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lazy-loading 'fault' on Instance uuid 4a666ce7-0433-421b-a544-09993f3d8bb9 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:40.747762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908d4af5549b42d983c53229ad84e588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2ee1225f444a6b9aa4b072f71b72ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:40.764574 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5628434b-d1ae-433e-9180-c414098522b9 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 200 len: 1314 microversion: 2.1 time: 0.353678 Nov 02 13:14:40.779669 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 218/399] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:40 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:40.788991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:40.801836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:40.828416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:40.831366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:40.832233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:40.837731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:40.839827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:40.840284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:41.044929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:41.057028 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c446bf18-0d7d-4b5f-b7c2-14b5b1d7edfb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1281 microversion: 2.1 time: 0.275943 Nov 02 13:14:41.058470 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 219/400] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:40 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1281 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:41.467851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f635010-d1f2-4a7a-9d9a-688bc3b2fb90 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:41.468539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8f635010-d1f2-4a7a-9d9a-688bc3b2fb90 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:41.481950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f635010-d1f2-4a7a-9d9a-688bc3b2fb90 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:41.483959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f635010-d1f2-4a7a-9d9a-688bc3b2fb90 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:41.484521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f635010-d1f2-4a7a-9d9a-688bc3b2fb90 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:41.486312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f635010-d1f2-4a7a-9d9a-688bc3b2fb90 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:41.490159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f635010-d1f2-4a7a-9d9a-688bc3b2fb90 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:41.490858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f635010-d1f2-4a7a-9d9a-688bc3b2fb90 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:41.710550 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8f635010-d1f2-4a7a-9d9a-688bc3b2fb90 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1648 microversion: 2.1 time: 0.647896 Nov 02 13:14:41.730789 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 220/401] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:41 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1648 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:41.736629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:41.737248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:41.743820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:41.744389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:41.745016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:41.746008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:41.746877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:41.747520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:41.834106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:41.844800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:41.846594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:41.852551 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89b809f6-9d88-4178-9c68-dcffeb010360 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1515 microversion: 2.91 time: 0.120199 Nov 02 13:14:41.853806 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 221/402] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:41 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1515 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:41.860501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a81148c6-97b5-45ee-8dd5-34397c2195e4 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:41.861341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a81148c6-97b5-45ee-8dd5-34397c2195e4 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:41.869358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a81148c6-97b5-45ee-8dd5-34397c2195e4 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:41.870926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a81148c6-97b5-45ee-8dd5-34397c2195e4 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:41.871950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a81148c6-97b5-45ee-8dd5-34397c2195e4 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:41.873230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a81148c6-97b5-45ee-8dd5-34397c2195e4 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:41.874191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a81148c6-97b5-45ee-8dd5-34397c2195e4 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:41.879492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a81148c6-97b5-45ee-8dd5-34397c2195e4 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.055352 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a81148c6-97b5-45ee-8dd5-34397c2195e4 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1648 microversion: 2.1 time: 0.199349 Nov 02 13:14:42.056408 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 222/403] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:41 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1648 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:42.062743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:42.063631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:42.069978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.070958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.071839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.073853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.074674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.075842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.092361 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] HTTP exception thrown: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Request method failure captured: Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 HTTP/1.1 Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4QLDM8r9-NilJbHTqr8DOvD7tDDiXeOyXzszo40EsY3_oZ7c9MMbnIezgpaGb8-csD0TuPU66_aKr3ZpLo2YcfGIX82OA_Zvt9n-LQy4MtXcATjlqyT4WfRFEHmSmtIVbE5k-fydqy8CcsXxfXTHluMlaY4q4oInRhVdKAbE0eaw Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:42.094043 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 908d4af5549b42d983c53229ad84e588 Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.095378 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '4a666ce7-0433-421b-a544-09993f3d8bb9'} Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:42.096050 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.097134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.103511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Returning 404 to user: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:42.103511 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3113bf4f-f1b8-4b3b-9f79-1573e24fb0ab tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 404 len: 111 microversion: 2.1 time: 0.037906 Nov 02 13:14:42.103511 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 223/404] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:42 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:42.103511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-64dcdace-98f8-4208-8861-5ca5893c26e1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:42.106313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64dcdace-98f8-4208-8861-5ca5893c26e1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.106804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64dcdace-98f8-4208-8861-5ca5893c26e1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.107286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64dcdace-98f8-4208-8861-5ca5893c26e1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.108189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64dcdace-98f8-4208-8861-5ca5893c26e1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.108803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64dcdace-98f8-4208-8861-5ca5893c26e1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.109380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64dcdace-98f8-4208-8861-5ca5893c26e1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.138475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-64dcdace-98f8-4208-8861-5ca5893c26e1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040766 Nov 02 13:14:42.139084 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 224/405] 10.222.0.113 () {58 vars in 1181 bytes} [Wed Nov 2 13:14:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:42.144181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:42.144786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:42.152441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.152931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.154273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.154683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.155373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.156706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.416461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:42.425541 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3785de73-dfea-4ee6-8f01-be0b313f58cc tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1323 microversion: 2.1 time: 0.285204 Nov 02 13:14:42.426127 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 225/406] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:42 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:42.438587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:42.439073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:42.452588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.453094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.453853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.454962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.455518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.456007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.482336 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] HTTP exception thrown: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Request method failure captured: Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 HTTP/1.1 Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4QLDM8r9-NilJbHTqr8DOvD7tDDiXeOyXzszo40EsY3_oZ7c9MMbnIezgpaGb8-csD0TuPU66_aKr3ZpLo2YcfGIX82OA_Zvt9n-LQy4MtXcATjlqyT4WfRFEHmSmtIVbE5k-fydqy8CcsXxfXTHluMlaY4q4oInRhVdKAbE0eaw Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:42.484010 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 908d4af5549b42d983c53229ad84e588 Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.485465 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '4a666ce7-0433-421b-a544-09993f3d8bb9'} Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:42.486289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:42.487558 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:42.489019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Returning 404 to user: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:42.489019 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-438f128d-75b5-4473-abd6-2dcda19b8bd7 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "DELETE /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 404 len: 111 microversion: 2.1 time: 0.058831 Nov 02 13:14:42.489019 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 226/407] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:14:42 2022] DELETE /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:42.495985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-19", "block_migration": true, "disk_over_commit": false}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:42.498769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:42.512729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.512729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.512729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.513406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:42.513918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:42.514345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:42.580134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lazy-loading 'flavor' on Instance uuid cca7fedf-baa0-4492-8c62-61a6452889a9 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:42.609815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Going to try to live migrate instance to n-h1-858384-19 {{(pid=120928) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:14:45.464855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:45.836928 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-960fdf9a-1de3-4d97-9fe3-f56d9366c8cc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9/action" status: 202 len: 0 microversion: 2.1 time: 3.345454 Nov 02 13:14:45.837691 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 227/408] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:14:42 2022] POST /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9/action => generated 0 bytes in 3351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:45.843753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:45.844508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 4a666ce7-0433-421b-a544-09993f3d8bb9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:45.859724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:45.862111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:45.863001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:45.866686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:45.867484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:45.868874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:45.912229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:45.915646 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] HTTP exception thrown: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Request method failure captured: Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 HTTP/1.1 Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4QLDM8r9-NilJbHTqr8DOvD7tDDiXeOyXzszo40EsY3_oZ7c9MMbnIezgpaGb8-csD0TuPU66_aKr3ZpLo2YcfGIX82OA_Zvt9n-LQy4MtXcATjlqyT4WfRFEHmSmtIVbE5k-fydqy8CcsXxfXTHluMlaY4q4oInRhVdKAbE0eaw Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:45.918972 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 908d4af5549b42d983c53229ad84e588 Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:45.920338 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '4a666ce7-0433-421b-a544-09993f3d8bb9'} Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:45.920999 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. Nov 02 13:14:45.922065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:45.927797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Returning 404 to user: Instance 4a666ce7-0433-421b-a544-09993f3d8bb9 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:45.932358 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0be89175-754f-49a4-8818-12598f3a315a tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9" status: 404 len: 111 microversion: 2.1 time: 0.090192 Nov 02 13:14:45.934493 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 228/409] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:45 2022] GET /compute/v2.1/servers/4a666ce7-0433-421b-a544-09993f3d8bb9 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:46.050023 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0fa173b5-8404-4ddf-8321-06c7b5a9b470 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715/action" status: 202 len: 0 microversion: 2.25 time: 6.549600 Nov 02 13:14:46.050932 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 182/410] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:14:39 2022] POST /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715/action => generated 0 bytes in 6551 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:14:46.058935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:46.060316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:46.078919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.085311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.086702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.087717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.090409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.091261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.430176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:46.447302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Calling method '.version_select at 0x7fe787bf65e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:46.450641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:46.452139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.452621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:46.453572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.454090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.458610 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af127989-c49a-4f56-a506-cd6b693613ab tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1536 microversion: 2.91 time: 0.406490 Nov 02 13:14:46.460036 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 183/411] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:46 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1536 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:46.465475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:46.466085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:46.471964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.472661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.473264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.484357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.484859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.485297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.486006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.487648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.488231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.488408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.488961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.489469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.498663 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c7c0d7b6-5f08-43f1-89a0-272fc81c9718 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.562791 Nov 02 13:14:46.505179 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 229/412] 10.222.0.113 () {60 vars in 1192 bytes} [Wed Nov 2 13:14:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:46.509954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d1626385-9be7-4320-9ee8-5c5a1251c5fb req-860f5e32-16e8-4b80-82de-e74b6c7d236b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf", "tag": "8a96ffe6-083e-4c11-addf-363213fc7f2c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:46.524165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d1626385-9be7-4320-9ee8-5c5a1251c5fb req-860f5e32-16e8-4b80-82de-e74b6c7d236b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.524803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d1626385-9be7-4320-9ee8-5c5a1251c5fb req-860f5e32-16e8-4b80-82de-e74b6c7d236b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.525302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d1626385-9be7-4320-9ee8-5c5a1251c5fb req-860f5e32-16e8-4b80-82de-e74b6c7d236b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.557275 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d1626385-9be7-4320-9ee8-5c5a1251c5fb req-860f5e32-16e8-4b80-82de-e74b6c7d236b service nova] Creating event network-changed:8a96ffe6-083e-4c11-addf-363213fc7f2c for instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf on n-h2-858384-19 Nov 02 13:14:46.564418 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d1626385-9be7-4320-9ee8-5c5a1251c5fb req-860f5e32-16e8-4b80-82de-e74b6c7d236b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059513 Nov 02 13:14:46.565235 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 230/413] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:46.575549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:46.575549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:46.581622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.582190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.582694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.583717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.584091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.584581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.711197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:46.748685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:46.757439 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-139ee604-ae9f-4137-99ed-0e42fbbd699b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.188910 Nov 02 13:14:46.758334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 231/414] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:46 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:46.764399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:46.765237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:46.772377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.773200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.774056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.775263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.775969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.778502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.801311 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] HTTP exception thrown: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Request method failure captured: Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 HTTP/1.1 Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4QLDM8r9-NilJbHTqr8DOvD7tDDiXeOyXzszo40EsY3_oZ7c9MMbnIezgpaGb8-csD0TuPU66_aKr3ZpLo2YcfGIX82OA_Zvt9n-LQy4MtXcATjlqyT4WfRFEHmSmtIVbE5k-fydqy8CcsXxfXTHluMlaY4q4oInRhVdKAbE0eaw Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:46.804809 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 908d4af5549b42d983c53229ad84e588 Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:46.806089 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '342f003f-a39c-4185-878f-26cf14c103e0'} Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:46.806743 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:46.808917 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:46.812970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Returning 404 to user: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:46.814073 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7180ab32-c289-4e3a-8d55-860fde02867b tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "DELETE /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 404 len: 111 microversion: 2.1 time: 0.054594 Nov 02 13:14:46.818515 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 232/415] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:14:46 2022] DELETE /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:46.825511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:46.826474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:46.834501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.834996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.835482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.836205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.836657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.837084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:46.847561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:46.858006 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83dc2918-e1ab-451e-a254-f7e3a9ecaec6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1323 microversion: 2.1 time: 0.396730 Nov 02 13:14:46.888359 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 184/416] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:46 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1323 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:46.989350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Calling method '.version_select at 0x7fe787ef8160>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:46.991923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:46.992510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:46.993023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.016439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.016936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.017385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.032204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.032845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.033465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.042937 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-48f75b7a-8e99-48cd-b0b8-b61bfd8bbb8a tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.152133 Nov 02 13:14:47.044587 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 185/417] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:14:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:47.046965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:47.057327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:47.060076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:47.061774 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b9bc9de-85aa-465c-bed6-e7f2102e8916 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.242250 Nov 02 13:14:47.084137 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 233/418] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:46 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:47.091000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9df72c8c-3d62-4e42-901a-658f8e210373 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Calling method '.version_select at 0x7fe787bf6c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:47.097880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9df72c8c-3d62-4e42-901a-658f8e210373 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.098601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9df72c8c-3d62-4e42-901a-658f8e210373 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.099256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9df72c8c-3d62-4e42-901a-658f8e210373 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.114967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9df72c8c-3d62-4e42-901a-658f8e210373 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.115743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9df72c8c-3d62-4e42-901a-658f8e210373 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.116366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9df72c8c-3d62-4e42-901a-658f8e210373 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.139571 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9df72c8c-3d62-4e42-901a-658f8e210373 tempest-HypervisorAdminV228Test-8014772 tempest-HypervisorAdminV228Test-8014772-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.054030 Nov 02 13:14:47.140122 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 234/419] 10.222.0.113 () {60 vars in 1198 bytes} [Wed Nov 2 13:14:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:47.164461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:47.165086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] [instance: 342f003f-a39c-4185-878f-26cf14c103e0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:47.188090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.188584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.189032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.189772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.190217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.190652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.231707 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] HTTP exception thrown: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Request method failure captured: Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 HTTP/1.1 Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYmz4QLDM8r9-NilJbHTqr8DOvD7tDDiXeOyXzszo40EsY3_oZ7c9MMbnIezgpaGb8-csD0TuPU66_aKr3ZpLo2YcfGIX82OA_Zvt9n-LQy4MtXcATjlqyT4WfRFEHmSmtIVbE5k-fydqy8CcsXxfXTHluMlaY4q4oInRhVdKAbE0eaw Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:47.234930 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/da2ee1225f444a6b9aa4b072f71b72ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: da2ee1225f444a6b9aa4b072f71b72ae Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1424731654 Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 908d4af5549b42d983c53229ad84e588 Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersAdminTestJSON-1424731654-project Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:47.236527 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '342f003f-a39c-4185-878f-26cf14c103e0'} Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:47.237366 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. Nov 02 13:14:47.238761 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:47.241102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] Returning 404 to user: Instance 342f003f-a39c-4185-878f-26cf14c103e0 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:47.243359 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f36ae596-5d5e-47a5-a0f7-2cead0c0b701 tempest-DeleteServersAdminTestJSON-1424731654 tempest-DeleteServersAdminTestJSON-1424731654-project] 10.222.0.113 "GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0" status: 404 len: 111 microversion: 2.1 time: 0.100124 Nov 02 13:14:47.248065 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 235/420] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:47 2022] GET /compute/v2.1/servers/342f003f-a39c-4185-878f-26cf14c103e0 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:47.278986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:47.279468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:47.293520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.294013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.294668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.295742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.296360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.296950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.493805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:47.505979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lazy-loading 'services' on Instance uuid 4d3ead0b-c738-4855-8460-8be9b17b0727 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:47.540540 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-18ebea3b-479b-4efd-bb0e-2115ad0d5f5a tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1943 microversion: 2.91 time: 0.494622 Nov 02 13:14:47.555153 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 186/421] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:47 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1943 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:47.576095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:47.576714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:47.586277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.586808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.587251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.591899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.592661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.593370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.710082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lazy-loading 'services' on Instance uuid 4d3ead0b-c738-4855-8460-8be9b17b0727 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:47.755718 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3e76ee1e-c049-4e3c-890e-19f266595ea4 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1943 microversion: 2.91 time: 0.185810 Nov 02 13:14:47.756620 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 187/422] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:47 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1943 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:14:47.788550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3699a714-457f-4ae0-ae3a-95b1ea29fd91 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:47.799269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3699a714-457f-4ae0-ae3a-95b1ea29fd91 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.800848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3699a714-457f-4ae0-ae3a-95b1ea29fd91 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.801549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3699a714-457f-4ae0-ae3a-95b1ea29fd91 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.802606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3699a714-457f-4ae0-ae3a-95b1ea29fd91 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.802954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3699a714-457f-4ae0-ae3a-95b1ea29fd91 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.803485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3699a714-457f-4ae0-ae3a-95b1ea29fd91 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.844711 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3699a714-457f-4ae0-ae3a-95b1ea29fd91 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.063690 Nov 02 13:14:47.845598 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 188/423] 10.222.0.113 () {60 vars in 1222 bytes} [Wed Nov 2 13:14:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:14:47.851232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:47.852179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:47.860280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.860763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.861198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.861907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.862426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.862779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.898797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-356c0e27-bf40-4bf5-9a16-21c4962b9064 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] Calling method '.version_select at 0x7fe787bf6f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:47.903554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-356c0e27-bf40-4bf5-9a16-21c4962b9064 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '55c87641f18d46369453005945818094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df327ca396154919899f9212b06ef6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-356c0e27-bf40-4bf5-9a16-21c4962b9064 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] Request method failure captured: Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hypervisors/n-h2-858384-19/search HTTP/1.1 Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1E2RrTvY7oqYaUqlHx2OY3bhM1khxB4cn8kLFBSFbzhIvw9YgSyDPCjmMVy4WmBEg_sJw89S_namaOLV_AKs073WXOt-SfHvRd6cUHxP3amy4Xj9JQAEZZhyJaJXGpamknfS7Pe4Wg7VGCPMT1WJJRyt9RbHtsTbopgVPNWr9s95w Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: df327ca396154919899f9212b06ef6c4 Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1170010904 Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:47.908330 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/df327ca396154919899f9212b06ef6c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/df327ca396154919899f9212b06ef6c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_df327ca396154919899f9212b06ef6c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/df327ca396154919899f9212b06ef6c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1170010904 Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: df327ca396154919899f9212b06ef6c4 Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1170010904 Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 55c87641f18d46369453005945818094 Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 13:14:47.909746 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'n-h2-858384-19'} Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:47.910552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 13:14:47.911911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:47.913755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-356c0e27-bf40-4bf5-9a16-21c4962b9064 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:47.913755 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-356c0e27-bf40-4bf5-9a16-21c4962b9064 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/n-h2-858384-19/search" status: 403 len: 117 microversion: 2.1 time: 0.660496 Nov 02 13:14:47.924838 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 236/424] 10.222.0.113 () {58 vars in 1217 bytes} [Wed Nov 2 13:14:47 2022] GET /compute/v2.1/os-hypervisors/n-h2-858384-19/search => generated 117 bytes in 672 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:47.937171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:47.937816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:47.948811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.949572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.950187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:47.952031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:47.952796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:47.953398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.029155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lazy-loading 'flavor' on Instance uuid 4d3ead0b-c738-4855-8460-8be9b17b0727 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:48.257861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:48.271761 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e14c36f0-2d79-41cc-9be1-3294eb35bbf7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.424932 Nov 02 13:14:48.272897 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 189/425] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:47 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:48.279073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:48.279957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:48.286808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.287525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.288144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.289016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.289630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.290219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.504703 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10af4d4a-a359-4069-8eb1-9f5ac20ca578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "POST /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727/action" status: 202 len: 0 microversion: 2.91 time: 0.582781 Nov 02 13:14:48.507306 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 237/426] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:14:47 2022] POST /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:14:48.528593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c976eed-734d-4e71-be39-9208af7d6aa1 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Calling method '.version_select at 0x7fe787bf6310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:48.536387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c976eed-734d-4e71-be39-9208af7d6aa1 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.537337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c976eed-734d-4e71-be39-9208af7d6aa1 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.538225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c976eed-734d-4e71-be39-9208af7d6aa1 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.556970 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-0c976eed-734d-4e71-be39-9208af7d6aa1 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c976eed-734d-4e71-be39-9208af7d6aa1 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Request method failure captured: Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1GiO7Q7bhKn3u7Fk8OIOSdBNg-2EGB4Jet9bxkSJiImcqj8U2tDPj6AcU3Wqo9oh3fYG_xjl_7-19ufs68dyctezN2FNlWjGvCGMNAMKKsEMUcCYg6Ba7ZkeXnCMejXK8vC2nzZpDMDE62X1v0guHyWZc9fr9FaYXwB_iAYR7hkE4 Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: ce99598c795d4df5955360f963322a0d Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-709397151 Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:14:48.561777 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ce99598c795d4df5955360f963322a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ce99598c795d4df5955360f963322a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_ce99598c795d4df5955360f963322a0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/ce99598c795d4df5955360f963322a0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-709397151 Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: ce99598c795d4df5955360f963322a0d Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-709397151 Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: a8da749f0e81427da8c3e29a89747137 Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 13:14:48.563441 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'nonexistent_hypervisor_name'} Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:48.564431 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:48.565848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:48.565848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:48.565848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:48.565848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 13:14:48.565848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:48.567285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c976eed-734d-4e71-be39-9208af7d6aa1 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:48.569398 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c976eed-734d-4e71-be39-9208af7d6aa1 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.060879 Nov 02 13:14:48.571878 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 238/427] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:14:48 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:48.572678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:48.583821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:48.584230 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3380cfd8-32ea-4ddc-897f-3afb4e8e6261 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1323 microversion: 2.1 time: 0.310091 Nov 02 13:14:48.586859 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 190/428] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:48 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:48.587277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:48.601594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.603444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.604961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.607988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.610530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.611241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.620556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:48.623146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:48.630354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.631076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.632060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.632938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.633610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.634269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.738819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:48.755964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:48.757469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:48.778260 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4de61441-7826-426d-84e8-d728ff895fa1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.174638 Nov 02 13:14:48.780026 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 191/429] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:48 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:48.787685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Calling method '.version_select at 0x7fe787e7ca60>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:48.805483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.806502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.807932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.830875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.831871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.832467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.845147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.845994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.846601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.857178 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f6b4faf-5e7c-473a-8a2c-b0875d6a804b tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.075775 Nov 02 13:14:48.864621 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 192/430] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:14:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:48.870865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52e0822c-2fb5-4bd3-a5cc-3174b0330303 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] Calling method '.version_select at 0x7fe787e90040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:48.873872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-52e0822c-2fb5-4bd3-a5cc-3174b0330303 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '55c87641f18d46369453005945818094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df327ca396154919899f9212b06ef6c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52e0822c-2fb5-4bd3-a5cc-3174b0330303 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] Request method failure captured: Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1E2RrTvY7oqYaUqlHx2OY3bhM1khxB4cn8kLFBSFbzhIvw9YgSyDPCjmMVy4WmBEg_sJw89S_namaOLV_AKs073WXOt-SfHvRd6cUHxP3amy4Xj9JQAEZZhyJaJXGpamknfS7Pe4Wg7VGCPMT1WJJRyt9RbHtsTbopgVPNWr9s95w Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: df327ca396154919899f9212b06ef6c4 Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1170010904 Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:14:48.876522 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/df327ca396154919899f9212b06ef6c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/df327ca396154919899f9212b06ef6c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_df327ca396154919899f9212b06ef6c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/df327ca396154919899f9212b06ef6c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1170010904 Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: df327ca396154919899f9212b06ef6c4 Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1170010904 Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 55c87641f18d46369453005945818094 Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 13:14:48.877842 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '1'} Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:48.878532 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 13:14:48.879705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:48.882337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52e0822c-2fb5-4bd3-a5cc-3174b0330303 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:48.883415 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-52e0822c-2fb5-4bd3-a5cc-3174b0330303 tempest-HypervisorAdminNegativeUnderV252Test-1170010904 tempest-HypervisorAdminNegativeUnderV252Test-1170010904-project] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.017496 Nov 02 13:14:48.884322 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 193/431] 10.222.0.113 () {58 vars in 1181 bytes} [Wed Nov 2 13:14:48 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:48.895410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-921fafdd-2434-49f0-af6c-3527435a4877 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Calling method '.version_select at 0x7fe787e7c670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:48.898906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-921fafdd-2434-49f0-af6c-3527435a4877 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:48.899742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-921fafdd-2434-49f0-af6c-3527435a4877 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:48.900845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-921fafdd-2434-49f0-af6c-3527435a4877 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:48.908837 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-921fafdd-2434-49f0-af6c-3527435a4877 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] HTTP exception thrown: No hypervisor matching '1d67697f-80a7-4c53-96b7-d48f2113a90e' could be found. Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-921fafdd-2434-49f0-af6c-3527435a4877 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Request method failure captured: Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-hypervisors/1d67697f-80a7-4c53-96b7-d48f2113a90e/servers HTTP/1.1 Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1GiO7Q7bhKn3u7Fk8OIOSdBNg-2EGB4Jet9bxkSJiImcqj8U2tDPj6AcU3Wqo9oh3fYG_xjl_7-19ufs68dyctezN2FNlWjGvCGMNAMKKsEMUcCYg6Ba7ZkeXnCMejXK8vC2nzZpDMDE62X1v0guHyWZc9fr9FaYXwB_iAYR7hkE4 Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: ce99598c795d4df5955360f963322a0d Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-709397151 Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:14:48.911744 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ce99598c795d4df5955360f963322a0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ce99598c795d4df5955360f963322a0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_ce99598c795d4df5955360f963322a0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/ce99598c795d4df5955360f963322a0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-709397151 Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: ce99598c795d4df5955360f963322a0d Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-709397151 Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: a8da749f0e81427da8c3e29a89747137 Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: exception: No hypervisor matching '1d67697f-80a7-4c53-96b7-d48f2113a90e' could be found. Nov 02 13:14:48.912960 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '1d67697f-80a7-4c53-96b7-d48f2113a90e'} Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '1d67697f-80a7-4c53-96b7-d48f2113a90e' could be found. Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:48.913632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:48.914679 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:48.914679 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:48.914679 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:48.914679 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:48.914679 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '1d67697f-80a7-4c53-96b7-d48f2113a90e' could be found. Nov 02 13:14:48.914679 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:48.917910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-921fafdd-2434-49f0-af6c-3527435a4877 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] Returning 404 to user: No hypervisor matching '1d67697f-80a7-4c53-96b7-d48f2113a90e' could be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:48.920111 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-921fafdd-2434-49f0-af6c-3527435a4877 tempest-HypervisorAdminNegativeUnderV252Test-709397151 tempest-HypervisorAdminNegativeUnderV252Test-709397151-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/1d67697f-80a7-4c53-96b7-d48f2113a90e/servers" status: 404 len: 123 microversion: 2.1 time: 0.028129 Nov 02 13:14:48.926275 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 194/432] 10.222.0.113 () {58 vars in 1286 bytes} [Wed Nov 2 13:14:48 2022] GET /compute/v2.1/os-hypervisors/1d67697f-80a7-4c53-96b7-d48f2113a90e/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:48.967446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d3ffbd7d-1c3c-41b5-a8d3-f939e0375409 req-6a7deb6b-ac1c-4561-8da1-42c9763e4078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca7fedf-baa0-4492-8c62-61a6452889a9", "name": "network-vif-unplugged", "status": "completed", "tag": "0e82bbfc-811d-44dc-84ed-e4ab1baebc95"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:49.004079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3ffbd7d-1c3c-41b5-a8d3-f939e0375409 req-6a7deb6b-ac1c-4561-8da1-42c9763e4078 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:49.007312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3ffbd7d-1c3c-41b5-a8d3-f939e0375409 req-6a7deb6b-ac1c-4561-8da1-42c9763e4078 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:49.007771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3ffbd7d-1c3c-41b5-a8d3-f939e0375409 req-6a7deb6b-ac1c-4561-8da1-42c9763e4078 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:49.048260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:49.064192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:49.067009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:49.069733 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de9cee7e-10fb-4ebb-bb82-fd4f16b411e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.496636 Nov 02 13:14:49.071178 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 239/433] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:48 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:49.105500 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d3ffbd7d-1c3c-41b5-a8d3-f939e0375409 req-6a7deb6b-ac1c-4561-8da1-42c9763e4078 service nova] Creating event network-vif-unplugged:0e82bbfc-811d-44dc-84ed-e4ab1baebc95 for instance cca7fedf-baa0-4492-8c62-61a6452889a9 on n-h2-858384-19 Nov 02 13:14:49.128083 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d3ffbd7d-1c3c-41b5-a8d3-f939e0375409 req-6a7deb6b-ac1c-4561-8da1-42c9763e4078 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160051 Nov 02 13:14:49.130402 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 195/434] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:14:49.298788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:49.299413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:49.310132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:49.318433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:49.325637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:49.326098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:49.326853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:49.327355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:49.327792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:49.622416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:49.623876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:49.652860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:49.653638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:49.656981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:49.663364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:49.665770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:49.668253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:49.875312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:49.906834 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-455ba251-537f-4d0c-869a-4f9ca2df7c4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.603871 Nov 02 13:14:49.909025 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 240/435] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:49 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:49.924347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:49.929429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:49.946762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:49.950543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:49.959866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:49.960640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:49.961115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:49.961552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:50.141974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:50.161632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:50.167835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:50.220972 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4eca6d22-f61c-40de-989a-f9a78432052a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.307487 Nov 02 13:14:50.221622 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 241/436] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:49 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:50.238419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:50.241310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:50.262443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:50.262969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:50.265004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:50.270220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:50.271458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:50.274011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:50.453558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:50.467046 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-393a3743-0766-4eec-859c-e9ee35681364 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1323 microversion: 2.1 time: 0.852279 Nov 02 13:14:50.467841 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 196/437] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:49 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1323 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:50.617447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:50.628113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:50.629972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:50.633121 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a6e3fa9b-4166-4639-b08d-0e88f3db1f3d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.407948 Nov 02 13:14:50.634109 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 242/438] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:50 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:50.940013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:50.941620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:50.952314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:50.953325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:50.953961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:50.954846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:50.956065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:50.957218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:51.170753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d29ace42-c79c-4db1-bd97-8590a21d2b16 req-55b9830e-4721-4cdc-b31a-d1baac9f860f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca7fedf-baa0-4492-8c62-61a6452889a9", "tag": "0e82bbfc-811d-44dc-84ed-e4ab1baebc95"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:51.196798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d29ace42-c79c-4db1-bd97-8590a21d2b16 req-55b9830e-4721-4cdc-b31a-d1baac9f860f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:51.197370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d29ace42-c79c-4db1-bd97-8590a21d2b16 req-55b9830e-4721-4cdc-b31a-d1baac9f860f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:51.198036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d29ace42-c79c-4db1-bd97-8590a21d2b16 req-55b9830e-4721-4cdc-b31a-d1baac9f860f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:51.228152 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d29ace42-c79c-4db1-bd97-8590a21d2b16 req-55b9830e-4721-4cdc-b31a-d1baac9f860f service nova] Creating event network-changed:0e82bbfc-811d-44dc-84ed-e4ab1baebc95 for instance cca7fedf-baa0-4492-8c62-61a6452889a9 on n-h2-858384-19 Nov 02 13:14:51.234290 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d29ace42-c79c-4db1-bd97-8590a21d2b16 req-55b9830e-4721-4cdc-b31a-d1baac9f860f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071150 Nov 02 13:14:51.235779 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 243/439] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:51.256136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:51.256766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:51.269952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:51.270256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:51.270691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:51.272082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:51.272543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:51.272964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:51.413661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:51.423492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:51.425237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:51.433042 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-40459762-6ec1-49a6-b988-f0c2a895c2ea tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.181239 Nov 02 13:14:51.434811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 244/440] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:51 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:51.494543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:51.499947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:51.506393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:51.506785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:51.507246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:51.507940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:51.512052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:51.512763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:51.527189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:51.549790 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0109103e-79ef-4840-ba00-310f5fa0f691 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.612640 Nov 02 13:14:51.575395 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 197/441] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:50 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:51.662794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:51.663513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:51.677017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:51.677702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:51.678184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:51.679570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:51.680983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:51.683384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:52.059733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:52.076515 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfd423be-97d8-4a59-9e15-e3e20f97c197 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1323 microversion: 2.1 time: 0.582485 Nov 02 13:14:52.095975 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 245/442] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:51 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1323 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:52.464842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:52.466198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:52.468366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=16 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:52.474748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:52.484316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:52.485816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:52.490222 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b65f9209-9927-48d5-a81c-9adf81a4026c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.829082 Nov 02 13:14:52.491986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:52.492509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:52.493039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:52.495372 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 198/443] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:51 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:14:52.495612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:52.496548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:52.497355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:52.581890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:52.582897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:52.598256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:52.599106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:52.599931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:52.601612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:52.604287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:52.606778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:52.666173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:52.681954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:52.687043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:52.697316 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c684654-0e53-4d91-9b00-9512b4e164e9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.237501 Nov 02 13:14:52.701982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 246/444] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:52 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:53.077231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:53.096169 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-638b9f76-6bac-44aa-a55f-15fc7733ef6c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.518912 Nov 02 13:14:53.098058 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 199/445] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:52 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:53.115088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:53.116073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:53.123983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:53.127171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:53.129209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:53.130204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:53.132033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:53.133759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:53.481994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:53.493360 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dbbdc176-4cd8-410a-88a2-c140e397d166 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1323 microversion: 2.1 time: 0.394606 Nov 02 13:14:53.498411 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 247/446] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:53 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:53.526059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:53.526710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:53.546492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:53.549948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:53.550509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:53.559901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:53.561280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:53.565279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:53.566935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f093bb40-66f0-4639-9ca9-352972edad15 req-af6531d2-3b5d-4a55-a148-cc25ab9f587b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7e88a9-99ef-4852-9e10-1c55a1ded715", "name": "network-vif-unplugged", "status": "completed", "tag": "88c1f69b-6cdf-4c29-8632-fbddd4fe544c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:53.600011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f093bb40-66f0-4639-9ca9-352972edad15 req-af6531d2-3b5d-4a55-a148-cc25ab9f587b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:53.601813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f093bb40-66f0-4639-9ca9-352972edad15 req-af6531d2-3b5d-4a55-a148-cc25ab9f587b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:53.602421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f093bb40-66f0-4639-9ca9-352972edad15 req-af6531d2-3b5d-4a55-a148-cc25ab9f587b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:53.615499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:53.637410 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f093bb40-66f0-4639-9ca9-352972edad15 req-af6531d2-3b5d-4a55-a148-cc25ab9f587b service nova] Creating event network-vif-unplugged:88c1f69b-6cdf-4c29-8632-fbddd4fe544c for instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 on n-h1-858384-19 Nov 02 13:14:53.648099 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f093bb40-66f0-4639-9ca9-352972edad15 req-af6531d2-3b5d-4a55-a148-cc25ab9f587b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095286 Nov 02 13:14:53.655382 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 248/447] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:53.729944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:53.730719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:53.749750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:53.751260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:53.751260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:53.752379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:53.752919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:53.753367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:53.949702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:53.961378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:53.965942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:53.975363 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f22f516f-3373-450e-89a4-d5d3a30ac875 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.252402 Nov 02 13:14:53.976581 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 249/448] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:53 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:14:54.122850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:54.123884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:54.124421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:54.136826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:54.139968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:54.141184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:54.142648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:54.143134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:54.143874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:54.148230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:54.148748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:54.149218 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-07ea5314-8054-4272-9b7f-299aa4a1f1ee tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.624172 Nov 02 13:14:54.150082 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 200/449] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:53 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:54.451522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:54.465238 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83fb3362-0dfe-4b5d-8d1f-ff598e855982 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.343847 Nov 02 13:14:54.469958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 250/450] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:54 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:54.527842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:54.529620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:54.565506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:54.567776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:54.568572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:54.571143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:54.576482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:54.578367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:55.195831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31947dc2-2851-4d04-9c1d-ae42fa16f778 tempest-QuotaClassesAdminTestJSON-1739890064 tempest-QuotaClassesAdminTestJSON-1739890064-project-admin] Calling method '.version_select at 0x7fe787c15b80>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:55.241517 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31947dc2-2851-4d04-9c1d-ae42fa16f778 tempest-QuotaClassesAdminTestJSON-1739890064 tempest-QuotaClassesAdminTestJSON-1739890064-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.561375 Nov 02 13:14:55.242605 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 251/451] 10.222.0.113 () {58 vars in 1190 bytes} [Wed Nov 2 13:14:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:55.266802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:55.268835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:55.283461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:55.285823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:55.288592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:55.290829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:55.293926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:55.294755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:55.322374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:55.332276 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1bdaf20f-8bdf-45a1-b543-2ff6e5cc52a2 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1323 microversion: 2.1 time: 0.811696 Nov 02 13:14:55.333230 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 201/452] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:54 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1323 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:55.344784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:55.345654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:55.359492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:55.360256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:55.360896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:55.361800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:55.362448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:55.363066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:55.445404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:55.454712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:55.460024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:55.469182 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d4b9a2da-1802-4f27-8b84-59c1f46b7dc7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.223926 Nov 02 13:14:55.473587 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 252/453] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:55 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:55.487866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-48ac963d-8be8-4bf0-9e5d-eb7f2736af29 tempest-QuotaClassesAdminTestJSON-1739890064 tempest-QuotaClassesAdminTestJSON-1739890064-project-admin] Action: 'update', calling method: .version_select at 0x7fe787b18d30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:55.633638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:55.646242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:55.647915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:55.649657 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b5c8968-e535-4f89-8231-982841e2a9fa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.314032 Nov 02 13:14:55.651380 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 202/454] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:55 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:55.662568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:55.668347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:55.689517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:55.690408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:55.693484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:55.694253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:55.696979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:55.697857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:55.901521 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-48ac963d-8be8-4bf0-9e5d-eb7f2736af29 tempest-QuotaClassesAdminTestJSON-1739890064 tempest-QuotaClassesAdminTestJSON-1739890064-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.426056 Nov 02 13:14:55.904131 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 253/455] 10.222.0.113 () {60 vars in 1211 bytes} [Wed Nov 2 13:14:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:56.031053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:56.042710 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dca53b11-2ce9-4b93-bfd6-60ba05b7c2b1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.390023 Nov 02 13:14:56.070019 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 203/456] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:55 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:56.078807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a35aef1f-1207-45e8-995d-08aed9086960 req-1197b6ae-ab3e-4269-825e-8618a7c90631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d7e88a9-99ef-4852-9e10-1c55a1ded715", "tag": "88c1f69b-6cdf-4c29-8632-fbddd4fe544c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:56.114586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a35aef1f-1207-45e8-995d-08aed9086960 req-1197b6ae-ab3e-4269-825e-8618a7c90631 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.119768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a35aef1f-1207-45e8-995d-08aed9086960 req-1197b6ae-ab3e-4269-825e-8618a7c90631 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.121216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a35aef1f-1207-45e8-995d-08aed9086960 req-1197b6ae-ab3e-4269-825e-8618a7c90631 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.146986 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a35aef1f-1207-45e8-995d-08aed9086960 req-1197b6ae-ab3e-4269-825e-8618a7c90631 service nova] Creating event network-changed:88c1f69b-6cdf-4c29-8632-fbddd4fe544c for instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 on n-h1-858384-19 Nov 02 13:14:56.159734 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a35aef1f-1207-45e8-995d-08aed9086960 req-1197b6ae-ab3e-4269-825e-8618a7c90631 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087672 Nov 02 13:14:56.161960 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 204/457] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:56.178191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-765ea7ad-b832-4df0-a6f7-251f8668f84a tempest-QuotaClassesAdminTestJSON-1739890064 tempest-QuotaClassesAdminTestJSON-1739890064-project-admin] Calling method '.version_select at 0x7fe78c4fcc10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:56.210922 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-765ea7ad-b832-4df0-a6f7-251f8668f84a tempest-QuotaClassesAdminTestJSON-1739890064 tempest-QuotaClassesAdminTestJSON-1739890064-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.047671 Nov 02 13:14:56.212360 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 205/458] 10.222.0.113 () {58 vars in 1190 bytes} [Wed Nov 2 13:14:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:56.218243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5a76c1f4-7fe6-42c4-9be7-b6cee944fda5 req-ce608095-7a70-4dbc-8682-758c67e43ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf", "name": "network-vif-plugged", "status": "completed", "tag": "8a96ffe6-083e-4c11-addf-363213fc7f2c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:56.253040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5a76c1f4-7fe6-42c4-9be7-b6cee944fda5 req-ce608095-7a70-4dbc-8682-758c67e43ddb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.254952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5a76c1f4-7fe6-42c4-9be7-b6cee944fda5 req-ce608095-7a70-4dbc-8682-758c67e43ddb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.256834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5a76c1f4-7fe6-42c4-9be7-b6cee944fda5 req-ce608095-7a70-4dbc-8682-758c67e43ddb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.282353 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5a76c1f4-7fe6-42c4-9be7-b6cee944fda5 req-ce608095-7a70-4dbc-8682-758c67e43ddb service nova] Creating event network-vif-plugged:8a96ffe6-083e-4c11-addf-363213fc7f2c for instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf on n-h2-858384-19 Nov 02 13:14:56.290878 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5a76c1f4-7fe6-42c4-9be7-b6cee944fda5 req-ce608095-7a70-4dbc-8682-758c67e43ddb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076911 Nov 02 13:14:56.292563 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 206/459] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:56.296905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1a7c1729-7dd7-4f63-b82a-d95577827a3f tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Calling method '.version_select at 0x7fe787b18310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:56.299830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1a7c1729-7dd7-4f63-b82a-d95577827a3f tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '2f57922366ee43079573605c1768e10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca2e401a18a411c91eb3399c527e9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1a7c1729-7dd7-4f63-b82a-d95577827a3f tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Request method failure captured: Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1Ng0fn0N60I2HVw78OK8ULKgyBYmCY6NA3o_iWyeQfJyZEx7-IpGcIEY0S7nKLdN2CUaEOa-tPmK8ze9zmidPhVhekWljuCVol_tVShcheXedlZOAImEFqymATKRSTRc-GgoDTP0okZ_-TXbAzo5EOBXbNfd6d_KR4efYWUen1Rss Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:56.304016 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 2f57922366ee43079573605c1768e10e Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: action_args: {} Nov 02 13:14:56.305669 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._detail(req) Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:56.306614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 13:14:56.309332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:56.310648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1a7c1729-7dd7-4f63-b82a-d95577827a3f tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:56.311769 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1a7c1729-7dd7-4f63-b82a-d95577827a3f tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.404851 Nov 02 13:14:56.313634 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 254/460] 10.222.0.113 () {58 vars in 1172 bytes} [Wed Nov 2 13:14:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 409 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:56.329486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0d440b0-69f4-4a47-a240-429e9338bb85 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Calling method '.version_select at 0x7fe787c16c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:56.333594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc87ff0f-b6db-47db-8700-26812ed7eb21 tempest-QuotaClassesAdminTestJSON-1739890064 tempest-QuotaClassesAdminTestJSON-1739890064-project-admin] Action: 'update', calling method: .version_select at 0x7fe787ef4310>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:56.336962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e0d440b0-69f4-4a47-a240-429e9338bb85 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '2f57922366ee43079573605c1768e10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca2e401a18a411c91eb3399c527e9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0d440b0-69f4-4a47-a240-429e9338bb85 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Request method failure captured: Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1Ng0fn0N60I2HVw78OK8ULKgyBYmCY6NA3o_iWyeQfJyZEx7-IpGcIEY0S7nKLdN2CUaEOa-tPmK8ze9zmidPhVhekWljuCVol_tVShcheXedlZOAImEFqymATKRSTRc-GgoDTP0okZ_-TXbAzo5EOBXbNfd6d_KR4efYWUen1Rss Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:14:56.340553 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 2f57922366ee43079573605c1768e10e Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: action_args: {} Nov 02 13:14:56.342027 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:56.342954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 13:14:56.344235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:14:56.345894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0d440b0-69f4-4a47-a240-429e9338bb85 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:56.347628 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e0d440b0-69f4-4a47-a240-429e9338bb85 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.028631 Nov 02 13:14:56.351717 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 255/461] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:14:56 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:56.362078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:56.363838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:56.382036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.382625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.383070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.384141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.384610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.385213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.567651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=11 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:56.593912 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc87ff0f-b6db-47db-8700-26812ed7eb21 tempest-QuotaClassesAdminTestJSON-1739890064 tempest-QuotaClassesAdminTestJSON-1739890064-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.266010 Nov 02 13:14:56.594853 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 207/462] 10.222.0.113 () {60 vars in 1211 bytes} [Wed Nov 2 13:14:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:56.600453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d90408c-d0a1-431f-8fd1-12f612812fd9 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Calling method '.version_select at 0x7fe787ef44c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:56.624723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d90408c-d0a1-431f-8fd1-12f612812fd9 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '2f57922366ee43079573605c1768e10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca2e401a18a411c91eb3399c527e9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d90408c-d0a1-431f-8fd1-12f612812fd9 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Request method failure captured: Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1Ng0fn0N60I2HVw78OK8ULKgyBYmCY6NA3o_iWyeQfJyZEx7-IpGcIEY0S7nKLdN2CUaEOa-tPmK8ze9zmidPhVhekWljuCVol_tVShcheXedlZOAImEFqymATKRSTRc-GgoDTP0okZ_-TXbAzo5EOBXbNfd6d_KR4efYWUen1Rss Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:14:56.632033 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 2f57922366ee43079573605c1768e10e Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: action_args: {} Nov 02 13:14:56.633316 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:56.636173 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 13:14:56.639490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:56.641437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d90408c-d0a1-431f-8fd1-12f612812fd9 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:56.641437 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2d90408c-d0a1-431f-8fd1-12f612812fd9 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.034901 Nov 02 13:14:56.641437 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 208/463] 10.222.0.113 () {58 vars in 1184 bytes} [Wed Nov 2 13:14:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:56.646388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:56.647851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:56.659492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.659997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.660453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.661191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.662380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.663013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.692245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:56.712715 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-266e944d-125e-42b1-9813-542e1cfd61b1 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1323 microversion: 2.1 time: 0.354965 Nov 02 13:14:56.714759 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 256/464] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:56 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1323 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:56.774325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:56.788464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:56.790839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:56.805866 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9954523c-939b-4303-8743-e96542a5cb1d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.168497 Nov 02 13:14:56.808159 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 209/465] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:56 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:56.820049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:56.821483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:56.842150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.851081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.851576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.853316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:56.854590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:56.855014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:56.870521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:57.187248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:57.200842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:57.205818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:57.210623 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-823de42f-ca0e-4aa5-be86-0c2abd655f14 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.398536 Nov 02 13:14:57.211736 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 210/466] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:56 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:57.269238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Calling method '.version_select at 0x7fe787b25670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.271224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.271717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.272150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.319634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.320244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.320550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.350250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.350954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.351609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.361139 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-352a8945-4691-4f5c-bf92-394ab6452d40 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.640521 Nov 02 13:14:57.373728 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 257/467] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:14:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:57.381513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.382378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:57.389655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.390737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.391405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.392124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.392671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.393088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.481344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a96c5fbc-0879-421b-9476-f897fca6485f tempest-InstanceUsageAuditLogTestJSON-1109504233 tempest-InstanceUsageAuditLogTestJSON-1109504233-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.505512 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a96c5fbc-0879-421b-9476-f897fca6485f tempest-InstanceUsageAuditLogTestJSON-1109504233 tempest-InstanceUsageAuditLogTestJSON-1109504233-project-admin] 10.222.0.113 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 13:14:56" status: 200 len: 318 microversion: 2.1 time: 0.292171 Nov 02 13:14:57.506729 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 211/468] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2013%3A14%3A56 => generated 318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:57.512799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-68f0d6f9-073a-4df7-808c-afce709bde82 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Calling method '.version_select at 0x7fe787ef4790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.515605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-68f0d6f9-073a-4df7-808c-afce709bde82 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '2f57922366ee43079573605c1768e10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca2e401a18a411c91eb3399c527e9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-68f0d6f9-073a-4df7-808c-afce709bde82 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Request method failure captured: Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1Ng0fn0N60I2HVw78OK8ULKgyBYmCY6NA3o_iWyeQfJyZEx7-IpGcIEY0S7nKLdN2CUaEOa-tPmK8ze9zmidPhVhekWljuCVol_tVShcheXedlZOAImEFqymATKRSTRc-GgoDTP0okZ_-TXbAzo5EOBXbNfd6d_KR4efYWUen1Rss Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:14:57.518177 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 2f57922366ee43079573605c1768e10e Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '1'} Nov 02 13:14:57.519458 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:57.520204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 13:14:57.521321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.522238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-68f0d6f9-073a-4df7-808c-afce709bde82 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:57.522238 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-68f0d6f9-073a-4df7-808c-afce709bde82 tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011530 Nov 02 13:14:57.522238 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 212/469] 10.222.0.113 () {58 vars in 1178 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:57.525739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7051257f-df0b-400d-807c-76f177ae4dcf tempest-InstanceUsageAuditLogTestJSON-1109504233 tempest-InstanceUsageAuditLogTestJSON-1109504233-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.544973 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7051257f-df0b-400d-807c-76f177ae4dcf tempest-InstanceUsageAuditLogTestJSON-1109504233 tempest-InstanceUsageAuditLogTestJSON-1109504233-project-admin] 10.222.0.113 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.023443 Nov 02 13:14:57.545786 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 213/470] 10.222.0.113 () {58 vars in 1190 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:57.551280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-87db25bd-efb7-4c73-ac47-746b92100bc8 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Calling method '.version_select at 0x7fe78c2c7430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.553218 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-87db25bd-efb7-4c73-ac47-746b92100bc8 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] HTTP exception thrown: Hypervisor with ID 'de1fd788-6e11-4b12-8f54-7d18d4ceee4b' could not be found. Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-87db25bd-efb7-4c73-ac47-746b92100bc8 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Request method failure captured: Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-hypervisors/de1fd788-6e11-4b12-8f54-7d18d4ceee4b/uptime HTTP/1.1 Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1PlPBzLZCh2TBEsZa9RLiiYKDS2gkWnVCbJs8HjIMOws5wZdbymcriDqc7ncbOUcOkPoxw3lHHwr3S_m6OB4EN_8_h-uy74pXv-O8ZGXeqkX4crmtnL0tKYwSUwh05NVcmKcS-ik2lUbsqdYHJscCkPwCAmyfn325hSVCcueaKv6w Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8282d09c43fa487e919ffbf48a502bc2 Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1418811245 Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:14:57.566987 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8282d09c43fa487e919ffbf48a502bc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8282d09c43fa487e919ffbf48a502bc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8282d09c43fa487e919ffbf48a502bc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8282d09c43fa487e919ffbf48a502bc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1418811245 Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8282d09c43fa487e919ffbf48a502bc2 Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1418811245 Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e10f51e1a27b40269db17b96f304ca63 Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: exception: Hypervisor with ID 'de1fd788-6e11-4b12-8f54-7d18d4ceee4b' could not be found. Nov 02 13:14:57.568633 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'de1fd788-6e11-4b12-8f54-7d18d4ceee4b'} Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'de1fd788-6e11-4b12-8f54-7d18d4ceee4b' Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 13:14:57.569481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'de1fd788-6e11-4b12-8f54-7d18d4ceee4b' could not be found. Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.571001 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.572465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.572465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:57.572465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:57.572465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:57.572465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:57.572465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'de1fd788-6e11-4b12-8f54-7d18d4ceee4b' could not be found. Nov 02 13:14:57.572465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.572465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-87db25bd-efb7-4c73-ac47-746b92100bc8 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Returning 404 to user: Hypervisor with ID 'de1fd788-6e11-4b12-8f54-7d18d4ceee4b' could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:57.572465 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-87db25bd-efb7-4c73-ac47-746b92100bc8 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/de1fd788-6e11-4b12-8f54-7d18d4ceee4b/uptime" status: 404 len: 123 microversion: 2.1 time: 0.023961 Nov 02 13:14:57.573873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 214/471] 10.222.0.113 () {58 vars in 1283 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/os-hypervisors/de1fd788-6e11-4b12-8f54-7d18d4ceee4b/uptime => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:57.581956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Calling method '.version_select at 0x7fe787e83820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.584101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.584589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.585224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.602816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.603356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.604525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.616629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.617554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.618128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.628023 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-72ffaf2f-ad8e-4152-ae87-868cb09c55f0 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.049212 Nov 02 13:14:57.635024 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 215/472] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:57.643027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bf5bb589-ee63-4def-9d23-fb99f4617eeb tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Calling method '.version_select at 0x7fe787e839d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.645306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bf5bb589-ee63-4def-9d23-fb99f4617eeb tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '2f57922366ee43079573605c1768e10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca2e401a18a411c91eb3399c527e9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bf5bb589-ee63-4def-9d23-fb99f4617eeb tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Request method failure captured: Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1Ng0fn0N60I2HVw78OK8ULKgyBYmCY6NA3o_iWyeQfJyZEx7-IpGcIEY0S7nKLdN2CUaEOa-tPmK8ze9zmidPhVhekWljuCVol_tVShcheXedlZOAImEFqymATKRSTRc-GgoDTP0okZ_-TXbAzo5EOBXbNfd6d_KR4efYWUen1Rss Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:14:57.647246 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3ca2e401a18a411c91eb3399c527e9ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 3ca2e401a18a411c91eb3399c527e9ab Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595 Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 2f57922366ee43079573605c1768e10e Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1391434595-project Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '1'} Nov 02 13:14:57.648635 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:14:57.649385 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 13:14:57.650452 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.651640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bf5bb589-ee63-4def-9d23-fb99f4617eeb tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:57.651640 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bf5bb589-ee63-4def-9d23-fb99f4617eeb tempest-HypervisorAdminNegativeTestJSON-1391434595 tempest-HypervisorAdminNegativeTestJSON-1391434595-project] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.011748 Nov 02 13:14:57.655591 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 216/473] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:14:57.661055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b991acc8-f5b3-44f7-92f2-11080a8f1468 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Calling method '.version_select at 0x7fe78c111940>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.662846 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b991acc8-f5b3-44f7-92f2-11080a8f1468 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] HTTP exception thrown: Hypervisor with ID 'c366b439-42f5-4d0c-9f5d-56f2b5d23ef3' could not be found. Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b991acc8-f5b3-44f7-92f2-11080a8f1468 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Request method failure captured: Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-hypervisors/c366b439-42f5-4d0c-9f5d-56f2b5d23ef3 HTTP/1.1 Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1PlPBzLZCh2TBEsZa9RLiiYKDS2gkWnVCbJs8HjIMOws5wZdbymcriDqc7ncbOUcOkPoxw3lHHwr3S_m6OB4EN_8_h-uy74pXv-O8ZGXeqkX4crmtnL0tKYwSUwh05NVcmKcS-ik2lUbsqdYHJscCkPwCAmyfn325hSVCcueaKv6w Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8282d09c43fa487e919ffbf48a502bc2 Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1418811245 Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:14:57.664546 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8282d09c43fa487e919ffbf48a502bc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8282d09c43fa487e919ffbf48a502bc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8282d09c43fa487e919ffbf48a502bc2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8282d09c43fa487e919ffbf48a502bc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1418811245 Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8282d09c43fa487e919ffbf48a502bc2 Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1418811245 Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e10f51e1a27b40269db17b96f304ca63 Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: exception: Hypervisor with ID 'c366b439-42f5-4d0c-9f5d-56f2b5d23ef3' could not be found. Nov 02 13:14:57.665761 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'c366b439-42f5-4d0c-9f5d-56f2b5d23ef3'} Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c366b439-42f5-4d0c-9f5d-56f2b5d23ef3' Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 13:14:57.667039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:14:57.668405 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c366b439-42f5-4d0c-9f5d-56f2b5d23ef3' could not be found. Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c366b439-42f5-4d0c-9f5d-56f2b5d23ef3' could not be found. Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b991acc8-f5b3-44f7-92f2-11080a8f1468 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] Returning 404 to user: Hypervisor with ID 'c366b439-42f5-4d0c-9f5d-56f2b5d23ef3' could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:57.669520 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b991acc8-f5b3-44f7-92f2-11080a8f1468 tempest-HypervisorAdminNegativeTestJSON-1418811245 tempest-HypervisorAdminNegativeTestJSON-1418811245-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors/c366b439-42f5-4d0c-9f5d-56f2b5d23ef3" status: 404 len: 123 microversion: 2.1 time: 0.009488 Nov 02 13:14:57.671851 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 217/474] 10.222.0.113 () {58 vars in 1262 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/os-hypervisors/c366b439-42f5-4d0c-9f5d-56f2b5d23ef3 => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:57.738855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.739669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:57.750123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.750764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.751477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.752494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.753290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.754290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.851297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:57.884947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:57.893993 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2cce99c1-50da-4860-9fd8-bb0f778dc1af tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.518898 Nov 02 13:14:57.897702 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 258/475] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:57.910851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:57.911543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:57.918707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.919535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.920252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:57.921168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:57.921854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:57.922559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:58.043222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:58.059480 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a980ca1e-e3b4-40c6-946f-221e76c8c667 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1323 microversion: 2.1 time: 0.326827 Nov 02 13:14:58.073244 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 218/476] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1323 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:58.104821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:58.120217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:58.130384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:58.142284 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1661c85a-4b46-4961-b642-d905ec372ee5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.243308 Nov 02 13:14:58.143972 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 259/477] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:57 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:58.241307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:58.242049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:58.250611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:58.251370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:58.251973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:58.253079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:58.254621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:58.255420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:58.688625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:58.698961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:58.701547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:58.703755 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7acc05f6-a509-4137-a598-6e5b848e4edc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.466693 Nov 02 13:14:58.705108 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 219/478] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:58 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:58.923674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:58.924298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:58.937295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:58.937859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:58.939307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:58.940428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:58.941169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:58.945035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.082302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:59.083218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:59.091799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.092593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.093245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.094249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.094974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.096234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.409865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:59.428961 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35ab965f-b15c-43a6-b698-d74a10bcde22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.508104 Nov 02 13:14:59.435023 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 260/479] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:58 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:14:59.450085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:59.450644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:59.474338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.474828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.475309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.476027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.476481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.477041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.612037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:59.622850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:59.624306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:59.631817 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c705d12a-35b0-4e31-80c6-097daa118ac8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.195607 Nov 02 13:14:59.633104 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 261/480] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:59 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:14:59.634560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:14:59.647366 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-773fc4b1-a054-488e-b7e8-28ad020994a6 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1473 microversion: 2.1 time: 0.569358 Nov 02 13:14:59.648522 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 220/481] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:59 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1473 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:14:59.677067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:59.677598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:59.686840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:INSERT=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:59.702849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.703381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.704762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.705862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.706318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.706916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.731887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:59.732717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:59.743302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.746672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.747418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.753176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.754621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.755594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.771592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lazy-loading 'flavor' on Instance uuid e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:14:59.950008 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b7eb57a6-79ae-4189-97b8-6ae504ca5636 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf/action" status: 202 len: 0 microversion: 2.1 time: 0.276515 Nov 02 13:14:59.951057 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 262/482] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:14:59 2022] POST /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:59.966023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:59.966733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:14:59.982736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.985102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.986521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:14:59.987623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:14:59.990255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:14:59.991699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.168513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:00.179764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:00.185898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:00.187256 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e1c93e22-7ca6-499a-b38a-ba00e3e17608 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.460572 Nov 02 13:15:00.204857 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 221/483] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:14:59 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:15:00.319387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:00.333020 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1ab0304b-9bb9-4c66-9aed-365bc88ef5ec tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1481 microversion: 2.1 time: 0.375361 Nov 02 13:15:00.334287 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 263/484] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:14:59 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1481 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:00.462218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:00.464518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:00.473738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.474538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.475265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.476210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.476871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.477721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.667938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:00.669122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:00.677213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.678109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.678988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.680006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:00.682507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:00.684020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:00.820666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:00.839339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:00.846261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:00.862517 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0e5c41b6-f466-465a-a008-d19d14ea5a49 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.200364 Nov 02 13:15:00.866732 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 264/485] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:00 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:01.044725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:01.058054 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1bc4de7-599a-402e-be90-70b4fd13bec0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1505 microversion: 2.1 time: 0.602770 Nov 02 13:15:01.061931 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 222/486] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:00 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:01.217805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:01.218807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:01.232205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:01.233768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:01.234629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:01.236711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:01.240770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:01.241833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:01.582036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:01.597099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:01.598785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:01.603205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-12e4e7df-d049-4a9c-a27c-1417c9843323 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.390721 Nov 02 13:15:01.605824 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 223/487] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:01 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:01.618124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:01.618749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:01.640490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:01.641043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:01.641498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:01.642238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:01.642701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:01.648038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:01.676586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-441eb309-78c9-4de6-9f82-f94b362b435e tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:01.696704 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-441eb309-78c9-4de6-9f82-f94b362b435e tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.588405 Nov 02 13:15:01.707190 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 265/488] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:15:01 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:01.917592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:01.929698 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b4e2fc93-81ff-4405-97b5-c68ae4765c9a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1464 microversion: 2.1 time: 0.320125 Nov 02 13:15:01.931284 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 224/489] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:01 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1464 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:01.938316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:01.938928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:01.960735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:01.962716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:01.963981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:01.965952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:01.966524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:01.967199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.048356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:02.061303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:02.062818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:02.068923 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0111deeb-2d70-4eb8-be43-acab7e26b81f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.135685 Nov 02 13:15:02.069449 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 225/490] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:01 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:02.075079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-632eeff4-594b-4a46-80d7-369a7096fbd1 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.075723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-632eeff4-594b-4a46-80d7-369a7096fbd1 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:02.085184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632eeff4-594b-4a46-80d7-369a7096fbd1 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.085955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632eeff4-594b-4a46-80d7-369a7096fbd1 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.086759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632eeff4-594b-4a46-80d7-369a7096fbd1 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.088576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632eeff4-594b-4a46-80d7-369a7096fbd1 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.089450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632eeff4-594b-4a46-80d7-369a7096fbd1 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.089891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632eeff4-594b-4a46-80d7-369a7096fbd1 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.201246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fdaf7705-a9e1-4aa3-bda6-911e10a1d984 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1644340115", "id": 1031214878, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:02.236435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fdaf7705-a9e1-4aa3-bda6-911e10a1d984 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.521140 Nov 02 13:15:02.237854 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 266/491] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:01 2022] POST /compute/v2.1/flavors => generated 427 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:15:02.242529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.243164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:02.249871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.250362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.250817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.251543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.252379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.253454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.488355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:02.516553 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf4658f9-9eb0-4fa1-a735-0eb3d11fbfb0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1495 microversion: 2.1 time: 0.277443 Nov 02 13:15:02.520053 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 267/492] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:02 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1495 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:02.521422 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-632eeff4-594b-4a46-80d7-369a7096fbd1 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1617 microversion: 2.1 time: 0.448611 Nov 02 13:15:02.536106 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 226/493] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:02 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1617 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:02.545322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c04047e-e589-478b-a9fe-7580c9ef99a3 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.553916 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c04047e-e589-478b-a9fe-7580c9ef99a3 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032552 Nov 02 13:15:02.555690 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 268/494] 10.222.0.113 () {58 vars in 1187 bytes} [Wed Nov 2 13:15:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:15:02.559243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7f220d49-0500-43f8-8615-2780bd15941d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '.version_select at 0x7fe78c0c4310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.562811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a17aebfb-c054-48c3-b2ec-a523637a52de tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.567794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17aebfb-c054-48c3-b2ec-a523637a52de tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.568294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17aebfb-c054-48c3-b2ec-a523637a52de tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.568791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17aebfb-c054-48c3-b2ec-a523637a52de tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.569539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17aebfb-c054-48c3-b2ec-a523637a52de tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.570004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17aebfb-c054-48c3-b2ec-a523637a52de tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.570124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f220d49-0500-43f8-8615-2780bd15941d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.570472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17aebfb-c054-48c3-b2ec-a523637a52de tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.586391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f220d49-0500-43f8-8615-2780bd15941d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.589764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f220d49-0500-43f8-8615-2780bd15941d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.600231 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a17aebfb-c054-48c3-b2ec-a523637a52de tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.042274 Nov 02 13:15:02.600928 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 269/495] 10.222.0.113 () {58 vars in 1181 bytes} [Wed Nov 2 13:15:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:02.615965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6889291a-9daf-42d1-aad3-6b34097d21c4 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1669789633", "id": 1947419631, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:02.632763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7f220d49-0500-43f8-8615-2780bd15941d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 788 microversion: 2.1 time: 0.086228 Nov 02 13:15:02.633919 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 227/496] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:15:02 2022] GET /compute/v2.1/os-migrations => generated 788 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:02.641741 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6889291a-9daf-42d1-aad3-6b34097d21c4 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.030801 Nov 02 13:15:02.643424 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 270/497] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:02 2022] POST /compute/v2.1/flavors => generated 427 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:02.648668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.649770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:02.655049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-19", "block_migration": true, "disk_over_commit": false}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:02.657369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.657501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:02.658160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.658853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.659939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.660742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.662011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.675834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.676316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.676758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.677474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.677926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.678349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.724031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Lazy-loading 'flavor' on Instance uuid e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:02.738656 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf while it is in vm_state suspended Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Request method failure captured: Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf/action HTTP/1.1 Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 98 Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0VGSAiQDe9X-TpLnsBtpxV4Mu9aB90Ku-1-loZ7w4SWy2m06EqoF5afDJTWZBW8OVj0XSavdTPCw-aYc5HFEVHixz78WMUM8f2J3F83RfohQ6MyFwzHZHqAbNaenZmS_ajp9a7odrKfqMqnJccQ1P39MTGnS4WvFTmdI4jzBRVHfc Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 48fc3bac8edc4cceac3ec65bbad28d3f Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-LiveMigrationNegativeTest-653266951 Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:15:02.741053 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/48fc3bac8edc4cceac3ec65bbad28d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/48fc3bac8edc4cceac3ec65bbad28d3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_48fc3bac8edc4cceac3ec65bbad28d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/48fc3bac8edc4cceac3ec65bbad28d3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-LiveMigrationNegativeTest-653266951 Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 48fc3bac8edc4cceac3ec65bbad28d3f Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-653266951 Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-LiveMigrationNegativeTest-653266951-project-admin Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 3a7ac80c0aaf48bea22aa763927a1b83 Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-LiveMigrationNegativeTest-653266951-project-admin Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: {"os-migrateLive": {"host": "n-h1-858384-19", "block_migration": true, "disk_over_commit": false}} Nov 02 13:15:02.742636 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: exception: Cannot 'os-migrateLive' instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf while it is in vm_state suspended Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf', 'body': {'os-migrateLive': {'host': 'n-h1-858384-19', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 13:15:02.743633 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf in vm_state suspended. Cannot live_migrate while the instance is in this state. Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:02.746127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf while it is in vm_state suspended Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf while it is in vm_state suspended Nov 02 13:15:02.747620 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.748916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf while it is in vm_state suspended {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:02.748916 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-393e43bd-db86-4787-b22c-cf952d1cfed8 tempest-LiveMigrationNegativeTest-653266951 tempest-LiveMigrationNegativeTest-653266951-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf/action" status: 409 len: 155 microversion: 2.1 time: 0.107678 Nov 02 13:15:02.749171 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 228/498] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:15:02 2022] POST /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf/action => generated 155 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:15:02.754632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d5b52bc7-13b6-4dba-94f6-34c3fe8431d6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.755485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d5b52bc7-13b6-4dba-94f6-34c3fe8431d6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:02.769154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5b52bc7-13b6-4dba-94f6-34c3fe8431d6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.769931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5b52bc7-13b6-4dba-94f6-34c3fe8431d6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.770527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5b52bc7-13b6-4dba-94f6-34c3fe8431d6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.772372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5b52bc7-13b6-4dba-94f6-34c3fe8431d6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:02.774431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5b52bc7-13b6-4dba-94f6-34c3fe8431d6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:02.774880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5b52bc7-13b6-4dba-94f6-34c3fe8431d6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:02.961214 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d5b52bc7-13b6-4dba-94f6-34c3fe8431d6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1648 microversion: 2.1 time: 0.210608 Nov 02 13:15:02.964470 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 229/499] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:02 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1648 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:02.983476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-21085074-529e-4ffd-8620-d4b0869b0923 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.992745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:03.002407 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-21085074-529e-4ffd-8620-d4b0869b0923 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036649 Nov 02 13:15:03.002994 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 230/500] 10.222.0.113 () {58 vars in 1187 bytes} [Wed Nov 2 13:15:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:15:03.010928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:03.012696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:03.016610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:03.018244 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c777b647-dc59-4de8-ac1b-ac76ce78bb37 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.373552 Nov 02 13:15:03.018947 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 271/501] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:02 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:03.024328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:03.041906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-069f7ec8-3061-4c02-b798-618b4f099b40 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Action: 'create', calling method: .version_select at 0x7fe787b189d0>, body: {"keypair": {"name": "tempest-keypair-1877925391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeqijlX+mCLxkybj7hvpOX7/rdR1zbJxWb8I3rlSY0bSQRDRUblEYBfalulOA2kytQzQmOFn0t6gD9CRq24leUAjn7w+5RsOVFUBWaVuJf1dzVPqs4AadGdBXR7HCAmRQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:03.048356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.049572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.050165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.051343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.051948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.054009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.092806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-069f7ec8-3061-4c02-b798-618b4f099b40 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Getting quotas for project a27e4041951f43b6a4beb4e471cbb63b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:03.109829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-069f7ec8-3061-4c02-b798-618b4f099b40 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Getting quotas for user c67a249e060245d8a474939741a581b3 and project a27e4041951f43b6a4beb4e471cbb63b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:03.125751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:15:03.184628 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-069f7ec8-3061-4c02-b798-618b4f099b40 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160755 Nov 02 13:15:03.185451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 272/502] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:15:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:03.190353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:03.193902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:03.201481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.202154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.202748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.203664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.212319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.213657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.255524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:03.307871 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a78e30f-6b18-4f3c-a3a5-a9cb3f6dbf26 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 204 len: 0 microversion: 2.1 time: 0.302684 Nov 02 13:15:03.312310 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 231/503] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:15:03 2022] DELETE /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:15:03.318447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:03.320214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:03.333092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.333971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.334734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.335671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:03.336440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:03.337040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:03.412431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:03.429691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:03.438749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:03.450081 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ad9d81b9-a3b1-484a-bdc7-66776bd6bae8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.263028 Nov 02 13:15:03.464516 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 273/504] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:03 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:03.484375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1726252050", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "11ec4f6b-127c-44f1-a825-014c9ea38647"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:03.594595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] validate_networks() for [('11ec4f6b-127c-44f1-a825-014c9ea38647', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:03.689612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:03.697072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:03.707532 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a2ef025-a129-43a2-9c70-d8280dad65e3 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1470 microversion: 2.1 time: 0.392223 Nov 02 13:15:03.708671 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 232/505] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:03 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:04.052518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:04.055468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:04.075190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.079723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.080241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.081002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.081470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.081896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.471048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:04.490904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:04.493183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:04.496593 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b9d43fa3-62ee-4194-8152-01ff5a0d8dc2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.456393 Nov 02 13:15:04.497834 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 233/506] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:04 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:04.503870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:04.505120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:04.564198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.565427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.566156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.566800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.577362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.577906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.654710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:04.655533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:04.655908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:04.656330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:04.656757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:04.676850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.678494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.679149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.680371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.681029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.682113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.733517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:04.741587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:04.754467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for user 392d81e9a1c74430a325c9ecc1dcfb44 and project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:04.761343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:04.763372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:04.781455 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-44e5b88b-66fb-4625-9334-4923ce13bc1a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.282321 Nov 02 13:15:04.782691 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 234/507] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:04 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:04.799387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:04.799655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:04.799847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:04.823401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:04.834429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.841888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.842606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.845488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:04.847898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:04.851728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:04.998088 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-093b82c7-d5f9-432d-a140-f44bbb51ca07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.531337 Nov 02 13:15:04.998798 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 274/508] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:15:05.018860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b62972b-d5b9-4ad8-8d12-16a01d67bced tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:05.019530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b62972b-d5b9-4ad8-8d12-16a01d67bced tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:05.221124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b62972b-d5b9-4ad8-8d12-16a01d67bced tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:05.235742 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b62972b-d5b9-4ad8-8d12-16a01d67bced tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1215 microversion: 2.1 time: 0.229471 Nov 02 13:15:05.254585 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 275/509] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:05 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:05.395033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:05.406647 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4d3ad3b-2a37-4ac1-a932-c3c04f807581 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1470 microversion: 2.1 time: 0.620677 Nov 02 13:15:05.424219 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 235/510] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:04 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1470 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:05.523825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:05.524758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:05.538246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:05.538906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:05.539537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:05.543003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:05.547711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:05.549519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:05.821870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:05.823172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:05.864526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:05.865038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:05.870559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:05.873570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:05.874056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:05.874555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.065221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.070948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.078202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.082897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.083936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.085148 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10b3a5e1-fe61-4b66-819a-9a69b8c86dab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.565970 Nov 02 13:15:06.093663 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 276/511] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:05 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:06.108632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.121836 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b880ee16-43ae-4b47-8118-dbbe71e233c7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.301490 Nov 02 13:15:06.127680 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 236/512] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:05 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:06.261044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:06.261676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:06.274392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:06.276051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:06.279453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.280303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:06.280772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:06.281406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.444131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:06.444761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:06.467473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:06.468041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:06.468533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.469269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:06.469723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:06.477087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:06.544343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.569086 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f29de132-1a20-4e7f-a39a-9731ce5821d4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1211 microversion: 2.1 time: 0.312651 Nov 02 13:15:06.574548 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 277/513] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:06 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1211 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:06.819806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:06.831338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-df78aeae-8e0a-4fc3-a92b-95b66fe9dc2d tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1470 microversion: 2.1 time: 0.394529 Nov 02 13:15:06.831851 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 237/514] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:06 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:07.003689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d445382a-9c90-4955-ae60-988f4e86efb5 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Action: 'create', calling method: .version_select at 0x7fe787a8b8b0>, body: {"keypair": {"name": "tempest-keypair-12911824", "type": "ssh", "user_id": "99e30c9a0cdc4a289c4ae9fbb4b69f45", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSf7JepmYYAHDtQ3HsYvW6glc0cKAplbPFW+BgjLag2HyELsiJx/rE7ys1kkySBvAHHpL/A0zwU8K9RIoosIlpAmeRo3ywlmu+yyKMNmNSqOxdAVgCizMMGbLYY0RLecA=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:07.031884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d445382a-9c90-4955-ae60-988f4e86efb5 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Getting quotas for project 6e64109bdfb14193a9fd59da7342c2a0. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:07.037787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d445382a-9c90-4955-ae60-988f4e86efb5 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Getting quotas for user 1720431e2b704016b97ddbe0b8a6be09 and project 6e64109bdfb14193a9fd59da7342c2a0. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:07.078490 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d445382a-9c90-4955-ae60-988f4e86efb5 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.359468 Nov 02 13:15:07.080785 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 278/515] 10.222.0.113 () {62 vars in 1205 bytes} [Wed Nov 2 13:15:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 363 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:15:07.100626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7938da8-e909-48bd-8608-26c94055869d tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Action: 'create', calling method: .version_select at 0x7fe787a98940>, body: {"keypair": {"name": "tempest-keypair-116791070", "type": "ssh", "user_id": "99e30c9a0cdc4a289c4ae9fbb4b69f45", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTl2/wD69UPRJXQmXxUmNrxPf+i1h5MToje5KGUTM3Ja3Uj7N7RgO0rO9DqC9mRq0APPbOAJB78b2dumor9cFSjCnj+OQbtuK1C1St3hDEfn4iIgaiv2TXj7hgdcMd9xg=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:07.138275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-327357047", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:07.173692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d7938da8-e909-48bd-8608-26c94055869d tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Getting quotas for project 6e64109bdfb14193a9fd59da7342c2a0. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:07.181957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d7938da8-e909-48bd-8608-26c94055869d tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Getting quotas for user 1720431e2b704016b97ddbe0b8a6be09 and project 6e64109bdfb14193a9fd59da7342c2a0. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:07.219026 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d7938da8-e909-48bd-8608-26c94055869d tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.128517 Nov 02 13:15:07.220262 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 279/516] 10.222.0.113 () {62 vars in 1205 bytes} [Wed Nov 2 13:15:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:15:07.227485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:07.228440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:07.237355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.238099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.238847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.241122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.242859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.243734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.275946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] validate_networks() for None {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:07.541583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:07.784035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:07.784460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:07.785140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:07.785705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:07.786268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:07.802135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.803231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.808149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.808984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.809636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.811744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.819841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:07.832190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:07.838687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:07.848165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:07.850603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:07.852943 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a5c46467-c329-4ca8-b148-3fe67860f734 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1572 microversion: 2.25 time: 0.630967 Nov 02 13:15:07.856005 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 280/517] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:07 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1572 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:07.857478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:07.859844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:07.862673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:07.865757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:07.873757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.874590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.876023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.877071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:07.877805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:07.878625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:07.920281 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a723083d-0cc4-4a12-b0bb-a593e6c844cf tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.907830 Nov 02 13:15:07.921678 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 238/518] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:15:07.926469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e43d1ab9-512f-4854-b386-bf36f51abbbe tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Calling method '.version_select at 0x7fe787e901f0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:07.942658 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e43d1ab9-512f-4854-b386-bf36f51abbbe tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] 10.222.0.113 "GET /compute/v2.1/os-keypairs/tempest-keypair-12911824?user_id=99e30c9a0cdc4a289c4ae9fbb4b69f45" status: 200 len: 510 microversion: 2.10 time: 0.019713 Nov 02 13:15:07.944033 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 239/519] 10.222.0.113 () {60 vars in 1339 bytes} [Wed Nov 2 13:15:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-12911824?user_id=99e30c9a0cdc4a289c4ae9fbb4b69f45 => generated 510 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:15:08.011147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:08.024469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:08.029311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:08.036847 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f9894a21-2ce6-4786-b0eb-314987b858a5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.179188 Nov 02 13:15:08.037798 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 281/520] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:07 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:08.043680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:08.044286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:08.051635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.052137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.052787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.053776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.054385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.055037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.156330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:08.165438 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12660b96-8f7c-412c-99bc-b20b257c2da0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1273 microversion: 2.1 time: 0.126465 Nov 02 13:15:08.166687 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 282/521] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:08 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:08.175524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-957173621", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "1947419631", "adminPass": "***", "networks": [{"uuid": "e4e8486f-100c-4eb5-98f1-c9d83089cd3f"}], "security_groups": [{"name": "tempest-securitygroup--1351989893"}], "key_name": "tempest-keypair-1877925391", "user_data": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:08.191799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:08.221201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a271a524-f316-43d6-af0a-4dbeb90b611d tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Action: 'update', calling method: .version_select at 0x7fe787d61ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:08.299615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a271a524-f316-43d6-af0a-4dbeb90b611d tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.300097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a271a524-f316-43d6-af0a-4dbeb90b611d tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.300534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a271a524-f316-43d6-af0a-4dbeb90b611d tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.301286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a271a524-f316-43d6-af0a-4dbeb90b611d tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.301742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a271a524-f316-43d6-af0a-4dbeb90b611d tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.302167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a271a524-f316-43d6-af0a-4dbeb90b611d tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.370068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] validate_networks() for [('e4e8486f-100c-4eb5-98f1-c9d83089cd3f', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:08.387135 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a271a524-f316-43d6-af0a-4dbeb90b611d tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/e409a5ad72854193b553593619944caf" status: 200 len: 148 microversion: 2.57 time: 0.441777 Nov 02 13:15:08.388374 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 240/522] 10.222.0.113 () {62 vars in 1308 bytes} [Wed Nov 2 13:15:07 2022] PUT /compute/v2.1/os-quota-sets/e409a5ad72854193b553593619944caf => generated 148 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:15:08.395226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6fa8eb63-74e3-4e6a-b47d-f622526f7241 req-436526f9-6b9a-4806-ac02-1f19eecdfe49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf", "name": "network-vif-deleted", "tag": "8a96ffe6-083e-4c11-addf-363213fc7f2c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:08.405471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6fa8eb63-74e3-4e6a-b47d-f622526f7241 req-436526f9-6b9a-4806-ac02-1f19eecdfe49 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.406406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6fa8eb63-74e3-4e6a-b47d-f622526f7241 req-436526f9-6b9a-4806-ac02-1f19eecdfe49 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.407006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6fa8eb63-74e3-4e6a-b47d-f622526f7241 req-436526f9-6b9a-4806-ac02-1f19eecdfe49 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.420044 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6fa8eb63-74e3-4e6a-b47d-f622526f7241 req-436526f9-6b9a-4806-ac02-1f19eecdfe49 service nova] Creating event network-vif-deleted:8a96ffe6-083e-4c11-addf-363213fc7f2c for instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf on n-h2-858384-19 Nov 02 13:15:08.425533 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6fa8eb63-74e3-4e6a-b47d-f622526f7241 req-436526f9-6b9a-4806-ac02-1f19eecdfe49 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035732 Nov 02 13:15:08.426151 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 241/523] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:08.433618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:08.434968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:08.442919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.443660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.444919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.445961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.446592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.448713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.488425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:08.494494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:08.495549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:08.496568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:08.497073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lazy-loading 'fault' on Instance uuid e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:08.610767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:08.633361 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17399314-c778-47af-8ecf-203fa6bd8750 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 200 len: 1313 microversion: 2.1 time: 0.205089 Nov 02 13:15:08.635230 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 242/524] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:08 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:08.641362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2598cb52-0c1d-4fac-84b2-e1000d592c92 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:08.642296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2598cb52-0c1d-4fac-84b2-e1000d592c92 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:08.771874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2598cb52-0c1d-4fac-84b2-e1000d592c92 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:08.779689 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2598cb52-0c1d-4fac-84b2-e1000d592c92 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1220 microversion: 2.1 time: 0.142878 Nov 02 13:15:08.783720 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 243/525] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:08 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:08.788885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03462226-4039-4b77-822c-775b4a381fa5 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Action: 'create', calling method: .version_select at 0x7fe787d10dc0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1488280601", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJu9QHFL3yUBEtHEZch4EXEAw8XEzK4CBayyDx9dlPNwoF9460ncCIHta3dViNColE8Sl8bL2DgaApIIDlm5X7VA/Z2OF7xqZRiKK8SopXy7VsGCVR0zlsJlHJU3L35Tug=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:08.842346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-03462226-4039-4b77-822c-775b4a381fa5 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Getting quotas for project 6e64109bdfb14193a9fd59da7342c2a0. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:08.860158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-03462226-4039-4b77-822c-775b4a381fa5 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Getting quotas for user 1720431e2b704016b97ddbe0b8a6be09 and project 6e64109bdfb14193a9fd59da7342c2a0. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:08.946417 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03462226-4039-4b77-822c-775b4a381fa5 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.161247 Nov 02 13:15:08.947547 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 244/526] 10.222.0.113 () {62 vars in 1205 bytes} [Wed Nov 2 13:15:08 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:15:08.953943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9491b586-d93f-4b88-8146-0d39ac8899b7 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Calling method '.version_select at 0x7fe787d1d310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.025952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9491b586-d93f-4b88-8146-0d39ac8899b7 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.026416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9491b586-d93f-4b88-8146-0d39ac8899b7 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.026854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9491b586-d93f-4b88-8146-0d39ac8899b7 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.027833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9491b586-d93f-4b88-8146-0d39ac8899b7 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.028285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9491b586-d93f-4b88-8146-0d39ac8899b7 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.028868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9491b586-d93f-4b88-8146-0d39ac8899b7 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.049509 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9491b586-d93f-4b88-8146-0d39ac8899b7 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/e409a5ad72854193b553593619944caf/detail" status: 200 len: 463 microversion: 2.57 time: 0.100548 Nov 02 13:15:09.050127 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 245/527] 10.222.0.113 () {60 vars in 1309 bytes} [Wed Nov 2 13:15:08 2022] GET /compute/v2.1/os-quota-sets/e409a5ad72854193b553593619944caf/detail => generated 463 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:15:09.055724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.057134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:09.064520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.065243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.065874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.066787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.067466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.068081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.071856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:09.072922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:09.073777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:09.074518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:09.075833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:09.088546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.089498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.090166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.091126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.091926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.092868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.113797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Getting quotas for project a27e4041951f43b6a4beb4e471cbb63b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:09.120571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Getting quotas for user c67a249e060245d8a474939741a581b3 and project a27e4041951f43b6a4beb4e471cbb63b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:09.136478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:09.138787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:09.200500 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8af6576f-773e-410f-aeac-36875ca76993 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.031415 Nov 02 13:15:09.201466 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 283/528] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:08 2022] POST /compute/v2.1/servers => generated 404 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:15:09.205934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74c7c542-0a17-4be0-9732-03707bcc498c tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Calling method '.version_select at 0x7fe787b25790>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.211836 n-d-858384-19 devstack@n-api.service[120928]: WARNING oslo_db.sqlalchemy.utils [None req-74c7c542-0a17-4be0-9732-03707bcc498c tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:15:09.220475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74c7c542-0a17-4be0-9732-03707bcc498c tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] 10.222.0.113 "GET /compute/v2.1/os-keypairs?user_id=99e30c9a0cdc4a289c4ae9fbb4b69f45" status: 200 len: 723 microversion: 2.10 time: 0.017887 Nov 02 13:15:09.221377 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 284/529] 10.222.0.113 () {60 vars in 1264 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/os-keypairs?user_id=99e30c9a0cdc4a289c4ae9fbb4b69f45 => generated 723 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:15:09.225953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.227533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:09.236926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.237677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.238273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.239152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.239838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.240420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.279984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.289379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.292117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.293579 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ac8c8d71-8d29-4c1e-bf6a-b6e07b2b342c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1562 microversion: 2.25 time: 0.241498 Nov 02 13:15:09.307724 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 246/530] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1562 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:09.320822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.321642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:09.329492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.330233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.330858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.331596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.332228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.332813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.380056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.394015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.397068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.425543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-27c58e6b-ba29-428a-b374-74dc18477a38 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.203075 Nov 02 13:15:09.426442 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 285/531] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:09.441207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dd192ab7-2ab9-4b2c-a8fc-6c00c6624010 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.441919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dd192ab7-2ab9-4b2c-a8fc-6c00c6624010 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:09.533175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd192ab7-2ab9-4b2c-a8fc-6c00c6624010 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.545425 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dd192ab7-2ab9-4b2c-a8fc-6c00c6624010 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1268 microversion: 2.1 time: 0.107184 Nov 02 13:15:09.551521 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 286/532] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1268 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:09.562794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-661977c9-16e0-46a8-865d-fa3780718702 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Calling method '.version_select at 0x7fe787ae3a60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.593042 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-661977c9-16e0-46a8-865d-fa3780718702 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1488280601" status: 204 len: 0 microversion: 2.10 time: 0.045186 Nov 02 13:15:09.593805 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 287/533] 10.222.0.113 () {60 vars in 1330 bytes} [Wed Nov 2 13:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1488280601 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:15:09.603661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Action: 'update', calling method: .version_select at 0x7fe787a98280>, body: {"quota_set": {"ram": "2048"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:09.700988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.701583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.702088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.703073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.703649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.704138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.750245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.750723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.751334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.751966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.752416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.752851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.823658 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eb2e8fa0-9bb4-418c-8e50-1f34b4f30f96 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/e409a5ad72854193b553593619944caf?user_id=cf0ece9a25b5480b9436991062946605" status: 200 len: 148 microversion: 2.57 time: 0.228448 Nov 02 13:15:09.824315 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 288/534] 10.222.0.113 () {62 vars in 1389 bytes} [Wed Nov 2 13:15:09 2022] PUT /compute/v2.1/os-quota-sets/e409a5ad72854193b553593619944caf?user_id=cf0ece9a25b5480b9436991062946605 => generated 148 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:15:09.828868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e5d3c492-744e-43a2-bc49-d3e0fbba0108 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '.version_select at 0x7fe787ae3ee0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.832532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5d3c492-744e-43a2-bc49-d3e0fbba0108 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.833008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5d3c492-744e-43a2-bc49-d3e0fbba0108 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.833443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5d3c492-744e-43a2-bc49-d3e0fbba0108 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.850546 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e5d3c492-744e-43a2-bc49-d3e0fbba0108 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 864 microversion: 2.25 time: 0.025130 Nov 02 13:15:09.851070 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 289/535] 10.222.0.113 () {60 vars in 1189 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/os-migrations => generated 864 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:15:09.856289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-81002cbe-b441-484c-a965-727a85a86a69 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Calling method '.version_select at 0x7fe787c03ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.879027 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-81002cbe-b441-484c-a965-727a85a86a69 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-116791070?user_id=99e30c9a0cdc4a289c4ae9fbb4b69f45" status: 204 len: 0 microversion: 2.10 time: 0.026714 Nov 02 13:15:09.880485 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 290/536] 10.222.0.113 () {60 vars in 1345 bytes} [Wed Nov 2 13:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-116791070?user_id=99e30c9a0cdc4a289c4ae9fbb4b69f45 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:15:09.887845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:09.890860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.891507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:09.896853 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d498931a-8f99-4577-9185-9b65d7808c64 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1315 microversion: 2.1 time: 0.587914 Nov 02 13:15:09.898057 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 247/537] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:09.906885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.907789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.908516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.910562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.911717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.912444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.916629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:09.918744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:09.925642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.926342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.926999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.928324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:09.929316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:09.929946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:09.930635 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] HTTP exception thrown: Instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf could not be found. Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Request method failure captured: Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf HTTP/1.1 Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0T0CI3hJkWd2bs4eIPdUQf8DNLH8_Wslxbkv3_Aj5QTGHMjYP_RH6halW8Dd0StIT4KMNKXJ4DvybCOx_Nbm7ESaocOIn591Dmsps0K0MqfBYdftOOxN0mtGJncfghL3VDk66bWQSGxzLc-rsc1eCy_vbf5zGIajaVn_p85AlG_mY Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 40d6720a9e154953b426a39100429327 Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-LiveMigrationNegativeTest-789566103 Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:15:09.933581 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/40d6720a9e154953b426a39100429327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/40d6720a9e154953b426a39100429327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_40d6720a9e154953b426a39100429327"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/40d6720a9e154953b426a39100429327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-LiveMigrationNegativeTest-789566103 Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 40d6720a9e154953b426a39100429327 Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-789566103 Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-LiveMigrationNegativeTest-789566103-project Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0195abc2f8b24f46895a27d5ee2e8f7f Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-LiveMigrationNegativeTest-789566103-project Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf could not be found. Nov 02 13:15:09.934847 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf'} Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf could not be found. Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:09.936460 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf could not be found. Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf could not be found. Nov 02 13:15:09.937681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:09.938724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Returning 404 to user: Instance e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:09.938724 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-33f29c8a-885f-4439-bce4-f6c45bf19299 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf" status: 404 len: 111 microversion: 2.1 time: 0.053739 Nov 02 13:15:09.938724 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 291/538] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/servers/e60e7fe2-fe42-4db0-8a2f-21b97cc1dccf => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:15:09.945738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f922b62-4abb-407f-ac99-f275c0f64a74 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] Calling method '.version_select at 0x7fe787bf6310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:10.066661 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f922b62-4abb-407f-ac99-f275c0f64a74 tempest-QuotasAdminTestV257-945235803 tempest-QuotasAdminTestV257-945235803-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/e409a5ad72854193b553593619944caf?user_id=cf0ece9a25b5480b9436991062946605" status: 200 len: 190 microversion: 2.57 time: 0.129953 Nov 02 13:15:10.072983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:10.076019 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 292/539] 10.222.0.113 () {60 vars in 1369 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/os-quota-sets/e409a5ad72854193b553593619944caf?user_id=cf0ece9a25b5480b9436991062946605 => generated 190 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:15:10.081317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:10.082030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:10.092543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.093728 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-47abe388-7ddc-4da0-b34f-cf066b94a734 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1272 microversion: 2.1 time: 0.194473 Nov 02 13:15:10.093890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.094504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.095292 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 248/540] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:09 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:10.095610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.096142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.096804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.103055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cc380488-8cd2-420d-8308-9b1d4bb58de8 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] Calling method '.version_select at 0x7fe787dfff70>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:10.141507 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cc380488-8cd2-420d-8308-9b1d4bb58de8 tempest-KeyPairsV210TestJSON-1715955576 tempest-KeyPairsV210TestJSON-1715955576-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-12911824?user_id=99e30c9a0cdc4a289c4ae9fbb4b69f45" status: 204 len: 0 microversion: 2.10 time: 0.043628 Nov 02 13:15:10.142903 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 249/541] 10.222.0.113 () {60 vars in 1342 bytes} [Wed Nov 2 13:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-12911824?user_id=99e30c9a0cdc4a289c4ae9fbb4b69f45 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:15:10.157806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:10.159730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:10.172633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.173487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.174150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.175063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.175756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.176961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.208648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:15:10.263830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 8d7e88a9-99ef-4852-9e10-1c55a1ded715 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:10.344094 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0dca4b97-142f-4d03-8bef-581b924208f4 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 2056 microversion: 2.25 time: 0.266521 Nov 02 13:15:10.361268 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 293/542] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:10 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 2056 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:10.376452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d8d91941-3f26-4590-a116-8276272f50a6 req-2912432c-961c-4f3c-8626-b01917cb339c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fbd976e-6935-43e4-b29b-767d119733f8", "tag": "613e5fac-e26d-4c56-84b7-c232722f889f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:10.396622 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e89d61b-da72-4a05-823f-99df0fc51d22 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "DELETE /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 204 len: 0 microversion: 2.1 time: 0.249339 Nov 02 13:15:10.397956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d8d91941-3f26-4590-a116-8276272f50a6 req-2912432c-961c-4f3c-8626-b01917cb339c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.403493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d8d91941-3f26-4590-a116-8276272f50a6 req-2912432c-961c-4f3c-8626-b01917cb339c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.403664 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 250/543] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:15:10 2022] DELETE /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:15:10.403764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d8d91941-3f26-4590-a116-8276272f50a6 req-2912432c-961c-4f3c-8626-b01917cb339c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.411228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:10.412304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:10.428431 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d8d91941-3f26-4590-a116-8276272f50a6 req-2912432c-961c-4f3c-8626-b01917cb339c service nova] Creating event network-changed:613e5fac-e26d-4c56-84b7-c232722f889f for instance 4fbd976e-6935-43e4-b29b-767d119733f8 on n-h2-858384-19 Nov 02 13:15:10.434763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.438701 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d8d91941-3f26-4590-a116-8276272f50a6 req-2912432c-961c-4f3c-8626-b01917cb339c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074384 Nov 02 13:15:10.438945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.440050 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 294/544] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:10.440485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.441264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.441748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.442227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.465135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:10.466947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:10.481850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.483096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.483868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.485677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.486345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.487258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.620374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:10.632646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:10.639707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:10.645282 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-14c26b0e-721b-4a68-8c87-0d9cdeddcf19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.187590 Nov 02 13:15:10.646239 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 295/545] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:10 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:10.652107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:10.652940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:10.659448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.660251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.661079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.662198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.662799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.663603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.738445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:10.742671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:10.750112 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d969f983-f978-4253-a0e9-c48f19486dbb tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1478 microversion: 2.1 time: 0.345062 Nov 02 13:15:10.758827 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cb3f33d2-e25d-4c3f-ba8b-1870cffe9e22 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1320 microversion: 2.1 time: 0.111379 Nov 02 13:15:10.761278 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 296/546] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:10 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1320 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:10.764163 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 251/547] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:10 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1478 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:10.766759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1035463278", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "d4fa706d-0b70-4668-8feb-3fb6d614d14b"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:10.839942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] validate_networks() for [('d4fa706d-0b70-4668-8feb-3fb6d614d14b', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:10.924483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:10.925165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:10.937841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.938634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.939257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:10.940199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:10.940864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:10.943310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.130036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:11.140399 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4031ac7f-9b62-44cc-a948-bafa408bf320 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1315 microversion: 2.1 time: 0.220618 Nov 02 13:15:11.151748 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 252/548] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:10 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:11.160816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:11.161435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:11.170045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.170733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.171183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.172096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.172833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.173269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.251624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:11.260205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-be88048f-7e97-49e5-8129-4518ab9cf4f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1290 microversion: 2.1 time: 0.106472 Nov 02 13:15:11.276036 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 253/549] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:11 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1290 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:11.423795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:11.424433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:11.425259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:11.425925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:11.426578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:11.438178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.438877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.439373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.440180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.440644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.441209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.460524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for project d89e00efbe3c49019171062c5e914dc9. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:11.467828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for user 4b987e6d2a814bc6b30b8191cfd5351d and project d89e00efbe3c49019171062c5e914dc9. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:11.483338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:11.485789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:11.539768 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4776ae71-84e8-4e94-8ecb-57ac05bfd558 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 0.777198 Nov 02 13:15:11.540439 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 297/550] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:15:10 2022] POST /compute/v2.1/servers => generated 382 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:15:11.553882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cee2725e-b900-421c-998c-2932d57ee59b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:11.554497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cee2725e-b900-421c-998c-2932d57ee59b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:11.642170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cee2725e-b900-421c-998c-2932d57ee59b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:11.655947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cee2725e-b900-421c-998c-2932d57ee59b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:11.660256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cee2725e-b900-421c-998c-2932d57ee59b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:11.663775 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cee2725e-b900-421c-998c-2932d57ee59b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1266 microversion: 2.25 time: 0.112264 Nov 02 13:15:11.664379 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 254/551] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:11 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:11.689854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:11.690476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:11.701541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.704252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.705146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.708320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.710345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.710950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.794991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:11.795895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:11.817169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.820787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.821571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.829630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.830154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.830685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.837527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:11.863801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:11.886864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:11.889560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:11.900023 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3ab9906-5ce1-4ce3-9397-112cd40115ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.221694 Nov 02 13:15:11.915173 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 298/552] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:11 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:11.925074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:11.925074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:11.942091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.944770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.945234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:11.945957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:11.948432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:11.949144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.029447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:12.044144 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-55202268-bb53-4e3a-89e1-0392664820ed tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1320 microversion: 2.1 time: 0.250650 Nov 02 13:15:12.044805 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 255/553] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:11 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:12.163956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:12.164569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:12.177941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.178435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.182555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.183405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.183882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.184319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.229012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:12.239404 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-299f155b-ae84-4362-a4e9-08f2bd78b754 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1478 microversion: 2.1 time: 0.331950 Nov 02 13:15:12.255149 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 299/554] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:11 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1478 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:12.287860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:12.288697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:12.292747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:12.308667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.309317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.309869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.310855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.311329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.311820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.439012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:12.448759 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6ef2de3-b3fb-4e7c-aa80-e0e5d7bd1c55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1278 microversion: 2.1 time: 0.167978 Nov 02 13:15:12.451533 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 300/555] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:12 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:12.694918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:12.697480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:12.709345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.710233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.710972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.712269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.714027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.714890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.765540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:12.773740 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e669c499-2fb7-463c-b8d5-8fa78bb92bee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1315 microversion: 2.1 time: 0.613769 Nov 02 13:15:12.788310 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 256/556] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:12 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:12.808437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:12.815017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:12.822731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:12.824875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:12.825997 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-148c32bf-3754-40d4-a87f-f4ab2cfafd1b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1270 microversion: 2.25 time: 0.136374 Nov 02 13:15:12.827438 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 301/557] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:12 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:12.933833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:12.934461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:12.940449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.940937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.941607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:12.942321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:12.942941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:12.943422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:13.071093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:13.072672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:13.081791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:13.082395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:13.082970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:13.083977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:13.084510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:13.085035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:13.102320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:13.115616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:13.118227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:13.125152 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-14b9db14-d980-48c0-a0cc-8382a77c0af7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.196159 Nov 02 13:15:13.126824 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 257/558] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:12 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:13.170035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:13.180993 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1ef2bc37-e129-4398-be02-9d35741dc1d5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1326 microversion: 2.1 time: 0.114968 Nov 02 13:15:13.192861 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 302/559] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:13 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:13.266845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:13.268332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:13.279626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:13.280317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:13.281693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:13.283083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:13.283995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:13.284577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:13.476554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:13.479548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:13.488729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:13.491456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:13.492083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:13.493097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:13.494416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:13.495151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:13.674928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:13.690112 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2dd10acc-f8e0-4841-aa27-eeabb263b4d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.215956 Nov 02 13:15:13.690671 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 303/560] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:13 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:13.802969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:13.804255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:13.834268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:13.835167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:13.835602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:13.836331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:13.836963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:13.839705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.055651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.069817 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f8d8077-0c4e-4b16-9769-0a52839b5ce0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1478 microversion: 2.1 time: 0.808533 Nov 02 13:15:14.086751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.089545 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 258/561] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:13 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1478 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:14.099969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:14.102375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:14.105778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b60c901a-5179-4c41-9e53-c33936cbccf2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1315 microversion: 2.1 time: 0.304168 Nov 02 13:15:14.106369 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 304/562] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:13 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:14.112662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:14.113232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:14.113722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.114540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:14.115052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:14.115556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.155504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:14.156124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:14.177599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:14.179933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:14.180431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.187469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:14.188316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:14.188936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.330978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.351410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.354555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.388135 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf7cea1b-52a7-47d1-8a26-1afc68a627cb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.238343 Nov 02 13:15:14.389058 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 305/563] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:14 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:14.405353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:14.411202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:14.432698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:14.433803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:14.438283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.441806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:14.442996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:14.446174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.555322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.573918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.575789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.577796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.585173 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04e537b9-f48c-47de-b47a-5664869d1519 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1262 microversion: 2.25 time: 0.489648 Nov 02 13:15:14.586088 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 259/564] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:14 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1262 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:14.592065 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1141c80a-4bd6-4cb5-95eb-d36e241575b0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1326 microversion: 2.1 time: 0.198068 Nov 02 13:15:14.592665 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 306/565] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:14 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1326 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:14.698978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d1218483-b197-46b6-afd4-6017ab7d31a9 req-c315dbdf-3d25-441d-983b-793d9c84b67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800fbdf2-d748-4d08-ae3b-c5a4d0401ab1", "name": "network-vif-deleted", "tag": "ba1e40c1-88cc-4a22-992b-41cc1769803d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:14.720903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d1218483-b197-46b6-afd4-6017ab7d31a9 req-c315dbdf-3d25-441d-983b-793d9c84b67f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:14.721116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:14.721558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:14.721746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d1218483-b197-46b6-afd4-6017ab7d31a9 req-c315dbdf-3d25-441d-983b-793d9c84b67f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:14.722231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d1218483-b197-46b6-afd4-6017ab7d31a9 req-c315dbdf-3d25-441d-983b-793d9c84b67f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.729430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:14.730204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:14.730888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.731659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:14.732422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:14.733016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:14.747874 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d1218483-b197-46b6-afd4-6017ab7d31a9 req-c315dbdf-3d25-441d-983b-793d9c84b67f service nova] Creating event network-vif-deleted:ba1e40c1-88cc-4a22-992b-41cc1769803d for instance 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 on n-h1-858384-19 Nov 02 13:15:14.757392 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d1218483-b197-46b6-afd4-6017ab7d31a9 req-c315dbdf-3d25-441d-983b-793d9c84b67f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063305 Nov 02 13:15:14.758010 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 260/566] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:14.961208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:14.984506 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a80d1eaa-efcf-4331-8504-7205c3e7e1ad tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.274291 Nov 02 13:15:14.988691 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 307/567] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:14 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:15.100362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:15.101228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:15.110566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.112660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.113955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.115325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.115956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.116838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.131637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:15.132444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:15.143042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.143451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.143885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.147132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.148753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.153183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.168792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.169280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.169864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.170327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lazy-loading 'fault' on Instance uuid 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:15.312565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:15.325390 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-60f9cf60-611b-4737-b7bb-1d5df1622996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1315 microversion: 2.1 time: 0.198054 Nov 02 13:15:15.326202 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 308/568] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:15 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:15.367872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0195abc2f8b24f46895a27d5ee2e8f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40d6720a9e154953b426a39100429327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:15.378657 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ced003a-87b4-4fd7-b023-fa3ad2670aa0 tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 200 len: 1312 microversion: 2.1 time: 0.285015 Nov 02 13:15:15.393351 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 261/569] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:15 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 1312 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:15.420250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:15.420961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:15.429641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.430471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.431631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.432712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.434248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.435392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.682112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:15.694864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:15.697652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:15.708307 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e03639a7-e56e-4bfa-94ff-8c3d281a7516 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.293303 Nov 02 13:15:15.715766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1465088446", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:15.727369 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 262/570] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:15 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:15.733132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:15.733741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:15.742600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.749380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.749865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.750626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.751095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.751556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.796040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:15.905095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:15.914026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:15.916460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:15.917795 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-159b8a87-aa40-451d-8196-04d05001bff9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1324 microversion: 2.25 time: 0.193489 Nov 02 13:15:15.931974 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 263/571] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:15 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1324 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:15.943340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:15.944186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:15.952318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.953038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.953645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:15.954526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:15.955156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:15.955769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.069528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:16.070032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:16.070586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:16.072451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:16.072958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:16.083381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.084138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.084704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.085544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.086102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.086633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.111047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Getting quotas for project 8255f68e708743abb89b81695baacdbd. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:16.117504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Getting quotas for user 393aa3e8607542e6a22a4ae389bd936e and project 8255f68e708743abb89b81695baacdbd. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:16.132276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:16.135883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:16.187845 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be496678-f8c7-4d2d-8ea8-a12848d5c4f9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.845288 Nov 02 13:15:16.188935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 309/572] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:15 2022] POST /compute/v2.1/servers => generated 382 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:15:16.373036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ced28fb5-2276-4ebd-a191-00d79387d93e tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:16.378555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ced28fb5-2276-4ebd-a191-00d79387d93e tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.379022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ced28fb5-2276-4ebd-a191-00d79387d93e tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.379667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ced28fb5-2276-4ebd-a191-00d79387d93e tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.380447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ced28fb5-2276-4ebd-a191-00d79387d93e tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.381949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ced28fb5-2276-4ebd-a191-00d79387d93e tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.382384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ced28fb5-2276-4ebd-a191-00d79387d93e tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.409866 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ced28fb5-2276-4ebd-a191-00d79387d93e tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.219325 Nov 02 13:15:16.419319 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 310/573] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:15:16 2022] GET /compute/v2.1/os-services => generated 949 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:16.419319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:16.419319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:16.423036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.423574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.424014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.425006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.425638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.426007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.613719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:16.626765 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3a0c3263-2a21-41f1-bca9-ed361ad5da29 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.214649 Nov 02 13:15:16.628288 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 311/574] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:16 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:16.633810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-32ff7f09-6b71-442a-9966-5f9363f6442c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:16.635090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-32ff7f09-6b71-442a-9966-5f9363f6442c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:16.703371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-32ff7f09-6b71-442a-9966-5f9363f6442c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:16.711403 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-32ff7f09-6b71-442a-9966-5f9363f6442c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1227 microversion: 2.1 time: 0.081741 Nov 02 13:15:16.713526 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 312/575] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:16 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1227 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:16.718917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:16.719688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:16.726434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.727471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.728737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.729973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.730183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.730646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.813600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:16.826499 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b825448b-c90a-49ac-840e-9448e9c28c33 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.891656 Nov 02 13:15:16.827702 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 264/576] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:15 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:16.838532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:16.839483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] [instance: 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:16.847919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.848930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.849708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.850933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.851916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.852568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.872000 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] HTTP exception thrown: Instance 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 could not be found. Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Request method failure captured: Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 HTTP/1.1 Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0T0CI3hJkWd2bs4eIPdUQf8DNLH8_Wslxbkv3_Aj5QTGHMjYP_RH6halW8Dd0StIT4KMNKXJ4DvybCOx_Nbm7ESaocOIn591Dmsps0K0MqfBYdftOOxN0mtGJncfghL3VDk66bWQSGxzLc-rsc1eCy_vbf5zGIajaVn_p85AlG_mY Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 40d6720a9e154953b426a39100429327 Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-LiveMigrationNegativeTest-789566103 Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:15:16.876021 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/40d6720a9e154953b426a39100429327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/40d6720a9e154953b426a39100429327"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_40d6720a9e154953b426a39100429327"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/40d6720a9e154953b426a39100429327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-LiveMigrationNegativeTest-789566103 Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 40d6720a9e154953b426a39100429327 Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-789566103 Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-LiveMigrationNegativeTest-789566103-project Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0195abc2f8b24f46895a27d5ee2e8f7f Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-LiveMigrationNegativeTest-789566103-project Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 could not be found. Nov 02 13:15:16.877447 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '800fbdf2-d748-4d08-ae3b-c5a4d0401ab1'} Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 could not be found. Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:16.878195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 could not be found. Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 could not be found. Nov 02 13:15:16.879590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:15:16.883640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] Returning 404 to user: Instance 800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:16.891185 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-31340d0e-a797-4dd8-a61a-c21dda33503a tempest-LiveMigrationNegativeTest-789566103 tempest-LiveMigrationNegativeTest-789566103-project] 10.222.0.113 "GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1" status: 404 len: 111 microversion: 2.1 time: 0.054938 Nov 02 13:15:16.891185 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 265/577] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:16 2022] GET /compute/v2.1/servers/800fbdf2-d748-4d08-ae3b-c5a4d0401ab1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:15:16.896834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de1a8e8f-c57e-40de-a85c-a40deaa9c884 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:16.903484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de1a8e8f-c57e-40de-a85c-a40deaa9c884 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.903853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de1a8e8f-c57e-40de-a85c-a40deaa9c884 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.904965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de1a8e8f-c57e-40de-a85c-a40deaa9c884 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.905928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de1a8e8f-c57e-40de-a85c-a40deaa9c884 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.906536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de1a8e8f-c57e-40de-a85c-a40deaa9c884 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.907128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de1a8e8f-c57e-40de-a85c-a40deaa9c884 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.940276 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de1a8e8f-c57e-40de-a85c-a40deaa9c884 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.048423 Nov 02 13:15:16.941168 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 266/578] 10.222.0.113 () {58 vars in 1175 bytes} [Wed Nov 2 13:15:16 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:16.947399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:16.948263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:16.958272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.959351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.959991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.960881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:16.961485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:16.962063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:16.979621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:16.991896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bae3db17-50f8-4e03-8423-93cdab06599a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1315 microversion: 2.1 time: 0.276696 Nov 02 13:15:17.007908 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 313/579] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:16 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:17.013198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.015955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:17.027527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.028392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.029055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.029989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.030654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.031343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.109259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:17.126106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:17.130003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:17.144427 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-18767d55-9327-4a7b-9068-3ae10239b911 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.201767 Nov 02 13:15:17.148062 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 267/580] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:16 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:17.153060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:17.158013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b592a51-e156-4193-b5fa-1f6a9237bb2b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.170119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:17.170421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b592a51-e156-4193-b5fa-1f6a9237bb2b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.171105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b592a51-e156-4193-b5fa-1f6a9237bb2b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.172619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b592a51-e156-4193-b5fa-1f6a9237bb2b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.173342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:17.173589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b592a51-e156-4193-b5fa-1f6a9237bb2b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.174054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b592a51-e156-4193-b5fa-1f6a9237bb2b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.174488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b592a51-e156-4193-b5fa-1f6a9237bb2b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.175543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6d06b2f2-54ad-4f52-9275-f26ac6698918 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1324 microversion: 2.25 time: 0.172955 Nov 02 13:15:17.176255 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 314/581] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1324 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:17.206175 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b592a51-e156-4193-b5fa-1f6a9237bb2b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.056898 Nov 02 13:15:17.207149 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 268/582] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/os-services => generated 949 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:17.221743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e04ff00-9ff8-45f4-aa95-36c1c0de1b7b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.225731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e04ff00-9ff8-45f4-aa95-36c1c0de1b7b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.226446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e04ff00-9ff8-45f4-aa95-36c1c0de1b7b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.227066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e04ff00-9ff8-45f4-aa95-36c1c0de1b7b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.228269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e04ff00-9ff8-45f4-aa95-36c1c0de1b7b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.228899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e04ff00-9ff8-45f4-aa95-36c1c0de1b7b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.229329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e04ff00-9ff8-45f4-aa95-36c1c0de1b7b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.261014 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e04ff00-9ff8-45f4-aa95-36c1c0de1b7b tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?host=n-d-858384-19&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.042562 Nov 02 13:15:17.262076 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 315/583] 10.222.0.113 () {58 vars in 1201 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/os-services?host=n-d-858384-19&binary=xxx => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:15:17.276323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a65997e-0cd7-4f97-a5b6-fe2353b8368c tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.280866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a65997e-0cd7-4f97-a5b6-fe2353b8368c tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.281543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a65997e-0cd7-4f97-a5b6-fe2353b8368c tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.282270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a65997e-0cd7-4f97-a5b6-fe2353b8368c tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.283712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a65997e-0cd7-4f97-a5b6-fe2353b8368c tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.284185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a65997e-0cd7-4f97-a5b6-fe2353b8368c tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.284589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a65997e-0cd7-4f97-a5b6-fe2353b8368c tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.330352 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a65997e-0cd7-4f97-a5b6-fe2353b8368c tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.060263 Nov 02 13:15:17.331555 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 269/584] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/os-services => generated 949 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:17.350303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2ad0d0f-20e9-447d-b4d3-7a2958bd39f1 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.361252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2ad0d0f-20e9-447d-b4d3-7a2958bd39f1 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.361728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2ad0d0f-20e9-447d-b4d3-7a2958bd39f1 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.362600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2ad0d0f-20e9-447d-b4d3-7a2958bd39f1 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.363528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2ad0d0f-20e9-447d-b4d3-7a2958bd39f1 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.363813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2ad0d0f-20e9-447d-b4d3-7a2958bd39f1 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.366037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2ad0d0f-20e9-447d-b4d3-7a2958bd39f1 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.411400 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2ad0d0f-20e9-447d-b4d3-7a2958bd39f1 tempest-ServicesAdminNegativeTestJSON-722984124 tempest-ServicesAdminNegativeTestJSON-722984124-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.070678 Nov 02 13:15:17.412584 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 316/585] 10.222.0.113 () {58 vars in 1203 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:15:17.434468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-544a1b50-8893-4b7f-8082-53f7ed5cab6f req-997d21de-bb76-4fdb-b7ef-de2d8bb1e6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd2a3ab-5b0a-47ad-8467-33b0414c55e1", "tag": "2d1f66ee-e441-44c4-a485-ad6f31eded50"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:17.452513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-544a1b50-8893-4b7f-8082-53f7ed5cab6f req-997d21de-bb76-4fdb-b7ef-de2d8bb1e6ef service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.454551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-544a1b50-8893-4b7f-8082-53f7ed5cab6f req-997d21de-bb76-4fdb-b7ef-de2d8bb1e6ef service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.455315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-544a1b50-8893-4b7f-8082-53f7ed5cab6f req-997d21de-bb76-4fdb-b7ef-de2d8bb1e6ef service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.499537 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-544a1b50-8893-4b7f-8082-53f7ed5cab6f req-997d21de-bb76-4fdb-b7ef-de2d8bb1e6ef service nova] Creating event network-changed:2d1f66ee-e441-44c4-a485-ad6f31eded50 for instance 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 on n-h1-858384-19 Nov 02 13:15:17.519518 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-544a1b50-8893-4b7f-8082-53f7ed5cab6f req-997d21de-bb76-4fdb-b7ef-de2d8bb1e6ef service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118752 Nov 02 13:15:17.522585 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 270/586] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:17.665921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1b0ca85-6d52-41c6-b1e3-656f08bb4a8a tempest-ServicesAdminNegativeTestJSON-1075547183 tempest-ServicesAdminNegativeTestJSON-1075547183-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.668017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.669046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:17.673975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c1b0ca85-6d52-41c6-b1e3-656f08bb4a8a tempest-ServicesAdminNegativeTestJSON-1075547183 tempest-ServicesAdminNegativeTestJSON-1075547183-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '90a4e507cb9443b69d61e864b3c4f77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4454d1a70d43dcac15f91614c03438', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1b0ca85-6d52-41c6-b1e3-656f08bb4a8a tempest-ServicesAdminNegativeTestJSON-1075547183 tempest-ServicesAdminNegativeTestJSON-1075547183-project] Request method failure captured: Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1iZX7Jw1hJii7sIJUSfQddKJMgt7BIQR7wEYCn4l7NuH9ASvLhpDyrAYfJBIANCox5B8GjpR9F3y3NMqjbBPQ3EM7E5QAeEZoyXjLwCzG3rYxdO0nnFcCJ6yqt-Szqnm---tou3i_ktfoVIbhv92AUq4_VZ3n3wIYBtEt6ndn9r9c Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: be4454d1a70d43dcac15f91614c03438 Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1075547183 Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:15:17.677416 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/be4454d1a70d43dcac15f91614c03438"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/be4454d1a70d43dcac15f91614c03438"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_be4454d1a70d43dcac15f91614c03438"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/be4454d1a70d43dcac15f91614c03438"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1075547183 Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: be4454d1a70d43dcac15f91614c03438 Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1075547183 Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServicesAdminNegativeTestJSON-1075547183-project Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 90a4e507cb9443b69d61e864b3c4f77a Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1075547183-project Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:15:17.678737 n-d-858384-19 devstack@n-api.service[120928]: action_args: {} Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:15:17.679588 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:15:17.681577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:17.683023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1b0ca85-6d52-41c6-b1e3-656f08bb4a8a tempest-ServicesAdminNegativeTestJSON-1075547183 tempest-ServicesAdminNegativeTestJSON-1075547183-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:17.683023 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1b0ca85-6d52-41c6-b1e3-656f08bb4a8a tempest-ServicesAdminNegativeTestJSON-1075547183 tempest-ServicesAdminNegativeTestJSON-1075547183-project] 10.222.0.113 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.259213 Nov 02 13:15:17.688896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.689390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.689818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.690546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.690991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.691297 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 317/587] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/os-services => generated 112 bytes in 270 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:15:17.691937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.736016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.736588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:17.748381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.749412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.750064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.751806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.752613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.753260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.902480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:17.911696 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87ea7cbc-61cb-46d8-a236-15d5922d46c9 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1279 microversion: 2.1 time: 0.180098 Nov 02 13:15:17.912830 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 318/588] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1279 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:17.918488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:17.919471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:17.926384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.927077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.927713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:17.928834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:17.929636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:17.930291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.253753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.264150 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4023d276-cf56-4613-bd06-c96f5b2579b1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.610309 Nov 02 13:15:18.273972 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 271/589] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:18.280672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:18.281469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:18.287328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:18.301980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.302479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.307034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.307993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.308478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.308916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.562702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.571008 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0f913415-be1f-4f27-9def-85a9bce5bc5f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.656977 Nov 02 13:15:18.587865 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 319/590] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:17 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:18.593956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:18.594565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:18.602154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.602643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.604141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.604985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.606280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.606789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.690798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.700097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.702138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.707385 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3d81e079-f6eb-4db8-9172-04597a94d214 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.117453 Nov 02 13:15:18.726709 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 320/591] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:18 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:18.726709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:18.726709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:18.726709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.727288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.727288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.727288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.727288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.727586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.907511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.919569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.922022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.923781 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-862b267d-4432-45e3-83d2-75c5bc955697 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.213625 Nov 02 13:15:18.928027 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 321/592] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:18 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:18.935255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-56a41a81-1730-47ae-b5ce-4f31fa16db08 req-6447a71c-ae08-41be-b62d-476eb10f26b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbd976e-6935-43e4-b29b-767d119733f8", "name": "network-vif-plugged", "status": "completed", "tag": "613e5fac-e26d-4c56-84b7-c232722f889f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:18.939410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:18.949067 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e0471630-9625-476f-b38c-1006a0533abb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1315 microversion: 2.1 time: 0.672373 Nov 02 13:15:18.951736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-56a41a81-1730-47ae-b5ce-4f31fa16db08 req-6447a71c-ae08-41be-b62d-476eb10f26b1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.952507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-56a41a81-1730-47ae-b5ce-4f31fa16db08 req-6447a71c-ae08-41be-b62d-476eb10f26b1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.953380 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 272/593] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:18 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:18.953508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-56a41a81-1730-47ae-b5ce-4f31fa16db08 req-6447a71c-ae08-41be-b62d-476eb10f26b1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.968967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:18.971005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:18.972955 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-56a41a81-1730-47ae-b5ce-4f31fa16db08 req-6447a71c-ae08-41be-b62d-476eb10f26b1 service nova] Creating event network-vif-plugged:613e5fac-e26d-4c56-84b7-c232722f889f for instance 4fbd976e-6935-43e4-b29b-767d119733f8 on n-h2-858384-19 Nov 02 13:15:18.978957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.979709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.980498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:18.980669 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-56a41a81-1730-47ae-b5ce-4f31fa16db08 req-6447a71c-ae08-41be-b62d-476eb10f26b1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050493 Nov 02 13:15:18.981620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:18.981787 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 322/594] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:18.982428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:18.982913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.300184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:19.300846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:19.310597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.311169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.311623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.312393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.312999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.313490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.446595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:19.459967 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dcb49547-be4a-49f3-8c53-4ead09b2b593 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1285 microversion: 2.1 time: 0.504057 Nov 02 13:15:19.461286 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 273/595] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:18 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1285 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:19.560869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-0397861e-a66a-4ea2-b240-6665f54cedbd req-bfdc4f59-7398-4ba0-83a9-c5443cb08051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b1c802-d2e4-4c0b-841a-f0baba14e1a0", "tag": "0d829b33-7204-477e-a57b-fb4f3f12903f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:19.572497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0397861e-a66a-4ea2-b240-6665f54cedbd req-bfdc4f59-7398-4ba0-83a9-c5443cb08051 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.572981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0397861e-a66a-4ea2-b240-6665f54cedbd req-bfdc4f59-7398-4ba0-83a9-c5443cb08051 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.573941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0397861e-a66a-4ea2-b240-6665f54cedbd req-bfdc4f59-7398-4ba0-83a9-c5443cb08051 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.592150 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-0397861e-a66a-4ea2-b240-6665f54cedbd req-bfdc4f59-7398-4ba0-83a9-c5443cb08051 service nova] Creating event network-changed:0d829b33-7204-477e-a57b-fb4f3f12903f for instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 on n-h1-858384-19 Nov 02 13:15:19.612325 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-0397861e-a66a-4ea2-b240-6665f54cedbd req-bfdc4f59-7398-4ba0-83a9-c5443cb08051 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064851 Nov 02 13:15:19.613219 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 274/596] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:15:19.622289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:19.624021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:19.632552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.633331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.633997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.635028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.635930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.637552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.673441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:19.677326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:19.684367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-145b8624-515c-4d71-aa59-df5f0deda8c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.390345 Nov 02 13:15:19.685705 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 323/597] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:19 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:19.735878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:19.736582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:19.742847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.743511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.744192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.744908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.745368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.746302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.840134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:19.858048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:19.862179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:19.869315 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cb5fe316-41c6-43b5-940b-6f4b037e2c11 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.137800 Nov 02 13:15:19.892462 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 324/598] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:19 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:19.952743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:19.954815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:19.966447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.967315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.968009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:19.969091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:19.969835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:19.970896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:20.038706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:20.054585 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66f3c663-dcd2-45da-9144-8617ae9b5d06 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.438489 Nov 02 13:15:20.076991 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 275/599] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:19 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:20.083955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:20.084591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:20.093744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:20.094260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:20.094878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:20.095775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:20.096354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:20.096790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:20.101604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:20.190616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:20.202053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:20.203827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:20.205069 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9a2506a5-4e7b-4fc0-be72-fcfca64c5e9d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.257097 Nov 02 13:15:20.219859 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 325/600] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:19 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:20.491865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:20.493790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:20.506907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:20.507740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:20.508406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:20.509644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:20.510357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:20.510816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:20.511799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:20.528859 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-004640cb-6bf8-4e7c-8a92-0019e5bf477d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1315 microversion: 2.1 time: 0.450688 Nov 02 13:15:20.530213 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 276/601] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:20 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:20.628807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:20.639376 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2935c68e-430f-4d35-898c-b4cad3818c89 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1285 microversion: 2.1 time: 0.156642 Nov 02 13:15:20.640964 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 326/602] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:20 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:20.709632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:20.710520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:20.717264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:20.718097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:20.718699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:20.719626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:20.720242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:20.720832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.048227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.058373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8a3fd90a-d15d-49e6-9c21-1aa4b60e71ec tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.352638 Nov 02 13:15:21.059443 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 277/603] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:20 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:21.068629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:21.069941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:21.074098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-694755052", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:21.077322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.078062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.078809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.080368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.081226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.082339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.134853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:21.196936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.223023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.224609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.233427 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad21da26-7f46-41d1-acb3-fd5f575ded79 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.171984 Nov 02 13:15:21.234032 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 278/604] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:21 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:21.255260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:21.256236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:21.265438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.266242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.266832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.267749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.268396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.268968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.467068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:21.467068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:21.468245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:21.469747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:21.470511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:21.480995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=84,nova_cell0:UPDATE=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:21.500004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.500520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.500971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.502193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.505348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.505884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.535750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:21.543851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for user e7104fb14f5c430a8bfd7e6aa7ada5ee and project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:21.569369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:21.574725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:21.630357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.641097 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f445b68-8d33-43b6-a274-7f3c30fe4385 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.405237 Nov 02 13:15:21.641430 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 279/605] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:21 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:21.646637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:21.647619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:21.652867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=24 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:21.654975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.655780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.656408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.657710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.658335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.658790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.666263 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7143d8c-0591-4eda-9a4c-2926458d8df4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.824347 Nov 02 13:15:21.673160 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 327/606] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:15:21.679083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:21.679943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:21.686790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.687535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.688315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.689193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.689654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.690084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.917885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.927041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.929153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.930650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:21.939422 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-acccf551-bbf6-4170-b1a7-11e0e3c06663 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.296700 Nov 02 13:15:21.940913 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 280/607] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:21 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:21.941147 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ba6d87d-f07d-48d3-8fa0-2a55e2e90eeb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1315 microversion: 2.1 time: 0.266450 Nov 02 13:15:21.952785 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 328/608] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:21 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:21.955755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6a71f86c-aa2b-4708-80ee-788b88e48afe req-109af9b6-2bda-45d0-b802-ddfb7438d252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e466d0e-a517-440d-a860-46bdb84b883a", "tag": "97246982-73ce-4b56-989e-35e7f8e74360"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:21.961944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:21.963331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:21.971808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6a71f86c-aa2b-4708-80ee-788b88e48afe req-109af9b6-2bda-45d0-b802-ddfb7438d252 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.972564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6a71f86c-aa2b-4708-80ee-788b88e48afe req-109af9b6-2bda-45d0-b802-ddfb7438d252 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.974445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6a71f86c-aa2b-4708-80ee-788b88e48afe req-109af9b6-2bda-45d0-b802-ddfb7438d252 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.987665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.989897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.990557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.992723 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6a71f86c-aa2b-4708-80ee-788b88e48afe req-109af9b6-2bda-45d0-b802-ddfb7438d252 service nova] Creating event network-changed:97246982-73ce-4b56-989e-35e7f8e74360 for instance 0e466d0e-a517-440d-a860-46bdb84b883a on n-h2-858384-19 Nov 02 13:15:21.994535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:21.995253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:21.997630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:21.998677 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6a71f86c-aa2b-4708-80ee-788b88e48afe req-109af9b6-2bda-45d0-b802-ddfb7438d252 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054316 Nov 02 13:15:21.999668 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 281/609] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:22.005013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-61f8c070-f577-4c49-a447-bbb5014c4cc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:22.005722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-61f8c070-f577-4c49-a447-bbb5014c4cc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:22.119414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-61f8c070-f577-4c49-a447-bbb5014c4cc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:22.128371 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-61f8c070-f577-4c49-a447-bbb5014c4cc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1216 microversion: 2.1 time: 0.127351 Nov 02 13:15:22.129405 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 282/610] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:21 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1216 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:22.135724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:22.136479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:22.143377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.144141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.144901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.145776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.146853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.147495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.200635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:22.210946 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b723b00-9355-454f-ac6c-d720a45a352b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.256701 Nov 02 13:15:22.212592 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 329/611] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:21 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:22.264685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:22.265644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:22.269565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:22.274910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.275984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.276990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.278252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.279526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.280689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.369344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:22.381016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:22.383260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:22.389574 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-403bab6a-fe16-4c41-b18c-51f380581f4c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.128908 Nov 02 13:15:22.390418 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 330/612] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:22 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:22.550629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:22.560995 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6037e19e-fe13-4543-a09e-ee926bf3c327 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.430449 Nov 02 13:15:22.561904 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 283/613] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:22 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:22.682604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:22.684038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:22.690869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.691569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.692003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.692696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.693471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.694388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.702405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-718568952", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:22.762783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:22.957688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:22.958115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:22.958589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:22.959054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:22.959519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:22.969832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.970318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.970757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.971525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:22.971979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:22.972465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:22.990911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Getting quotas for project 380ebfa7af2140e88cf0e9b264e5a759. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:22.996904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Getting quotas for user 6b91d6b4a24e4c2e828cef94ddf8f914 and project 380ebfa7af2140e88cf0e9b264e5a759. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:23.010437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:23.012659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:23.062058 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91999b1f-66db-44bc-8991-8648c0cbd59d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.482177 Nov 02 13:15:23.062820 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 331/614] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:15:23.069832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.069832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.075700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.076193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.076630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.077336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.077787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.078252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.246268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.254846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.256420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.257663 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ac2f6a30-cfdb-44e6-93df-5775addc1c7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.193997 Nov 02 13:15:23.258223 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 332/615] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:23.265502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.266455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.280709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.281506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.282062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.282872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.284052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.284717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.373598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.382433 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c96bea37-cdf6-4ce4-93a6-2c5c7f621b10 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.703681 Nov 02 13:15:23.399724 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 284/616] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:22 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:23.406374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-033083d6-a0d0-4fda-8700-c7903dd6c608 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.407425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-033083d6-a0d0-4fda-8700-c7903dd6c608 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.451402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.460379 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-13061f51-88e5-4d8d-95d2-4467035dff7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1497 microversion: 2.1 time: 0.199558 Nov 02 13:15:23.461254 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 333/617] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:23.467612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.468299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.474986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.475705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.476477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.478461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.478940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.479542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.489912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-033083d6-a0d0-4fda-8700-c7903dd6c608 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.499670 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-033083d6-a0d0-4fda-8700-c7903dd6c608 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1220 microversion: 2.1 time: 0.098379 Nov 02 13:15:23.500426 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 285/618] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:23.520785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.521775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.542529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.543568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.544312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.545675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.546432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.547095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.571849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.583161 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efd07d13-3b61-405c-8446-e7d2c1a602d0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1220 microversion: 2.1 time: 0.119863 Nov 02 13:15:23.584069 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 334/619] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:23.606422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.607202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.614261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.614754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.615235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.615932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.616549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.617343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.693573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.703291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.705578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.710737 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00801ca3-46b3-4fb1-b6c2-4c80a0480e63 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.125477 Nov 02 13:15:23.711426 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 335/620] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:23.716618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1331d06d-e5a2-4650-838e-9de7390a1d4d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.717403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1331d06d-e5a2-4650-838e-9de7390a1d4d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.723767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1331d06d-e5a2-4650-838e-9de7390a1d4d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.724070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1331d06d-e5a2-4650-838e-9de7390a1d4d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.724512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1331d06d-e5a2-4650-838e-9de7390a1d4d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.725208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1331d06d-e5a2-4650-838e-9de7390a1d4d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.725664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1331d06d-e5a2-4650-838e-9de7390a1d4d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.726092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1331d06d-e5a2-4650-838e-9de7390a1d4d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.792036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:23.803431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9c32a669-91c5-4e73-ae48-e68fbde961a1 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.287072 Nov 02 13:15:23.804102 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 286/621] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:23.816163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.817710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.825028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.825605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.826124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.826911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.827541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.828154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.861119 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1331d06d-e5a2-4650-838e-9de7390a1d4d tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1650 microversion: 2.1 time: 0.148506 Nov 02 13:15:23.861957 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 336/622] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1650 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:23.885037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c29c5fa3-c668-4a70-b26e-301e276ee0dc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:23.885801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c29c5fa3-c668-4a70-b26e-301e276ee0dc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:23.891925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c29c5fa3-c668-4a70-b26e-301e276ee0dc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.892538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c29c5fa3-c668-4a70-b26e-301e276ee0dc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.892832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c29c5fa3-c668-4a70-b26e-301e276ee0dc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:23.893530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c29c5fa3-c668-4a70-b26e-301e276ee0dc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:23.894143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c29c5fa3-c668-4a70-b26e-301e276ee0dc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:23.894581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c29c5fa3-c668-4a70-b26e-301e276ee0dc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.012135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.020014 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1efbb987-65b7-4088-a3a7-f8defc4750c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.214551 Nov 02 13:15:24.020593 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 287/623] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:24.026402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c29c5fa3-c668-4a70-b26e-301e276ee0dc tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1650 microversion: 2.1 time: 0.145393 Nov 02 13:15:24.027000 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 337/624] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:23 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1650 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:24.048973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-087e4a41-e80c-4dde-aa56-08cf50d4f9a5 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:24.053184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087e4a41-e80c-4dde-aa56-08cf50d4f9a5 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.053700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087e4a41-e80c-4dde-aa56-08cf50d4f9a5 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.054148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087e4a41-e80c-4dde-aa56-08cf50d4f9a5 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.054315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-57665892-9405-4b50-a764-c88bd0f2d7df req-4684a1bd-2a62-4b88-bf3c-eaf82cc347f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d1b37e-3424-465f-9441-82d097890375", "tag": "c8903bc9-0ff4-4e83-878d-a1a96c7496d5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:24.054875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087e4a41-e80c-4dde-aa56-08cf50d4f9a5 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.055428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087e4a41-e80c-4dde-aa56-08cf50d4f9a5 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.056454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087e4a41-e80c-4dde-aa56-08cf50d4f9a5 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.064482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-57665892-9405-4b50-a764-c88bd0f2d7df req-4684a1bd-2a62-4b88-bf3c-eaf82cc347f5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.064973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-57665892-9405-4b50-a764-c88bd0f2d7df req-4684a1bd-2a62-4b88-bf3c-eaf82cc347f5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.068219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-57665892-9405-4b50-a764-c88bd0f2d7df req-4684a1bd-2a62-4b88-bf3c-eaf82cc347f5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.078171 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-57665892-9405-4b50-a764-c88bd0f2d7df req-4684a1bd-2a62-4b88-bf3c-eaf82cc347f5 service nova] Creating event network-changed:c8903bc9-0ff4-4e83-878d-a1a96c7496d5 for instance a3d1b37e-3424-465f-9441-82d097890375 on n-h1-858384-19 Nov 02 13:15:24.080116 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-087e4a41-e80c-4dde-aa56-08cf50d4f9a5 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035007 Nov 02 13:15:24.080726 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 288/625] 10.222.0.113 () {58 vars in 1181 bytes} [Wed Nov 2 13:15:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:24.083077 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-57665892-9405-4b50-a764-c88bd0f2d7df req-4684a1bd-2a62-4b88-bf3c-eaf82cc347f5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032382 Nov 02 13:15:24.083842 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 338/626] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:15:24.092379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf46474f-ff1e-4e6c-8129-0db0d7863c8b tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:24.092908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf46474f-ff1e-4e6c-8129-0db0d7863c8b tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.098913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf46474f-ff1e-4e6c-8129-0db0d7863c8b tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.099435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf46474f-ff1e-4e6c-8129-0db0d7863c8b tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.099871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf46474f-ff1e-4e6c-8129-0db0d7863c8b tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.100556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf46474f-ff1e-4e6c-8129-0db0d7863c8b tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.101006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf46474f-ff1e-4e6c-8129-0db0d7863c8b tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.101430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf46474f-ff1e-4e6c-8129-0db0d7863c8b tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.174809 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf46474f-ff1e-4e6c-8129-0db0d7863c8b tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8/action" status: 202 len: 0 microversion: 2.1 time: 0.085668 Nov 02 13:15:24.176252 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 289/627] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:15:24 2022] POST /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:15:24.184321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6682af31-d4de-44ae-8cd6-90218782509f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:24.185010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6682af31-d4de-44ae-8cd6-90218782509f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.191264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6682af31-d4de-44ae-8cd6-90218782509f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.191749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6682af31-d4de-44ae-8cd6-90218782509f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.192186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6682af31-d4de-44ae-8cd6-90218782509f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.192883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6682af31-d4de-44ae-8cd6-90218782509f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.193342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6682af31-d4de-44ae-8cd6-90218782509f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.193770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6682af31-d4de-44ae-8cd6-90218782509f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.285395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:24.286098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.293600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.294140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.294586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.295362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.295816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.296271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.335160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6682af31-d4de-44ae-8cd6-90218782509f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1655 microversion: 2.1 time: 0.154989 Nov 02 13:15:24.335907 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 339/628] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:24 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:24.406543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:24.407179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.413910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.414399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.415011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.415829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.416269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.416698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.440918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.449929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.451443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.452548 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60dcf10b-9de3-4063-8785-68d0efd3b0b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.171624 Nov 02 13:15:24.453108 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 290/629] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:24 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:15:24.528377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:24.529095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.535099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.535697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.536205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.537112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.537644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.538066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.549079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.557150 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ac09ab9-2d3f-493d-9d54-e6865b119413 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.154754 Nov 02 13:15:24.557826 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 340/630] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:24 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:24.605812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.606092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:24.606772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.613338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.613500 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ad5621c-9f38-4153-9ea6-3f58eab7a70e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1224 microversion: 2.1 time: 0.089840 Nov 02 13:15:24.613954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.614051 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 291/631] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:24 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:24.614395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.615090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.615570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.615986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.681501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.691324 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-76764430-9ae8-4328-ba7e-4ccf4545c724 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1220 microversion: 2.1 time: 0.089229 Nov 02 13:15:24.691915 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 341/632] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:24 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:24.738746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:24.740280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.745998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.746697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.746915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.747649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.748095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.748513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.819736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.827737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:24.828348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:24.830143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.831687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.834505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.834998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.835471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.836188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:24.836993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:24.837705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:24.837906 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-171e03a2-5d1c-4dcf-8446-a12b6dc8688e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.102242 Nov 02 13:15:24.838633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 292/633] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:24 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:24.856487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:24.974833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:24.983539 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-438e2f73-82e8-482c-b55b-d51b3cb7e81d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.159806 Nov 02 13:15:24.984135 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 342/634] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:24 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:25.041931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:25.042535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:25.048338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.048816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.049249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.049976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.050420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.050839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.184086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.193002 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee10bef7-fc38-4233-93f6-2f8ad13384bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.154959 Nov 02 13:15:25.193805 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 293/635] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:25 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:25.358345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-73e118a6-11c2-418f-9617-b23b708a923e tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:25.358982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-73e118a6-11c2-418f-9617-b23b708a923e tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:25.365361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73e118a6-11c2-418f-9617-b23b708a923e tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.365896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73e118a6-11c2-418f-9617-b23b708a923e tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.366334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73e118a6-11c2-418f-9617-b23b708a923e tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.367033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73e118a6-11c2-418f-9617-b23b708a923e tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.367517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73e118a6-11c2-418f-9617-b23b708a923e tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.367944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73e118a6-11c2-418f-9617-b23b708a923e tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.478606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:25.479557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:25.486517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.487006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.487477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.488188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.488641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.489067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.501407 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-73e118a6-11c2-418f-9617-b23b708a923e tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1655 microversion: 2.1 time: 0.146771 Nov 02 13:15:25.502007 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 343/636] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:25 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:25.580880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:25.581572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:25.587814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.588294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.588728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.589421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.589866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.590289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.629375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.639067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.640593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.641720 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c93ec724-6c31-40c1-ad19-f2ee558cccdf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.167853 Nov 02 13:15:25.642281 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 294/637] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:25 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:15:25.647009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:25.647635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:25.654838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.655389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.655826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.656656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.657177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.657650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.662352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:25.733205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.740510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.741726 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8612206f-e3a4-4d6f-88a7-e01a90adbf4a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1224 microversion: 2.1 time: 0.098210 Nov 02 13:15:25.742306 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 295/638] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:25 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:25.752196 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6cf28ce0-c3f2-4510-8bc0-544af8a6258b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.175150 Nov 02 13:15:25.758459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:25.759880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:25.762357 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 344/639] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:25 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:25.766814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.767528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.768315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.768481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.769159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.769348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.836032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.844780 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1311870d-c1ff-4729-a846-e0534971968c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1220 microversion: 2.1 time: 0.096306 Nov 02 13:15:25.845359 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 296/640] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:25 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:25.866584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:25.867412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:25.874216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.874702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.875158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.875859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:25.876313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:25.876807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:25.950149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.958820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.960377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:25.965816 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a27bea33-8ed1-41c4-adda-8293cc680934 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.103537 Nov 02 13:15:25.966398 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 345/641] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:25 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:26.010899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:26.012070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:26.023199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.024066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.024826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.026035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.026862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.027630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.218448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:26.219349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:26.226900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.227454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.228013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.229034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.229728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.230149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.443077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:26.459614 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fccfcca2-7e3a-400f-9dc7-1299d8bc598b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.244900 Nov 02 13:15:26.460656 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 346/642] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:26 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:26.546366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ab4c5133-a865-4b34-bba1-6eb2a86b0720 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:26.547730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ab4c5133-a865-4b34-bba1-6eb2a86b0720 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:26.562658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab4c5133-a865-4b34-bba1-6eb2a86b0720 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.563666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab4c5133-a865-4b34-bba1-6eb2a86b0720 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.564297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab4c5133-a865-4b34-bba1-6eb2a86b0720 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.565315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab4c5133-a865-4b34-bba1-6eb2a86b0720 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.565934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab4c5133-a865-4b34-bba1-6eb2a86b0720 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.566702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab4c5133-a865-4b34-bba1-6eb2a86b0720 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.723423 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ab4c5133-a865-4b34-bba1-6eb2a86b0720 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1635 microversion: 2.1 time: 0.196048 Nov 02 13:15:26.724280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 347/643] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:26 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1635 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:26.730558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:26.731273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:26.739347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.740108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.741495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.742696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.743556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.744830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.797431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:26.808868 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eaa83e91-c768-4a4c-af03-8d6cd7b9a8fb tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.805482 Nov 02 13:15:26.810093 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 297/644] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:26 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:26.825904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-19", "block_migration": true, "disk_over_commit": false}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:26.830903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:26.842638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.843307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.843828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.844689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:26.845326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:26.845893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:26.876395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lazy-loading 'flavor' on Instance uuid 4fbd976e-6935-43e4-b29b-767d119733f8 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:26.891738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Going to try to live migrate instance to n-h1-858384-19 {{(pid=120929) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:15:26.972465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.004397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.005928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.007134 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-278abae1-c819-4aec-aa76-351212c1910b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.281762 Nov 02 13:15:27.007758 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 348/645] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:26 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:27.031031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:27.032171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:27.042336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.043344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.044142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.045173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.051499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.052909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.191698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.217083 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb8e7d8c-0308-490d-92a5-d110b39801bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1272 microversion: 2.1 time: 0.205131 Nov 02 13:15:27.218972 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 349/646] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:27 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:27.234680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:27.236400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:27.256932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.258806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.259770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.262449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.267245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.267245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.682392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.703669 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d00d7912-9b4a-49f0-bbf9-5351ac1e1822 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.482494 Nov 02 13:15:27.704458 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 350/647] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:27 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:27.734312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:27.734927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:27.742498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.743443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.744233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.745857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.746565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.747030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.839213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.860888 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf2825b9-6d1d-46ec-b8b8-5a784f22858e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1268 microversion: 2.1 time: 0.130318 Nov 02 13:15:27.862036 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 351/648] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:27 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:27.867067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:27.867837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:27.877497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.877981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.878424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.879166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.879622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.880049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.953976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.963952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.965667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:27.971218 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8fd7b2a-5134-4a14-9402-fc51d73f592b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.108078 Nov 02 13:15:27.972013 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 352/649] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:27 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:27.976544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:27.977390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:27.984230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.984708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.985138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:27.985971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:27.986428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:27.986854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:28.291554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:28.302533 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-279dea97-de7d-4bc4-af7d-8dd9052c0161 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.329549 Nov 02 13:15:28.303146 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 353/650] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:27 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:28.308386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-29053891-da2c-477e-aa52-d7d13c1e9196 req-73ee2115-dd23-490b-8a99-446240cde659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd2a3ab-5b0a-47ad-8467-33b0414c55e1", "name": "network-vif-plugged", "status": "completed", "tag": "2d1f66ee-e441-44c4-a485-ad6f31eded50"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:28.328785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-29053891-da2c-477e-aa52-d7d13c1e9196 req-73ee2115-dd23-490b-8a99-446240cde659 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:28.330036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-29053891-da2c-477e-aa52-d7d13c1e9196 req-73ee2115-dd23-490b-8a99-446240cde659 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:28.330482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-29053891-da2c-477e-aa52-d7d13c1e9196 req-73ee2115-dd23-490b-8a99-446240cde659 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:28.342860 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-29053891-da2c-477e-aa52-d7d13c1e9196 req-73ee2115-dd23-490b-8a99-446240cde659 service nova] Creating event network-vif-plugged:2d1f66ee-e441-44c4-a485-ad6f31eded50 for instance 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 on n-h1-858384-19 Nov 02 13:15:28.349289 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-29053891-da2c-477e-aa52-d7d13c1e9196 req-73ee2115-dd23-490b-8a99-446240cde659 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044796 Nov 02 13:15:28.350314 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 354/651] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:28.356754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:28.357525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:28.364539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:28.365041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:28.365491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:28.366174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:28.366632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:28.367063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:28.712456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:28.730075 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35eddeab-db4d-4b00-9a2f-0acff0c0fe68 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.378089 Nov 02 13:15:28.733445 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 355/652] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:28 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:28.742232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:28.746808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:28.756403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:28.757448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:28.758212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:28.760266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:28.761235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:28.762075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.137690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.160296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.161324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.162493 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-394a3e96-4e42-4ece-a5fb-b82a244771fc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.427059 Nov 02 13:15:29.163818 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 356/653] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:28 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:29.167830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:29.168443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:29.174464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.175241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.175644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.176123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.176575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.177006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.297992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.308197 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-30510210-8546-40b5-bbc6-cd9a99d8b240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1278 microversion: 2.1 time: 0.143062 Nov 02 13:15:29.311529 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 357/654] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:29 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:29.327309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:29.327961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:29.340758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.343860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.344546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.345301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.345840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.346280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.619525 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40defa20-e1b1-418f-95d7-a1185ef6193f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8/action" status: 202 len: 0 microversion: 2.1 time: 2.806107 Nov 02 13:15:29.620263 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 298/655] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:15:26 2022] POST /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8/action => generated 0 bytes in 2809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:15:29.625519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:29.626160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:29.642201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.642888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.643577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.645292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.646051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.646744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.737069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.756433 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-775d11a1-44ec-449a-989f-fcb91498137c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1274 microversion: 2.1 time: 0.134879 Nov 02 13:15:29.760783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.779911 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c2fa80b2-a1e8-4018-bd9d-f603a5c324dc tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.465765 Nov 02 13:15:29.782391 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 299/656] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:29 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:29.791944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:29.793530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:29.795624 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 358/657] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:29 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:29.802560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:29.803218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:29.822868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.823379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.825055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.825745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.826345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.827277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.827890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.828120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.828646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.828899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:29.829386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:29.829828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:29.955792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.968781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.972961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:29.989879 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a9f0a05a-6cab-41f8-9cb4-0dacc36f2651 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.205881 Nov 02 13:15:30.003364 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 300/658] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:29 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:30.017071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:30.018350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:30.030752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.031303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.031762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.033200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.034112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.034112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.248723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:30.259828 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7bb31d8e-118e-487c-911a-a08cff73bb07 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.251588 Nov 02 13:15:30.278624 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 301/659] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:30 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:30.284975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:30.285599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:30.293007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.293663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.294117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.295154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.295914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.296684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.520364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:30.536789 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b53f2d6f-6e45-47e1-9a01-d493192d37e8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.255871 Nov 02 13:15:30.538030 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 302/660] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:30 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:30.544201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:30.547468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:30.561876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.562644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.563367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.564208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.564768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.565465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.595838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:30.603620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:30.606843 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5715928e-ae88-4d8c-a9f2-f98d5639c649 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.809981 Nov 02 13:15:30.607524 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 359/661] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:29 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:30.634692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:30.635616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:30.656207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.656736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.657141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.657888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.660104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.663012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.771846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:30.785913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:30.788400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:30.797876 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9105c72a-21b5-4d50-9f49-624ce9047012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.258469 Nov 02 13:15:30.799179 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 303/662] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:30 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:30.804772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-91b5eede-7204-4451-8ea0-d84824e90cca req-03e1e0df-797e-4466-bc8f-201385b90a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b1c802-d2e4-4c0b-841a-f0baba14e1a0", "name": "network-vif-plugged", "status": "completed", "tag": "0d829b33-7204-477e-a57b-fb4f3f12903f"}, {"server_uuid": "0e466d0e-a517-440d-a860-46bdb84b883a", "name": "network-vif-plugged", "status": "completed", "tag": "97246982-73ce-4b56-989e-35e7f8e74360"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:30.833687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-91b5eede-7204-4451-8ea0-d84824e90cca req-03e1e0df-797e-4466-bc8f-201385b90a98 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.834183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-91b5eede-7204-4451-8ea0-d84824e90cca req-03e1e0df-797e-4466-bc8f-201385b90a98 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.834806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-91b5eede-7204-4451-8ea0-d84824e90cca req-03e1e0df-797e-4466-bc8f-201385b90a98 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.849823 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-91b5eede-7204-4451-8ea0-d84824e90cca req-03e1e0df-797e-4466-bc8f-201385b90a98 service nova] Creating event network-vif-plugged:0d829b33-7204-477e-a57b-fb4f3f12903f for instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 on n-h1-858384-19 Nov 02 13:15:30.850478 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-91b5eede-7204-4451-8ea0-d84824e90cca req-03e1e0df-797e-4466-bc8f-201385b90a98 service nova] Creating event network-vif-plugged:97246982-73ce-4b56-989e-35e7f8e74360 for instance 0e466d0e-a517-440d-a860-46bdb84b883a on n-h2-858384-19 Nov 02 13:15:30.865214 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-91b5eede-7204-4451-8ea0-d84824e90cca req-03e1e0df-797e-4466-bc8f-201385b90a98 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064615 Nov 02 13:15:30.866612 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 304/663] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:30.874194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:30.874970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:30.881388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.881953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.882479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:30.883279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:30.884083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:30.884791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.033266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:31.046791 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-403dbfa4-3e21-4f79-9df3-8996accde749 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1320 microversion: 2.1 time: 0.424381 Nov 02 13:15:31.046791 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 360/664] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:30 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1320 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:31.075896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:31.076543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:31.090709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.092735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.094411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.097382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.098129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.101908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.104813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:31.113455 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2bd25389-db6c-46d3-b37d-671bcdedc14f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.245393 Nov 02 13:15:31.153568 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 305/665] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:30 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:31.159416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:31.160036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:31.176729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.177235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.180914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.181683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.182165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.182609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.269763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:31.283037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:31.285505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:31.290370 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e6b83f8-8d9d-48f1-b510-66fe6eec2520 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.135395 Nov 02 13:15:31.316245 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 306/666] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:31 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:31.322274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:31.331216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:31.338410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.338897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.339428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.340216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.340730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.341161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.425575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:31.443787 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-840a64d8-8a45-4acd-b60b-6d1455256124 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.396230 Nov 02 13:15:31.459710 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 361/667] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:31 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:31.546733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:31.564972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:31.566250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:31.569479 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fa1eb7e3-8d91-4b94-b0d2-0e4e5e9fdc15 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.240518 Nov 02 13:15:31.570147 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 307/668] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:31 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:31.575391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.575891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.576337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.577047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.577537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.578216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.640024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:31.640689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:31.646604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.647082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.647536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.648246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.648737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.650132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.815656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:31.825435 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16da840a-18f1-4860-9e1a-d821b2f737cc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.191605 Nov 02 13:15:31.826303 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 308/669] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:31 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:31.833254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:31.834336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:31.841625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.842384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.843155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.844172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:31.844798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:31.845289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:31.902564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:31.920673 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10a009ff-02c3-4cb1-93f2-8506a26fce2c tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.361537 Nov 02 13:15:31.921611 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 362/670] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:31 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:32.030717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:32.045559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:32.053977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:32.055357 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-67ea7726-b02b-42d5-bd0c-8e9fbc4b8379 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1366 microversion: 2.25 time: 0.227836 Nov 02 13:15:32.056740 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 309/671] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:31 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:32.074844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:32.076212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:32.086691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.090473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.091055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.091940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.092535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.095772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.162918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:32.163684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:32.173222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.173747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.174182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.174894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.175370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.175803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.200401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:32.406674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:32.416363 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4aff06aa-3814-4fe3-a7d7-8170b08d3527 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.260521 Nov 02 13:15:32.416954 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 310/672] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:32 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:32.421543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:32.422156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:32.428288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.428775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.429223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.429909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.430243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:32.430994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.431493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.449095 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f368a9c7-0f99-4c6c-ad6f-8998dc54a3d8 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1320 microversion: 2.1 time: 0.379715 Nov 02 13:15:32.450056 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 363/673] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:32 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:32.454824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b40eca71-7f12-4b9b-ac6f-06216522c627 req-f5beabe7-b50c-4c74-ab1c-01c001b4c488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e08b0c-8192-434f-bcad-97df4f95e59c", "tag": "25d7d239-84c0-46c5-a2d2-300eba783012"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:32.489466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b40eca71-7f12-4b9b-ac6f-06216522c627 req-f5beabe7-b50c-4c74-ab1c-01c001b4c488 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.489962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b40eca71-7f12-4b9b-ac6f-06216522c627 req-f5beabe7-b50c-4c74-ab1c-01c001b4c488 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.490402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b40eca71-7f12-4b9b-ac6f-06216522c627 req-f5beabe7-b50c-4c74-ab1c-01c001b4c488 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.526597 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b40eca71-7f12-4b9b-ac6f-06216522c627 req-f5beabe7-b50c-4c74-ab1c-01c001b4c488 service nova] Creating event network-changed:25d7d239-84c0-46c5-a2d2-300eba783012 for instance 47e08b0c-8192-434f-bcad-97df4f95e59c on n-h2-858384-19 Nov 02 13:15:32.532143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b40eca71-7f12-4b9b-ac6f-06216522c627 req-f5beabe7-b50c-4c74-ab1c-01c001b4c488 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080573 Nov 02 13:15:32.532844 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 364/674] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:32.536203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:32.539415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:32.541160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:32.547742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.548479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.549098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.549994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.550609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.551241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.553422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:32.556233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:32.572111 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe651715-9842-4b29-99ff-8f97651ad013 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.153384 Nov 02 13:15:32.588589 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 311/675] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:32 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:32.607339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:32.608117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:32.619782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.620696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.621244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.622081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:32.622941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:32.623226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:32.955582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:32.966073 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-54d651f8-14db-4b68-822e-90c4c01d137f tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.431506 Nov 02 13:15:32.966694 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 365/676] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:32 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:32.975438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:32.976057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:33.000586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=25 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:33.002502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.003273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.003891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.004900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.005528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.006137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.007727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=11 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:33.301787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:33.310808 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dff8593c-c01a-4f11-8bf4-667b2f6429a8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.718468 Nov 02 13:15:33.329718 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 312/677] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:32 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:33.329718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:33.329718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:33.330716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:33.345044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.346428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.348266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.349817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.351727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.353777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.494335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:33.494950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:33.505844 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7e482d1-e12b-40eb-b6d3-0c2ef118641d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1320 microversion: 2.1 time: 0.538055 Nov 02 13:15:33.510644 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 366/678] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:32 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1320 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:33.534699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:33.535791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:33.553014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.556491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.560045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.561179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.563881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.564558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.626462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:33.637013 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c4d5eb7-6e79-4a6e-a38f-cd24e2a8f8e3 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.321563 Nov 02 13:15:33.637620 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 313/679] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:33 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:33.652560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:33.658905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:33.668927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.673040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.675106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.677262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.678116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.679697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.905907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:33.914295 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-388a33ae-19c8-4acc-8c63-9d9008c963ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.275509 Nov 02 13:15:33.928087 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 314/680] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:33 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:33.938217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:33.939242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:33.948524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.949259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.949904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.950845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:33.951641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:33.952284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:33.981517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:33.998688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:34.000297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:34.001484 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efa09f46-4fda-4439-867c-1df6b1165b06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1563 microversion: 2.25 time: 0.489470 Nov 02 13:15:34.007231 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 367/681] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:33 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1563 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:34.029128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:34.030049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:34.046900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.047741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.048376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.049994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.052905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.053553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.062264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=14 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:34.172876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:34.185977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:34.187516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:34.190442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:34.193259 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b4181573-1aef-4971-bd7b-5cbb75201ef0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.184777 Nov 02 13:15:34.203148 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 368/682] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:34 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:34.203148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:34.203148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:34.211143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.211143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.211143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.211143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.212152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.212152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.221186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:34.223605 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cd2b0097-7c5f-45c3-91a5-64ff49f3a38f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1320 microversion: 2.1 time: 0.289415 Nov 02 13:15:34.241791 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 315/683] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:33 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:34.250488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:34.251138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:34.260545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.261134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.261584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.266187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.266713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.267197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.379750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:34.389299 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-07570ddb-be4f-4c80-aeae-3a642343e99b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.194400 Nov 02 13:15:34.390082 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 369/684] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:34 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:34.395077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:34.395707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:34.403308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.403802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.404250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.404958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.405414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.405845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.473981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 0e466d0e-a517-440d-a860-46bdb84b883a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:34.489114 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-71f13fc9-f5c4-43b3-8cf1-4f6db00dc129 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 2058 microversion: 2.25 time: 0.246790 Nov 02 13:15:34.489967 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 316/685] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:34 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 2058 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:34.518471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:34.519020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:34.528540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.529137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.530048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.530851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.531539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.532127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.580084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:34.591827 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de532bec-7554-4667-a7a4-e29e7df5578a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.200315 Nov 02 13:15:34.592419 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 370/686] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:34 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:34.603591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:34.603591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:34.604658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.605149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.605591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.606296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.606751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.607210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.714026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 0e466d0e-a517-440d-a860-46bdb84b883a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:34.729911 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-861c7654-7154-423e-8b51-684de36ebd3e tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 2058 microversion: 2.25 time: 0.217380 Nov 02 13:15:34.730440 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 317/687] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:34 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 2058 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:34.736598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-528cce37-304b-44e9-94f1-683884d31090 req-300dcecc-8b94-4bd7-8cc9-88d2f303a85b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4", "tag": "23b3c7e1-ffaf-4afb-81a2-cf840371d46f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:34.747620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-528cce37-304b-44e9-94f1-683884d31090 req-300dcecc-8b94-4bd7-8cc9-88d2f303a85b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.748093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-528cce37-304b-44e9-94f1-683884d31090 req-300dcecc-8b94-4bd7-8cc9-88d2f303a85b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.748533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-528cce37-304b-44e9-94f1-683884d31090 req-300dcecc-8b94-4bd7-8cc9-88d2f303a85b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.767046 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-528cce37-304b-44e9-94f1-683884d31090 req-300dcecc-8b94-4bd7-8cc9-88d2f303a85b service nova] Creating event network-changed:23b3c7e1-ffaf-4afb-81a2-cf840371d46f for instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 on n-h2-858384-19 Nov 02 13:15:34.790883 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-528cce37-304b-44e9-94f1-683884d31090 req-300dcecc-8b94-4bd7-8cc9-88d2f303a85b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058500 Nov 02 13:15:34.791577 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 318/688] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:34.797165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:34.797919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:34.804712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.805750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.806241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.807001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.808040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.808319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.823387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:34.833312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9b737394-ff73-4a75-8ce4-6170f557e101 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1470 microversion: 2.1 time: 0.239836 Nov 02 13:15:34.833921 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 371/689] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:34 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:34.839519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-052c7e36-d36e-4443-881e-4aff62a586f6 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:34.848633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-052c7e36-d36e-4443-881e-4aff62a586f6 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.854313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-052c7e36-d36e-4443-881e-4aff62a586f6 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.855239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-052c7e36-d36e-4443-881e-4aff62a586f6 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.856309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-052c7e36-d36e-4443-881e-4aff62a586f6 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:34.856992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-052c7e36-d36e-4443-881e-4aff62a586f6 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:34.857643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-052c7e36-d36e-4443-881e-4aff62a586f6 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:34.889903 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-052c7e36-d36e-4443-881e-4aff62a586f6 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.054641 Nov 02 13:15:34.890965 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 372/690] 10.222.0.113 () {60 vars in 1222 bytes} [Wed Nov 2 13:15:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:15:35.005668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:35.015456 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2779ff0d-12a4-4c21-ad84-d3bed8524a2d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.222714 Nov 02 13:15:35.033727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e44f9d64-3a11-4ba7-8aba-62cb81968d6d tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:35.033727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e44f9d64-3a11-4ba7-8aba-62cb81968d6d tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:35.034434 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 319/691] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:34 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:35.040253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14003a79-27a3-404f-ab62-65c10acf0a8d tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:35.041149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-14003a79-27a3-404f-ab62-65c10acf0a8d tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:35.045349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44f9d64-3a11-4ba7-8aba-62cb81968d6d tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.045846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44f9d64-3a11-4ba7-8aba-62cb81968d6d tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.046290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44f9d64-3a11-4ba7-8aba-62cb81968d6d tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.047006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44f9d64-3a11-4ba7-8aba-62cb81968d6d tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.048610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14003a79-27a3-404f-ab62-65c10acf0a8d tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.049187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44f9d64-3a11-4ba7-8aba-62cb81968d6d tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.049554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14003a79-27a3-404f-ab62-65c10acf0a8d tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.049674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44f9d64-3a11-4ba7-8aba-62cb81968d6d tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.050321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14003a79-27a3-404f-ab62-65c10acf0a8d tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.051324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14003a79-27a3-404f-ab62-65c10acf0a8d tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.051983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14003a79-27a3-404f-ab62-65c10acf0a8d tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.052733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14003a79-27a3-404f-ab62-65c10acf0a8d tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.161414 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-14003a79-27a3-404f-ab62-65c10acf0a8d tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a/action" status: 202 len: 0 microversion: 2.25 time: 0.125134 Nov 02 13:15:35.163062 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 320/692] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:15:35 2022] POST /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:15:35.169814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:35.170618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:35.177696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.178261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.178762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.179838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.180767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.181276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.497780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:35.511035 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f96154d1-a650-4014-9ae7-d8fbef8365af tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.343892 Nov 02 13:15:35.513511 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 321/693] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:35 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:35.521636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:35.522377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:35.527449 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e44f9d64-3a11-4ba7-8aba-62cb81968d6d tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1623 microversion: 2.1 time: 0.634710 Nov 02 13:15:35.538206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.539082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.540506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.541260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.542165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.542606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.545687 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 373/694] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:34 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1623 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:35.578004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:35.578655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:35.585500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.586228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.588510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.589429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.592581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.593286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.685436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:35.707136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 0e466d0e-a517-440d-a860-46bdb84b883a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:35.713542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:35.715167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:35.720797 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-65acb02e-53ba-42c0-b23a-4fdb9e52b93c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.173787 Nov 02 13:15:35.721380 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 374/695] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:35 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:35.726393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:35.728005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:35.734996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.736063 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d81d650c-71f2-460e-a3ca-54a7543593ff tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 2063 microversion: 2.25 time: 0.219193 Nov 02 13:15:35.737167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.738248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.739166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.739787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.740917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.747427 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 322/696] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:35 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 2063 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:35.757933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:35.759415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:35.766952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.767498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.768009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.770450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:35.771385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:35.771898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:35.942620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:35.953066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e84031c8-ca3b-41ab-87a7-398066f28c35 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1320 microversion: 2.1 time: 0.230092 Nov 02 13:15:35.982500 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 375/697] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:35 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:35.995958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0f9111de-d166-455d-8128-ca7e79483fa3 req-1fee2f39-d9cc-4805-b16a-305cc20610eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d1b37e-3424-465f-9441-82d097890375", "name": "network-vif-plugged", "status": "completed", "tag": "c8903bc9-0ff4-4e83-878d-a1a96c7496d5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:36.012165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0f9111de-d166-455d-8128-ca7e79483fa3 req-1fee2f39-d9cc-4805-b16a-305cc20610eb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:36.012937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0f9111de-d166-455d-8128-ca7e79483fa3 req-1fee2f39-d9cc-4805-b16a-305cc20610eb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:36.013562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0f9111de-d166-455d-8128-ca7e79483fa3 req-1fee2f39-d9cc-4805-b16a-305cc20610eb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:36.026349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:36.026913 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0f9111de-d166-455d-8128-ca7e79483fa3 req-1fee2f39-d9cc-4805-b16a-305cc20610eb service nova] Creating event network-vif-plugged:c8903bc9-0ff4-4e83-878d-a1a96c7496d5 for instance a3d1b37e-3424-465f-9441-82d097890375 on n-h1-858384-19 Nov 02 13:15:36.035187 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0f9111de-d166-455d-8128-ca7e79483fa3 req-1fee2f39-d9cc-4805-b16a-305cc20610eb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049133 Nov 02 13:15:36.037341 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17b19eaf-80b7-4d19-837f-3f0ed409fab4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1394 microversion: 2.1 time: 0.282125 Nov 02 13:15:36.038675 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 323/698] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:35 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1394 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:36.046565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a185efad-3977-4a28-844d-925a1d2e7b4c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Action: 'create', calling method: .version_select at 0x7fe787c50af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1330426535", "policies": ["affinity"]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:36.052226 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 376/699] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:36.066643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:36.067653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:36.075489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:36.076297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:36.076918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:36.077805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:36.078423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:36.079015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:36.080569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a185efad-3977-4a28-844d-925a1d2e7b4c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:36.090311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a185efad-3977-4a28-844d-925a1d2e7b4c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:36.177391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a185efad-3977-4a28-844d-925a1d2e7b4c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:36.185885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a185efad-3977-4a28-844d-925a1d2e7b4c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:36.199870 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a185efad-3977-4a28-844d-925a1d2e7b4c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.157733 Nov 02 13:15:36.200468 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 324/700] 10.222.0.113 () {60 vars in 1179 bytes} [Wed Nov 2 13:15:36 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:36.217085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:36.217085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:36.222901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:36.223526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:36.223960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:36.224657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:36.225111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:36.225535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:36.301667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:36.310325 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10c6df4c-e3e8-4c6a-96b4-befacec19359 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.256619 Nov 02 13:15:36.311129 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 377/701] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:36 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:36.387524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-4b7549fe-976e-4a59-84cd-65f04bf913b1 req-2ac91fb8-a52f-46e4-af3b-5b319e9e1d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbd976e-6935-43e4-b29b-767d119733f8", "name": "network-vif-unplugged", "status": "completed", "tag": "613e5fac-e26d-4c56-84b7-c232722f889f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:36.402786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4b7549fe-976e-4a59-84cd-65f04bf913b1 req-2ac91fb8-a52f-46e4-af3b-5b319e9e1d1f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:36.403640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4b7549fe-976e-4a59-84cd-65f04bf913b1 req-2ac91fb8-a52f-46e4-af3b-5b319e9e1d1f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:36.404168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4b7549fe-976e-4a59-84cd-65f04bf913b1 req-2ac91fb8-a52f-46e4-af3b-5b319e9e1d1f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:36.422504 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-4b7549fe-976e-4a59-84cd-65f04bf913b1 req-2ac91fb8-a52f-46e4-af3b-5b319e9e1d1f service nova] Creating event network-vif-unplugged:613e5fac-e26d-4c56-84b7-c232722f889f for instance 4fbd976e-6935-43e4-b29b-767d119733f8 on n-h2-858384-19 Nov 02 13:15:36.438439 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-4b7549fe-976e-4a59-84cd-65f04bf913b1 req-2ac91fb8-a52f-46e4-af3b-5b319e9e1d1f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064915 Nov 02 13:15:36.440717 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 378/702] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:36.447159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1470110981", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "95b78563-8c8c-4291-860a-88720e62eaeb"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:36.521688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:36.653574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:36.667295 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c6401684-6975-432a-a8b7-f1accdd5adc6 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.454904 Nov 02 13:15:36.668488 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 325/703] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:36 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:36.682865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:36.683825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:36.692164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:36.701170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:36.701885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:36.702848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:36.703512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:36.704106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:36.999869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:37.003856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:37.015816 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-76b95de9-9df1-449c-bb7a-44db29a188a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.340600 Nov 02 13:15:37.031923 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 326/704] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:36 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:37.038142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:37.039077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:37.046162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.046843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.047482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.048435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.049047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.049622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.181727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:37.182849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:37.184214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:37.184832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:37.185494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:37.225379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:37.244475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:37.262588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:37.266817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.271750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.272220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.273066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.273518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.275135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.289548 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cb274636-4b0c-444b-8369-3441fb6a790a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.256171 Nov 02 13:15:37.293140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 327/705] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:37 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:37.299951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:37.302327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:37.302874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:37.321892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:37.329264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.329924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.330518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.331563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.332729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.334073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.341307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:37.366091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Going to run 2 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:37.377407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:37.454451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120928) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 13:15:37.499759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:37.514036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:37.574925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:37.580908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:37.586789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 0e466d0e-a517-440d-a860-46bdb84b883a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:37.597254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=c58e31fc-dbb3-440f-a950-6759a10dbee4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:37.608528 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-73059170-16b0-4326-a897-d73381f19565 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 2063 microversion: 2.25 time: 0.313965 Nov 02 13:15:37.609948 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 328/706] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:37 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 2063 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:37.631709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:37.633524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:37.643271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.644686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.645448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.646437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.647227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.647891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.682301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:37.688698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:37.750986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:37.758614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:37.818938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:37.829027 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b8a8e5d-19e1-4742-afe0-500eec282a12 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.387061 Nov 02 13:15:37.832686 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da008cbc-1096-4122-8426-aeec1781c66e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1320 microversion: 2.1 time: 0.221193 Nov 02 13:15:37.833545 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 329/707] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:37 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:37.835947 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 379/708] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:36 2022] POST /compute/v2.1/servers => generated 32 bytes in 1394 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:15:37.841112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:37.841903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:37.847400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:37.848095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:37.848701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.849343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.850753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.851680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.853127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.853866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.866317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.866815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.867289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:37.868184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:37.868684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:37.869251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.052659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:38.077602 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-583e0e46-f9a2-4285-9519-16dc6cd33cf4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1592 microversion: 2.1 time: 0.238684 Nov 02 13:15:38.096141 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 330/709] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:37 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1592 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:38.104178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:38.105589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:38.106391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:38.112599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.113092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.113590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.114234 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-daae2a75-80fc-481f-9b16-7e686c7c40f5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.276364 Nov 02 13:15:38.114410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.114871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.115341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.131099 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 380/710] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:37 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:38.137107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:38.142837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:38.143650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Searching by: {'deleted': False, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:15:38.148272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:38.169065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.169686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.170129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.171246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.172991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.173591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.297125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:15:38.313563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:38.326827 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a086478-5510-46e8-8d4a-1c41ef8e09b8 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1327 microversion: 2.1 time: 0.226784 Nov 02 13:15:38.327746 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 331/711] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:38 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1327 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:38.336386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:38.337427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:38.349327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.349783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.353016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.355245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.355747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.356703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.520395 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-230136d6-b3cd-488f-9c2f-060e2170eece tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.386371 Nov 02 13:15:38.529257 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 381/712] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:15:38 2022] GET /compute/v2.1/servers => generated 1009 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:38.535390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8e8d09b9-7ca7-46a7-b208-e47ac0330629 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:38.535982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8e8d09b9-7ca7-46a7-b208-e47ac0330629 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:38.545843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e8d09b9-7ca7-46a7-b208-e47ac0330629 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.547748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e8d09b9-7ca7-46a7-b208-e47ac0330629 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.548210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e8d09b9-7ca7-46a7-b208-e47ac0330629 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.548937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e8d09b9-7ca7-46a7-b208-e47ac0330629 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.549542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e8d09b9-7ca7-46a7-b208-e47ac0330629 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.549977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e8d09b9-7ca7-46a7-b208-e47ac0330629 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.584446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:38.595682 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a39660c0-20e6-4e68-b084-7676311cac29 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.266572 Nov 02 13:15:38.596862 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 332/713] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:38 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:38.616709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:38.618247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:38.629234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.629980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.634131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.635911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.637556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.638006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.737099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:38.761889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:38.763910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:38.770912 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad9b90b5-eee8-4df1-a320-e74390b58429 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.172815 Nov 02 13:15:38.777485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8e8d09b9-7ca7-46a7-b208-e47ac0330629 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.246835 Nov 02 13:15:38.778787 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 382/714] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:15:38 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:38.785424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-90fca144-e015-405f-b5a9-1e782d0fbd81 req-2d9750db-1740-4b71-b847-8ae72750ae36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fbd976e-6935-43e4-b29b-767d119733f8", "tag": "613e5fac-e26d-4c56-84b7-c232722f889f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:38.788622 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 333/715] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:38 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:38.794505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f06397d5-4314-4947-9abc-4d935a920edc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:38.802893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f06397d5-4314-4947-9abc-4d935a920edc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:38.810990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-90fca144-e015-405f-b5a9-1e782d0fbd81 req-2d9750db-1740-4b71-b847-8ae72750ae36 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.811515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-90fca144-e015-405f-b5a9-1e782d0fbd81 req-2d9750db-1740-4b71-b847-8ae72750ae36 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.816737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-90fca144-e015-405f-b5a9-1e782d0fbd81 req-2d9750db-1740-4b71-b847-8ae72750ae36 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.844322 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-90fca144-e015-405f-b5a9-1e782d0fbd81 req-2d9750db-1740-4b71-b847-8ae72750ae36 service nova] Creating event network-changed:613e5fac-e26d-4c56-84b7-c232722f889f for instance 4fbd976e-6935-43e4-b29b-767d119733f8 on n-h2-858384-19 Nov 02 13:15:38.855598 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-90fca144-e015-405f-b5a9-1e782d0fbd81 req-2d9750db-1740-4b71-b847-8ae72750ae36 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074743 Nov 02 13:15:38.856579 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 383/716] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:38.875921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:38.877068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:38.896957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.899933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.900883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.901672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.902367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.902955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.910283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f06397d5-4314-4947-9abc-4d935a920edc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:38.920209 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f06397d5-4314-4947-9abc-4d935a920edc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1223 microversion: 2.1 time: 0.130310 Nov 02 13:15:38.921621 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 334/717] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:38 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1223 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:38.926833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:38.927768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:38.935500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.936456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.936983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:38.937912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:38.938563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:38.939251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:39.180664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:39.192263 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-acd2d7c6-38b5-465e-a351-0c42c6c1fe5e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1320 microversion: 2.1 time: 0.266089 Nov 02 13:15:39.192870 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 335/718] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:38 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:39.211930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:39.212984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:39.222854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:39.224645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:39.225349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:39.229593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:39.231518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:39.232230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:39.307406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 0e466d0e-a517-440d-a860-46bdb84b883a {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:39.334474 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c03f285-9d91-41b5-9676-eaa1784083e3 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 2043 microversion: 2.25 time: 0.476095 Nov 02 13:15:39.343435 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 384/719] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:38 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 2043 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:39.363513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:39.364791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:39.389714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:39.391404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:39.392428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:39.394939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:39.395566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:39.397816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:39.470155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:39.481236 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d285fc0-7cfb-4486-ac3e-ee0030145085 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.287331 Nov 02 13:15:39.482041 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 336/720] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:39 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:39.486897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-19", "block_migration": "auto"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:39.489539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:39.497119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:39.497614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:39.498060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:39.498771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:39.499405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:39.499833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:39.553914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'flavor' on Instance uuid 0e466d0e-a517-440d-a860-46bdb84b883a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:39.587000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Going to try to live migrate instance to n-h1-858384-19 {{(pid=120929) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:15:39.814149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:39.826432 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-48dfefe4-eb72-4aeb-90d5-2f910368a8ba tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1477 microversion: 2.1 time: 0.474204 Nov 02 13:15:39.839231 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 385/721] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:39 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1477 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:39.839231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:39.839231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:39.849914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:39.850410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:39.850855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:39.855568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:39.856104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:39.856559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:40.136794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:40.145526 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bea64fcc-5625-4b7d-bcd7-2c3055072a68 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.317416 Nov 02 13:15:40.150208 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 386/722] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:39 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:40.167764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:40.168436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:40.179231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:40.180893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:40.182606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:40.184516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:40.185190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:40.185822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:40.483961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:40.500400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:40.506221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:40.521110 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-987123e5-c708-4b2f-b08a-8c1f68d5a508 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.369566 Nov 02 13:15:40.522006 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 387/723] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:40 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:40.533207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:40.533207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:40.546308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:40.546916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:40.547467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:40.553048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:40.553048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:40.553048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:40.617531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Request method failure captured: Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375/diagnostics HTTP/1.1 Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1hlBWO_3musxbm3mkeh8B80xUEHdZ-qO7C6BVAZ0g4ZNXoNRF-J7VnPJjDlBOwKQxVmsfQkfJqk8FqC-1mWUtCUjiq-rayVeD8YP0iS3OT6OzhI7a6QZcNUfHEq7gnsqishpF_9kEr_evq77lkU0_lVBBnGW4VCxCsxhUY4cnKriA Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8255f68e708743abb89b81695baacdbd Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-665313698 Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:15:40.623015 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8255f68e708743abb89b81695baacdbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8255f68e708743abb89b81695baacdbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8255f68e708743abb89b81695baacdbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8255f68e708743abb89b81695baacdbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-665313698 Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8255f68e708743abb89b81695baacdbd Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-665313698 Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerDiagnosticsNegativeTest-665313698-project Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 393aa3e8607542e6a22a4ae389bd936e Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-665313698-project Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:15:40.624562 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'server_id': 'a3d1b37e-3424-465f-9441-82d097890375'} Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:15:40.625263 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 13:15:40.626508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:40.637777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:40.637777 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83275a03-e3b6-44c2-950b-31ec54b6803b tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.106395 Nov 02 13:15:40.638156 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 388/724] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:15:40 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375/diagnostics => generated 117 bytes in 115 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:15:40.650509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:40.651562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:40.663488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:40.663990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:40.665319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:40.666062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:40.666514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:40.678462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:40.835503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:40.864750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7a191def-1ebc-4009-9b03-b2b6d1bab7e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1275 microversion: 2.1 time: 0.225386 Nov 02 13:15:40.865440 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 389/725] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:40 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:40.891472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:40.904612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:40.926193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:40.926732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:40.927214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:40.928070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:40.928707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:40.929293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:41.520665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:41.526911 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-63c5f8f6-1e61-4ec5-867e-e843aca345e2 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1320 microversion: 2.1 time: 0.660237 Nov 02 13:15:41.529701 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 390/726] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:40 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1320 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:41.548724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:41.549464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:41.565798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:41.566382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:41.566896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:41.567827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:41.571622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:41.572227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:42.097479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:42.107857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c0f316d-c7ac-4e28-9faa-7a3fe999f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.575816 Nov 02 13:15:42.115490 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 391/727] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:41 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:42.122817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:42.132066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:42.140966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:42.143206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:42.145596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:42.148151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:42.155563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:42.156434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:42.210424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:15:42.402968 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-557881fa-b192-48a1-9b24-7cfe6f406697 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 204 len: 0 microversion: 2.1 time: 0.285928 Nov 02 13:15:42.407295 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 392/728] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:15:42 2022] DELETE /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:15:42.415973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1d59c2bd-fb55-4a21-a686-e1b8e2399934 req-97483eef-2012-4d1c-a337-f3d3878b21b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e08b0c-8192-434f-bcad-97df4f95e59c", "name": "network-vif-plugged", "status": "completed", "tag": "25d7d239-84c0-46c5-a2d2-300eba783012"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:42.437237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1d59c2bd-fb55-4a21-a686-e1b8e2399934 req-97483eef-2012-4d1c-a337-f3d3878b21b3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:42.441944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1d59c2bd-fb55-4a21-a686-e1b8e2399934 req-97483eef-2012-4d1c-a337-f3d3878b21b3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:42.442528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1d59c2bd-fb55-4a21-a686-e1b8e2399934 req-97483eef-2012-4d1c-a337-f3d3878b21b3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:42.464851 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1d59c2bd-fb55-4a21-a686-e1b8e2399934 req-97483eef-2012-4d1c-a337-f3d3878b21b3 service nova] Creating event network-vif-plugged:25d7d239-84c0-46c5-a2d2-300eba783012 for instance 47e08b0c-8192-434f-bcad-97df4f95e59c on n-h2-858384-19 Nov 02 13:15:42.470210 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1d59c2bd-fb55-4a21-a686-e1b8e2399934 req-97483eef-2012-4d1c-a337-f3d3878b21b3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060897 Nov 02 13:15:42.475365 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 393/729] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:42.482419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:42.482419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:42.501001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:42.501708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:42.504391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:42.505286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:42.505865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:42.509970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:42.875288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:42.887978 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c11d1151-48f2-4b75-8bcb-50ca8043363d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.411188 Nov 02 13:15:42.915935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 394/730] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:42 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:42.924255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:42.933197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:42.953847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:42.954567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:42.955206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:42.956280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:42.957181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:42.957763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:43.070036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:43.080631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:43.084377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:43.105565 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-790825c9-d6b6-4aad-b414-19326e8a80b9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.188388 Nov 02 13:15:43.106434 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 395/731] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:42 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:43.111820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:43.112616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:43.137310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:43.138291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:43.138735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:43.142630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:43.143972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:43.146806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:43.170964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:43.372250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:43.391182 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fa315c52-623e-4a50-8182-c00b4d096d5a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1281 microversion: 2.1 time: 0.280417 Nov 02 13:15:43.405514 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 396/732] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:43 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1281 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:43.405514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:43.405514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:43.417538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:43.418049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:43.418510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:43.419280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:43.419744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:43.420177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:43.707298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:43.716124 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2a76821b-0bc5-42bb-94bd-e3b434e6ea11 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 200 len: 1592 microversion: 2.1 time: 0.322251 Nov 02 13:15:43.731412 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 397/733] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:43 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 1592 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:43.738071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b7ba15c0-efa1-447d-86fd-30adf9d035df req-a77de3cd-9990-4f6f-bb99-8f69b41cd1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b1c802-d2e4-4c0b-841a-f0baba14e1a0", "tag": "0d829b33-7204-477e-a57b-fb4f3f12903f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:43.759636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b7ba15c0-efa1-447d-86fd-30adf9d035df req-a77de3cd-9990-4f6f-bb99-8f69b41cd1a0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:43.760098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b7ba15c0-efa1-447d-86fd-30adf9d035df req-a77de3cd-9990-4f6f-bb99-8f69b41cd1a0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:43.761467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b7ba15c0-efa1-447d-86fd-30adf9d035df req-a77de3cd-9990-4f6f-bb99-8f69b41cd1a0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:43.780942 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b7ba15c0-efa1-447d-86fd-30adf9d035df req-a77de3cd-9990-4f6f-bb99-8f69b41cd1a0 service nova] Creating event network-changed:0d829b33-7204-477e-a57b-fb4f3f12903f for instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 on n-h1-858384-19 Nov 02 13:15:43.789269 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b7ba15c0-efa1-447d-86fd-30adf9d035df req-a77de3cd-9990-4f6f-bb99-8f69b41cd1a0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060271 Nov 02 13:15:43.790292 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 398/734] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:43.799303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:43.800013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:43.808069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:43.808567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:43.808990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:43.809706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:43.810454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:43.810892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:43.911805 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bdcd5c76-9f7a-47bb-a382-18d9b61a0041 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a/action" status: 202 len: 0 microversion: 2.25 time: 4.428744 Nov 02 13:15:43.912476 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 337/735] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:15:39 2022] POST /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a/action => generated 0 bytes in 4430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:15:43.922187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:43.922792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:43.937584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:43.938391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:43.938984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:43.939903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:43.940581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:43.941155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:44.175494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:44.190070 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f61782f4-1ed1-4777-8b8a-e7efd3eafa6d tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1483 microversion: 2.1 time: 0.394834 Nov 02 13:15:44.194145 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 399/736] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:43 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1483 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:44.202423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:44.203567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:44.212845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:44.213839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:44.214465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:44.215568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:44.216337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:44.217164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:44.463421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:44.473891 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bc185dfb-99d7-4d8d-87fa-c907420a8138 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.275456 Nov 02 13:15:44.475715 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 400/737] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:44 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:44.481356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:44.482536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:44.488323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:44.488945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:44.489484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:44.490307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:44.490868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:44.491532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:44.824197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:44.838590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:44.850441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:44.852609 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e434a831-24be-4713-baaa-763313eccedb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.375115 Nov 02 13:15:44.853336 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 401/738] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:44 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:44.864195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:44.864977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:44.879729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:44.880923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:44.884525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:44.887885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:44.888499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:44.889065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:44.919179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:44.935569 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57a2cac6-a1b1-40ac-9ca1-fc51ed2e3837 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1320 microversion: 2.1 time: 1.016565 Nov 02 13:15:44.938065 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 338/739] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:43 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1320 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:44.953939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:44.959806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:44.973609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:44.980594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:44.981549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:44.982505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:44.983220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:44.983922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:45.116529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:45.130210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:45.132448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:45.141298 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6d8864bc-56fa-4b57-9d86-c5c03f9ecd6c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.202021 Nov 02 13:15:45.143035 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 339/740] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:44 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:45.149847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:45.150996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:45.160784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:45.163665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:45.165612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:45.166640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:45.168037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:45.168711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:45.255811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:45.268763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6a9a8405-e4c2-41f7-989e-cfea402e5727 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.413891 Nov 02 13:15:45.269987 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 402/741] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:44 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:45.275922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:45.276770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:45.286538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:45.287328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:45.287939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:45.288962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:45.290279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:45.290954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:45.788115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:45.796409 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e0a46336-deec-4dfc-bb83-206ccc4478bd tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1483 microversion: 2.1 time: 0.525218 Nov 02 13:15:45.797015 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 403/742] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:45 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1483 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:45.801569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:45.802173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:45.823224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:45.823717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:45.824149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:45.824859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:45.825309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:45.825779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:45.878496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:45.894777 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2401f931-7447-4720-869d-f1bed2a3c7a4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.750346 Nov 02 13:15:45.897681 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 340/743] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:45 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:45.912358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:45.913394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:45.923728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:45.926910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:45.927795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:45.928755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:45.929463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:45.930269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.211195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:46.228095 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9711fc77-3ae3-43d1-855f-74df29543340 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.429085 Nov 02 13:15:46.249023 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 404/744] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:45 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:46.249023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:46.249023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:46.270610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.277531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.279242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.280185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.281367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.282223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.481091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:46.497563 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-52df49f8-2cfc-4f69-9655-32dc5257fe91 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1469 microversion: 2.1 time: 0.258627 Nov 02 13:15:46.499270 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 405/745] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:46 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1469 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:46.505142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0da8829c-597a-40fe-bc90-0a733164ea35 req-888fa4a5-5ef4-4ab6-aa10-b5e55ce4435e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d1b37e-3424-465f-9441-82d097890375", "name": "network-vif-deleted", "tag": "c8903bc9-0ff4-4e83-878d-a1a96c7496d5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:46.517090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0da8829c-597a-40fe-bc90-0a733164ea35 req-888fa4a5-5ef4-4ab6-aa10-b5e55ce4435e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.518372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0da8829c-597a-40fe-bc90-0a733164ea35 req-888fa4a5-5ef4-4ab6-aa10-b5e55ce4435e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.518950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0da8829c-597a-40fe-bc90-0a733164ea35 req-888fa4a5-5ef4-4ab6-aa10-b5e55ce4435e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.563252 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0da8829c-597a-40fe-bc90-0a733164ea35 req-888fa4a5-5ef4-4ab6-aa10-b5e55ce4435e service nova] Creating event network-vif-deleted:c8903bc9-0ff4-4e83-878d-a1a96c7496d5 for instance a3d1b37e-3424-465f-9441-82d097890375 on n-h1-858384-19 Nov 02 13:15:46.575983 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0da8829c-597a-40fe-bc90-0a733164ea35 req-888fa4a5-5ef4-4ab6-aa10-b5e55ce4435e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074721 Nov 02 13:15:46.577057 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 406/746] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:46.584297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:46.585681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:46.592604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.596713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:46.603727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.603727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.603727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.603727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.604491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.631954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:46.636405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:46.640426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-955d152c-4342-4aed-9347-93cba85391be tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.740692 Nov 02 13:15:46.643408 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 341/747] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:45 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:46.654210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:46.655458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:46.677765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.679919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.681595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.685385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.686124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.687638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.699243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:46.731465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:46.741500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:46.743066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:46.763907 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b034f214-7983-4c01-8b0a-8d33eb38790d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.184798 Nov 02 13:15:46.767766 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 407/748] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:46 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:46.781298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c1af0d7f-d768-4c39-96aa-58c6bc8065ce req-647e35ec-31c2-46e9-b718-f5000900559c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58e31fc-dbb3-440f-a950-6759a10dbee4", "tag": "2d1aedad-90d3-4fe0-9ae9-eafd0c29b66d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:46.809772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c1af0d7f-d768-4c39-96aa-58c6bc8065ce req-647e35ec-31c2-46e9-b718-f5000900559c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.809772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c1af0d7f-d768-4c39-96aa-58c6bc8065ce req-647e35ec-31c2-46e9-b718-f5000900559c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.809772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c1af0d7f-d768-4c39-96aa-58c6bc8065ce req-647e35ec-31c2-46e9-b718-f5000900559c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.824325 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c1af0d7f-d768-4c39-96aa-58c6bc8065ce req-647e35ec-31c2-46e9-b718-f5000900559c service nova] Creating event network-changed:2d1aedad-90d3-4fe0-9ae9-eafd0c29b66d for instance c58e31fc-dbb3-440f-a950-6759a10dbee4 on n-h1-858384-19 Nov 02 13:15:46.880945 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c1af0d7f-d768-4c39-96aa-58c6bc8065ce req-647e35ec-31c2-46e9-b718-f5000900559c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103290 Nov 02 13:15:46.894144 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 408/749] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:46.901376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1461373021", "metadata": {"image_type": "test"}}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:46.904132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:46.932960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.933744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.934443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:46.935878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:46.936616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:46.937214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:47.032266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Getting quotas for project 380ebfa7af2140e88cf0e9b264e5a759. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:47.044799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Getting quotas for user 6b91d6b4a24e4c2e828cef94ddf8f914 and project 380ebfa7af2140e88cf0e9b264e5a759. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:47.166165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:47.180550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad71dd01-b905-4cf6-ac07-6edb7f8770fd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.535591 Nov 02 13:15:47.181555 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 342/750] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:46 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:47.188610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:47.189499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:47.196996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:47.197771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:47.198287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:47.199082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:47.199649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:47.200588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:47.286068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:47.288702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:47.289479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:47.290296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lazy-loading 'fault' on Instance uuid a3d1b37e-3424-465f-9441-82d097890375 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:15:47.397306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393aa3e8607542e6a22a4ae389bd936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8255f68e708743abb89b81695baacdbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:47.415008 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e05813a-e8df-4fca-9dc3-31c6102c81ce tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 200 len: 1317 microversion: 2.1 time: 0.230626 Nov 02 13:15:47.417134 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 343/751] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:47 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:47.433303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:47.435760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:47.442192 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-477bf126-aa65-49ea-8c41-6225f564543e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "POST /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c/action" status: 202 len: 0 microversion: 2.1 time: 0.545465 Nov 02 13:15:47.445358 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 409/752] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:15:46 2022] POST /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:15:47.452166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:47.454429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e0dacf69-3def-4a18-bf5c-367482d8b20f req-789aea2f-8aae-4a2e-8122-5ef2225c041b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4", "name": "network-vif-plugged", "status": "completed", "tag": "23b3c7e1-ffaf-4afb-81a2-cf840371d46f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:47.455956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:47.456466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:47.456909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:47.462727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:47.462853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:47.467239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:47.483758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e0dacf69-3def-4a18-bf5c-367482d8b20f req-789aea2f-8aae-4a2e-8122-5ef2225c041b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:47.484661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e0dacf69-3def-4a18-bf5c-367482d8b20f req-789aea2f-8aae-4a2e-8122-5ef2225c041b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:47.486005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e0dacf69-3def-4a18-bf5c-367482d8b20f req-789aea2f-8aae-4a2e-8122-5ef2225c041b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:47.508839 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e0dacf69-3def-4a18-bf5c-367482d8b20f req-789aea2f-8aae-4a2e-8122-5ef2225c041b service nova] Creating event network-vif-plugged:23b3c7e1-ffaf-4afb-81a2-cf840371d46f for instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 on n-h2-858384-19 Nov 02 13:15:47.516927 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e0dacf69-3def-4a18-bf5c-367482d8b20f req-789aea2f-8aae-4a2e-8122-5ef2225c041b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068047 Nov 02 13:15:47.518042 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 410/753] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:47.528379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:47.529812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:47.549387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:47.550442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:47.551240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:47.552283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:47.553175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:47.553858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:47.776127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=22 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:47.877803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:47.889808 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-512a1cf2-2618-475c-8ce3-5764e76ee6fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.369824 Nov 02 13:15:47.911297 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 411/754] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:47 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:47.918535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f963c7fb-bc1b-471a-925e-d064a87afd6b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787abec10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:47.994296 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f963c7fb-bc1b-471a-925e-d064a87afd6b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1427 microversion: 2.1 time: 0.081341 Nov 02 13:15:47.995907 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 412/755] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:15:47 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:47.997918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:48.003044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:48.003937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:48.007277 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a1ebafbb-9d71-4b64-aa31-b38841a35909 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.587101 Nov 02 13:15:48.013016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.014469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.015314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.016652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.017387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.018089 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 344/756] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:47 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:48.018498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.023022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:48.023932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:48.041325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.041710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.042144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.042850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.043419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.043419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.173506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:48.183550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:48.186022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:48.207365 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6cce265b-a57c-49ab-b0e6-52b910676fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.187861 Nov 02 13:15:48.209103 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 345/757] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:48 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:48.215065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:48.215928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:48.221923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.222612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.223233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.224184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.224587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.225171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.232029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:48.350934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:48.361974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:48.363499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:48.364941 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4bea51b3-4c9e-4255-840d-c1c509c527f4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.367587 Nov 02 13:15:48.365513 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 413/758] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:47 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:48.380739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:48.389772 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-80644bd0-1ec6-45a2-a421-68758a5c383c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.179243 Nov 02 13:15:48.390586 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 346/759] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:48 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:48.441812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:48.442559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] [instance: a3d1b37e-3424-465f-9441-82d097890375] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:48.450996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.451707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.452280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.453215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.453769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.454301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.469590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] HTTP exception thrown: Instance a3d1b37e-3424-465f-9441-82d097890375 could not be found. Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Request method failure captured: Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 HTTP/1.1 Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1hlBWO_3musxbm3mkeh8B80xUEHdZ-qO7C6BVAZ0g4ZNXoNRF-J7VnPJjDlBOwKQxVmsfQkfJqk8FqC-1mWUtCUjiq-rayVeD8YP0iS3OT6OzhI7a6QZcNUfHEq7gnsqishpF_9kEr_evq77lkU0_lVBBnGW4VCxCsxhUY4cnKriA Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8255f68e708743abb89b81695baacdbd Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-665313698 Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:15:48.471416 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8255f68e708743abb89b81695baacdbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8255f68e708743abb89b81695baacdbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8255f68e708743abb89b81695baacdbd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8255f68e708743abb89b81695baacdbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-665313698 Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8255f68e708743abb89b81695baacdbd Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-665313698 Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerDiagnosticsNegativeTest-665313698-project Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 393aa3e8607542e6a22a4ae389bd936e Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-665313698-project Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance a3d1b37e-3424-465f-9441-82d097890375 could not be found. Nov 02 13:15:48.472990 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a3d1b37e-3424-465f-9441-82d097890375'} Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d1b37e-3424-465f-9441-82d097890375 could not be found. Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:48.473878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d1b37e-3424-465f-9441-82d097890375 could not be found. Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d1b37e-3424-465f-9441-82d097890375 could not be found. Nov 02 13:15:48.475377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:15:48.477315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] Returning 404 to user: Instance a3d1b37e-3424-465f-9441-82d097890375 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:48.477315 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c2b0f43a-587e-497e-afb3-b1e09b928948 tempest-ServerDiagnosticsNegativeTest-665313698 tempest-ServerDiagnosticsNegativeTest-665313698-project] 10.222.0.113 "GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375" status: 404 len: 111 microversion: 2.1 time: 0.034998 Nov 02 13:15:48.477315 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 414/760] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:48 2022] GET /compute/v2.1/servers/a3d1b37e-3424-465f-9441-82d097890375 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:15:48.919104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:48.919761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:48.921693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:48.927167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.927654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.928086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.928902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.929356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.930331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.955135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ff1014c7-e52b-46b0-9925-adaaca0cafcb req-c7572cd9-4bb4-4c64-869e-a58ea7e33c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e913dade-1692-4209-a986-4d16548ffc95", "tag": "a683d13e-4bb1-4f12-a364-6838e49d4af7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:48.968517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ff1014c7-e52b-46b0-9925-adaaca0cafcb req-c7572cd9-4bb4-4c64-869e-a58ea7e33c01 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:48.969157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ff1014c7-e52b-46b0-9925-adaaca0cafcb req-c7572cd9-4bb4-4c64-869e-a58ea7e33c01 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:48.969596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ff1014c7-e52b-46b0-9925-adaaca0cafcb req-c7572cd9-4bb4-4c64-869e-a58ea7e33c01 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:48.973580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:48.981621 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ff1014c7-e52b-46b0-9925-adaaca0cafcb req-c7572cd9-4bb4-4c64-869e-a58ea7e33c01 service nova] Creating event network-changed:a683d13e-4bb1-4f12-a364-6838e49d4af7 for instance e913dade-1692-4209-a986-4d16548ffc95 on n-h1-858384-19 Nov 02 13:15:48.986733 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ff1014c7-e52b-46b0-9925-adaaca0cafcb req-c7572cd9-4bb4-4c64-869e-a58ea7e33c01 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035836 Nov 02 13:15:48.987368 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 415/761] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:49.011787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2d07ca5-f8ab-4ac7-9754-a5188672c799 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787867dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:49.063329 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f2d07ca5-f8ab-4ac7-9754-a5188672c799 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1427 microversion: 2.1 time: 0.057202 Nov 02 13:15:49.072422 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 416/762] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:15:49 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:49.078909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:49.079700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:49.087057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:49.087580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:49.088031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:49.088752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:49.089416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:49.090006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:49.109339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:49.122358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-abbbee33-a3d7-4859-8cf2-f5819884857c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.208050 Nov 02 13:15:49.123536 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 347/763] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:48 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:49.240636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:49.241262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:49.249452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:49.250319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:49.250970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:49.251709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:49.252332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:49.252771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:49.260306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:49.272943 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47dc0522-04d3-474b-b775-f921f3000d9b tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.199260 Nov 02 13:15:49.274591 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 417/764] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:49 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:49.331450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:49.339888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:49.341382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:49.346622 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3ba43e2-6ea7-480d-b900-1b1da6e7398e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.109946 Nov 02 13:15:49.347269 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 348/765] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:49 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:15:49.392177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:49.393835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:49.401314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:49.401725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:49.402159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:49.402856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:49.403503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:49.403926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:49.413838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:49.415495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:49.421855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:49.422567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:49.423013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:49.423756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:49.424357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:49.424637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:49.551498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:49.561029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:49.562538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:49.563721 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b4fa1fc6-7a89-4040-ada3-e83b61592ef4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.175780 Nov 02 13:15:49.564277 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 418/766] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:49 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:49.628285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:49.635965 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b870060a-2cdd-4ce8-95a3-b281f1e6f4d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1316 microversion: 2.1 time: 0.226113 Nov 02 13:15:49.645902 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 349/767] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:49 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:50.079865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87ae11ea-c458-491d-91d4-ce260309fe3f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787ee3430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:50.124354 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87ae11ea-c458-491d-91d4-ce260309fe3f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1427 microversion: 2.1 time: 0.048362 Nov 02 13:15:50.125446 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 419/768] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:15:50 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:50.145696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:50.146305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:50.153580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.153965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.154404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.155332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.156315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.156984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.298183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:50.298884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:50.321068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.322830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:50.325514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.326184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.330014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.330538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.330976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.339254 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f44b957-7f5d-42f7-bd5c-946ddd38a810 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.192352 Nov 02 13:15:50.339984 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 350/769] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:50 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:50.378938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:50.379844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:50.392601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.393098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.393535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.394416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.394875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.395335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.473457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:50.488164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:50.490346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:50.497526 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dd7c5b0c-4c73-4818-a88c-6f8e8e8277e3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1540 microversion: 2.91 time: 0.123643 Nov 02 13:15:50.499246 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 351/770] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:50 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1540 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:50.562283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:50.571435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b07b00e-b74d-45f7-a7da-8a7cbdbbd8fa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.276576 Nov 02 13:15:50.572121 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 420/771] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:50 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:50.593877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:50.594500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:50.600539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.601021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.601539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.602237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.602881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.603333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.663694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:50.664281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:50.670871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.672109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.672748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.674825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:50.675552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:50.676192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:50.771005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:50.780703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:50.782438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:50.784490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-91e52c54-5938-4ee2-a2bb-cb245c10ffd7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.194399 Nov 02 13:15:50.785596 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 352/772] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:50 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:15:50.873691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:50.881976 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-27e201b2-3829-4efb-9ddb-554031b3ff6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1466 microversion: 2.1 time: 0.225802 Nov 02 13:15:50.891287 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 421/773] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:50 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1466 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:51.141059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-53138c7e-8869-40aa-92cc-8a9aabb66389 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787cd4940>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:51.142655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-293bad4a-fbb0-48ae-8606-ad2750aeaf53 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:51.143756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-293bad4a-fbb0-48ae-8606-ad2750aeaf53 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:51.151592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-293bad4a-fbb0-48ae-8606-ad2750aeaf53 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:51.152087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-293bad4a-fbb0-48ae-8606-ad2750aeaf53 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:51.152537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-293bad4a-fbb0-48ae-8606-ad2750aeaf53 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:51.153255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-293bad4a-fbb0-48ae-8606-ad2750aeaf53 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:51.153717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-293bad4a-fbb0-48ae-8606-ad2750aeaf53 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:51.154149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-293bad4a-fbb0-48ae-8606-ad2750aeaf53 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:51.196738 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-53138c7e-8869-40aa-92cc-8a9aabb66389 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1427 microversion: 2.1 time: 0.059654 Nov 02 13:15:51.197797 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 422/774] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:15:51 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:51.362022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:51.362961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:51.374497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:51.375005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:51.375475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:51.376201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:51.376844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:51.377448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:51.525412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:51.533747 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e25a29c2-7779-45ea-9368-87e7e1ebffab tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.175517 Nov 02 13:15:51.534340 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 423/775] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:51 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:51.661500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1120481513", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:51.715197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:51.933246 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-293bad4a-fbb0-48ae-8606-ad2750aeaf53 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1619 microversion: 2.1 time: 1.032715 Nov 02 13:15:51.934015 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 353/776] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:50 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1619 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:51.938735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:51.939613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:51.946780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:51.948055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:51.948718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:51.949762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:51.950659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:51.951963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:51.964620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:51.965061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:51.965521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:51.965932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:51.966346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:51.972068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:51.979367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:51.979875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:51.980303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:51.981038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:51.981491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:51.981921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.001247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Getting quotas for project ee640ec7f0fd4d7a96969792712a4298. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:52.006579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Getting quotas for user dbdcd46f460e455d926fcc6127f4f94f and project ee640ec7f0fd4d7a96969792712a4298. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:52.020534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:52.022333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:52.022831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:52.030692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:52.032196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:52.037000 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d84b3453-5991-43d9-be28-73da8d75b0df tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1540 microversion: 2.91 time: 0.101974 Nov 02 13:15:52.037567 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 354/777] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:51 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1540 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:52.042269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:52.043167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:52.048774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.049322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.049818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.050574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.051083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.051691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.071891 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c534f82-2175-4b64-905d-a3a24bbb865b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.535164 Nov 02 13:15:52.072560 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 424/778] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:51 2022] POST /compute/v2.1/servers => generated 382 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:15:52.077713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:52.078632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:52.089433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.089925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.090366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.091080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.092200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.092582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.221862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:52.232610 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ef69183-6dbc-4f25-9f2d-1209cf2b87d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.194031 Nov 02 13:15:52.233755 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 355/779] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:52 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:52.238434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:52.239231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:52.244840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:52.246278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.246763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.247467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.248356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.249138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.249698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.254040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:52.255538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:52.257052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1d0107f9-8414-4694-a11a-1ad360a72ea7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.183229 Nov 02 13:15:52.258073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 425/780] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:52 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:52.263323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1603243844", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:52.324068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:52.338772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '98378d3c8963463ba87042f3e7a3f89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f7da88e7a647eba214f7f9412eb94b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:52.339683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] flavor_id is None. Assuming migration. {{(pid=120929) resize /opt/stack/nova/nova/compute/api.py:4197}} Nov 02 13:15:52.340128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120929) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 13:15:52.508100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:52.531562 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2d13cb19-bb2a-414c-b4bb-15c4da23b478 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4/action" status: 202 len: 0 microversion: 2.1 time: 0.296542 Nov 02 13:15:52.535182 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 356/781] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:15:52 2022] POST /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:15:52.540970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2f59825b-9965-4d9e-86ae-cbfb04309d28 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787c74040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:52.566173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:15:52.567095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:15:52.567604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:15:52.568076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:15:52.568748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:15:52.579145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.579876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.580490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.581531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.582218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.582879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.611647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Getting quotas for project ee640ec7f0fd4d7a96969792712a4298. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:52.620423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Getting quotas for user dbdcd46f460e455d926fcc6127f4f94f and project ee640ec7f0fd4d7a96969792712a4298. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:52.662658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:15:52.673016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:15:52.779184 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c50d6abe-caf4-4eed-92ab-3b7efd810942 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.519850 Nov 02 13:15:52.788361 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 426/782] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:15:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:15:52.794501 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2f59825b-9965-4d9e-86ae-cbfb04309d28 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1427 microversion: 2.1 time: 0.260679 Nov 02 13:15:52.794762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:52.795672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:52.796817 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 357/783] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:15:52 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1427 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:52.806631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.807655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.810772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.814037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.814614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.815096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.820701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:52.821590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:52.829523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.830232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.830824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:52.832372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:52.832990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:52.833580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.016296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.024968 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ccdeba8f-e7df-40f7-a914-629b84d77c98 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.220305 Nov 02 13:15:53.025549 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 358/784] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:52 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:53.039739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-893beacd-2359-4c6b-bb32-376c72616e6f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:53.040364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-893beacd-2359-4c6b-bb32-376c72616e6f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:53.095828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.108004 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-30f6a785-3a58-4d53-975a-7ecaf4035c1e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1475 microversion: 2.1 time: 0.317948 Nov 02 13:15:53.108596 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 427/785] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:52 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1475 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:53.137414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:53.137934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:53.152979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-893beacd-2359-4c6b-bb32-376c72616e6f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.160808 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-893beacd-2359-4c6b-bb32-376c72616e6f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1218 microversion: 2.1 time: 0.134229 Nov 02 13:15:53.161372 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 359/786] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:53 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:53.163963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.167266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.167939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.168879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.169590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.170254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.261129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:53.261756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:53.272311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.272792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.273867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.277498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.280604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.281460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.333277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.348583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.350165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.370779 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2ddb0394-1340-48d5-b37a-3a6f46957d4e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1543 microversion: 2.91 time: 0.243825 Nov 02 13:15:53.371449 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 428/787] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:53 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1543 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:53.387889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:53.390691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:53.406913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.407496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.407954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.408680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.409299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.409804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.590395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.598482 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aed81ff3-cd94-451d-bf62-84d26163784c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.342333 Nov 02 13:15:53.600692 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 360/788] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:53 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:53.608048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858384-19"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:53.610557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:53.635259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.635756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.636194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.636904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.637350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.637772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.721204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858384-19". {{(pid=120929) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Nov 02 13:15:53.733255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.743663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.745659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.747340 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-147c6110-ed75-4369-a1dc-c678da44a58b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.373128 Nov 02 13:15:53.748328 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 429/789] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:53 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:53.813939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3bdad8be-974e-430a-8e22-653ed3a9106c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7878b1310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:53.855603 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-faca0195-32fc-497b-b24c-27c2993c9914 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727/action" status: 202 len: 0 microversion: 2.91 time: 0.251790 Nov 02 13:15:53.856598 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 361/790] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:15:53 2022] POST /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:15:53.867570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:53.868736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:53.876527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.877147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.877756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.878689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:53.879325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:53.879776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:53.895478 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3bdad8be-974e-430a-8e22-653ed3a9106c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1427 microversion: 2.1 time: 0.086020 Nov 02 13:15:53.896152 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 430/791] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:15:53 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:53.983952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.994772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:53.998098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:54.007068 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-114f1846-e8fb-41f6-b5e2-e817a1ee1295 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1491 microversion: 2.91 time: 0.145935 Nov 02 13:15:54.009575 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 362/792] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:53 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1491 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:54.051244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:54.051856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:54.059372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.059922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.060378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.061072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.061754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.062339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.138778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:54.139426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:54.149440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.149957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.150403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.152130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.152792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.153412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.231650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:54.240896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-53a1ab68-8ef0-44c9-990f-ab2a4f1cd28f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.193562 Nov 02 13:15:54.259388 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 431/793] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:54 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:54.265090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:54.265922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:54.275456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.276212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.276850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.277763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.278441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.280084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.333976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:54.343488 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de8f593e-50b4-482f-b8b8-88391e29bd93 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1475 microversion: 2.1 time: 0.209025 Nov 02 13:15:54.344576 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 363/794] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:54 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1475 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:54.443777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:54.460078 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aead00ee-5fce-4ac0-8083-5b8ec963a4f9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1222 microversion: 2.1 time: 0.199217 Nov 02 13:15:54.461787 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 432/795] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:54 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1222 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:54.624419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:54.625013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:54.636666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.637174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.637618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.638344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.638782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.640883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.776564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:54.777166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:54.785357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.786110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.789406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:54.794917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:54.795682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:54.796205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.002379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.015464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.018143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.020356 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0fc70800-5c56-4fd2-b7f1-62644cab80c2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.248176 Nov 02 13:15:55.022122 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 433/796] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:54 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:15:55.037929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2a7db41-afd4-42d0-847f-af690d2c6674 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7878b18b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:55.096344 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2a7db41-afd4-42d0-847f-af690d2c6674 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1427 microversion: 2.1 time: 0.072936 Nov 02 13:15:55.097258 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 434/797] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:15:55 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:55.103879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b23b42c8-dcd0-4d27-aaf7-8f65951c072a req-ca12f343-bd55-4480-9d41-ef192901de53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e08b0c-8192-434f-bcad-97df4f95e59c", "name": "network-vif-plugged", "status": "completed", "tag": "25d7d239-84c0-46c5-a2d2-300eba783012"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:55.115080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b23b42c8-dcd0-4d27-aaf7-8f65951c072a req-ca12f343-bd55-4480-9d41-ef192901de53 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.115894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b23b42c8-dcd0-4d27-aaf7-8f65951c072a req-ca12f343-bd55-4480-9d41-ef192901de53 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.116418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b23b42c8-dcd0-4d27-aaf7-8f65951c072a req-ca12f343-bd55-4480-9d41-ef192901de53 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.128060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.141546 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6fd45075-e3f1-41c8-b60a-3b6bbad58105 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.521149 Nov 02 13:15:55.142432 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 364/798] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:54 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:55.149470 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b23b42c8-dcd0-4d27-aaf7-8f65951c072a req-ca12f343-bd55-4480-9d41-ef192901de53 service nova] Creating event network-vif-plugged:25d7d239-84c0-46c5-a2d2-300eba783012 for instance 47e08b0c-8192-434f-bcad-97df4f95e59c on n-h2-858384-19 Nov 02 13:15:55.155873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:55.156523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:55.165468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.165972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.166438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.167319 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b23b42c8-dcd0-4d27-aaf7-8f65951c072a req-ca12f343-bd55-4480-9d41-ef192901de53 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062287 Nov 02 13:15:55.167965 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 435/799] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:55.168753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.169395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.169994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.267365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:55.268399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:55.278910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.279658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.280265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.281158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.281774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.282211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.309255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.323452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.326012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.339387 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e2738e8d-1910-430f-be6a-f7046d7a85ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.193784 Nov 02 13:15:55.340538 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 365/800] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:55 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:55.369855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:55.370869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:55.377112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.377818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.378259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.378953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.379427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.379876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.434149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.442136 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c8d8940-a456-4964-b201-2cc50b21d771 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.180442 Nov 02 13:15:55.442713 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 436/801] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:55 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:55.485874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:55.486638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:55.493750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.494242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.494685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.495678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:55.496134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:55.496696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:55.518889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.527036 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fb8b9567-8bd7-4dc8-ae73-213da95b1a85 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1475 microversion: 2.1 time: 0.161166 Nov 02 13:15:55.527629 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 366/802] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:55 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1475 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:55.560270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:55.567906 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aee02119-1558-4ab2-b593-d112773ae5f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1214 microversion: 2.1 time: 0.085960 Nov 02 13:15:55.568493 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 437/803] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:55 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:56.051278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:56.053192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:56.072263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.072978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.073644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.074586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.076750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.077413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.113073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3141b12c-2de8-43d7-bc49-bffa27882879 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7878b1700>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:56.171608 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3141b12c-2de8-43d7-bc49-bffa27882879 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1427 microversion: 2.1 time: 0.062299 Nov 02 13:15:56.172887 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 438/804] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:15:56 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:15:56.177857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:56.178742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:56.190734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.191259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.191776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.192603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.193190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.193695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.280439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.292448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.294808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.296108 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af9d7e68-c9e7-4c5f-90b9-162189e23423 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.250778 Nov 02 13:15:56.296716 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 367/805] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:56 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:56.381807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:56.382479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:56.390310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.391000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.391611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.392478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.393085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.393725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.428076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.439799 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cf3224ff-e653-4b7c-895f-2f64fa320510 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.266500 Nov 02 13:15:56.440611 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 439/806] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:56 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:56.466642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:56.467318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:56.473569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.474051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.474486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.475225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.475684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.476222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.488259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.500402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.502472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.509347 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e9dce4ab-0693-45a7-a7d7-996d1aae8757 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.134149 Nov 02 13:15:56.510473 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 368/807] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:56 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:56.546992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:56.554028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:56.556745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:56.569986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.571309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.574055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.574976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.576577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.577203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.799202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.816336 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e98894fe-0201-4df4-9a55-790afdee03a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1475 microversion: 2.1 time: 0.267454 Nov 02 13:15:56.816929 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 369/808] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:56 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1475 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:56.821622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:56.822242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:56.836511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.837019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.837468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.838193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:56.838655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:56.839106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:56.937149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:56.948252 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df8f478f-9f28-41ab-bbd5-5ca526328fdf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.485317 Nov 02 13:15:56.954134 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 440/809] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:56 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:57.088344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:57.108746 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b8fd3b4-73ca-4806-96b7-4e89d3e1684e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1214 microversion: 2.1 time: 0.290675 Nov 02 13:15:57.112621 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 370/810] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:56 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:57.188345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3183eaf0-bf1c-4a14-92df-2132b5186534 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7878dfca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:57.203496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d954e0fe-d213-4fa4-96b0-33656c978f34 req-3b50c75f-371c-4bd4-a20c-a554e4c1668a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58e31fc-dbb3-440f-a950-6759a10dbee4", "name": "network-vif-plugged", "status": "completed", "tag": "2d1aedad-90d3-4fe0-9ae9-eafd0c29b66d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:57.237693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d954e0fe-d213-4fa4-96b0-33656c978f34 req-3b50c75f-371c-4bd4-a20c-a554e4c1668a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:57.239456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d954e0fe-d213-4fa4-96b0-33656c978f34 req-3b50c75f-371c-4bd4-a20c-a554e4c1668a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:57.240148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d954e0fe-d213-4fa4-96b0-33656c978f34 req-3b50c75f-371c-4bd4-a20c-a554e4c1668a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:57.283536 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d954e0fe-d213-4fa4-96b0-33656c978f34 req-3b50c75f-371c-4bd4-a20c-a554e4c1668a service nova] Creating event network-vif-plugged:2d1aedad-90d3-4fe0-9ae9-eafd0c29b66d for instance c58e31fc-dbb3-440f-a950-6759a10dbee4 on n-h1-858384-19 Nov 02 13:15:57.294860 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d954e0fe-d213-4fa4-96b0-33656c978f34 req-3b50c75f-371c-4bd4-a20c-a554e4c1668a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097809 Nov 02 13:15:57.297197 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 371/811] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:15:57.324317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:57.325292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:57.337848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:57.338353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:57.338793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:57.341698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:57.344559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:57.345271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:57.660991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:57.675737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:57.683395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:57.685510 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b837b627-3d25-4237-80b3-983a86e05fad tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.367433 Nov 02 13:15:57.690579 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 372/812] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:57 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:15:57.698402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:57.702095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:57.721561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:57.722391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:57.723272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:57.724347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:57.725710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:57.727508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:57.931256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:57.939299 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e5820c14-e536-46fc-af8c-2d95f94ad4b0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.247302 Nov 02 13:15:57.939893 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 373/813] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:57 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:57.946445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:57.947073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:57.953218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:57.953862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:57.954730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:57.955655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:57.956278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:57.957085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:58.041759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:58.050822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:58.055513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:58.057753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:58.064845 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b93c1e59-6aa3-4ead-a3be-400f214883f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.123782 Nov 02 13:15:58.066703 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 374/814] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:57 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:58.075090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:58.076350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:58.087371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:58.087800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:58.088245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:58.089071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:58.089530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:58.089997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:58.344237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:58.361056 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0955d23c-9f73-42e0-bc8d-60ec57e7cc22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1475 microversion: 2.1 time: 0.292263 Nov 02 13:15:58.382209 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 375/815] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:58 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1475 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:58.389969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:58.391501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:58.400956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:58.401939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:58.402773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:58.403999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:58.404734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:58.405414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:58.795400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:58.812350 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6767d4d6-e471-4555-96b6-587517b5ffe7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1507 microversion: 2.1 time: 0.428709 Nov 02 13:15:58.831268 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 376/816] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:58 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1507 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:58.853103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:58.855983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:58.864016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:58.864845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:58.865488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:58.866428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:58.867177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:58.877893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:58.982499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:58.997976 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2b67197a-167c-40ee-835c-f76c29ce4768 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1270 microversion: 2.1 time: 0.164402 Nov 02 13:15:58.998568 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 377/817] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:58 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:59.003338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:59.003928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:59.016252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:59.016756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:59.017189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:59.017905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:59.018357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:59.018790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:59.353418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:59.381401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:59.384858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:59.388458 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-073daffe-57ae-419d-a588-57dd981667f1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.388900 Nov 02 13:15:59.389125 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 378/818] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:58 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:15:59.394533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:59.406903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:59.427228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:59.429053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:59.430185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:59.431138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:59.431782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:59.432379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:59.783483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:15:59.806349 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-945ea018-dfc2-4c50-baf0-43443cde7002 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.415219 Nov 02 13:15:59.806953 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 379/819] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:15:59 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:15:59.817794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:59.818325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:15:59.847827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:59.851731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:59.852304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:15:59.854881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:15:59.856131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:15:59.859708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:00.159779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:00.180263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:00.189297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:00.204588 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f22f0dc-364b-4bc2-8496-c83ceb030109 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.395171 Nov 02 13:16:00.205261 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 380/820] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:15:59 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:00.218863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-28576a84-8fe8-407e-bd99-cfd175002af7 req-0c118cca-0e04-4a39-b191-bba98d235a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e913dade-1692-4209-a986-4d16548ffc95", "name": "network-vif-plugged", "status": "completed", "tag": "a683d13e-4bb1-4f12-a364-6838e49d4af7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:00.246238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-28576a84-8fe8-407e-bd99-cfd175002af7 req-0c118cca-0e04-4a39-b191-bba98d235a08 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:00.246741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-28576a84-8fe8-407e-bd99-cfd175002af7 req-0c118cca-0e04-4a39-b191-bba98d235a08 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:00.249743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-28576a84-8fe8-407e-bd99-cfd175002af7 req-0c118cca-0e04-4a39-b191-bba98d235a08 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:00.283922 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-28576a84-8fe8-407e-bd99-cfd175002af7 req-0c118cca-0e04-4a39-b191-bba98d235a08 service nova] Creating event network-vif-plugged:a683d13e-4bb1-4f12-a364-6838e49d4af7 for instance e913dade-1692-4209-a986-4d16548ffc95 on n-h1-858384-19 Nov 02 13:16:00.297249 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-28576a84-8fe8-407e-bd99-cfd175002af7 req-0c118cca-0e04-4a39-b191-bba98d235a08 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089995 Nov 02 13:16:00.297900 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 381/821] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:00.319843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:00.321723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:00.330027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:00.348477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:00.349628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:00.351679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:00.352854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:00.353827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:00.357289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:01.027714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:01.041236 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-067365f9-e4c9-4ecd-85cc-d6617c16be56 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.734170 Nov 02 13:16:01.055168 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 382/822] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:00 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:01.055168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:01.055168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:01.062948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:01.062948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:01.062948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:01.062948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:01.063475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:01.063865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:01.432410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:01.444380 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-28244f59-5560-45cf-aecf-648d33d7dd11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1482 microversion: 2.1 time: 0.401444 Nov 02 13:16:01.445025 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 383/823] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:01 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1482 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:01.455943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:01.459949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:01.479979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:01.480473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:01.481089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:01.482875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:01.483535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:01.483916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:01.604970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:01.615090 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9bfdf784-2fb9-43ea-8348-62fd28698feb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1276 microversion: 2.1 time: 0.165999 Nov 02 13:16:01.616054 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 384/824] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:01 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:01.622753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:01.623487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:01.649730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:01.650556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:01.651458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:01.652933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:01.654596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:01.655885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:02.105104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:02.122051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:02.128035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:02.129734 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-215a6682-5679-4c33-a577-a0e326d80111 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.511732 Nov 02 13:16:02.130463 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 385/825] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:01 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:02.142368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ca9f3c51-0e7c-4c8e-813f-f43451fcd09c req-c1d12382-ae55-4e2f-bf69-a662322b0f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e5b238-3258-4e2d-ba0e-01268713299a", "tag": "bdbac33f-c52c-4822-983e-75fc66196e13"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:02.156024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ca9f3c51-0e7c-4c8e-813f-f43451fcd09c req-c1d12382-ae55-4e2f-bf69-a662322b0f58 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:02.156786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ca9f3c51-0e7c-4c8e-813f-f43451fcd09c req-c1d12382-ae55-4e2f-bf69-a662322b0f58 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:02.157433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ca9f3c51-0e7c-4c8e-813f-f43451fcd09c req-c1d12382-ae55-4e2f-bf69-a662322b0f58 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:02.175472 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ca9f3c51-0e7c-4c8e-813f-f43451fcd09c req-c1d12382-ae55-4e2f-bf69-a662322b0f58 service nova] Creating event network-changed:bdbac33f-c52c-4822-983e-75fc66196e13 for instance d8e5b238-3258-4e2d-ba0e-01268713299a on n-h1-858384-19 Nov 02 13:16:02.182229 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ca9f3c51-0e7c-4c8e-813f-f43451fcd09c req-c1d12382-ae55-4e2f-bf69-a662322b0f58 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050154 Nov 02 13:16:02.183446 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 386/826] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:02.203502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:02.204794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:02.217824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:02.218589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:02.219235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:02.220856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:02.221497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:02.222606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:02.502530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:02.515234 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2d2fec8b-2e6e-49a0-996a-0c3a7c0ea8e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.320009 Nov 02 13:16:02.516351 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 387/827] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:02 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:02.521171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:02.529470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:02.539944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:02.540719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:02.541341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:02.542344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:02.542962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:02.543619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:02.594037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:02.643725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:02.742709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:02.754625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:02.764086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:02.775887 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9026b572-9049-418a-bc77-667fc286706a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.258196 Nov 02 13:16:02.777171 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 388/828] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:02 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:02.781871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b533eac-f31f-4be1-aa32-c3d37167dbef tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '.version_select at 0x7fe787edb9d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:02.785477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b533eac-f31f-4be1-aa32-c3d37167dbef tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:02.786207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b533eac-f31f-4be1-aa32-c3d37167dbef tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:02.786812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b533eac-f31f-4be1-aa32-c3d37167dbef tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:02.815401 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b533eac-f31f-4be1-aa32-c3d37167dbef tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.1 time: 0.022267 Nov 02 13:16:02.816208 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 389/829] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:16:02 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:02.821535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:02.822328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:02.834296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:02.834795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:02.835425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:02.836143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:02.841351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:02.841810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:03.124909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:03.133196 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3881064-2d06-4661-a25a-7b92ffdffc84 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.315788 Nov 02 13:16:03.137071 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 390/830] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:02 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:03.153955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:03.154504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:03.162625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:03.173549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:03.174163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:03.174597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:03.175350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:03.175958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:03.176394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:03.424796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:03.437163 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b065b704-c9e1-4cf4-8273-9d31c9d19486 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1318 microversion: 2.1 time: 0.296234 Nov 02 13:16:03.439551 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 391/831] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:03 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:03.453727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-96591499-bad8-4c7d-860b-9a5ad4847d1f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:03.455702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-96591499-bad8-4c7d-860b-9a5ad4847d1f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:03.468959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96591499-bad8-4c7d-860b-9a5ad4847d1f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:03.469556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96591499-bad8-4c7d-860b-9a5ad4847d1f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:03.470188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96591499-bad8-4c7d-860b-9a5ad4847d1f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:03.471423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96591499-bad8-4c7d-860b-9a5ad4847d1f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:03.471947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96591499-bad8-4c7d-860b-9a5ad4847d1f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:03.472391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96591499-bad8-4c7d-860b-9a5ad4847d1f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:03.882416 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-96591499-bad8-4c7d-860b-9a5ad4847d1f tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1635 microversion: 2.1 time: 0.441133 Nov 02 13:16:03.899144 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 392/832] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:03 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1635 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:03.899144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:03.899144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:03.899144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:03.899630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:03.899630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:03.902570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:03.902570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:03.914600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:03.938772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:04.146815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:04.159490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:04.161089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:04.162287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-794fc336-a926-43ea-998c-fa6b001fd15c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.277589 Nov 02 13:16:04.165174 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 393/833] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:03 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:04.169941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:04.170549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:04.194301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:04.194773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:04.199443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:04.206946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:04.207487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:04.208108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:04.422377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:04.437051 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8174bfd3-4e77-4166-9e54-be2c9a2833cb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.270535 Nov 02 13:16:04.439341 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 394/834] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:04 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:04.444591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:04.445342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:04.453948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:04.454483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:04.454972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:04.457381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:04.457929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:04.458365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:04.566841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:04.582186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:04.586837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:04.593300 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-12804f6f-de6f-4c0f-be93-36443ac7cba3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.152809 Nov 02 13:16:04.594293 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 395/835] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:04 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:04.601590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1ed26ec2-96bc-472d-9096-dfaa1c270880 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Action: 'create', calling method: .version_select at 0x7fe787dff1f0>, body: {"keypair": {"name": "tempest-keypair-414931152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqoGX2MAwX85Xj4zF3kOgB48bl1N0OAQ65SSb/3R0fDhoYNTidNCDoQRhRJM/w/byUcXNiHEqvHDFYXU6sBVmLiQe0IRKdBuIv3X8aPqF/PgivC4zxnXHacsXYz9qQElg=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:04.633702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1ed26ec2-96bc-472d-9096-dfaa1c270880 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:04.645504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1ed26ec2-96bc-472d-9096-dfaa1c270880 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for user 392d81e9a1c74430a325c9ecc1dcfb44 and project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:04.736142 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1ed26ec2-96bc-472d-9096-dfaa1c270880 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139712 Nov 02 13:16:04.738321 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 396/836] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:16:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:04.777717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-eeff1330-08db-414b-91d7-a17cd05c1976 req-679fc4be-920b-4ef0-8ceb-6457f8b3843d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b14418-609a-441d-b425-dc284f665ff0", "tag": "516365e1-ad71-4734-bcb5-844568ba6af2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:04.885873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eeff1330-08db-414b-91d7-a17cd05c1976 req-679fc4be-920b-4ef0-8ceb-6457f8b3843d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:04.887967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eeff1330-08db-414b-91d7-a17cd05c1976 req-679fc4be-920b-4ef0-8ceb-6457f8b3843d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:04.888431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eeff1330-08db-414b-91d7-a17cd05c1976 req-679fc4be-920b-4ef0-8ceb-6457f8b3843d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:04.900490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-eeff1330-08db-414b-91d7-a17cd05c1976 req-679fc4be-920b-4ef0-8ceb-6457f8b3843d service nova] Creating event network-changed:516365e1-ad71-4734-bcb5-844568ba6af2 for instance d6b14418-609a-441d-b425-dc284f665ff0 on n-h1-858384-19 Nov 02 13:16:04.906130 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-eeff1330-08db-414b-91d7-a17cd05c1976 req-679fc4be-920b-4ef0-8ceb-6457f8b3843d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164912 Nov 02 13:16:04.906939 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 397/837] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:04.912198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:04.912930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:04.923441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:04.923947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:04.924522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:04.925578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:04.930319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:04.930319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:05.300544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:05.314936 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f1d2eaf-401d-4cd3-b3e1-110ec5b6f422 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.406737 Nov 02 13:16:05.360231 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 398/838] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:04 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:05.376025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:05.377021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:05.386641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:05.396711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:05.397321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:05.399883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:05.400663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:05.401109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:05.702434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:05.713844 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b3f52f8-a6f2-49cd-91e1-48ad40bdeec9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1318 microversion: 2.1 time: 0.354339 Nov 02 13:16:05.714722 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 399/839] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:05 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:05.729483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:05.729483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:05.731242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:05.732159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:05.739345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:05.742147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:05.743447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:05.748642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:06.145300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:06.158181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:06.168354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:06.171786 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c0f648e-c366-4503-931d-f016a8545f8f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.455969 Nov 02 13:16:06.172385 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 400/840] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:05 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:06.184224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:06.184512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:06.202838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:06.203526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:06.204174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:06.204905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:06.206131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:06.213982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:06.471228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:06.739004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:06.760392 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7bc50ae-019b-43aa-943e-3f248c629212 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1323 microversion: 2.1 time: 0.586878 Nov 02 13:16:06.762782 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 401/841] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:06 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1323 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:06.774372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:06.779392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:06.801325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:06.802387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:06.804785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:06.807679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:06.809838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:06.810653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:06.947835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:06.994294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:07.014731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:07.016379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:07.034131 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ff9fdce-2743-477e-87b4-160147a37bf4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.269810 Nov 02 13:16:07.034725 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 402/842] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:06 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:07.039863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:07.040479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:07.059518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:07.060015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:07.061128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:07.061859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:07.062321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:07.062747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:07.517219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:07.538924 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0164868f-0a87-4044-8307-2902ec820252 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.502973 Nov 02 13:16:07.539721 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 403/843] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:07 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:07.545962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:07.546583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:07.576638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:07.577145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:07.577579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:07.578307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:07.578778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:07.595375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:08.791465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:08.803555 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-80bbb99f-7d1c-4ba4-b87d-30a84810b710 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1318 microversion: 2.1 time: 1.263025 Nov 02 13:16:08.822122 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 404/844] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:07 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1318 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:08.827586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:08.828511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:08.849638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:08.851250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:08.852129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:08.853382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:08.857192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:08.857991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:09.198738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:09.209695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:09.211774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:09.212960 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-01c25232-3650-46ff-a7e7-cee3a63bc800 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.389394 Nov 02 13:16:09.215066 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 405/845] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:08 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:09.220715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:09.221558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:09.249069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:09.249661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:09.250172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:09.251021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:09.251618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:09.252134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:09.535312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:09.558168 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-65fe5375-fcf1-4f63-87a9-28dbea0fca0d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1473 microversion: 2.1 time: 0.341616 Nov 02 13:16:09.571541 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 406/846] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:09 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:09.582008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:09.582879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:09.590738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:09.591760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:09.594416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:09.596814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:09.599334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:09.601473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:09.751592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:09.777327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:09.782184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:09.797558 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8aa6faba-9824-42dd-9a6c-6cd4c1ac4ffb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.223578 Nov 02 13:16:09.810400 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 407/847] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:09 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:09.830197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:09.831294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:09.844286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:09.845033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:09.845623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:09.846599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:09.847269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:09.847852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.086292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:10.095011 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-97f803f4-904c-4adf-9ad8-bdc4212827d7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.283415 Nov 02 13:16:10.096635 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 408/848] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:09 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:10.102301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:10.103281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:10.111162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.112151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.113157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.114572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.115384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.117091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.286467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:10.295299 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-07ae6a0f-2602-4eaf-b7cf-53c9738a1ff4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 200 len: 1472 microversion: 2.1 time: 0.197269 Nov 02 13:16:10.296016 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 409/849] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:10 2022] GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:10.301376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2067600425", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "11ec4f6b-127c-44f1-a825-014c9ea38647"}], "security_groups": [{"name": "tempest-securitygroup--2013545398"}], "key_name": "tempest-keypair-414931152", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:10.402995 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3183eaf0-bf1c-4a14-92df-2132b5186534 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1436 microversion: 2.1 time: 13.219870 Nov 02 13:16:10.404372 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 441/850] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:15:57 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1436 bytes in 13222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:10.409305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:10.410110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:10.417233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.417717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.418151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.418849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.419341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.419766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.477090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] validate_networks() for [('11ec4f6b-127c-44f1-a825-014c9ea38647', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:10.587631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:10.596482 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-56d0baa2-f798-4ac7-a32b-a830d9e6ba64 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1318 microversion: 2.1 time: 0.190848 Nov 02 13:16:10.597061 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 442/851] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:10 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:10.603009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:10.603722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:10.609780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.610239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.610867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.611932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.612385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.612816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.799215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:10.814943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:10.816680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:10.818272 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e69a311e-e9d0-471e-8bd3-a81fb8b35937 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.219897 Nov 02 13:16:10.820164 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 443/852] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:10 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:10.824981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:10.830362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:10.831557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Searching by: {'reservation_id': 'r-voc07ta8', 'deleted': False, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:10.839713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.840575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.841105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.841933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.842545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.843265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.928436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:16:10.931226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:16:10.932102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:16:10.932838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:16:10.933583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:16:10.949081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.949856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.950502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.951560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:10.952213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:10.952645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:10.970723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:10.976169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for user 392d81e9a1c74430a325c9ecc1dcfb44 and project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:10.989519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:16:10.992531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:16:11.035213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:16:11.048968 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94ff3b34-1f75-4c95-b3ad-a46541d06a74 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.751884 Nov 02 13:16:11.049878 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 410/853] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:16:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:16:11.055463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72f70cc3-e42e-44d9-ace8-d7ca1f9fc268 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787cc0040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:11.141756 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-72f70cc3-e42e-44d9-ace8-d7ca1f9fc268 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 200 len: 1436 microversion: 2.1 time: 0.089585 Nov 02 13:16:11.152808 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 411/854] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:11 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 1436 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:11.158808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:11.159632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:11.169914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.170407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.170801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:11.171005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.171595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.172934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.173460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.179713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.180550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.180722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.368733 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-085c529a-72ea-4cde-9cef-245e64f26ea9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/detail?reservation_id=r-voc07ta8" status: 200 len: 2938 microversion: 2.1 time: 0.547193 Nov 02 13:16:11.369348 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 444/855] 10.222.0.113 () {58 vars in 1202 bytes} [Wed Nov 2 13:16:10 2022] GET /compute/v2.1/servers/detail?reservation_id=r-voc07ta8 => generated 2938 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:11.391959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99c8329b-c7be-4509-b80f-695f8c66cd4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:11.395569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-99c8329b-c7be-4509-b80f-695f8c66cd4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:11.443256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:11.496231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:11.496231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:11.513227 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec79499c-e81e-4792-9570-c874b8674d31 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.359215 Nov 02 13:16:11.513823 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 412/856] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:11 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:11.526614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:11.540308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:11.551629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99c8329b-c7be-4509-b80f-695f8c66cd4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:11.560396 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-99c8329b-c7be-4509-b80f-695f8c66cd4f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1238 microversion: 2.1 time: 0.189767 Nov 02 13:16:11.561018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.563499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.564198 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 445/857] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:11 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1238 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:11.569711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:11.570555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:11.578487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.579250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.579876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.580078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.580915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.581361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.581690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.587245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.587245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.588864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.612418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:11.825408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:11.840787 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e220a6c9-1d24-4809-bdb4-fbdb789c9d06 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1482 microversion: 2.1 time: 0.275174 Nov 02 13:16:11.842114 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 446/858] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:11 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1482 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:11.847737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d1a4d094-fc3a-4bd2-8547-4ab28cab7e25 req-5aa35f2b-256d-40ad-b651-f155ed3daa18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e5b238-3258-4e2d-ba0e-01268713299a", "name": "network-vif-plugged", "status": "completed", "tag": "bdbac33f-c52c-4822-983e-75fc66196e13"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:11.860247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d1a4d094-fc3a-4bd2-8547-4ab28cab7e25 req-5aa35f2b-256d-40ad-b651-f155ed3daa18 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.861163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d1a4d094-fc3a-4bd2-8547-4ab28cab7e25 req-5aa35f2b-256d-40ad-b651-f155ed3daa18 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.861701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d1a4d094-fc3a-4bd2-8547-4ab28cab7e25 req-5aa35f2b-256d-40ad-b651-f155ed3daa18 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.887045 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d1a4d094-fc3a-4bd2-8547-4ab28cab7e25 req-5aa35f2b-256d-40ad-b651-f155ed3daa18 service nova] Creating event network-vif-plugged:bdbac33f-c52c-4822-983e-75fc66196e13 for instance d8e5b238-3258-4e2d-ba0e-01268713299a on n-h1-858384-19 Nov 02 13:16:11.892498 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d1a4d094-fc3a-4bd2-8547-4ab28cab7e25 req-5aa35f2b-256d-40ad-b651-f155ed3daa18 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048940 Nov 02 13:16:11.893426 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 447/859] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:11.899195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dbd0ad32-ea19-4b1e-a58f-ea023ac6e3ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:11.908774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:11.920763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1105a81e-7f62-4737-8afd-513d89fd4ea0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.405876 Nov 02 13:16:11.924338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 413/860] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:11 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:11.931965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:11.933366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:11.941835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.compute.server_groups [None req-dbd0ad32-ea19-4b1e-a58f-ea023ac6e3ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Querying cell 9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) for 2 instances {{(pid=120928) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 13:16:11.944489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbd0ad32-ea19-4b1e-a58f-ea023ac6e3ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.945392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbd0ad32-ea19-4b1e-a58f-ea023ac6e3ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.948442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbd0ad32-ea19-4b1e-a58f-ea023ac6e3ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.954443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.961842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.962724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:11.965688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:11.966443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:11.967160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.024227 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dbd0ad32-ea19-4b1e-a58f-ea023ac6e3ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups/95b78563-8c8c-4291-860a-88720e62eaeb" status: 200 len: 266 microversion: 2.1 time: 0.129457 Nov 02 13:16:12.024834 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 448/861] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:16:11 2022] GET /compute/v2.1/os-server-groups/95b78563-8c8c-4291-860a-88720e62eaeb => generated 266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:12.033315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:12.034276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:12.047253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.047903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.048445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.049897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.050600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.051169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.219693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:12.230043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:12.231579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:12.232754 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0cf0c30f-d6c2-4853-96d1-b46ee24814bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.205151 Nov 02 13:16:12.233864 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 449/862] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:12 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:12.238603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bea37c51-ae02-4efa-905c-6c33b46fcf2a tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:12.239226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bea37c51-ae02-4efa-905c-6c33b46fcf2a tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:12.246528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea37c51-ae02-4efa-905c-6c33b46fcf2a tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.247235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea37c51-ae02-4efa-905c-6c33b46fcf2a tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.247630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea37c51-ae02-4efa-905c-6c33b46fcf2a tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.248998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea37c51-ae02-4efa-905c-6c33b46fcf2a tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.249462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea37c51-ae02-4efa-905c-6c33b46fcf2a tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.249916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bea37c51-ae02-4efa-905c-6c33b46fcf2a tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.315960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:12.345681 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-702daf50-b541-42f0-8dfb-136248b7867c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1318 microversion: 2.1 time: 0.419859 Nov 02 13:16:12.346269 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 414/863] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:11 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:12.416024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-97600c3b-da5b-4187-b6f5-c21dcb7ececa req-3d1f17f1-91d5-436f-8d9b-d3ede0c4673f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e466d0e-a517-440d-a860-46bdb84b883a", "name": "network-vif-unplugged", "status": "completed", "tag": "97246982-73ce-4b56-989e-35e7f8e74360"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:12.437710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-97600c3b-da5b-4187-b6f5-c21dcb7ececa req-3d1f17f1-91d5-436f-8d9b-d3ede0c4673f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.438464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-97600c3b-da5b-4187-b6f5-c21dcb7ececa req-3d1f17f1-91d5-436f-8d9b-d3ede0c4673f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.439073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-97600c3b-da5b-4187-b6f5-c21dcb7ececa req-3d1f17f1-91d5-436f-8d9b-d3ede0c4673f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.451092 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bea37c51-ae02-4efa-905c-6c33b46fcf2a tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 200 len: 1625 microversion: 2.1 time: 0.213812 Nov 02 13:16:12.467305 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 450/864] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:12 2022] GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 1625 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:12.475192 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-97600c3b-da5b-4187-b6f5-c21dcb7ececa req-3d1f17f1-91d5-436f-8d9b-d3ede0c4673f service nova] Creating event network-vif-unplugged:97246982-73ce-4b56-989e-35e7f8e74360 for instance 0e466d0e-a517-440d-a860-46bdb84b883a on n-h2-858384-19 Nov 02 13:16:12.477547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea37c439-aab8-486a-996d-50bae3101f99 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:12.478277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ea37c439-aab8-486a-996d-50bae3101f99 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:12.485031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea37c439-aab8-486a-996d-50bae3101f99 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.485778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea37c439-aab8-486a-996d-50bae3101f99 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.486717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea37c439-aab8-486a-996d-50bae3101f99 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.487804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea37c439-aab8-486a-996d-50bae3101f99 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.488345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea37c439-aab8-486a-996d-50bae3101f99 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.488886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea37c439-aab8-486a-996d-50bae3101f99 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.490869 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-97600c3b-da5b-4187-b6f5-c21dcb7ececa req-3d1f17f1-91d5-436f-8d9b-d3ede0c4673f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081246 Nov 02 13:16:12.495900 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 415/865] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:16:12.549539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:12.549539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:12.580649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:12.583866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.586425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.587621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.588780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.590282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.590953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.717134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:12.732090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:12.733871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:12.742635 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-722908da-7209-4503-ba5d-6fd2a0a6e7f7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.203204 Nov 02 13:16:12.745874 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 416/866] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:12 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:12.750671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:12.759991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:12.769025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.769794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.770308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.771090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.775721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.777118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.797702 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ea37c439-aab8-486a-996d-50bae3101f99 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1626 microversion: 2.1 time: 0.326876 Nov 02 13:16:12.814054 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 451/867] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:12 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1626 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:12.836100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b792ff40-ebda-4e32-9719-78d75c77eeb3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Action: 'create', calling method: .version_select at 0x7fe78c0ca430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1419985184", "policies": ["anti-affinity"]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:12.863887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b792ff40-ebda-4e32-9719-78d75c77eeb3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:12.870495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b792ff40-ebda-4e32-9719-78d75c77eeb3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:12.884955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:12.893265 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d0422be-4d0f-40b3-be22-564d9920cbbc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1242 microversion: 2.1 time: 0.146299 Nov 02 13:16:12.894087 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 417/868] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:12 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1242 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:12.917451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:12.918419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:12.924916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.925627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.926250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.927136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.927757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.929287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.942765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b792ff40-ebda-4e32-9719-78d75c77eeb3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:12.950565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b792ff40-ebda-4e32-9719-78d75c77eeb3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:12.964738 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b792ff40-ebda-4e32-9719-78d75c77eeb3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.135733 Nov 02 13:16:12.965712 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 452/869] 10.222.0.113 () {60 vars in 1179 bytes} [Wed Nov 2 13:16:12 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:16:12.970363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:12.970974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:12.987485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.988214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.988688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:12.989407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:12.990622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:12.991771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.170067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.176880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.188755 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2872cee9-5a2b-4fed-bb98-8fd13145ea8d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.221907 Nov 02 13:16:13.189345 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 453/870] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:12 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:13.198341 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60dc1d55-5643-447e-b7c8-ae4cd86b1550 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1482 microversion: 2.1 time: 0.289587 Nov 02 13:16:13.207128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1010304712", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5dd3866b-0d34-4e45-8249-394322194b66"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:13.207354 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 418/871] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:12 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1482 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:13.258580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:13.259625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:13.264517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:13.267229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.267786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.268290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.269053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.269702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.270323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.424114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.434647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.436450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.437630 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ea41cafa-3604-4f5d-aca1-ce0713307bd9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.183702 Nov 02 13:16:13.443578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 419/872] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:13 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:13.450553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:13.451604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:13.458908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.460784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.461318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.462028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.462930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.463377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.512160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:16:13.512658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:16:13.513889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:16:13.514327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:16:13.514800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:16:13.530539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.531025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.531506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.532242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.532720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.533125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.552619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:13.558435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:13.571880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Going to run 2 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:16:13.574227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:16:13.604818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.613803 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4fa57e29-e1ce-422c-99fe-44a65c5cc70f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1318 microversion: 2.1 time: 0.168411 Nov 02 13:16:13.614642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 420/873] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:13 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:13.627635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:13.634187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:13.668741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:13.674142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:13.688930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=0d8af7fb-9ec0-41f9-b19e-f8a9611be065,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:16:13.705997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:13.736619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:13.742296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:13.776627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:13.781690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:13.797247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:13.797869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:13.804911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.805394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.805838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.806534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.806994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.807468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.817768 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b025a4cc-2ee1-492a-839d-ac3c4ff24d87 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.627284 Nov 02 13:16:13.818714 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 454/874] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:16:13 2022] POST /compute/v2.1/servers => generated 32 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:16:13.826838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:13.832101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.832873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Searching by: {'deleted': False, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:13.851462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.851913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.852457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.853191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.853647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.854078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.882333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:16:13.903527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.911743 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8723aadc-71b3-47e4-9fb1-a7d029c726d5 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 1675 microversion: 2.1 time: 0.088523 Nov 02 13:16:13.912331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.912628 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 455/875] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:16:13 2022] GET /compute/v2.1/servers => generated 1675 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:13.916826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.922449 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0ffbd75-7b58-4ae4-836d-1b288d0dfd9a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.130038 Nov 02 13:16:13.923210 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 421/876] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:13 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:13.926651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:13.927299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:13.928308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0a1092e7-1fb6-4ddf-b79c-cb1485e94ee1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:13.929210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0a1092e7-1fb6-4ddf-b79c-cb1485e94ee1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:13.934110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.934727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.935186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.935885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:13.936329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:13.936750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:13.985736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a1092e7-1fb6-4ddf-b79c-cb1485e94ee1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:13.998881 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0a1092e7-1fb6-4ddf-b79c-cb1485e94ee1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1223 microversion: 2.1 time: 0.074201 Nov 02 13:16:13.999522 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 422/877] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:13 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1223 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:14.023308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:14.031959 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e1ac8e9-d854-47dd-ab6a-7d934842bca0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1242 microversion: 2.1 time: 0.111051 Nov 02 13:16:14.032923 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 456/878] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:13 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:14.214057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:14.214671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:14.221178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.221566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:14.221705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.222035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.222475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:14.222738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.223351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.223786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.228865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.229634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.230497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.231580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.232152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.232705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.387003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:14.396128 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-324e6aa7-326e-40fe-b0cb-614166d04e1d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.186964 Nov 02 13:16:14.404094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:14.408346 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 423/879] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:14 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:14.413501 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c2cfd6a4-5eaf-4264-a842-4d995f01ebf6 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1482 microversion: 2.1 time: 0.194937 Nov 02 13:16:14.414471 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 457/880] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:14 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1482 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:14.463466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:14.464073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:14.470196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.470685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.471163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.471907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.472378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.472796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.530039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e5cc3f36-57bb-4d30-b277-02586cbc5d77 req-3c6f628f-0306-4e4c-ac54-a5ae22f62a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e466d0e-a517-440d-a860-46bdb84b883a", "tag": "97246982-73ce-4b56-989e-35e7f8e74360"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:14.540693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e5cc3f36-57bb-4d30-b277-02586cbc5d77 req-3c6f628f-0306-4e4c-ac54-a5ae22f62a1e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.541175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e5cc3f36-57bb-4d30-b277-02586cbc5d77 req-3c6f628f-0306-4e4c-ac54-a5ae22f62a1e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.541605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e5cc3f36-57bb-4d30-b277-02586cbc5d77 req-3c6f628f-0306-4e4c-ac54-a5ae22f62a1e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.559685 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e5cc3f36-57bb-4d30-b277-02586cbc5d77 req-3c6f628f-0306-4e4c-ac54-a5ae22f62a1e service nova] Creating event network-changed:97246982-73ce-4b56-989e-35e7f8e74360 for instance 0e466d0e-a517-440d-a860-46bdb84b883a on n-h2-858384-19 Nov 02 13:16:14.564988 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e5cc3f36-57bb-4d30-b277-02586cbc5d77 req-3c6f628f-0306-4e4c-ac54-a5ae22f62a1e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039131 Nov 02 13:16:14.565749 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 458/881] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:16:14.625314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:14.635243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:14.637020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:14.638306 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b93f1d8-a16b-45b4-87be-cb3498524889 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.179380 Nov 02 13:16:14.639017 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 424/882] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:14 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:14.640915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:14.641612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:14.648112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.648870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.649322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.650176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.650623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.651044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.790938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:14.799862 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef660718-14f9-4a92-8ffb-38e1a5f0b5d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1318 microversion: 2.1 time: 0.165392 Nov 02 13:16:14.800654 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 459/883] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:14 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:14.952483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:14.953131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:14.959231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.960528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.960989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:14.962054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:14.962164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:14.962568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.023217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:15.023782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:15.030407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.036925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.037506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.038798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.038929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.039797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.040327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.040443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.040893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.045821 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-424bc2ed-42f6-4bd1-bd22-7ef31308a0db tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.098910 Nov 02 13:16:15.046377 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 425/884] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:14 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:15.055280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:15.056406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:15.062495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.062961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.063490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.064187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.064637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.065055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.117361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.125597 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4289e368-536e-4393-bf32-8048702521f1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1275 microversion: 2.1 time: 0.107194 Nov 02 13:16:15.126498 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 460/885] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:15 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1275 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:15.138651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.146829 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dba162ee-f28c-4605-94f2-938f6095f9a2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1242 microversion: 2.1 time: 0.095315 Nov 02 13:16:15.147873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 426/886] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:15 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:15.420272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:15.420905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:15.426815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.427337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.427778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.428988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.429446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.429871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.438421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:15.439046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:15.447373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.448128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.448575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.449457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.450209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.450639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.582384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.587052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:15.592896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b609499-0ccf-47ca-af69-299922ad25dd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.176529 Nov 02 13:16:15.607207 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 461/887] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:15 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:15.607207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3671900f-777b-45c4-ba53-88a32f71f5ab req-58e970cc-60fc-43cd-bc48-d9e7a5a147b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b14418-609a-441d-b425-dc284f665ff0", "name": "network-vif-plugged", "status": "completed", "tag": "516365e1-ad71-4734-bcb5-844568ba6af2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:15.613065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3671900f-777b-45c4-ba53-88a32f71f5ab req-58e970cc-60fc-43cd-bc48-d9e7a5a147b1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.613452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3671900f-777b-45c4-ba53-88a32f71f5ab req-58e970cc-60fc-43cd-bc48-d9e7a5a147b1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.613876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3671900f-777b-45c4-ba53-88a32f71f5ab req-58e970cc-60fc-43cd-bc48-d9e7a5a147b1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.624246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.627912 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3671900f-777b-45c4-ba53-88a32f71f5ab req-58e970cc-60fc-43cd-bc48-d9e7a5a147b1 service nova] Creating event network-vif-plugged:516365e1-ad71-4734-bcb5-844568ba6af2 for instance d6b14418-609a-441d-b425-dc284f665ff0 on n-h1-858384-19 Nov 02 13:16:15.634927 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3671900f-777b-45c4-ba53-88a32f71f5ab req-58e970cc-60fc-43cd-bc48-d9e7a5a147b1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039995 Nov 02 13:16:15.635662 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec2677b1-f342-431f-84e0-1e5035e5724b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1482 microversion: 2.1 time: 0.201346 Nov 02 13:16:15.636488 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 462/888] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:15.636839 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 427/889] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:15 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1482 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:15.665582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:15.666199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:15.672331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.672826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.673266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.674014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.674479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.674909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.822217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:15.823501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:15.827819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.835363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.836044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.836571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.837492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:15.838060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:15.838564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:15.844781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.846283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.847504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e19db662-8880-4ddb-b6fa-ba6ad840abeb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.186567 Nov 02 13:16:15.862227 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 428/890] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:15 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:15.982715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:15.990710 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-235592ad-ddf7-41aa-b013-26d30ebdcd39 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1318 microversion: 2.1 time: 0.172722 Nov 02 13:16:15.992021 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 463/891] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:15 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:16.074933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:16.075478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:16.081424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.081905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.082335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.083145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.083582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.084004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.152044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:16.152747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:16.160406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.160892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.161330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.162066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.162514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.162968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.239181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:16.248924 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9b96c93f-df2c-419d-bcca-ddc3e1ef4760 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1283 microversion: 2.1 time: 0.100993 Nov 02 13:16:16.249784 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 464/892] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:16 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1283 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:16.254075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:16.254723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:16.261580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.262073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.262512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.263251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.263705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.264132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.332684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:16.342246 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0ae3b63-6403-4a39-be83-171d396a4c2d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1242 microversion: 2.1 time: 0.091662 Nov 02 13:16:16.343141 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 465/893] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:16 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:16.367464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:16.380487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:16.382307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:16.388703 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-55c4e771-af28-4b4b-ab64-c1a3f93e3b92 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.317666 Nov 02 13:16:16.390742 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 429/894] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:16 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:16.622117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:16.622647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:16.628658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.629140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.629579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.630272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.630729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.631186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.659686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:16.660310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:16.667868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.668352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.669045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.669744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.670191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.670610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.767553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:16.777460 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44799ae4-f045-45f8-89a1-1da8a386df92 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.159518 Nov 02 13:16:16.778047 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 466/895] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:16 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:16.805840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:16.813557 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1f30c61c-4693-48c6-ae7b-248f6b2b0512 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1482 microversion: 2.1 time: 0.158040 Nov 02 13:16:16.814125 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 430/896] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:16 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1482 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:16.877634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:16.878778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:16.890072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.890923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.891748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:16.892990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:16.893574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:16.894004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.013942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:17.014549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:17.020590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.021817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.023049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.023985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.024438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:17.024578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.024944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.032894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:17.034374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:17.035541 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bcc7ec4b-f370-46b1-8601-0937f41ad9ab tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.165822 Nov 02 13:16:17.036107 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 467/897] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:16 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:17.155887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:17.159348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:17.165517 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75bdc13e-846d-4cfa-9115-efa913ec3d1c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1318 microversion: 2.1 time: 0.155514 Nov 02 13:16:17.166099 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 431/898] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:17 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:17.285303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:17.287162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:17.294152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.294735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.295310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.296177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.296763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.297232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.366698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:17.367569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:17.374245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.375005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.375451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.376400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.376987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.377413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.390444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:17.399564 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-04fa0d69-5398-4cf0-89c9-fc41dbd7a311 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1281 microversion: 2.1 time: 0.118225 Nov 02 13:16:17.400340 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 468/899] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:17 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1281 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:17.422762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:17.423310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:17.429979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.430449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.430882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.431601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.432058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.432480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.464570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:17.473592 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2eaeab8-b560-43f8-bffc-d8fb4130ecc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1234 microversion: 2.1 time: 0.111568 Nov 02 13:16:17.474179 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 432/900] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:17 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1234 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:17.504390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:17.514151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:17.515667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:17.520991 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a0210533-9540-488e-8e53-2235cc6d6d4b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.102852 Nov 02 13:16:17.521760 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 469/901] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:17 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:17.804591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:17.805360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:17.812780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.813353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.814090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.814975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.815800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.816421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.842688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:17.843630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:17.854463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.854888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.855438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:17.856141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:17.856611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:17.857132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.041552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.052093 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bda5b17e-3f47-4a07-b120-adcf720c1a4b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1482 microversion: 2.1 time: 0.219577 Nov 02 13:16:18.054032 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 470/902] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:17 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1482 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:18.075356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:18.076135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:18.084130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.086240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.087445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.088216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.088740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.089182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.128678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.138986 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c047d2e-a1c4-4863-bbfe-933a15ceca8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.340813 Nov 02 13:16:18.139626 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 433/903] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:17 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:18.190907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:18.191513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:18.199566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.200058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.200564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.201276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.201726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.202148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.284658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.297062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.300257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.302032 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8ed52dbc-cb54-4e3d-bad5-71d4ebeeb185 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.239362 Nov 02 13:16:18.321140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 471/904] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:18 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:18.426613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:18.429201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:18.440366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.441072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.441531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.442384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.443639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.445229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.488874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.507529 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9303348c-8ed2-4b9b-8898-9fa4eae36daa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1468 microversion: 2.1 time: 0.318958 Nov 02 13:16:18.510671 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 434/905] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:18 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:18.528552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:18.529407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:18.542495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.542996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.543464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.544176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.545041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.545680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.626480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.639645 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d564f4c-0ee0-4920-a9ce-ae7106780c40 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1234 microversion: 2.1 time: 0.127365 Nov 02 13:16:18.640178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.642930 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 435/906] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:18 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1234 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:18.648301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:18.649433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:18.649559 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88b10141-9c10-48c8-897f-038adb7846d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.229964 Nov 02 13:16:18.650421 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 472/907] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:18 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:18.660060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:18.660723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:18.660878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.661343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.661774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.662471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.662924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.663374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.668689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.668689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.669081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.669709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:18.670165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:18.670600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:18.741998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.752545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.754414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.761913 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3df478fb-0e87-42d3-bf81-3d75072c86f5 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.110110 Nov 02 13:16:18.763860 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 473/908] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:18 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:18.921421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:18.931087 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-87b5b5c8-8c23-4cdf-a1bb-f3ede8278cbe tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1467 microversion: 2.1 time: 0.289330 Nov 02 13:16:18.931691 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 436/909] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:18 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1467 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:18.995669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2103498558", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d8e5b238-3258-4e2d-ba0e-01268713299a"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:19.034877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1d41d436-76e8-4bb1-9984-76a5f5ae5478 req-eaf870e1-aa70-4903-ba35-1196a0ca38c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "645cc834-6c82-4eab-a09b-3f568b8343e8", "tag": "58bc6b38-0de6-42c0-be05-1b6a0b8246b5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:19.052642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1d41d436-76e8-4bb1-9984-76a5f5ae5478 req-eaf870e1-aa70-4903-ba35-1196a0ca38c5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.053932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1d41d436-76e8-4bb1-9984-76a5f5ae5478 req-eaf870e1-aa70-4903-ba35-1196a0ca38c5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.054432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1d41d436-76e8-4bb1-9984-76a5f5ae5478 req-eaf870e1-aa70-4903-ba35-1196a0ca38c5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.072052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:19.078206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1d41d436-76e8-4bb1-9984-76a5f5ae5478 req-eaf870e1-aa70-4903-ba35-1196a0ca38c5 service nova] Creating event network-changed:58bc6b38-0de6-42c0-be05-1b6a0b8246b5 for instance 645cc834-6c82-4eab-a09b-3f568b8343e8 on n-h1-858384-19 Nov 02 13:16:19.084305 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1d41d436-76e8-4bb1-9984-76a5f5ae5478 req-eaf870e1-aa70-4903-ba35-1196a0ca38c5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053973 Nov 02 13:16:19.085811 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 437/910] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:19.092371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:19.093260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:19.101175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.101667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.102115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.102820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.103307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.103726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.304079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:16:19.305265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:16:19.305747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:16:19.306188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:16:19.306600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:16:19.315784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.316270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.316705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.317434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.317892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.318317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.337577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Getting quotas for project ee640ec7f0fd4d7a96969792712a4298. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:19.343460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Getting quotas for user dbdcd46f460e455d926fcc6127f4f94f and project ee640ec7f0fd4d7a96969792712a4298. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:19.359383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.360581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:16:19.362942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:16:19.368177 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f2fed1d1-d603-4ce6-ad92-b99d1c95c247 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1469 microversion: 2.1 time: 0.280860 Nov 02 13:16:19.368822 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 438/911] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:19 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1469 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:19.375241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:19.376724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:19.384495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.385055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.385644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.386574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.387219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.387945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.431613 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39670edc-9a88-42b2-a43a-bdd270dfc962 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.440960 Nov 02 13:16:19.432331 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 474/912] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:16:18 2022] POST /compute/v2.1/servers => generated 382 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:16:19.443610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:19.445208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:19.452640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.452819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.453268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.454111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.454570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.455172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.616993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.623936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.630148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.631742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.632896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e44b53a6-6133-4461-82ff-296842fe6b5f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.196572 Nov 02 13:16:19.633690 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 475/913] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:19 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:19.634217 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f45ea62-9b34-401c-9dc8-bf2f4d45d00e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.264037 Nov 02 13:16:19.634881 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 439/914] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:19 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:19.640108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff5c7623-899c-4109-9b3d-98fd528e50dd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:19.640796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ff5c7623-899c-4109-9b3d-98fd528e50dd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:19.661098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91c9d3c5-d611-4511-950f-043ea2b81739 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7876c9820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:19.711900 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91c9d3c5-d611-4511-950f-043ea2b81739 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/c691e80e-3ff7-4224-8e34-80d276ecc1b1" status: 200 len: 787 microversion: 2.1 time: 0.060681 Nov 02 13:16:19.712982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 476/915] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:19 2022] GET /compute/v2.1/images/c691e80e-3ff7-4224-8e34-80d276ecc1b1 => generated 787 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:19.720590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:19.721671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:19.730780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.731578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.732329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.733414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.734137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.735067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.741017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff5c7623-899c-4109-9b3d-98fd528e50dd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.749063 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff5c7623-899c-4109-9b3d-98fd528e50dd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1218 microversion: 2.1 time: 0.112933 Nov 02 13:16:19.750457 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 440/916] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:19 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:19.755658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:19.756593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:19.763882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.764718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.765375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.766570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.767308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.767793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.813880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.822638 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c7c319fb-1e34-4b2b-8a97-783a9b6a0f22 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1234 microversion: 2.1 time: 0.108423 Nov 02 13:16:19.822880 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 477/917] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:19 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1234 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:19.831335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-db3d174c-a351-4495-b7f6-44d0d580786c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:19.840617 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-db3d174c-a351-4495-b7f6-44d0d580786c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.016744 Nov 02 13:16:19.841438 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 478/918] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:16:19 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:19.846561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:19.847615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:19.856255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.857148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.857757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.858632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:19.859094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:19.859677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:19.940874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.953940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.955546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.956583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:19.962231 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca273ba3-8df7-4c7d-ab73-c92682909fd7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.119603 Nov 02 13:16:19.966030 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-082064ac-958e-4886-93ea-63bca594c88a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.214097 Nov 02 13:16:19.966727 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 441/919] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:19 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:19.971423 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 479/920] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:19 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:19.975210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3ab30dd6-e0a1-41c8-b12b-065479b71cc9 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787ff0b80>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:20.403206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3ab30dd6-e0a1-41c8-b12b-065479b71cc9 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "DELETE /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 204 len: 0 microversion: 2.1 time: 0.435148 Nov 02 13:16:20.403781 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 442/921] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:19 2022] DELETE /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:16:20.411912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8f3c5b0-0972-4c6b-8175-b4e149b63f1e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787893a60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:20.433365 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-b8f3c5b0-0972-4c6b-8175-b4e149b63f1e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] HTTP exception thrown: Image not found. Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8f3c5b0-0972-4c6b-8175-b4e149b63f1e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Request method failure captured: Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 HTTP/1.1 Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1qx7pUURhNHaUMhsKLubQPv20ysCJlMQnGGh6pufoi4GUxjkLI6gENTEPVrAydnO_6M8mYrRvERgmqr2Q43YFryIFcdZOyhEZwW6aCu4m28P6YH10ua5ByiXcRHWkx62RcdZrZ5Tyx3acYBOeJ0E7Z6CV98hTVOO2my8B0E1S4Ny0 Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 380ebfa7af2140e88cf0e9b264e5a759 Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerTestJSON-344791689 Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:16:20.446347 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerTestJSON-344791689 Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 380ebfa7af2140e88cf0e9b264e5a759 Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-344791689 Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerTestJSON-344791689-project Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 6b91d6b4a24e4c2e828cef94ddf8f914 Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerTestJSON-344791689-project Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'aafeaf0f-efde-4b3e-91e8-c40c02679f73'} Nov 02 13:16:20.448084 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:16:20.449036 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aafeaf0f-efde-4b3e-91e8-c40c02679f73 Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:16:20.450193 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aafeaf0f-efde-4b3e-91e8-c40c02679f73 could not be found. Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:16:20.451543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8f3c5b0-0972-4c6b-8175-b4e149b63f1e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:16:20.452788 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b8f3c5b0-0972-4c6b-8175-b4e149b63f1e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 404 len: 62 microversion: 2.1 time: 0.039847 Nov 02 13:16:20.453844 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 480/922] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:20 2022] GET /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:16:20.458691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2ff283e5-97cd-4c08-8e99-723bcd448b9e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-802632678"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:20.461772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2ff283e5-97cd-4c08-8e99-723bcd448b9e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:20.467875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ff283e5-97cd-4c08-8e99-723bcd448b9e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.468362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ff283e5-97cd-4c08-8e99-723bcd448b9e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.468832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ff283e5-97cd-4c08-8e99-723bcd448b9e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.469533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ff283e5-97cd-4c08-8e99-723bcd448b9e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.469993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ff283e5-97cd-4c08-8e99-723bcd448b9e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.470421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ff283e5-97cd-4c08-8e99-723bcd448b9e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.659043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:20.660748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:20.667196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.667888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.668429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.669332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.669977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.670408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.680223 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2ff283e5-97cd-4c08-8e99-723bcd448b9e tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "POST /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c/action" status: 202 len: 0 microversion: 2.1 time: 0.225529 Nov 02 13:16:20.681065 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 443/923] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:16:20 2022] POST /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:16:20.686495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:20.686933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:20.693062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.693548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.694857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.695442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.695887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.696357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.838249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:20.847382 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-118d55cc-5fb3-4fa7-a5c0-3bf624a19d3f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.193346 Nov 02 13:16:20.847972 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 481/924] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:20 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:20.854276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5961e5da-c571-4984-9e16-2faa618a40ce tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7876c95e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:20.875712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:20.886753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:20.888555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:20.889952 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c6a19174-f275-4931-b057-3e0886ed8e52 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.207736 Nov 02 13:16:20.890620 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 444/925] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:20 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:20.908135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:20.908835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:20.913767 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5961e5da-c571-4984-9e16-2faa618a40ce tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.064563 Nov 02 13:16:20.916188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.916685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.917150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.917853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.918300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.918723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.921642 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 482/926] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:20 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:20.926270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-93ada5da-b1f5-4fd5-a82f-b72e3159b2bd req-fd65a166-c6cc-4441-83b8-1803f9be9506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e08b0c-8192-434f-bcad-97df4f95e59c", "name": "network-vif-unplugged", "status": "completed", "tag": "25d7d239-84c0-46c5-a2d2-300eba783012"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:20.936415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-93ada5da-b1f5-4fd5-a82f-b72e3159b2bd req-fd65a166-c6cc-4441-83b8-1803f9be9506 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.936885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-93ada5da-b1f5-4fd5-a82f-b72e3159b2bd req-fd65a166-c6cc-4441-83b8-1803f9be9506 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.937312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-93ada5da-b1f5-4fd5-a82f-b72e3159b2bd req-fd65a166-c6cc-4441-83b8-1803f9be9506 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.950445 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-93ada5da-b1f5-4fd5-a82f-b72e3159b2bd req-fd65a166-c6cc-4441-83b8-1803f9be9506 service nova] Creating event network-vif-unplugged:25d7d239-84c0-46c5-a2d2-300eba783012 for instance 47e08b0c-8192-434f-bcad-97df4f95e59c on n-h2-858384-19 Nov 02 13:16:20.955480 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-93ada5da-b1f5-4fd5-a82f-b72e3159b2bd req-fd65a166-c6cc-4441-83b8-1803f9be9506 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032621 Nov 02 13:16:20.956073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 483/927] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:20.960260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:20.962031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:20.962031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:20.968293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.968767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.969197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.969891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:20.970343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:20.970764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:20.984184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:20.993373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-86cd8e91-f136-4995-b631-142a53a0e099 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1222 microversion: 2.1 time: 0.101410 Nov 02 13:16:20.993581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:20.993964 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 445/928] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:20 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:20.999057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:20.999698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:21.005517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:21.006123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:21.007315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:21.007988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:21.008451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:21.008886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:21.044801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:21.052768 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-25db4248-6f8a-4021-8e72-f3178107ba02 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1234 microversion: 2.1 time: 0.095560 Nov 02 13:16:21.053922 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 484/929] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:20 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1234 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:21.058598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:21.059239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:21.061003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:21.066550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:21.067028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:21.067511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:21.068199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:21.068664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:21.069334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:21.137148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:21.145309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:21.145751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:21.147339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:21.152874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af7f2c6e-6071-496f-8bfa-92ef4ab7fadb tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.097888 Nov 02 13:16:21.153547 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 485/930] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:21 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:21.154910 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dfdf17c2-4867-4bf9-a16e-8a836ce154fd tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.159850 Nov 02 13:16:21.155514 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 446/931] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:20 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:21.873365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:21.873921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:21.886386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:21.887154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:21.887786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:21.888660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:21.889328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:21.889919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:21.919463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:21.920092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:21.933283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:21.936449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:21.936947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:21.937695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:21.938172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:21.938615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:22.101767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.106646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.109922 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1000a6b6-17e9-485c-aa61-c6ec1e003e55 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.241643 Nov 02 13:16:22.111358 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 486/932] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:21 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:22.118599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2699555d-5310-4520-9f8d-3935af9f6aaa tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7878935e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:22.141467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.144785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.175626 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f0d3110d-8724-4585-9865-d6cb4a6d6277 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.260394 Nov 02 13:16:22.176727 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 447/933] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:21 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:22.183902 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2699555d-5310-4520-9f8d-3935af9f6aaa tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.070899 Nov 02 13:16:22.185086 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 487/934] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:22 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:22.190463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:22.191246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:22.199103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:22.208110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:22.208301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:22.209092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:22.211403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:22.213978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:22.214706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:22.215413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:22.216055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:22.216615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:22.217502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:22.219046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:22.219697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:22.220289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:22.294640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.302953 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-82209e9f-daac-46ca-8a1a-1e806579579a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1222 microversion: 2.1 time: 0.124881 Nov 02 13:16:22.303644 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 448/935] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:22 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:22.308647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.309239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:22.309860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:22.315911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:22.316393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:22.316830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:22.317528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:22.317926 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fe37c32b-7b66-4873-96fe-5ee34cc7f4e9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1234 microversion: 2.1 time: 0.131351 Nov 02 13:16:22.318292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:22.319278 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 488/936] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:22 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1234 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:22.323361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:22.324581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:22.325191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:22.331536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:22.332030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:22.332472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:22.333176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:22.333634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:22.334066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:22.401236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.409860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.411359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.418662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09f46a63-c310-4f8f-aa18-ba16c76fc05b tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.097665 Nov 02 13:16:22.419277 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 489/937] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:22 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:22.465488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:22.468943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:22.474194 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b20641c-09af-4401-8fd8-6f37d8ca3d50 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.169102 Nov 02 13:16:22.474770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 449/938] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:22 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:23.159346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:23.159962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:23.167579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.167995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.168437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.169148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.169698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.170174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.200518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e808353-ba72-46c7-a39f-01a3ed565421 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787e83550>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:23.251389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e808353-ba72-46c7-a39f-01a3ed565421 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.054713 Nov 02 13:16:23.251985 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 450/939] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:23 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:23.260977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:23.261704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:23.268209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.268810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.269262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.269982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.270449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.271046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.309016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.317096 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c807bd77-9c97-4f54-9c31-d94ec68b0706 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.161679 Nov 02 13:16:23.317665 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 490/940] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:23 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:23.329924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:23.330693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:23.338109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.338713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.339247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.340091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.340542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.340992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.406496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.415226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.415614 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d72fc8a-3c3c-4ed9-8e3e-91e6aa9b493e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1222 microversion: 2.1 time: 0.089731 Nov 02 13:16:23.416212 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 491/941] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:23 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:23.420808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:23.421455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:23.424581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.426150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.427267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.427567 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7aeb0e7a-8b0b-43bf-ba9f-e16b0bace666 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.174552 Nov 02 13:16:23.427749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.428897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.429820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.430469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.430725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.433278 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 451/942] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:23 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:23.446378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:23.447740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:23.453690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.454180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.454620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.455372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.455834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.456339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.500780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.509439 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd158678-20d7-41a6-87ed-d40a097779f8 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1234 microversion: 2.1 time: 0.092175 Nov 02 13:16:23.510028 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 492/943] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:23 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:23.514678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:23.515275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:23.522167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.522652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.523088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.523810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:23.524259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:23.524681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:23.533430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.542499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.544048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.552295 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2f716592-e63f-49e5-8b40-b02dc6eaa3f2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.110111 Nov 02 13:16:23.555250 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 452/944] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:23 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:23.675770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:23.684585 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fff0a716-2376-4724-81fd-6e8274831406 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.173537 Nov 02 13:16:23.684585 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 493/945] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:23 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:24.274347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f722ce83-634d-4664-81cc-b1259a74c929 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787e830d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:24.344836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:24.346093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:24.365130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:24.366912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:24.367447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:24.368325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:24.369020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:24.369477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:24.390982 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f722ce83-634d-4664-81cc-b1259a74c929 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.124235 Nov 02 13:16:24.392928 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 453/946] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:24 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:24.441138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:24.441934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:24.466408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:24.467790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:24.481051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:24.482635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:24.483151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:24.483603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:24.752257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:24.763684 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1378bb74-22fa-40f5-b570-714823fc2de5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.423980 Nov 02 13:16:24.783224 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 494/947] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:24 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:24.786687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:24.791409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:24.801432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:24.802347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:24.802801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:24.804892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:24.806176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:24.806915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:24.829792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:24.847903 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04251ec5-3d3a-4046-ba5a-c11e7155e48b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1222 microversion: 2.1 time: 0.412222 Nov 02 13:16:24.848927 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 454/948] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:24 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1222 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:24.857075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:24.858677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:24.878156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:24.878904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:24.879546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:24.880434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:24.881153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:24.884105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:24.999134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:25.017120 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a7e478b-8d92-4a61-8ca2-37c19196c4b3 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1290 microversion: 2.1 time: 0.166906 Nov 02 13:16:25.017717 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 455/949] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:24 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1290 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:25.031304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:25.031304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:25.043992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:25.044694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:25.045339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:25.046232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:25.046700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:25.047358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:25.150868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:25.159975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:25.161762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:25.163682 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71fda3fb-0492-468c-9fb2-2da8e802342f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.387372 Nov 02 13:16:25.164539 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 495/950] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:24 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:25.171437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:25.171437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:25.185092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:25.185747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:25.186376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:25.187259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:25.187822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:25.188359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:25.190210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:25.204478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:25.206730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:25.214001 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c48cf2b2-1941-4dc5-b7ea-711486546807 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.193161 Nov 02 13:16:25.214776 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 456/951] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:25 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:25.408039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0f572c3c-c87a-43d9-8036-94ea087a2fec tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787c691f0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:25.452054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:25.463035 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c90a689f-f34b-4930-a3fc-c43aaafad9e0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.297404 Nov 02 13:16:25.463707 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 496/952] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:25 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:25.467824 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0f572c3c-c87a-43d9-8036-94ea087a2fec tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.065042 Nov 02 13:16:25.468406 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 457/953] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:25 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:25.798949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:25.799808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:25.806995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:25.807802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:25.809188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:25.810306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:25.810922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:25.811540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:25.876232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:25.877316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:25.885827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:25.886674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:25.887518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:25.888459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:25.889452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:25.889960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.047831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.056976 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45cac5a6-1ffa-486b-9914-4cf0f47d5683 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.263537 Nov 02 13:16:26.075953 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 497/954] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:25 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:26.086833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:26.087915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:26.094699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.095720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.096410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.097341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.098012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.098653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.205244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.218628 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-50125b5e-cacd-4697-8413-7504c525654d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1298 microversion: 2.1 time: 0.140891 Nov 02 13:16:26.219504 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 498/955] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:26 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:26.229637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:26.234576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:26.258099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.258511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.259732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.260837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.261317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.261724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.339098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.351421 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-15c6cf96-ac06-4a4a-986e-e176e82fe052 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1278 microversion: 2.1 time: 0.479785 Nov 02 13:16:26.355773 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 458/956] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:25 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1278 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:26.369306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:26.370482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:26.384606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.386555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.387244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.388178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.395550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.396208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.524929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.538661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.557883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.560164 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e1de453-0f54-4f94-9fd7-74e41071b595 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.339387 Nov 02 13:16:26.561473 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 499/957] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:26 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:26.569463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:26.570095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:26.577513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.578304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.578928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.579942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.580637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.581443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.623518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.633204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.639353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.645252 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fafaffe4-374f-466c-9f15-bcfb228ff143 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1536 microversion: 2.91 time: 0.288210 Nov 02 13:16:26.646037 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 459/958] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:26 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1536 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:26.653999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-945fac43-4a9e-4a0f-a962-14faecf5add5 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787c508b0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:26.708455 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-945fac43-4a9e-4a0f-a962-14faecf5add5 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.060581 Nov 02 13:16:26.709862 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 460/959] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:26 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:26.729230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:26.730096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:26.744045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.746539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.748592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.759289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:26.760164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:26.760846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:26.840514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:26.853591 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6b05bbd1-ea66-479d-9d78-958e8fd2bec6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.290465 Nov 02 13:16:26.855509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 500/960] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:26 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:27.076050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lazy-loading 'services' on Instance uuid 4d3ead0b-c738-4855-8460-8be9b17b0727 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:16:27.094187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:27.095104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:27.117985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.118826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.119549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.120835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.121458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.122450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.126130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:27.128779 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6a70c92c-18d9-4060-b0cb-145b05ac7bf5 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1943 microversion: 2.91 time: 0.417198 Nov 02 13:16:27.130362 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 461/961] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:26 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1943 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:27.175014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:27.176299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:27.189367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.190325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.191101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.191997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.192677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.193860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.232600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lazy-loading 'flavor' on Instance uuid 4d3ead0b-c738-4855-8460-8be9b17b0727 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:16:27.566124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:27.575359 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d4b820e2-42f8-4555-b931-0d497afe1b11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.486873 Nov 02 13:16:27.578723 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 501/962] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:27 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:27.596056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:27.596923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:27.613310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.614410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.616547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.618391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.620126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.621391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.633022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:27.685342 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d037595-f98b-4b3f-bbda-24ea18d92b74 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "POST /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727/action" status: 202 len: 0 microversion: 2.91 time: 0.517840 Nov 02 13:16:27.686673 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 462/963] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:16:27 2022] POST /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:16:27.698433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:27.699594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:27.708578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.710966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.712227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.713262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.714009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.714725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.850332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:27.862021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:27.875950 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c45e9e1-5abf-48ab-a26c-9375e7c21ad7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1296 microversion: 2.1 time: 0.295138 Nov 02 13:16:27.877446 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 502/964] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:27 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1296 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:27.879841 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3020892d-2df2-424a-9bb3-57c1c042e3c0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1276 microversion: 2.1 time: 0.187116 Nov 02 13:16:27.880731 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 463/965] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:27 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:27.885666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:27.886173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:27.886319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:27.887293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:27.896260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.899633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.900503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.901938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.903241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.904147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.904843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.904969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.905079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:27.905772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:27.906266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:27.906649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:28.070902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:28.091728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:28.094859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:28.119074 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba4ee722-dffa-4b41-9fb5-da10ba0da634 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.234639 Nov 02 13:16:28.120580 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 464/966] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:27 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:28.126759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fb891028-335a-4a86-adb8-dda3c55b0c70 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787c69940>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:28.183185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:28.195825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:28.197762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:28.201725 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3a0db454-b410-439d-b336-de74f649cfa6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1573 microversion: 2.25 time: 0.322530 Nov 02 13:16:28.203690 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 503/967] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:27 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1573 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:28.217542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:28.218582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:28.228480 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fb891028-335a-4a86-adb8-dda3c55b0c70 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.106476 Nov 02 13:16:28.231104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:28.232193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:28.232765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:28.234208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:28.234449 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 465/968] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:28 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:28.235167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:28.236814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:28.398576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:28.406571 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0d2cfad7-517c-432f-8dad-760b54937e7f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.201560 Nov 02 13:16:28.407174 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 504/969] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:28 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:28.607919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:28.608552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:28.621530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:28.622027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:28.622650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:28.623564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:28.624211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:28.624632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:28.903544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:28.904844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:28.911457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:28.912843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:28.913505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:28.914476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:28.915042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:28.915797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.078043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:29.091504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:29.103689 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16ed3e9a-3907-4c12-a6f0-6f722e7b720e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1480 microversion: 2.1 time: 0.501660 Nov 02 13:16:29.104289 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bc103062-55eb-4ba7-810f-fd8a3f6b8563 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.198233 Nov 02 13:16:29.105074 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 466/970] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:28 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1480 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:29.106520 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 505/971] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:28 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:29.121773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:29.126794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:29.126930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8e1c8eb6-d497-42e0-947a-4c310ef58bfc req-6acce4ce-4b85-418d-bb21-8b7aa2faec73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e08b0c-8192-434f-bcad-97df4f95e59c", "name": "network-vif-plugged", "status": "completed", "tag": "25d7d239-84c0-46c5-a2d2-300eba783012"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:29.136714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.138028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8e1c8eb6-d497-42e0-947a-4c310ef58bfc req-6acce4ce-4b85-418d-bb21-8b7aa2faec73 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.138694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8e1c8eb6-d497-42e0-947a-4c310ef58bfc req-6acce4ce-4b85-418d-bb21-8b7aa2faec73 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.139330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8e1c8eb6-d497-42e0-947a-4c310ef58bfc req-6acce4ce-4b85-418d-bb21-8b7aa2faec73 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.142100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.142807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.144484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.144971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.145453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.157101 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8e1c8eb6-d497-42e0-947a-4c310ef58bfc req-6acce4ce-4b85-418d-bb21-8b7aa2faec73 service nova] Creating event network-vif-plugged:25d7d239-84c0-46c5-a2d2-300eba783012 for instance 47e08b0c-8192-434f-bcad-97df4f95e59c on n-h2-858384-19 Nov 02 13:16:29.166774 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8e1c8eb6-d497-42e0-947a-4c310ef58bfc req-6acce4ce-4b85-418d-bb21-8b7aa2faec73 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048663 Nov 02 13:16:29.168020 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 506/972] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:29.175285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:29.176288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:29.185300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.186929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.189846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.190040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.192386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.194143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.272773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:29.282547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:29.284311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:29.291577 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34cc217d-3abb-4db0-87e2-b2a3c1a6d913 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.121970 Nov 02 13:16:29.292471 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 507/973] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:29 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:29.297387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:29.298164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:29.305473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.305957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.306395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.307099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.307575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.308002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.329041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:29.353153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=40 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:29.462258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:29.470869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:29.472382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:29.473904 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-991b9499-39af-4b29-9c86-48f77c2c18e1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1548 microversion: 2.25 time: 0.180584 Nov 02 13:16:29.475273 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 508/974] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:29 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:29.497808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1f2542a9-b92f-4a60-aa1f-1a14aa247e26 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7876df280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:29.553086 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1f2542a9-b92f-4a60-aa1f-1a14aa247e26 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.064142 Nov 02 13:16:29.554650 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 509/975] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:29 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:29.570030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:29.570758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:29.578041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.578599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.579125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.579976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.580511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.581125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.746483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=14 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:29.854789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:29.863667 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-02e211bb-8cfc-419c-b3c0-62886c70d91a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.746476 Nov 02 13:16:29.864312 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 467/976] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:29 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:29.870730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3286ce37-5a14-44c7-93d9-243b8a02b019 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '.version_select at 0x7fe787c50af0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:29.878509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3286ce37-5a14-44c7-93d9-243b8a02b019 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.879290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3286ce37-5a14-44c7-93d9-243b8a02b019 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.879943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3286ce37-5a14-44c7-93d9-243b8a02b019 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.894256 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3286ce37-5a14-44c7-93d9-243b8a02b019 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 2386 microversion: 2.25 time: 0.028631 Nov 02 13:16:29.895504 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 468/977] 10.222.0.113 () {60 vars in 1189 bytes} [Wed Nov 2 13:16:29 2022] GET /compute/v2.1/os-migrations => generated 2386 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:29.917120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:29.919942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:29.935639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.936524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.937361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.938323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:29.938983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:29.940615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:29.980607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:30.001634 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-096c4533-95c3-4b02-b750-3a4ef7f2a827 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.441043 Nov 02 13:16:30.005643 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 510/978] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:29 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:30.131550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:30.135094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:30.146038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:30.148295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:30.148295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:30.148976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:30.150068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:30.150876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:30.366361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:30.379169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 0e466d0e-a517-440d-a860-46bdb84b883a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:16:30.444436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-010f9f2c-29e3-4612-8075-393d7d0213b5 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 2043 microversion: 2.25 time: 0.533293 Nov 02 13:16:30.446518 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 469/979] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:29 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 2043 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:30.458867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:30.460096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:30.477353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:30.478513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:30.479019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:30.482169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:30.483026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:30.483552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:30.484000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:30.494244 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1dd0e04d-f04e-431e-8cde-ec9e8be009a2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1479 microversion: 2.1 time: 0.365010 Nov 02 13:16:30.495534 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 511/980] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:30 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1479 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:30.513994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8bd184fd-84ed-411b-8f78-e46a1ff6e351 req-b86b8780-6d84-4646-b848-e08d597cb6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8af7fb-9ec0-41f9-b19e-f8a9611be065", "tag": "6c00af57-80ac-4518-aa54-e45203b976a5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:30.544402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8bd184fd-84ed-411b-8f78-e46a1ff6e351 req-b86b8780-6d84-4646-b848-e08d597cb6f9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:30.545302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8bd184fd-84ed-411b-8f78-e46a1ff6e351 req-b86b8780-6d84-4646-b848-e08d597cb6f9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:30.546167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8bd184fd-84ed-411b-8f78-e46a1ff6e351 req-b86b8780-6d84-4646-b848-e08d597cb6f9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:30.577242 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8bd184fd-84ed-411b-8f78-e46a1ff6e351 req-b86b8780-6d84-4646-b848-e08d597cb6f9 service nova] Creating event network-changed:6c00af57-80ac-4518-aa54-e45203b976a5 for instance 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 on n-h2-858384-19 Nov 02 13:16:30.590417 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8bd184fd-84ed-411b-8f78-e46a1ff6e351 req-b86b8780-6d84-4646-b848-e08d597cb6f9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087940 Nov 02 13:16:30.591126 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 512/981] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:30.601264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:30.602061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:30.622678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:30.626586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:30.629535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:30.630635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:30.635867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:30.636623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:30.805437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:30.820790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:30.823295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:30.839561 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b4521c23-e67d-4fe0-8ea6-259657307346 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.246013 Nov 02 13:16:30.840818 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 513/982] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:30 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:30.847841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-256937f0-52ea-47fc-a63d-8407ae511965 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Action: 'create', calling method: .version_select at 0x7fe787656550>, body: {"keypair": {"name": "tempest-keypair-1519404356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKp+AnXGcp1pKqgdFm2i2foC24jStODE/yr38JvFUQQLneao06bkZbFw5BhCvwIXrLS2GqFAp18MofhoKBBEVj51RSVEXUipDO20/pj1xTGyedXB5bwS0b03E1m2jbqpQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:30.880955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-256937f0-52ea-47fc-a63d-8407ae511965 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for project d89e00efbe3c49019171062c5e914dc9. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:30.890747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-256937f0-52ea-47fc-a63d-8407ae511965 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for user 4b987e6d2a814bc6b30b8191cfd5351d and project d89e00efbe3c49019171062c5e914dc9. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:30.920391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:30.933636 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-45972585-50af-4aba-a2d7-5796071bc1e5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.483896 Nov 02 13:16:30.936176 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 470/983] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:30 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:30.937659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-256937f0-52ea-47fc-a63d-8407ae511965 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.094976 Nov 02 13:16:30.948108 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 514/984] 10.222.0.113 () {62 vars in 1205 bytes} [Wed Nov 2 13:16:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:16:30.962888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:30.963573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:30.964778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fc9e0872-7665-4bc8-812b-99b92243dc5d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787c69d30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:30.971953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:30.972461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:30.973261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:30.974398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:30.975462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:30.976460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:31.048231 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fc9e0872-7665-4bc8-812b-99b92243dc5d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.109160 Nov 02 13:16:31.049431 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 471/985] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:30 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:31.055217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:31.056049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:31.064203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:31.065296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:31.065910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:31.066825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:31.067494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:31.069157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:31.255471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:31.266226 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1749622a-3de9-426c-9142-4dd4c47ff89f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.317113 Nov 02 13:16:31.266830 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 515/986] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:30 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:31.283204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-dfde3a0d-871f-47e2-8997-c0c338cc74e4 req-15d9b8a8-a219-4b04-9597-6ca93517eddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8f4a4c-224d-4a42-9b89-dadf667e644b", "tag": "9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:31.295964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dfde3a0d-871f-47e2-8997-c0c338cc74e4 req-15d9b8a8-a219-4b04-9597-6ca93517eddc service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:31.296450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dfde3a0d-871f-47e2-8997-c0c338cc74e4 req-15d9b8a8-a219-4b04-9597-6ca93517eddc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:31.296885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dfde3a0d-871f-47e2-8997-c0c338cc74e4 req-15d9b8a8-a219-4b04-9597-6ca93517eddc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:31.310602 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-dfde3a0d-871f-47e2-8997-c0c338cc74e4 req-15d9b8a8-a219-4b04-9597-6ca93517eddc service nova] Creating event network-changed:9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d for instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b on n-h2-858384-19 Nov 02 13:16:31.317641 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-dfde3a0d-871f-47e2-8997-c0c338cc74e4 req-15d9b8a8-a219-4b04-9597-6ca93517eddc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049335 Nov 02 13:16:31.319894 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 516/987] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:31.457281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ff099d9a-58d9-4dc1-b5dd-e18e5023b5da req-39ddab61-332e-48ca-864a-83d6d7b6ca6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645cc834-6c82-4eab-a09b-3f568b8343e8", "name": "network-vif-plugged", "status": "completed", "tag": "58bc6b38-0de6-42c0-be05-1b6a0b8246b5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:31.473874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ff099d9a-58d9-4dc1-b5dd-e18e5023b5da req-39ddab61-332e-48ca-864a-83d6d7b6ca6f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:31.481778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ff099d9a-58d9-4dc1-b5dd-e18e5023b5da req-39ddab61-332e-48ca-864a-83d6d7b6ca6f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:31.482506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ff099d9a-58d9-4dc1-b5dd-e18e5023b5da req-39ddab61-332e-48ca-864a-83d6d7b6ca6f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:31.506271 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ff099d9a-58d9-4dc1-b5dd-e18e5023b5da req-39ddab61-332e-48ca-864a-83d6d7b6ca6f service nova] Creating event network-vif-plugged:58bc6b38-0de6-42c0-be05-1b6a0b8246b5 for instance 645cc834-6c82-4eab-a09b-3f568b8343e8 on n-h1-858384-19 Nov 02 13:16:31.516059 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ff099d9a-58d9-4dc1-b5dd-e18e5023b5da req-39ddab61-332e-48ca-864a-83d6d7b6ca6f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062610 Nov 02 13:16:31.517450 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 517/988] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:31.536621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:31.539073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:31.557768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:31.558514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:31.559330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:31.562361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:31.563312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:31.566661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:31.625405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:31.634951 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6a443eef-3bf4-4c2b-b37e-857281ed503e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.584213 Nov 02 13:16:31.655969 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 472/989] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:31 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:31.872838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:31.873454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:31.879827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:31.880417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:31.880960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:31.882272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:31.883006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:31.883667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:31.998999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:32.009902 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-593beb62-e86a-4d44-9375-405be4706fc5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1479 microversion: 2.1 time: 0.484603 Nov 02 13:16:32.010601 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 518/990] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:31 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1479 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:32.017162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:32.033369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:32.035125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:32.037908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:32.039041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:32.050055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:32.051892 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f9d9c3a-6706-4601-83fb-ac3a6c900772 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.183242 Nov 02 13:16:32.052985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:32.054579 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 473/991] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:31 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:32.055391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:32.056422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:32.057097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:32.058238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:32.067324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0173502-3c1b-4ada-93e1-6cf989b03469 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787e831f0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:32.135193 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0173502-3c1b-4ada-93e1-6cf989b03469 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.074963 Nov 02 13:16:32.135898 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 474/992] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:32 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:32.293433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:32.299933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:32.301142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:32.301718 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-73ae09ca-2f38-4d08-9bb5-b70d12abe409 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.289400 Nov 02 13:16:32.302322 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 519/993] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:32 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:32.310083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:32.310846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:32.311379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:32.313249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:32.313249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:32.313249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:32.558965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:32.567000 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d71ea824-4795-4b90-9f83-c588c95b99d9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.277755 Nov 02 13:16:32.567655 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 475/994] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:32 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:32.612652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9a77bbec-24b7-45e3-a9da-d0bac9b05df0 req-1bbdac6f-15ac-49b0-b176-a10b26a0ee98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7abafda-06b1-412b-be6d-88482b4716c1", "tag": "bc98d529-d478-4d4a-b88d-9a5c95bb4099"}, {"server_uuid": "ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4", "name": "network-vif-unplugged", "status": "completed", "tag": "23b3c7e1-ffaf-4afb-81a2-cf840371d46f"}, {"name": "network-changed", "server_uuid": "ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4", "tag": "23b3c7e1-ffaf-4afb-81a2-cf840371d46f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:32.625427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9a77bbec-24b7-45e3-a9da-d0bac9b05df0 req-1bbdac6f-15ac-49b0-b176-a10b26a0ee98 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:32.625904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9a77bbec-24b7-45e3-a9da-d0bac9b05df0 req-1bbdac6f-15ac-49b0-b176-a10b26a0ee98 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:32.626434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9a77bbec-24b7-45e3-a9da-d0bac9b05df0 req-1bbdac6f-15ac-49b0-b176-a10b26a0ee98 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:32.641113 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9a77bbec-24b7-45e3-a9da-d0bac9b05df0 req-1bbdac6f-15ac-49b0-b176-a10b26a0ee98 service nova] Creating event network-changed:bc98d529-d478-4d4a-b88d-9a5c95bb4099 for instance e7abafda-06b1-412b-be6d-88482b4716c1 on n-h1-858384-19 Nov 02 13:16:32.641647 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9a77bbec-24b7-45e3-a9da-d0bac9b05df0 req-1bbdac6f-15ac-49b0-b176-a10b26a0ee98 service nova] Creating event network-vif-unplugged:23b3c7e1-ffaf-4afb-81a2-cf840371d46f for instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 on n-h1-858384-19 Nov 02 13:16:32.642142 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9a77bbec-24b7-45e3-a9da-d0bac9b05df0 req-1bbdac6f-15ac-49b0-b176-a10b26a0ee98 service nova] Creating event network-changed:23b3c7e1-ffaf-4afb-81a2-cf840371d46f for instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 on n-h1-858384-19 Nov 02 13:16:32.651094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-9a77bbec-24b7-45e3-a9da-d0bac9b05df0 req-1bbdac6f-15ac-49b0-b176-a10b26a0ee98 service nova] Instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:16:32.669162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:32.669865 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9a77bbec-24b7-45e3-a9da-d0bac9b05df0 req-1bbdac6f-15ac-49b0-b176-a10b26a0ee98 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.060659 Nov 02 13:16:32.669983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:32.671213 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 520/995] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:32.676837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:32.677423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:32.678495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:32.679301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:32.679698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:32.680125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:32.901704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:32.909427 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-46d62d5f-4a66-462d-b8ea-2e4a92865e23 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.244673 Nov 02 13:16:32.910011 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 476/996] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:32 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:33.039159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:33.039967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:33.046885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.047399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.047837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.048544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.048998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.049428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.087879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:33.088488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:33.095553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.096261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.096939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.098216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.098837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.099291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.192234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:33.201355 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f2ee0b9-ce58-48d9-b7c6-839bcb74aa5f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1479 microversion: 2.1 time: 0.167184 Nov 02 13:16:33.201950 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 521/997] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:33 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1479 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:33.206537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ceffeca-4db9-4d23-9463-342506605fad tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7876574c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:33.210440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:33.222359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:33.223938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:33.230447 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-172823f5-e621-4de2-ac67-3f89b5ffcbd3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.147063 Nov 02 13:16:33.231036 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 477/998] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:33 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:33.265693 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ceffeca-4db9-4d23-9463-342506605fad tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.062679 Nov 02 13:16:33.266491 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 522/999] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:33 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:33.326730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:33.327328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:33.335767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.336311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.336744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.337474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.337938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.338368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.424083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1600097068", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "d4fa706d-0b70-4668-8feb-3fb6d614d14b"}], "security_groups": [{"name": "tempest-securitygroup--626746384"}], "key_name": "tempest-keypair-1519404356", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:33.479438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:33.487419 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b066d14-47a7-4b28-92bc-2c4e26ed00c7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.164577 Nov 02 13:16:33.487874 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 478/1000] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:33 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:33.532786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] validate_networks() for [('d4fa706d-0b70-4668-8feb-3fb6d614d14b', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:33.592720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:33.593283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:33.600153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.601220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.601669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.602397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.602859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.603321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.754504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:33.765258 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fbde51b2-186f-4ecc-9574-977f5aed9cc4 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.176705 Nov 02 13:16:33.765990 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 479/1001] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:33 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:33.933141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:33.933669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:33.939685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.940182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.940651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.941319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.941778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.942211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.943910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:16:33.944982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:16:33.945484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:16:33.946073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:16:33.946492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:16:33.955558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.956181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.956626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.957365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:33.957826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:33.958256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:33.978965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for project d89e00efbe3c49019171062c5e914dc9. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:33.984882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for user 4b987e6d2a814bc6b30b8191cfd5351d and project d89e00efbe3c49019171062c5e914dc9. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:33.994842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:34.000680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:16:34.003012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:16:34.057195 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-afbbfce2-14c9-412c-9ebe-da56d960f4b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.25 time: 0.637444 Nov 02 13:16:34.064295 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 523/1002] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:16:33 2022] POST /compute/v2.1/servers => generated 407 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 13:16:34.074221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bd94010b-3f28-44ea-8257-edcf2b1299c7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:34.075518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bd94010b-3f28-44ea-8257-edcf2b1299c7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:34.087567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:34.096009 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3dc637ae-2976-4630-836e-aeb8a7b07bc2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.166960 Nov 02 13:16:34.099182 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 480/1003] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:33 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:34.140329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bd94010b-3f28-44ea-8257-edcf2b1299c7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:34.148678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bd94010b-3f28-44ea-8257-edcf2b1299c7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:34.149995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bd94010b-3f28-44ea-8257-edcf2b1299c7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:34.151105 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bd94010b-3f28-44ea-8257-edcf2b1299c7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1290 microversion: 2.25 time: 0.085758 Nov 02 13:16:34.151697 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 524/1004] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:34 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:34.225916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:34.226526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:34.232924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:34.233410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:34.233844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:34.234534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:34.234982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:34.235425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:34.263197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:34.263795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:34.270686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:34.273428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:34.273995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:34.275083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:34.276060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:34.276657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:34.345222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:34.355104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:34.356800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:34.363591 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f68009bf-5857-4c90-9915-c461dd9c4352 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.104411 Nov 02 13:16:34.364349 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 525/1005] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:34 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:34.370516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6fe63bf5-c133-4a70-bc3d-92146337d952 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787656790>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:34.402212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:34.416880 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ebff7acd-3560-48b6-92c8-cea1d70ea447 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1479 microversion: 2.1 time: 0.195035 Nov 02 13:16:34.422068 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 481/1006] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:34 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1479 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:34.426896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6fe63bf5-c133-4a70-bc3d-92146337d952 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.061227 Nov 02 13:16:34.428304 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 526/1007] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:34 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:34.511379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:34.512250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:34.519674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:34.520616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:34.521356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:34.522355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:34.523088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:34.523728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:34.791066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:34.796209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:34.814997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:34.818640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:34.819996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:34.821834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:34.823023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:34.823540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:34.846352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:34.855973 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce215dc9-e652-4aab-bb86-5c4f08e51b9c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.348214 Nov 02 13:16:34.881018 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 482/1008] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:34 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:34.881996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:35.121717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:35.122604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:35.132712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.133790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.138040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:35.139030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.139714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.140309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:35.375329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:35.385988 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6935415e-984e-4239-84b5-2154dc5b430c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.268601 Nov 02 13:16:35.386879 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 483/1009] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:35 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:35.391937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:35.392821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:35.399573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.400404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.400852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:35.401573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.402375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.402909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:35.417514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:35.431295 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97512369-4fd0-4d8a-8652-0fe55a66b16b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.644621 Nov 02 13:16:35.432523 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 527/1010] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:34 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:35.440893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:35.442407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:35.452483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.452977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.453423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:35.454288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.454778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.455236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:35.485965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:35.498274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:35.499836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:35.500989 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5aee3bee-b9eb-4e98-b478-73336af4a770 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1342 microversion: 2.25 time: 0.113127 Nov 02 13:16:35.501562 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 484/1011] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:35 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1342 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:35.507050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:35.507710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:35.514171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.514657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.515146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:35.515902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.516360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.516833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:35.532493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:35.548072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:35.550424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:35.559458 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0e3d8ecc-81c9-4deb-815a-ddd41cfbc0c1 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.124869 Nov 02 13:16:35.570356 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 528/1012] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:35 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:35.578606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bbe99e76-8ea2-4a67-b654-ca635544e619 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe78761ee50>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:35.641592 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bbe99e76-8ea2-4a67-b654-ca635544e619 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.069176 Nov 02 13:16:35.642189 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 529/1013] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:35 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:35.713880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:35.728314 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c581a5ba-3ca4-4e13-a325-88552fdb7479 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1479 microversion: 2.1 time: 0.225623 Nov 02 13:16:35.729247 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 485/1014] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:35 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1479 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:35.894572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:35.895300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:35.923352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.924097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.924757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:35.925788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:35.926526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:35.927264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.415798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:36.416577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:36.430567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.438677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.439772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.441028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.442548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.442548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.445977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:36.463518 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-282f3c59-237a-4733-bf93-39dfb22aa18e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.574240 Nov 02 13:16:36.467498 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 530/1015] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:35 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:36.480613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:36.483576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:36.490931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.495611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.496133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.496827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.497403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.497813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.746890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:36.764118 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e3eab0e-91cb-41a1-b167-4354f131d649 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.294336 Nov 02 13:16:36.765538 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 531/1016] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:36 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:36.773158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:36.774142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:36.782071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.783537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.784212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.785173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.786048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.787309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.872326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:36.886480 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7e2880c-2316-449f-85da-9be5bfdd002a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.476057 Nov 02 13:16:36.900036 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 486/1017] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:36 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:36.918780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:36.924182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:36.925153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:36.932148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:36.934790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:36.936337 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9682d50c-e215-448e-a7ab-e8eb77509642 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1348 microversion: 2.25 time: 0.169588 Nov 02 13:16:36.937529 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 532/1018] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:36 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1348 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:36.942024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.942530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.943085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:36.944542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-55a7f8d7-5283-4097-b221-f9ceb4758d2b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787662e50>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:36.947989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:36.951603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:36.952162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:37.002252 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-55a7f8d7-5283-4097-b221-f9ceb4758d2b tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.063171 Nov 02 13:16:37.003206 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 533/1019] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:36 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:37.008301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:37.009077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:37.026262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:37.028060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:37.028951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:37.030047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:37.030836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:37.031462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:37.253873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:37.277339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:37.281754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:37.291489 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7369590-8fdc-4d14-b431-9e07e96bd87a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.389323 Nov 02 13:16:37.294715 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 487/1020] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:36 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:37.304320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-cdc9f36f-f723-4939-93d5-7be557160556 req-6bf3e723-922c-4e6a-a5fe-db1bd245f452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8af7fb-9ec0-41f9-b19e-f8a9611be065", "name": "network-vif-plugged", "status": "completed", "tag": "6c00af57-80ac-4518-aa54-e45203b976a5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:37.324289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cdc9f36f-f723-4939-93d5-7be557160556 req-6bf3e723-922c-4e6a-a5fe-db1bd245f452 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:37.325818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cdc9f36f-f723-4939-93d5-7be557160556 req-6bf3e723-922c-4e6a-a5fe-db1bd245f452 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:37.326478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cdc9f36f-f723-4939-93d5-7be557160556 req-6bf3e723-922c-4e6a-a5fe-db1bd245f452 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:37.331303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:37.340972 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-cdc9f36f-f723-4939-93d5-7be557160556 req-6bf3e723-922c-4e6a-a5fe-db1bd245f452 service nova] Creating event network-vif-plugged:6c00af57-80ac-4518-aa54-e45203b976a5 for instance 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 on n-h2-858384-19 Nov 02 13:16:37.348319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-cdc9f36f-f723-4939-93d5-7be557160556 req-6bf3e723-922c-4e6a-a5fe-db1bd245f452 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051675 Nov 02 13:16:37.349629 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 488/1021] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:37.441879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:37.454356 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05fa19f0-c31b-4987-af09-582135b1baa8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1479 microversion: 2.1 time: 0.449866 Nov 02 13:16:37.456768 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 534/1022] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:37 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1479 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:37.498979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:37.500362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:37.507292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:37.508273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:37.508711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:37.509413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:37.510087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:37.510452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:37.796696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:37.797476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:37.801786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:37.811998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:37.812187 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cba52e97-7b67-4fe8-9049-9ad7edb63d55 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.317810 Nov 02 13:16:37.812933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:37.813526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:37.814523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:37.820634 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 489/1023] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:37 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:37.849008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:37.849612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:37.919554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:37.920485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:37.934061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:37.934877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:37.935603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:37.936517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:37.937911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:37.940954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:38.142495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:38.164755 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bc8195dd-aca8-48da-8f8f-6a458a1d9486 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.373789 Nov 02 13:16:38.165833 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 535/1024] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:37 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:38.203365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:38.204918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:38.238887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:38.239474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:38.241291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:38.242192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:38.242669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:38.248605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:38.375842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:38.386816 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c3cff084-8623-4028-8193-b6a837d33365 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1323 microversion: 2.1 time: 0.472581 Nov 02 13:16:38.387441 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 490/1025] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:37 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:38.392158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-82f333e3-3560-4b4c-993a-05cbb1b20300 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787c508b0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:38.502334 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-82f333e3-3560-4b4c-993a-05cbb1b20300 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.113644 Nov 02 13:16:38.503352 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 491/1026] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:38 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:38.508570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:38.509172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:38.528624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:38.529399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:38.530005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:38.530911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:38.531545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:38.532330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:38.643722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:38.646357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:38.656352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:38.661207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:38.662483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-65f4e68c-39fe-45f9-81c4-62800a3c374a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.494359 Nov 02 13:16:38.665418 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 536/1027] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:38 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:38.680052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:38.680897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:38.689941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:38.694328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:38.695227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:38.696158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:38.696782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:38.697381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:38.716386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:38.717957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:38.736789 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe29ec1b-3ec7-4b0d-8033-3b66214f0541 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.232377 Nov 02 13:16:38.739507 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 492/1028] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:38 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:38.848022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:38.848646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:38.857568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:38.858911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:38.859476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:38.860476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:38.861000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:38.861475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:38.987199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:39.003415 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efc6939e-778e-4798-8bb7-61bd6304831d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1479 microversion: 2.1 time: 0.332871 Nov 02 13:16:39.015723 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 537/1029] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:38 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1479 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:39.095913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:39.105599 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04e8846b-7416-4655-a28e-6e0c10adbf9f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.261387 Nov 02 13:16:39.106194 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 493/1030] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:38 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:39.190333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:39.191338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:39.198779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:39.199300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:39.199876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:39.201253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:39.202309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:39.203187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:39.375532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ff29f483-6190-4d59-b622-c2982a692503 req-5ec1a330-450f-4c22-b001-b2f70a4c0507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7abafda-06b1-412b-be6d-88482b4716c1", "name": "network-vif-plugged", "status": "completed", "tag": "bc98d529-d478-4d4a-b88d-9a5c95bb4099"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:39.387655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ff29f483-6190-4d59-b622-c2982a692503 req-5ec1a330-450f-4c22-b001-b2f70a4c0507 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:39.388465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ff29f483-6190-4d59-b622-c2982a692503 req-5ec1a330-450f-4c22-b001-b2f70a4c0507 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:39.392149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:39.396748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ff29f483-6190-4d59-b622-c2982a692503 req-5ec1a330-450f-4c22-b001-b2f70a4c0507 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:39.406439 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87e4ea61-7b9c-46a3-a835-cfb93cebdf17 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.221350 Nov 02 13:16:39.407332 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 538/1031] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:39 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:39.421520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:39.426282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ff29f483-6190-4d59-b622-c2982a692503 req-5ec1a330-450f-4c22-b001-b2f70a4c0507 service nova] Creating event network-vif-plugged:bc98d529-d478-4d4a-b88d-9a5c95bb4099 for instance e7abafda-06b1-412b-be6d-88482b4716c1 on n-h1-858384-19 Nov 02 13:16:39.428056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:39.438858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:39.440797 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ff29f483-6190-4d59-b622-c2982a692503 req-5ec1a330-450f-4c22-b001-b2f70a4c0507 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071738 Nov 02 13:16:39.441785 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 494/1032] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:39.441952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:39.442144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:39.442976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:39.444167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:39.445189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:39.520076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4e77a8ec-051c-4fdc-b848-e87b3d119b51 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787c69f70>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:39.593754 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4e77a8ec-051c-4fdc-b848-e87b3d119b51 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.078840 Nov 02 13:16:39.594352 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 495/1033] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:39 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:39.697504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:39.700118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:39.700920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:39.712472 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed31caf5-c899-4a2c-86d8-69f926f5eca1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1473 microversion: 2.1 time: 0.298795 Nov 02 13:16:39.718646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:39.719779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:39.726730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:39.728052 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 539/1034] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:39 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1473 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:39.728218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:39.728829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:39.729462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:39.736211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:39.737069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:39.745560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:39.746388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:39.747021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:39.747955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:39.748597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:39.749458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:40.017079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.027962 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1686bfa1-f931-451a-9bc6-b10531b12182 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 200 len: 1323 microversion: 2.1 time: 0.295627 Nov 02 13:16:40.031158 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 540/1035] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:39 2022] GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:40.033899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:40.034754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:40.042119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:40.042386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:40.042803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:40.043626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:40.044082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:40.044518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:40.093193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.108630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.114209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.117297 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d4be0b2f-f162-41d8-a1ab-6582f79c647e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.422367 Nov 02 13:16:40.118495 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 496/1036] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:39 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:40.135075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:40.136528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:40.143943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:40.144722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:40.145332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:40.147000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:40.148253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:40.148861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:40.159284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.169146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.170711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.178191 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8f8439c9-39fe-47ae-8eae-18343e6b80c6 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.147160 Nov 02 13:16:40.178816 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 541/1037] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:40 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:40.185054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:40.186087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:40.193068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:40.194433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:40.195184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:40.201961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:40.202792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:40.203504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:40.461800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.479729 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f7bc50f-bd02-483c-816f-54afa272743f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.298719 Nov 02 13:16:40.485279 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 542/1038] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:40 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:40.516346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.527549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:40.534707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:40.541919 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-603331b2-865b-49bb-9701-3b8aebcd8034 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1477 microversion: 2.1 time: 0.422043 Nov 02 13:16:40.551867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:40.553405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:40.554093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:40.555424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:40.557951 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 497/1039] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:40 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1477 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:40.563830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:40.564321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:40.616902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c2c31330-12f1-40e2-b6ba-987a3e6242c5 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787b2c8b0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:40.698474 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c2c31330-12f1-40e2-b6ba-987a3e6242c5 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.087994 Nov 02 13:16:40.699786 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 498/1040] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:40 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:40.770181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:40.787253 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5448c74c-298b-4f8a-8a4d-7bb2601e4653 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.270866 Nov 02 13:16:40.790263 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 543/1041] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:40 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:40.978051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d04a22dd-8ea9-4d37-ade4-4754c856e862 req-7f122fd0-de96-4043-a650-c95fd31b0d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed1faa6-e6ad-4757-992d-0750ae29a307", "tag": "530566a3-df01-427e-bd74-d9826d6be3a7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:41.003251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d04a22dd-8ea9-4d37-ade4-4754c856e862 req-7f122fd0-de96-4043-a650-c95fd31b0d7c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.004598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d04a22dd-8ea9-4d37-ade4-4754c856e862 req-7f122fd0-de96-4043-a650-c95fd31b0d7c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.017110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d04a22dd-8ea9-4d37-ade4-4754c856e862 req-7f122fd0-de96-4043-a650-c95fd31b0d7c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.046020 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d04a22dd-8ea9-4d37-ade4-4754c856e862 req-7f122fd0-de96-4043-a650-c95fd31b0d7c service nova] Creating event network-changed:530566a3-df01-427e-bd74-d9826d6be3a7 for instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 on n-h2-858384-19 Nov 02 13:16:41.053193 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d04a22dd-8ea9-4d37-ade4-4754c856e862 req-7f122fd0-de96-4043-a650-c95fd31b0d7c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081478 Nov 02 13:16:41.054228 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 499/1042] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:41.059010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:41.059703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:41.069920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.070535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.070995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.072042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.072680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.073277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.166801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:41.168953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:41.241183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.243929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.244875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.246334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.246909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.247612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.290841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:41.306266 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93b5651c-2c56-4886-b1da-8eaabfdda0bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 200 len: 1323 microversion: 2.1 time: 0.255727 Nov 02 13:16:41.306938 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 544/1043] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:41 2022] GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 1323 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:41.313647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:41.314564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:41.323994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.324499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.325137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.326301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.326944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.328232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.453562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:41.465107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:41.467024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:41.473076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68983d8d-4d69-498f-a39d-949edc99a4d0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.165031 Nov 02 13:16:41.474703 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 545/1044] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:41 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:41.530082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:41.531069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:41.543503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.544249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.544936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.545821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.546520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.547103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.579539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:41.658222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:41.677904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:41.679898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:41.681428 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4190712c-ef38-4e98-9d97-c51daea808bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.529247 Nov 02 13:16:41.684251 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 500/1045] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:41 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:41.695922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:41.697479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:41.712286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.715989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.716458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.717219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.717686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.718120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.807431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:41.817470 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd5de374-0b1e-42fb-8f6e-cef6d0d4104a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.292111 Nov 02 13:16:41.819081 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 546/1046] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:41 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:41.824830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69b79073-8770-4110-96d4-703c2997c674 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787623af0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:41.879812 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69b79073-8770-4110-96d4-703c2997c674 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.058733 Nov 02 13:16:41.882527 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 547/1047] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:41 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:41.889534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:41.890781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:41.901414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.909335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.910126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.911179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:41.914227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:41.914951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:41.987055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:41.997750 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22ee38dc-816f-413c-89c2-dca2edb48812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1477 microversion: 2.1 time: 0.312333 Nov 02 13:16:42.003450 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 501/1048] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:41 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:42.144955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.153992 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-61e92ce4-180b-44db-8bd4-60493ac2363e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.270074 Nov 02 13:16:42.155077 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 548/1049] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:41 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:42.343264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:42.343890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:42.365936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.366433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.367427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.368163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.368636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.369068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.512133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:42.512884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:42.519283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.519767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.520234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.521025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.521498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.521939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.627064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.640460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.642802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.646762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.653080 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-03cb3197-7c8c-44aa-838a-c07344ddc5c4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.147856 Nov 02 13:16:42.665250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-495e78f4-3cde-47a4-bcc5-e8f0b4d42648 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 200 len: 1472 microversion: 2.1 time: 0.327048 Nov 02 13:16:42.668408 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 549/1050] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:42 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:42.679451 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 502/1051] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:42 2022] GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 1472 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:42.688860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:42.694147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.695098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Searching by: {'reservation_id': 'r-mpdhlool', 'deleted': False, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:42.700610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.701094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.701530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.702258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.709732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:42.710329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:42.715880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.716397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.721910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.722427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.722847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.726124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.726124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.726389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.823667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:16:42.938274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.947667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:42.948590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:42.949402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:42.971803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.987239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.996629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:42.997849 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cd7a3efa-2bcd-49d8-80e0-c4ab24448009 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.292273 Nov 02 13:16:43.011457 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 503/1052] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:42 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:43.018170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:43.018170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:43.030931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.038013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.040536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.042310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.043946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.044730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.154601 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7507fc66-93ff-42c9-b3ef-741d35c273a3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/detail?reservation_id=r-mpdhlool" status: 200 len: 2938 microversion: 2.1 time: 0.468631 Nov 02 13:16:43.167152 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 550/1053] 10.222.0.113 () {58 vars in 1202 bytes} [Wed Nov 2 13:16:42 2022] GET /compute/v2.1/servers/detail?reservation_id=r-mpdhlool => generated 2938 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:43.167152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e4fbb8ea-ad72-45c0-9853-e0f490dba481 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787642280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:43.249386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:43.265635 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d14bb1d-2bba-491f-bc4c-278ac5df877a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.258850 Nov 02 13:16:43.296597 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e4fbb8ea-ad72-45c0-9853-e0f490dba481 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.139920 Nov 02 13:16:43.297388 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 504/1054] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:42 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:43.299725 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 551/1055] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:43 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:43.311171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:43.311830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:43.329635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:43.330291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:43.336053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.337063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.337504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.338771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.339630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.339770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.340183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.340557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.340693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.341428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.341887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.342314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.521091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:43.530443 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd830fe6-cfca-4caf-baec-df31cc000e9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1477 microversion: 2.1 time: 0.231897 Nov 02 13:16:43.531421 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 505/1056] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:43 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1477 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:43.542911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2c426a09-905d-49ed-a4b0-5a655962d85c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:43.594869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.compute.server_groups [None req-2c426a09-905d-49ed-a4b0-5a655962d85c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Querying cell 9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) for 2 instances {{(pid=120929) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 13:16:43.595543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c426a09-905d-49ed-a4b0-5a655962d85c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.596024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c426a09-905d-49ed-a4b0-5a655962d85c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.597212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c426a09-905d-49ed-a4b0-5a655962d85c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.608733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:43.617503 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f2b91d67-f110-4027-9d8d-4818bf425759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.302562 Nov 02 13:16:43.629934 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 552/1057] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:43 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:43.642707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b6245307-c36f-4c42-8b5a-07c317f07d40 req-8a801dda-9a12-40aa-86ba-6aae26babd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8f4a4c-224d-4a42-9b89-dadf667e644b", "name": "network-vif-plugged", "status": "completed", "tag": "9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:43.662824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b6245307-c36f-4c42-8b5a-07c317f07d40 req-8a801dda-9a12-40aa-86ba-6aae26babd25 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.667990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b6245307-c36f-4c42-8b5a-07c317f07d40 req-8a801dda-9a12-40aa-86ba-6aae26babd25 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.671902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b6245307-c36f-4c42-8b5a-07c317f07d40 req-8a801dda-9a12-40aa-86ba-6aae26babd25 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.678751 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2c426a09-905d-49ed-a4b0-5a655962d85c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups/5dd3866b-0d34-4e45-8249-394322194b66" status: 200 len: 271 microversion: 2.1 time: 0.145779 Nov 02 13:16:43.681021 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 506/1058] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:16:43 2022] GET /compute/v2.1/os-server-groups/5dd3866b-0d34-4e45-8249-394322194b66 => generated 271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:43.686273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:43.687235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:43.695397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.696306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.697009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.698055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.698903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.699624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.705531 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b6245307-c36f-4c42-8b5a-07c317f07d40 req-8a801dda-9a12-40aa-86ba-6aae26babd25 service nova] Creating event network-vif-plugged:9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d for instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b on n-h2-858384-19 Nov 02 13:16:43.719983 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b6245307-c36f-4c42-8b5a-07c317f07d40 req-8a801dda-9a12-40aa-86ba-6aae26babd25 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089862 Nov 02 13:16:43.721062 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 553/1059] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:43.729859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1a409950-289a-4946-8d6e-8fe074fdb4af tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:43.730686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1a409950-289a-4946-8d6e-8fe074fdb4af tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:43.747427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a409950-289a-4946-8d6e-8fe074fdb4af tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.748080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a409950-289a-4946-8d6e-8fe074fdb4af tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.748626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a409950-289a-4946-8d6e-8fe074fdb4af tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.749464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a409950-289a-4946-8d6e-8fe074fdb4af tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:43.757124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a409950-289a-4946-8d6e-8fe074fdb4af tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:43.757731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a409950-289a-4946-8d6e-8fe074fdb4af tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:43.840379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:43.852117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:43.853573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:43.868375 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3351a5e5-3b65-441f-82d6-f3b18d133552 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.186013 Nov 02 13:16:43.868984 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 507/1060] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:43 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:43.984736 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1a409950-289a-4946-8d6e-8fe074fdb4af tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 200 len: 1625 microversion: 2.1 time: 0.262299 Nov 02 13:16:43.985661 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 554/1061] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:43 2022] GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 1625 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:44.012551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-23689192-37e6-4efb-b039-b5776882a85f tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:44.014151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-23689192-37e6-4efb-b039-b5776882a85f tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:44.031875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:44.032778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:44.042123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.042914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.043565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.044440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23689192-37e6-4efb-b039-b5776882a85f tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.044622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.045219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23689192-37e6-4efb-b039-b5776882a85f tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.045395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.046850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.047481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23689192-37e6-4efb-b039-b5776882a85f tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.048940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23689192-37e6-4efb-b039-b5776882a85f tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.051709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23689192-37e6-4efb-b039-b5776882a85f tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.053077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23689192-37e6-4efb-b039-b5776882a85f tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.244185 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-23689192-37e6-4efb-b039-b5776882a85f tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1626 microversion: 2.1 time: 0.238804 Nov 02 13:16:44.259480 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 508/1062] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:44 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1626 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:44.268474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:44.280082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:44.281779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:44.283291 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-46d466cd-a024-42ff-b69c-2c38d98c3931 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.257392 Nov 02 13:16:44.284349 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 555/1063] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:44 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:44.297869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:44.298614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:44.309687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.309687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.310050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.310882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.311450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.316482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4d305f22-5379-463a-882e-26ab3cabce53 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787547280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:44.322783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.398552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4d305f22-5379-463a-882e-26ab3cabce53 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.085745 Nov 02 13:16:44.402120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 556/1064] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:44 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:44.404746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-408274375", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8cd2a3ab-5b0a-47ad-8467-33b0414c55e1"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:44.473432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:44.554998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:44.571353 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b776a49b-247d-417c-b5a0-6d451dc3d78f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 0.277541 Nov 02 13:16:44.589002 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 509/1065] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:44 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:44.599616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:44.601808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:44.611415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.611964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.612727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.613959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.615278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.615989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.623952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:44.892694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:44.905477 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-13ce403f-d92d-4a23-80fd-8397f2ded253 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1474 microversion: 2.1 time: 0.312961 Nov 02 13:16:44.907084 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 510/1066] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:44 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1474 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:44.917368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:44.918786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:44.926426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:44.930164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.932095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.932909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.934057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:44.935311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:44.936255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:44.984192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:16:44.985185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:16:44.986529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:16:44.987203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:16:44.987890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:16:45.009446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.010623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.011702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.012482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.017509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.018193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.047749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:45.057474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:45.082107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:16:45.087766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:16:45.166925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.176060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-883f7cfc-a328-4540-926b-b0268d3e26ee tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.773289 Nov 02 13:16:45.178305 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 557/1067] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:16:44 2022] POST /compute/v2.1/servers => generated 382 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:16:45.188218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:45.188895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:45.195568 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b751ef84-d6f6-4ef9-9b42-5d00d2b6c59f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.285611 Nov 02 13:16:45.205722 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 511/1068] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:44 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:45.206203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.206852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.207332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.208055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.208601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.209260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.239090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-36657da6-dc49-447f-b8e3-fbe1cc3276cd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:45.240711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-36657da6-dc49-447f-b8e3-fbe1cc3276cd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:45.263365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36657da6-dc49-447f-b8e3-fbe1cc3276cd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.266362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36657da6-dc49-447f-b8e3-fbe1cc3276cd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.267177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36657da6-dc49-447f-b8e3-fbe1cc3276cd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.268417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36657da6-dc49-447f-b8e3-fbe1cc3276cd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.271005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36657da6-dc49-447f-b8e3-fbe1cc3276cd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.271920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36657da6-dc49-447f-b8e3-fbe1cc3276cd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.348857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.358321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.359855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.366087 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cf4db79c-402e-4c78-89ab-70cf6d7a5754 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.186568 Nov 02 13:16:45.380913 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 558/1069] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:45 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:45.392805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b0e5e17-8ad2-41d1-8809-7df69c7d1a55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:45.393431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b0e5e17-8ad2-41d1-8809-7df69c7d1a55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:45.444378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-36657da6-dc49-447f-b8e3-fbe1cc3276cd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4/action" status: 204 len: 0 microversion: 2.1 time: 0.233440 Nov 02 13:16:45.448265 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 512/1070] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:16:45 2022] POST /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4/action => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:16:45.466506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:45.467834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:45.471606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0b0e5e17-8ad2-41d1-8809-7df69c7d1a55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.481438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.482449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.483250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.484491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.485834 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b0e5e17-8ad2-41d1-8809-7df69c7d1a55 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1220 microversion: 2.1 time: 0.103379 Nov 02 13:16:45.486264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.487302 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 559/1071] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:45 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:45.496433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-db973165-764e-44cc-8cca-ab4799813fd7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe78766e790>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:45.496581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.601107 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-db973165-764e-44cc-8cca-ab4799813fd7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.112285 Nov 02 13:16:45.601692 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 560/1072] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:45 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:45.612633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:45.613249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:45.621307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.621988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.622432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.626013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:45.626503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:45.626943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:45.872532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.897682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.916866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.923646 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-256cc4ae-93c6-43fe-85f2-49b9fafd1339 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.471898 Nov 02 13:16:45.946063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:45.961056 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 513/1073] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:45 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:45.966116 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0678a893-fe74-4e8e-8e5a-2ff6f3506331 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1474 microversion: 2.1 time: 0.363311 Nov 02 13:16:45.968061 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 561/1074] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:45 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:45.990121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:45.996764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:46.017221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:46.019648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:46.022003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:46.022876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:46.024289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:46.024823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:46.249743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:46.250953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:46.253382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:46.269190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:46.283684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:46.293923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:46.325053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:46.325574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:46.326826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:46.764956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:46.781440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-117b3abb-b513-4c58-a39d-89edcfc5d533 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.537611 Nov 02 13:16:46.782309 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 562/1075] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:46 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:46.805110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:46.807267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:46.818958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:46.825654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:46.826223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:46.827008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:46.827689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:46.828225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.012757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:47.039833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:47.050830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:47.077412 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-834a1da1-06aa-4d0d-91c3-39a2881b0dcf tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.293617 Nov 02 13:16:47.093300 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 563/1076] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:46 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:47.108917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:47.109538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:47.138684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.139443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.140002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.140878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.142063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.142624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.153147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:47.176458 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fbc67cfb-e4ff-4f18-a7cd-251ea662ac01 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1318 microversion: 2.1 time: 1.201587 Nov 02 13:16:47.183903 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 514/1077] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:45 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1318 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:47.190900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92cd8c0a-0c8d-4985-a897-df69035edecb tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787ad5a60>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:47.284608 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-92cd8c0a-0c8d-4985-a897-df69035edecb tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.098389 Nov 02 13:16:47.285620 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 515/1078] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:47 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:47.298078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:47.298865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:47.311588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.312441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.313088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.328213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.328981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.329649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.584970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:47.595665 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-24c6a027-21f1-4446-9f19-a873e1a7ee2f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1272 microversion: 2.1 time: 0.501201 Nov 02 13:16:47.596271 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 564/1079] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:47 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1272 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:47.603391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:47.604037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:47.623503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.623912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.624350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.625077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.625536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.626174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.696814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:47.729587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:47.736696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:47.741132 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b4be1fd-cce7-489b-9b04-96b35f47d1cb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.451689 Nov 02 13:16:47.742213 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 516/1080] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:47 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:47.811518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:47.812494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:47.829028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.830330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.831019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:47.832198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:47.833207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:47.834058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.033469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:48.057609 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5b8825bf-842a-448f-8fbe-356d789cf2f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1474 microversion: 2.1 time: 0.460094 Nov 02 13:16:48.058811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 565/1081] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:47 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1474 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:48.137543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:48.138676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:48.152227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:48.159065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.160865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.163588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.165329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.166505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.167245 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aced24c9-19db-4ee2-bb4c-bbc1d2e8f0e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1364 microversion: 2.1 time: 0.360114 Nov 02 13:16:48.179257 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 517/1082] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:47 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1364 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:48.180312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.212830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:48.214197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:48.221912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.227345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.228257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.229300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.230034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.230721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.346248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:48.375296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:48.381223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:48.415398 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6eb3ac57-83d9-4311-a0a1-8676451e6227 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.270520 Nov 02 13:16:48.427972 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 566/1083] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:48 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:48.442227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:48.445077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84027fab-64c4-4c6c-a892-b1ffeb6ba939 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787509700>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:48.468444 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de622a04-36f2-42e8-9aec-89bc3526a91a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1467 microversion: 2.1 time: 0.260664 Nov 02 13:16:48.487139 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 518/1084] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:48 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1467 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:48.487139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6b4ecd69-9bc5-4cd9-96f5-d95b82951521 req-feb280de-1715-4a78-adcc-afe059fad1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4", "name": "network-vif-plugged", "status": "completed", "tag": "23b3c7e1-ffaf-4afb-81a2-cf840371d46f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:48.513605 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84027fab-64c4-4c6c-a892-b1ffeb6ba939 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.084576 Nov 02 13:16:48.514595 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 567/1085] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:48 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:48.525544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6b4ecd69-9bc5-4cd9-96f5-d95b82951521 req-feb280de-1715-4a78-adcc-afe059fad1eb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.526335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6b4ecd69-9bc5-4cd9-96f5-d95b82951521 req-feb280de-1715-4a78-adcc-afe059fad1eb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.526773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6b4ecd69-9bc5-4cd9-96f5-d95b82951521 req-feb280de-1715-4a78-adcc-afe059fad1eb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.551917 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6b4ecd69-9bc5-4cd9-96f5-d95b82951521 req-feb280de-1715-4a78-adcc-afe059fad1eb service nova] Creating event network-vif-plugged:23b3c7e1-ffaf-4afb-81a2-cf840371d46f for instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 on n-h1-858384-19 Nov 02 13:16:48.554731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-6b4ecd69-9bc5-4cd9-96f5-d95b82951521 req-feb280de-1715-4a78-adcc-afe059fad1eb service nova] Instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:16:48.569432 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6b4ecd69-9bc5-4cd9-96f5-d95b82951521 req-feb280de-1715-4a78-adcc-afe059fad1eb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096216 Nov 02 13:16:48.570317 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 519/1086] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:48.601793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97344f86-bb16-4f9f-81b4-7a2d339c9dd0 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:48.607629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-97344f86-bb16-4f9f-81b4-7a2d339c9dd0 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Searching by: {'deleted': False, 'project_id': '9ae15394f93e47e694fafa8a6c963870'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:48.614773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97344f86-bb16-4f9f-81b4-7a2d339c9dd0 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.615295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97344f86-bb16-4f9f-81b4-7a2d339c9dd0 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.616027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97344f86-bb16-4f9f-81b4-7a2d339c9dd0 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.616709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97344f86-bb16-4f9f-81b4-7a2d339c9dd0 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.617168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97344f86-bb16-4f9f-81b4-7a2d339c9dd0 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.617602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97344f86-bb16-4f9f-81b4-7a2d339c9dd0 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.633393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:48.634254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:48.643043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.643692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.644223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.646556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.647219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.647753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.759840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:48.760784 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97344f86-bb16-4f9f-81b4-7a2d339c9dd0 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.244885 Nov 02 13:16:48.761728 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 568/1087] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:16:48 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:16:48.770392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:48.771720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:48.788453 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-68fbc5a2-5fc3-421a-875f-bc969f38a017 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1278 microversion: 2.1 time: 0.160181 Nov 02 13:16:48.788740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.789151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.789725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.790459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.790695 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 520/1088] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:48 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:48.791004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.791691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.824227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:48.842021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Searching by: {'deleted': False} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:48.859922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.861648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.865524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:48.869813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:48.870528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:48.871049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:49.054510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:49.068512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:49.070044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:49.077568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Listed batch of 19 results from cell out of 1000 limit. Returned 19 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:16:49.086428 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4f768aa-127e-4573-9ab6-7df7c53d4775 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.317818 Nov 02 13:16:49.090351 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 569/1089] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:48 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:49.104238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:49.105004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:49.127488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:49.127987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:49.128432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:49.129151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:49.132702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:49.133212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:49.149191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:49.251790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:49.252337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:49.252702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:49.496755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:49.505064 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71bcbf01-7dfa-40b7-92df-c16c807b2964 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1474 microversion: 2.1 time: 0.404524 Nov 02 13:16:49.520259 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 570/1090] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:49 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1474 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:49.528948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:49.531882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:49.545914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:49.549857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:49.550620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:49.557170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:49.558847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:49.560930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:49.932516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:49.949925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-92c792d7-0e25-4c59-bad2-710d6a806732 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1545 microversion: 2.1 time: 0.428193 Nov 02 13:16:49.951420 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 571/1091] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:49 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1545 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:49.958003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:49.958870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:49.970330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:49.970840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:49.971339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:49.972848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:49.974125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:49.976233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:50.516777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:50.527379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:50.540654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:50.559458 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-575cf2bc-6f71-4599-8f4b-7c37b6459a8d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.606388 Nov 02 13:16:50.560457 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 572/1092] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:49 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:50.568159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3dd014fa-3dd3-4277-9fdf-e5898e8470ff tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787578820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:50.616940 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7b05149c-b0ab-4347-b2f6-a7084792e98a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 30499 microversion: 2.1 time: 1.822665 Nov 02 13:16:50.618026 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 521/1093] 10.222.0.113 () {58 vars in 1176 bytes} [Wed Nov 2 13:16:48 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 30499 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:16:50.628186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:50.629221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:50.629589 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3dd014fa-3dd3-4277-9fdf-e5898e8470ff tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.067132 Nov 02 13:16:50.631969 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 573/1094] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:50 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:50.647494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:50.649092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44afa5b5-6c30-4843-a601-18fd4b7e3583 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:50.649772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-44afa5b5-6c30-4843-a601-18fd4b7e3583 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:50.649971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:50.650580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:50.655151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:50.657787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:50.659526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:50.664946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44afa5b5-6c30-4843-a601-18fd4b7e3583 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:50.665813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44afa5b5-6c30-4843-a601-18fd4b7e3583 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:50.666520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44afa5b5-6c30-4843-a601-18fd4b7e3583 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:50.667414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44afa5b5-6c30-4843-a601-18fd4b7e3583 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:50.668030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44afa5b5-6c30-4843-a601-18fd4b7e3583 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:50.668601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44afa5b5-6c30-4843-a601-18fd4b7e3583 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:50.824317 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44afa5b5-6c30-4843-a601-18fd4b7e3583 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181485 Nov 02 13:16:50.832747 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 574/1095] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:16:50 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:50.838569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:50.839503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:50.847803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:50.849360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:50.850284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:50.851630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:50.852288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:50.852963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.080320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:51.092906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:51.094860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:51.096730 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-66faf233-a657-4e2e-aa02-8c849c9bfc98 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.262482 Nov 02 13:16:51.108044 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 575/1096] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:50 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:51.133101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:51.133743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:51.151208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.155600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.156225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.156991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.157471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.157958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.391753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:51.412373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:51.413389 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bbd8b345-64d2-496f-b71e-b6d38e5add58 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1466 microversion: 2.1 time: 0.303392 Nov 02 13:16:51.414776 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 576/1097] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:51 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1466 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:51.423334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d39328ba-2e2d-4e51-9c0d-9a9933355971 req-e9bad1a5-94f6-4ec0-9f49-ee9fecd2e3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed1faa6-e6ad-4757-992d-0750ae29a307", "name": "network-vif-plugged", "status": "completed", "tag": "530566a3-df01-427e-bd74-d9826d6be3a7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:51.439724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d39328ba-2e2d-4e51-9c0d-9a9933355971 req-e9bad1a5-94f6-4ec0-9f49-ee9fecd2e3c0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.439978 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-11e431cb-008f-48ce-807a-25a1c3079e10 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.820473 Nov 02 13:16:51.440775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d39328ba-2e2d-4e51-9c0d-9a9933355971 req-e9bad1a5-94f6-4ec0-9f49-ee9fecd2e3c0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.440895 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 522/1098] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:50 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:51.441811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d39328ba-2e2d-4e51-9c0d-9a9933355971 req-e9bad1a5-94f6-4ec0-9f49-ee9fecd2e3c0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.447416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42942740-b260-4898-979e-fe5742b7d8cf tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:51.460130 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d39328ba-2e2d-4e51-9c0d-9a9933355971 req-e9bad1a5-94f6-4ec0-9f49-ee9fecd2e3c0 service nova] Creating event network-vif-plugged:530566a3-df01-427e-bd74-d9826d6be3a7 for instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 on n-h2-858384-19 Nov 02 13:16:51.464983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-42942740-b260-4898-979e-fe5742b7d8cf tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Searching by: {'deleted': False, 'project_id': '9ae15394f93e47e694fafa8a6c963870'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:51.468659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d39328ba-2e2d-4e51-9c0d-9a9933355971 req-e9bad1a5-94f6-4ec0-9f49-ee9fecd2e3c0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051816 Nov 02 13:16:51.469895 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 577/1099] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:51.478166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d3f1496-f262-4744-99d5-a6f837ca2b7d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:51.479027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d3f1496-f262-4744-99d5-a6f837ca2b7d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:51.488203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d3f1496-f262-4744-99d5-a6f837ca2b7d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.488203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d3f1496-f262-4744-99d5-a6f837ca2b7d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.488203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d3f1496-f262-4744-99d5-a6f837ca2b7d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.488203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d3f1496-f262-4744-99d5-a6f837ca2b7d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.488962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d3f1496-f262-4744-99d5-a6f837ca2b7d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.488962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d3f1496-f262-4744-99d5-a6f837ca2b7d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.490325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42942740-b260-4898-979e-fe5742b7d8cf tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.490325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42942740-b260-4898-979e-fe5742b7d8cf tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.491290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42942740-b260-4898-979e-fe5742b7d8cf tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.497245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42942740-b260-4898-979e-fe5742b7d8cf tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.497857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42942740-b260-4898-979e-fe5742b7d8cf tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.498312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42942740-b260-4898-979e-fe5742b7d8cf tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.653446 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-42942740-b260-4898-979e-fe5742b7d8cf tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/detail?tenant_id=ee640ec7f0fd4d7a96969792712a4298" status: 200 len: 15 microversion: 2.1 time: 0.211450 Nov 02 13:16:51.654088 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 523/1100] 10.222.0.113 () {58 vars in 1236 bytes} [Wed Nov 2 13:16:51 2022] GET /compute/v2.1/servers/detail?tenant_id=ee640ec7f0fd4d7a96969792712a4298 => generated 15 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:16:51.680745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:51.681390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:51.688157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.688652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.689246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.689978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.690443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.690869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.863961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:51.872866 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d3f1496-f262-4744-99d5-a6f837ca2b7d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1619 microversion: 2.1 time: 0.401250 Nov 02 13:16:51.875354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:51.876859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:51.885618 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cc6aa84e-e0a7-4147-86ec-7d07ffd97cd4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.216552 Nov 02 13:16:51.899185 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 578/1101] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:51 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1619 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:51.899795 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 524/1102] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:51 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:51.903251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5c9bd68d-b6f0-4a4a-a79f-75b00f23bf6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787578dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:51.910031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:51.920649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Searching by: {'tenant_id': 'ee640ec7f0fd4d7a96969792712a4298', 'deleted': False} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:51.944844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.945679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.946395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.947636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:51.948616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:51.949569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:51.990859 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5c9bd68d-b6f0-4a4a-a79f-75b00f23bf6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.100102 Nov 02 13:16:51.992280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 579/1103] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:51 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:51.995149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:16:51.997435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c75b1fe9-9fc2-4027-9939-b1fb9d4a8003 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '.version_select at 0x7fe787547b80>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:52.001799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c75b1fe9-9fc2-4027-9939-b1fb9d4a8003 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.002452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c75b1fe9-9fc2-4027-9939-b1fb9d4a8003 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.003007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c75b1fe9-9fc2-4027-9939-b1fb9d4a8003 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.014592 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c75b1fe9-9fc2-4027-9939-b1fb9d4a8003 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 1965 microversion: 2.1 time: 0.021087 Nov 02 13:16:52.015831 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 580/1104] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:16:51 2022] GET /compute/v2.1/os-migrations => generated 1965 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:52.129082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.129612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.131272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.131772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:52.132969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:52.143150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.143521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.143951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.144673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.145248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.145604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.346861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:52.359859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:52.361601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:52.362857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2c4bc1f5-095f-453b-9331-457470d29793 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.237478 Nov 02 13:16:52.375285 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 581/1105] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:52 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:52.375285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-437252359", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:52.451871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:52.758416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:16:52.759540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:16:52.760339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:16:52.761121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:16:52.768791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:16:52.784693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.785340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.787493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.788854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.789439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.790132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.817366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:52.824554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for user e7104fb14f5c430a8bfd7e6aa7ada5ee and project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:52.852117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:16:52.857851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:16:52.922323 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4cbf1a31-7323-4436-8427-ffcbaae6fd1a tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ee640ec7f0fd4d7a96969792712a4298" status: 200 len: 4844 microversion: 2.1 time: 1.020891 Nov 02 13:16:52.923966 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 525/1106] 10.222.0.113 () {58 vars in 1262 bytes} [Wed Nov 2 13:16:51 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ee640ec7f0fd4d7a96969792712a4298 => generated 4844 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:52.930181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:52.931732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:52.946398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.948686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.949796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.956990 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5cb4cd30-a2ef-4578-8865-727aead968b4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.592369 Nov 02 13:16:52.959963 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 582/1107] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:16:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:16:52.963963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.964845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.969603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:52.970433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:52.971275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.981416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.982190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.982814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:52.983903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:52.984554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:52.985185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.054710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:53.114602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.127206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.132336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.147763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16b5cae1-cf84-4f02-a1a8-8bd314e2c83f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.184693 Nov 02 13:16:53.174646 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 583/1108] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:52 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:53.180115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad02bae8-2bce-41c0-ae29-c21babf17616 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:53.203035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ad02bae8-2bce-41c0-ae29-c21babf17616 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Searching by: {'tenant_id': '9ae15394f93e47e694fafa8a6c963870', 'deleted': False} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:53.232330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad02bae8-2bce-41c0-ae29-c21babf17616 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.233167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad02bae8-2bce-41c0-ae29-c21babf17616 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.233929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad02bae8-2bce-41c0-ae29-c21babf17616 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.237994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad02bae8-2bce-41c0-ae29-c21babf17616 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.238802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad02bae8-2bce-41c0-ae29-c21babf17616 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.239505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad02bae8-2bce-41c0-ae29-c21babf17616 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.288135 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ad02bae8-2bce-41c0-ae29-c21babf17616 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9ae15394f93e47e694fafa8a6c963870" status: 200 len: 15 microversion: 2.1 time: 0.112002 Nov 02 13:16:53.306087 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 584/1109] 10.222.0.113 () {58 vars in 1262 bytes} [Wed Nov 2 13:16:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9ae15394f93e47e694fafa8a6c963870 => generated 15 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:16:53.312144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae256b64-4908-4356-b167-18838520519b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:53.313264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae256b64-4908-4356-b167-18838520519b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:53.401182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae256b64-4908-4356-b167-18838520519b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.412666 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae256b64-4908-4356-b167-18838520519b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1216 microversion: 2.1 time: 0.104992 Nov 02 13:16:53.424621 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 585/1110] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:53 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1216 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:53.439402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.439606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-764c2ea6-45f5-4d83-81c3-d7e6ea24db74 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7876570d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:53.459050 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d1d20bf-c04c-4d70-96ea-17b952b0a01e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.531374 Nov 02 13:16:53.461427 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 526/1111] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:52 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:53.481675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-460eb665-4aad-4379-b565-37110bb1e5d8 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:53.497760 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-460eb665-4aad-4379-b565-37110bb1e5d8 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.034958 Nov 02 13:16:53.503035 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 527/1112] 10.222.0.113 () {58 vars in 1194 bytes} [Wed Nov 2 13:16:53 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:16:53.510103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:53.510720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:53.543072 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-764c2ea6-45f5-4d83-81c3-d7e6ea24db74 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1431 microversion: 2.1 time: 0.117196 Nov 02 13:16:53.543892 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 586/1113] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:53 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1431 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:53.547612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.548783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.550117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.551076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.552806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.553964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.562459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9ee892ec-82c9-498a-b3fe-9bd17218fedc req-384731eb-96de-47d9-9069-74bcde1a94cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b594218-5f5b-47ae-8c89-b9a4ea8cb794", "tag": "1c071412-832b-48a0-9f41-3f56b4b64a08"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:53.595642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9ee892ec-82c9-498a-b3fe-9bd17218fedc req-384731eb-96de-47d9-9069-74bcde1a94cf service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.596122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9ee892ec-82c9-498a-b3fe-9bd17218fedc req-384731eb-96de-47d9-9069-74bcde1a94cf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.596555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9ee892ec-82c9-498a-b3fe-9bd17218fedc req-384731eb-96de-47d9-9069-74bcde1a94cf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.623215 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9ee892ec-82c9-498a-b3fe-9bd17218fedc req-384731eb-96de-47d9-9069-74bcde1a94cf service nova] Creating event network-changed:1c071412-832b-48a0-9f41-3f56b4b64a08 for instance 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 on n-h2-858384-19 Nov 02 13:16:53.633412 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9ee892ec-82c9-498a-b3fe-9bd17218fedc req-384731eb-96de-47d9-9069-74bcde1a94cf service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086894 Nov 02 13:16:53.638573 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 587/1114] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:53.650936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0497e079-8026-4c6f-994b-f904394ef2c2 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:53.654069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0497e079-8026-4c6f-994b-f904394ef2c2 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:53.665736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0497e079-8026-4c6f-994b-f904394ef2c2 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.667240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0497e079-8026-4c6f-994b-f904394ef2c2 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.668211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0497e079-8026-4c6f-994b-f904394ef2c2 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.669213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0497e079-8026-4c6f-994b-f904394ef2c2 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.669991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0497e079-8026-4c6f-994b-f904394ef2c2 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.671320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0497e079-8026-4c6f-994b-f904394ef2c2 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.808276 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0497e079-8026-4c6f-994b-f904394ef2c2 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action" status: 202 len: 0 microversion: 2.1 time: 0.168251 Nov 02 13:16:53.808740 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 588/1115] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:16:53 2022] POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:16:53.820640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:53.825923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.826772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:53.832898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.833410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.834073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.835035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:53.835661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:53.836102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:53.966608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.972729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:16:53.979082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.981374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:53.982876 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-308b5e5f-14de-4c60-879e-fb4949096c38 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1415 microversion: 2.25 time: 0.477235 Nov 02 13:16:53.999522 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 528/1116] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:53 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1415 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:54.115778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3409020b-3f66-49c2-8d23-12abb6327cae tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers?status=error" status: 200 len: 341 microversion: 2.1 time: 0.301678 Nov 02 13:16:54.119468 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 589/1117] 10.222.0.113 () {58 vars in 1155 bytes} [Wed Nov 2 13:16:53 2022] GET /compute/v2.1/servers?status=error => generated 341 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:16:54.131765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0f11a68d-06f0-4237-8882-2764ad454026 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:54.135998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0f11a68d-06f0-4237-8882-2764ad454026 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:54.143305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f11a68d-06f0-4237-8882-2764ad454026 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.144014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f11a68d-06f0-4237-8882-2764ad454026 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.144547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f11a68d-06f0-4237-8882-2764ad454026 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.146258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f11a68d-06f0-4237-8882-2764ad454026 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.146793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f11a68d-06f0-4237-8882-2764ad454026 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.147568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f11a68d-06f0-4237-8882-2764ad454026 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.184143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.195688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:54.206803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.207725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.210129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.212430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.215151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.216266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.312723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:54.330874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:54.333046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:54.340635 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eecace0c-129b-4062-91dd-57ce6c5c40ad tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.164074 Nov 02 13:16:54.341481 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0f11a68d-06f0-4237-8882-2764ad454026 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action" status: 202 len: 0 microversion: 2.1 time: 0.214451 Nov 02 13:16:54.345183 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 529/1118] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:16:54 2022] POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:16:54.345352 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 590/1119] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:54.356128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92aa8239-e128-43d2-9856-8a21412342a1 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.356921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-92aa8239-e128-43d2-9856-8a21412342a1 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:54.363508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aa8239-e128-43d2-9856-8a21412342a1 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.365670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aa8239-e128-43d2-9856-8a21412342a1 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.366197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aa8239-e128-43d2-9856-8a21412342a1 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.367080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aa8239-e128-43d2-9856-8a21412342a1 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.367663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aa8239-e128-43d2-9856-8a21412342a1 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.368173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aa8239-e128-43d2-9856-8a21412342a1 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.450253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.450989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:54.459865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.460302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.460751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.461496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.461944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.462378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.595495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:54.610778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee12fee5-9caa-413f-8bb9-8fb517752bfc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1268 microversion: 2.1 time: 0.173090 Nov 02 13:16:54.612126 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 591/1120] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:54.621577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.623061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:54.634277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.635171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.635950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.637200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.638748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.638748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.668778 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-92aa8239-e128-43d2-9856-8a21412342a1 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1620 microversion: 2.1 time: 0.321631 Nov 02 13:16:54.670683 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 530/1121] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1620 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:54.688534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3927812-d6b2-44e6-a416-bb9990f55db7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787ad5820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.783455 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3927812-d6b2-44e6-a416-bb9990f55db7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1440 microversion: 2.1 time: 0.108862 Nov 02 13:16:54.784138 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 531/1122] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1440 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:54.795458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-76a734d9-42d6-4afb-91b9-3c8c6ac0766c tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.796300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-76a734d9-42d6-4afb-91b9-3c8c6ac0766c tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:54.804441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76a734d9-42d6-4afb-91b9-3c8c6ac0766c tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.805033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76a734d9-42d6-4afb-91b9-3c8c6ac0766c tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.805729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76a734d9-42d6-4afb-91b9-3c8c6ac0766c tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.806451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76a734d9-42d6-4afb-91b9-3c8c6ac0766c tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.807065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76a734d9-42d6-4afb-91b9-3c8c6ac0766c tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.807603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76a734d9-42d6-4afb-91b9-3c8c6ac0766c tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.889380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:54.891996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:54.903509 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ffca77a5-74d2-4c99-ad83-62f8350c1640 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.289933 Nov 02 13:16:54.904206 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 592/1123] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:54.924711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef794389-e6c7-4d00-a003-f94e76a90eb1 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe787547820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.957907 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-76a734d9-42d6-4afb-91b9-3c8c6ac0766c tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1620 microversion: 2.1 time: 0.172510 Nov 02 13:16:54.958854 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 532/1124] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1620 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:54.976799 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef794389-e6c7-4d00-a003-f94e76a90eb1 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 200 len: 1440 microversion: 2.1 time: 0.058410 Nov 02 13:16:54.987172 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 593/1125] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 1440 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:54.987368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.987368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Searching by: {'host': 'n-h1-858384-19', 'deleted': False} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:54.992981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.993471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.994068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.994903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:54.995390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:54.995817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:54.997191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:54.997794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:55.006215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.006859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.007457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.008276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.008831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.009609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.118991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:16:55.182115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:55.187919 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1938b223-acc6-49fb-9701-35e1ca76db2b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers?host=n-h1-858384-19&all_tenants=1" status: 200 len: 3978 microversion: 2.1 time: 0.210665 Nov 02 13:16:55.188092 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3f6bf00e-a2f6-42ab-a8e8-6f16b0d6af5c tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1469 microversion: 2.1 time: 0.196204 Nov 02 13:16:55.199194 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 533/1127] 10.222.0.113 () {58 vars in 1197 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/servers?host=n-h1-858384-19&all_tenants=1 => generated 3978 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:55.199436 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 594/1127] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:54 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:55.199526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:55.199526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:55.207384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.207384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.207384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.207384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.208751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.208751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.208939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-60ca542a-07da-4a5d-81a6-95a1dcda2e9b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:55.215413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-60ca542a-07da-4a5d-81a6-95a1dcda2e9b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:16:55.222059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60ca542a-07da-4a5d-81a6-95a1dcda2e9b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.222552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60ca542a-07da-4a5d-81a6-95a1dcda2e9b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.222990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60ca542a-07da-4a5d-81a6-95a1dcda2e9b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.224965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60ca542a-07da-4a5d-81a6-95a1dcda2e9b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.224965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60ca542a-07da-4a5d-81a6-95a1dcda2e9b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.225195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60ca542a-07da-4a5d-81a6-95a1dcda2e9b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.311009 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-60ca542a-07da-4a5d-81a6-95a1dcda2e9b tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.109816 Nov 02 13:16:55.311955 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 595/1128] 10.222.0.113 () {58 vars in 1201 bytes} [Wed Nov 2 13:16:55 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 13:16:55.316752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e3f08eb-0bc4-45cc-ae6b-0bde04f770ac tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe7876c9e50>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:55.363432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:55.372382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:55.374024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:55.375236 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40a0f914-63a6-4e04-bcc6-f84a5e1bfb00 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1612 microversion: 2.25 time: 0.185433 Nov 02 13:16:55.375804 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 534/1129] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:55 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1612 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:55.386535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5fe269be-b1d0-45fa-86f4-c2f1bc776eff tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:55.388949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5fe269be-b1d0-45fa-86f4-c2f1bc776eff tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:55.395899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe269be-b1d0-45fa-86f4-c2f1bc776eff tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.397797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe269be-b1d0-45fa-86f4-c2f1bc776eff tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.398356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe269be-b1d0-45fa-86f4-c2f1bc776eff tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.399088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe269be-b1d0-45fa-86f4-c2f1bc776eff tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.399587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe269be-b1d0-45fa-86f4-c2f1bc776eff tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.400018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe269be-b1d0-45fa-86f4-c2f1bc776eff tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.491557 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5fe269be-b1d0-45fa-86f4-c2f1bc776eff tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action" status: 202 len: 0 microversion: 2.1 time: 0.114218 Nov 02 13:16:55.492435 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 535/1130] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:16:55 2022] POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:16:55.499347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:55.499966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:55.507838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.509254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.509705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.510440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.510902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.511418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.599961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:55.610635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:55.612493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:55.618986 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b812776c-5cee-49b7-972e-447259819b19 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.124985 Nov 02 13:16:55.619858 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 536/1131] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:55 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:55.624817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-453eacb1-8f7b-4426-924c-23d2249e1173 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:55.625562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-453eacb1-8f7b-4426-924c-23d2249e1173 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:55.632220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-453eacb1-8f7b-4426-924c-23d2249e1173 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.632953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-453eacb1-8f7b-4426-924c-23d2249e1173 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.633581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-453eacb1-8f7b-4426-924c-23d2249e1173 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.634539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-453eacb1-8f7b-4426-924c-23d2249e1173 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.635283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-453eacb1-8f7b-4426-924c-23d2249e1173 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.635867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-453eacb1-8f7b-4426-924c-23d2249e1173 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.726618 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-453eacb1-8f7b-4426-924c-23d2249e1173 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.104831 Nov 02 13:16:55.727448 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 537/1132] 10.222.0.113 () {60 vars in 1321 bytes} [Wed Nov 2 13:16:55 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:16:55.747788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:55.750659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:55.757943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.758439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.759302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.760027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.760490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.760920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.840241 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e3f08eb-0bc4-45cc-ae6b-0bde04f770ac tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "DELETE /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94" status: 204 len: 0 microversion: 2.1 time: 0.527064 Nov 02 13:16:55.841212 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 596/1133] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:55 2022] DELETE /compute/v2.1/images/21638d2d-f108-48bc-9508-a18e852c2c94 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:16:55.848401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:55.849934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:55.856788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.857278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.857717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.858619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.859076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.859540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.865703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:16:55.867459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:16:55.868138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:16:55.868564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:16:55.869151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:16:55.934846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:55.941111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.941465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.941907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.942867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:55.943235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:55.943699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:55.952321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:55.962367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97106b75-4ba5-4153-898c-6955074877d4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1268 microversion: 2.1 time: 0.117874 Nov 02 13:16:55.966021 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 597/1134] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:55 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1268 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:55.970952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1dcc83ef-02d5-4811-bd3e-fdb7675b9945 req-142fc82e-aee9-4dfb-9d72-e3a1fa725cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8f4a4c-224d-4a42-9b89-dadf667e644b", "tag": "9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:55.971767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6d2cd8ef-f43c-47f4-afa8-1513778ba45d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action" status: 202 len: 1071 microversion: 2.1 time: 0.243130 Nov 02 13:16:55.972744 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 538/1135] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:16:55 2022] POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action => generated 1071 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:16:55.978194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5449a0eb-f7b1-4563-8a83-54bd777ca1d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '.version_select at 0x7fe78c212700>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:56.003258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1dcc83ef-02d5-4811-bd3e-fdb7675b9945 req-142fc82e-aee9-4dfb-9d72-e3a1fa725cd1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.003750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1dcc83ef-02d5-4811-bd3e-fdb7675b9945 req-142fc82e-aee9-4dfb-9d72-e3a1fa725cd1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.004363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1dcc83ef-02d5-4811-bd3e-fdb7675b9945 req-142fc82e-aee9-4dfb-9d72-e3a1fa725cd1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.016542 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1dcc83ef-02d5-4811-bd3e-fdb7675b9945 req-142fc82e-aee9-4dfb-9d72-e3a1fa725cd1 service nova] Creating event network-changed:9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d for instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b on n-h2-858384-19 Nov 02 13:16:56.023189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1dcc83ef-02d5-4811-bd3e-fdb7675b9945 req-142fc82e-aee9-4dfb-9d72-e3a1fa725cd1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055712 Nov 02 13:16:56.023811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 598/1136] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:56.028956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:56.029677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:56.036088 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-5449a0eb-f7b1-4563-8a83-54bd777ca1d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] HTTP exception thrown: Image not found. Nov 02 13:16:56.036662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.037088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.037531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.038455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.038968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.039438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5449a0eb-f7b1-4563-8a83-54bd777ca1d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Request method failure captured: Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 HTTP/1.1 Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1qx7pUURhNHaUMhsKLubQPv20ysCJlMQnGGh6pufoi4GUxjkLI6gENTEPVrAydnO_6M8mYrRvERgmqr2Q43YFryIFcdZOyhEZwW6aCu4m28P6YH10ua5ByiXcRHWkx62RcdZrZ5Tyx3acYBOeJ0E7Z6CV98hTVOO2my8B0E1S4Ny0 Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 380ebfa7af2140e88cf0e9b264e5a759 Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesOneServerTestJSON-344791689 Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:16:56.040354 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesOneServerTestJSON-344791689 Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 380ebfa7af2140e88cf0e9b264e5a759 Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-344791689 Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesOneServerTestJSON-344791689-project Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 6b91d6b4a24e4c2e828cef94ddf8f914 Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesOneServerTestJSON-344791689-project Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: exception: Image not found. Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'aafeaf0f-efde-4b3e-91e8-c40c02679f73'} Nov 02 13:16:56.042056 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aafeaf0f-efde-4b3e-91e8-c40c02679f73 to delete Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:56.043050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aafeaf0f-efde-4b3e-91e8-c40c02679f73 could not be found. Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:16:56.044598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5449a0eb-f7b1-4563-8a83-54bd777ca1d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Returning 404 to user: Image not found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:16:56.047299 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5449a0eb-f7b1-4563-8a83-54bd777ca1d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "DELETE /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73" status: 404 len: 62 microversion: 2.1 time: 0.071218 Nov 02 13:16:56.048538 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 539/1137] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:55 2022] DELETE /compute/v2.1/images/aafeaf0f-efde-4b3e-91e8-c40c02679f73 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:16:56.054511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:56.055977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:56.064953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.073596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.076105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.076969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.077898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.078350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.249570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:56.259950 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7271afe9-5fa5-49ba-9749-e95e74b85009 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.211846 Nov 02 13:16:56.260535 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 540/1138] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:56 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:56.265054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:56.265552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:56.279726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.280382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.280855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.281822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.282050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.282520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.288234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:56.311371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:16:56.329244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:56.339093 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e9b21d6-9676-4c83-b8f9-5d5c85c11a40 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.313914 Nov 02 13:16:56.339665 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 599/1139] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:56 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:56.400917 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-065b2499-3362-4a02-8fb5-327b08f6e0d7 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "DELETE /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 204 len: 0 microversion: 2.1 time: 0.139140 Nov 02 13:16:56.401763 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 541/1140] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:16:56 2022] DELETE /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:16:56.410253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:56.411661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:56.420445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.420941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.425582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.429071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.429565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.434790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.648982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:56.649674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:56.656034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.656514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.656948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.657672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:56.658121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:56.658538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:56.679229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:56.687518 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e9fe88e4-38aa-4d91-a9c4-5f133f89a299 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1475 microversion: 2.1 time: 0.281589 Nov 02 13:16:56.688500 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 600/1141] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:56 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:56.729113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:56.737350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:56.738864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:56.744084 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a8273aa6-a0d0-41d8-b225-2474450e69b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.100110 Nov 02 13:16:56.745504 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 542/1142] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:56 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:56.993132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:56.993988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:57.001138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.001741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.002229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.003020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.003611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.004102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.013028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a8a96318-1631-41e9-b329-e58fa9992789 req-0464f3be-fe53-402b-bd4a-34b2351daabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed1faa6-e6ad-4757-992d-0750ae29a307", "tag": "530566a3-df01-427e-bd74-d9826d6be3a7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:57.025440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a8a96318-1631-41e9-b329-e58fa9992789 req-0464f3be-fe53-402b-bd4a-34b2351daabd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.026533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a8a96318-1631-41e9-b329-e58fa9992789 req-0464f3be-fe53-402b-bd4a-34b2351daabd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.027185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a8a96318-1631-41e9-b329-e58fa9992789 req-0464f3be-fe53-402b-bd4a-34b2351daabd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.042468 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a8a96318-1631-41e9-b329-e58fa9992789 req-0464f3be-fe53-402b-bd4a-34b2351daabd service nova] Creating event network-changed:530566a3-df01-427e-bd74-d9826d6be3a7 for instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 on n-h2-858384-19 Nov 02 13:16:57.048598 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a8a96318-1631-41e9-b329-e58fa9992789 req-0464f3be-fe53-402b-bd4a-34b2351daabd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038962 Nov 02 13:16:57.049726 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 543/1143] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:57.079961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:57.088091 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-185c21cc-fe37-468e-bea6-c0456f59ad4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1268 microversion: 2.1 time: 0.099761 Nov 02 13:16:57.088688 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 601/1144] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:56 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1268 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:57.287015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:57.288008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:57.294224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.294788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.295312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.296092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.296604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.297099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.362101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:57.362707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:57.369676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.370164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.370600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.371482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.371948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.372380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.439824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:57.449539 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-176660bb-52f4-4269-9786-dabd320414b5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.167989 Nov 02 13:16:57.463135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 544/1145] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:57 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:57.518188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:57.527559 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-945097d4-fcd9-4b24-a147-add0f053b079 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.168952 Nov 02 13:16:57.527559 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 602/1146] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:57 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:57.711839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:57.712464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:57.719771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.720190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.720635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.721368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.721830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.722260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.773654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:57.779066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:57.787304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.789757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.790222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.791206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.791835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.792469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.881886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:57.897506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:57.898963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:57.899652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:57.905864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:57.907684 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d31a30f4-d1e9-413c-b0a2-60a8d84bbf03 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.139523 Nov 02 13:16:57.908074 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-19f7b87a-a716-4b22-b5d9-be6794a3763f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1475 microversion: 2.1 time: 0.200311 Nov 02 13:16:57.908643 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 603/1147] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:57 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:16:57.913829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-41fe1262-ef40-46c9-8ab6-3404da62ba66 req-9cd91680-4f43-44b4-9fd9-2a276310b85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e08b0c-8192-434f-bcad-97df4f95e59c", "name": "network-vif-unplugged", "status": "completed", "tag": "25d7d239-84c0-46c5-a2d2-300eba783012"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:57.921392 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 545/1148] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:57 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1475 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:57.925139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-41fe1262-ef40-46c9-8ab6-3404da62ba66 req-9cd91680-4f43-44b4-9fd9-2a276310b85f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:57.925612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-41fe1262-ef40-46c9-8ab6-3404da62ba66 req-9cd91680-4f43-44b4-9fd9-2a276310b85f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:57.926064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-41fe1262-ef40-46c9-8ab6-3404da62ba66 req-9cd91680-4f43-44b4-9fd9-2a276310b85f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:57.937928 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-41fe1262-ef40-46c9-8ab6-3404da62ba66 req-9cd91680-4f43-44b4-9fd9-2a276310b85f service nova] Creating event network-vif-unplugged:25d7d239-84c0-46c5-a2d2-300eba783012 for instance 47e08b0c-8192-434f-bcad-97df4f95e59c on n-h2-858384-19 Nov 02 13:16:57.943189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-41fe1262-ef40-46c9-8ab6-3404da62ba66 req-9cd91680-4f43-44b4-9fd9-2a276310b85f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033373 Nov 02 13:16:57.943766 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 604/1149] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:58.112300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:58.113509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:58.120511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.120996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.121431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.122131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.122585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.123004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.197037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:58.206589 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16457caf-86bb-458c-9ef3-ed9f503eb3f7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1268 microversion: 2.1 time: 0.098199 Nov 02 13:16:58.207190 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 546/1150] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:58 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1268 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:58.478921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:58.479974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:58.490173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.490790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.491587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.492763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.493578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.494075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.552135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:58.553439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:58.559868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.560361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.560804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.561537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.561989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.562422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.632296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:58.640407 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-46a601d6-6066-402c-a8c2-54acc279437f tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.169683 Nov 02 13:16:58.640997 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 605/1151] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:58 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:58.704121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:58.712257 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-829ca1d6-fd2f-4956-959f-d3a1fb0ace24 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.164928 Nov 02 13:16:58.712821 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 547/1152] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:58 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:58.936128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:58.936777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:58.943052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.943490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.943925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.944615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.945065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.945490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.956158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:58.956950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:58.964458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.964946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.965396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:58.966117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:58.966615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:58.967048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:59.016817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:59.026837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:59.028413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:59.033785 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-985824a6-ba96-4248-bf98-bed8330b14ae tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.101656 Nov 02 13:16:59.034366 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 606/1153] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:16:58 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:16:59.106998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:59.114877 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec478c4e-e579-4a4f-8572-52b0581bdd80 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1475 microversion: 2.1 time: 0.163525 Nov 02 13:16:59.115527 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 548/1154] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:58 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1475 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:16:59.229898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:59.230535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:59.236555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:59.237025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:59.237454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:59.238214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:59.238664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:59.239254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:59.306105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:59.316181 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4509661b-fa9c-4383-89c4-dee3854248ce tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1268 microversion: 2.1 time: 0.090350 Nov 02 13:16:59.316760 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 607/1155] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:59 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1268 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:59.666443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:59.667050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:59.673208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:59.673727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:59.674200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:59.674908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:59.675378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:59.675800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:59.737761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:59.738817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:16:59.749654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:59.750773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:59.751405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:59.752319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:16:59.753030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:16:59.754017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:16:59.830617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:59.839211 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1304cb02-14de-4c44-9680-24c5911aafef tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.177804 Nov 02 13:16:59.839799 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 549/1156] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:59 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:16:59.907554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:16:59.916376 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-730eced6-216c-43b5-8275-bfcdde6086d6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.184309 Nov 02 13:16:59.916954 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 608/1157] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:16:59 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:00.064258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:00.064857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:00.071700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.072185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.072626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.073317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.073768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.074190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.138657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:00.139966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:00.146241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:00.146831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.147348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.147784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.148490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.148940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.149508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.155670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:00.157250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:00.164240 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-29e641a3-e60a-473a-bf65-63cfb1cc71b8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.103947 Nov 02 13:17:00.164824 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 550/1158] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:00 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:00.284666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:00.293183 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ca09a76-44df-4285-8b39-be5f4e6aec1a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1475 microversion: 2.1 time: 0.158437 Nov 02 13:17:00.294090 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 609/1159] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:00 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1475 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:00.339961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:00.340467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:00.346445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.346936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.347410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.348165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.348838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.349416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.432530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:00.443672 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-93bf43cc-24e0-4cd1-824a-78536a05f5c5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1268 microversion: 2.1 time: 0.107670 Nov 02 13:17:00.445860 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 551/1160] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:00 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1268 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:00.862955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:00.863599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:00.871470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.871960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.872406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.873113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.873576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.874004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.940396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:00.940921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:00.947755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.948245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.948682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:00.949422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:00.949873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:00.950294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.016171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:01.024612 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c4c99455-134a-4778-a4a0-124c91fb1dc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.165527 Nov 02 13:17:01.025203 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 610/1161] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:00 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:01.097958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:01.106695 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4426399f-e8b6-4406-9445-e46f032a9757 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.170363 Nov 02 13:17:01.107527 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 552/1162] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:00 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:01.191618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:01.192706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:01.199679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.200166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.200701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.202063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.202568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.207411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.317720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:01.318345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:01.321533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:01.330461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.331719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.334531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.359523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.360510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.362153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.595778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:01.607026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:01.609391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:01.616518 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8ab6f158-dc01-4626-a115-fd925d8e410e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.428793 Nov 02 13:17:01.617708 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 611/1163] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:01 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:01.634058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:01.634925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:01.643396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.644260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.645474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.646752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:01.647269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:01.647792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:01.717617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:01.726420 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-54b35c7d-88aa-4c94-91d9-4939988ba00d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1274 microversion: 2.1 time: 0.107182 Nov 02 13:17:01.726936 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 612/1164] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:01 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:02.050603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:02.051921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:02.086193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.090339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.096476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.102080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.103982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.104732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.105399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:02.118467 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bda9028b-e7fe-402f-b915-6d036a6ca02d tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1475 microversion: 2.1 time: 0.804782 Nov 02 13:17:02.119831 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 553/1165] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:01 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1475 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:02.133132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:02.134409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:02.136090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:02.146379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:02.149756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.150874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.151650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.152702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.154152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.154956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.495155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:02.496779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:02.506863 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ba76b79-af3d-41f8-9449-81bad35a33c3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.378332 Nov 02 13:17:02.508770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 554/1166] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:02 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:02.516354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-96bda104-34e1-4453-912e-6edbd0639243 req-c552c19f-f7b6-4d83-8eb1-63922280772c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b594218-5f5b-47ae-8c89-b9a4ea8cb794", "name": "network-vif-plugged", "status": "completed", "tag": "1c071412-832b-48a0-9f41-3f56b4b64a08"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:02.525354 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2ae296d3-b772-4a49-95da-be04f1e607f1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.479102 Nov 02 13:17:02.526175 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 613/1167] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:02 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:02.538784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-96bda104-34e1-4453-912e-6edbd0639243 req-c552c19f-f7b6-4d83-8eb1-63922280772c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.539207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-96bda104-34e1-4453-912e-6edbd0639243 req-c552c19f-f7b6-4d83-8eb1-63922280772c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.539805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-96bda104-34e1-4453-912e-6edbd0639243 req-c552c19f-f7b6-4d83-8eb1-63922280772c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.553708 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-96bda104-34e1-4453-912e-6edbd0639243 req-c552c19f-f7b6-4d83-8eb1-63922280772c service nova] Creating event network-vif-plugged:1c071412-832b-48a0-9f41-3f56b4b64a08 for instance 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 on n-h2-858384-19 Nov 02 13:17:02.559764 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-96bda104-34e1-4453-912e-6edbd0639243 req-c552c19f-f7b6-4d83-8eb1-63922280772c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049442 Nov 02 13:17:02.560578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 555/1168] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:02.645621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:02.647298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:02.656840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.657537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.658119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.658970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.659751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.660419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.751162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:02.752007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:02.762194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.764367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.765055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.765861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.766420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.767881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.795896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:02.814007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:02.815559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:02.834950 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c5f425ea-75fa-4806-9542-68955ad183c8 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.193849 Nov 02 13:17:02.835726 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 614/1169] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:02 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:02.861666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c5f3a693-d647-4aff-8a20-2ff7b3d3b564 req-a7352725-6316-4e99-86fc-5a210d90a426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e08b0c-8192-434f-bcad-97df4f95e59c", "name": "network-vif-deleted", "tag": "25d7d239-84c0-46c5-a2d2-300eba783012"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:02.886055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c5f3a693-d647-4aff-8a20-2ff7b3d3b564 req-a7352725-6316-4e99-86fc-5a210d90a426 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:02.887039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c5f3a693-d647-4aff-8a20-2ff7b3d3b564 req-a7352725-6316-4e99-86fc-5a210d90a426 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:02.887884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c5f3a693-d647-4aff-8a20-2ff7b3d3b564 req-a7352725-6316-4e99-86fc-5a210d90a426 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:02.917658 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c5f3a693-d647-4aff-8a20-2ff7b3d3b564 req-a7352725-6316-4e99-86fc-5a210d90a426 service nova] Creating event network-vif-deleted:25d7d239-84c0-46c5-a2d2-300eba783012 for instance 47e08b0c-8192-434f-bcad-97df4f95e59c on n-h2-858384-19 Nov 02 13:17:02.922672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:02.925114 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c5f3a693-d647-4aff-8a20-2ff7b3d3b564 req-a7352725-6316-4e99-86fc-5a210d90a426 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077403 Nov 02 13:17:02.927555 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 615/1170] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:02.936655 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f547af78-6c90-48f1-ba9f-215b84553e11 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1274 microversion: 2.1 time: 0.189929 Nov 02 13:17:02.937249 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 556/1171] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:02 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1274 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:03.150961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:03.152089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:03.163685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.164580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.165099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:03.165912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.166458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.167093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:03.242843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:03.252616 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-03958f15-315e-4211-aa6d-a710517c8028 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1305 microversion: 2.1 time: 0.106004 Nov 02 13:17:03.255827 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 616/1172] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:03 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:03.530938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:03.531587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:03.539846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.540354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.540797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:03.541521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.544357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.549817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:03.551828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:03.554135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=30 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:03.556120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:03.567834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.568337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.568791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:03.569525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.569999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.570432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:03.586667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:03.731083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:03.742022 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ccc49e91-737f-47da-9347-9309edadb9dc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.195846 Nov 02 13:17:03.743381 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 617/1173] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:03 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:03.801117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:03.810755 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e5f2d6e1-9917-4d59-9da4-2271324ca401 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.283658 Nov 02 13:17:03.811893 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 557/1174] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:03 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:03.866738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:03.867557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:03.874608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.875250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.875787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:03.877380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.878052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:03.878821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:03.960163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:03.970314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:03.971622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:03.971856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:03.972234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:03.980938 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e14228fc-64be-4a8a-b789-8f6d7899f519 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.119172 Nov 02 13:17:03.982394 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 618/1175] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:03 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:03.998631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:03.999426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.000008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.000862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:04.001466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.002050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.228909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:04.237821 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d278bee0-f195-42b2-a4c9-728d52f4e183 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.270203 Nov 02 13:17:04.239440 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 558/1176] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:03 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:04.276966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:04.278329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:04.286350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:04.287171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.287614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.288323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:04.288778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.289204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.331015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:04.331593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.332150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.332853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lazy-loading 'fault' on Instance uuid 47e08b0c-8192-434f-bcad-97df4f95e59c {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:17:04.387209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:04.398497 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82dc3018-e8dd-49f7-98c9-a71fe767a092 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1310 microversion: 2.1 time: 0.125355 Nov 02 13:17:04.399152 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 619/1177] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:04 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1310 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:04.766203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:04.766821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:04.774287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:04.774778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.775246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.775953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:04.776412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.776844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.835627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:04.836237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:04.842755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:04.843271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.843708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.844409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:04.844858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.845281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.930664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:04.939228 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3629b904-6c51-41f7-9c77-3e89eee1f3ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.176920 Nov 02 13:17:04.952936 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 559/1178] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:04 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:04.960694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6ea3998c-8fa3-4473-8a78-6c040b8ee00c req-945513b9-c8c1-4d9b-a07b-0411f6085a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b61a6bd-c846-47b8-bc2e-1ced93a130de", "tag": "165d7495-3fe4-430c-b934-4fffcdeadf3a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:04.970849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6ea3998c-8fa3-4473-8a78-6c040b8ee00c req-945513b9-c8c1-4d9b-a07b-0411f6085a43 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:04.971751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6ea3998c-8fa3-4473-8a78-6c040b8ee00c req-945513b9-c8c1-4d9b-a07b-0411f6085a43 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:04.972360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6ea3998c-8fa3-4473-8a78-6c040b8ee00c req-945513b9-c8c1-4d9b-a07b-0411f6085a43 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:04.985367 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6ea3998c-8fa3-4473-8a78-6c040b8ee00c req-945513b9-c8c1-4d9b-a07b-0411f6085a43 service nova] Creating event network-changed:165d7495-3fe4-430c-b934-4fffcdeadf3a for instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de on n-h2-858384-19 Nov 02 13:17:04.991334 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6ea3998c-8fa3-4473-8a78-6c040b8ee00c req-945513b9-c8c1-4d9b-a07b-0411f6085a43 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036767 Nov 02 13:17:04.991949 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 560/1179] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:05.011999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:05.013346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:05.014049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:05.020694 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c6c2034-22a2-4b53-a120-d71eaf55cecc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1320 microversion: 2.1 time: 0.189544 Nov 02 13:17:05.020929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.021426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.021866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.022003 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 620/1180] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:04 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:05.022741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.023232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.023661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.033667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:05.101344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:05.110780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:05.112445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:05.118569 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2570744e-9f32-47f3-a199-15a44effb290 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.109583 Nov 02 13:17:05.119787 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 561/1181] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:05 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:05.263897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:05.264619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:05.266857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=16 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:05.281008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.281625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.281924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.286567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.287060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.287599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.422098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:05.422760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:05.429269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.429756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.430179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.431374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.431488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.431894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.440086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:05.449146 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e3920e5-9705-45c3-89b2-2f4df4e761ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.189263 Nov 02 13:17:05.450053 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 621/1182] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:05 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:05.466101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.466513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.466967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.467429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lazy-loading 'fault' on Instance uuid 47e08b0c-8192-434f-bcad-97df4f95e59c {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:17:05.511218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:05.518894 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74eef3d2-4a67-4aeb-8f8d-68264c384a6a tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1310 microversion: 2.1 time: 0.100842 Nov 02 13:17:05.519519 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 562/1183] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:05 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:05.964818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:05.965464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:05.971854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.972339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.972789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:05.974162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:05.974628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:05.975062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.048395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:06.049389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:06.056924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.057413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.057856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.058568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.059028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.059516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.142902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:06.152557 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ed37572-51f7-4568-af71-057d682d7058 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.191620 Nov 02 13:17:06.153181 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 622/1184] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:05 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:06.159570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:06.161817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:06.168126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.168711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.169223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.170022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.170563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.171065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.241631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:06.251354 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-652da076-7026-4e53-82aa-4e2ed471669f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1469 microversion: 2.1 time: 0.209412 Nov 02 13:17:06.251950 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 563/1185] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:06 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:06.257110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:06.275849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:06.277359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:06.278050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a22b5f4-7059-4402-9bd1-509e1914ef79 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:06.278895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a22b5f4-7059-4402-9bd1-509e1914ef79 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:06.284207 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a95d206c-c37f-419e-afcc-bc5530529db3 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.129697 Nov 02 13:17:06.285543 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 623/1186] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:06 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:06.286773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a22b5f4-7059-4402-9bd1-509e1914ef79 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.287301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a22b5f4-7059-4402-9bd1-509e1914ef79 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.288111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a22b5f4-7059-4402-9bd1-509e1914ef79 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.288473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a22b5f4-7059-4402-9bd1-509e1914ef79 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.288947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a22b5f4-7059-4402-9bd1-509e1914ef79 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.289373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a22b5f4-7059-4402-9bd1-509e1914ef79 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.447134 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a22b5f4-7059-4402-9bd1-509e1914ef79 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1622 microversion: 2.1 time: 0.173352 Nov 02 13:17:06.447751 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 564/1187] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:06 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1622 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:06.478910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:06.479334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:06.487486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.487975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.488416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.490071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.490531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.491011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.526288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1339356128", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8cd2a3ab-5b0a-47ad-8467-33b0414c55e1"]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:06.615623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] validate_networks() for None {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:17:06.657984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:06.666624 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-99ce7236-5ba8-4806-8838-1dd86a99f448 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.195688 Nov 02 13:17:06.667246 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 624/1188] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:06 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:06.672514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:06.673767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:06.680399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.680898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.681344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.682091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.683172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.683816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.721232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.721716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.722163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.722609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lazy-loading 'fault' on Instance uuid 47e08b0c-8192-434f-bcad-97df4f95e59c {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:17:06.773001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:06.782360 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bbdae01d-4c02-4ba2-b527-9fd57967f0bc tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1310 microversion: 2.1 time: 0.114053 Nov 02 13:17:06.783309 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 625/1189] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:06 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1310 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:06.878375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:17:06.878800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:17:06.879307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:17:06.879717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:17:06.880128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:17:06.889206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.889693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.890137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.890867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:06.891369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:06.891801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:06.911096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:17:06.917169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:17:06.930511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:17:06.932881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:17:06.991582 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b438a1f7-e9c4-4660-a1f4-30ec33837c19 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.471139 Nov 02 13:17:06.992523 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 565/1190] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:17:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:17:07.003993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9264fe17-0b8d-46cd-ac43-ad5366da6094 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:07.004982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9264fe17-0b8d-46cd-ac43-ad5366da6094 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:07.060348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9264fe17-0b8d-46cd-ac43-ad5366da6094 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:07.068164 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9264fe17-0b8d-46cd-ac43-ad5366da6094 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1221 microversion: 2.1 time: 0.068107 Nov 02 13:17:07.068761 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 626/1191] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:06 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:07.184207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:07.185341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:07.192462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.192948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.193387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.194088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.194542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.194966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.318804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:07.319918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:07.328772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.329657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.330209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.331273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.331839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.332612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.348321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:07.358409 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-701e66a2-f0cc-4c2c-9abb-8cc5b690e2ff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.178540 Nov 02 13:17:07.360092 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 566/1192] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:07 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:07.408660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:07.418514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:07.420027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:07.425757 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41b4d201-67b2-4b54-8145-ba4c6551d5ce tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.112263 Nov 02 13:17:07.427458 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 627/1193] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:07 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:07.693952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:07.694477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:07.700815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.701296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.701730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.702417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.702874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.703454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.807016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:07.807692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:07.814380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.814888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.815365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.816195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.816763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.817846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.847235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:07.854274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:07.854756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:07.855224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:07.855682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lazy-loading 'fault' on Instance uuid 47e08b0c-8192-434f-bcad-97df4f95e59c {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:17:07.857328 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f12f37b-e4bd-4277-b106-368bcb9b71a9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.167544 Nov 02 13:17:07.857912 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 567/1194] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:07 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:07.899219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:07.906874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b60fd13d-c6e7-4190-bf17-96005efcb0fd tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1310 microversion: 2.1 time: 0.104737 Nov 02 13:17:07.907492 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 628/1195] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:07 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:08.100878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:08.101497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:08.107598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.108086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.108522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.109222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.109683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.110113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.172835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:08.183738 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8062c351-105d-4be6-93cc-440ff4cbdab3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1225 microversion: 2.1 time: 0.086971 Nov 02 13:17:08.184333 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 568/1196] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:08 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:08.384142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:08.384881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:08.391362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.391825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.392259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.392959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.393412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.393839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.454499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:08.455133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:08.461915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.462442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.462860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.463670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.464133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.464695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.533443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:08.537288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:08.544360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:08.546050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:08.546536 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a30a8fbf-b0ae-4dfd-8ab4-eec324b8ddf3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1475 microversion: 2.1 time: 0.167341 Nov 02 13:17:08.558369 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-39f52183-af04-41dc-8804-b9adb634b06e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.107714 Nov 02 13:17:08.563520 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 629/1197] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:08 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1475 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:08.571428 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 569/1198] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:08 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:08.882787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:08.884129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:08.893014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.893729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.894364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.895244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.896163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.896670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.931489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:08.932242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:08.939007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.939582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.940419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:08.941119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:08.942250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:08.944176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.012046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:09.012720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:09.012982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.013497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lazy-loading 'fault' on Instance uuid 47e08b0c-8192-434f-bcad-97df4f95e59c {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:17:09.068992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b91d6b4a24e4c2e828cef94ddf8f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ebfa7af2140e88cf0e9b264e5a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:09.078815 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-41b7624e-a95b-4567-b82e-ec7d5d12d240 tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 200 len: 1310 microversion: 2.1 time: 0.151468 Nov 02 13:17:09.079695 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 570/1199] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:08 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 1310 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:09.079894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:09.083013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:09.091229 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d4e68b9-a9ee-443e-b17d-26dcbe9c1e65 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.212638 Nov 02 13:17:09.103385 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 630/1200] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:08 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:09.208673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:09.209290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:09.216808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:09.217303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:09.217772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.218653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:09.219132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:09.219564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.293309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:09.302072 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6325e15d-759e-4ada-a823-fcc9e52b4c3e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1273 microversion: 2.1 time: 0.097512 Nov 02 13:17:09.302790 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 571/1201] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:09 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:09.570398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:09.571005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:09.577059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:09.577540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:09.577976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.578667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:09.579148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:09.579573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.588481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:09.589084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:09.595064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:09.595580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:09.596020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.596727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:09.597187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:09.597617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:09.678473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:09.687467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:09.688949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:09.694851 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-781946d4-fc32-4533-a9ca-c9489a28f947 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.110265 Nov 02 13:17:09.695657 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 572/1202] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:09 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:09.719740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:09.729061 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e82d2eaf-6204-4aed-b2fd-b8afa5e1c588 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.163184 Nov 02 13:17:09.729649 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 631/1203] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:09 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:10.104636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:10.105240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] [instance: 47e08b0c-8192-434f-bcad-97df4f95e59c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:10.111753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.112423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.112873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.115227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.116361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.116361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.119360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:10.124090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:10.132303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.133141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.133762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.134668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.134987 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] HTTP exception thrown: Instance 47e08b0c-8192-434f-bcad-97df4f95e59c could not be found. Nov 02 13:17:10.135492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.136236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Request method failure captured: Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c HTTP/1.1 Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1qx7pUURhNHaUMhsKLubQPv20ysCJlMQnGGh6pufoi4GUxjkLI6gENTEPVrAydnO_6M8mYrRvERgmqr2Q43YFryIFcdZOyhEZwW6aCu4m28P6YH10ua5ByiXcRHWkx62RcdZrZ5Tyx3acYBOeJ0E7Z6CV98hTVOO2my8B0E1S4Ny0 Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 380ebfa7af2140e88cf0e9b264e5a759 Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesOneServerTestJSON-344791689 Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:17:10.136984 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/380ebfa7af2140e88cf0e9b264e5a759"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesOneServerTestJSON-344791689 Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 380ebfa7af2140e88cf0e9b264e5a759 Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-344791689 Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesOneServerTestJSON-344791689-project Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 6b91d6b4a24e4c2e828cef94ddf8f914 Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesOneServerTestJSON-344791689-project Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 47e08b0c-8192-434f-bcad-97df4f95e59c could not be found. Nov 02 13:17:10.138548 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '47e08b0c-8192-434f-bcad-97df4f95e59c'} Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e08b0c-8192-434f-bcad-97df4f95e59c could not be found. Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:10.139465 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e08b0c-8192-434f-bcad-97df4f95e59c could not be found. Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e08b0c-8192-434f-bcad-97df4f95e59c could not be found. Nov 02 13:17:10.141027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:10.142327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] Returning 404 to user: Instance 47e08b0c-8192-434f-bcad-97df4f95e59c could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:10.143042 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f83aa5a-f086-44d7-b0d5-fd9b5ee8336f tempest-ImagesOneServerTestJSON-344791689 tempest-ImagesOneServerTestJSON-344791689-project] 10.222.0.113 "GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c" status: 404 len: 111 microversion: 2.1 time: 0.040224 Nov 02 13:17:10.145689 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 573/1204] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:10 2022] GET /compute/v2.1/servers/47e08b0c-8192-434f-bcad-97df4f95e59c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:17:10.299405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:10.310498 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6faec9a1-7628-4942-b2d5-2ed606b0b001 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.197031 Nov 02 13:17:10.311698 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 632/1205] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:10 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:10.332570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:10.333369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:10.340471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.341174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.341806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.342748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.343461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.344099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.433391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:10.443058 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0d0a6c4-a9b9-4cc8-8bc2-2473f796d2ce tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1279 microversion: 2.1 time: 0.114550 Nov 02 13:17:10.444027 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 574/1206] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:10 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:10.722532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:10.724121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:10.733663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.734165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.734613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.735373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.739652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.743311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.760721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:10.761858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:10.776129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.777213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.779927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.780968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:10.782320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:10.783010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:10.815464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:10.852262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:10.863482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:10.865546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:10.873588 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7770476-1448-4561-9e8d-5e2121a7a578 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.155151 Nov 02 13:17:10.874989 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 633/1207] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:10 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:11.128525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:11.138175 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-15ed12d1-7b7f-42a6-9e54-9ded19535589 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.386413 Nov 02 13:17:11.147216 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 575/1208] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:10 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:11.339434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:11.340513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:11.371754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.373879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.376055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.380596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.383077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.384979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.469408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:11.470713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:11.482700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.484606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.487502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.489208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.502433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.503399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.653504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:11.665023 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-957ec3dd-32ac-45a0-be34-0b79d6862567 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.332862 Nov 02 13:17:11.666243 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 634/1209] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:11 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:11.749069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0ebb3b78-6c31-435a-9e7f-0d1aaf1b448f req-95a6d528-f0b1-4cad-b22c-aa198e30b706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e5b238-3258-4e2d-ba0e-01268713299a", "name": "network-vif-unplugged", "status": "completed", "tag": "bdbac33f-c52c-4822-983e-75fc66196e13"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:11.769650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0ebb3b78-6c31-435a-9e7f-0d1aaf1b448f req-95a6d528-f0b1-4cad-b22c-aa198e30b706 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.770666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0ebb3b78-6c31-435a-9e7f-0d1aaf1b448f req-95a6d528-f0b1-4cad-b22c-aa198e30b706 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.771370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0ebb3b78-6c31-435a-9e7f-0d1aaf1b448f req-95a6d528-f0b1-4cad-b22c-aa198e30b706 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.795318 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0ebb3b78-6c31-435a-9e7f-0d1aaf1b448f req-95a6d528-f0b1-4cad-b22c-aa198e30b706 service nova] Creating event network-vif-unplugged:bdbac33f-c52c-4822-983e-75fc66196e13 for instance d8e5b238-3258-4e2d-ba0e-01268713299a on n-h1-858384-19 Nov 02 13:17:11.805732 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0ebb3b78-6c31-435a-9e7f-0d1aaf1b448f req-95a6d528-f0b1-4cad-b22c-aa198e30b706 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072108 Nov 02 13:17:11.807049 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 635/1210] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:11.908990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:11.912410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:11.919056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.919582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.920061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.920935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:11.921473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:11.921911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:11.998187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:12.009260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:12.010744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:12.016891 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f63029fb-f77e-4997-af61-b948e1205127 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1563 microversion: 2.91 time: 0.113362 Nov 02 13:17:12.035018 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 636/1211] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:11 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1563 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:12.106844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:12.116188 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-097d20ad-7310-4a7f-82be-d2a09baa2684 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1321 microversion: 2.1 time: 0.651787 Nov 02 13:17:12.116571 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 576/1212] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:11 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1321 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:12.149896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-fe5b8a10-bdd0-4fdf-ae35-64985fd2234b req-4b2c1598-ee93-44c0-8350-b75cc62ccad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc106b9-6602-400b-b3b4-b5b3e15fc5b0", "tag": "de29ee87-06b0-4365-ba65-10ad14a416c3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:12.161052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fe5b8a10-bdd0-4fdf-ae35-64985fd2234b req-4b2c1598-ee93-44c0-8350-b75cc62ccad5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:12.161543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fe5b8a10-bdd0-4fdf-ae35-64985fd2234b req-4b2c1598-ee93-44c0-8350-b75cc62ccad5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:12.161983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fe5b8a10-bdd0-4fdf-ae35-64985fd2234b req-4b2c1598-ee93-44c0-8350-b75cc62ccad5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:12.168296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:12.169105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:12.174600 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-fe5b8a10-bdd0-4fdf-ae35-64985fd2234b req-4b2c1598-ee93-44c0-8350-b75cc62ccad5 service nova] Creating event network-changed:de29ee87-06b0-4365-ba65-10ad14a416c3 for instance 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 on n-h2-858384-19 Nov 02 13:17:12.179288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:12.179919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:12.180583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:12.182400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:12.182843 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-fe5b8a10-bdd0-4fdf-ae35-64985fd2234b req-4b2c1598-ee93-44c0-8350-b75cc62ccad5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034703 Nov 02 13:17:12.183781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:12.184436 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 637/1213] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:12.185050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:12.442591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:12.453833 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6df922d4-ad3d-4ba1-b490-38ba3c7249d1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.291445 Nov 02 13:17:12.454977 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 577/1214] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:12 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:12.694128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:12.694854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:12.709631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:12.710531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:12.710981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:12.711754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:12.712341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:12.712667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:12.989321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:13.001787 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2da79348-319c-433c-8411-91603f335210 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.315065 Nov 02 13:17:13.002900 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 638/1215] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:12 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:13.045546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:13.046146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:13.054610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:13.056911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:13.058427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:13.059420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:13.064559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:13.065290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:13.141825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:13.142608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:13.155012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:13.155935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:13.157138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:13.158098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:13.158540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:13.159022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:13.159687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:13.170057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:13.171950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:13.179924 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-910d8699-fb2a-4191-a9bc-00e347b9f52d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.138205 Nov 02 13:17:13.193565 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 578/1216] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:13 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:13.460267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:13.468790 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d48e32d5-abba-4b10-86ee-adcf20f2c911 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1321 microversion: 2.1 time: 0.331264 Nov 02 13:17:13.486039 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 639/1217] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:13 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:13.490785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:13.491427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:13.502347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:13.503327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:13.504636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:13.512737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:13.513686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:13.514367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:13.721788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:13.733481 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0de0add-7373-4876-8db0-64071a545ac6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.246757 Nov 02 13:17:13.734941 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 579/1218] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:13 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:13.914702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-81265124-1af5-499d-bf2a-87c49089cdcc req-b027b4bd-7a01-49af-8b67-df9253c16004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b61a6bd-c846-47b8-bc2e-1ced93a130de", "name": "network-vif-plugged", "status": "completed", "tag": "165d7495-3fe4-430c-b934-4fffcdeadf3a"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:13.930701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-81265124-1af5-499d-bf2a-87c49089cdcc req-b027b4bd-7a01-49af-8b67-df9253c16004 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:13.935503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-81265124-1af5-499d-bf2a-87c49089cdcc req-b027b4bd-7a01-49af-8b67-df9253c16004 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:13.940157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-81265124-1af5-499d-bf2a-87c49089cdcc req-b027b4bd-7a01-49af-8b67-df9253c16004 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:13.961012 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-81265124-1af5-499d-bf2a-87c49089cdcc req-b027b4bd-7a01-49af-8b67-df9253c16004 service nova] Creating event network-vif-plugged:165d7495-3fe4-430c-b934-4fffcdeadf3a for instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de on n-h2-858384-19 Nov 02 13:17:13.968753 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-81265124-1af5-499d-bf2a-87c49089cdcc req-b027b4bd-7a01-49af-8b67-df9253c16004 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058530 Nov 02 13:17:13.969796 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 640/1219] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:14.032938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:14.033943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:14.065515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.067942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.068755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.070471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.071286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.072553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.212385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:14.214479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:14.217132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:14.232646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.234989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.236129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.238337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.239430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.240137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.365936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:14.386454 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f534ca00-9017-4d64-b841-2f3f8d34fbd5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.355474 Nov 02 13:17:14.390007 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 580/1220] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:14 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:14.494171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:14.495087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:14.508926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.511881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.512552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.513604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.516141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.516609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.780049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:14.782543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:14.790559 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dbb09209-97dd-41c7-b680-88538654c054 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1321 microversion: 2.1 time: 0.300532 Nov 02 13:17:14.792176 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 581/1221] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:14 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:14.798824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:14.799779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:14.807704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.808153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:14.808728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.809389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.810318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:14.810435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:14.811174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:14.811817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:14.823058 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a5c15976-e1cd-4fcf-b52b-e5026c31f46a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.616222 Nov 02 13:17:14.826498 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 641/1222] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:14 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:15.069249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:15.078303 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c53dfbaa-418b-40b8-a260-b277b9637c12 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.284760 Nov 02 13:17:15.079537 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 582/1223] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:14 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:15.420713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:15.423060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:15.445711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:15.448737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:15.449430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:15.450368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:15.451655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:15.452292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:15.716030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:15.728252 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ade63c6f-e8df-42b2-9327-f04993c06f7d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.314728 Nov 02 13:17:15.728871 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 642/1224] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:15 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:15.816048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:15.819769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:15.844023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:15.846525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:15.846983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:15.850416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:15.851037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:15.851884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:15.858337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:15.859200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:15.873002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:15.875658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:15.877318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:15.880817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:15.881480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:15.882022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:16.050600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:16.065894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:16.073746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:16.088411 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cdff3d4a-0626-4541-bce7-8dbfa9b20419 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.236284 Nov 02 13:17:16.099152 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 643/1225] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:15 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:16.107154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:16.107154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:16.115147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:16.115147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:16.115147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:16.115147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:16.115677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:16.115677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:16.466827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:16.475656 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b68cc60a-39e5-4ac7-b78b-91d5274acc85 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.375435 Nov 02 13:17:16.496057 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 644/1226] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:16 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:16.745324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:16.754452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:16.755073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:16.762757 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-29c53542-1501-4187-9f81-fd28de00f0c0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1321 microversion: 2.1 time: 0.950602 Nov 02 13:17:16.771771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:16.772252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:16.772695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:16.773423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:16.773968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:16.774366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:16.778121 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 583/1227] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:15 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1321 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:17.014187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:17.029105 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c10c38f5-5121-4f75-a3a7-6cb421b2fdaf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.277266 Nov 02 13:17:17.030831 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 645/1228] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:16 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:17.124539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:17.125147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:17.129333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:17.132741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:17.137876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.138372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.138815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:17.145896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.146390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.149375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:17.299044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:17.308876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:17.312739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:17.327414 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-beb30c43-f156-45b8-95e1-56c363696f75 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.206666 Nov 02 13:17:17.331799 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 584/1229] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:17 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:17.504386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:17.505582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:17.513607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:17.522998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.523551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.524054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:17.525310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.530710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.531632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:17.719325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:17.728817 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8b7aab8a-5a54-4e74-816d-b6ed2550e825 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.229250 Nov 02 13:17:17.734073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 646/1230] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:17 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:17.805823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:17.807077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:17.815661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.819945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.820677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:17.821623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:17.822078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:17.822505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:18.065757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:18.076983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:18.098569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:18.104996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:18.105789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:18.106871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:18.111807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:18.112425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:18.320998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:18.340111 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60737c41-002a-448c-9a28-df6b78c11308 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1321 microversion: 2.1 time: 0.538951 Nov 02 13:17:18.341038 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 585/1231] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:17 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:18.368672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:18.369579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:18.388442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:18.388831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:18.389669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:18.390394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:18.391216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:18.394609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:18.444779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:18.454003 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-67994524-4211-4eeb-bced-c3a78026ac34 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1316 microversion: 2.1 time: 0.399467 Nov 02 13:17:18.454611 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 647/1232] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:18 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:18.568169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:18.603328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:18.605854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:18.616818 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e7ec2654-4042-4c91-af87-e12a7a0d6637 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.256881 Nov 02 13:17:18.619245 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 586/1233] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:18 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:18.762235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:18.762841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:18.779935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:18.781527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:18.783918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:18.785991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:18.789557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:18.790463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.073441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:19.100095 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0a0199b8-79f5-4270-89df-06443b9e5b94 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.338979 Nov 02 13:17:19.113704 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 648/1234] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:18 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:19.365749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:19.366463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:19.382926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.386343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.386829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.391941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.392444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.392894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.481796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:19.482414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:19.498311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.506498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.508122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.512988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.514729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.516532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.573280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:19.792189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:19.803165 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce9f67f4-f09a-42fb-8532-b21fdffeff04 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1466 microversion: 2.1 time: 0.325105 Nov 02 13:17:19.804607 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 649/1235] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:19 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1466 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:19.810240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:19.811106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:19.820125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.821498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.822973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.824612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.825254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.826199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.846394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:19.859840 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a2404a3-d90c-4b20-a2ad-bc7f1e0cdcde tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1321 microversion: 2.1 time: 0.500038 Nov 02 13:17:19.878052 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 587/1236] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:19 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1321 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:19.894490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:19.907800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:19.916634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:19.919497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.921046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.924293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.926107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:19.927544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:19.931684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:19.932206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:19.955063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:19.961699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:19.970300 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7a6fc0ff-d5c5-4d70-982f-051c87b071ef tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.163855 Nov 02 13:17:19.971732 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 650/1237] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:19 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:20.017134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-49a66c28-bbf5-478a-977f-ee8afba676fb req-57c83bea-95bd-4f76-9512-1675a6816ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e5b238-3258-4e2d-ba0e-01268713299a", "name": "network-vif-plugged", "status": "completed", "tag": "bdbac33f-c52c-4822-983e-75fc66196e13"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:20.030814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-49a66c28-bbf5-478a-977f-ee8afba676fb req-57c83bea-95bd-4f76-9512-1675a6816ce7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:20.031828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-49a66c28-bbf5-478a-977f-ee8afba676fb req-57c83bea-95bd-4f76-9512-1675a6816ce7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:20.032489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-49a66c28-bbf5-478a-977f-ee8afba676fb req-57c83bea-95bd-4f76-9512-1675a6816ce7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:20.054117 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-49a66c28-bbf5-478a-977f-ee8afba676fb req-57c83bea-95bd-4f76-9512-1675a6816ce7 service nova] Creating event network-vif-plugged:bdbac33f-c52c-4822-983e-75fc66196e13 for instance d8e5b238-3258-4e2d-ba0e-01268713299a on n-h1-858384-19 Nov 02 13:17:20.061714 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-49a66c28-bbf5-478a-977f-ee8afba676fb req-57c83bea-95bd-4f76-9512-1675a6816ce7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049033 Nov 02 13:17:20.064073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 651/1238] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:20.106680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:20.115425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Old instance type m1.heat2, new instance type m1.heat {{(pid=120929) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 13:17:20.123830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:17:20.124627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:17:20.125260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:17:20.125824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:17:20.126392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:17:20.134590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:20.135592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:20.167545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:20.169286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:20.172531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:20.173393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:20.173983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:20.177147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:20.462870 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-828f22d7-6325-4813-a0b2-f4b2726d840f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de/action" status: 202 len: 0 microversion: 2.1 time: 0.577680 Nov 02 13:17:20.468213 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 588/1239] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:17:19 2022] POST /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:20.491524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:20.503460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:20.525118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:20.529536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:20.532198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:20.533664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:20.534485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:20.537066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:20.601139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:20.614079 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-25dda460-4883-41b7-b475-b24102ef77e2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.484099 Nov 02 13:17:20.636900 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 652/1240] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:20 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:20.873785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb4a75c7-1d4a-4920-bacf-b2090d50b69b tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787c15a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-95777088", "description": "tempest-description-604670309"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:21.160897 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb4a75c7-1d4a-4920-bacf-b2090d50b69b tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.522121 Nov 02 13:17:21.161534 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 653/1241] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:17:20 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:21.174620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:21.175478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:21.183617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.184693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.185432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.186569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.216291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.217085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.431600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:21.445850 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-320b6dea-f3d3-43d2-bb50-7a0162d2abd0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1475 microversion: 2.1 time: 0.973089 Nov 02 13:17:21.447806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 589/1242] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:20 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1475 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:21.455047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:21.456331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:21.470762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.473143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.474675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.476005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.477012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.477852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.578757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:21.582003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:21.592815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:21.594347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:21.611055 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fdaccd79-2a6f-4ac9-a46c-76c8ae30b881 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.161567 Nov 02 13:17:21.612189 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 590/1243] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:21 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:21.615443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:21.623684 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f9346772-61a9-484e-92bf-a2a204713019 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1321 microversion: 2.1 time: 0.461092 Nov 02 13:17:21.625300 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 654/1244] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:21 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:21.641951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:21.645243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e2b7818-36f2-413d-87cf-697845125fd7 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe78776e940>, body: {"security_group_rule": {"parent_group_id": "ae1f58e7-4352-4bda-96ea-d7242432abf9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:21.647101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:21.666279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.667604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.668315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.669200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:21.669815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:21.670405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:21.855276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:21.869596 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dbe23609-34f1-415a-908a-abbc4e38230c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.231250 Nov 02 13:17:21.870265 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 655/1245] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:21 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:21.993269 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e2b7818-36f2-413d-87cf-697845125fd7 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.378933 Nov 02 13:17:21.994607 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 591/1246] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:17:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:22.024563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-519dfb8e-ebe9-4a4b-9c15-bf7613f33b20 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787c15ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1221155237", "description": "tempest-description-2117009964"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:22.284800 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-519dfb8e-ebe9-4a4b-9c15-bf7613f33b20 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.279185 Nov 02 13:17:22.286685 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 656/1247] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:17:22 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:22.303456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63666be2-2d8b-463c-8d72-d42f6f80dde3 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787722f70>, body: {"security_group_rule": {"parent_group_id": "bce73d55-c457-4048-975a-f07d217d8724", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:22.337785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b537ff95-6558-43b6-b9c8-cbe7f888fc2e req-4954e5fd-7486-4a59-951e-c0d95661184b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc106b9-6602-400b-b3b4-b5b3e15fc5b0", "name": "network-vif-plugged", "status": "completed", "tag": "de29ee87-06b0-4365-ba65-10ad14a416c3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:22.357110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b537ff95-6558-43b6-b9c8-cbe7f888fc2e req-4954e5fd-7486-4a59-951e-c0d95661184b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.360669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b537ff95-6558-43b6-b9c8-cbe7f888fc2e req-4954e5fd-7486-4a59-951e-c0d95661184b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.361348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b537ff95-6558-43b6-b9c8-cbe7f888fc2e req-4954e5fd-7486-4a59-951e-c0d95661184b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.391438 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b537ff95-6558-43b6-b9c8-cbe7f888fc2e req-4954e5fd-7486-4a59-951e-c0d95661184b service nova] Creating event network-vif-plugged:de29ee87-06b0-4365-ba65-10ad14a416c3 for instance 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 on n-h2-858384-19 Nov 02 13:17:22.400032 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b537ff95-6558-43b6-b9c8-cbe7f888fc2e req-4954e5fd-7486-4a59-951e-c0d95661184b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070107 Nov 02 13:17:22.410279 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 657/1248] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:17:22.478526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:22.479617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:22.494061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.495013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.495853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.497020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.497830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.498642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.695059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:22.704634 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-61e921a0-0e56-4025-9ad0-d13e83726059 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1475 microversion: 2.1 time: 0.233172 Nov 02 13:17:22.705445 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 658/1249] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:22 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1475 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:22.711538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:22.713418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:22.727891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.728059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.728750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.729978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.730738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.731480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.731608 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63666be2-2d8b-463c-8d72-d42f6f80dde3 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.433105 Nov 02 13:17:22.732210 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 592/1250] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:17:22 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:22.746117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:22.746730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:22.753676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.754371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.755364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.756273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.756891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.757482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.844313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:22.854840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:22.856446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:22.863593 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-535bb5c7-bb9f-4d74-849b-41ab33867707 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.156426 Nov 02 13:17:22.880254 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 659/1251] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:22 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:22.893296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3f1e8951-0ce3-4fdf-8d8d-d30493c39e53 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787c150d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1435423848", "description": "tempest-description-1650143109"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:22.969821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:22.980947 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-72258d7a-932f-468d-97d7-b1c0d45c2e6a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1321 microversion: 2.1 time: 0.246873 Nov 02 13:17:22.982376 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 593/1252] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:22 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:22.988241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:22.989213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:22.997027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:22.997895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:22.998689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:22.999502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:23.000178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:23.000806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:23.141860 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3f1e8951-0ce3-4fdf-8d8d-d30493c39e53 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.260207 Nov 02 13:17:23.142497 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 660/1253] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:17:22 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:23.157370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f3ae827e-f062-48e9-8444-a18ac3f8a6e0 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787509040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-58281914", "description": "tempest-description-1368578662"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:23.235712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:23.250402 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9935df42-d10d-4699-a86d-c51674211adb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1481 microversion: 2.1 time: 0.266077 Nov 02 13:17:23.251851 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 594/1254] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:22 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1481 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:23.371901 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f3ae827e-f062-48e9-8444-a18ac3f8a6e0 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.218791 Nov 02 13:17:23.372837 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 661/1255] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:17:23 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:23.387212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-600aa52a-a0f3-46cc-852e-d84f322b6c1b tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787719f70>, body: {"security_group_rule": {"parent_group_id": "c69d80d9-1aee-45a5-adad-2d41e3f69d2b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1e094046-346e-409a-b7c3-487bfe869fde"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:23.733938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:23.734782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:23.755466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:23.765622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:23.766880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:23.768268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:23.771474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:23.773140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:23.831711 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-600aa52a-a0f3-46cc-852e-d84f322b6c1b tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.449248 Nov 02 13:17:23.841679 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 595/1256] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:17:23 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:23.846814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b46c766-e3d2-4ed1-880d-b274d9014537 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe78776e9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-676688618", "description": "tempest-description-1421021107"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:24.104970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:24.117313 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ffe20b19-4f05-44c5-8538-ed19bfb11573 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1475 microversion: 2.1 time: 0.388925 Nov 02 13:17:24.119085 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 662/1257] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:23 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1475 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:24.125371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:24.125969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:24.133599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:24.134417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:24.135276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:24.136032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:24.136527 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3b46c766-e3d2-4ed1-880d-b274d9014537 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.293641 Nov 02 13:17:24.136673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:24.136962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:24.137294 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 596/1258] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:17:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:24.142487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:24.143423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:24.174132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:24.182622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:24.183392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:24.184405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:24.187213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:24.187922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:24.258328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:24.277790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:24.285679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:24.292096 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-04ecdcb9-9a99-431d-9266-8bd00bb7f37e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.171247 Nov 02 13:17:24.303953 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 663/1259] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:24 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:24.346359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf98f2cb-76da-49a3-9c68-cf5fbeb5d059 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787d3c310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-80013097", "description": "tempest-description-1109635456"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:24.490037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:24.501636 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3c6cd61b-e242-443d-abab-5f8e23073e75 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1321 microversion: 2.1 time: 0.362987 Nov 02 13:17:24.515148 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 597/1260] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:24 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:24.515148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:24.515148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:24.525457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:24.525972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:24.526522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:24.528311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:24.529375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:24.529810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:24.677362 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf98f2cb-76da-49a3-9c68-cf5fbeb5d059 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.372051 Nov 02 13:17:24.678073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 664/1261] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:17:24 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:24.692010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f3224ec5-7127-48f1-9b33-9756d9bf8260 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787bc8ee0>, body: {"security_group_rule": {"parent_group_id": "a261f130-e974-467a-aff9-e00535fa1d65", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7b267108-5ec4-4251-b440-35b6839e4a49"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:24.812968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:24.836063 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a36b100-2d8e-4fc1-b128-58b120be91f6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1467 microversion: 2.1 time: 0.325363 Nov 02 13:17:24.839994 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 598/1262] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:24 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1467 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:24.889017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:24.890037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:24.907754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:24.908749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:24.909460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:24.911025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:24.912621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:24.914165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:25.302374 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f3224ec5-7127-48f1-9b33-9756d9bf8260 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.614646 Nov 02 13:17:25.314581 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 665/1263] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:17:24 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:17:25.334639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:25.339643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:25.354573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:25.355469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:25.356424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:25.357375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:25.358018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:25.358640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:25.632087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:25.642009 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7e3617f-7a88-4a78-8767-778257f7d2e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1475 microversion: 2.1 time: 0.325115 Nov 02 13:17:25.644805 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 666/1264] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:25 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1475 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:25.651174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:25.652187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a258ad96-a16f-4f12-bf84-d8a5623ad477 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe787d3c3a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:25.672358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9aff3b05-5103-4352-83d0-60f1b0d2d1b0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1467 microversion: 2.1 time: 0.804511 Nov 02 13:17:25.683453 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 599/1265] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:24 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1467 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:25.693654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:25.705355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:25.717961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:25.719022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:25.719523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:25.720260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:25.720971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:25.721410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:25.871052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:25.896317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:25.897860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:25.925000 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f93e8ccf-4b10-494f-9bdf-4ba644ff090a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.239796 Nov 02 13:17:25.927060 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 600/1266] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:25 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:25.940632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:25.942273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:25.952201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:25.953250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:25.953927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:25.958710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:25.962294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:25.963323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.079967 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a258ad96-a16f-4f12-bf84-d8a5623ad477 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/7b267108-5ec4-4251-b440-35b6839e4a49" status: 202 len: 0 microversion: 2.1 time: 0.433391 Nov 02 13:17:26.081153 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 667/1267] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:25 2022] DELETE /compute/v2.1/os-security-groups/7b267108-5ec4-4251-b440-35b6839e4a49 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:26.088587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:26.092335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:26.107644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.109247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.110103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.111286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.111827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.113978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.258640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:17:26.259405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:17:26.260069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:17:26.260794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:17:26.261387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:17:26.347140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:26.355686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.356255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.356802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.357623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.358302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.358722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.372818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:26.392802 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c8138659-8823-4add-867d-da543bba2f14 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1470 microversion: 2.1 time: 0.464439 Nov 02 13:17:26.395142 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 601/1268] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:25 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1470 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:26.404004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1f65183-a1bc-4c2f-8bda-c7db25535d07 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe7877891f0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:26.431636 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00636e29-a102-4f89-85e3-c256f556f691 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action" status: 202 len: 1071 microversion: 2.1 time: 0.348292 Nov 02 13:17:26.433280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 668/1269] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:17:26 2022] POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action => generated 1071 bytes in 351 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:17:26.438929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:26.439671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:26.461353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.463279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.464007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.465539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.466826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.467355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.501497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:17:26.571918 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e1f65183-a1bc-4c2f-8bda-c7db25535d07 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups/a261f130-e974-467a-aff9-e00535fa1d65" status: 200 len: 247 microversion: 2.1 time: 0.175122 Nov 02 13:17:26.572806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 602/1270] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:17:26 2022] GET /compute/v2.1/os-security-groups/a261f130-e974-467a-aff9-e00535fa1d65 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:26.586305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90f48c1e-8ace-4a8e-b499-fb13d6cc081c tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:26.588072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90f48c1e-8ace-4a8e-b499-fb13d6cc081c tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:26.600841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f48c1e-8ace-4a8e-b499-fb13d6cc081c tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.601694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f48c1e-8ace-4a8e-b499-fb13d6cc081c tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.602255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f48c1e-8ace-4a8e-b499-fb13d6cc081c tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.603341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f48c1e-8ace-4a8e-b499-fb13d6cc081c tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.603880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f48c1e-8ace-4a8e-b499-fb13d6cc081c tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.605040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f48c1e-8ace-4a8e-b499-fb13d6cc081c tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.638228 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6b9f254c-4f90-4f1d-8a54-7cd72fb01b9c tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 204 len: 0 microversion: 2.1 time: 0.203368 Nov 02 13:17:26.642537 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 669/1271] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:17:26 2022] DELETE /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:17:26.669707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:26.670706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:26.697850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.699185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.699846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.701052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:26.701663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:26.702145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:26.836273 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90f48c1e-8ace-4a8e-b499-fb13d6cc081c tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1623 microversion: 2.1 time: 0.261313 Nov 02 13:17:26.838234 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 603/1272] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:26 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1623 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:26.844133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de4a04cd-76a1-43e7-962f-5679be71e741 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe7877225e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1717896637", "description": "tempest-description-1256932570"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:26.931545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:26.934897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:26.961028 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e0eaa5f-328d-4324-bf1b-fed5a98222fb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.316081 Nov 02 13:17:26.966063 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 670/1273] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:26 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:26.981929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:26.982597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:27.005858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.008066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.009738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.010677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.013625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.014801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.125148 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de4a04cd-76a1-43e7-962f-5679be71e741 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.285515 Nov 02 13:17:27.126372 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 604/1274] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:17:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:27.140577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-278211097", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "1031214878", "adminPass": "***", "networks": [{"uuid": "e4e8486f-100c-4eb5-98f1-c9d83089cd3f"}], "security_groups": [{"name": "tempest-securitygroup--1351989893"}], "key_name": "tempest-keypair-1877925391", "user_data": "}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:27.345579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:27.356086 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-534dffd0-a4b3-4f26-9d4e-7c1c7ccde2b3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.388346 Nov 02 13:17:27.357274 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 671/1275] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:26 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:27.368358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:27.368358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:27.372468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] validate_networks() for [('e4e8486f-100c-4eb5-98f1-c9d83089cd3f', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:17:27.377005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.377955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.379471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.380750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.381459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.386411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.488561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:27.502348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:27.504590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:27.510323 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b9e8fdf8-ae6f-42a1-afa8-c8584d2ae7a4 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.151781 Nov 02 13:17:27.523140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 672/1276] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:27 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:27.523140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-591824398", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8cd2a3ab-5b0a-47ad-8467-33b0414c55e1"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:27.578412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:17:27.919530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:17:27.920245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:17:27.920899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:17:27.921539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:17:27.922334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:17:27.940737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.942063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.942485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.943477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.943603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:17:27.944062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.944202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:17:27.944499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.944623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:17:27.945006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:17:27.945421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:17:27.960885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.962025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.962728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.964011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:27.965027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:27.965691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:27.966259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:17:27.972609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Getting quotas for user cddc6a408b8143999f80691c3234e6a4 and project c7be3a8c61da4ee7aa4d1b500f5e9cec. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:17:28.000047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Getting quotas for project a27e4041951f43b6a4beb4e471cbb63b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:17:28.001534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:17:28.006369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:17:28.008046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Getting quotas for user c67a249e060245d8a474939741a581b3 and project a27e4041951f43b6a4beb4e471cbb63b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:17:28.023631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:17:28.026735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:17:28.090766 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a21798c1-055f-4b8d-a58d-6fca82b938c0 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.962864 Nov 02 13:17:28.100741 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 605/1277] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:17:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:17:28.107637 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d9675a4-709d-4cd2-acc7-f8311b5a193f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.594702 Nov 02 13:17:28.109480 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 673/1278] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:17:27 2022] POST /compute/v2.1/servers => generated 382 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:17:28.117950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:28.119649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:28.127871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:28.129870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:28.131236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:28.132152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:28.132607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9681eaf0-a1ec-4138-bb53-acb9589aade8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787722f70>, body: {"security_group_rule": {"parent_group_id": "8b47c0a9-8751-4bf3-ba68-89c7f976b863", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:28.133310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:28.133927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:28.491378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:28.518027 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-feee2dea-b519-49e0-846f-4f761fb6745d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.406401 Nov 02 13:17:28.531153 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 674/1279] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:28 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:28.531153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df44b5e8-ea55-46be-b5ca-6bc990f595d8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:28.531153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df44b5e8-ea55-46be-b5ca-6bc990f595d8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:28.590560 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9681eaf0-a1ec-4138-bb53-acb9589aade8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.469942 Nov 02 13:17:28.591732 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 606/1280] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:17:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:28.599998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-312c354c-6f14-4e78-a516-b14584b30174 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:28.601001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-312c354c-6f14-4e78-a516-b14584b30174 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:28.702996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-312c354c-6f14-4e78-a516-b14584b30174 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:28.714062 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-312c354c-6f14-4e78-a516-b14584b30174 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1220 microversion: 2.1 time: 0.120894 Nov 02 13:17:28.732197 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 607/1281] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:28 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:28.740863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-df44b5e8-ea55-46be-b5ca-6bc990f595d8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:28.742917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:28.745766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:28.752874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df44b5e8-ea55-46be-b5ca-6bc990f595d8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1268 microversion: 2.1 time: 0.230545 Nov 02 13:17:28.759359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:28.760238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:28.760912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:28.762212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:28.762885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:28.763721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:28.769243 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 675/1282] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:28 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1268 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:28.781855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:28.783074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:28.798814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:28.799733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:28.801515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:28.802869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:28.803704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:28.804533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:28.998115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:29.009186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:29.010676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:29.017303 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eb0a6254-71c4-4a9f-aee8-5a58ae7b3616 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.246367 Nov 02 13:17:29.018250 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 676/1283] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:28 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:29.025427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5b03e49-051e-4c8c-aa19-b7ff134078db tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Action: 'create', calling method: .version_select at 0x7fe787c15e50>, body: {"security_group_rule": {"parent_group_id": "8b47c0a9-8751-4bf3-ba68-89c7f976b863", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:29.275580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:29.288364 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-283a32e1-5d49-4bf5-b4dd-8db1531e4f8c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.564886 Nov 02 13:17:29.291549 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 608/1284] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:28 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:29.476575 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b5b03e49-051e-4c8c-aa19-b7ff134078db tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.456396 Nov 02 13:17:29.477499 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 677/1285] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:17:29 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:29.492941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-537a6db0-4dec-4fdd-ac95-ae95cc069616 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe78773db80>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:29.555717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:29.557649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:29.579916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:29.580773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:29.582116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:29.583297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:29.584033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:29.585009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:29.646897 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-537a6db0-4dec-4fdd-ac95-ae95cc069616 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups/8b47c0a9-8751-4bf3-ba68-89c7f976b863" status: 200 len: 665 microversion: 2.1 time: 0.158886 Nov 02 13:17:29.648280 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 609/1286] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:17:29 2022] GET /compute/v2.1/os-security-groups/8b47c0a9-8751-4bf3-ba68-89c7f976b863 => generated 665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:29.668718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c8dbea6f-85a6-4a32-ae60-eb0e0eccdb5c tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe78773ddc0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:29.879893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:29.893305 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8baa5215-b6bc-4986-b215-d965dd197506 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.349240 Nov 02 13:17:29.896765 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 678/1287] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:29 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:29.908033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:29.919279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:29.924911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:29.933444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:29.938308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:29.939357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:29.941208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:29.943585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:29.944350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.065763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:30.078570 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f444a80-d1b6-465d-8121-d43f1cd35319 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1272 microversion: 2.1 time: 0.180314 Nov 02 13:17:30.079644 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 679/1288] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:29 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:30.090867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:30.092269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:30.105315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.106035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.106950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.108904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.109707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.125325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.154473 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c8dbea6f-85a6-4a32-ae60-eb0e0eccdb5c tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-group-rules/4e9382d4-c87e-40f8-989a-dd6a2ef56d54" status: 202 len: 0 microversion: 2.1 time: 0.489986 Nov 02 13:17:30.159214 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 610/1289] 10.222.0.113 () {58 vars in 1292 bytes} [Wed Nov 2 13:17:29 2022] DELETE /compute/v2.1/os-security-group-rules/4e9382d4-c87e-40f8-989a-dd6a2ef56d54 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:30.166643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:30.168743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:30.184094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.184587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.187707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.189705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.190361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.192750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.305805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:30.310793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:30.322935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:30.326556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:30.327651 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09b03017-c55e-4640-b1ae-fab5304c78f3 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1320 microversion: 2.1 time: 0.246766 Nov 02 13:17:30.328263 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 680/1290] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:30 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:30.334690 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-edba0f8b-d435-4383-a5a0-72fe94e22f7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.174261 Nov 02 13:17:30.343766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0782573a-fe09-4b7c-a06c-81d6397dc9b1 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe7877631f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:30.357144 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 611/1291] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:30 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:30.370586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:30.371247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:30.395299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.396429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.397170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.397944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.398608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.403242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.751886 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0782573a-fe09-4b7c-a06c-81d6397dc9b1 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/8b47c0a9-8751-4bf3-ba68-89c7f976b863" status: 202 len: 0 microversion: 2.1 time: 0.417642 Nov 02 13:17:30.752661 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 681/1292] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:30 2022] DELETE /compute/v2.1/os-security-groups/8b47c0a9-8751-4bf3-ba68-89c7f976b863 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:30.761495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0de39a33-8a19-4d6b-9ac2-75675fc4baa8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe787cd4c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:30.812310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:30.828861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-0de39a33-8a19-4d6b-9ac2-75675fc4baa8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b267108-5ec4-4251-b440-35b6839e4a49 does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:17:30.829555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-0de39a33-8a19-4d6b-9ac2-75675fc4baa8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Neutron security group 7b267108-5ec4-4251-b440-35b6839e4a49 not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:17:30.830107 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-0de39a33-8a19-4d6b-9ac2-75675fc4baa8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] HTTP exception thrown: Security group 7b267108-5ec4-4251-b440-35b6839e4a49 does not exist Nov 02 13:17:30.830107 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-13bebd3b-22ab-40f7-8bcc-874b4673b325'] Nov 02 13:17:30.834339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-056cd218-fe6a-4634-84b4-98ca77a15093 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.479697 Nov 02 13:17:30.851920 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 612/1293] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:30 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0de39a33-8a19-4d6b-9ac2-75675fc4baa8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Request method failure captured: Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-security-groups/7b267108-5ec4-4251-b440-35b6839e4a49 HTTP/1.1 Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm3guxCP-KtY6sjimd2BGbg9BXQpkIbqy80A_VL-u6EgIEWlekdpbeUM1yMvjJP3a8iTyTSAsuXRB80WF1ohPKNwpAIG7kaW_6pm5ztWEMMTfVhg7QURTCEHG7MY3XjIG8ZZ3IONbQaMfooftQW__7qV2uPl5dwZtO8GhvygwctsgqQ Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: abc8f60e7d3b480ab1ce9e088a509c3e Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1436374977 Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:17:30.858238 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/abc8f60e7d3b480ab1ce9e088a509c3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/abc8f60e7d3b480ab1ce9e088a509c3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_abc8f60e7d3b480ab1ce9e088a509c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/abc8f60e7d3b480ab1ce9e088a509c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1436374977 Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: abc8f60e7d3b480ab1ce9e088a509c3e Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1436374977 Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupRulesTestJSON-1436374977-project Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: ec58e42e91ad4678bf416537fc7849be Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1436374977-project Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group 7b267108-5ec4-4251-b440-35b6839e4a49 does not exist Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-13bebd3b-22ab-40f7-8bcc-874b4673b325'] Nov 02 13:17:30.859978 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7b267108-5ec4-4251-b440-35b6839e4a49'} Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:30.861029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7b267108-5ec4-4251-b440-35b6839e4a49 does not exist Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-13bebd3b-22ab-40f7-8bcc-874b4673b325'] Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:17:30.862445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7b267108-5ec4-4251-b440-35b6839e4a49 does not exist Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-13bebd3b-22ab-40f7-8bcc-874b4673b325'] Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7b267108-5ec4-4251-b440-35b6839e4a49 does not exist Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-13bebd3b-22ab-40f7-8bcc-874b4673b325'] Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:30.864407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7b267108-5ec4-4251-b440-35b6839e4a49 does not exist Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-13bebd3b-22ab-40f7-8bcc-874b4673b325'] Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0de39a33-8a19-4d6b-9ac2-75675fc4baa8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Returning 404 to user: Security group 7b267108-5ec4-4251-b440-35b6839e4a49 does not exist Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-13bebd3b-22ab-40f7-8bcc-874b4673b325'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:30.865947 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0de39a33-8a19-4d6b-9ac2-75675fc4baa8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/7b267108-5ec4-4251-b440-35b6839e4a49" status: 404 len: 194 microversion: 2.1 time: 0.102500 Nov 02 13:17:30.869651 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 682/1294] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:30 2022] DELETE /compute/v2.1/os-security-groups/7b267108-5ec4-4251-b440-35b6839e4a49 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:17:30.871749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-054bc37c-3d34-432e-a1ea-3599bc4f00ac tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe787664820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:30.923154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:30.931006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:30.942433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.948537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.949287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:30.951547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:30.952233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:30.953674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.247094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:31.263722 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd18d33b-322c-4853-a72b-256fde59c2d3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.348123 Nov 02 13:17:31.264770 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 683/1295] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:30 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:31.274846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:31.277106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:31.292010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.292516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.292970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.299789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.303723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.304370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.482678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:31.494977 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74c6fdc7-5513-43f3-9c69-f72b853689f2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1290 microversion: 2.1 time: 0.228803 Nov 02 13:17:31.496336 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 684/1296] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:31 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1290 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:31.501270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:31.501950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:31.509928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.510571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.511045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.511847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.512507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.512880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.617453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:31.634107 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fe21492a-8428-45bf-97e2-2ae09025e918 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1326 microversion: 2.1 time: 0.136519 Nov 02 13:17:31.640019 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 685/1297] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:31 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1326 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:31.647438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:31.648059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:31.654993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.655172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.655547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.656256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.656714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.657144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.747337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:31.760394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:31.761895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:31.780689 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-37cfc3ff-971b-409d-a3ae-41a65120b388 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1558 microversion: 2.91 time: 0.139337 Nov 02 13:17:31.781858 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 686/1298] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:31 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1558 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:31.789813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-685baa4c-a130-4778-a39b-92cc9c58fe17 req-a4e9693d-529a-4529-86cf-e414a432a56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b1c802-d2e4-4c0b-841a-f0baba14e1a0", "name": "network-vif-deleted", "tag": "0d829b33-7204-477e-a57b-fb4f3f12903f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:31.808540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-685baa4c-a130-4778-a39b-92cc9c58fe17 req-a4e9693d-529a-4529-86cf-e414a432a56b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.809218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-685baa4c-a130-4778-a39b-92cc9c58fe17 req-a4e9693d-529a-4529-86cf-e414a432a56b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.809840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-685baa4c-a130-4778-a39b-92cc9c58fe17 req-a4e9693d-529a-4529-86cf-e414a432a56b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.840263 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-685baa4c-a130-4778-a39b-92cc9c58fe17 req-a4e9693d-529a-4529-86cf-e414a432a56b service nova] Creating event network-vif-deleted:0d829b33-7204-477e-a57b-fb4f3f12903f for instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 on n-h1-858384-19 Nov 02 13:17:31.851372 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-685baa4c-a130-4778-a39b-92cc9c58fe17 req-a4e9693d-529a-4529-86cf-e414a432a56b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067734 Nov 02 13:17:31.853470 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 687/1299] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:31.861992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:31.863950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:31.871547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.873809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.874659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.876286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:31.877021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:31.877683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:31.938101 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-054bc37c-3d34-432e-a1ea-3599bc4f00ac tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/a261f130-e974-467a-aff9-e00535fa1d65" status: 202 len: 0 microversion: 2.1 time: 1.071747 Nov 02 13:17:31.939055 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 613/1300] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:30 2022] DELETE /compute/v2.1/os-security-groups/a261f130-e974-467a-aff9-e00535fa1d65 => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:31.948958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99b9a618-95f1-41df-80cd-890d3b198422 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe78773d430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:32.364504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:32.375997 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5fd9c23d-d6d5-4668-9828-46348c3c1f7e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.520983 Nov 02 13:17:32.388008 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 688/1301] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:31 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:32.392979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:32.393708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:32.404113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:32.405156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:32.405749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:32.410937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:32.411574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:32.412067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:32.658869 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99b9a618-95f1-41df-80cd-890d3b198422 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/1e094046-346e-409a-b7c3-487bfe869fde" status: 202 len: 0 microversion: 2.1 time: 0.715185 Nov 02 13:17:32.662759 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 614/1302] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:31 2022] DELETE /compute/v2.1/os-security-groups/1e094046-346e-409a-b7c3-487bfe869fde => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:32.665194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:32.665916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:32.686130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:32.687747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:32.688365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:32.695653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:32.696415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:32.697083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:32.833738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:32.845456 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68170193-626a-4d10-b992-b6786a412981 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.456226 Nov 02 13:17:32.848600 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 689/1303] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:32 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:32.859036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:32.860014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:32.876459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:32.877233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:32.877900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:32.879034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:32.879891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:32.880530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:33.135896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:33.148188 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f40d237-6440-49cb-945f-5b22e2188cea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.486810 Nov 02 13:17:33.149579 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 615/1304] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:32 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:33.155176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-76c58125-0edf-4af2-b78d-59afa5409394 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe787624c10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:33.588753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:33.600613 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-962d23f1-a621-4701-a661-3bcc3a3f09f5 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.750563 Nov 02 13:17:33.601213 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 690/1305] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:32 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:33.610353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:33.614108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:33.622405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:33.623250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:33.623917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:33.624788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:33.625396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:33.625988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:33.725031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:33.745981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:33.748119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:33.757323 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-685849ae-77cf-4573-b49f-0fdba4517370 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1540 microversion: 2.91 time: 0.150737 Nov 02 13:17:33.763974 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 691/1306] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:33 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1540 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:33.775676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:33.779925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:33.788082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:33.790559 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-76c58125-0edf-4af2-b78d-59afa5409394 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/c69d80d9-1aee-45a5-adad-2d41e3f69d2b" status: 202 len: 0 microversion: 2.1 time: 0.639705 Nov 02 13:17:33.791165 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 616/1307] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:33 2022] DELETE /compute/v2.1/os-security-groups/c69d80d9-1aee-45a5-adad-2d41e3f69d2b => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:33.791598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:33.792152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:33.792892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:33.793347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:33.793767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:33.799565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a04c87a9-4dbb-47ff-9e9a-20b6ffcf8ff8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe7876249d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:34.035292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:34.040334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:34.046543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-943d6ec0-5b31-45ad-b059-d501a5eecec5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.280640 Nov 02 13:17:34.047328 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 692/1308] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:33 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:34.052794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:34.053418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:34.063642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.064141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.064593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.065330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.065798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.066242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.225643 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a04c87a9-4dbb-47ff-9e9a-20b6ffcf8ff8 tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/bce73d55-c457-4048-975a-f07d217d8724" status: 202 len: 0 microversion: 2.1 time: 0.429754 Nov 02 13:17:34.233114 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 617/1309] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:33 2022] DELETE /compute/v2.1/os-security-groups/bce73d55-c457-4048-975a-f07d217d8724 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:17:34.239565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b9d4bc98-cb87-4927-b6ab-d3dcf44e0621 req-e2e459cf-5e2d-4cb0-a1bf-2ef7a8ee191d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f813fd-58b7-418d-8779-6da7f3856870", "tag": "d944e463-5baa-4f92-9797-a5e4b5a4ae3d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:34.260333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9d4bc98-cb87-4927-b6ab-d3dcf44e0621 req-e2e459cf-5e2d-4cb0-a1bf-2ef7a8ee191d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.260819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9d4bc98-cb87-4927-b6ab-d3dcf44e0621 req-e2e459cf-5e2d-4cb0-a1bf-2ef7a8ee191d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.261259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9d4bc98-cb87-4927-b6ab-d3dcf44e0621 req-e2e459cf-5e2d-4cb0-a1bf-2ef7a8ee191d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.277645 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b9d4bc98-cb87-4927-b6ab-d3dcf44e0621 req-e2e459cf-5e2d-4cb0-a1bf-2ef7a8ee191d service nova] Creating event network-changed:d944e463-5baa-4f92-9797-a5e4b5a4ae3d for instance 77f813fd-58b7-418d-8779-6da7f3856870 on n-h1-858384-19 Nov 02 13:17:34.286690 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b9d4bc98-cb87-4927-b6ab-d3dcf44e0621 req-e2e459cf-5e2d-4cb0-a1bf-2ef7a8ee191d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051116 Nov 02 13:17:34.288290 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 618/1310] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:34.297997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:34.298891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:34.309058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.309863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.310495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.311414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.312241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.312981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.340956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:34.352620 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47a2ea37-691e-4987-8d4d-b1014abcbd4a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.303986 Nov 02 13:17:34.354307 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 693/1311] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:34 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:34.360671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b614719-be87-43f3-9a0e-ecda2ab5209d tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] Calling method '.version_select at 0x7fe7878b7310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:34.522574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:34.530350 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f25cc208-f3dd-40cf-8b3f-2fb3fd334e13 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.239900 Nov 02 13:17:34.530932 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 619/1312] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:34 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:34.536484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e879303b-242f-4e1a-ac28-0f84fa6a44cc req-436d14c0-2c51-471d-9614-ce677d3aaa00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a4217c-1a63-48d7-9f9f-95f6dcf98a33", "tag": "2a1d7d81-182b-49ee-9769-5410cd39d830"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:34.546419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e879303b-242f-4e1a-ac28-0f84fa6a44cc req-436d14c0-2c51-471d-9614-ce677d3aaa00 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.547012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e879303b-242f-4e1a-ac28-0f84fa6a44cc req-436d14c0-2c51-471d-9614-ce677d3aaa00 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.547488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e879303b-242f-4e1a-ac28-0f84fa6a44cc req-436d14c0-2c51-471d-9614-ce677d3aaa00 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.560877 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e879303b-242f-4e1a-ac28-0f84fa6a44cc req-436d14c0-2c51-471d-9614-ce677d3aaa00 service nova] Creating event network-changed:2a1d7d81-182b-49ee-9769-5410cd39d830 for instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 on n-h2-858384-19 Nov 02 13:17:34.566325 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e879303b-242f-4e1a-ac28-0f84fa6a44cc req-436d14c0-2c51-471d-9614-ce677d3aaa00 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033296 Nov 02 13:17:34.566927 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 620/1313] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:34.625137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:34.625947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:34.632953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.633439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.633874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.634696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.635178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.635730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.755933 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b614719-be87-43f3-9a0e-ecda2ab5209d tempest-SecurityGroupRulesTestJSON-1436374977 tempest-SecurityGroupRulesTestJSON-1436374977-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/ae1f58e7-4352-4bda-96ea-d7242432abf9" status: 202 len: 0 microversion: 2.1 time: 0.400318 Nov 02 13:17:34.756732 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 694/1314] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:34 2022] DELETE /compute/v2.1/os-security-groups/ae1f58e7-4352-4bda-96ea-d7242432abf9 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:34.788311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:34.788917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:34.798489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.799334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.800726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.801491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:34.801947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:34.802375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:34.832018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:34.842303 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4fdb75d5-2fd6-4793-b498-3130f5dded45 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.221611 Nov 02 13:17:34.858917 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 621/1315] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:34 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:34.894041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:34.906554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:34.908088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:34.914360 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc9bbc6e-a0c3-49dc-afbc-2b2d5adf3db9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1540 microversion: 2.91 time: 0.130480 Nov 02 13:17:34.914962 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 695/1316] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:34 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1540 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:35.069970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:35.070674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:35.076746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.077219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.077646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.078381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.078828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.079283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.323464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:35.333486 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0e82a115-55e0-496f-bd2c-a708a097d6bc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.267840 Nov 02 13:17:35.334080 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 622/1317] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:35 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:35.381225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:35.381843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:35.388635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.389123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.389565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.390272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.390731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.391216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.526653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:35.534561 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a71afd8f-b973-4eeb-950b-46403df73566 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.157743 Nov 02 13:17:35.535296 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 696/1318] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:35 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:35.558537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:35.561164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:35.568655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.569232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.569753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.570541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.570926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.571385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.586812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:35.769615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:35.777563 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-185f36ef-799a-40c1-a2b1-395e17201d1e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.222986 Nov 02 13:17:35.778169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 623/1319] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:35 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:35.868589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:35.869373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:35.875826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.876307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.876739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.877435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.877896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.878312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.956425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:35.957729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:35.968187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.971986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.972605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:35.973888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:35.974671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:35.975319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:36.056127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:36.066659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-70cb000b-c59a-42b3-85dc-4eded8bc78f2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.202037 Nov 02 13:17:36.067285 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 697/1320] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:35 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:36.085791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:36.094918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:36.097111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:36.102767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b46901b1-7228-4da8-9f83-63760d1cb397 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1540 microversion: 2.91 time: 0.154142 Nov 02 13:17:36.107804 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 624/1321] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:35 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1540 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:36.357702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:36.358419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:36.365295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:36.365900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:36.366214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:36.366919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:36.367400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:36.368042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:36.524198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:36.545160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c57567db-0836-4c57-9c41-fb4226e01bc4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.191180 Nov 02 13:17:36.545761 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 698/1322] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:36 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:36.567494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:36.568992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:36.579752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:36.580481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:36.581646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:36.582587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:36.583278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:36.583866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:36.802000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:36.802619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:36.809613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:36.810404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:36.810831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:36.812620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:36.813408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:36.814074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:36.929438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:36.953683 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-849b6ba9-ccd5-4ef5-9de5-ea1024465e5c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.396774 Nov 02 13:17:36.954470 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 625/1323] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:36 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:36.982030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:36.994004 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d76a0738-a410-44ca-9aff-eecc6b1408c2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.196415 Nov 02 13:17:36.995208 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 699/1324] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:36 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:37.091434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:37.092356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:37.099495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.100253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.100686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.101563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.102022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.102438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.131462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:37.132282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:37.138880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.139427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.139870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.141426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.141894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.142331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.219679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:37.231069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:37.233074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:37.239764 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2c395dbb-7b3a-42db-a8f0-5ead46f8362a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1483 microversion: 2.91 time: 0.112281 Nov 02 13:17:37.240379 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 700/1325] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:37 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1483 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:37.272831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:37.275863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:37.292169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.300691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.301248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.302030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.302507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.303299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.381109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858384-19". {{(pid=120928) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Nov 02 13:17:37.453786 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-57fce6e9-b52a-44c7-9ef7-a197e3b43e46 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727/action" status: 202 len: 0 microversion: 2.91 time: 0.186958 Nov 02 13:17:37.457567 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 701/1326] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:17:37 2022] POST /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:17:37.464779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:37.465466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:37.473417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.473909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.474347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.475059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.475663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.476282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.559798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:37.586872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:37.588767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:37.595484 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-42d67aef-2a3d-4acc-8a3f-353488e13ad9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1491 microversion: 2.91 time: 0.136241 Nov 02 13:17:37.597841 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 702/1327] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:37 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1491 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:37.603881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:37.604734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:37.613424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.614643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.615531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.617581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.618232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.620195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.883094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:37.897135 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2bc192a6-0af9-436b-b3af-dda25e2364e9 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.810685 Nov 02 13:17:37.901873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:37.911478 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-36970181-3d3e-411a-8514-495f4baec327 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.312092 Nov 02 13:17:37.911642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 626/1328] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:37 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:37.917658 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 703/1329] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:37 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:37.978098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:37.978713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:37.981299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:37.989783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.990515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.991164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:37.992045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:37.992808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:37.993827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:38.019179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:38.019957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:38.022187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:38.032644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:38.037063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:38.037585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:38.038251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:38.038708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:38.040256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:38.207956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:38.215851 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8a2abfe-f9c6-42d6-907c-d5974ab03846 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.201800 Nov 02 13:17:38.216441 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 704/1330] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:38 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:38.335425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:38.343725 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6b7b340-81bf-4d03-8236-ef081f8f6622 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.369664 Nov 02 13:17:38.344300 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 627/1331] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:37 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:38.631570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:38.632304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:38.639186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:38.639881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:38.640325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:38.641217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:38.641676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:38.642103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:38.742465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:38.751383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:38.753705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:38.757408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:38.761432 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4197bd36-2a38-4b17-827c-470344a7dc70 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1491 microversion: 2.91 time: 0.136137 Nov 02 13:17:38.775157 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 705/1332] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:38 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1491 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:38.918942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:38.924025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:38.926249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:38.932776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:38.933262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:38.933701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:38.934509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:38.934963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:38.935412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:38.942181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:38.942789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:38.950037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:38.950523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:38.950955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:38.951710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:38.966334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:38.966928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:39.184651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:39.199015 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-55724711-fe1d-485a-8cc0-d50fc4f0e152 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.261005 Nov 02 13:17:39.200177 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 706/1333] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:38 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:39.222850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:39.232052 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b40f0e3-8583-450a-88ea-13b601b33bd2 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.314187 Nov 02 13:17:39.247576 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 628/1334] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:38 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:39.255601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:39.256791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:39.263716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:39.264535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:39.265193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:39.266140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:39.266817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:39.267726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:39.366805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:39.367552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:39.376680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:39.381890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:39.382657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:39.383649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:39.384311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:39.389303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:39.596169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:39.609922 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-890652ed-aa5b-4339-b7af-4dbf85d9dea8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.371835 Nov 02 13:17:39.610532 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 707/1335] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:39 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:39.795480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:39.797007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:39.805626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:39.806256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:39.806888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:39.807760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:39.808309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:39.809016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:39.888556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:39.903023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:39.904568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:39.911248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d87a0e5e-1fd0-4ed4-acaa-2e80b1a11452 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.120692 Nov 02 13:17:39.912223 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 708/1336] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:39 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:39.938511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:39.946481 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-79d3c8c9-9795-4a6e-9230-7519ef5372af tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.584529 Nov 02 13:17:39.947047 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 629/1337] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:39 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:40.224930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:40.225901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:40.237234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:40.237801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:40.238795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:40.240064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:40.240405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:40.240916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:40.245443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:40.258076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:40.258688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:40.272715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:40.273204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:40.274903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:40.278453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:40.279529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:40.280147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:40.505280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:40.509786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:40.520516 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82fe6f00-29a9-440a-be51-68819ebbffab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.301379 Nov 02 13:17:40.521121 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 709/1338] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:40 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:40.521248 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e6f0932f-5551-4539-ac92-74d7b1b2cc1b tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.267301 Nov 02 13:17:40.551699 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 630/1339] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:40 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:40.635679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:40.636524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:40.642655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:40.643385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:40.644001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:40.644745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:40.645205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:40.645642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:40.786309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:40.794776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a277699-fe5f-48da-9c44-14691e365c5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.163090 Nov 02 13:17:40.811138 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 710/1340] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:40 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:40.939749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:40.941258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:40.958744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:40.960464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:40.961019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:40.963104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:40.965285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:40.967347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:40.972046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:40.972883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:40.991226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:40.993809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:40.994844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:41.011371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:41.012072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:41.012880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:41.084379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:41.098713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:41.100579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:41.106676 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2bc6a977-bf8d-4519-842e-e24e94dc98aa tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.170779 Nov 02 13:17:41.119168 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 631/1341] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:40 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:41.179926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:41.189367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e992052f-5118-4a16-acc8-e65b55d6e3b8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.222760 Nov 02 13:17:41.190077 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 711/1342] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:40 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:41.546165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:41.546790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:41.553352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:41.557362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:41.557733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:41.557886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:41.558302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:41.559024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:41.563630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:41.564088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:41.568101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:41.569013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:41.569835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:41.570797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:41.571510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:41.572392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:41.776794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:41.786694 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-62faf54b-35f7-4a99-9e9d-7b5b415b9960 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.239328 Nov 02 13:17:41.794914 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 712/1343] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:41 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:41.819539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:41.820857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:41.828244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:41.828948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:41.829786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:41.831504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:41.832160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:41.832762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:41.835190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:41.855873 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-588c81e4-53b8-47ab-8d68-5c9c7d868af5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.313864 Nov 02 13:17:41.857408 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 632/1344] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:41 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:42.034774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:42.043729 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-740f555d-f931-4809-b69a-29795b32e357 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.228381 Nov 02 13:17:42.059568 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 713/1345] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:41 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:42.138714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:42.139844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:42.147756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:42.148764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:42.149479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:42.150614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:42.151526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:42.152338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:42.214011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:42.214930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:42.224643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:42.225475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:42.226135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:42.227264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:42.228269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:42.229115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:42.275883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:42.298632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:42.303682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:42.318388 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0738b8f-355a-458e-9868-098b5e90e060 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.185382 Nov 02 13:17:42.320962 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 633/1346] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:42 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:42.394187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:42.403777 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2882eabc-a0a6-45bb-99ab-2abca16188de tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.194169 Nov 02 13:17:42.418968 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 714/1347] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:42 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:42.825993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:42.826742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:42.829118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:42.834255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:42.835061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:42.835749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:42.836716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:42.837433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:42.838235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:42.881727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:42.882447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:42.894392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:42.895577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:42.896305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:42.897327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:42.898230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:42.899274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:43.092797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:43.118172 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aab043f0-9307-4ba4-ae30-6b5f7bb831c4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.241063 Nov 02 13:17:43.121543 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 715/1348] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:42 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:43.149246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:43.155979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:43.168839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:43.169682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:43.170321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:43.173119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:43.173814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:43.176137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:43.228658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:43.242191 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-249d1ee1-a19d-4314-ad48-156067f74b03 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.420157 Nov 02 13:17:43.245039 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 634/1349] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:42 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:43.356150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:43.356840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:43.370782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:43.373836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:43.383874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:43.384910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:43.387576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:43.388237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:43.426220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:43.438591 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8a58d21-e031-4c63-add4-21792f2c5f21 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.302047 Nov 02 13:17:43.439225 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 716/1350] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:43 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:43.451243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:43.451889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:43.467988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:43.468637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:43.469284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:43.470082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:43.470657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:43.471767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:43.669235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:43.678849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:43.683404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:43.699810 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7e0d3979-4296-4abf-a107-e0590c18247c tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.349694 Nov 02 13:17:43.701729 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 635/1351] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:43 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:43.712472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9c328352-a941-4789-a2ad-74c1ccbb7b8c req-807c5d17-057b-4c0a-a73a-7eb23c665ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f813fd-58b7-418d-8779-6da7f3856870", "name": "network-vif-plugged", "status": "completed", "tag": "d944e463-5baa-4f92-9797-a5e4b5a4ae3d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:43.719374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:43.728830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9c328352-a941-4789-a2ad-74c1ccbb7b8c req-807c5d17-057b-4c0a-a73a-7eb23c665ba5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:43.729691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9c328352-a941-4789-a2ad-74c1ccbb7b8c req-807c5d17-057b-4c0a-a73a-7eb23c665ba5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:43.730346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9c328352-a941-4789-a2ad-74c1ccbb7b8c req-807c5d17-057b-4c0a-a73a-7eb23c665ba5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:43.730954 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-63b667f5-185a-4bf3-9c76-8c4d350255d9 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.288480 Nov 02 13:17:43.734340 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 717/1352] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:43 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:43.757492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9c328352-a941-4789-a2ad-74c1ccbb7b8c req-807c5d17-057b-4c0a-a73a-7eb23c665ba5 service nova] Creating event network-vif-plugged:d944e463-5baa-4f92-9797-a5e4b5a4ae3d for instance 77f813fd-58b7-418d-8779-6da7f3856870 on n-h1-858384-19 Nov 02 13:17:43.762891 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9c328352-a941-4789-a2ad-74c1ccbb7b8c req-807c5d17-057b-4c0a-a73a-7eb23c665ba5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059511 Nov 02 13:17:43.763826 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 636/1353] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:44.148129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:44.149452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:44.165876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.167532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.168258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.171974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.172553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.173046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.272530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:44.273251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:44.286624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.290421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.291623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.293525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.298578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.299658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.417013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:44.455331 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1513e63e-fee6-48a4-8558-bb64418cde30 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.313334 Nov 02 13:17:44.460350 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 718/1354] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:44 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:44.466123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:44.466961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:44.481700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.482519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.483173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.484085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.484547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.485050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.673541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:44.685645 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5ca26c4b-eb96-49a3-8742-b7c4872429f8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.419159 Nov 02 13:17:44.692115 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 637/1355] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:44 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:44.730682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:44.732032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:44.742819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:44.758713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b582b2b9-79d3-4065-8ed2-44fd4662ab1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.296771 Nov 02 13:17:44.759356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.761673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.762852 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 719/1356] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:44 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:44.765461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.773373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.778690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.782500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.788479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:44.789549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:44.804411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.804961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.805409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.806134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:44.807228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:44.807228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:44.908204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:44.948237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:44.951055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:44.983647 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a5f67e2f-2cfb-4281-8245-520757f76a05 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.258396 Nov 02 13:17:44.999280 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 638/1357] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:44 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:45.291957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:45.309840 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-699f0e9b-5fd1-4894-876f-e3624c8d6905 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.541650 Nov 02 13:17:45.313006 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 720/1358] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:44 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:45.490162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:45.490162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:45.508410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:45.508903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:45.509337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:45.510763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:45.511264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:45.511691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:45.713934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:45.714570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:45.725757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:45.726845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:45.729264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:45.730104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:45.733426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:45.733876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:45.884145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:45.894377 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-65cf9559-accb-4547-8ea4-5dd8aec1a32c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.413778 Nov 02 13:17:45.913138 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 639/1359] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:45 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:45.922475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:45.923087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:45.945584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:45.946183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:45.946619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:45.947591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:45.951305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:45.951949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:46.050579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:46.060127 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e349664a-c8c6-46cb-a559-d85827e50e41 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.350111 Nov 02 13:17:46.074193 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 721/1360] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:45 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:46.082392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:46.083303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:46.092295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:46.095736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:46.096999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:46.102319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:46.103853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:46.105316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:46.213869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:46.236322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:46.242117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:46.246132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:46.246777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:46.257016 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aae78df1-eebb-4736-83d5-ca268127e126 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.338358 Nov 02 13:17:46.257873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 640/1361] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:45 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:46.261566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:46.263757 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2744a629-43ea-44d9-8a3f-0641269a4c7d tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.188114 Nov 02 13:17:46.264907 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 722/1362] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:46 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:46.337587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:46.338219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:46.359792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:46.360302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:46.360751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:46.361594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:46.362940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:46.363501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:46.623469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:46.633101 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e38b4860-d425-4c2d-ad76-2f80a0e04dce tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.299537 Nov 02 13:17:46.633699 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 641/1363] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:46 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:46.941400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:46.945366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:46.971530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:46.972983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:46.974165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:46.978513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:46.979232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:46.979891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:47.089976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:47.090881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:47.113631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:47.124706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:47.125166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:47.129258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:47.130015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:47.130975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:47.402416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:47.416713 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-842c4f1b-c6f3-4c7f-89a6-cfa725ecf3e6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.330850 Nov 02 13:17:47.418424 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 642/1364] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:47 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:47.425792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:47.426633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:47.434013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:47.435232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:47.436043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:47.437125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:47.437740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:47.438320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:47.645040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:47.661500 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-43de1ed5-7e5a-41e0-8e45-8bc236c0b859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.725075 Nov 02 13:17:47.664402 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 723/1365] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:46 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:47.670594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:47.671492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:47.680521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:47.681443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:47.682505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:47.683373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:47.688062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:47.688608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:47.691997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:47.695280 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-069fbab9-5c19-4b0d-b6e5-a071710f2d78 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.272141 Nov 02 13:17:47.698590 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 643/1366] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:47 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:47.712296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:47.716258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:47.739222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:47.739733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:47.740187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:47.740923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:47.741402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:47.751274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:47.888520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:47.900195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:47.901700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:47.923132 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-64f09e0b-b3dd-4e13-8f2e-3a9ffab65d2f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.255872 Nov 02 13:17:47.925794 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 724/1367] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:47 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:48.025882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:48.036912 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-549a619a-2689-4763-9623-e6173cc1734d tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.336607 Nov 02 13:17:48.054333 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 644/1368] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:47 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:48.443092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:48.443720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:48.457746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:48.458249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:48.458672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:48.459425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:48.465598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:48.466200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:48.694170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:48.695573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:48.709568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:48.710347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:48.712695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:48.713612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:48.717526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:48.719863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:48.834610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:48.837937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:48.848396 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4deaf5b7-b3ff-4789-a706-534ea2f1f875 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.410201 Nov 02 13:17:48.851481 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 725/1369] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:48 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:48.872862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:48.874508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:48.894365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:48.898783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:48.903757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:48.904850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:48.905491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:48.906104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:48.925317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:48.937265 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-55652a07-7639-4e24-9d26-45e1a786f187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.248309 Nov 02 13:17:48.938055 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 645/1370] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:48 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:48.951927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-fbeec6fb-77af-4b3a-9d28-40d2feb30054 req-1bc5be79-b2bb-4555-aa17-bb858782bc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a4217c-1a63-48d7-9f9f-95f6dcf98a33", "name": "network-vif-plugged", "status": "completed", "tag": "2a1d7d81-182b-49ee-9769-5410cd39d830"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:48.965208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fbeec6fb-77af-4b3a-9d28-40d2feb30054 req-1bc5be79-b2bb-4555-aa17-bb858782bc76 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:48.965977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fbeec6fb-77af-4b3a-9d28-40d2feb30054 req-1bc5be79-b2bb-4555-aa17-bb858782bc76 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:48.966592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fbeec6fb-77af-4b3a-9d28-40d2feb30054 req-1bc5be79-b2bb-4555-aa17-bb858782bc76 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:48.982691 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-fbeec6fb-77af-4b3a-9d28-40d2feb30054 req-1bc5be79-b2bb-4555-aa17-bb858782bc76 service nova] Creating event network-vif-plugged:2a1d7d81-182b-49ee-9769-5410cd39d830 for instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 on n-h2-858384-19 Nov 02 13:17:49.000493 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-fbeec6fb-77af-4b3a-9d28-40d2feb30054 req-1bc5be79-b2bb-4555-aa17-bb858782bc76 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059309 Nov 02 13:17:49.001404 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 646/1371] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:49.010164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:49.011259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:49.020721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:49.021603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:49.022325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:49.023357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:49.024114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:49.024764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:49.221104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:49.231431 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9a48f3f5-a8af-4aa0-9452-3b1243f10c1d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.375089 Nov 02 13:17:49.233438 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 726/1372] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:48 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:49.247924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:49.248557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:49.267566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:49.268673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:49.269501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:49.270380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:49.270764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:49.271106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:49.287978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:49.298691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:49.306403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:49.313284 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6bebfd5d-59a3-4563-9879-53004acd0aa9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.310346 Nov 02 13:17:49.316671 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 647/1373] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:49 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:49.621420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:49.631100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c730186-ecdc-4506-be06-58fef2c985fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.395917 Nov 02 13:17:49.631360 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 727/1374] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:49 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:49.876595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:49.880043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:49.895067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:49.896811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:49.897591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:49.898584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:49.899283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:49.899878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:49.995946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:49.996574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:50.016583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:50.017079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:50.017518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:50.022087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:50.022576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:50.023019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:50.233813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:50.257407 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-faa044cc-ef46-45e6-89dc-736d181f1a67 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.385307 Nov 02 13:17:50.260133 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 648/1375] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:49 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:50.269766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:50.275321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:50.307851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:50.308464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:50.308925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:50.309690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:50.310153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:50.310584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:50.387904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:50.404745 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-904092b6-fa4b-4134-9ebd-8154c3334006 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.441230 Nov 02 13:17:50.405403 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 728/1376] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:49 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:50.649186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:50.671267 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ddb7cb73-3f5e-4836-ad54-0cabb8a2f9c7 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.402175 Nov 02 13:17:50.671267 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 649/1377] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:50 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:50.682148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:50.683470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:50.691466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:50.692425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:50.693262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:50.694213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:50.695410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:50.696350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:50.729288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-301a23a0-16e4-4ce4-bb86-c878501d149b tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Calling method '.version_select at 0x7fe787ac99d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:50.757366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-301a23a0-16e4-4ce4-bb86-c878501d149b tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7fab9035-76e5-4376-99f7-58065e9f2402 does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:17:50.757972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-301a23a0-16e4-4ce4-bb86-c878501d149b tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Neutron security group 7fab9035-76e5-4376-99f7-58065e9f2402 not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:17:50.758539 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-301a23a0-16e4-4ce4-bb86-c878501d149b tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] HTTP exception thrown: Security group 7fab9035-76e5-4376-99f7-58065e9f2402 does not exist Nov 02 13:17:50.758539 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-de8938f4-7d89-43a3-a58c-dd79b96ba91d'] Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-301a23a0-16e4-4ce4-bb86-c878501d149b tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Request method failure captured: Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-security-groups/7fab9035-76e5-4376-99f7-58065e9f2402 HTTP/1.1 Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm3-tRS5YTkUD8ZhvLkzZ3x18Kg4xNyiwf3HrFWixooAmnxDWNkx00O0zNO0xoKc5RV-OIUkYosMRkE6w0ahvKgciEYcHcPNsYvSsGIBrx-lYJH2UDvUFfDf4t2PP6BpOEl3TkPsvKG22usjm1vWG7BTVZ1Rz2m8ftXJiTzZIylrrB8 Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9cb6fb288d8c43cebfb2abc9375507a9 Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:17:50.760545 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9cb6fb288d8c43cebfb2abc9375507a9 Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsNegativeTestJSON-1812613061-project Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 91c7a19fd40a49528fe9d70955c79be8 Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061-project Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group 7fab9035-76e5-4376-99f7-58065e9f2402 does not exist Nov 02 13:17:50.762258 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-de8938f4-7d89-43a3-a58c-dd79b96ba91d'] Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7fab9035-76e5-4376-99f7-58065e9f2402'} Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:50.763562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7fab9035-76e5-4376-99f7-58065e9f2402 does not exist Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de8938f4-7d89-43a3-a58c-dd79b96ba91d'] Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:17:50.764961 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7fab9035-76e5-4376-99f7-58065e9f2402 does not exist Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de8938f4-7d89-43a3-a58c-dd79b96ba91d'] Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7fab9035-76e5-4376-99f7-58065e9f2402 does not exist Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de8938f4-7d89-43a3-a58c-dd79b96ba91d'] Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:50.766313 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7fab9035-76e5-4376-99f7-58065e9f2402 does not exist Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de8938f4-7d89-43a3-a58c-dd79b96ba91d'] Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-301a23a0-16e4-4ce4-bb86-c878501d149b tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Returning 404 to user: Security group 7fab9035-76e5-4376-99f7-58065e9f2402 does not exist Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-de8938f4-7d89-43a3-a58c-dd79b96ba91d'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:50.768597 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-301a23a0-16e4-4ce4-bb86-c878501d149b tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/7fab9035-76e5-4376-99f7-58065e9f2402" status: 404 len: 194 microversion: 2.1 time: 0.356323 Nov 02 13:17:50.770445 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 729/1378] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:50 2022] DELETE /compute/v2.1/os-security-groups/7fab9035-76e5-4376-99f7-58065e9f2402 => generated 194 bytes in 364 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:17:50.776314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:50.777582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:50.786635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:50.787296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:50.787828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:50.788634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:50.789169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:50.789704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:50.800112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:50.809206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:50.810702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:50.816290 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd3c629b-6ebb-49e9-afd5-095b5920c418 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.150637 Nov 02 13:17:50.817073 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 650/1379] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:50 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:50.835676 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-77aa8bc0-d42b-48db-8ad5-6f105ae14a17 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004600 Nov 02 13:17:50.836567 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 651/1380] 10.222.0.113 () {58 vars in 1169 bytes} [Wed Nov 2 13:17:50 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 13:17:50.845113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a71b8bcc-7ce4-47fa-a7ea-946b7384648b tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Calling method '.version_select at 0x7fe787790a60>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:50.960249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:50.979406 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8573ebf0-7740-4226-938b-5e7507b00a3e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.207949 Nov 02 13:17:50.980935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 730/1381] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:50 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:51.041089 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a71b8bcc-7ce4-47fa-a7ea-946b7384648b tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.199593 Nov 02 13:17:51.044526 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 652/1382] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:17:50 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:17:51.059186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77f24782-a0f8-42af-8a78-39fbe574a289 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Calling method '.version_select at 0x7fe7878b1040>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:51.179345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-77f24782-a0f8-42af-8a78-39fbe574a289 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:17:51.180004 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-77f24782-a0f8-42af-8a78-39fbe574a289 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 02 13:17:51.180004 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-b128dd9f-754b-4946-9273-c71185cc3339'] Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77f24782-a0f8-42af-8a78-39fbe574a289 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Request method failure captured: Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-security-groups/223c4606-0686-4eac-836a-d7b1aa9f1c16 HTTP/1.1 Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm3-tRS5YTkUD8ZhvLkzZ3x18Kg4xNyiwf3HrFWixooAmnxDWNkx00O0zNO0xoKc5RV-OIUkYosMRkE6w0ahvKgciEYcHcPNsYvSsGIBrx-lYJH2UDvUFfDf4t2PP6BpOEl3TkPsvKG22usjm1vWG7BTVZ1Rz2m8ftXJiTzZIylrrB8 Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9cb6fb288d8c43cebfb2abc9375507a9 Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:17:51.182020 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9cb6fb288d8c43cebfb2abc9375507a9 Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsNegativeTestJSON-1812613061-project Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 91c7a19fd40a49528fe9d70955c79be8 Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061-project Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: exception: Insufficient rights for removing default security group. Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-b128dd9f-754b-4946-9273-c71185cc3339'] Nov 02 13:17:51.183588 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '223c4606-0686-4eac-836a-d7b1aa9f1c16'} Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.191231 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b128dd9f-754b-4946-9273-c71185cc3339'] Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Nov 02 13:17:51.192724 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b128dd9f-754b-4946-9273-c71185cc3339'] Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b128dd9f-754b-4946-9273-c71185cc3339'] Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.194187 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b128dd9f-754b-4946-9273-c71185cc3339'] Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77f24782-a0f8-42af-8a78-39fbe574a289 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-b128dd9f-754b-4946-9273-c71185cc3339'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77f24782-a0f8-42af-8a78-39fbe574a289 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/223c4606-0686-4eac-836a-d7b1aa9f1c16" status: 400 len: 182 microversion: 2.1 time: 0.129071 Nov 02 13:17:51.195962 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 731/1383] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:17:51 2022] DELETE /compute/v2.1/os-security-groups/223c4606-0686-4eac-836a-d7b1aa9f1c16 => generated 182 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:17:51.196741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6334de03-0411-4b7e-9320-2997e072b5b6 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Calling method '.version_select at 0x7fe78767c700>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:51.223051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG neutronclient.v2_0.client [None req-6334de03-0411-4b7e-9320-2997e072b5b6 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f0c3b86f-633d-4278-9926-c901c8c036d2 does not exist", "detail": ""}} {{(pid=120929) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:17:51.223051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.security_group_api [None req-6334de03-0411-4b7e-9320-2997e072b5b6 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Neutron security group f0c3b86f-633d-4278-9926-c901c8c036d2 not found {{(pid=120929) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:17:51.223865 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-6334de03-0411-4b7e-9320-2997e072b5b6 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] HTTP exception thrown: Security group f0c3b86f-633d-4278-9926-c901c8c036d2 does not exist Nov 02 13:17:51.223865 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-a3a5464d-d8fa-4f3f-ae68-17686e5e522d'] Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6334de03-0411-4b7e-9320-2997e072b5b6 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Request method failure captured: Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-security-groups/f0c3b86f-633d-4278-9926-c901c8c036d2 HTTP/1.1 Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm3-tRS5YTkUD8ZhvLkzZ3x18Kg4xNyiwf3HrFWixooAmnxDWNkx00O0zNO0xoKc5RV-OIUkYosMRkE6w0ahvKgciEYcHcPNsYvSsGIBrx-lYJH2UDvUFfDf4t2PP6BpOEl3TkPsvKG22usjm1vWG7BTVZ1Rz2m8ftXJiTzZIylrrB8 Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 9cb6fb288d8c43cebfb2abc9375507a9 Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:17:51.228917 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 9cb6fb288d8c43cebfb2abc9375507a9 Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupsNegativeTestJSON-1812613061-project Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 91c7a19fd40a49528fe9d70955c79be8 Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061-project Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: exception: Security group f0c3b86f-633d-4278-9926-c901c8c036d2 does not exist Nov 02 13:17:51.230706 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-a3a5464d-d8fa-4f3f-ae68-17686e5e522d'] Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f0c3b86f-633d-4278-9926-c901c8c036d2'} Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.232263 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f0c3b86f-633d-4278-9926-c901c8c036d2 does not exist Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3a5464d-d8fa-4f3f-ae68-17686e5e522d'] Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:17:51.237907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f0c3b86f-633d-4278-9926-c901c8c036d2 does not exist Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3a5464d-d8fa-4f3f-ae68-17686e5e522d'] Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f0c3b86f-633d-4278-9926-c901c8c036d2 does not exist Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3a5464d-d8fa-4f3f-ae68-17686e5e522d'] Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.240137 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f0c3b86f-633d-4278-9926-c901c8c036d2 does not exist Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3a5464d-d8fa-4f3f-ae68-17686e5e522d'] Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6334de03-0411-4b7e-9320-2997e072b5b6 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Returning 404 to user: Security group f0c3b86f-633d-4278-9926-c901c8c036d2 does not exist Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-a3a5464d-d8fa-4f3f-ae68-17686e5e522d'] {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6334de03-0411-4b7e-9320-2997e072b5b6 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups/f0c3b86f-633d-4278-9926-c901c8c036d2" status: 404 len: 194 microversion: 2.1 time: 0.039381 Nov 02 13:17:51.241492 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 653/1384] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:17:51 2022] GET /compute/v2.1/os-security-groups/f0c3b86f-633d-4278-9926-c901c8c036d2 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:17:51.248909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-adb1828c-3dd2-4bc5-b593-4922e1124217 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Action: 'update', calling method: .version_select at 0x7fe78761e160>, body: {"security_group": {"name": "tempest-sg-2010767327", "description": "tempest-description-1893898207"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:51.273291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-adb1828c-3dd2-4bc5-b593-4922e1124217 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e9d250c1-d495-4666-a30a-b4e2546cceae does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:17:51.273941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-adb1828c-3dd2-4bc5-b593-4922e1124217 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Neutron security group e9d250c1-d495-4666-a30a-b4e2546cceae not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:17:51.274476 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-adb1828c-3dd2-4bc5-b593-4922e1124217 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] HTTP exception thrown: Security group e9d250c1-d495-4666-a30a-b4e2546cceae does not exist Nov 02 13:17:51.274476 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-83bd30ae-2503-4643-b542-22c46152a559'] Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-adb1828c-3dd2-4bc5-b593-4922e1124217 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Request method failure captured: Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/os-security-groups/e9d250c1-d495-4666-a30a-b4e2546cceae HTTP/1.1 Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 102 Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm3-tRS5YTkUD8ZhvLkzZ3x18Kg4xNyiwf3HrFWixooAmnxDWNkx00O0zNO0xoKc5RV-OIUkYosMRkE6w0ahvKgciEYcHcPNsYvSsGIBrx-lYJH2UDvUFfDf4t2PP6BpOEl3TkPsvKG22usjm1vWG7BTVZ1Rz2m8ftXJiTzZIylrrB8 Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9cb6fb288d8c43cebfb2abc9375507a9 Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:17:51.277386 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9cb6fb288d8c43cebfb2abc9375507a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9cb6fb288d8c43cebfb2abc9375507a9 Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061 Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsNegativeTestJSON-1812613061-project Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 91c7a19fd40a49528fe9d70955c79be8 Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1812613061-project Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: {"security_group": {"name": "tempest-sg-2010767327", "description": "tempest-description-1893898207"}} Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:17:51.280322 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group e9d250c1-d495-4666-a30a-b4e2546cceae does not exist Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-83bd30ae-2503-4643-b542-22c46152a559'] Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e9d250c1-d495-4666-a30a-b4e2546cceae', 'body': {'security_group': {'name': 'tempest-sg-2010767327', 'description': 'tempest-description-1893898207'}}} Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:17:51.281216 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e9d250c1-d495-4666-a30a-b4e2546cceae does not exist Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83bd30ae-2503-4643-b542-22c46152a559'] Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:17:51.282343 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e9d250c1-d495-4666-a30a-b4e2546cceae does not exist Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83bd30ae-2503-4643-b542-22c46152a559'] Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e9d250c1-d495-4666-a30a-b4e2546cceae does not exist Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83bd30ae-2503-4643-b542-22c46152a559'] Nov 02 13:17:51.283739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e9d250c1-d495-4666-a30a-b4e2546cceae does not exist Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83bd30ae-2503-4643-b542-22c46152a559'] Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-adb1828c-3dd2-4bc5-b593-4922e1124217 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] Returning 404 to user: Security group e9d250c1-d495-4666-a30a-b4e2546cceae does not exist Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-83bd30ae-2503-4643-b542-22c46152a559'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:51.285782 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-adb1828c-3dd2-4bc5-b593-4922e1124217 tempest-SecurityGroupsNegativeTestJSON-1812613061 tempest-SecurityGroupsNegativeTestJSON-1812613061-project] 10.222.0.113 "PUT /compute/v2.1/os-security-groups/e9d250c1-d495-4666-a30a-b4e2546cceae" status: 404 len: 194 microversion: 2.1 time: 0.040115 Nov 02 13:17:51.289491 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 732/1385] 10.222.0.113 () {60 vars in 1295 bytes} [Wed Nov 2 13:17:51 2022] PUT /compute/v2.1/os-security-groups/e9d250c1-d495-4666-a30a-b4e2546cceae => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:17:51.298628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:51.299967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:51.310114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:51.310723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:51.311367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:51.312730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:51.312730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:51.313558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:51.434556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:51.435516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:51.442836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:51.443686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:51.444455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:51.445394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:51.446053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:51.446686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:51.507999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:51.518892 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6cc18b17-4efa-451c-b61f-f89b162f94f4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1394 microversion: 2.1 time: 0.235241 Nov 02 13:17:51.519566 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 654/1386] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:51 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1394 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:51.705542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:51.706157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:51.714476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:51.714998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:51.715458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:51.716164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:51.716614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:51.717326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:51.746891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:51.755954 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cad60bd3-4a2a-44b1-8cb8-61a8e6f1b365 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.325461 Nov 02 13:17:51.761296 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 733/1387] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:51 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:51.847220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:51.847941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:51.854385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:51.854889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:51.855641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:51.857185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:51.858029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:51.858594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:51.869781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:51.880679 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f72ff58-95a8-4759-9b99-736a5a96780f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.179110 Nov 02 13:17:51.882267 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 655/1388] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:51 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:51.969273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:51.980670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:51.982567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:51.989863 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e9470687-ac62-4534-b585-59e51481c832 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.147826 Nov 02 13:17:51.991266 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 734/1389] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:51 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:52.012757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:52.013749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:52.020884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:52.021776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:52.022780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:52.023774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:52.024449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:52.025090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:52.169814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:52.180163 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c954c157-301c-4869-9d69-2eb60f600aad tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.171510 Nov 02 13:17:52.180844 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 656/1390] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:52 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:52.543652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:52.544539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:52.556106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:52.556222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:52.556574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:52.558121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:52.558741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:52.559978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:52.781568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:52.782759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:52.790496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:52.791087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:52.791682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:52.792773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:52.793304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:52.793801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:52.964891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:52.986151 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-19ad45b9-b2f6-4d60-9c52-8ec6e774ed75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.208246 Nov 02 13:17:53.011698 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 657/1391] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:52 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:53.018931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:53.022261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:53.023655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:53.027733 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6c163753-fa32-4fe5-8d11-9a6b0fc55078 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1592 microversion: 2.1 time: 0.488242 Nov 02 13:17:53.028321 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 735/1392] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:52 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1592 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:53.031724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.032929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.044354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:53.045744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.052555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:53.052829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.053833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.055670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.083027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.087014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.087699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.088607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.091938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.092562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.204092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:53.222567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:53.224405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:53.231874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-54afb6a9-316b-42d0-abb9-0b77aaa4041e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.202521 Nov 02 13:17:53.233196 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 736/1393] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:53 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:53.239089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1fa7d6e4-67b4-4701-8309-d93b386cc533 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:53.239826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1fa7d6e4-67b4-4701-8309-d93b386cc533 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:53.246466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa7d6e4-67b4-4701-8309-d93b386cc533 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.247356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa7d6e4-67b4-4701-8309-d93b386cc533 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.248222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa7d6e4-67b4-4701-8309-d93b386cc533 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.249162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa7d6e4-67b4-4701-8309-d93b386cc533 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.250043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa7d6e4-67b4-4701-8309-d93b386cc533 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.250625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa7d6e4-67b4-4701-8309-d93b386cc533 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.353095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:53.362224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3975c918-c80c-43fa-a423-e512b49e3ad4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.348469 Nov 02 13:17:53.362814 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 658/1394] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:53 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:53.369279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:53.370163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:53.376859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.378239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.378685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.382428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:53.382918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:53.383370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:53.436877 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1fa7d6e4-67b4-4701-8309-d93b386cc533 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202260 Nov 02 13:17:53.437491 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 737/1395] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:17:53 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:53.555103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:53.567926 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-21b3a034-b68f-4ffb-99a9-d95277896609 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.202797 Nov 02 13:17:53.583421 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 659/1396] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:53 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:54.021472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:54.023202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:54.030784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.032250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.032934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:54.035139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.038933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.039699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:54.269342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:54.270277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:54.284547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.285258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.285909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:54.286631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.287320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.287751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:54.379376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:54.393137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:54.394704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:54.401293 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-401b9adf-bd43-4e43-b02c-16c207f550e7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.139199 Nov 02 13:17:54.402091 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 660/1397] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:54 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:54.407086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:54.407723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:54.414384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.414882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.415353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:54.416060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.416517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.416940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:54.421834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:54.456474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:54.474528 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e3cdbc75-780b-46e1-827e-ed8826e7ceea tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.459481 Nov 02 13:17:54.475248 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 738/1398] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:54 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:54.576499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:54.586640 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da1c4882-dea1-456f-8fc5-e71cc3f00f69 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.182589 Nov 02 13:17:54.587467 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 661/1399] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:54 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:54.597408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:54.598056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:54.606479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.606967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.607463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:54.608325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:54.608803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:54.609248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:54.926896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:54.934912 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2ee90ae3-5cdb-44d2-b628-e5fd4d9480ee tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.345858 Nov 02 13:17:54.943943 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 739/1400] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:54 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:55.430637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:55.431597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:55.439064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.439863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.440602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.441402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.441863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.442292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.505245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:55.506909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:55.524851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:55.526850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.527663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.528393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.529331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.529881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.530514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.542702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:55.544229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:55.551021 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fc8f1eb3-89d1-4fc4-9e30-cee80fe63fac tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.124429 Nov 02 13:17:55.563148 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 662/1401] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:55 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:55.611947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:55.612276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:55.618179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.618927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.619380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.620075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.620520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.620940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.754754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:55.776298 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dabc317c-a510-48bf-8730-510b9fc98400 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.169074 Nov 02 13:17:55.781251 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 663/1402] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:55 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:55.834205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:55.834814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:55.847752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.848609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.849265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.849997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.850446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.850869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.855589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:55.870233 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8a5b04c-0965-4998-9a1d-786d77f485c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.370181 Nov 02 13:17:55.871348 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 740/1403] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:55 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:55.879238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d5739de0-67a7-46f2-92cc-411400c6aa91 req-4c5d2318-cdff-4584-a189-46e0137cdfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5a4217c-1a63-48d7-9f9f-95f6dcf98a33", "tag": "2a1d7d81-182b-49ee-9769-5410cd39d830"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:55.890362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d5739de0-67a7-46f2-92cc-411400c6aa91 req-4c5d2318-cdff-4584-a189-46e0137cdfe3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.895233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d5739de0-67a7-46f2-92cc-411400c6aa91 req-4c5d2318-cdff-4584-a189-46e0137cdfe3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.895828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d5739de0-67a7-46f2-92cc-411400c6aa91 req-4c5d2318-cdff-4584-a189-46e0137cdfe3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.917470 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d5739de0-67a7-46f2-92cc-411400c6aa91 req-4c5d2318-cdff-4584-a189-46e0137cdfe3 service nova] Creating event network-changed:2a1d7d81-182b-49ee-9769-5410cd39d830 for instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 on n-h2-858384-19 Nov 02 13:17:55.922722 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d5739de0-67a7-46f2-92cc-411400c6aa91 req-4c5d2318-cdff-4584-a189-46e0137cdfe3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049239 Nov 02 13:17:55.924224 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 741/1404] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:55.961766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:55.962553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:55.969752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.970606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.972034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:55.972557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:55.973047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:55.973478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:56.258379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:56.273148 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-946adf08-8fae-486b-8d31-076c08b26dff tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.314408 Nov 02 13:17:56.274065 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 742/1405] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:55 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:56.323493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:56.333130 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6ba1051-bf72-4a91-aa1e-7894a4145bab tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1592 microversion: 2.1 time: 0.503042 Nov 02 13:17:56.333992 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 664/1406] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:55 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1592 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:56.583420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:56.584763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:56.592668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:56.593457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:56.594107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:56.595214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:56.596550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:56.597160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:56.700896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:56.712588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:56.714236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:56.720692 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef1d0303-05ef-40f0-8659-489bdaf3206a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.143269 Nov 02 13:17:56.721657 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 743/1407] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:56 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:56.804701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:56.805317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:56.812538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:56.813036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:56.813472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:56.814178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:56.815088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:56.815749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:56.899232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:56.900243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:56.911224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:56.912073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:56.912726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:56.913668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:56.914336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:56.914999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:57.126736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:57.140307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-40015664-b016-480e-833e-ccffd7603318 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.245599 Nov 02 13:17:57.141263 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 744/1408] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:56 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:57.202989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:57.214284 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a995820b-0e87-42e8-b02e-ba87d62926bc tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.413412 Nov 02 13:17:57.215061 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 665/1409] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:56 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:57.297703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:57.298330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:57.305985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:57.306484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:57.307304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:57.308285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:57.308785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:57.309171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:57.450260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:57.458824 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cccc2f23-1033-4565-b8f1-af939c1a78cb tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.164958 Nov 02 13:17:57.459431 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 745/1410] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:57 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:57.750666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:57.751303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:57.758359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:57.758840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:57.759539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:57.763140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:57.763140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:57.763140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:57.843423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:57.854663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:57.856199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:57.862636 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51bead03-e2d8-4355-9e91-10d30df7bcbc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.116233 Nov 02 13:17:57.862984 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 666/1411] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:57 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:17:58.164689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:58.165415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:58.172436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.172916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.173412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.174653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.175104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.175549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.191960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:58.238135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:58.238861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:58.248440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.248942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.249383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.250289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.250753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.251212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.321407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:58.329587 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3b9ad45-9ca8-4351-9073-f4f79e43e764 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1480 microversion: 2.1 time: 0.168863 Nov 02 13:17:58.330440 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 746/1412] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:58 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1480 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:58.406285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:58.421399 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f9eafab-6a77-415f-b74d-f896edbc0072 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.188165 Nov 02 13:17:58.422002 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 667/1413] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:58 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:58.483158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:58.483776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:58.493129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.493129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.493129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.493129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.493800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.493800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.634715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:58.643308 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e3393eb3-c964-4752-82de-be5f81dba79c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.164211 Nov 02 13:17:58.643905 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 747/1414] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:58 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:58.890016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:58.890630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:58.897356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.897852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.898299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.899210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.899849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.900666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.973047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:58.981325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75c50c05-9bc8-4f61-8f40-553af1cf514d tempest-AZV2TestJSON-443834658 tempest-AZV2TestJSON-443834658-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:58.984158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c50c05-9bc8-4f61-8f40-553af1cf514d tempest-AZV2TestJSON-443834658 tempest-AZV2TestJSON-443834658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.985005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c50c05-9bc8-4f61-8f40-553af1cf514d tempest-AZV2TestJSON-443834658 tempest-AZV2TestJSON-443834658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.985779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c50c05-9bc8-4f61-8f40-553af1cf514d tempest-AZV2TestJSON-443834658 tempest-AZV2TestJSON-443834658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.986977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:58.987156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c50c05-9bc8-4f61-8f40-553af1cf514d tempest-AZV2TestJSON-443834658 tempest-AZV2TestJSON-443834658-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:58.987984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c50c05-9bc8-4f61-8f40-553af1cf514d tempest-AZV2TestJSON-443834658 tempest-AZV2TestJSON-443834658-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:58.988757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c50c05-9bc8-4f61-8f40-553af1cf514d tempest-AZV2TestJSON-443834658 tempest-AZV2TestJSON-443834658-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:58.989586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:58.996440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f2880ae8-3221-43e9-81b6-ca8927e30f33 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.110431 Nov 02 13:17:58.997026 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 748/1415] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:17:58 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:17:59.029970 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75c50c05-9bc8-4f61-8f40-553af1cf514d tempest-AZV2TestJSON-443834658 tempest-AZV2TestJSON-443834658-project] 10.222.0.113 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.185066 Nov 02 13:17:59.031170 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 668/1416] 10.222.0.113 () {58 vars in 1169 bytes} [Wed Nov 2 13:17:58 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:17:59.353806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:59.354345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:59.361843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:59.362335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:59.362777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:59.363701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:59.364164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:59.364594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:59.446913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:59.447575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:59.453939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:59.454645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:59.455903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:59.456908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:59.457530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:59.457970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:59.511623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:59.520373 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee9b9c6a-6fae-4017-8caa-81fad30244c6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1479 microversion: 2.1 time: 0.170453 Nov 02 13:17:59.520958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 749/1417] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:59 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1479 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:17:59.666181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:59.676312 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-54bea403-377c-4971-917d-b9750ebf3d47 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.233463 Nov 02 13:17:59.676888 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 669/1418] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:59 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:17:59.681299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:59.681944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:17:59.688356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:59.688843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:59.689338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:59.690374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:17:59.690668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:17:59.691137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:17:59.859565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:17:59.870356 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d946127f-5021-407d-bb59-c6734b340c34 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.193632 Nov 02 13:17:59.871518 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 750/1419] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:17:59 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:00.042788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:00.043442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:00.051093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.051707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.052236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:00.052947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.053405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.053834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:00.124814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:00.133695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:00.135520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:00.140650 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a5ee361-155b-4279-8c51-b6e7f46ae59f tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.102688 Nov 02 13:18:00.141420 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 670/1420] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:00 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:00.545151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:00.545781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:00.554100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.554846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.555322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:00.556138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.556491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.556927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:00.702586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:00.703939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:00.712397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:00.715205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.716076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.716864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:00.718006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.718828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.719867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:00.722190 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01a23d7a-f7c2-4184-a464-94ca818292aa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1479 microversion: 2.1 time: 0.180612 Nov 02 13:18:00.722744 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 751/1421] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:00 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1479 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:00.871147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:00.882898 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-43763203-d473-468b-9633-747be7d625ea tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.184863 Nov 02 13:18:00.882898 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 671/1422] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:00 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:00.902539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:00.903395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:00.910023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.910543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.910987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:00.911722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:00.912183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:00.912621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:01.116576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:01.124925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45453b4c-ab25-4248-891c-cd456cd8f44b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.226414 Nov 02 13:18:01.125619 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 752/1423] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:00 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:01.172410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:01.172410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:01.177727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:01.178213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:01.178652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:01.179385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:01.179843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:01.180354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:01.258991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:01.268758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:01.270419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:01.277026 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8b8661ff-5998-4216-b0ce-83f53c96ca1e tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.110478 Nov 02 13:18:01.277026 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 672/1424] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:01 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:01.748501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:01.748501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:01.762441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:01.764236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:01.766001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:01.766964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:01.767935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:01.768674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:01.905042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:01.906043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:01.913218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:01.914036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:01.914734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:01.915860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:01.916559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:01.917231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:02.062689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:02.084355 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-709a45c3-9068-40c5-9322-792715a399a6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1479 microversion: 2.1 time: 0.340529 Nov 02 13:18:02.086573 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 753/1425] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:01 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1479 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:02.105154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0aa0c2cf-585a-4776-815a-35179f1f2ee1 req-2cb43f5a-68b4-4c6d-b85a-6351af3eaa70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b61a6bd-c846-47b8-bc2e-1ced93a130de", "name": "network-vif-unplugged", "status": "completed", "tag": "165d7495-3fe4-430c-b934-4fffcdeadf3a"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:02.117624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0aa0c2cf-585a-4776-815a-35179f1f2ee1 req-2cb43f5a-68b4-4c6d-b85a-6351af3eaa70 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:02.118100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0aa0c2cf-585a-4776-815a-35179f1f2ee1 req-2cb43f5a-68b4-4c6d-b85a-6351af3eaa70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:02.118807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0aa0c2cf-585a-4776-815a-35179f1f2ee1 req-2cb43f5a-68b4-4c6d-b85a-6351af3eaa70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:02.138558 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0aa0c2cf-585a-4776-815a-35179f1f2ee1 req-2cb43f5a-68b4-4c6d-b85a-6351af3eaa70 service nova] Creating event network-vif-unplugged:165d7495-3fe4-430c-b934-4fffcdeadf3a for instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de on n-h1-858384-19 Nov 02 13:18:02.153213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-0aa0c2cf-585a-4776-815a-35179f1f2ee1 req-2cb43f5a-68b4-4c6d-b85a-6351af3eaa70 service nova] Instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:18:02.172236 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0aa0c2cf-585a-4776-815a-35179f1f2ee1 req-2cb43f5a-68b4-4c6d-b85a-6351af3eaa70 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083061 Nov 02 13:18:02.174399 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 754/1426] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:02.183006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:02.183924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:02.192395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:02.193275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:02.194561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:02.195657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:02.196287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:02.196883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:02.328204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:02.343908 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7c5b8da8-da01-4fbe-ad4f-81d4237c8e62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1320 microversion: 2.1 time: 0.442894 Nov 02 13:18:02.359887 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 673/1427] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:01 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1320 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:02.369366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:02.370280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:02.377871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:02.379471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:02.381883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:02.382841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:02.384226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:02.385474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:02.442160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:02.457884 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9a0a57c8-4ef3-4c3c-a192-9081e8a39b28 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.281964 Nov 02 13:18:02.458948 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 755/1428] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:02 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:02.516571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:02.526937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:02.528677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:02.536093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04d80a19-fd5c-4dcd-b23f-fe248c7b4565 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.171283 Nov 02 13:18:02.537600 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 674/1429] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:02 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:03.116444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:03.117948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:03.125557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.126145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.127056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.133214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.134025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.134697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.370247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:03.371607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:03.379474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.380524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.381203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.382182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.383518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.384198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.566921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:03.575719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-011aa186-b32c-47e4-8b5b-54d889f76766 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1470 microversion: 2.1 time: 0.209679 Nov 02 13:18:03.577267 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 675/1430] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:03 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:03.582411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:03.583185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:03.589920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:03.591907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.592765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.593428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.594370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.595044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.596375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.678547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:03.693850 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0f3e59c7-1386-48c0-aff3-5f3b432c4bed tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1479 microversion: 2.1 time: 0.580256 Nov 02 13:18:03.698232 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 756/1431] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:03 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1479 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:03.703560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:03.706665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:03.718118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.718866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.723266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.724304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.727784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.728971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.841576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:03.850766 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b252e5d0-67b5-49d1-95fe-b534ad7f9db0 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.272104 Nov 02 13:18:03.860083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:03.864201 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 676/1432] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:03 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:03.876625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5e6fa37-678c-4d0f-aea4-f765ed4fb536 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:03.880836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f5e6fa37-678c-4d0f-aea4-f765ed4fb536 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:03.888126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5e6fa37-678c-4d0f-aea4-f765ed4fb536 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.888817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:03.889314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5e6fa37-678c-4d0f-aea4-f765ed4fb536 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.889924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5e6fa37-678c-4d0f-aea4-f765ed4fb536 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.891569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5e6fa37-678c-4d0f-aea4-f765ed4fb536 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:03.892788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5e6fa37-678c-4d0f-aea4-f765ed4fb536 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:03.894016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5e6fa37-678c-4d0f-aea4-f765ed4fb536 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:03.894782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:03.905630 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-232fa269-09de-4acf-b631-c5712feb4e7a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.205873 Nov 02 13:18:03.906599 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 757/1433] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:03 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:04.190611 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5e6fa37-678c-4d0f-aea4-f765ed4fb536 tempest-ServersOnMultiNodesTest-691687275 tempest-ServersOnMultiNodesTest-691687275-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1623 microversion: 2.1 time: 0.320052 Nov 02 13:18:04.192126 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 677/1434] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:03 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1623 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:04.210430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7446c266-6860-4c26-a4f2-615d7fe78c8b req-b45d65c6-05d0-43a2-9bcf-013329532def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b61a6bd-c846-47b8-bc2e-1ced93a130de", "tag": "165d7495-3fe4-430c-b934-4fffcdeadf3a"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:04.226789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:04.227673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:04.230410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7446c266-6860-4c26-a4f2-615d7fe78c8b req-b45d65c6-05d0-43a2-9bcf-013329532def service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.230901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7446c266-6860-4c26-a4f2-615d7fe78c8b req-b45d65c6-05d0-43a2-9bcf-013329532def service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.231364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7446c266-6860-4c26-a4f2-615d7fe78c8b req-b45d65c6-05d0-43a2-9bcf-013329532def service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.244791 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7446c266-6860-4c26-a4f2-615d7fe78c8b req-b45d65c6-05d0-43a2-9bcf-013329532def service nova] Creating event network-changed:165d7495-3fe4-430c-b934-4fffcdeadf3a for instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de on n-h1-858384-19 Nov 02 13:18:04.245531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.246198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.246772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.252214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.255937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.256503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.259051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-7446c266-6860-4c26-a4f2-615d7fe78c8b req-b45d65c6-05d0-43a2-9bcf-013329532def service nova] Instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:18:04.274405 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7446c266-6860-4c26-a4f2-615d7fe78c8b req-b45d65c6-05d0-43a2-9bcf-013329532def service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069352 Nov 02 13:18:04.275696 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 758/1435] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:04.277637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:04.290023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:04.387002 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d4c06f0a-64bf-46d3-859b-3964a0347ddb tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 204 len: 0 microversion: 2.1 time: 0.165942 Nov 02 13:18:04.389089 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 678/1436] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:04 2022] DELETE /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:04.398859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:04.399675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:04.408992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.409749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.410729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.412229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.413051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.413650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.581264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:04.591884 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20813686-cd0d-4890-a802-03479545704c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1476 microversion: 2.1 time: 0.197517 Nov 02 13:18:04.593035 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 759/1437] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:04 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1476 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:04.728574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:04.729791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:04.737480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.738850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.739753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.741061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.742356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.742990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.881494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:04.881494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:04.887051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.888672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.889184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:04.889969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:04.890698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:04.891470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:05.053248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:05.067827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:05.080681 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09c501fb-48b0-4042-9e4a-577fe3ed4004 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.206324 Nov 02 13:18:05.082285 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a5f7e03-5d10-4673-a72c-0bc6c1185e72 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1479 microversion: 2.1 time: 0.360244 Nov 02 13:18:05.083596 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 679/1438] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:04 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1479 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:05.096919 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 760/1439] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:04 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:05.109409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:05.110387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:05.121876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:05.122662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:05.123370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:05.124274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:05.124900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:05.126050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:05.241861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:05.260916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:05.262792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:05.271610 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0ce0fe61-9b3f-4804-96b3-d872b13275cc tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1549 microversion: 2.91 time: 0.173300 Nov 02 13:18:05.272544 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 680/1440] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:05 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1549 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:05.618113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:05.619664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:05.627826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:05.628317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:05.628786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:05.629573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:05.630029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:05.630464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:05.781639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:05.828060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cdeff32c-21fa-4841-9a0f-cd3d09e06265 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1476 microversion: 2.1 time: 0.214284 Nov 02 13:18:05.831391 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 761/1441] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:05 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:06.110150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.111521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.123721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.124332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.124843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.125629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.126159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.127007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.127210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.128136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.140897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.141935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.144052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.145043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.145745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.146398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.336631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.344931 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-046192be-fa68-4396-9ca2-84783a034fcc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.224860 Nov 02 13:18:06.347352 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 762/1442] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:06.352864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.353712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.361635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.362945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.363658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.364600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.365270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.366283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.440212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.448746 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1f8c0f97-0903-4f27-a71c-cae94b39f949 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1479 microversion: 2.1 time: 0.342602 Nov 02 13:18:06.449663 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 681/1443] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1479 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:06.473339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.485339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:06.496233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.497849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.504213 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-38ee8b68-060f-4a4d-89b0-48d844348365 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1536 microversion: 2.91 time: 0.155195 Nov 02 13:18:06.505092 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 763/1444] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1536 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:06.531648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.533277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.540049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.540564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.540997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.541734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.542184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.542614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.646405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] Lazy-loading 'services' on Instance uuid 4d3ead0b-c738-4855-8460-8be9b17b0727 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:06.665137 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8d25acd9-119b-4efa-97ed-616ad3224ca6 tempest-UnshelveToHostMultiNodesTest-674722230 tempest-UnshelveToHostMultiNodesTest-674722230-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1943 microversion: 2.91 time: 0.138106 Nov 02 13:18:06.665936 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 682/1445] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1943 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:06.727477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.728853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.736586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.737195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.737631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.738338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.738785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.739238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.766721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:06.844645 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fba4582a-25c5-4bb8-a4ab-fe386269da69 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "DELETE /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 204 len: 0 microversion: 2.91 time: 0.121739 Nov 02 13:18:06.846014 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 764/1446] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:18:06 2022] DELETE /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:18:06.855730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.856628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.857687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:06.858689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:06.863077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:06.863885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.864459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.865121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.865981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.866121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.866569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.871780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.872358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.872869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.873800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:06.874520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:06.874952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:06.985627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.997775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:06.999864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:07.006274 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6a0b028a-cb94-4849-934d-78b7142ea480 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.154749 Nov 02 13:18:07.007480 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 683/1447] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:07.070621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:07.087470 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d3cc8e8-29f6-490d-96c6-af16bce2361c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1476 microversion: 2.1 time: 0.234739 Nov 02 13:18:07.088429 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 765/1448] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:06 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:07.373505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:07.374716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:07.383617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:07.384597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:07.385213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:07.386103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:07.386729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:07.387491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:07.561869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:07.570842 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d90cbde9-f8ac-4baa-857b-f229adbb9998 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1476 microversion: 2.1 time: 0.201493 Nov 02 13:18:07.571820 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 684/1449] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:07 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:07.581578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:07.582588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:07.588987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:07.589567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:07.590075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:07.590947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:07.591517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:07.592112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:07.608395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93aa94e3-0803-489d-a441-93e1a8f1c575 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Action: 'create', calling method: .version_select at 0x7fe78f9803a0>, body: {"keypair": {"name": "tempest-keypair-794208347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcG4aaNEgjasGy+yMiqEZi9Sm3wpcCiDVawysr9kVPT+dl3DJdAuQ4D2RPOPVRiDhsbFS+hECMnGK53hNfKurSDZeky12MsrYslU2nRGv5poKi+LymHwelkvZaKdjZeKQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:07.626609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-93aa94e3-0803-489d-a441-93e1a8f1c575 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Getting quotas for project fd6b6d6701aa4a5fb5354b7b812b4f66. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:18:07.636216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-93aa94e3-0803-489d-a441-93e1a8f1c575 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Getting quotas for user b1f45ad62823445d8db546ac71b7f6af and project fd6b6d6701aa4a5fb5354b7b812b4f66. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:18:07.664793 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93aa94e3-0803-489d-a441-93e1a8f1c575 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209988 Nov 02 13:18:07.677077 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 766/1450] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:18:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:07.747876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:07.758891 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af1b9d4f-1d0e-43bd-b4c4-cc67fa4e75bd tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1479 microversion: 2.1 time: 0.182394 Nov 02 13:18:07.759560 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 685/1451] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:07 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1479 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:08.038968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:08.039758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:08.056874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.057514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.058263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.059090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.059542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.060741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.116054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:08.117264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:08.125609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.127380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.128273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.129031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.129489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.130467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.171542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:08.197686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:08.201002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:08.216092 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4faf2bad-9d20-4ca6-9e4a-793d03ade089 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.181549 Nov 02 13:18:08.220981 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 767/1452] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:08 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:08.547040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:08.573103 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-08f60666-045c-4077-b5e3-4bf886d6a8a6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1476 microversion: 2.1 time: 0.463902 Nov 02 13:18:08.588800 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 686/1453] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:08 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1476 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:08.601347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:08.602090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:08.613503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.614383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.614841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.615865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.616479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.617261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.786871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:08.788130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:08.797479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.799319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.800410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.802363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:08.803201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:08.804234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:08.997121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:09.018883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:09.035433 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d5e81c83-4ad1-46ef-8e7e-f77e4c386e8b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1479 microversion: 2.1 time: 0.255640 Nov 02 13:18:09.051150 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 687/1454] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:08 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1479 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:09.075283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:09.084021 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2c1b4870-876b-472d-b39f-76e3efe7f26e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.490508 Nov 02 13:18:09.084994 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 768/1455] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:08 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:09.261730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:09.262298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:09.269225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:09.269717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:09.270349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:09.271513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:09.272135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:09.272730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:09.364027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:09.375941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:09.378752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:09.385177 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3c5fe6be-f4d8-4901-80dd-63d34dff28ee tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.127448 Nov 02 13:18:09.386428 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 688/1456] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:09 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:09.451081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-14e49350-5c7f-47be-9a96-8f5810d7a10a req-221083a7-3274-419e-8ace-534af415f0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f813fd-58b7-418d-8779-6da7f3856870", "name": "network-vif-deleted", "tag": "d944e463-5baa-4f92-9797-a5e4b5a4ae3d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:09.464107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-14e49350-5c7f-47be-9a96-8f5810d7a10a req-221083a7-3274-419e-8ace-534af415f0a5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:09.464966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-14e49350-5c7f-47be-9a96-8f5810d7a10a req-221083a7-3274-419e-8ace-534af415f0a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:09.467905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-14e49350-5c7f-47be-9a96-8f5810d7a10a req-221083a7-3274-419e-8ace-534af415f0a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:09.490273 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-14e49350-5c7f-47be-9a96-8f5810d7a10a req-221083a7-3274-419e-8ace-534af415f0a5 service nova] Creating event network-vif-deleted:d944e463-5baa-4f92-9797-a5e4b5a4ae3d for instance 77f813fd-58b7-418d-8779-6da7f3856870 on n-h1-858384-19 Nov 02 13:18:09.498041 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-14e49350-5c7f-47be-9a96-8f5810d7a10a req-221083a7-3274-419e-8ace-534af415f0a5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051057 Nov 02 13:18:09.498822 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 769/1457] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:09.602721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:09.604391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:09.613006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:09.613504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:09.613947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:09.614669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:09.615388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:09.615988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:09.686533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:09.695683 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d7dd6d73-2f40-47dc-8223-98137498bded tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1434 microversion: 2.1 time: 0.099592 Nov 02 13:18:09.696370 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 689/1458] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:09 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1434 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:09.961849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "60b0d887-50f9-4ba7-8857-a710455f46c2"}], "security_groups": [{"name": "tempest-securitygroup--1120421824"}], "key_name": "tempest-keypair-794208347", "user_data": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:10.063485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:10.066228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:10.073513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.074397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.075212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.076330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.076984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.078211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.110990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] validate_networks() for [('60b0d887-50f9-4ba7-8857-a710455f46c2', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:18:10.318068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:10.326767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63e96eeb-9544-463b-affa-f908fedb9ba9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1477 microversion: 2.1 time: 0.267278 Nov 02 13:18:10.327984 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 690/1459] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:10 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1477 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:10.333891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:10.336553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:10.352114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.353277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.353950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.355103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.355817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.356496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.559797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:10.570150 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-61a1ec8d-2ea5-4170-9fbd-a1b92d0d10b3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.240865 Nov 02 13:18:10.571023 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 691/1460] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:10 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:10.578485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:10.580360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:10.587453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.588173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.588803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.589684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.590293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.590877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.664576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:10.673918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:10.675679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:10.684588 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c470ec84-7d2a-434f-ad22-6bb0fad727a7 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.112074 Nov 02 13:18:10.685176 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 692/1461] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:10 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:10.719864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:10.721885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:10.728160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.728653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.729117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.729834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.730543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.730978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.735344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:10.764063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:18:10.764486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:18:10.764990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:18:10.765408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:18:10.765827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:18:10.774349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.774836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.777094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.777553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 77f813fd-58b7-418d-8779-6da7f3856870 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:10.778216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.778704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.779245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.779985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:10.780449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:10.780883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:10.803666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Getting quotas for project fd6b6d6701aa4a5fb5354b7b812b4f66. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:18:10.809342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Getting quotas for user b1f45ad62823445d8db546ac71b7f6af and project fd6b6d6701aa4a5fb5354b7b812b4f66. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:18:10.824332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:10.825138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:18:10.829158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:18:10.833319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-53b892d6-777a-4baf-93e6-dc6a87e49854 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1310 microversion: 2.1 time: 0.117351 Nov 02 13:18:10.834104 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 693/1462] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:10 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1310 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:10.883044 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-beec28a4-a98a-4020-a850-8bd320b5fc47 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.926764 Nov 02 13:18:10.883736 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 770/1463] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:18:09 2022] POST /compute/v2.1/servers => generated 411 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:18:10.896606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fe8ac85-8edd-4192-93ac-1066fb91bbe0 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:10.897348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0fe8ac85-8edd-4192-93ac-1066fb91bbe0 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:10.975360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0fe8ac85-8edd-4192-93ac-1066fb91bbe0 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:10.983834 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0fe8ac85-8edd-4192-93ac-1066fb91bbe0 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1229 microversion: 2.1 time: 0.092434 Nov 02 13:18:10.984789 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 694/1464] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:10 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:11.352266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:11.353013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:11.364297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:11.364801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:11.365258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:11.365978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:11.366442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:11.366956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:11.514052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:11.522014 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6d083d9a-31cc-474b-be2e-d5d9d13a3027 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1477 microversion: 2.1 time: 0.174250 Nov 02 13:18:11.522595 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 771/1465] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:11 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1477 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:11.595553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:11.596194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:11.602694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:11.603265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:11.603817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:11.604597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:11.605050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:11.605475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:11.712245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:11.712769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:11.719132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:11.719647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:11.720208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:11.721345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:11.721812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:11.722246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:11.759948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:11.769719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ac5c9f15-d7f6-4bb3-a94b-b434b9d45149 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.179325 Nov 02 13:18:11.771546 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 695/1466] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:11 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:11.801707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:11.810454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:11.812196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:11.818492 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-980d393f-50e8-44d5-9999-19bca14e9308 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.110393 Nov 02 13:18:11.819504 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 772/1467] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:11 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:18:11.857492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:11.858104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:11.864958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:11.865435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:11.865872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:11.866573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:11.867031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:11.867514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:11.901270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:11.901746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:11.902180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:11.902622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 77f813fd-58b7-418d-8779-6da7f3856870 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:11.946025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:11.953793 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4191c4c9-bb8f-494d-8e92-41fdbab51567 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1310 microversion: 2.1 time: 0.100204 Nov 02 13:18:11.954565 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 696/1468] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:11 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:12.007472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:12.008032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:12.014294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:12.014790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:12.015288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:12.016010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:12.016454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:12.016915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:12.079311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:12.087192 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-814409e0-1d21-4aca-8d15-d6ed5f2183ae tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1281 microversion: 2.1 time: 0.083774 Nov 02 13:18:12.087770 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 773/1469] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:12 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:12.546029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:12.546660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:12.554406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:12.554926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:12.555382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:12.556806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:12.556806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:12.557028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:12.758694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:12.766484 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1ad74a3-0cea-46c1-aa69-a5f4ef03517c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1477 microversion: 2.1 time: 0.224810 Nov 02 13:18:12.768012 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 697/1470] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:12 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:12.798815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:12.799490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:12.806238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:12.806736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:12.807202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:12.807912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:12.808371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:12.808807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:12.849482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:12.850364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:12.857310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:12.858036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:12.858470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:12.859546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:12.860097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:12.861423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:12.962539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:12.968145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:12.974673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:12.977458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:12.982670 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0373df2a-c678-42ef-b2bb-81a299417ec5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.189529 Nov 02 13:18:12.983299 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 774/1471] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:12 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:12.996401 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7172caba-9cb0-4c16-bae1-a17f50e5b4d9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.137972 Nov 02 13:18:12.996541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:12.996541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:12.996723 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 698/1472] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:12 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:18:13.009934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:13.010344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:13.010791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:13.011583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:13.012035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:13.012465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:13.047847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:13.048901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:13.049317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:13.049771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 77f813fd-58b7-418d-8779-6da7f3856870 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:13.097880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:13.113854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:13.114614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:13.116743 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-434364ef-cc07-4e33-85b9-74ab0e3ac6df tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1310 microversion: 2.1 time: 0.131206 Nov 02 13:18:13.132198 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 775/1473] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:12 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1310 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:13.142677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:13.143320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:13.143940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:13.144689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:13.145158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:13.145651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:13.386797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:13.396470 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-19e9b8f7-2f7d-442e-8443-39308ff4e926 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.288896 Nov 02 13:18:13.398169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 699/1474] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:13 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:13.792336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:13.793222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:13.799859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:13.800665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:13.800814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:13.801452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:13.801911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:13.802332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:13.947099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:13.955950 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-14b70b90-8314-4991-86ad-ee68826c5feb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1477 microversion: 2.1 time: 0.167456 Nov 02 13:18:13.956557 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 776/1475] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:13 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:13.985962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3dbd0045-3da3-47a8-8aac-559eb820bb63 req-80a9eec6-410d-423a-a7b7-e17cb1c327db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ab01f1-89f5-420d-b86d-e5acf742c5af", "tag": "2e8c4e11-04bc-4c12-a44f-c34d5f883b06"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:13.997562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3dbd0045-3da3-47a8-8aac-559eb820bb63 req-80a9eec6-410d-423a-a7b7-e17cb1c327db service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:13.998161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3dbd0045-3da3-47a8-8aac-559eb820bb63 req-80a9eec6-410d-423a-a7b7-e17cb1c327db service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:13.998602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3dbd0045-3da3-47a8-8aac-559eb820bb63 req-80a9eec6-410d-423a-a7b7-e17cb1c327db service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.014757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:14.015249 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3dbd0045-3da3-47a8-8aac-559eb820bb63 req-80a9eec6-410d-423a-a7b7-e17cb1c327db service nova] Creating event network-changed:2e8c4e11-04bc-4c12-a44f-c34d5f883b06 for instance f3ab01f1-89f5-420d-b86d-e5acf742c5af on n-h2-858384-19 Nov 02 13:18:14.017759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:14.022373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3dbd0045-3da3-47a8-8aac-559eb820bb63 req-80a9eec6-410d-423a-a7b7-e17cb1c327db service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040314 Nov 02 13:18:14.023929 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 700/1476] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:14.028195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.028739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.029176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.030088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.030607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.031266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.036501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:14.038495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:14.048021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.049063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.049757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.050669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.051158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.051592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.137428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:14.155438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:14.158994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:14.169366 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f0cef900-adbd-444f-9d73-29401bbc69a0 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.142694 Nov 02 13:18:14.170578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 701/1477] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:14 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:14.180503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:14.182098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:14.193496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.194654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.195736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.197229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.198368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.199994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.214391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:14.226713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47ab2eec-d3c6-40b7-bb3a-4b6d82e777e1 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.219062 Nov 02 13:18:14.227362 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 777/1478] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:14 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:14.242722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.243526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.244574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.245043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 77f813fd-58b7-418d-8779-6da7f3856870 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:14.305330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:14.313108 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bfcb761a-dfa8-4792-9f7c-0151302f38c6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1310 microversion: 2.1 time: 0.141082 Nov 02 13:18:14.314310 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 702/1479] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:14 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1310 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:14.420274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:14.421018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:14.428735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.429341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.429773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.430487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.430948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.431412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.584547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:14.601380 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-092ae5d9-0a83-4957-9be1-e0e7f7c7d9be tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.184992 Nov 02 13:18:14.601988 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 778/1480] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:14 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:14.637113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7f1c1887-21b5-40f8-bc83-9c9850677542 req-2465cb4c-97ff-472e-a98d-43cc8c62c9ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e5b238-3258-4e2d-ba0e-01268713299a", "name": "network-vif-unplugged", "status": "completed", "tag": "bdbac33f-c52c-4822-983e-75fc66196e13"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:14.647947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7f1c1887-21b5-40f8-bc83-9c9850677542 req-2465cb4c-97ff-472e-a98d-43cc8c62c9ef service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.648873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7f1c1887-21b5-40f8-bc83-9c9850677542 req-2465cb4c-97ff-472e-a98d-43cc8c62c9ef service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.649486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7f1c1887-21b5-40f8-bc83-9c9850677542 req-2465cb4c-97ff-472e-a98d-43cc8c62c9ef service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.662296 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7f1c1887-21b5-40f8-bc83-9c9850677542 req-2465cb4c-97ff-472e-a98d-43cc8c62c9ef service nova] Creating event network-vif-unplugged:bdbac33f-c52c-4822-983e-75fc66196e13 for instance d8e5b238-3258-4e2d-ba0e-01268713299a on n-h1-858384-19 Nov 02 13:18:14.668048 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7f1c1887-21b5-40f8-bc83-9c9850677542 req-2465cb4c-97ff-472e-a98d-43cc8c62c9ef service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034698 Nov 02 13:18:14.668632 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 703/1481] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:14.980286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:14.980908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:14.988884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.989387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.989807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:14.990532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:14.990973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:14.991476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.125748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:15.134231 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d01b392-1982-40a1-83bb-2c5261097970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1477 microversion: 2.1 time: 0.157861 Nov 02 13:18:15.134811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 779/1482] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:14 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:15.200512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:15.201129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:15.207969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:15.208455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:15.208890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.209645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:15.210097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:15.210523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.253384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:15.254203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:15.260574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:15.261174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:15.261681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.262460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:15.263033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:15.263549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.279244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:15.292209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:15.293704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:15.300577 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6a9944a5-a4dd-4d3a-ab75-c798a2c49c6a tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.105051 Nov 02 13:18:15.301172 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 704/1483] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:15 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:15.338192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:15.338814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:15.344977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:15.345641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:15.346081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.346796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:15.347467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:15.347730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.381494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:15.381983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:15.382457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.382911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 77f813fd-58b7-418d-8779-6da7f3856870 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:15.408477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:15.410817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:15.417678 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a48e32f7-197b-460b-8903-1cd102f65d7c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.169345 Nov 02 13:18:15.418262 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 780/1484] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:15 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:15.429800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:15.437591 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ae9d149-c446-42d3-a48d-f6639f46355e tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1310 microversion: 2.1 time: 0.103475 Nov 02 13:18:15.438170 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 705/1485] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:15 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1310 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:15.625726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:15.627241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:15.635086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:15.635606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:15.636048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.636755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:15.637214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:15.637641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:15.777976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:15.787179 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd1636cb-8d8b-4222-acf6-62ec5ad5d9f2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.165715 Nov 02 13:18:15.787784 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 781/1486] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:15 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:16.158975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:16.159760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:16.165958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.166442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.166873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.167623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.168120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.168538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.309011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:16.317358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5f75fcc8-99a3-4fe8-baf1-7807d958bd25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1477 microversion: 2.1 time: 0.163097 Nov 02 13:18:16.318028 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 706/1487] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:16 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:16.328950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:16.329605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:16.337197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.337716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.338248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.339033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.339520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.339944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.411539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:16.422610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:16.425011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:16.430516 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b871d38c-29bd-4dfb-aace-13af825ad003 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.105792 Nov 02 13:18:16.431098 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 782/1488] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:16 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:16.441294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:16.441905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:16.448035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.448527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.448989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.449677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.450135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.450576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.463136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:16.464449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:16.473906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.474451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.475278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.476383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.476939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.477451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.539494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.539998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.540506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.540966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 77f813fd-58b7-418d-8779-6da7f3856870 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:16.597762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:16.608586 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5bd45c5c-8242-4126-aee0-99bcb31ceb8d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1310 microversion: 2.1 time: 0.150557 Nov 02 13:18:16.609633 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 783/1489] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:16 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1310 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:16.652390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:16.662162 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee14a5da-176d-4cf2-91c0-dfdacf7f08a5 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.224777 Nov 02 13:18:16.662682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 707/1490] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:16 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:16.810243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:16.810992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:16.817829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.818311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.818749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.819488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:16.819947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:16.820381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:16.964133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:16.972849 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-facf3571-c593-4722-a0f5-54a6ea9c79c5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.166593 Nov 02 13:18:16.973482 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 784/1491] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:16 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:17.341724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:17.342334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:17.349453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.349929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.350362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.351181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.351634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.352059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.464542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:17.465156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:17.473650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.474161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.474594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.475372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.475833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.476303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.489434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:17.497683 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-baea13c1-0779-4f13-baed-9693e6167160 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1477 microversion: 2.1 time: 0.159950 Nov 02 13:18:17.498260 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 708/1492] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:17 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1477 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:17.544431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:17.553438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:17.554924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:17.560608 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cac5fe45-0197-4531-8495-e71e772b73a2 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.100002 Nov 02 13:18:17.561197 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 785/1493] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:17 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:18:17.633308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:17.633987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:17.640426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.640974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.641413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.642405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.642881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.643358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.674642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:17.678611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.679096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.679580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.680025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 77f813fd-58b7-418d-8779-6da7f3856870 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:17.686813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:17.687579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:17.698613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.699130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.699579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.700291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:17.700751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:17.701184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:17.737410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:17.747017 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6803e8aa-5a0e-4049-82eb-5c5105f2a004 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1310 microversion: 2.1 time: 0.117621 Nov 02 13:18:17.747651 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 709/1494] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:17 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1310 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:17.838673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:17.847358 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e4b119d9-ea02-4e0d-ac7c-c469d725a490 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.164731 Nov 02 13:18:17.847952 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 786/1495] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:17 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:18.000434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:18.001848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:18.008162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.008653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.009093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.009825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.010282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.010712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.026599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:18.144300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:18.152159 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc8980c3-b25b-478b-8b4c-a7f2f3928aac tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.155964 Nov 02 13:18:18.152825 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 710/1496] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:17 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:18.522588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:18.523166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:18.530104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.530583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.531020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.531757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.532284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.533001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.589681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:18.590287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:18.596920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.597400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.598027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.598741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.599223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.599642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.667833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:18.672896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:18.678114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:18.679810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:18.681039 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b7f6378-c740-4185-84bd-69ca20706be6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1477 microversion: 2.1 time: 0.162432 Nov 02 13:18:18.681818 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 787/1497] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:18 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:18.685326 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6049eca-4fe4-4707-9fd0-21d1bc554001 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.099663 Nov 02 13:18:18.685907 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 711/1498] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:18 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:18:18.771607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:18.771607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:18.777696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.778173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.778607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.779325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.779774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.780200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.811603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.812076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.812510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.812957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 77f813fd-58b7-418d-8779-6da7f3856870 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:18.857690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:18.866189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a031ef20-5231-42d2-871f-935a4cc34eb0 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1310 microversion: 2.1 time: 0.100171 Nov 02 13:18:18.866772 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 788/1499] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:18 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:18.871300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:18.871985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:18.878851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.879375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.879818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:18.880526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:18.880987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:18.881419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.028474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:19.036565 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49e43ca2-cc9e-46c1-b120-edf7a25d02a6 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.169471 Nov 02 13:18:19.037169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 712/1500] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:18 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:19.176156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:19.176773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:19.182909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.183463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.183913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.184674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.185111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.185575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.367017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:19.376354 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e277cc7-c684-4b48-b85c-99e071e40459 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.203996 Nov 02 13:18:19.376724 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 789/1501] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:19 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:19.664280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c10749ce-cdd1-4314-bf36-97dc5a98b905 req-ff305548-57a9-4b41-862f-0bdbe4a47fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b61a6bd-c846-47b8-bc2e-1ced93a130de", "name": "network-vif-plugged", "status": "completed", "tag": "165d7495-3fe4-430c-b934-4fffcdeadf3a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:19.675041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c10749ce-cdd1-4314-bf36-97dc5a98b905 req-ff305548-57a9-4b41-862f-0bdbe4a47fc9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.675526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c10749ce-cdd1-4314-bf36-97dc5a98b905 req-ff305548-57a9-4b41-862f-0bdbe4a47fc9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.675981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c10749ce-cdd1-4314-bf36-97dc5a98b905 req-ff305548-57a9-4b41-862f-0bdbe4a47fc9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.688625 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c10749ce-cdd1-4314-bf36-97dc5a98b905 req-ff305548-57a9-4b41-862f-0bdbe4a47fc9 service nova] Creating event network-vif-plugged:165d7495-3fe4-430c-b934-4fffcdeadf3a for instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de on n-h1-858384-19 Nov 02 13:18:19.694555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-c10749ce-cdd1-4314-bf36-97dc5a98b905 req-ff305548-57a9-4b41-862f-0bdbe4a47fc9 service nova] Instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:18:19.707138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:19.708337 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c10749ce-cdd1-4314-bf36-97dc5a98b905 req-ff305548-57a9-4b41-862f-0bdbe4a47fc9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047917 Nov 02 13:18:19.708902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:19.711063 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 713/1502] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:19.716865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:19.717816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:19.718400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.720313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.721638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.725802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.726464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.727172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.728061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.728896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.729501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.730478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.731212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.731752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.816182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:19.827754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:19.832245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65c3ea9c1eb84e038a1ea5c80d2bbac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26aa825790e446d6babe2b0481cbdf01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:19.839378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dcf0531b-38b9-4bd5-8d7f-62d300cd9559 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 200 len: 1542 microversion: 2.91 time: 0.126563 Nov 02 13:18:19.840054 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 714/1503] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:19 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 1542 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:19.890014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:19.891244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:19.898432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.898917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.899429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.900320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.900997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.901418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.905358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:19.914797 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-761651b5-747a-4264-902a-124a727ea812 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1477 microversion: 2.1 time: 0.213532 Nov 02 13:18:19.915622 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 790/1504] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:19 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1477 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:19.938510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:19.938987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:19.940294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:19.940742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 77f813fd-58b7-418d-8779-6da7f3856870 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:19.991894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:20.002739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38af344f-fb2a-4160-9c0d-82928e1ee3e9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 200 len: 1310 microversion: 2.1 time: 0.116385 Nov 02 13:18:20.003516 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 715/1505] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:19 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 1310 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:20.062421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:20.063345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:20.070195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:20.070843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:20.071383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:20.072226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:20.072769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:20.073250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:20.296102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:20.306797 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b4c5871-5344-4d2e-be56-db10b6440745 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.249733 Nov 02 13:18:20.315180 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 791/1506] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:20 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:20.401726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:20.402360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:20.409220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:20.409718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:20.410153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:20.410872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:20.411384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:20.411817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:20.562620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:20.571830 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f4e7247-b9f8-4f35-86c7-7a69dbfb8dbe tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.174862 Nov 02 13:18:20.572409 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 716/1507] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:20 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:20.869004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:20.870287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] [instance: 4d3ead0b-c738-4855-8460-8be9b17b0727] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:20.873485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:20.874504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:20.880956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:20.881880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:20.882563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:20.883303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:20.883815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:20.884186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:20.900182 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] HTTP exception thrown: Instance 4d3ead0b-c738-4855-8460-8be9b17b0727 could not be found. Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Request method failure captured: Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 HTTP/1.1 Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm05zgB6ROjwN7287KziMjs5SgyISTiHwnPWY_XvIRbwy6dKd5NSU_WYVkAahUiH0t2d-ANTxwF_gUoqiQCyoXNU51P5ECWNeLNbO8cT3TQRb85rXY5MJZfzl_ELW7FocrD4WkNPTP80qZenBNnoSStGhsY1vrQ36fbpOqaiWlQYcVg Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.91 Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 26aa825790e446d6babe2b0481cbdf01 Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-662362042 Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:18:20.901851 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/26aa825790e446d6babe2b0481cbdf01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/26aa825790e446d6babe2b0481cbdf01"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_26aa825790e446d6babe2b0481cbdf01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/26aa825790e446d6babe2b0481cbdf01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-662362042 Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 26aa825790e446d6babe2b0481cbdf01 Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-662362042 Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-UnshelveToHostMultiNodesTest-662362042-project Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 65c3ea9c1eb84e038a1ea5c80d2bbac7 Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-662362042-project Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 4d3ead0b-c738-4855-8460-8be9b17b0727 could not be found. Nov 02 13:18:20.903328 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '4d3ead0b-c738-4855-8460-8be9b17b0727'} Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3ead0b-c738-4855-8460-8be9b17b0727 could not be found. Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:20.904111 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3ead0b-c738-4855-8460-8be9b17b0727 could not be found. Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3ead0b-c738-4855-8460-8be9b17b0727 could not be found. Nov 02 13:18:20.905586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:20.907559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] Returning 404 to user: Instance 4d3ead0b-c738-4855-8460-8be9b17b0727 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:20.907559 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68c0b8eb-759d-490a-80be-933cf3d277c9 tempest-UnshelveToHostMultiNodesTest-662362042 tempest-UnshelveToHostMultiNodesTest-662362042-project] 10.222.0.113 "GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727" status: 404 len: 111 microversion: 2.91 time: 0.039759 Nov 02 13:18:20.907559 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 792/1508] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:20 2022] GET /compute/v2.1/servers/4d3ead0b-c738-4855-8460-8be9b17b0727 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:18:20.942160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:20.942847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:20.951187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:20.952051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:20.952464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:20.953251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:20.954619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:20.955268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:20.985763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:21.026330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:21.027284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 77f813fd-58b7-418d-8779-6da7f3856870] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:21.035603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.036482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.037127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.038072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.038763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.039235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.061593 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] HTTP exception thrown: Instance 77f813fd-58b7-418d-8779-6da7f3856870 could not be found. Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Request method failure captured: Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 HTTP/1.1 Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1XAqZc6Mlu35sSVyjpBE0eQ1odky3stto0epk6-PKbBRlt677a543F2dVM18A7a4rX2o0s-tJoxHEV4Jfl3Qic_sHInQ1J59_eDJ2R8CGQI4DkFNzKTbCuyDIvim1IOofAIMbkOhBH0nkYl4e5PkNPRDGPR6L3ngg7K8qpcNfHsUE Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:18:21.063300 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: cddc6a408b8143999f80691c3234e6a4 Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 77f813fd-58b7-418d-8779-6da7f3856870 could not be found. Nov 02 13:18:21.065646 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '77f813fd-58b7-418d-8779-6da7f3856870'} Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f813fd-58b7-418d-8779-6da7f3856870 could not be found. Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:21.066480 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f813fd-58b7-418d-8779-6da7f3856870 could not be found. Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f813fd-58b7-418d-8779-6da7f3856870 could not be found. Nov 02 13:18:21.068142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:21.076358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Returning 404 to user: Instance 77f813fd-58b7-418d-8779-6da7f3856870 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:21.077281 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b25664eb-32e6-47f3-9ea2-8b0562393d08 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870" status: 404 len: 111 microversion: 2.1 time: 0.054841 Nov 02 13:18:21.078422 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 793/1509] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:21 2022] GET /compute/v2.1/servers/77f813fd-58b7-418d-8779-6da7f3856870 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:18:21.087809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:21.088414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:21.094723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.095980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.097374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.098339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.099088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.099781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.129420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:21.131550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:21.138904 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e45408a-658f-49a8-ad1e-45b9886f76e1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1474 microversion: 2.1 time: 0.201632 Nov 02 13:18:21.140163 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 717/1510] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:20 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1474 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:21.164251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e11addce-b879-4834-bf2e-88f733ee2781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:21.165027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e11addce-b879-4834-bf2e-88f733ee2781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:21.171456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e11addce-b879-4834-bf2e-88f733ee2781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.171940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e11addce-b879-4834-bf2e-88f733ee2781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.172368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e11addce-b879-4834-bf2e-88f733ee2781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.173068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e11addce-b879-4834-bf2e-88f733ee2781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.174330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e11addce-b879-4834-bf2e-88f733ee2781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.174765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e11addce-b879-4834-bf2e-88f733ee2781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.217536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:21.238312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d3e1e6f-c7ed-4655-b971-289a6ae54162 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 204 len: 0 microversion: 2.1 time: 0.154080 Nov 02 13:18:21.239099 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 794/1511] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:21 2022] DELETE /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:21.248395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:21.249245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:21.256077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.256514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.257073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.257409 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e11addce-b879-4834-bf2e-88f733ee2781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de/action" status: 204 len: 0 microversion: 2.1 time: 0.097070 Nov 02 13:18:21.257696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.258152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.258584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.259373 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 718/1512] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:18:21 2022] POST /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de/action => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:18:21.270416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:21.272187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:21.280295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.281056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.281648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.282739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.283962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.284613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.453316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:21.463676 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-44309eea-230e-4b36-865c-d6497c6b4a75 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1474 microversion: 2.1 time: 0.198255 Nov 02 13:18:21.464262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 719/1513] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:21 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1474 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:21.469000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:21.469610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:21.475099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:21.476794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.477241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.477714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.478544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.478871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.479334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.516062 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3551da09-3611-440e-8fd0-31274a71f40c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1476 microversion: 2.1 time: 0.272349 Nov 02 13:18:21.533100 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 795/1514] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:21 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1476 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:21.602694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:21.608498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:21.631533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.633103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.633828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.634955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:21.636559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:21.637241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:21.672439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:21.855406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:21.867801 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e12c641a-cca3-4e75-aff5-fb7c71815b64 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.275993 Nov 02 13:18:21.868968 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 796/1515] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:21 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:21.956154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:21.964746 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e93c3abb-4195-463f-81fc-e87ed4f5de82 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.499447 Nov 02 13:18:21.965327 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 720/1516] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:21 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:22.490072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:22.490682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:22.500348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:22.501365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:22.503473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:22.505032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:22.506478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:22.509320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:22.547279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:22.547999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:22.556533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:22.557247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:22.558675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:22.559612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:22.563288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:22.564891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:22.708933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:22.722149 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a5504306-032b-46a3-89c6-08b2db7a3595 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1474 microversion: 2.1 time: 0.236083 Nov 02 13:18:22.725771 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 797/1517] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:22 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1474 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:22.741429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-59c20bb9-7cf5-438e-9fad-2f03661c0a6d req-a19ad1ea-f655-4c3d-a360-c83696912cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ab01f1-89f5-420d-b86d-e5acf742c5af", "name": "network-vif-plugged", "status": "completed", "tag": "2e8c4e11-04bc-4c12-a44f-c34d5f883b06"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:22.758169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-59c20bb9-7cf5-438e-9fad-2f03661c0a6d req-a19ad1ea-f655-4c3d-a360-c83696912cb8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:22.759020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-59c20bb9-7cf5-438e-9fad-2f03661c0a6d req-a19ad1ea-f655-4c3d-a360-c83696912cb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:22.759746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-59c20bb9-7cf5-438e-9fad-2f03661c0a6d req-a19ad1ea-f655-4c3d-a360-c83696912cb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:22.776009 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-59c20bb9-7cf5-438e-9fad-2f03661c0a6d req-a19ad1ea-f655-4c3d-a360-c83696912cb8 service nova] Creating event network-vif-plugged:2e8c4e11-04bc-4c12-a44f-c34d5f883b06 for instance f3ab01f1-89f5-420d-b86d-e5acf742c5af on n-h2-858384-19 Nov 02 13:18:22.783449 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-59c20bb9-7cf5-438e-9fad-2f03661c0a6d req-a19ad1ea-f655-4c3d-a360-c83696912cb8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052612 Nov 02 13:18:22.784523 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 798/1518] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:22.845632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:22.854150 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4bf5b0e8-b7cd-46f1-b4df-105f0ad7cfe6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1476 microversion: 2.1 time: 0.313792 Nov 02 13:18:22.854671 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 721/1519] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:22 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:22.890399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:22.891100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:22.903362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:22.903949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:22.904385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:22.905089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:22.905535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:22.905984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:22.988671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:22.989343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:22.997146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:22.997638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:22.998080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:22.998846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:22.999405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:22.999988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:23.058845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:23.067561 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11323ff0-bf19-47c8-b739-a504b0b0453e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.181157 Nov 02 13:18:23.068490 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 799/1520] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:22 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:23.297084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:23.306269 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6abac79f-d167-44d9-9a17-de197e380a1a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.322127 Nov 02 13:18:23.319632 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 722/1521] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:22 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:23.746920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:23.748921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:23.764210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:23.764850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:23.765599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:23.766624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:23.768207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:23.769129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:23.846929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e9cf6612-acc8-4525-8434-0599556f30a5 req-e5ef1a62-1e24-4270-aa43-84ba3a93cb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc106b9-6602-400b-b3b4-b5b3e15fc5b0", "name": "network-vif-deleted", "tag": "de29ee87-06b0-4365-ba65-10ad14a416c3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:23.863916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e9cf6612-acc8-4525-8434-0599556f30a5 req-e5ef1a62-1e24-4270-aa43-84ba3a93cb23 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:23.865092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e9cf6612-acc8-4525-8434-0599556f30a5 req-e5ef1a62-1e24-4270-aa43-84ba3a93cb23 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:23.866089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e9cf6612-acc8-4525-8434-0599556f30a5 req-e5ef1a62-1e24-4270-aa43-84ba3a93cb23 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:23.882772 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e9cf6612-acc8-4525-8434-0599556f30a5 req-e5ef1a62-1e24-4270-aa43-84ba3a93cb23 service nova] Creating event network-vif-deleted:de29ee87-06b0-4365-ba65-10ad14a416c3 for instance 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 on n-h2-858384-19 Nov 02 13:18:23.890696 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e9cf6612-acc8-4525-8434-0599556f30a5 req-e5ef1a62-1e24-4270-aa43-84ba3a93cb23 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047417 Nov 02 13:18:23.891817 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 723/1522] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:23.899066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:23.899994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:23.912464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:23.913297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:23.913972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:23.914994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:23.915823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:23.916637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:24.007743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:24.010019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:24.016661 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4ffd7d5-232b-454d-ae95-a2a043b39503 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1434 microversion: 2.1 time: 0.122211 Nov 02 13:18:24.017333 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 724/1523] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:23 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1434 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:24.031797 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2fcec0f-092e-4959-9df8-45fd1cb2da2f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1474 microversion: 2.1 time: 0.279672 Nov 02 13:18:24.031797 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 800/1524] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:23 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1474 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:24.093196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:24.093711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:24.101307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:24.102110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:24.102624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:24.103712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:24.104313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:24.104622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:24.272634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:24.282437 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b9b3fe04-c399-4c37-a78c-8455bbb766e5 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.193874 Nov 02 13:18:24.285143 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 725/1525] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:24 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:24.308248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ffdbabec-a1c1-4b42-9d89-407a2993d800 tempest-TenantUsagesNegativeTestJSON-643193622 tempest-TenantUsagesNegativeTestJSON-643193622-project-admin] 10.222.0.113 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T13%3A18%3A24.129489&end=2022-11-03T13%3A18%3A24.129489" status: 404 len: 112 microversion: - time: 0.175164 Nov 02 13:18:24.309131 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 801/1526] 10.222.0.113 () {58 vars in 1321 bytes} [Wed Nov 2 13:18:24 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T13%3A18%3A24.129489&end=2022-11-03T13%3A18%3A24.129489 => generated 112 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 02 13:18:24.318742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ad080c4-3f7a-4944-a6b0-134d7b068207 tempest-TenantUsagesNegativeTestJSON-643193622 tempest-TenantUsagesNegativeTestJSON-643193622-project-admin] Calling method '.version_select at 0x7fe78c0c4040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:24.325690 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-4ad080c4-3f7a-4944-a6b0-134d7b068207 tempest-TenantUsagesNegativeTestJSON-643193622 tempest-TenantUsagesNegativeTestJSON-643193622-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ad080c4-3f7a-4944-a6b0-134d7b068207 tempest-TenantUsagesNegativeTestJSON-643193622 tempest-TenantUsagesNegativeTestJSON-643193622-project-admin] Request method failure captured: Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-simple-tenant-usage/0919ec9661a740aabdd6319fdafd58b2?start=2022-11-03T13%3A18%3A24.129489&end=2022-11-01T13%3A18%3A24.129489 HTTP/1.1 Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm4gC63gsKP-fCO5-KD8FY9tsaAqsmvpPo2zp4bzHzBuk-MFpgIxJN3G9YfpftXNrJJ4vBN1oq8kXJLKpGGIEKn5iNj2aHtaOQMSDCPmi4FVt3buI31Cxf5jkiCVKzxZBY7eivlCS5uLXfEbI1Ey5x4zUKCHvmKQlTZF93RgfclNzfg Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: af54070181ed44b9ad00a97ca100be5f Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-643193622 Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:18:24.329320 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/af54070181ed44b9ad00a97ca100be5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/af54070181ed44b9ad00a97ca100be5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_af54070181ed44b9ad00a97ca100be5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/af54070181ed44b9ad00a97ca100be5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-643193622 Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: af54070181ed44b9ad00a97ca100be5f Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-643193622 Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TenantUsagesNegativeTestJSON-643193622-project-admin Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1d0bcc9de7b74c50ab972aa36b093664 Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-643193622-project-admin Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid start time. The start time cannot occur after the end time. Nov 02 13:18:24.331333 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '0919ec9661a740aabdd6319fdafd58b2'} Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 13:18:24.336997 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ad080c4-3f7a-4944-a6b0-134d7b068207 tempest-TenantUsagesNegativeTestJSON-643193622 tempest-TenantUsagesNegativeTestJSON-643193622-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:24.338331 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ad080c4-3f7a-4944-a6b0-134d7b068207 tempest-TenantUsagesNegativeTestJSON-643193622 tempest-TenantUsagesNegativeTestJSON-643193622-project-admin] 10.222.0.113 "GET /compute/v2.1/os-simple-tenant-usage/0919ec9661a740aabdd6319fdafd58b2?start=2022-11-03T13%3A18%3A24.129489&end=2022-11-01T13%3A18%3A24.129489" status: 400 len: 111 microversion: 2.1 time: 0.016730 Nov 02 13:18:24.339201 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 726/1527] 10.222.0.113 () {58 vars in 1417 bytes} [Wed Nov 2 13:18:24 2022] GET /compute/v2.1/os-simple-tenant-usage/0919ec9661a740aabdd6319fdafd58b2?start=2022-11-03T13%3A18%3A24.129489&end=2022-11-01T13%3A18%3A24.129489 => generated 111 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:18:24.341892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:24.342800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:24.352198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:24.352788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:24.353488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:24.354433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:24.355147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:24.355668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:24.469708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d348bf58-f88b-4ac6-91ed-c539b7a915db tempest-TenantUsagesNegativeTestJSON-1575570061 tempest-TenantUsagesNegativeTestJSON-1575570061-project] Calling method '.version_select at 0x7fe787c69ca0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:24.475105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d348bf58-f88b-4ac6-91ed-c539b7a915db tempest-TenantUsagesNegativeTestJSON-1575570061 tempest-TenantUsagesNegativeTestJSON-1575570061-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'e7e6d9cf09da4c45ad834e842147711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0919ec9661a740aabdd6319fdafd58b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d348bf58-f88b-4ac6-91ed-c539b7a915db tempest-TenantUsagesNegativeTestJSON-1575570061 tempest-TenantUsagesNegativeTestJSON-1575570061-project] Request method failure captured: Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A18%3A24.129489&end=2022-11-03T13%3A18%3A24.129489&detailed=1 HTTP/1.1 Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm4flX9E1aA9InR3OwJA39bl5-L5mW08EEvwj51bb6exbO7MpcF__2Ur5G5Hhi95bB7wgQHIFXxaQylieSnOtVVMYHZE-hMObYx7PsF_KgVrGhnq6p5il77-lZ3wfucA42myWFvseh5KkeNK6Y-mu5cdnICXXzNTX3CIaAxtewnaguQ Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 0919ec9661a740aabdd6319fdafd58b2 Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1575570061 Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:18:24.477095 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0919ec9661a740aabdd6319fdafd58b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0919ec9661a740aabdd6319fdafd58b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_0919ec9661a740aabdd6319fdafd58b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/0919ec9661a740aabdd6319fdafd58b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1575570061 Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 0919ec9661a740aabdd6319fdafd58b2 Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1575570061 Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TenantUsagesNegativeTestJSON-1575570061-project Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e7e6d9cf09da4c45ad834e842147711b Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1575570061-project Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: action_args: {} Nov 02 13:18:24.478541 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:18:24.483741 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:18:24.485009 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:18:24.489244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 13:18:24.489244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:24.489244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d348bf58-f88b-4ac6-91ed-c539b7a915db tempest-TenantUsagesNegativeTestJSON-1575570061 tempest-TenantUsagesNegativeTestJSON-1575570061-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:24.489244 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d348bf58-f88b-4ac6-91ed-c539b7a915db tempest-TenantUsagesNegativeTestJSON-1575570061 tempest-TenantUsagesNegativeTestJSON-1575570061-project] 10.222.0.113 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A18%3A24.129489&end=2022-11-03T13%3A18%3A24.129489&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.137185 Nov 02 13:18:24.489244 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 727/1528] 10.222.0.113 () {58 vars in 1340 bytes} [Wed Nov 2 13:18:24 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A18%3A24.129489&end=2022-11-03T13%3A18%3A24.129489&detailed=1 => generated 123 bytes in 140 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:18:24.518970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:24.535215 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-558bafbd-c66d-4cbe-923f-a9dfc7f6d89b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.207214 Nov 02 13:18:24.537514 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 802/1529] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:24 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:24.807026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1b142f91-25ee-4267-a7e3-9bc9a054fe55 req-e52afa22-b29a-4ee4-954c-935eb1207574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e5b238-3258-4e2d-ba0e-01268713299a", "name": "network-vif-plugged", "status": "completed", "tag": "bdbac33f-c52c-4822-983e-75fc66196e13"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:24.824076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1b142f91-25ee-4267-a7e3-9bc9a054fe55 req-e52afa22-b29a-4ee4-954c-935eb1207574 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:24.824076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1b142f91-25ee-4267-a7e3-9bc9a054fe55 req-e52afa22-b29a-4ee4-954c-935eb1207574 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:24.824076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1b142f91-25ee-4267-a7e3-9bc9a054fe55 req-e52afa22-b29a-4ee4-954c-935eb1207574 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:24.845926 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1b142f91-25ee-4267-a7e3-9bc9a054fe55 req-e52afa22-b29a-4ee4-954c-935eb1207574 service nova] Creating event network-vif-plugged:bdbac33f-c52c-4822-983e-75fc66196e13 for instance d8e5b238-3258-4e2d-ba0e-01268713299a on n-h1-858384-19 Nov 02 13:18:24.852529 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1b142f91-25ee-4267-a7e3-9bc9a054fe55 req-e52afa22-b29a-4ee4-954c-935eb1207574 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050189 Nov 02 13:18:24.853670 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 728/1530] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:25.052007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:25.053410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:25.058494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:25.059239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:25.067082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.067607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.068053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.068783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.071554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.074704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.074870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.075994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.076839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.077602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.078070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.078506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.116173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:25.119088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.119871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.120551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.121223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:25.208518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:25.218507 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c432190-45b0-4ee7-8844-e19dd900bde4 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1311 microversion: 2.1 time: 0.179167 Nov 02 13:18:25.219431 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 803/1531] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:25 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1311 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:25.262265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:25.271352 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a3c8541f-29a5-4820-ac11-2a20e6c5dc99 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1474 microversion: 2.1 time: 0.218025 Nov 02 13:18:25.271948 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 729/1532] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:25 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:25.308269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:25.309090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:25.316133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.317064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.317858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.318677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.319350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.319893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.561215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:25.561857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:25.571266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.571769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.572210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.573423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:25.574091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:25.574540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:25.729749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:25.743957 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-903321c6-58ca-4c06-90c6-3c38bdec1c04 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.186868 Nov 02 13:18:25.745259 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 730/1533] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:25 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:25.769472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:25.779224 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8bf32a81-5a90-4c60-b872-e265579c79de tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1355 microversion: 2.1 time: 0.474810 Nov 02 13:18:25.780336 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 804/1534] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:25 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1355 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:26.243042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:26.243945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:26.252620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.253424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.254347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.255452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.256286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.257329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.304789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:26.305739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:26.312485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.312768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.313213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.313927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.314940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.315451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.321112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.321476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.321896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.322445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:26.374939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:26.394045 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c3962e3f-b95f-4070-84e2-a35a711b355a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 200 len: 1311 microversion: 2.1 time: 0.155039 Nov 02 13:18:26.396099 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 731/1535] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:26 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:26.504079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:26.517772 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ffad0055-f422-4905-b2de-41a8c0fe9178 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1474 microversion: 2.1 time: 0.215476 Nov 02 13:18:26.518978 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 805/1536] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:26 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:26.768914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:26.769520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:26.776859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.777382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.778155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.778691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.779173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.779607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.806068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:26.807440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:26.814165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.814750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.815312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.816208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:26.816622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:26.817252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:26.975648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:26.996397 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ffd4dd65-9574-45dd-8326-32fd256629aa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1482 microversion: 2.1 time: 0.231804 Nov 02 13:18:26.999223 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 732/1537] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:26 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1482 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:27.017816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:27.032092 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-faec9d53-5aa1-4f2d-b149-519f56604164 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1545 microversion: 2.1 time: 0.233452 Nov 02 13:18:27.033713 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 806/1538] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:26 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1545 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:27.060566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cbea3f55-53bf-479b-a88a-99efb1fd3fe2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.061325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cbea3f55-53bf-479b-a88a-99efb1fd3fe2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:27.073047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbea3f55-53bf-479b-a88a-99efb1fd3fe2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.081104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbea3f55-53bf-479b-a88a-99efb1fd3fe2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.081683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbea3f55-53bf-479b-a88a-99efb1fd3fe2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.082543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbea3f55-53bf-479b-a88a-99efb1fd3fe2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.083079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbea3f55-53bf-479b-a88a-99efb1fd3fe2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.083604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbea3f55-53bf-479b-a88a-99efb1fd3fe2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.175865 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cbea3f55-53bf-479b-a88a-99efb1fd3fe2 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119237 Nov 02 13:18:27.177278 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 733/1539] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:18:27 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:27.353543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a452ae1-d345-4f30-8c1d-5484bc667cc2 tempest-ListImagesTestJSON-1283834817 tempest-ListImagesTestJSON-1283834817-project] Calling method '.version_select at 0x7fe78f93b040>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.402606 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7a452ae1-d345-4f30-8c1d-5484bc667cc2 tempest-ListImagesTestJSON-1283834817 tempest-ListImagesTestJSON-1283834817-project] 10.222.0.113 "GET /compute/v2.1/images/c691e80e-3ff7-4224-8e34-80d276ecc1b1" status: 200 len: 787 microversion: 2.1 time: 0.205117 Nov 02 13:18:27.403234 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 807/1540] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:18:27 2022] GET /compute/v2.1/images/c691e80e-3ff7-4224-8e34-80d276ecc1b1 => generated 787 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:27.418181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.418751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39e0706b-2d91-4756-838b-efb078459e3f tempest-ListImagesTestJSON-1283834817 tempest-ListImagesTestJSON-1283834817-project] Calling method '.version_select at 0x7fe78f93fca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.419686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:27.427319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.428097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.428641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.429549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.430010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.430444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.446538 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] HTTP exception thrown: Instance 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 could not be found. Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Request method failure captured: Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 HTTP/1.1 Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1XAqZc6Mlu35sSVyjpBE0eQ1odky3stto0epk6-PKbBRlt677a543F2dVM18A7a4rX2o0s-tJoxHEV4Jfl3Qic_sHInQ1J59_eDJ2R8CGQI4DkFNzKTbCuyDIvim1IOofAIMbkOhBH0nkYl4e5PkNPRDGPR6L3ngg7K8qpcNfHsUE Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:18:27.448708 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: cddc6a408b8143999f80691c3234e6a4 Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 could not be found. Nov 02 13:18:27.450352 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '9dc106b9-6602-400b-b3b4-b5b3e15fc5b0'} Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 could not be found. Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:27.451313 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 could not be found. Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 could not be found. Nov 02 13:18:27.452830 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:27.456440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Returning 404 to user: Instance 9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:27.457505 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cdf93058-7014-45c3-a060-6724204ad24c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0" status: 404 len: 111 microversion: 2.1 time: 0.043509 Nov 02 13:18:27.458705 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 734/1541] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:27 2022] GET /compute/v2.1/servers/9dc106b9-6602-400b-b3b4-b5b3e15fc5b0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:18:27.466359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.467027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:27.474466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.474953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.475428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.476236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.476692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.477118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.505484 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39e0706b-2d91-4756-838b-efb078459e3f tempest-ListImagesTestJSON-1283834817 tempest-ListImagesTestJSON-1283834817-project] 10.222.0.113 "GET /compute/v2.1/images" status: 200 len: 448 microversion: 2.1 time: 0.090548 Nov 02 13:18:27.508549 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 808/1542] 10.222.0.113 () {58 vars in 1127 bytes} [Wed Nov 2 13:18:27 2022] GET /compute/v2.1/images => generated 448 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:27.515502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:27.521324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ab104c0f-050e-4d3d-9c88-03960f2dfcf7 tempest-ListImagesTestJSON-1283834817 tempest-ListImagesTestJSON-1283834817-project] Calling method '.version_select at 0x7fe78f926280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.594184 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ab104c0f-050e-4d3d-9c88-03960f2dfcf7 tempest-ListImagesTestJSON-1283834817 tempest-ListImagesTestJSON-1283834817-project] 10.222.0.113 "GET /compute/v2.1/images/detail" status: 200 len: 790 microversion: 2.1 time: 0.077065 Nov 02 13:18:27.596338 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 809/1543] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:18:27 2022] GET /compute/v2.1/images/detail => generated 790 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:27.603223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.605510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:27.615551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.616386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.617056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.618002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.619050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.619718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.670830 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38826f52-8ffe-464d-b2d3-bc1c8e41cd4f tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 204 len: 0 microversion: 2.1 time: 0.206670 Nov 02 13:18:27.671746 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 735/1544] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:27 2022] DELETE /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:18:27.697994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.701291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:27.714621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.715133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.715569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.717978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.718454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.720074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.794551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:27.803970 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5054f2d7-7df4-4215-8e2f-4c42189a5c25 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1466 microversion: 2.1 time: 0.206013 Nov 02 13:18:27.804509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 810/1545] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:27 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1466 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:27.837426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:27.838056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:27.844472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.845091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.856429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.858284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:27.860154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:27.863703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:27.996053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:28.008554 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0ffcb68b-6a8d-49ca-9cc8-c52126dd8f54 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1475 microversion: 2.1 time: 0.328443 Nov 02 13:18:28.009576 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 736/1546] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:27 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1475 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:28.027814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:28.028755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:28.032181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:28.040800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.041622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.042753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.043740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.044306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.044835 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f542376-9bff-422e-aa80-e1e638618c6f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1466 microversion: 2.1 time: 0.216392 Nov 02 13:18:28.045124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.045919 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 811/1547] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:27 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1466 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:28.073762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe87d64c-9353-497a-b07e-b8ca3388f166 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'create', calling method: .version_select at 0x7fe78f93f0d0>, body: {"keypair": {"name": "tempest-keypair-1898406173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByP3C1S2pJIm1D2YhMP8gyNfAIEU3izmfrZj/2oVyvkYG1nrLUbT8XTDbyo6rImI/saS4q8l8H5SY5I+4E4rg1h0lQw8rqv5qgupVKiZyl3eoW/l8xI6QR57Q8XRNissw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:28.093095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-fe87d64c-9353-497a-b07e-b8ca3388f166 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:18:28.101824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-fe87d64c-9353-497a-b07e-b8ca3388f166 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for user e7104fb14f5c430a8bfd7e6aa7ada5ee and project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:18:28.135485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fe87d64c-9353-497a-b07e-b8ca3388f166 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065550 Nov 02 13:18:28.136420 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 812/1548] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:18:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:28.338454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:28.348180 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5130272-bfb1-4644-8635-8231befa39e8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1467 microversion: 2.1 time: 0.328542 Nov 02 13:18:28.349254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 737/1549] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:28 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1467 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:28.391350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f513867c-ad12-4c15-9ed6-e342ba04eefb tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:28.394749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f513867c-ad12-4c15-9ed6-e342ba04eefb tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:28.402860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f513867c-ad12-4c15-9ed6-e342ba04eefb tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.403524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f513867c-ad12-4c15-9ed6-e342ba04eefb tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.404097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f513867c-ad12-4c15-9ed6-e342ba04eefb tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.404959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f513867c-ad12-4c15-9ed6-e342ba04eefb tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.405596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f513867c-ad12-4c15-9ed6-e342ba04eefb tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.406030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f513867c-ad12-4c15-9ed6-e342ba04eefb tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.508778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f513867c-ad12-4c15-9ed6-e342ba04eefb tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action" status: 202 len: 0 microversion: 2.1 time: 0.122646 Nov 02 13:18:28.509882 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 813/1550] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:18:28 2022] POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:18:28.519209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:28.520011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:28.539723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8f8fb5d1-eaa0-421a-aa5a-8e2edc9f5404 req-dd49b697-8ab0-40d9-841b-1e5255de62dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ab01f1-89f5-420d-b86d-e5acf742c5af", "tag": "2e8c4e11-04bc-4c12-a44f-c34d5f883b06"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:28.540542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.541375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.541961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.543023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.543532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.544236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.558028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8f8fb5d1-eaa0-421a-aa5a-8e2edc9f5404 req-dd49b697-8ab0-40d9-841b-1e5255de62dd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.558413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8f8fb5d1-eaa0-421a-aa5a-8e2edc9f5404 req-dd49b697-8ab0-40d9-841b-1e5255de62dd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.559362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8f8fb5d1-eaa0-421a-aa5a-8e2edc9f5404 req-dd49b697-8ab0-40d9-841b-1e5255de62dd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.574845 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8f8fb5d1-eaa0-421a-aa5a-8e2edc9f5404 req-dd49b697-8ab0-40d9-841b-1e5255de62dd service nova] Creating event network-changed:2e8c4e11-04bc-4c12-a44f-c34d5f883b06 for instance f3ab01f1-89f5-420d-b86d-e5acf742c5af on n-h2-858384-19 Nov 02 13:18:28.582412 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8f8fb5d1-eaa0-421a-aa5a-8e2edc9f5404 req-dd49b697-8ab0-40d9-841b-1e5255de62dd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054937 Nov 02 13:18:28.583771 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 814/1551] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:28.617867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.618627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.619062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.619547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lazy-loading 'fault' on Instance uuid d8e5b238-3258-4e2d-ba0e-01268713299a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:28.926693 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-71b35d49-51f8-4d76-9c31-acbc186dcc73 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1603 microversion: 2.1 time: 0.412388 Nov 02 13:18:28.928549 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 738/1552] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:28 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1603 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:28.950103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5bd5173-f1dc-4e26-9301-a86966aaa411 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:28.952477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b5bd5173-f1dc-4e26-9301-a86966aaa411 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:28.964178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bd5173-f1dc-4e26-9301-a86966aaa411 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.965110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bd5173-f1dc-4e26-9301-a86966aaa411 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.966036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bd5173-f1dc-4e26-9301-a86966aaa411 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:28.966934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bd5173-f1dc-4e26-9301-a86966aaa411 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:28.967578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bd5173-f1dc-4e26-9301-a86966aaa411 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:28.968240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bd5173-f1dc-4e26-9301-a86966aaa411 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.039679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:29.042121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:29.074142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:29.077387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:29.078094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.078798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:29.082307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b5bd5173-f1dc-4e26-9301-a86966aaa411 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action" status: 202 len: 0 microversion: 2.1 time: 0.136338 Nov 02 13:18:29.082839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:29.086577 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 815/1553] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:18:28 2022] POST /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:18:29.086739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.092715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c9a8612f-c67a-494f-af56-635ac0d6f638 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:29.094368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c9a8612f-c67a-494f-af56-635ac0d6f638 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:29.102993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9a8612f-c67a-494f-af56-635ac0d6f638 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:29.105313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9a8612f-c67a-494f-af56-635ac0d6f638 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:29.105979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9a8612f-c67a-494f-af56-635ac0d6f638 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.107964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9a8612f-c67a-494f-af56-635ac0d6f638 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:29.109483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9a8612f-c67a-494f-af56-635ac0d6f638 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:29.110276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9a8612f-c67a-494f-af56-635ac0d6f638 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.144169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:29.426761 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c9a8612f-c67a-494f-af56-635ac0d6f638 tempest-ServersAdminTestJSON-139690534 tempest-ServersAdminTestJSON-139690534-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1620 microversion: 2.1 time: 0.338042 Nov 02 13:18:29.431535 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 816/1554] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:29 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1620 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:29.451658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:29.452192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:29.463363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:29.463869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:29.464322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.469031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:29.471619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:29.472319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.547252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:29.575296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:29.587994 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-76d6fbd8-0f20-4474-b8c6-60a22e0ac7b8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1475 microversion: 2.1 time: 0.557372 Nov 02 13:18:29.588927 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 739/1555] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:29 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1475 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:29.652013 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f381ad8-125f-41de-9cbd-7c35baa99b0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 204 len: 0 microversion: 2.1 time: 0.203922 Nov 02 13:18:29.653120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 817/1556] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:29 2022] DELETE /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:18:29.671503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:29.672375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:29.686609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:29.688574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:29.693361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:29.695048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:29.696150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:29.697529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:30.281458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:30.300082 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1699c70f-5621-41a5-a9c4-1a22192184f2 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1473 microversion: 2.1 time: 0.632086 Nov 02 13:18:30.302973 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 740/1557] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:29 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1473 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:30.619376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:30.621594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:30.638532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:30.639523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:30.640181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:30.641253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:30.642039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:30.644459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:30.850853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:30.861941 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4565abcd-ac15-48b3-8c2d-7f98bca91a5d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1433 microversion: 2.1 time: 0.250248 Nov 02 13:18:30.863160 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 818/1558] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:30 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1433 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:30.875609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-624f6c4b-cf54-4704-92f2-cd270c0a25a8 req-a775d3d9-23f9-4261-ae4c-a662fc81371f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b594218-5f5b-47ae-8c89-b9a4ea8cb794", "name": "network-vif-deleted", "tag": "1c071412-832b-48a0-9f41-3f56b4b64a08"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:30.891034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-624f6c4b-cf54-4704-92f2-cd270c0a25a8 req-a775d3d9-23f9-4261-ae4c-a662fc81371f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:30.893543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-624f6c4b-cf54-4704-92f2-cd270c0a25a8 req-a775d3d9-23f9-4261-ae4c-a662fc81371f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:30.894740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-624f6c4b-cf54-4704-92f2-cd270c0a25a8 req-a775d3d9-23f9-4261-ae4c-a662fc81371f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:30.917065 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-624f6c4b-cf54-4704-92f2-cd270c0a25a8 req-a775d3d9-23f9-4261-ae4c-a662fc81371f service nova] Creating event network-vif-deleted:1c071412-832b-48a0-9f41-3f56b4b64a08 for instance 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 on n-h2-858384-19 Nov 02 13:18:30.926095 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-624f6c4b-cf54-4704-92f2-cd270c0a25a8 req-a775d3d9-23f9-4261-ae4c-a662fc81371f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055567 Nov 02 13:18:30.928781 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 741/1559] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:31.321227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87f716d7-03c1-4a33-99e4-3df5f0ac63a0 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '.version_select at 0x7fe7876df280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:31.328962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:31.331886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:31.336410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87f716d7-03c1-4a33-99e4-3df5f0ac63a0 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.345854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87f716d7-03c1-4a33-99e4-3df5f0ac63a0 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.348429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87f716d7-03c1-4a33-99e4-3df5f0ac63a0 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.352463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.354682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.355141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.355893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.356357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.356784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.386125 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87f716d7-03c1-4a33-99e4-3df5f0ac63a0 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.1 time: 0.073396 Nov 02 13:18:31.386751 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 819/1560] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:18:31 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:31.427618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d81eb069-f537-4a66-a88b-9c82e5a7bf88 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:31.436929 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d81eb069-f537-4a66-a88b-9c82e5a7bf88 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.016086 Nov 02 13:18:31.446056 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 820/1561] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:18:31 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:31.451621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d197f90c-0220-41ce-b4e2-d14b23f3f390 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-18839667", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:31.498644 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d197f90c-0220-41ce-b4e2-d14b23f3f390 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.050630 Nov 02 13:18:31.501902 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 821/1562] 10.222.0.113 () {60 vars in 1151 bytes} [Wed Nov 2 13:18:31 2022] POST /compute/v2.1/flavors => generated 499 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:31.517401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e6f91ab-8ea2-46e3-89f6-212dba4abd9a tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:31.526408 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e6f91ab-8ea2-46e3-89f6-212dba4abd9a tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013017 Nov 02 13:18:31.527331 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 822/1563] 10.222.0.113 () {58 vars in 1187 bytes} [Wed Nov 2 13:18:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:18:31.695616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1423950206", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "eab6f2b4-4688-4663-9388-5ef7fcdc736f"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:31.703813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:31.734440 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ac9b4939-a01c-48ed-a914-2b716f6d0cfa tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1473 microversion: 2.1 time: 0.409436 Nov 02 13:18:31.750236 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 742/1564] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:31 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1473 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:31.764457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:18:31.896254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:31.897793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:31.904611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.905175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.905688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.906472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.906999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.907543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.965575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:31.966099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:31.966586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:31.967048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:32.022624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:32.035234 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-861835bf-e8e3-4e3e-90f3-92adbeb1cdd9 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 200 len: 1310 microversion: 2.1 time: 0.144336 Nov 02 13:18:32.036224 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 743/1565] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:31 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 1310 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:32.572708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:18:32.573130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:18:32.573600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:18:32.574183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:18:32.574597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:18:32.585820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:32.586469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:32.587104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:32.588055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:32.588734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:32.589160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:32.608758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:18:32.616263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for user e7104fb14f5c430a8bfd7e6aa7ada5ee and project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:18:32.630481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:18:32.632911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:18:32.690402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd140db8-f549-4ecf-a389-7af7d096e2ab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.002609 Nov 02 13:18:32.691670 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 823/1566] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:18:31 2022] POST /compute/v2.1/servers => generated 382 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:18:32.702756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cc2f7011-4f2d-4731-8398-7cb0869a124b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:32.710842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cc2f7011-4f2d-4731-8398-7cb0869a124b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:32.713721 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:18:32.714102 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 13:18:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 (ip 10.222.0.113) !!! Nov 02 13:18:32.790832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:32.792353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:32.802611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:32.803140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:32.804433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:32.805464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:32.806867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:32.807538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:32.882188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:32.900302 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a43b794a-ebd9-4008-8b21-ed3a5f725d59 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1431 microversion: 2.1 time: 0.114363 Nov 02 13:18:32.901799 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 824/1567] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:32 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1431 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:32.965616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a6a1f9a8-ed09-41f8-9180-f99494854be2 req-dfccfa01-de3c-4590-8be8-5a700849db4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7abafda-06b1-412b-be6d-88482b4716c1", "name": "network-vif-deleted", "tag": "bc98d529-d478-4d4a-b88d-9a5c95bb4099"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:32.979500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a6a1f9a8-ed09-41f8-9180-f99494854be2 req-dfccfa01-de3c-4590-8be8-5a700849db4b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:32.980127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a6a1f9a8-ed09-41f8-9180-f99494854be2 req-dfccfa01-de3c-4590-8be8-5a700849db4b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:32.980786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a6a1f9a8-ed09-41f8-9180-f99494854be2 req-dfccfa01-de3c-4590-8be8-5a700849db4b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:32.981105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cc2f7011-4f2d-4731-8398-7cb0869a124b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:32.996383 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cc2f7011-4f2d-4731-8398-7cb0869a124b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1283 microversion: 2.1 time: 0.297469 Nov 02 13:18:33.011253 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a6a1f9a8-ed09-41f8-9180-f99494854be2 req-dfccfa01-de3c-4590-8be8-5a700849db4b service nova] Creating event network-vif-deleted:bc98d529-d478-4d4a-b88d-9a5c95bb4099 for instance e7abafda-06b1-412b-be6d-88482b4716c1 on n-h1-858384-19 Nov 02 13:18:33.012738 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 744/1568] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:32 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1283 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:33.013712 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a6a1f9a8-ed09-41f8-9180-f99494854be2 req-dfccfa01-de3c-4590-8be8-5a700849db4b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047862 Nov 02 13:18:33.013712 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 825/1569] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:33.064799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:33.065980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 9b594218-5f5b-47ae-8c89-b9a4ea8cb794] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:33.079070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.079745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.086350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.086350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.086350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.086350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.126558 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] HTTP exception thrown: Instance 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 could not be found. Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Request method failure captured: Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 HTTP/1.1 Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1XAqZc6Mlu35sSVyjpBE0eQ1odky3stto0epk6-PKbBRlt677a543F2dVM18A7a4rX2o0s-tJoxHEV4Jfl3Qic_sHInQ1J59_eDJ2R8CGQI4DkFNzKTbCuyDIvim1IOofAIMbkOhBH0nkYl4e5PkNPRDGPR6L3ngg7K8qpcNfHsUE Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:18:33.131791 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: cddc6a408b8143999f80691c3234e6a4 Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 could not be found. Nov 02 13:18:33.133365 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '9b594218-5f5b-47ae-8c89-b9a4ea8cb794'} Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 could not be found. Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:33.134159 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 could not be found. Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 could not be found. Nov 02 13:18:33.135510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:33.142975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Returning 404 to user: Instance 9b594218-5f5b-47ae-8c89-b9a4ea8cb794 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:33.144512 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0efe3c3-6f79-4075-a436-e44eb3ebd526 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794" status: 404 len: 111 microversion: 2.1 time: 0.084631 Nov 02 13:18:33.145695 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 745/1570] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:33 2022] GET /compute/v2.1/servers/9b594218-5f5b-47ae-8c89-b9a4ea8cb794 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:18:33.155914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:33.156610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:33.168006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.168882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.169341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.170279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.170910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.171376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.233988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:33.380872 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3191c381-9b94-4ed2-ac09-b867852337d1 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 204 len: 0 microversion: 2.1 time: 0.229568 Nov 02 13:18:33.384645 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 826/1571] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:33 2022] DELETE /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:33.395473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:33.396783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:33.406662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.407593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.409160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.410437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.411326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.412080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.454424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:33.465569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:33.617965 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99b6b094-ac57-4ec5-b8b2-0dd78a11577c tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 204 len: 0 microversion: 2.1 time: 0.230869 Nov 02 13:18:33.619331 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 746/1572] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:33 2022] DELETE /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:33.636786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:33.638243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:33.651448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=5 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:33.656022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.656468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.657389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.659404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.660357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.661316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.839438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:33.848623 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7744eed-204c-4815-bed3-3605982fc6b3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 200 len: 1478 microversion: 2.1 time: 0.223688 Nov 02 13:18:33.849450 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 827/1573] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:33 2022] GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 1478 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:33.927366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:33.929239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:33.938094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.939977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.940800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.942064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.942787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.944545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.979724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:33.985402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:33.986749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:33.987250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:33.987744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lazy-loading 'fault' on Instance uuid e7abafda-06b1-412b-be6d-88482b4716c1 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:34.024428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:34.025203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:34.033119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:34.033998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:34.034780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:34.035941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:34.036480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:34.036973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:34.106548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:34.116130 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b2ad222-0a90-447a-bb2e-9e6bba81ded7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1287 microversion: 2.1 time: 0.096076 Nov 02 13:18:34.116807 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 828/1574] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:34 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:34.148043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:34.170219 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-28e42de7-06a4-406a-9306-cac113d205fd tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1308 microversion: 2.1 time: 0.248159 Nov 02 13:18:34.175237 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 747/1575] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:33 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:34.873593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:34.874035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:34.889850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:34.890382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:34.890831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:34.891592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:34.892080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:34.892506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:35.140365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:35.141254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:35.150587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:35.156777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:35.159238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:35.160279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:35.160916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:35.165164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:35.207984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:35.217913 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd7aee34-ca4a-4943-82fa-c77f578aac62 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 200 len: 1478 microversion: 2.1 time: 0.348592 Nov 02 13:18:35.221110 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 829/1576] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:34 2022] GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 1478 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:35.236643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:35.237566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:35.249858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:35.254033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:35.254434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:35.255497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:35.256147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:35.256729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:35.272324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:35.280740 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-791918ee-daee-4853-9383-386a3c93464c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1335 microversion: 2.1 time: 0.144341 Nov 02 13:18:35.300330 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 748/1577] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:35 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1335 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:35.329668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:35.330171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:35.330619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:35.331082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lazy-loading 'fault' on Instance uuid e7abafda-06b1-412b-be6d-88482b4716c1 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:35.430113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:35.460403 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-091b3187-de9b-43f5-b2fe-a63eea7415f8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 200 len: 1308 microversion: 2.1 time: 0.228490 Nov 02 13:18:35.461098 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 830/1578] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:35 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:36.247304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:36.247926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:36.266689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.267409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.267965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.268787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.269349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.269857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.308202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:36.309398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:36.322547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.332417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.333119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.334062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.334723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.335372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.453493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:36.466498 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d6f2813-7aff-4ece-95f4-66b8375178a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1341 microversion: 2.1 time: 0.162152 Nov 02 13:18:36.467378 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 831/1579] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:36 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:36.494298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:36.497410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: e7abafda-06b1-412b-be6d-88482b4716c1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:36.518441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.519249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.520047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.521118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.521772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.522399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.538557 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] HTTP exception thrown: Instance e7abafda-06b1-412b-be6d-88482b4716c1 could not be found. Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Request method failure captured: Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 HTTP/1.1 Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm2GIGiWMODKa-uvsFIxoxKDFldZTmVO_cYuLc6WTaB-IO4tPDN0yVP1iP_cK9eeWtO2f55OguSqrUWkI3dvljapdsa6LJos-zbqCgwTcCJ8XvJo7NJ3LYnSRb15it5jixNOES3Mm5bmXRQ1D3UviOsxQZovu-ldcKAl-llcQelC1ec Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: ee640ec7f0fd4d7a96969792712a4298 Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersAdminTestJSON-2127548012 Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:18:36.541503 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersAdminTestJSON-2127548012 Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: ee640ec7f0fd4d7a96969792712a4298 Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersAdminTestJSON-2127548012 Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersAdminTestJSON-2127548012-project Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: dbdcd46f460e455d926fcc6127f4f94f Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersAdminTestJSON-2127548012-project Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e7abafda-06b1-412b-be6d-88482b4716c1 could not be found. Nov 02 13:18:36.542994 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e7abafda-06b1-412b-be6d-88482b4716c1'} Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7abafda-06b1-412b-be6d-88482b4716c1 could not be found. Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:36.543843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7abafda-06b1-412b-be6d-88482b4716c1 could not be found. Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7abafda-06b1-412b-be6d-88482b4716c1 could not be found. Nov 02 13:18:36.545165 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:36.548258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Returning 404 to user: Instance e7abafda-06b1-412b-be6d-88482b4716c1 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:36.549848 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ab85014-8dbe-40fd-8774-6874d0a2e233 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1" status: 404 len: 111 microversion: 2.1 time: 0.059907 Nov 02 13:18:36.550460 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 832/1580] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:36 2022] GET /compute/v2.1/servers/e7abafda-06b1-412b-be6d-88482b4716c1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:18:36.560804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:36.561715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:36.569271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.569972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.570577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.571832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.572498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.573126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.612380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:36.661218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:36.676591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:36.702626 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22bbe590-4e70-4527-8469-3198c9b71c93 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 200 len: 1478 microversion: 2.1 time: 0.460473 Nov 02 13:18:36.703571 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 749/1581] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:36 2022] GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 1478 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:36.754703 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-671a5c99-b9b1-406e-a1bc-d4d4e59f4fa7 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 204 len: 0 microversion: 2.1 time: 0.198851 Nov 02 13:18:36.758608 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 833/1582] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:36 2022] DELETE /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:36.763903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:36.764530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:36.777420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.778225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.789045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:36.790150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:36.791008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:36.797313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.182816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-891182d3-9ddb-46da-aaa6-d55f7dcb80a4 req-fa190fc9-cf4c-4dc7-8f99-f0cc1d820499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8af7fb-9ec0-41f9-b19e-f8a9611be065", "name": "network-vif-deleted", "tag": "6c00af57-80ac-4518-aa54-e45203b976a5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:37.200194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-891182d3-9ddb-46da-aaa6-d55f7dcb80a4 req-fa190fc9-cf4c-4dc7-8f99-f0cc1d820499 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:37.200780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-891182d3-9ddb-46da-aaa6-d55f7dcb80a4 req-fa190fc9-cf4c-4dc7-8f99-f0cc1d820499 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:37.201583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-891182d3-9ddb-46da-aaa6-d55f7dcb80a4 req-fa190fc9-cf4c-4dc7-8f99-f0cc1d820499 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.218247 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-891182d3-9ddb-46da-aaa6-d55f7dcb80a4 req-fa190fc9-cf4c-4dc7-8f99-f0cc1d820499 service nova] Creating event network-vif-deleted:6c00af57-80ac-4518-aa54-e45203b976a5 for instance 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 on n-h2-858384-19 Nov 02 13:18:37.233646 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-891182d3-9ddb-46da-aaa6-d55f7dcb80a4 req-fa190fc9-cf4c-4dc7-8f99-f0cc1d820499 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056051 Nov 02 13:18:37.234818 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 834/1583] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:37.313850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:37.327935 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f28b68dd-b178-4f25-ae85-bf01b0dd9e83 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1474 microversion: 2.1 time: 0.568168 Nov 02 13:18:37.328899 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 750/1584] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:36 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1474 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:37.498764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:37.500057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:37.511722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:37.513111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:37.513889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.514947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:37.517250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:37.517797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.724193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c5eff52a-4cf5-42fe-96c4-a931572bea15 req-5906f429-aad1-4a48-921c-f6030f2bcdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "645cc834-6c82-4eab-a09b-3f568b8343e8", "name": "network-vif-deleted", "tag": "58bc6b38-0de6-42c0-be05-1b6a0b8246b5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:37.755448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c5eff52a-4cf5-42fe-96c4-a931572bea15 req-5906f429-aad1-4a48-921c-f6030f2bcdb8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:37.755932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c5eff52a-4cf5-42fe-96c4-a931572bea15 req-5906f429-aad1-4a48-921c-f6030f2bcdb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:37.756363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c5eff52a-4cf5-42fe-96c4-a931572bea15 req-5906f429-aad1-4a48-921c-f6030f2bcdb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.776250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c5eff52a-4cf5-42fe-96c4-a931572bea15 req-5906f429-aad1-4a48-921c-f6030f2bcdb8 service nova] Creating event network-vif-deleted:58bc6b38-0de6-42c0-be05-1b6a0b8246b5 for instance 645cc834-6c82-4eab-a09b-3f568b8343e8 on n-h1-858384-19 Nov 02 13:18:37.795358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c5eff52a-4cf5-42fe-96c4-a931572bea15 req-5906f429-aad1-4a48-921c-f6030f2bcdb8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075774 Nov 02 13:18:37.796627 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 751/1585] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:37.803272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:37.804208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:37.812488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:37.820621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:37.821066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.822146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:37.822758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:37.823363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.891425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:37.892359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:37.893402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:37.894153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:38.026718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:38.038116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:38.046595 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cb226cb2-fc84-4d2a-959c-98886f6a13f3 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 200 len: 1313 microversion: 2.1 time: 0.249041 Nov 02 13:18:38.047252 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 752/1586] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:37 2022] GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:38.049700 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d4577d4-8964-4226-8984-5192a16ec19c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.556154 Nov 02 13:18:38.052343 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 835/1587] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:37 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:38.353566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:38.354768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:38.370598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:38.371480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:38.372117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:38.373054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:38.375829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:38.376986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:38.679542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:38.700940 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2847e0a7-393e-493f-ba6f-7bf9e0da8c0b tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1474 microversion: 2.1 time: 0.351621 Nov 02 13:18:38.702067 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 753/1588] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:38 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1474 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:39.075876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:39.077571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 0d8af7fb-9ec0-41f9-b19e-f8a9611be065] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:39.078000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:39.078631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:39.087560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.088416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.088535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.088921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.089468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.090403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.091066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.091734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.092425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.093179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.093652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.094089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.119266 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] HTTP exception thrown: Instance 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 could not be found. Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Request method failure captured: Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 HTTP/1.1 Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1XAqZc6Mlu35sSVyjpBE0eQ1odky3stto0epk6-PKbBRlt677a543F2dVM18A7a4rX2o0s-tJoxHEV4Jfl3Qic_sHInQ1J59_eDJ2R8CGQI4DkFNzKTbCuyDIvim1IOofAIMbkOhBH0nkYl4e5PkNPRDGPR6L3ngg7K8qpcNfHsUE Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:18:39.122249 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: cddc6a408b8143999f80691c3234e6a4 Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 could not be found. Nov 02 13:18:39.123642 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0d8af7fb-9ec0-41f9-b19e-f8a9611be065'} Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 could not be found. Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:39.124505 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 could not be found. Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 could not be found. Nov 02 13:18:39.127407 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:39.132362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Returning 404 to user: Instance 0d8af7fb-9ec0-41f9-b19e-f8a9611be065 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:39.133475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-46259b30-a014-439c-afe0-cb4a1021d051 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065" status: 404 len: 111 microversion: 2.1 time: 0.062426 Nov 02 13:18:39.137758 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 836/1589] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:39 2022] GET /compute/v2.1/servers/0d8af7fb-9ec0-41f9-b19e-f8a9611be065 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:18:39.144530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:39.145465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:39.155490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.156325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.157416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.158983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.160348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.161043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.200466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.201375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.202041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.202730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 645cc834-6c82-4eab-a09b-3f568b8343e8 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:39.269442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:39.284560 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b89cdc5-78bd-4461-8d2b-ff16a4f20434 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 200 len: 1313 microversion: 2.1 time: 0.144715 Nov 02 13:18:39.285102 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 837/1590] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:39 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:39.294153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-95614600-8bae-4b63-948c-f5d00b82ecbf req-3846c292-b647-4876-a452-09f1be1c960e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49", "tag": "abaa7e07-a933-4415-be82-70f57348ba75"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:39.325849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-95614600-8bae-4b63-948c-f5d00b82ecbf req-3846c292-b647-4876-a452-09f1be1c960e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.327124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-95614600-8bae-4b63-948c-f5d00b82ecbf req-3846c292-b647-4876-a452-09f1be1c960e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.329599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-95614600-8bae-4b63-948c-f5d00b82ecbf req-3846c292-b647-4876-a452-09f1be1c960e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.346966 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-95614600-8bae-4b63-948c-f5d00b82ecbf req-3846c292-b647-4876-a452-09f1be1c960e service nova] Creating event network-changed:abaa7e07-a933-4415-be82-70f57348ba75 for instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 on n-h2-858384-19 Nov 02 13:18:39.369105 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-95614600-8bae-4b63-948c-f5d00b82ecbf req-3846c292-b647-4876-a452-09f1be1c960e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081552 Nov 02 13:18:39.370298 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 838/1591] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:39.462700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:39.483775 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6010a914-ba4b-4a34-9b11-4ede22ac03b5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.409911 Nov 02 13:18:39.484944 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 754/1592] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:39 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:39.726941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:39.728092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:39.736265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.737042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.737648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.738747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.739560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.740156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.840576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c7424a84-22cc-44e3-9e75-02cda9023cbd req-8919bbee-376c-494c-8634-352844b35928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b14418-609a-441d-b425-dc284f665ff0", "name": "network-vif-deleted", "tag": "516365e1-ad71-4734-bcb5-844568ba6af2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:39.854192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:39.857597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c7424a84-22cc-44e3-9e75-02cda9023cbd req-8919bbee-376c-494c-8634-352844b35928 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:39.858306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c7424a84-22cc-44e3-9e75-02cda9023cbd req-8919bbee-376c-494c-8634-352844b35928 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:39.859236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c7424a84-22cc-44e3-9e75-02cda9023cbd req-8919bbee-376c-494c-8634-352844b35928 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:39.866984 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ed7ca14-692a-42ac-a45b-31f5aeddf213 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1303 microversion: 2.1 time: 0.145122 Nov 02 13:18:39.871156 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 839/1593] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:39 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:39.878338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c7424a84-22cc-44e3-9e75-02cda9023cbd req-8919bbee-376c-494c-8634-352844b35928 service nova] Creating event network-vif-deleted:516365e1-ad71-4734-bcb5-844568ba6af2 for instance d6b14418-609a-441d-b425-dc284f665ff0 on n-h1-858384-19 Nov 02 13:18:39.893413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c7424a84-22cc-44e3-9e75-02cda9023cbd req-8919bbee-376c-494c-8634-352844b35928 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056329 Nov 02 13:18:39.897634 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 755/1594] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:40.310652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:40.311846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 645cc834-6c82-4eab-a09b-3f568b8343e8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:40.332904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.337194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.337828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.339373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.340057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.344112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.371363 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] HTTP exception thrown: Instance 645cc834-6c82-4eab-a09b-3f568b8343e8 could not be found. Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Request method failure captured: Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 HTTP/1.1 Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1XAqZc6Mlu35sSVyjpBE0eQ1odky3stto0epk6-PKbBRlt677a543F2dVM18A7a4rX2o0s-tJoxHEV4Jfl3Qic_sHInQ1J59_eDJ2R8CGQI4DkFNzKTbCuyDIvim1IOofAIMbkOhBH0nkYl4e5PkNPRDGPR6L3ngg7K8qpcNfHsUE Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:18:40.373520 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: cddc6a408b8143999f80691c3234e6a4 Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 645cc834-6c82-4eab-a09b-3f568b8343e8 could not be found. Nov 02 13:18:40.375501 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '645cc834-6c82-4eab-a09b-3f568b8343e8'} Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 645cc834-6c82-4eab-a09b-3f568b8343e8 could not be found. Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:40.376538 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 645cc834-6c82-4eab-a09b-3f568b8343e8 could not be found. Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 645cc834-6c82-4eab-a09b-3f568b8343e8 could not be found. Nov 02 13:18:40.378041 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:40.382485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Returning 404 to user: Instance 645cc834-6c82-4eab-a09b-3f568b8343e8 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:40.384765 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b8e695f-8c68-41b0-abd5-d5b894a4d86a tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8" status: 404 len: 111 microversion: 2.1 time: 0.078540 Nov 02 13:18:40.385572 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 840/1595] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:40 2022] GET /compute/v2.1/servers/645cc834-6c82-4eab-a09b-3f568b8343e8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:18:40.395895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e62ad6e5-969c-4452-b43c-b1a980259483 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:40.441138 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e62ad6e5-969c-4452-b43c-b1a980259483 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/5dd3866b-0d34-4e45-8249-394322194b66" status: 204 len: 0 microversion: 2.1 time: 0.050476 Nov 02 13:18:40.442215 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 756/1596] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:18:40 2022] DELETE /compute/v2.1/os-server-groups/5dd3866b-0d34-4e45-8249-394322194b66 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:40.450855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:40.451382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:40.458554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.459537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.460156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.461076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.461570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.461994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.494718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:40.514094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:40.515456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:40.522215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.523684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.524352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.525258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.525935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.526667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.625810 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0fcb3275-081a-4f57-ab53-f46f7b3d9697 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 204 len: 0 microversion: 2.1 time: 0.179025 Nov 02 13:18:40.627081 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 841/1597] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:40 2022] DELETE /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:40.640331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:40.642545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:40.651204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.651805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.653575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.655074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.655686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.656381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.696032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:40.774445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:40.784167 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a245466-28ee-44cf-b687-8a528db1c6ad tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.273953 Nov 02 13:18:40.800908 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 757/1598] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:40 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:40.826458 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-172f1bd1-1b9a-42cd-98de-4ae978a34889 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 204 len: 0 microversion: 2.1 time: 0.193296 Nov 02 13:18:40.827765 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 842/1599] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:40 2022] DELETE /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:18:40.836969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:40.837543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:40.844484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.844484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.845019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.845880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.846334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.846761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.893670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:40.894716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:40.902922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.903735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.904351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.905974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.906681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.909191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.955837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:40.956576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:40.957193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:40.957820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lazy-loading 'fault' on Instance uuid d6b14418-609a-441d-b425-dc284f665ff0 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:41.012662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:41.021431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-307475a3-14fa-4ca3-8b41-c6fb40df9511 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 200 len: 1478 microversion: 2.1 time: 0.189124 Nov 02 13:18:41.022022 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 758/1600] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:40 2022] GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 1478 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:41.083215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:41.097562 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d7b0afbe-967b-4438-a722-a2ab2eb2c928 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1308 microversion: 2.1 time: 0.208263 Nov 02 13:18:41.099034 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 843/1601] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:40 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:41.541641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1472046503", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "13fe8030-bf94-4a3d-a151-8f8cfea87b6a"}, {"uuid": "45134ec0-9a0c-4d69-aa3a-98cd96bbf488"}, {"uuid": "13fe8030-bf94-4a3d-a151-8f8cfea87b6a"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:41.602107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] validate_networks() for [('13fe8030-bf94-4a3d-a151-8f8cfea87b6a', None, None, None, None, None), ('45134ec0-9a0c-4d69-aa3a-98cd96bbf488', None, None, None, None, None), ('13fe8030-bf94-4a3d-a151-8f8cfea87b6a', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:18:41.809996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:41.811460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:41.820066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:41.820565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:41.821085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:41.821981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:41.822631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:41.823066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:41.978418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:41.988421 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1cb8d3b6-6224-4a7c-809e-8bfc34274efc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.182765 Nov 02 13:18:41.991696 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 844/1602] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:41 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:42.045423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:42.046353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:42.055022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:42.056424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:42.056873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:42.057600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:42.058060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:42.058496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:42.243274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:42.254425 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d5d363ed-4514-4115-85e2-f40ea55757f8 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 200 len: 1478 microversion: 2.1 time: 0.212857 Nov 02 13:18:42.255661 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 845/1603] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:42 2022] GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 1478 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:42.262464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:42.263331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:42.271574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:42.272069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:42.273542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:42.274447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:42.274956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:42.275439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:42.311993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:42.312599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:42.313213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:42.316043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lazy-loading 'fault' on Instance uuid d6b14418-609a-441d-b425-dc284f665ff0 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:42.375948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:42.384805 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2159f105-ca6b-4721-b8a6-cb4b45434db3 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1308 microversion: 2.1 time: 0.127505 Nov 02 13:18:42.390660 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 846/1604] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:42 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:42.491923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:18:42.492493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:18:42.493113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:18:42.493984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:18:42.494468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:18:42.504577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:42.505172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:42.505682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:42.506505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:42.507032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:42.507574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:42.529656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Getting quotas for project 94a263e4d49c4d6b98ea983593d9a9f3. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:18:42.535658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Getting quotas for user 93f47e9ac7784ca0963d2b1fcc3db296 and project 94a263e4d49c4d6b98ea983593d9a9f3. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:18:42.548970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:18:42.551332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:18:42.601828 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c47d752d-77cd-45df-a158-144f6e23f000 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.064180 Nov 02 13:18:42.602664 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 759/1605] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:18:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:18:42.613807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d2ca02a-681d-458a-bc89-af2274609c1e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:42.614407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d2ca02a-681d-458a-bc89-af2274609c1e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:42.616407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:42.622958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:42.689643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9d2ca02a-681d-458a-bc89-af2274609c1e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:42.711461 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d2ca02a-681d-458a-bc89-af2274609c1e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1217 microversion: 2.1 time: 0.096277 Nov 02 13:18:42.715239 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 847/1606] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:42 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:43.014015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:43.015026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:43.023802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.024547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.025156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.026241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.027507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.028572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.278791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:43.280172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:43.287808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:43.293110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.302226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.302954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.304218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.307089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.307824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.312753 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e91f65dc-1202-4d4e-83ee-668135b70995 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.302269 Nov 02 13:18:43.314272 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 760/1607] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:43 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:43.422411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:43.423553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:43.430744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.431633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.432586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.437943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.439352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.439973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.496757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.497776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.498320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.498881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lazy-loading 'fault' on Instance uuid d6b14418-609a-441d-b425-dc284f665ff0 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:43.512342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:43.524301 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-db3d2825-a0fb-47cb-bf12-ca66dec49759 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 200 len: 1478 microversion: 2.1 time: 0.249736 Nov 02 13:18:43.542986 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 848/1608] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:43 2022] GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 1478 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:43.559988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:43.579638 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5bec9cdb-d9da-4ae8-84f9-8cf6d430dc0a tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 200 len: 1308 microversion: 2.1 time: 0.170167 Nov 02 13:18:43.599168 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 761/1609] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:43 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:43.734027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:43.740101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:43.759241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.759817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.760395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.762142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:43.766092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:43.767336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:43.778050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:43.969707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:43.982095 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee5d1051-ec4f-4048-a657-58c7209ac7c5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1213 microversion: 2.1 time: 0.251153 Nov 02 13:18:43.996929 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 849/1610] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:43 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1213 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:44.339378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:44.340134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:44.355680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.356617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.358479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:44.359427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.364001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.364593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:44.544292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:44.557338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:44.557951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:44.563343 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2be5c68f-8205-44c6-ac12-bd7f4a039cd9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.229462 Nov 02 13:18:44.568470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.569611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.570344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:44.571625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.571754 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 762/1611] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:44 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:44.572435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.573183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:44.624747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:44.625572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d6b14418-609a-441d-b425-dc284f665ff0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:44.640374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.640872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.641315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:44.642249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.643016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.650000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:44.690685 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] HTTP exception thrown: Instance d6b14418-609a-441d-b425-dc284f665ff0 could not be found. Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Request method failure captured: Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 HTTP/1.1 Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm2GIGiWMODKa-uvsFIxoxKDFldZTmVO_cYuLc6WTaB-IO4tPDN0yVP1iP_cK9eeWtO2f55OguSqrUWkI3dvljapdsa6LJos-zbqCgwTcCJ8XvJo7NJ3LYnSRb15it5jixNOES3Mm5bmXRQ1D3UviOsxQZovu-ldcKAl-llcQelC1ec Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: ee640ec7f0fd4d7a96969792712a4298 Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersAdminTestJSON-2127548012 Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:18:44.699170 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersAdminTestJSON-2127548012 Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: ee640ec7f0fd4d7a96969792712a4298 Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersAdminTestJSON-2127548012 Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersAdminTestJSON-2127548012-project Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: dbdcd46f460e455d926fcc6127f4f94f Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersAdminTestJSON-2127548012-project Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance d6b14418-609a-441d-b425-dc284f665ff0 could not be found. Nov 02 13:18:44.701032 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd6b14418-609a-441d-b425-dc284f665ff0'} Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b14418-609a-441d-b425-dc284f665ff0 could not be found. Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:44.701979 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b14418-609a-441d-b425-dc284f665ff0 could not be found. Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b14418-609a-441d-b425-dc284f665ff0 could not be found. Nov 02 13:18:44.703758 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:44.705604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Returning 404 to user: Instance d6b14418-609a-441d-b425-dc284f665ff0 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:44.705604 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d856b2a1-dd4d-4545-bba0-c7bbec2db53c tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0" status: 404 len: 111 microversion: 2.1 time: 0.083207 Nov 02 13:18:44.707225 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 763/1612] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:44 2022] GET /compute/v2.1/servers/d6b14418-609a-441d-b425-dc284f665ff0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:18:44.717073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:44.717498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:44.727944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.728438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.728878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:44.729659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:44.730131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:44.730563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:44.735376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:44.771791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:45.004125 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d233c3ed-b30f-4cdd-8039-637b441b2bc4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 204 len: 0 microversion: 2.1 time: 0.270811 Nov 02 13:18:45.004832 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 764/1613] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:44 2022] DELETE /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:45.012998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:45.014002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:45.044557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:45.045550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:45.046381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:45.050085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:45.051048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:45.052134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:45.205303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:45.214087 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03b55fd0-b777-4dff-ae57-eefd3e3bc230 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1287 microversion: 2.1 time: 0.207858 Nov 02 13:18:45.214682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 765/1614] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:45 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1287 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:45.226555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:45.233988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:45.250931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:45.251586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:45.252024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:45.252946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:45.253563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:45.254152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:45.328730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:45.342472 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d5399c19-6497-4243-9cf4-ec6340366111 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 200 len: 1478 microversion: 2.1 time: 0.789000 Nov 02 13:18:45.343073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 850/1615] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:44 2022] GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 1478 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:45.587694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:45.588373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:45.601546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:45.602732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:45.603752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:45.604772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:45.605354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:45.605897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:45.660638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:45.671468 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-14e59fde-24c0-4c94-aa52-e3ade8b84c53 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1473 microversion: 2.1 time: 0.455668 Nov 02 13:18:45.682072 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 766/1616] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:45 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1473 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:45.817329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a81a0374-27d0-4779-99e8-c77bd9a1544f req-9b24311d-f6a7-4c2f-9382-0ad95ea552f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58e31fc-dbb3-440f-a950-6759a10dbee4", "name": "network-vif-deleted", "tag": "2d1aedad-90d3-4fe0-9ae9-eafd0c29b66d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:45.826195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:45.833197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a81a0374-27d0-4779-99e8-c77bd9a1544f req-9b24311d-f6a7-4c2f-9382-0ad95ea552f4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:45.833940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a81a0374-27d0-4779-99e8-c77bd9a1544f req-9b24311d-f6a7-4c2f-9382-0ad95ea552f4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:45.834553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a81a0374-27d0-4779-99e8-c77bd9a1544f req-9b24311d-f6a7-4c2f-9382-0ad95ea552f4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:45.838589 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a25ee8b6-7a8a-4f99-aec7-3fb9c1d10d39 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.254866 Nov 02 13:18:45.840984 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 851/1617] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:45 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:45.856443 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a81a0374-27d0-4779-99e8-c77bd9a1544f req-9b24311d-f6a7-4c2f-9382-0ad95ea552f4 service nova] Creating event network-vif-deleted:2d1aedad-90d3-4fe0-9ae9-eafd0c29b66d for instance c58e31fc-dbb3-440f-a950-6759a10dbee4 on n-h1-858384-19 Nov 02 13:18:45.864551 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a81a0374-27d0-4779-99e8-c77bd9a1544f req-9b24311d-f6a7-4c2f-9382-0ad95ea552f4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145960 Nov 02 13:18:45.867680 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 767/1618] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:46.194646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-66491a1d-077b-4aec-ab79-dc15da73deec req-d89bc780-2fef-41c5-8b98-2f2852654e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e913dade-1692-4209-a986-4d16548ffc95", "name": "network-vif-deleted", "tag": "a683d13e-4bb1-4f12-a364-6838e49d4af7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:46.209440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-66491a1d-077b-4aec-ab79-dc15da73deec req-d89bc780-2fef-41c5-8b98-2f2852654e22 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.210222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-66491a1d-077b-4aec-ab79-dc15da73deec req-d89bc780-2fef-41c5-8b98-2f2852654e22 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.210811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-66491a1d-077b-4aec-ab79-dc15da73deec req-d89bc780-2fef-41c5-8b98-2f2852654e22 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.227568 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-66491a1d-077b-4aec-ab79-dc15da73deec req-d89bc780-2fef-41c5-8b98-2f2852654e22 service nova] Creating event network-vif-deleted:a683d13e-4bb1-4f12-a364-6838e49d4af7 for instance e913dade-1692-4209-a986-4d16548ffc95 on n-h1-858384-19 Nov 02 13:18:46.234817 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-66491a1d-077b-4aec-ab79-dc15da73deec req-d89bc780-2fef-41c5-8b98-2f2852654e22 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134275 Nov 02 13:18:46.235906 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 852/1619] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:46.239306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:46.240125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:46.247064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.247620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.248061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.248757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.249374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.249937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.324515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:46.334030 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eee259d4-f5d9-4fc0-bc28-8ad0e4332c2c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1275 microversion: 2.1 time: 0.099838 Nov 02 13:18:46.334971 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 768/1620] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:46 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:46.373611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:46.375088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:46.384879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.386375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.386984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.388998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.389878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.390502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.531574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:46.547563 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e4d87b41-d22c-424f-968c-331a3b8b8360 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 200 len: 1436 microversion: 2.1 time: 0.181871 Nov 02 13:18:46.549948 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 853/1621] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:46 2022] GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 1436 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:46.697973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:46.698606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:46.711758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.712550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.713784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.714706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.715812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.716487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.864895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:46.865562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:46.883036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.884018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.884645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:46.885740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:46.887206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:46.888138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:47.048678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:47.053664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:47.065625 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c4a6ff6e-6fb6-4c66-9836-6a8742d51fb4 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1473 microversion: 2.1 time: 0.371737 Nov 02 13:18:47.066422 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3079f530-5742-4f9d-87c3-31d7bba851d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.203734 Nov 02 13:18:47.067499 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 854/1622] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:46 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:47.072331 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 769/1623] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:46 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1473 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:47.357955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:47.358827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:47.366733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:47.367588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:47.368196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:47.369317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:47.369777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:47.371707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:47.528617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:47.542690 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c965747a-0f31-404d-b90a-100de1fc1caa tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1317 microversion: 2.1 time: 0.188239 Nov 02 13:18:47.560656 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 855/1624] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:47 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:47.576857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:47.577494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:47.584807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:47.585686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:47.586295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:47.587210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:47.587832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:47.588423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:47.632487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:47.633397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:47.634000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:47.635370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid c58e31fc-dbb3-440f-a950-6759a10dbee4 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:47.724003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:47.732876 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49b9a84f-2b5c-44ca-8f20-a2a4a5994205 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 200 len: 1313 microversion: 2.1 time: 0.159886 Nov 02 13:18:47.733475 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 770/1625] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:47 2022] GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:48.089940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:48.090505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:48.090648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:48.091251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:48.098716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.098915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.099170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.099654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.099838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.100101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.100745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.101062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.101192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.101525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.101642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.101954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.179412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:48.187580 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c53d050b-3288-4dbc-95fd-96418fc9f3fc tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1431 microversion: 2.1 time: 0.101353 Nov 02 13:18:48.188193 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 856/1626] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:48 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1431 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:48.365229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-4a0e4c99-d33b-4653-8c2f-dc56dfdd3b43 req-bc07f9b8-5089-4ad5-9c73-c8267c22bb26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e5b238-3258-4e2d-ba0e-01268713299a", "name": "network-vif-deleted", "tag": "bdbac33f-c52c-4822-983e-75fc66196e13"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:48.384535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4a0e4c99-d33b-4653-8c2f-dc56dfdd3b43 req-bc07f9b8-5089-4ad5-9c73-c8267c22bb26 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.385349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4a0e4c99-d33b-4653-8c2f-dc56dfdd3b43 req-bc07f9b8-5089-4ad5-9c73-c8267c22bb26 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.386005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4a0e4c99-d33b-4653-8c2f-dc56dfdd3b43 req-bc07f9b8-5089-4ad5-9c73-c8267c22bb26 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.401039 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-4a0e4c99-d33b-4653-8c2f-dc56dfdd3b43 req-bc07f9b8-5089-4ad5-9c73-c8267c22bb26 service nova] Creating event network-vif-deleted:bdbac33f-c52c-4822-983e-75fc66196e13 for instance d8e5b238-3258-4e2d-ba0e-01268713299a on n-h1-858384-19 Nov 02 13:18:48.412360 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-4a0e4c99-d33b-4653-8c2f-dc56dfdd3b43 req-bc07f9b8-5089-4ad5-9c73-c8267c22bb26 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054872 Nov 02 13:18:48.414371 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 857/1627] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:48.486983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:48.495739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad3eb000-57ea-4da6-8f93-57f9f06e69cf tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.409383 Nov 02 13:18:48.512943 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 771/1628] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:48 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:48.571427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:48.572129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:48.579989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.580761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.581208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.582012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.582385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.583044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.745718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:48.754727 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-db4c1f10-fdd0-4b53-a744-2d551a33a499 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1338 microversion: 2.1 time: 0.187506 Nov 02 13:18:48.755371 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 858/1629] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:48 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1338 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:48.759785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:48.760405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: c58e31fc-dbb3-440f-a950-6759a10dbee4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:48.768535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.768866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.769540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.770270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.770729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.771171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.786868 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] HTTP exception thrown: Instance c58e31fc-dbb3-440f-a950-6759a10dbee4 could not be found. Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Request method failure captured: Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 HTTP/1.1 Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1XAqZc6Mlu35sSVyjpBE0eQ1odky3stto0epk6-PKbBRlt677a543F2dVM18A7a4rX2o0s-tJoxHEV4Jfl3Qic_sHInQ1J59_eDJ2R8CGQI4DkFNzKTbCuyDIvim1IOofAIMbkOhBH0nkYl4e5PkNPRDGPR6L3ngg7K8qpcNfHsUE Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:18:48.788581 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: cddc6a408b8143999f80691c3234e6a4 Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance c58e31fc-dbb3-440f-a950-6759a10dbee4 could not be found. Nov 02 13:18:48.790263 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'c58e31fc-dbb3-440f-a950-6759a10dbee4'} Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c58e31fc-dbb3-440f-a950-6759a10dbee4 could not be found. Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:48.791221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c58e31fc-dbb3-440f-a950-6759a10dbee4 could not be found. Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c58e31fc-dbb3-440f-a950-6759a10dbee4 could not be found. Nov 02 13:18:48.792505 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:48.793639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Returning 404 to user: Instance c58e31fc-dbb3-440f-a950-6759a10dbee4 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:48.793639 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7b059152-04b7-44eb-a9dd-b293f1c52c71 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4" status: 404 len: 111 microversion: 2.1 time: 0.034207 Nov 02 13:18:48.793978 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 772/1630] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:48 2022] GET /compute/v2.1/servers/c58e31fc-dbb3-440f-a950-6759a10dbee4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:18:48.799431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:48.800075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:48.806366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.806859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.807338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.808049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.808496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.808916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.843462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:48.843943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:48.844380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:48.844823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid e913dade-1692-4209-a986-4d16548ffc95 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:48.889597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:48.906754 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bd5bf273-7fa3-4017-9505-ceb67b52cbfa tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 200 len: 1313 microversion: 2.1 time: 0.111532 Nov 02 13:18:48.909186 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 859/1631] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:48 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 1313 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:49.210939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:49.211879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:49.221059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.222531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.223255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.225863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.227405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.229608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.276669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.277493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.278011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.278546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lazy-loading 'fault' on Instance uuid d8e5b238-3258-4e2d-ba0e-01268713299a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:49.352262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-546012e4-0020-4175-aa57-888c1b75737c req-26a9750b-5dab-4f16-916b-379e9fc72638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49", "name": "network-vif-plugged", "status": "completed", "tag": "abaa7e07-a933-4415-be82-70f57348ba75"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:49.358223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbdcd46f460e455d926fcc6127f4f94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee640ec7f0fd4d7a96969792712a4298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:49.370349 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a8847727-45b3-40be-bca2-af93764f50d8 tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 200 len: 1308 microversion: 2.1 time: 0.163415 Nov 02 13:18:49.370759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-546012e4-0020-4175-aa57-888c1b75737c req-26a9750b-5dab-4f16-916b-379e9fc72638 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.371306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-546012e4-0020-4175-aa57-888c1b75737c req-26a9750b-5dab-4f16-916b-379e9fc72638 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.371958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-546012e4-0020-4175-aa57-888c1b75737c req-26a9750b-5dab-4f16-916b-379e9fc72638 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.383951 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 773/1632] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:49 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:49.387473 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-546012e4-0020-4175-aa57-888c1b75737c req-26a9750b-5dab-4f16-916b-379e9fc72638 service nova] Creating event network-vif-plugged:abaa7e07-a933-4415-be82-70f57348ba75 for instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 on n-h2-858384-19 Nov 02 13:18:49.393778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-546012e4-0020-4175-aa57-888c1b75737c req-26a9750b-5dab-4f16-916b-379e9fc72638 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045131 Nov 02 13:18:49.394919 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 860/1633] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:49.524506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:49.525224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:49.536748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.537516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.538049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.538838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.539848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.540134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.778904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:49.780470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:49.787606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.788087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.788525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.789234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.789688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.790114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.906763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:49.916745 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c90696b-aee8-4441-a49e-3f2709bfddde tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.396236 Nov 02 13:18:49.917575 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 774/1634] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:49 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:49.934291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:49.935332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: e913dade-1692-4209-a986-4d16548ffc95] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:49.943057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.943588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.944032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.944748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:49.945424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:49.946734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:49.948725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:49.957260 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1011395-44e3-4bb2-bd6b-8801894e40fb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.182667 Nov 02 13:18:49.957958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 861/1635] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:49 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:49.963249 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] HTTP exception thrown: Instance e913dade-1692-4209-a986-4d16548ffc95 could not be found. Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Request method failure captured: Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 HTTP/1.1 Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1XAqZc6Mlu35sSVyjpBE0eQ1odky3stto0epk6-PKbBRlt677a543F2dVM18A7a4rX2o0s-tJoxHEV4Jfl3Qic_sHInQ1J59_eDJ2R8CGQI4DkFNzKTbCuyDIvim1IOofAIMbkOhBH0nkYl4e5PkNPRDGPR6L3ngg7K8qpcNfHsUE Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:18:49.964853 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: cddc6a408b8143999f80691c3234e6a4 Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance e913dade-1692-4209-a986-4d16548ffc95 could not be found. Nov 02 13:18:49.966200 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e913dade-1692-4209-a986-4d16548ffc95'} Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e913dade-1692-4209-a986-4d16548ffc95 could not be found. Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:49.967005 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e913dade-1692-4209-a986-4d16548ffc95 could not be found. Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e913dade-1692-4209-a986-4d16548ffc95 could not be found. Nov 02 13:18:49.968845 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:49.971390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Returning 404 to user: Instance e913dade-1692-4209-a986-4d16548ffc95 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:49.971390 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90842fa7-4985-418a-b7f8-6a1cf1c4e050 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95" status: 404 len: 111 microversion: 2.1 time: 0.037989 Nov 02 13:18:49.971390 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 775/1636] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:49 2022] GET /compute/v2.1/servers/e913dade-1692-4209-a986-4d16548ffc95 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:18:49.977693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-85ee3431-536f-48bd-8dbe-e616a5eb6e67 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:49.979864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:50.013895 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-85ee3431-536f-48bd-8dbe-e616a5eb6e67 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/95b78563-8c8c-4291-860a-88720e62eaeb" status: 204 len: 0 microversion: 2.1 time: 0.039989 Nov 02 13:18:50.014508 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 862/1637] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:18:49 2022] DELETE /compute/v2.1/os-server-groups/95b78563-8c8c-4291-860a-88720e62eaeb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:50.023659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:50.024427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:50.030714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.031469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.031924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.033276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.033850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.034261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.061770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:18:50.147097 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e761bd01-cf32-483e-84a3-12be8359136d tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "DELETE /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 204 len: 0 microversion: 2.1 time: 0.127144 Nov 02 13:18:50.148127 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 776/1638] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:50 2022] DELETE /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:18:50.156463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:50.157147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:50.163830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.164439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.164989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.165666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.166123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.166738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.319859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:50.333393 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c2766b64-8445-4a17-9961-976674624227 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1476 microversion: 2.1 time: 0.180679 Nov 02 13:18:50.334407 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 863/1639] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:50 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1476 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:50.396688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:50.397426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] [instance: d8e5b238-3258-4e2d-ba0e-01268713299a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:50.399427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:50.406620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.407278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.407729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.408592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.409051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.409481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.426104 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] HTTP exception thrown: Instance d8e5b238-3258-4e2d-ba0e-01268713299a could not be found. Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Request method failure captured: Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a HTTP/1.1 Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm2GIGiWMODKa-uvsFIxoxKDFldZTmVO_cYuLc6WTaB-IO4tPDN0yVP1iP_cK9eeWtO2f55OguSqrUWkI3dvljapdsa6LJos-zbqCgwTcCJ8XvJo7NJ3LYnSRb15it5jixNOES3Mm5bmXRQ1D3UviOsxQZovu-ldcKAl-llcQelC1ec Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: ee640ec7f0fd4d7a96969792712a4298 Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersAdminTestJSON-2127548012 Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:18:50.427874 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/ee640ec7f0fd4d7a96969792712a4298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersAdminTestJSON-2127548012 Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: ee640ec7f0fd4d7a96969792712a4298 Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersAdminTestJSON-2127548012 Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersAdminTestJSON-2127548012-project Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: dbdcd46f460e455d926fcc6127f4f94f Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersAdminTestJSON-2127548012-project Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance d8e5b238-3258-4e2d-ba0e-01268713299a could not be found. Nov 02 13:18:50.430124 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd8e5b238-3258-4e2d-ba0e-01268713299a'} Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e5b238-3258-4e2d-ba0e-01268713299a could not be found. Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:50.431353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e5b238-3258-4e2d-ba0e-01268713299a could not be found. Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e5b238-3258-4e2d-ba0e-01268713299a could not be found. Nov 02 13:18:50.433353 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:18:50.435941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] Returning 404 to user: Instance d8e5b238-3258-4e2d-ba0e-01268713299a could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:50.435941 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d45a78b-c763-449d-9f95-439191893b7e tempest-ServersAdminTestJSON-2127548012 tempest-ServersAdminTestJSON-2127548012-project] 10.222.0.113 "GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a" status: 404 len: 111 microversion: 2.1 time: 0.037612 Nov 02 13:18:50.435941 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 777/1640] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:50 2022] GET /compute/v2.1/servers/d8e5b238-3258-4e2d-ba0e-01268713299a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:18:50.437008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3053b390-2a2a-4bee-9a04-aa8fc0fa51ba req-c9dfce6e-4ed1-4a8e-ac20-5bb15d63e428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "tag": "c04e1018-c9ce-44ff-b6bb-720682b18d5f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:50.453684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3053b390-2a2a-4bee-9a04-aa8fc0fa51ba req-c9dfce6e-4ed1-4a8e-ac20-5bb15d63e428 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.454470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3053b390-2a2a-4bee-9a04-aa8fc0fa51ba req-c9dfce6e-4ed1-4a8e-ac20-5bb15d63e428 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.455232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3053b390-2a2a-4bee-9a04-aa8fc0fa51ba req-c9dfce6e-4ed1-4a8e-ac20-5bb15d63e428 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.475081 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3053b390-2a2a-4bee-9a04-aa8fc0fa51ba req-c9dfce6e-4ed1-4a8e-ac20-5bb15d63e428 service nova] Creating event network-changed:c04e1018-c9ce-44ff-b6bb-720682b18d5f for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:18:50.482939 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3053b390-2a2a-4bee-9a04-aa8fc0fa51ba req-c9dfce6e-4ed1-4a8e-ac20-5bb15d63e428 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057929 Nov 02 13:18:50.484203 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 864/1641] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:18:50.945701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:50.952054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:50.963376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.963945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.964847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.965768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.966717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.967700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.981160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:50.981865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:50.990960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.991471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.991905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:50.992612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:50.993061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:50.995965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:51.186895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:51.195180 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0d7cd79b-c451-4a6d-bc73-1c1e73269536 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.218520 Nov 02 13:18:51.195904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 865/1642] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:50 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:51.299312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:51.311672 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba81974f-1dbd-46cb-bc58-2d350acdd489 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1383 microversion: 2.1 time: 0.370350 Nov 02 13:18:51.312852 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 778/1643] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:50 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1383 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:51.363414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:51.364433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:51.372198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:51.375563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:51.376738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:51.377903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:51.378593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:51.379034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:51.588641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:51.599253 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9294f50c-83d9-4aac-b5d4-f4ee03cbe9ab tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1476 microversion: 2.1 time: 0.242627 Nov 02 13:18:51.600297 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 866/1644] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:51 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:52.222865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:52.224271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:52.231409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.231900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.232344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.233059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.233714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.234160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.261583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:52.347913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:52.348530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:52.354867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.355393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.356023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.356921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.357387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.357819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.520877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:52.524222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:52.542664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:52.546087 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cbc5ab35-eca2-4050-b2f2-ded42cff7425 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1532 microversion: 2.1 time: 0.204194 Nov 02 13:18:52.561068 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 867/1645] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:52 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1532 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:52.568743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-54a7ba26-ded3-427a-80b0-cee2ecb9cc0b req-815e00cf-2305-4ba7-a05c-574d3fa52d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "tag": "6797473c-723b-4fa1-8ef1-261866f68154"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:52.582840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-54a7ba26-ded3-427a-80b0-cee2ecb9cc0b req-815e00cf-2305-4ba7-a05c-574d3fa52d6e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.583392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-54a7ba26-ded3-427a-80b0-cee2ecb9cc0b req-815e00cf-2305-4ba7-a05c-574d3fa52d6e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.583820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-54a7ba26-ded3-427a-80b0-cee2ecb9cc0b req-815e00cf-2305-4ba7-a05c-574d3fa52d6e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.597158 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-54a7ba26-ded3-427a-80b0-cee2ecb9cc0b req-815e00cf-2305-4ba7-a05c-574d3fa52d6e service nova] Creating event network-changed:6797473c-723b-4fa1-8ef1-261866f68154 for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:18:52.602402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-54a7ba26-ded3-427a-80b0-cee2ecb9cc0b req-815e00cf-2305-4ba7-a05c-574d3fa52d6e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040467 Nov 02 13:18:52.603570 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 868/1646] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:52.612691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:52.613137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:52.624228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.624789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.625353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.626303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.626963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.627440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.705157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:52.722308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:52.731812 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3cc69d95-5271-4ff9-a713-ab88a4fbf268 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.514506 Nov 02 13:18:52.733569 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 779/1647] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:52 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:52.740958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:52.740958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:52.757720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.759900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.759900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.760732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:52.761177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:52.761715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:52.852919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:52.856202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:52.864303 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bac1016d-c71e-4d65-97fa-237d2c3eb5e2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1532 microversion: 2.1 time: 0.259545 Nov 02 13:18:52.880065 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 869/1648] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:52 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1532 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:52.897810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8eeec65d-1c06-4c74-98c7-6430ea03941f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:52.927059 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8eeec65d-1c06-4c74-98c7-6430ea03941f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/eab6f2b4-4688-4663-9388-5ef7fcdc736f" status: 202 len: 0 microversion: 2.1 time: 0.041293 Nov 02 13:18:52.928025 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 870/1649] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:18:52 2022] DELETE /compute/v2.1/flavors/eab6f2b4-4688-4663-9388-5ef7fcdc736f => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:18:52.939357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd460afb-b47d-4f1a-bde3-ee21842d5977 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:52.973758 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd460afb-b47d-4f1a-bde3-ee21842d5977 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5853 microversion: 2.1 time: 0.039133 Nov 02 13:18:52.989120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 871/1650] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:18:52 2022] GET /compute/v2.1/flavors/detail => generated 5853 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:53.009549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:53.012060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:53.019724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.020237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.020770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:53.021599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.022062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.022538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:53.180014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:53.193245 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3edf0401-1b13-40bc-ac4d-12adb31a00b6 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1476 microversion: 2.1 time: 0.458129 Nov 02 13:18:53.194644 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 780/1651] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:52 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1476 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:53.396865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6ca2650a-8afc-4491-998a-e98602c198dd tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:53.398370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6ca2650a-8afc-4491-998a-e98602c198dd tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:53.409235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ca2650a-8afc-4491-998a-e98602c198dd tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.410746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ca2650a-8afc-4491-998a-e98602c198dd tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.411806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ca2650a-8afc-4491-998a-e98602c198dd tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:53.412795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ca2650a-8afc-4491-998a-e98602c198dd tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.415882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ca2650a-8afc-4491-998a-e98602c198dd tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.416721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ca2650a-8afc-4491-998a-e98602c198dd tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:53.485113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:53.503803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Old instance type tempest-test_resize_flavor_-18839667, new instance type m1.heat {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 13:18:53.516185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:18:53.517048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:18:53.517738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:18:53.518365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:18:53.519089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:18:53.710024 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-970be361-d00b-4804-b1bb-c6b346c32966 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49/action" status: 202 len: 0 microversion: 2.1 time: 0.715068 Nov 02 13:18:53.710657 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 872/1652] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:18:52 2022] POST /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:18:53.728224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:53.732701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:53.755450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.757105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.757918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:53.758872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:53.759477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:53.760173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.084904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:54.085738 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6ca2650a-8afc-4491-998a-e98602c198dd tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1817 microversion: 2.1 time: 0.694671 Nov 02 13:18:54.086342 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 781/1653] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:53 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1817 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:54.093918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:54.094819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:54.101169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.101877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.102509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.113622 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15736828-be45-43a5-a469-0056e972307f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1541 microversion: 2.1 time: 0.397883 Nov 02 13:18:54.117481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.118124 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 873/1654] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:53 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1541 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:54.118894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.119428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.132132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a42969e3-c344-4796-95b1-66bf89693cb9 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:54.161812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42969e3-c344-4796-95b1-66bf89693cb9 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.164213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42969e3-c344-4796-95b1-66bf89693cb9 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.165419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42969e3-c344-4796-95b1-66bf89693cb9 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.166775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42969e3-c344-4796-95b1-66bf89693cb9 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.168287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42969e3-c344-4796-95b1-66bf89693cb9 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.168925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42969e3-c344-4796-95b1-66bf89693cb9 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.242772 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a42969e3-c344-4796-95b1-66bf89693cb9 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.120916 Nov 02 13:18:54.244655 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 874/1655] 10.222.0.113 () {58 vars in 1181 bytes} [Wed Nov 2 13:18:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:54.250239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:54.250864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:54.278786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.279327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.282328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.285076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.285639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.286152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.388680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.389190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.389630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.390091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lazy-loading 'fault' on Instance uuid 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:54.597169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cddc6a408b8143999f80691c3234e6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7be3a8c61da4ee7aa4d1b500f5e9cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:54.613082 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59016a87-17bf-4345-9131-0da7437f7320 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 200 len: 1310 microversion: 2.1 time: 0.361777 Nov 02 13:18:54.613687 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 875/1656] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:54 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 1310 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:54.623323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:54.633687 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-69830e33-9f74-4289-a424-afc225c37dee tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.546315 Nov 02 13:18:54.639137 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 782/1657] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:54 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:54.660190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f1a15954-eb0a-4693-9ad3-7ea0df854b66 req-0d6bacfb-1778-4031-a1e7-c420f19b8fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd2a3ab-5b0a-47ad-8467-33b0414c55e1", "name": "network-vif-deleted", "tag": "2d1f66ee-e441-44c4-a485-ad6f31eded50"}, {"name": "network-changed", "server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "tag": "5ca88a21-96c7-42b4-8541-d011a43f174d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:54.671088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f1a15954-eb0a-4693-9ad3-7ea0df854b66 req-0d6bacfb-1778-4031-a1e7-c420f19b8fd4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:54.671777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f1a15954-eb0a-4693-9ad3-7ea0df854b66 req-0d6bacfb-1778-4031-a1e7-c420f19b8fd4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:54.672219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f1a15954-eb0a-4693-9ad3-7ea0df854b66 req-0d6bacfb-1778-4031-a1e7-c420f19b8fd4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:54.702263 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f1a15954-eb0a-4693-9ad3-7ea0df854b66 req-0d6bacfb-1778-4031-a1e7-c420f19b8fd4 service nova] Creating event network-vif-deleted:2d1f66ee-e441-44c4-a485-ad6f31eded50 for instance 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 on n-h1-858384-19 Nov 02 13:18:54.703017 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f1a15954-eb0a-4693-9ad3-7ea0df854b66 req-0d6bacfb-1778-4031-a1e7-c420f19b8fd4 service nova] Creating event network-changed:5ca88a21-96c7-42b4-8541-d011a43f174d for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:18:54.715428 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f1a15954-eb0a-4693-9ad3-7ea0df854b66 req-0d6bacfb-1778-4031-a1e7-c420f19b8fd4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058955 Nov 02 13:18:54.721410 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 876/1658] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:55.148368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:55.150652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:55.182585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.186723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.188558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.193760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.195720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.197220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.643634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:55.644409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] [instance: 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:55.653654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.655483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.661837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.663908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.666280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.667590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.713492 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] HTTP exception thrown: Instance 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 could not be found. Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Request method failure captured: Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 HTTP/1.1 Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1XAqZc6Mlu35sSVyjpBE0eQ1odky3stto0epk6-PKbBRlt677a543F2dVM18A7a4rX2o0s-tJoxHEV4Jfl3Qic_sHInQ1J59_eDJ2R8CGQI4DkFNzKTbCuyDIvim1IOofAIMbkOhBH0nkYl4e5PkNPRDGPR6L3ngg7K8qpcNfHsUE Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:18:55.717624 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c7be3a8c61da4ee7aa4d1b500f5e9cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c7be3a8c61da4ee7aa4d1b500f5e9cec Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1907214612 Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: cddc6a408b8143999f80691c3234e6a4 Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersOnMultiNodesTest-1907214612-project Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 could not be found. Nov 02 13:18:55.719927 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '8cd2a3ab-5b0a-47ad-8467-33b0414c55e1'} Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 could not be found. Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:55.721040 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 could not be found. Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 could not be found. Nov 02 13:18:55.722663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:18:55.727499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] Returning 404 to user: Instance 8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:55.728750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-003ccc1e-a4a2-4fae-bd98-25e8efd396d2 tempest-ServersOnMultiNodesTest-1907214612 tempest-ServersOnMultiNodesTest-1907214612-project] 10.222.0.113 "GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1" status: 404 len: 111 microversion: 2.1 time: 0.092680 Nov 02 13:18:55.729306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:55.734636 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 877/1659] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:55 2022] GET /compute/v2.1/servers/8cd2a3ab-5b0a-47ad-8467-33b0414c55e1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:18:55.743136 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d1c87817-8b68-4be6-8541-9a2c61d5708c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1541 microversion: 2.1 time: 0.603305 Nov 02 13:18:55.746412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:55.746753 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 783/1660] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:55 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1541 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:55.748300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:55.760703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.761497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.762115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.763057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.763526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:55.764139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:55.764563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.765019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.777922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.778414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.782005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:55.787669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:55.788384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:55.788982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:56.274437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 7ed1faa6-e6ad-4757-992d-0750ae29a307 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:18:56.291431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-780eb920-ad40-4945-aba2-9f4f1a231391 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 2351 microversion: 2.25 time: 0.531489 Nov 02 13:18:56.293151 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 784/1661] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:18:55 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 2351 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:18:56.322931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e41acc9c-5686-4b58-a081-69a0ac9343fe tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:56.326750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:56.328066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41acc9c-5686-4b58-a081-69a0ac9343fe tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:56.330570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41acc9c-5686-4b58-a081-69a0ac9343fe tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:56.331137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41acc9c-5686-4b58-a081-69a0ac9343fe tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:56.332043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41acc9c-5686-4b58-a081-69a0ac9343fe tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:56.336345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41acc9c-5686-4b58-a081-69a0ac9343fe tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:56.337047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41acc9c-5686-4b58-a081-69a0ac9343fe tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:56.342513 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75cf0c5d-8a0f-4c08-a0f1-2dc1f43da538 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.596920 Nov 02 13:18:56.344509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 878/1662] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:55 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:56.368278 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e41acc9c-5686-4b58-a081-69a0ac9343fe tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.049386 Nov 02 13:18:56.370795 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 785/1663] 10.222.0.113 () {60 vars in 1222 bytes} [Wed Nov 2 13:18:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:18:56.773583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:56.774370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:56.784792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:56.785442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:56.793752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:56.796156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:56.799258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:56.800048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:57.277026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:57.293992 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3b30f03a-dedb-4d6a-bbd1-77e670410c76 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1541 microversion: 2.1 time: 0.525990 Nov 02 13:18:57.319158 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 879/1664] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:56 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1541 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:57.369072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:57.369712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:57.388300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:57.388836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:57.393043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:57.394228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:57.394720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:57.403204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:57.992535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:58.005425 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-661efd60-9fe4-417a-b4f6-8186d82ceae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.641775 Nov 02 13:18:58.022828 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 786/1665] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:57 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:58.319401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:58.320191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:58.332122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:58.332777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:58.333410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:58.334430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:58.335216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:58.335931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:58.933637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c353255-9ab9-4c93-8087-4bf28782973a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a37a2cf-a744-41f4-b4fc-8c9b038f0a17", "device": "/dev/xvdb"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:58.938586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c353255-9ab9-4c93-8087-4bf28782973a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:58.946907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c353255-9ab9-4c93-8087-4bf28782973a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:58.950913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:58.955831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c353255-9ab9-4c93-8087-4bf28782973a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:58.962681 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f39a793b-9291-4959-a751-be7da55824a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1541 microversion: 2.1 time: 0.648317 Nov 02 13:18:58.963735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c353255-9ab9-4c93-8087-4bf28782973a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:58.964945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c353255-9ab9-4c93-8087-4bf28782973a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:58.965912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c353255-9ab9-4c93-8087-4bf28782973a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:58.966804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c353255-9ab9-4c93-8087-4bf28782973a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:58.994601 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 880/1666] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:58 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1541 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:18:59.029276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:59.029922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:59.043141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:59.043680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:59.044120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:59.044844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:59.046670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:59.047132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:59.353443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:18:59.370558 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed78683d-60fc-4049-80ae-edd145910a1d tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.343061 Nov 02 13:18:59.372470 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 881/1667] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:18:59 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:18:59.390134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f6fe4a0-56ae-45d3-a38d-c8c3c26cf7ed tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55359b37-94d7-4c48-9969-646bd59bfc09", "device": "/dev/xvdb"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:59.396630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f6fe4a0-56ae-45d3-a38d-c8c3c26cf7ed tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:18:59.410253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6fe4a0-56ae-45d3-a38d-c8c3c26cf7ed tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:59.411041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6fe4a0-56ae-45d3-a38d-c8c3c26cf7ed tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:59.412557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6fe4a0-56ae-45d3-a38d-c8c3c26cf7ed tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:18:59.413514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6fe4a0-56ae-45d3-a38d-c8c3c26cf7ed tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:18:59.414194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6fe4a0-56ae-45d3-a38d-c8c3c26cf7ed tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:18:59.414846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6fe4a0-56ae-45d3-a38d-c8c3c26cf7ed tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:01.800801 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5f6fe4a0-56ae-45d3-a38d-c8c3c26cf7ed tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "POST /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 2.426508 Nov 02 13:19:01.814003 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 882/1668] 10.222.0.113 () {62 vars in 1369 bytes} [Wed Nov 2 13:18:59 2022] POST /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 194 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:19:01.819917 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c353255-9ab9-4c93-8087-4bf28782973a tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "POST /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.881200 Nov 02 13:19:01.826640 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 787/1669] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:18:58 2022] POST /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 194 bytes in 2898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:01.834621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:01.838198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:01.856700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:01.858032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:01.858924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:01.859994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:01.862101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:01.862764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:01.867186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:01.872204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:01.913940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:01.914991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:01.917784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:01.918766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:01.921102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:01.923153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:02.173976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:02.182859 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c07fd5e-3e7a-4701-b7d8-533e6364441f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1541 microversion: 2.1 time: 0.364425 Nov 02 13:19:02.183486 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 883/1670] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:01 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1541 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:02.331673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df683796-560e-4ce5-b032-dd62c284b12d tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Action: 'create', calling method: .version_select at 0x7fe786e45f70>, body: {"pool": null} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:02.422478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:02.450469 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d71f9e03-46b3-4e03-819b-ce48f94c467c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.617615 Nov 02 13:19:02.453183 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 788/1671] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:01 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:03.209835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:03.210612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:03.232334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:03.235894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:03.245074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:03.246163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:03.247376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:03.247901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:03.700123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:03.728628 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bcc9898f-608a-4ac0-a0c9-95391fbea187 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.523638 Nov 02 13:19:03.729633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 789/1672] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:03 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:03.747702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:03.748744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:03.773024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:03.777269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:03.785665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:03.787134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:03.788160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:03.789084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:04.192166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:04.197706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:04.222110 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-46af8eec-9cee-4841-b731-79e157f36390 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.491140 Nov 02 13:19:04.222752 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 790/1673] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:03 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:04.496972 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df683796-560e-4ce5-b032-dd62c284b12d tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.312122 Nov 02 13:19:04.497575 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 884/1674] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:19:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:04.513853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0377731d-86ff-4811-8b4c-39f1058860f1 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Calling method '.version_select at 0x7fe78fa86280>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:04.765392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:04.767309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:04.775945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:04.776762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:04.777414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:04.778835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:04.780211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:04.780950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:05.019675 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0377731d-86ff-4811-8b4c-39f1058860f1 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] 10.222.0.113 "GET /compute/v2.1/os-floating-ips/73383cb0-708c-4f9d-86a7-68da6374e24d" status: 200 len: 142 microversion: 2.1 time: 0.511886 Nov 02 13:19:05.020578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 791/1675] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:19:04 2022] GET /compute/v2.1/os-floating-ips/73383cb0-708c-4f9d-86a7-68da6374e24d => generated 142 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:05.033656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6a0eacf-690d-4914-98ec-8a19022cf0a8 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Calling method '.version_select at 0x7fe78fa929d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:05.072714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:05.085606 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0e1ef319-fac2-4a86-b066-441ea6ef0fd3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.327699 Nov 02 13:19:05.087361 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 885/1676] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:04 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:05.245504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:05.248013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:05.263495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:05.263959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:05.267989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:05.268959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:05.269448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:05.269891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:05.651429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:05.662620 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6d94277-46bf-478e-9408-d1a25b5cbb75 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.421575 Nov 02 13:19:05.663766 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 886/1677] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:05 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:05.713504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6a0eacf-690d-4914-98ec-8a19022cf0a8 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] 10.222.0.113 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.684442 Nov 02 13:19:05.714558 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 792/1678] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:19:05 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:05.730032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a5396699-ea25-41a0-bfc4-e2619fa46be3 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Calling method '.version_select at 0x7fe786e57280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:06.109868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:06.110999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:06.121684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.122196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.129432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:06.132547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.133218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.133878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:06.350646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:06.435107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:06.445748 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0682e26a-2d34-4592-9940-5b3b6e1855d1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.339416 Nov 02 13:19:06.466180 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 793/1679] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:06 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:06.694097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:06.694765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:06.707013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.707563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.708015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:06.708742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:06.709215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:06.709648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:07.038981 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a5396699-ea25-41a0-bfc4-e2619fa46be3 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/73383cb0-708c-4f9d-86a7-68da6374e24d" status: 202 len: 0 microversion: 2.1 time: 1.314553 Nov 02 13:19:07.040768 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 887/1680] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:19:05 2022] DELETE /compute/v2.1/os-floating-ips/73383cb0-708c-4f9d-86a7-68da6374e24d => generated 0 bytes in 1317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:19:07.051906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01d43d59-2731-4b6d-8d2d-ad8ff19ef21a tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Action: 'create', calling method: .version_select at 0x7fe786e6f9d0>, body: {"pool": null} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:07.126983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:07.139349 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16465f26-6266-441c-94b8-a869680fdecf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.451200 Nov 02 13:19:07.149142 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 794/1681] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:06 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:07.470946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:07.471947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:07.484835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:07.487908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:07.488681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:07.490104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:07.491819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:07.493355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:08.004716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:08.018249 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d14ad99-7ef7-497c-8b6b-11251d4137a4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.552157 Nov 02 13:19:08.018926 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 795/1682] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:07 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:08.165584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:08.166295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:08.175523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:08.176031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:08.176480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:08.177215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:08.177677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:08.178108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:08.534354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:08.544349 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cdf9f324-258b-448d-99e8-8f9e58603f31 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.382585 Nov 02 13:19:08.544938 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 796/1683] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:08 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:08.907771 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01d43d59-2731-4b6d-8d2d-ad8ff19ef21a tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.860699 Nov 02 13:19:08.910448 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 888/1684] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:19:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:08.921362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8564d3a1-dd14-4952-97e6-6bb066bb539e tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Calling method '.version_select at 0x7fe786e6f790>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:08.954755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1864664758", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "fe1f4dee-9fc9-4df4-a781-6fab6083d12c"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:09.017400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] validate_networks() for [('fe1f4dee-9fc9-4df4-a781-6fab6083d12c', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:19:09.826425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:19:09.827024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:19:09.827563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:19:09.828076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:19:09.828612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:19:09.848785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:09.849706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:09.850354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:09.851471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:09.852546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:09.853144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:09.869009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:09.883859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Getting quotas for project edef03bc68bb49968039c234cfd5a556. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:19:09.899996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Getting quotas for user 4ae60e4432e446cfb7b96b2a647c7161 and project edef03bc68bb49968039c234cfd5a556. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:19:09.919525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:19:09.928023 n-d-858384-19 devstack@n-api.service[120929]: WARNING nova.utils [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1864664758 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-186466475 Nov 02 13:19:09.930619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:19:09.998525 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-86932cf1-f1c0-4fae-b431-e57c91487d32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.128046 Nov 02 13:19:09.999825 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 797/1685] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:19:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:19:10.005948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:10.013751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:10.035333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:10.036119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:10.036734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:10.037506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:10.037971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:10.038396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:10.084868 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8564d3a1-dd14-4952-97e6-6bb066bb539e tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/f16faaa7-3b02-4646-b4c3-81c8af11b668" status: 202 len: 0 microversion: 2.1 time: 1.167584 Nov 02 13:19:10.086881 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 889/1686] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:19:08 2022] DELETE /compute/v2.1/os-floating-ips/f16faaa7-3b02-4646-b4c3-81c8af11b668 => generated 0 bytes in 1170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:19:10.092476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:10.093370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:10.109335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:10.111170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:10.111965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:10.113798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:10.114587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:10.115229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:10.285014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:10.300263 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-381a6732-1bd6-4794-8753-18086bd0e8b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.298895 Nov 02 13:19:10.315527 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 798/1687] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:09 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:10.322065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64793dca-e7ce-480c-be50-f44eaf807328 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:10.322688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-64793dca-e7ce-480c-be50-f44eaf807328 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:10.416419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-64793dca-e7ce-480c-be50-f44eaf807328 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:10.426448 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-64793dca-e7ce-480c-be50-f44eaf807328 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1236 microversion: 2.1 time: 0.109694 Nov 02 13:19:10.431568 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 799/1688] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:10 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:10.437086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:10.437885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63a1abab-18a9-444c-ae94-8850182ef5f9 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Calling method '.version_select at 0x7fe78fa6e940>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:10.452587 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17b2e347-f0ee-4fce-a0a0-b2fbc1fea4c2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.363586 Nov 02 13:19:10.454883 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 890/1689] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:10 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:10.507997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG neutronclient.v2_0.client [None req-63a1abab-18a9-444c-ae94-8850182ef5f9 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f16faaa7-3b02-4646-b4c3-81c8af11b668 could not be found", "detail": ""}} {{(pid=120929) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:19:10.508703 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-63a1abab-18a9-444c-ae94-8850182ef5f9 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] HTTP exception thrown: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63a1abab-18a9-444c-ae94-8850182ef5f9 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Request method failure captured: Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-floating-ips/f16faaa7-3b02-4646-b4c3-81c8af11b668 HTTP/1.1 Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm5EI4C8850lbIm7MLxkZoSTv52SzzUC-S7E8joh09gK4LP4Mp1vQAtmpITrNSrAzqwsZrpPPRjcWBO8SpRQ10bYMW0uwfyuUZW8OSpkwCmQHWbNXNRrRGyMuUhNWJM81njt7ua0t_4LTqE44qtYkq1GMG4GgWAMFyQ4RdbFc4Tr4NM Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: ea4041c453154c8bbc03f5098a44da73 Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FloatingIPsTestJSON-635215178 Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:10.512705 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ea4041c453154c8bbc03f5098a44da73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ea4041c453154c8bbc03f5098a44da73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_ea4041c453154c8bbc03f5098a44da73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/ea4041c453154c8bbc03f5098a44da73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FloatingIPsTestJSON-635215178 Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: ea4041c453154c8bbc03f5098a44da73 Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FloatingIPsTestJSON-635215178 Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FloatingIPsTestJSON-635215178-project Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: fdd18fa778f24da5bafaa2eb39e4a56b Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FloatingIPsTestJSON-635215178-project Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: exception: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f16faaa7-3b02-4646-b4c3-81c8af11b668'} Nov 02 13:19:10.514251 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:19:10.515462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f16faaa7-3b02-4646-b4c3-81c8af11b668 could not be found Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c8f7f95-3cd3-4ae4-8b6e-8690044ea4f7'] Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668. Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:10.516933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:10.519040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:10.522917 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 Nov 02 13:19:10.522917 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.522917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63a1abab-18a9-444c-ae94-8850182ef5f9 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Returning 404 to user: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:10.522917 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63a1abab-18a9-444c-ae94-8850182ef5f9 tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] 10.222.0.113 "GET /compute/v2.1/os-floating-ips/f16faaa7-3b02-4646-b4c3-81c8af11b668" status: 404 len: 111 microversion: 2.1 time: 0.084451 Nov 02 13:19:10.522917 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 800/1690] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:19:10 2022] GET /compute/v2.1/os-floating-ips/f16faaa7-3b02-4646-b4c3-81c8af11b668 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:10.538042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d78de80-ed7f-46f4-958f-96384ff3b7bf tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Calling method '.version_select at 0x7fe786e564c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:10.601692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-3d78de80-ed7f-46f4-958f-96384ff3b7bf tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f16faaa7-3b02-4646-b4c3-81c8af11b668 could not be found", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:19:10.602721 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3d78de80-ed7f-46f4-958f-96384ff3b7bf tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] HTTP exception thrown: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d78de80-ed7f-46f4-958f-96384ff3b7bf tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Request method failure captured: Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-floating-ips/f16faaa7-3b02-4646-b4c3-81c8af11b668 HTTP/1.1 Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm5EI4C8850lbIm7MLxkZoSTv52SzzUC-S7E8joh09gK4LP4Mp1vQAtmpITrNSrAzqwsZrpPPRjcWBO8SpRQ10bYMW0uwfyuUZW8OSpkwCmQHWbNXNRrRGyMuUhNWJM81njt7ua0t_4LTqE44qtYkq1GMG4GgWAMFyQ4RdbFc4Tr4NM Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: ea4041c453154c8bbc03f5098a44da73 Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FloatingIPsTestJSON-635215178 Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:10.612045 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ea4041c453154c8bbc03f5098a44da73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/ea4041c453154c8bbc03f5098a44da73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_ea4041c453154c8bbc03f5098a44da73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/ea4041c453154c8bbc03f5098a44da73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FloatingIPsTestJSON-635215178 Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: ea4041c453154c8bbc03f5098a44da73 Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FloatingIPsTestJSON-635215178 Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FloatingIPsTestJSON-635215178-project Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: fdd18fa778f24da5bafaa2eb39e4a56b Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FloatingIPsTestJSON-635215178-project Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: exception: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f16faaa7-3b02-4646-b4c3-81c8af11b668'} Nov 02 13:19:10.614380 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:19:10.615544 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f16faaa7-3b02-4646-b4c3-81c8af11b668 could not be found Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe3c56c5-0056-4c54-b21a-1292f960dd3c'] Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668. Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:10.617166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:10.619034 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:10.620631 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 Nov 02 13:19:10.620631 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:10.624444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d78de80-ed7f-46f4-958f-96384ff3b7bf tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] Returning 404 to user: Floating IP not found for ID f16faaa7-3b02-4646-b4c3-81c8af11b668 {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:10.624444 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3d78de80-ed7f-46f4-958f-96384ff3b7bf tempest-FloatingIPsTestJSON-635215178 tempest-FloatingIPsTestJSON-635215178-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/f16faaa7-3b02-4646-b4c3-81c8af11b668" status: 404 len: 111 microversion: 2.1 time: 0.098903 Nov 02 13:19:10.624444 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 891/1691] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:19:10 2022] DELETE /compute/v2.1/os-floating-ips/f16faaa7-3b02-4646-b4c3-81c8af11b668 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:19:11.331222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:11.332453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:11.355985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.356576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.358609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.359686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.362820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.363500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.469055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:11.471313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:11.492799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.493296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.494004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.494722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.495203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.495634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.517018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:11.621504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:11.635495 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-46a847a5-4f29-47f3-a9af-4879626486f5 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1288 microversion: 2.1 time: 0.185761 Nov 02 13:19:11.636666 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 892/1692] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:11 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1288 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:11.650829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:11.651489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:11.667949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.669130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.669758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.671185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:11.674140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:11.679337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:11.692493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:11.702090 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cebc168b-828a-483e-a56c-07b8a000ffc1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.377588 Nov 02 13:19:11.702961 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 801/1693] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:11 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:11.930019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:11.944052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c254c929-78b1-4961-a233-950108369ad8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.306121 Nov 02 13:19:11.960654 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 893/1694] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:11 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:12.114482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c05a7cde-eb23-4b4f-a5e7-d473a2991228 req-0afc03d3-51d5-4ae0-af7a-85c9a161796f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "name": "network-vif-plugged", "status": "completed", "tag": "c04e1018-c9ce-44ff-b6bb-720682b18d5f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:12.134121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c05a7cde-eb23-4b4f-a5e7-d473a2991228 req-0afc03d3-51d5-4ae0-af7a-85c9a161796f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:12.135611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c05a7cde-eb23-4b4f-a5e7-d473a2991228 req-0afc03d3-51d5-4ae0-af7a-85c9a161796f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:12.136057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c05a7cde-eb23-4b4f-a5e7-d473a2991228 req-0afc03d3-51d5-4ae0-af7a-85c9a161796f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:12.167067 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c05a7cde-eb23-4b4f-a5e7-d473a2991228 req-0afc03d3-51d5-4ae0-af7a-85c9a161796f service nova] Creating event network-vif-plugged:c04e1018-c9ce-44ff-b6bb-720682b18d5f for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:19:12.187209 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c05a7cde-eb23-4b4f-a5e7-d473a2991228 req-0afc03d3-51d5-4ae0-af7a-85c9a161796f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206576 Nov 02 13:19:12.191831 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 802/1695] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:12.660354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:12.666054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:12.686937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:12.687543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:12.688043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:12.689179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:12.689622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:12.690131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:12.734820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:12.737858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:12.748937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:12.756560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:12.757621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:12.761961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:12.763433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:12.766595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:12.816588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:12.825546 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1ef87a54-fc69-405c-80f8-3120cebc0be1 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1294 microversion: 2.1 time: 0.169898 Nov 02 13:19:12.843661 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 894/1696] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:12 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1294 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:12.982145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:12.985136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:13.032577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:13.034613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:13.035489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:13.036482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:13.037148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:13.038539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:13.147934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:13.160358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8ab4fedf-2d75-42de-9bae-f67d5504d6b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.433390 Nov 02 13:19:13.175536 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 803/1697] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:12 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:13.314687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:13.338111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6eae07ae-e005-439d-9f8d-b1f67fda9a44 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.363770 Nov 02 13:19:13.353651 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 895/1698] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:12 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:13.855480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:13.857139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:13.874459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:13.875951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:13.877393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:13.878346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:13.878994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:13.879857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:14.193079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:14.195941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:14.210462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:14.211514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:14.212551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:14.213950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:14.215253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:14.216182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:14.256246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:14.267777 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c3304c20-0620-430f-a8b3-dec38ee79e28 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1336 microversion: 2.1 time: 0.416322 Nov 02 13:19:14.268391 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 804/1699] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:13 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1336 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:14.287101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1c7efcd6-24b9-4746-8594-baec8f18d961 req-81cc02e9-a1d5-4d32-baf8-df7b0fe603bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "name": "network-vif-plugged", "status": "completed", "tag": "5ca88a21-96c7-42b4-8541-d011a43f174d"}, {"server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "name": "network-vif-plugged", "status": "completed", "tag": "6797473c-723b-4fa1-8ef1-261866f68154"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:14.299483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1c7efcd6-24b9-4746-8594-baec8f18d961 req-81cc02e9-a1d5-4d32-baf8-df7b0fe603bb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:14.300804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1c7efcd6-24b9-4746-8594-baec8f18d961 req-81cc02e9-a1d5-4d32-baf8-df7b0fe603bb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:14.301488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1c7efcd6-24b9-4746-8594-baec8f18d961 req-81cc02e9-a1d5-4d32-baf8-df7b0fe603bb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:14.322456 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1c7efcd6-24b9-4746-8594-baec8f18d961 req-81cc02e9-a1d5-4d32-baf8-df7b0fe603bb service nova] Creating event network-vif-plugged:5ca88a21-96c7-42b4-8541-d011a43f174d for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:19:14.322994 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1c7efcd6-24b9-4746-8594-baec8f18d961 req-81cc02e9-a1d5-4d32-baf8-df7b0fe603bb service nova] Creating event network-vif-plugged:6797473c-723b-4fa1-8ef1-261866f68154 for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:19:14.337112 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1c7efcd6-24b9-4746-8594-baec8f18d961 req-81cc02e9-a1d5-4d32-baf8-df7b0fe603bb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060134 Nov 02 13:19:14.345390 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 805/1700] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:14.372024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:14.373236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:14.404366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:14.404920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:14.405368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:14.406100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:14.406558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:14.416721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:14.830105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:14.843469 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2be1e36f-bed8-4c36-b1e7-b9d52cf33b88 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.656559 Nov 02 13:19:14.843862 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 896/1701] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:14 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:15.295193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:15.296804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:15.311792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:15.330152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:15.332697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:15.334788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:15.336025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:15.337510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:15.667044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:15.688429 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5834594b-ce8a-4ab9-8588-0fef3b9d4b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1336 microversion: 2.1 time: 0.396999 Nov 02 13:19:15.690827 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 897/1702] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:15 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1336 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:15.704949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:15.716413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce21a962-39e8-4375-a432-a58b1f0131cb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 1.351875 Nov 02 13:19:15.717633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 806/1703] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:14 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:15.871863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:15.871863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:15.878500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:15.878986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:15.879453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:15.880185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:15.880636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:15.881062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:16.057548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:16.067204 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-24f0294d-45b8-46f2-83da-2e4a94abc21c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.200462 Nov 02 13:19:16.067802 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 898/1704] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:15 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:16.109136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-30e8a25a-a44f-4109-a217-9e414c0b3f12 req-1e270d65-edc6-4ccc-9b58-43e9ef4f1ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d52135d4-c308-473a-95c3-8e3493c11047", "tag": "ee5d0de9-60ad-4c8c-84f1-88f263565bc4"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:16.122087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-30e8a25a-a44f-4109-a217-9e414c0b3f12 req-1e270d65-edc6-4ccc-9b58-43e9ef4f1ca6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:16.122884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-30e8a25a-a44f-4109-a217-9e414c0b3f12 req-1e270d65-edc6-4ccc-9b58-43e9ef4f1ca6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:16.123637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-30e8a25a-a44f-4109-a217-9e414c0b3f12 req-1e270d65-edc6-4ccc-9b58-43e9ef4f1ca6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:16.136791 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-30e8a25a-a44f-4109-a217-9e414c0b3f12 req-1e270d65-edc6-4ccc-9b58-43e9ef4f1ca6 service nova] Creating event network-changed:ee5d0de9-60ad-4c8c-84f1-88f263565bc4 for instance d52135d4-c308-473a-95c3-8e3493c11047 on n-h1-858384-19 Nov 02 13:19:16.142121 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-30e8a25a-a44f-4109-a217-9e414c0b3f12 req-1e270d65-edc6-4ccc-9b58-43e9ef4f1ca6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036664 Nov 02 13:19:16.143240 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 807/1705] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:16.716030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:16.716548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:16.726469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:16.727462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:16.729649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:16.730585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:16.731342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:16.731990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:16.741258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:16.742076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:16.752252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:16.755016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:16.763275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:16.764254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:16.764798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:16.765313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:16.929261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:16.937216 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9acbff92-7235-4b2a-91ca-b4e3d8495a32 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1336 microversion: 2.1 time: 0.227067 Nov 02 13:19:16.937793 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 899/1706] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:16 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1336 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:16.966921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:16.976402 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-388568ce-4b0c-49e3-84a5-27698be69efb tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1359 microversion: 2.1 time: 0.240023 Nov 02 13:19:16.976989 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 808/1707] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:16 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:17.092586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:17.093255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:17.107061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.107581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.108019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:17.108950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.109398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.110929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:17.252928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:17.261195 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0e7f5e71-f5c9-4ddf-9c99-195a1e02380c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.172633 Nov 02 13:19:17.261597 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 900/1708] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:17 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:17.963855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:17.965218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:17.974392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.975093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.975651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:17.976594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:17.977253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:17.977779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.029166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c6ab1e9-8aa7-4032-ad4a-59fc772b51f4 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Calling method '.version_select at 0x7fe78fa31040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:18.050871 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-0c6ab1e9-8aa7-4032-ad4a-59fc772b51f4 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] HTTP exception thrown: Image not found. Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c6ab1e9-8aa7-4032-ad4a-59fc772b51f4 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Request method failure captured: Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/images/44425faf-a350-49c4-ba7e-46fbef3a04e7/metadata/os_distro HTTP/1.1 Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm5V6pNCgWgvCFGXmVVtn-EiL_ryZ4nZy5AVDifzyYZ_-23RDliFXdPYa6vkzphmH-BfK_VaqJ2Wi7WorXuyGC3gS8cE2yK4YV9nxJ_kc3zqmT38Q7VWKKG9hdJNFwc8j8XshMW9wpTU64Iufc0S4LrM-wZNa1bACRtmi-nxndmsi_Q Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:18.053848 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5c53c2f55d854fbb90fdf54ac4dddedc Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: exception: Image not found. Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'image_id': '44425faf-a350-49c4-ba7e-46fbef3a04e7', 'id': 'os_distro'} Nov 02 13:19:18.055546 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.056522 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 44425faf-a350-49c4-ba7e-46fbef3a04e7 Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.057762 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 44425faf-a350-49c4-ba7e-46fbef3a04e7 could not be found. Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:18.059040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.060308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c6ab1e9-8aa7-4032-ad4a-59fc772b51f4 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Returning 404 to user: Image not found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:18.061734 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c6ab1e9-8aa7-4032-ad4a-59fc772b51f4 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] 10.222.0.113 "DELETE /compute/v2.1/images/44425faf-a350-49c4-ba7e-46fbef3a04e7/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.161386 Nov 02 13:19:18.061734 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 809/1709] 10.222.0.113 () {58 vars in 1298 bytes} [Wed Nov 2 13:19:17 2022] DELETE /compute/v2.1/images/44425faf-a350-49c4-ba7e-46fbef3a04e7/metadata/os_distro => generated 62 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:19:18.061734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:18.064140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:18.070345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.070836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.071352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.072047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.072512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.073007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.115566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:18.123722 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a39d977-17b1-4c6d-8c9b-223effc0d94c tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1336 microversion: 2.1 time: 0.165139 Nov 02 13:19:18.124392 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 901/1710] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:17 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1336 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:18.129151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9260118-d27d-490f-8ce1-d52a29466278 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Calling method '.version_select at 0x7fe786e415e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:18.154662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-f9260118-d27d-490f-8ce1-d52a29466278 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] HTTP exception thrown: Image not found. Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9260118-d27d-490f-8ce1-d52a29466278 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Request method failure captured: Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/images/73f6f9f9-4771-427e-967b-643df5ad08bf/metadata/os_version HTTP/1.1 Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm5V6pNCgWgvCFGXmVVtn-EiL_ryZ4nZy5AVDifzyYZ_-23RDliFXdPYa6vkzphmH-BfK_VaqJ2Wi7WorXuyGC3gS8cE2yK4YV9nxJ_kc3zqmT38Q7VWKKG9hdJNFwc8j8XshMW9wpTU64Iufc0S4LrM-wZNa1bACRtmi-nxndmsi_Q Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:18.157607 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 5c53c2f55d854fbb90fdf54ac4dddedc Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'image_id': '73f6f9f9-4771-427e-967b-643df5ad08bf', 'id': 'os_version'} Nov 02 13:19:18.159309 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.161956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 73f6f9f9-4771-427e-967b-643df5ad08bf Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.163307 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 73f6f9f9-4771-427e-967b-643df5ad08bf could not be found. Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:18.164793 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.166349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9260118-d27d-490f-8ce1-d52a29466278 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:18.167705 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f9260118-d27d-490f-8ce1-d52a29466278 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] 10.222.0.113 "GET /compute/v2.1/images/73f6f9f9-4771-427e-967b-643df5ad08bf/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.033865 Nov 02 13:19:18.167705 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 902/1711] 10.222.0.113 () {58 vars in 1298 bytes} [Wed Nov 2 13:19:18 2022] GET /compute/v2.1/images/73f6f9f9-4771-427e-967b-643df5ad08bf/metadata/os_version => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:19:18.172638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-beaa4e80-816d-4271-b7ea-0ac51abb21fa tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Calling method '.version_select at 0x7fe786ebeb80>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:18.193609 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-beaa4e80-816d-4271-b7ea-0ac51abb21fa tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] HTTP exception thrown: Image not found. Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-beaa4e80-816d-4271-b7ea-0ac51abb21fa tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Request method failure captured: Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/images/e82e6de7-3093-4b86-917e-3f8083468a18/metadata HTTP/1.1 Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm5V6pNCgWgvCFGXmVVtn-EiL_ryZ4nZy5AVDifzyYZ_-23RDliFXdPYa6vkzphmH-BfK_VaqJ2Wi7WorXuyGC3gS8cE2yK4YV9nxJ_kc3zqmT38Q7VWKKG9hdJNFwc8j8XshMW9wpTU64Iufc0S4LrM-wZNa1bACRtmi-nxndmsi_Q Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:18.195712 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 5c53c2f55d854fbb90fdf54ac4dddedc Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'image_id': 'e82e6de7-3093-4b86-917e-3f8083468a18'} Nov 02 13:19:18.197327 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.198374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e82e6de7-3093-4b86-917e-3f8083468a18 Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.202853 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e82e6de7-3093-4b86-917e-3f8083468a18 could not be found. Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:18.204924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.206417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-beaa4e80-816d-4271-b7ea-0ac51abb21fa tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:18.207806 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-beaa4e80-816d-4271-b7ea-0ac51abb21fa tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] 10.222.0.113 "GET /compute/v2.1/images/e82e6de7-3093-4b86-917e-3f8083468a18/metadata" status: 404 len: 62 microversion: 2.1 time: 0.028367 Nov 02 13:19:18.207806 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 903/1712] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:19:18 2022] GET /compute/v2.1/images/e82e6de7-3093-4b86-917e-3f8083468a18/metadata => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:19:18.213521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0088958a-4eed-475b-b304-0ed5293d1a8b tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Action: 'update_all', calling method: .version_select at 0x7fe786e27a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:18.226461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:18.234660 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-48e20291-4999-4bb1-806a-779950bd41f8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1809 microversion: 2.1 time: 0.177518 Nov 02 13:19:18.235460 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 810/1713] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:18 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:18.236385 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-0088958a-4eed-475b-b304-0ed5293d1a8b tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] HTTP exception thrown: Image not found. Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0088958a-4eed-475b-b304-0ed5293d1a8b tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Request method failure captured: Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/images/dce3fcef-81a6-4ece-98da-52d39453f257/metadata HTTP/1.1 Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 57 Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm5V6pNCgWgvCFGXmVVtn-EiL_ryZ4nZy5AVDifzyYZ_-23RDliFXdPYa6vkzphmH-BfK_VaqJ2Wi7WorXuyGC3gS8cE2yK4YV9nxJ_kc3zqmT38Q7VWKKG9hdJNFwc8j8XshMW9wpTU64Iufc0S4LrM-wZNa1bACRtmi-nxndmsi_Q Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:18.238431 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 5c53c2f55d854fbb90fdf54ac4dddedc Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:19:18.240125 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'image_id': 'dce3fcef-81a6-4ece-98da-52d39453f257', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.244170 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dce3fcef-81a6-4ece-98da-52d39453f257 Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.245447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dce3fcef-81a6-4ece-98da-52d39453f257 could not be found. Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:18.246934 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:19:18.248364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.249904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0088958a-4eed-475b-b304-0ed5293d1a8b tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:18.249904 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0088958a-4eed-475b-b304-0ed5293d1a8b tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] 10.222.0.113 "PUT /compute/v2.1/images/dce3fcef-81a6-4ece-98da-52d39453f257/metadata" status: 404 len: 62 microversion: 2.1 time: 0.030257 Nov 02 13:19:18.249904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 904/1714] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:19:18 2022] PUT /compute/v2.1/images/dce3fcef-81a6-4ece-98da-52d39453f257/metadata => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:19:18.251432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b98600f-c396-4a45-bf79-c9d9f148e663 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Action: 'update', calling method: .version_select at 0x7fe78fa68c10>, body: {"meta": {"os_distro": "alt"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:18.260897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-48adca55-7d4d-4cba-8f6c-312337754324 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:18.261452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-48adca55-7d4d-4cba-8f6c-312337754324 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:18.268584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48adca55-7d4d-4cba-8f6c-312337754324 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.269096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48adca55-7d4d-4cba-8f6c-312337754324 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.269658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48adca55-7d4d-4cba-8f6c-312337754324 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.270368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48adca55-7d4d-4cba-8f6c-312337754324 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.271435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48adca55-7d4d-4cba-8f6c-312337754324 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.271916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48adca55-7d4d-4cba-8f6c-312337754324 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.274116 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7b98600f-c396-4a45-bf79-c9d9f148e663 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] HTTP exception thrown: Image not found. Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b98600f-c396-4a45-bf79-c9d9f148e663 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Request method failure captured: Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: request: PUT /compute/v2.1/images/5af99a2b-855b-4088-819a-d3d386b48865/metadata/os_distro HTTP/1.1 Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 30 Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm5V6pNCgWgvCFGXmVVtn-EiL_ryZ4nZy5AVDifzyYZ_-23RDliFXdPYa6vkzphmH-BfK_VaqJ2Wi7WorXuyGC3gS8cE2yK4YV9nxJ_kc3zqmT38Q7VWKKG9hdJNFwc8j8XshMW9wpTU64Iufc0S4LrM-wZNa1bACRtmi-nxndmsi_Q Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:18.276530 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5c53c2f55d854fbb90fdf54ac4dddedc Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: {"meta": {"os_distro": "alt"}} Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: exception: Image not found. Nov 02 13:19:18.278229 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'image_id': '5af99a2b-855b-4088-819a-d3d386b48865', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.279303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5af99a2b-855b-4088-819a-d3d386b48865 Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.280709 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5af99a2b-855b-4088-819a-d3d386b48865 could not be found. Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:18.283023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:19:18.284577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.286241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b98600f-c396-4a45-bf79-c9d9f148e663 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Returning 404 to user: Image not found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:18.286241 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7b98600f-c396-4a45-bf79-c9d9f148e663 tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] 10.222.0.113 "PUT /compute/v2.1/images/5af99a2b-855b-4088-819a-d3d386b48865/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.032264 Nov 02 13:19:18.286241 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 811/1715] 10.222.0.113 () {60 vars in 1315 bytes} [Wed Nov 2 13:19:18 2022] PUT /compute/v2.1/images/5af99a2b-855b-4088-819a-d3d386b48865/metadata/os_distro => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:19:18.290501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:18.291225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:18.299093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.299709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.300338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.301110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.301631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.301737 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-48adca55-7d4d-4cba-8f6c-312337754324 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad/ips" status: 200 len: 218 microversion: 2.1 time: 0.046280 Nov 02 13:19:18.302178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.302308 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 905/1716] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:19:18 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad/ips => generated 218 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:19:18.309046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe646077-bc79-4f1a-b248-16a95cd0608f tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Action: 'create', calling method: .version_select at 0x7fe786e41ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:18.328810 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-fe646077-bc79-4f1a-b248-16a95cd0608f tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] HTTP exception thrown: Image not found. Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe646077-bc79-4f1a-b248-16a95cd0608f tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Request method failure captured: Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/images/7fb4053b-2ee2-4d1f-add2-53461c9db153/metadata HTTP/1.1 Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 57 Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm5V6pNCgWgvCFGXmVVtn-EiL_ryZ4nZy5AVDifzyYZ_-23RDliFXdPYa6vkzphmH-BfK_VaqJ2Wi7WorXuyGC3gS8cE2yK4YV9nxJ_kc3zqmT38Q7VWKKG9hdJNFwc8j8XshMW9wpTU64Iufc0S4LrM-wZNa1bACRtmi-nxndmsi_Q Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:18.331097 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3f20cd9d45644f3ca35bbe8c27108f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 3f20cd9d45644f3ca35bbe8c27108f5e Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538 Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 5c53c2f55d854fbb90fdf54ac4dddedc Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1091779538-project Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:19:18.332874 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'image_id': '7fb4053b-2ee2-4d1f-add2-53461c9db153', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.333774 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7fb4053b-2ee2-4d1f-add2-53461c9db153 Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:19:18.335220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7fb4053b-2ee2-4d1f-add2-53461c9db153 could not be found. Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:18.336771 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:19:18.338205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:18.340168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe646077-bc79-4f1a-b248-16a95cd0608f tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:18.340168 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fe646077-bc79-4f1a-b248-16a95cd0608f tempest-ImagesMetadataNegativeTestJSON-1091779538 tempest-ImagesMetadataNegativeTestJSON-1091779538-project] 10.222.0.113 "POST /compute/v2.1/images/7fb4053b-2ee2-4d1f-add2-53461c9db153/metadata" status: 404 len: 62 microversion: 2.1 time: 0.029392 Nov 02 13:19:18.340168 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 906/1717] 10.222.0.113 () {60 vars in 1286 bytes} [Wed Nov 2 13:19:18 2022] POST /compute/v2.1/images/7fb4053b-2ee2-4d1f-add2-53461c9db153/metadata => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:19:18.341472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:18.341981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:18.350960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.350960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.351382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.352076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.352528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.352938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.381533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:19:18.471288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:18.481414 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ab5bb18-eee2-4346-975f-257244cae860 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.195319 Nov 02 13:19:18.482009 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 812/1718] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:18 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:18.507066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bc195122-01fe-4759-ad3d-c0edacae2286 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 204 len: 0 microversion: 2.1 time: 0.171526 Nov 02 13:19:18.508911 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 907/1719] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:19:18 2022] DELETE /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:19:18.518934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:18.519847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:18.537945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.538506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.539023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.539890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:18.540535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:18.541024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:18.712870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:18.721727 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a1083ed4-25bd-43f6-a739-1ef25b66f13f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1815 microversion: 2.1 time: 0.208084 Nov 02 13:19:18.722461 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 813/1720] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:18 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1815 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:19.147181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:19.147886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:19.151783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:19.156297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:19.156931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:19.157371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:19.158080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:19.158524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:19.158953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:19.505990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:19.507333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:19.510124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:19.524976 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5609e217-5acd-4e3d-be16-3c1cddde1530 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1336 microversion: 2.1 time: 0.381407 Nov 02 13:19:19.525904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 908/1721] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:19 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1336 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:19.545818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:19.549181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:19.549631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:19.550368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:19.550822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:19.551282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:19.746218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:19.746841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:19.754078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:19.754572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:19.755011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:19.755987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:19.756652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:19.757178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:19.833050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:19.849892 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eb81bb9e-91c2-4387-814b-e40ebdad6175 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.346314 Nov 02 13:19:19.852273 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 814/1722] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:19 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:19.954463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:19.966241 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75c2da94-0271-42b2-95ee-b95fa688e587 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1815 microversion: 2.1 time: 0.223837 Nov 02 13:19:19.972646 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 909/1723] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:19 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1815 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:20.550498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:20.556650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:20.559724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:20.559724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:20.564572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:20.565059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:20.565543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:20.567405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:20.567405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:20.567645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:20.783569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:20.791800 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dca78791-b578-43f8-9c86-1f5e7c09af7d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1336 microversion: 2.1 time: 0.246947 Nov 02 13:19:20.803632 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 815/1724] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:20 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1336 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:20.879017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:20.879931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:20.887044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:20.887777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:20.888330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:20.889153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:20.889746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:20.890289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:20.994839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:20.995981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:21.004502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:21.010514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:21.011364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:21.013644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:21.015520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:21.017615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:21.018162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:21.130907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:21.146424 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b200775-a185-43ff-a09b-b35a5c805b67 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.273203 Nov 02 13:19:21.147433 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 910/1725] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:20 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:21.355876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:21.364644 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6bf24e05-9383-4f8b-a9e0-6645c47426b9 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1815 microversion: 2.1 time: 0.375886 Nov 02 13:19:21.375205 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 816/1726] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:20 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1815 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:21.817432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:21.818622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:21.826083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:21.826712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:21.827189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:21.827912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:21.828373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:21.828944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:22.009405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:22.011648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:22.020412 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-53be0d7f-5536-42cd-b2b6-860544a4faed tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1336 microversion: 2.1 time: 0.207301 Nov 02 13:19:22.020992 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 911/1727] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:21 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1336 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:22.172086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:22.174252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:22.181451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:22.181943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:22.182419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:22.183192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:22.183651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:22.184081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:22.392308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:22.393094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:22.400332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:22.400825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:22.401264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:22.401974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:22.402429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:22.402867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:22.573307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:22.583837 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29af5ff5-dc11-4f47-9c17-94a0671a2927 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1815 microversion: 2.1 time: 0.196066 Nov 02 13:19:22.584608 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 912/1728] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:22 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1815 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:22.646275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:22.654666 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-acf06199-3e28-4ce5-9d7e-df449597cbfa tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.486640 Nov 02 13:19:22.655463 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 817/1729] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:22 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:23.046070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:23.046703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:23.055962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:23.056374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.056855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.057575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:23.058227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.059141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.119363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-89971c10-ad41-493c-a512-554bc1ed8480 req-baaf6f51-a271-44cc-a107-9975ba86f367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52135d4-c308-473a-95c3-8e3493c11047", "name": "network-vif-plugged", "status": "completed", "tag": "ee5d0de9-60ad-4c8c-84f1-88f263565bc4"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:23.155858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-89971c10-ad41-493c-a512-554bc1ed8480 req-baaf6f51-a271-44cc-a107-9975ba86f367 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:23.158064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-89971c10-ad41-493c-a512-554bc1ed8480 req-baaf6f51-a271-44cc-a107-9975ba86f367 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.159305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-89971c10-ad41-493c-a512-554bc1ed8480 req-baaf6f51-a271-44cc-a107-9975ba86f367 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.192972 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-89971c10-ad41-493c-a512-554bc1ed8480 req-baaf6f51-a271-44cc-a107-9975ba86f367 service nova] Creating event network-vif-plugged:ee5d0de9-60ad-4c8c-84f1-88f263565bc4 for instance d52135d4-c308-473a-95c3-8e3493c11047 on n-h1-858384-19 Nov 02 13:19:23.211231 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-89971c10-ad41-493c-a512-554bc1ed8480 req-baaf6f51-a271-44cc-a107-9975ba86f367 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108396 Nov 02 13:19:23.213785 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 818/1730] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:23.305232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:23.337835 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2ea2b4c1-7f24-4456-ba11-fb726e58744d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1336 microversion: 2.1 time: 0.293435 Nov 02 13:19:23.339848 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 913/1731] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:23 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1336 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:23.609287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:23.611891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:23.619976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:23.621375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.622060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.623079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:23.623783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.624428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.680553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:23.681571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:23.695298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:23.696167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.696926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.697870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:23.698552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:23.699228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:23.915227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:23.937517 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-638b2da3-f994-480a-83e2-548c9b55909e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.261319 Nov 02 13:19:23.952207 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 914/1732] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:23 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:24.040932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:24.053245 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-092598b3-253e-4f7c-866a-fb1690d5074b tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1815 microversion: 2.1 time: 0.448693 Nov 02 13:19:24.054267 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 819/1733] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:23 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1815 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:24.242104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-57fa6b85-db8a-4432-9732-73faef009c44 req-d5a4a21a-e985-4507-bc64-0d3020397508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "name": "network-vif-deleted", "tag": "c04e1018-c9ce-44ff-b6bb-720682b18d5f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:24.253389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-57fa6b85-db8a-4432-9732-73faef009c44 req-d5a4a21a-e985-4507-bc64-0d3020397508 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.254038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-57fa6b85-db8a-4432-9732-73faef009c44 req-d5a4a21a-e985-4507-bc64-0d3020397508 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.254991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-57fa6b85-db8a-4432-9732-73faef009c44 req-d5a4a21a-e985-4507-bc64-0d3020397508 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.272055 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-57fa6b85-db8a-4432-9732-73faef009c44 req-d5a4a21a-e985-4507-bc64-0d3020397508 service nova] Creating event network-vif-deleted:c04e1018-c9ce-44ff-b6bb-720682b18d5f for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:19:24.287370 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-57fa6b85-db8a-4432-9732-73faef009c44 req-d5a4a21a-e985-4507-bc64-0d3020397508 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048448 Nov 02 13:19:24.288171 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 915/1734] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:24.369750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:24.370881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:24.378968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.380293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.381090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.382580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.383227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.384568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.479033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d78fabd9-1027-40b8-b3bf-cdd8f2fc02ec tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:24.479901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d78fabd9-1027-40b8-b3bf-cdd8f2fc02ec tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:24.488492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d78fabd9-1027-40b8-b3bf-cdd8f2fc02ec tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.489546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d78fabd9-1027-40b8-b3bf-cdd8f2fc02ec tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.490878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d78fabd9-1027-40b8-b3bf-cdd8f2fc02ec tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.491976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d78fabd9-1027-40b8-b3bf-cdd8f2fc02ec tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.492710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d78fabd9-1027-40b8-b3bf-cdd8f2fc02ec tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.493149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d78fabd9-1027-40b8-b3bf-cdd8f2fc02ec tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.633536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:24.651624 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c1aa244f-3616-4486-a2dc-9a6273ae3c37 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1336 microversion: 2.1 time: 0.286292 Nov 02 13:19:24.652219 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 820/1735] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:24 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1336 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:24.660778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d78fabd9-1027-40b8-b3bf-cdd8f2fc02ec tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1863 microversion: 2.1 time: 0.185850 Nov 02 13:19:24.671689 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 916/1736] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:24 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1863 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:24.684789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-19", "block_migration": true, "disk_over_commit": false}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:24.688968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:24.696316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.696850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.697663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.699522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.699915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.700338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.706730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:24.740718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lazy-loading 'flavor' on Instance uuid 9f8f4a4c-224d-4a42-9b89-dadf667e644b {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:19:24.758241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Going to try to live migrate instance to n-h1-858384-19 {{(pid=120929) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:19:24.965215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:24.965993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:24.978248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.978795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.979293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:24.980374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:24.980849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:24.981289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:25.203830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:25.229197 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e26fad40-bd0a-4f6a-b196-81ace0166907 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1546 microversion: 2.1 time: 0.266018 Nov 02 13:19:25.230858 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 917/1737] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:24 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1546 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:25.255330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:25.258550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:25.300201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:25.305342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:25.308269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:25.310238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:25.310722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:25.311182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:25.619258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:25.630408 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93267a55-da82-4374-9450-6c5a3c86a3b1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1680 microversion: 2.1 time: 0.398399 Nov 02 13:19:25.652344 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 918/1738] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:25 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1680 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:25.693109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:25.695757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:25.705879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:25.707034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:25.707900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:25.710825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:25.711648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:25.712365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:25.996749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:26.034712 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c73fe562-5ff1-4257-b0cd-fa8092f3080a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1539 microversion: 2.1 time: 0.354134 Nov 02 13:19:26.072067 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 919/1739] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:25 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1539 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:26.089365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8b56644b-9c5a-4ed7-aad5-4a3179f72df4 req-863fe8cf-1f31-40d9-b266-fbb8c9e3a47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "name": "network-vif-unplugged", "status": "completed", "tag": "5ca88a21-96c7-42b4-8541-d011a43f174d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:26.122467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8b56644b-9c5a-4ed7-aad5-4a3179f72df4 req-863fe8cf-1f31-40d9-b266-fbb8c9e3a47a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:26.123835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8b56644b-9c5a-4ed7-aad5-4a3179f72df4 req-863fe8cf-1f31-40d9-b266-fbb8c9e3a47a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:26.124520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8b56644b-9c5a-4ed7-aad5-4a3179f72df4 req-863fe8cf-1f31-40d9-b266-fbb8c9e3a47a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:26.151623 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8b56644b-9c5a-4ed7-aad5-4a3179f72df4 req-863fe8cf-1f31-40d9-b266-fbb8c9e3a47a service nova] Creating event network-vif-unplugged:5ca88a21-96c7-42b4-8541-d011a43f174d for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:19:26.161579 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8b56644b-9c5a-4ed7-aad5-4a3179f72df4 req-863fe8cf-1f31-40d9-b266-fbb8c9e3a47a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087932 Nov 02 13:19:26.162732 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 920/1740] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:26.169627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4c706230-f3d2-459c-893c-ee4751a7d88d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Action: 'create', calling method: .version_select at 0x7fe786e27c10>, body: {"pool": "0f797fad-face-4759-a2f5-da28966ec454"} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:27.148461 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4142598b-d83d-4468-adce-d1faaaa8b72a tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/action" status: 202 len: 0 microversion: 2.1 time: 2.468094 Nov 02 13:19:27.149763 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 821/1741] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:19:24 2022] POST /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/action => generated 0 bytes in 2470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:19:27.166956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:27.170740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:27.190771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:27.191431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:27.193024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:27.194339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:27.194890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:27.195618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.013444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:28.038585 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4368e53e-1442-407e-b562-eb75044dceab tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1545 microversion: 2.1 time: 0.886898 Nov 02 13:19:28.040688 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 822/1742] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:27 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1545 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:28.059452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:28.066291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:28.079332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.088445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.091893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.093319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.097871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.099915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.471744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 7ed1faa6-e6ad-4757-992d-0750ae29a307 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:19:28.518525 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5fef9975-2c22-4508-948d-73d4810825bd tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 2429 microversion: 2.25 time: 0.476468 Nov 02 13:19:28.519717 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 823/1743] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:28 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 2429 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:28.527205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-916383c6-86c6-44da-b71d-9287c4ab6a64 req-ecd7f870-41d3-4552-9b93-fd2c761328cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "name": "network-vif-deleted", "tag": "5ca88a21-96c7-42b4-8541-d011a43f174d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:28.555162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-916383c6-86c6-44da-b71d-9287c4ab6a64 req-ecd7f870-41d3-4552-9b93-fd2c761328cf service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.557034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-916383c6-86c6-44da-b71d-9287c4ab6a64 req-ecd7f870-41d3-4552-9b93-fd2c761328cf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.557502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-916383c6-86c6-44da-b71d-9287c4ab6a64 req-ecd7f870-41d3-4552-9b93-fd2c761328cf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.592638 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-916383c6-86c6-44da-b71d-9287c4ab6a64 req-ecd7f870-41d3-4552-9b93-fd2c761328cf service nova] Creating event network-vif-deleted:5ca88a21-96c7-42b4-8541-d011a43f174d for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:19:28.611873 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-916383c6-86c6-44da-b71d-9287c4ab6a64 req-ecd7f870-41d3-4552-9b93-fd2c761328cf service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090042 Nov 02 13:19:28.614746 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 824/1744] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:28.621389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:28.623147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:28.632407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.633644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.634648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.636134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.637267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.637960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.683339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.684064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.684797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.685458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lazy-loading 'fault' on Instance uuid 0f440c11-aecc-456c-acf8-f3c84192c6ad {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:19:28.741975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:28.759783 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3afd87e9-be2f-4309-a404-1e8379087c8a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 200 len: 1307 microversion: 2.1 time: 0.142940 Nov 02 13:19:28.761281 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 825/1745] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:28 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 1307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:28.783302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:28.783302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:28.789675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.790168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.790601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:28.791557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:28.792093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:28.792642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:29.004912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:29.017173 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-88917eb7-a835-4918-bb5d-57eb3bd8da11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.245658 Nov 02 13:19:29.018534 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 826/1746] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:28 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:29.177185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-107728305", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "1f6a6e2d-1bbd-47fe-93c7-1ae7b623f51d"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:29.309686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] validate_networks() for [('1f6a6e2d-1bbd-47fe-93c7-1ae7b623f51d', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:19:29.371771 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4c706230-f3d2-459c-893c-ee4751a7d88d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.206131 Nov 02 13:19:29.372395 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 921/1747] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:19:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:29.379929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c77c485d-92a2-4ac5-ab88-1c91d2fb70bb req-03d8a26e-dea6-4abe-8c31-a97373265431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "name": "network-vif-unplugged", "status": "completed", "tag": "6797473c-723b-4fa1-8ef1-261866f68154"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:29.420041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c77c485d-92a2-4ac5-ab88-1c91d2fb70bb req-03d8a26e-dea6-4abe-8c31-a97373265431 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:29.428415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c77c485d-92a2-4ac5-ab88-1c91d2fb70bb req-03d8a26e-dea6-4abe-8c31-a97373265431 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:29.429836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c77c485d-92a2-4ac5-ab88-1c91d2fb70bb req-03d8a26e-dea6-4abe-8c31-a97373265431 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:29.462437 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c77c485d-92a2-4ac5-ab88-1c91d2fb70bb req-03d8a26e-dea6-4abe-8c31-a97373265431 service nova] Creating event network-vif-unplugged:6797473c-723b-4fa1-8ef1-261866f68154 for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:19:29.483644 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c77c485d-92a2-4ac5-ab88-1c91d2fb70bb req-03d8a26e-dea6-4abe-8c31-a97373265431 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108873 Nov 02 13:19:29.486123 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 922/1748] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:29.502489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-19", "block_migration": "auto"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:29.506999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:29.518812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:29.519756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:29.520532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:29.521457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:29.522077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:29.522680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:29.584333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'flavor' on Instance uuid 7ed1faa6-e6ad-4757-992d-0750ae29a307 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:19:29.630918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Going to try to live migrate instance to n-h1-858384-19 {{(pid=120928) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:19:30.495843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:19:30.496354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:19:30.496721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:19:30.497129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:19:30.497545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:19:30.509703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:30.510627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:30.511271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:30.512180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:30.512795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:30.513408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:30.534388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Getting quotas for project c905a294fc3f4d9cbd7e95bea56d2977. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:19:30.544259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Getting quotas for user 764311ce80524d08835261cf5ef6eff0 and project c905a294fc3f4d9cbd7e95bea56d2977. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:19:30.566527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:19:30.570623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:19:30.651430 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c02d203f-ecdb-45ec-ac45-3da36dba4949 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.629770 Nov 02 13:19:30.653051 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 827/1749] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:19:29 2022] POST /compute/v2.1/servers => generated 382 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:19:30.660848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:30.661928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:30.676926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:30.678580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:30.679222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:30.680814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:30.682154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:30.684201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:31.102082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:31.110836 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c2b65500-e3a7-4dbd-9d25-524c1ad9a56c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1477 microversion: 2.1 time: 0.456347 Nov 02 13:19:31.111675 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 828/1750] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:30 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1477 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:31.121917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Action: 'action', calling method: .version_select at 0x7fe78d3781f0>, body: {"addFloatingIp": {"address": "172.25.1.106"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:31.124647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:31.131484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:31.132243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:31.132681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:31.133608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:31.134065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:31.134500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:31.231272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:19:31.231690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquired lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:19:32.657543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Building network info cache for instance {{(pid=120929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:19:33.949443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Updating instance_info_cache with network_info: [{"id": "ee5d0de9-60ad-4c8c-84f1-88f263565bc4", "address": "fa:16:3e:f6:27:c0", "network": {"id": "fe1f4dee-9fc9-4df4-a781-6fab6083d12c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-374743273-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "edef03bc68bb49968039c234cfd5a556", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee5d0de9-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:19:33.966684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Releasing lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:19:33.967912 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9026d5ce-8256-4109-a815-3a4764012d6a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action" status: 202 len: 0 microversion: 2.1 time: 2.851143 Nov 02 13:19:33.968834 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 829/1751] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:19:31 2022] POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action => generated 0 bytes in 2857 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:19:33.977059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:33.978034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:33.985895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:33.986646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:33.987294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:33.988247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:33.988880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:33.989304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:34.006721 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] HTTP exception thrown: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Request method failure captured: Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad HTTP/1.1 Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm4uVFvrLSNzSUBdZT53tx6SeEKZ7TiSNbncpGghEvohNEXdOBtlY_v1W7jr8ACnY9OXkkpa9mwimK4fO0GNatRB0czYiKf_kCajtvI5rT5z8Oft1lYWkbfXrvYwgwPaXzjt02UygdKkIwp4BDho7xesRq2aFk4JdOBYNsWwbmC4cHg Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:34.009024 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestMultiNic-1216632423 Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 93f47e9ac7784ca0963d2b1fcc3db296 Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:19:34.010738 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '0f440c11-aecc-456c-acf8-f3c84192c6ad'} Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:34.011768 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:19:34.013375 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:34.015970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Returning 404 to user: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:34.017264 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9cef572b-9f17-4c02-a1d9-e0aa538c1261 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 404 len: 111 microversion: 2.1 time: 0.047025 Nov 02 13:19:34.018004 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 830/1752] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:33 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:34.023195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:34.024173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:34.030530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:34.031016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:34.031606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:34.032420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:34.033126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:34.033552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:34.411208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:34.425611 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e0dcb08c-3d03-4aa8-b77c-f95f214b7c1b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.406096 Nov 02 13:19:34.450026 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 831/1753] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:34 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:34.457227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4ddbf0b0-6a06-4c55-b379-ce6b82435b5d req-7bbae1c1-71ca-4c32-9097-a0e6b6ae6e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f440c11-aecc-456c-acf8-f3c84192c6ad", "name": "network-vif-deleted", "tag": "6797473c-723b-4fa1-8ef1-261866f68154"}, {"server_uuid": "6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49", "name": "network-vif-unplugged", "status": "completed", "tag": "abaa7e07-a933-4415-be82-70f57348ba75"}, {"name": "network-changed", "server_uuid": "6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49", "tag": "abaa7e07-a933-4415-be82-70f57348ba75"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:34.469555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4ddbf0b0-6a06-4c55-b379-ce6b82435b5d req-7bbae1c1-71ca-4c32-9097-a0e6b6ae6e57 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:34.470530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4ddbf0b0-6a06-4c55-b379-ce6b82435b5d req-7bbae1c1-71ca-4c32-9097-a0e6b6ae6e57 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:34.472845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4ddbf0b0-6a06-4c55-b379-ce6b82435b5d req-7bbae1c1-71ca-4c32-9097-a0e6b6ae6e57 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:34.505282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4ddbf0b0-6a06-4c55-b379-ce6b82435b5d req-7bbae1c1-71ca-4c32-9097-a0e6b6ae6e57 service nova] Creating event network-vif-deleted:6797473c-723b-4fa1-8ef1-261866f68154 for instance 0f440c11-aecc-456c-acf8-f3c84192c6ad on n-h2-858384-19 Nov 02 13:19:34.505282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4ddbf0b0-6a06-4c55-b379-ce6b82435b5d req-7bbae1c1-71ca-4c32-9097-a0e6b6ae6e57 service nova] Creating event network-vif-unplugged:abaa7e07-a933-4415-be82-70f57348ba75 for instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 on n-h1-858384-19 Nov 02 13:19:34.505282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4ddbf0b0-6a06-4c55-b379-ce6b82435b5d req-7bbae1c1-71ca-4c32-9097-a0e6b6ae6e57 service nova] Creating event network-changed:abaa7e07-a933-4415-be82-70f57348ba75 for instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 on n-h1-858384-19 Nov 02 13:19:34.514045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-4ddbf0b0-6a06-4c55-b379-ce6b82435b5d req-7bbae1c1-71ca-4c32-9097-a0e6b6ae6e57 service nova] Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:19:34.530778 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4ddbf0b0-6a06-4c55-b379-ce6b82435b5d req-7bbae1c1-71ca-4c32-9097-a0e6b6ae6e57 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.078061 Nov 02 13:19:34.532333 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 832/1754] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:34.538607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:34.539341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:34.549435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:34.550505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:34.551251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:34.552222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:34.553183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:34.554307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:35.106870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:35.115652 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-96d2ad45-60c6-45dc-9ee2-4f2d0ba9ade4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1328 microversion: 2.1 time: 0.581821 Nov 02 13:19:35.127593 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 833/1755] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:34 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1328 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:35.137465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:35.138435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:35.145048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:35.145766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:35.146399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:35.147330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:35.147946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:35.148537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:35.737513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:35.753225 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d57567b9-c28f-4535-9ba4-71aec7135f37 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1474 microversion: 2.1 time: 0.623956 Nov 02 13:19:35.753874 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 834/1756] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:35 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1474 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:35.780199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2abec102-15f8-4448-adab-2c021ee0203d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Action: 'create', calling method: .version_select at 0x7fe78fa715e0>, body: {"pool": "0f797fad-face-4759-a2f5-da28966ec454"} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:36.529190 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01541e6d-f22f-4fbd-b4a9-d4875da67751 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/action" status: 202 len: 0 microversion: 2.25 time: 7.038240 Nov 02 13:19:36.532982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 923/1757] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:19:29 2022] POST /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/action => generated 0 bytes in 7045 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:19:36.545546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:36.546800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:36.558609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.559094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.559620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.560339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.591303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.592058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.865300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:36.876776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d30e944-e5a6-4d7e-85a8-6ab0c2be09f2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.339544 Nov 02 13:19:36.877605 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 924/1758] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:36 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:36.883860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:36.884597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:36.893497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.894438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.895138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.896109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.896805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.897471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.954442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.955154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.956206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.957261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:36.957954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:36.958494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:36.994745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:19:37.005276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for user e7104fb14f5c430a8bfd7e6aa7ada5ee and project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:19:37.181704 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c1ac1c0-3ea7-41b7-905c-7782f55f3596 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49/action" status: 202 len: 0 microversion: 2.1 time: 0.301573 Nov 02 13:19:37.183519 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 925/1759] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:19:36 2022] POST /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:19:37.192682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:37.194919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:37.205592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.206451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.207373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:37.208774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.209423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.210096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:37.276819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:37.605993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:37.625822 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d3b872dc-73e6-4e80-9d9a-fca3e56faca1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1328 microversion: 2.1 time: 0.439699 Nov 02 13:19:37.633895 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 926/1760] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:37 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1328 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:37.640211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:37.641932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:37.651314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.651848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.653201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:37.655218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.657430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.658257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:37.706739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:19:37.827033 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ca518b2-ae77-476f-b4f7-a21d1edc5949 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 204 len: 0 microversion: 2.1 time: 0.190596 Nov 02 13:19:37.829007 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 927/1761] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:19:37 2022] DELETE /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:19:37.838019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:37.839497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:37.873488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.873988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.874431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:37.875237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:37.875844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:37.876695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.288384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:38.300048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:38.309437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:38.310837 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-289597c1-1262-47bd-a089-ddff25c8b6f6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.480512 Nov 02 13:19:38.311448 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 928/1762] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:37 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:38.316515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-01880093-70ab-4174-ac18-4096b9a86ddf req-57da0c76-ee33-4c07-9f84-8fc48bf7730a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d52135d4-c308-473a-95c3-8e3493c11047", "tag": "ee5d0de9-60ad-4c8c-84f1-88f263565bc4"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:38.330813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-01880093-70ab-4174-ac18-4096b9a86ddf req-57da0c76-ee33-4c07-9f84-8fc48bf7730a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.331994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-01880093-70ab-4174-ac18-4096b9a86ddf req-57da0c76-ee33-4c07-9f84-8fc48bf7730a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.332450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-01880093-70ab-4174-ac18-4096b9a86ddf req-57da0c76-ee33-4c07-9f84-8fc48bf7730a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.346041 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-01880093-70ab-4174-ac18-4096b9a86ddf req-57da0c76-ee33-4c07-9f84-8fc48bf7730a service nova] Creating event network-changed:ee5d0de9-60ad-4c8c-84f1-88f263565bc4 for instance d52135d4-c308-473a-95c3-8e3493c11047 on n-h1-858384-19 Nov 02 13:19:38.351670 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-01880093-70ab-4174-ac18-4096b9a86ddf req-57da0c76-ee33-4c07-9f84-8fc48bf7730a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038966 Nov 02 13:19:38.352283 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 929/1763] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:38.357681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:38.358568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:38.368193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.374742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.375332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.377697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.377697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.379225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.608338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:38.617656 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de2ff4f0-4c44-4695-b9ba-77babe2581a1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1473 microversion: 2.1 time: 0.264154 Nov 02 13:19:38.618367 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 930/1764] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:38 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1473 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:38.624485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:38.625282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:38.633139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.634439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.635352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.636216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.636748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.637310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.802419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:38.811603 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-447b5330-c5a8-4ac1-b86d-bcac3d928812 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1716 microversion: 2.1 time: 0.190941 Nov 02 13:19:38.812191 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 931/1765] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:38 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1716 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:38.813462 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2abec102-15f8-4448-adab-2c021ee0203d tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.044300 Nov 02 13:19:38.821774 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 835/1766] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:19:35 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:38.824289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-39572929-35e3-4bc2-91a2-2a6c752f875c req-4488541d-ee3e-4d42-8831-87479799b86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49", "name": "network-vif-plugged", "status": "completed", "tag": "abaa7e07-a933-4415-be82-70f57348ba75"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:38.834484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:38.835864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:38.837480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-39572929-35e3-4bc2-91a2-2a6c752f875c req-4488541d-ee3e-4d42-8831-87479799b86d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.837999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-39572929-35e3-4bc2-91a2-2a6c752f875c req-4488541d-ee3e-4d42-8831-87479799b86d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.838655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-39572929-35e3-4bc2-91a2-2a6c752f875c req-4488541d-ee3e-4d42-8831-87479799b86d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.843634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.844699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.845324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.846866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.847363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.847845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.852434 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-39572929-35e3-4bc2-91a2-2a6c752f875c req-4488541d-ee3e-4d42-8831-87479799b86d service nova] Creating event network-vif-plugged:abaa7e07-a933-4415-be82-70f57348ba75 for instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 on n-h1-858384-19 Nov 02 13:19:38.858466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-39572929-35e3-4bc2-91a2-2a6c752f875c req-4488541d-ee3e-4d42-8831-87479799b86d service nova] Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:19:38.871378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-39572929-35e3-4bc2-91a2-2a6c752f875c req-4488541d-ee3e-4d42-8831-87479799b86d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055183 Nov 02 13:19:38.872556 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 836/1767] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:38.879878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:38.881387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:38.889350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.889851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.890286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:38.891041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:38.891699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:38.892128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.038153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:39.046398 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ef6072ca-08c2-49ad-bafb-84acc4da60ae tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1328 microversion: 2.1 time: 0.172463 Nov 02 13:19:39.053497 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 837/1768] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:38 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:39.061183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.86"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:39.065129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:39.071831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.072322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.072769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.073481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.073950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.074387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.079239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:39.102628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:19:39.103026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquired lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:19:39.119668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:39.130857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1555da17-b37b-4119-9b69-2b962372dd34 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.302050 Nov 02 13:19:39.131636 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 932/1769] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:38 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:39.343737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:39.346295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:39.357208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.358076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.358829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.360658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.361544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.362235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.577356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:39.587719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:39.589229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:39.590635 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da643f0f-8548-43b4-a172-bef029bb9ac9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.253686 Nov 02 13:19:39.591464 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 933/1770] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:39 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:19:39.643468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:39.645095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:39.651294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG neutronclient.v2_0.client [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.86 (2e5fc319-f88d-4b73-8094-4451efe6f605) with port ee5d0de9-60ad-4c8c-84f1-88f263565bc4 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 0f797fad-face-4759-a2f5-da28966ec454.", "detail": ""}} {{(pid=120929) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:19:39.651897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Releasing lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:19:39.652746 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.86 (2e5fc319-f88d-4b73-8094-4451efe6f605) with port ee5d0de9-60ad-4c8c-84f1-88f263565bc4 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 0f797fad-face-4759-a2f5-da28966ec454. Nov 02 13:19:39.652746 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-6b94b870-45f5-490d-800e-c800ea785ec6'] Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Request method failure captured: Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action HTTP/1.1 Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 45 Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm5MpzY3Az7KNRM4zHvUTHIu4U06TcV6vIYFLrws9uH75Uqs1xoyAxES1qvVxJ74-fMMBh-TWB1Z0anTOT2bkOUJkO1-LCxJoms4mjpK0iQRKA0TH9R58PQnGnubmBmiC-ER9aJYHuBhztb0kh9CO3mYEU1oRTmJChh_RF7dibOA0Rc Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:39.654898 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_edef03bc68bb49968039c234cfd5a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4ae60e4432e446cfb7b96b2a647c7161 Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: {"addFloatingIp": {"address": "172.25.1.86"}} Nov 02 13:19:39.657944 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: exception: Cannot associate floating IP 172.25.1.86 (2e5fc319-f88d-4b73-8094-4451efe6f605) with port ee5d0de9-60ad-4c8c-84f1-88f263565bc4 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 0f797fad-face-4759-a2f5-da28966ec454. Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-6b94b870-45f5-490d-800e-c800ea785ec6'] Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd52135d4-c308-473a-95c3-8e3493c11047', 'body': {'addFloatingIp': {'address': '172.25.1.86'}}} Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:39.658973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:19:39.661365 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.86 (2e5fc319-f88d-4b73-8094-4451efe6f605) with port ee5d0de9-60ad-4c8c-84f1-88f263565bc4 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 0f797fad-face-4759-a2f5-da28966ec454. Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b94b870-45f5-490d-800e-c800ea785ec6'] Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.86 (2e5fc319-f88d-4b73-8094-4451efe6f605) with port ee5d0de9-60ad-4c8c-84f1-88f263565bc4 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 0f797fad-face-4759-a2f5-da28966ec454. Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b94b870-45f5-490d-800e-c800ea785ec6'] Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:39.663723 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.86 (2e5fc319-f88d-4b73-8094-4451efe6f605) with port ee5d0de9-60ad-4c8c-84f1-88f263565bc4 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 0f797fad-face-4759-a2f5-da28966ec454. Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b94b870-45f5-490d-800e-c800ea785ec6'] Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:39.665219 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.86 (2e5fc319-f88d-4b73-8094-4451efe6f605) with port ee5d0de9-60ad-4c8c-84f1-88f263565bc4 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 0f797fad-face-4759-a2f5-da28966ec454. Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b94b870-45f5-490d-800e-c800ea785ec6'] Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Returning 400 to user: Cannot associate floating IP 172.25.1.86 (2e5fc319-f88d-4b73-8094-4451efe6f605) with port ee5d0de9-60ad-4c8c-84f1-88f263565bc4 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 0f797fad-face-4759-a2f5-da28966ec454. Nov 02 13:19:39.668218 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-6b94b870-45f5-490d-800e-c800ea785ec6'] {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:39.669556 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c052a148-9084-4896-a2b8-58dc1bcd3ed9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action" status: 400 len: 380 microversion: 2.1 time: 0.603381 Nov 02 13:19:39.669556 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 838/1771] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:19:39 2022] POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action => generated 380 bytes in 605 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:19:39.669734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.669734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.669734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.669734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.670149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.670149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.670322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c675408d-8216-44cb-9f26-aa8f99785dde tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '.version_select at 0x7fe78fa303a0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:39.850169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:39.859366 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88c5452e-02a3-4858-ba8e-0fb8eca5b23f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1473 microversion: 2.1 time: 0.221026 Nov 02 13:19:39.861224 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 934/1772] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:39 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:39.866407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:39.867027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:39.873952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.875161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.876345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:39.877282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:39.877914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:39.878351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:40.037429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:40.046256 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22ff4715-97b8-481c-9002-1e8b850f43e8 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1716 microversion: 2.1 time: 0.183780 Nov 02 13:19:40.047153 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 935/1773] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:39 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1716 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:40.072283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:40.073086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:40.081155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:40.081763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:40.082455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:40.083414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:40.084134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:40.084585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:40.447135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:40.461377 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-62df5bcc-f7a7-4089-a818-9ea869f9c6c7 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1328 microversion: 2.1 time: 0.394929 Nov 02 13:19:40.462369 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 936/1774] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:40 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1328 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:40.484266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:40.485910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:40.492797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:40.493705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:40.494736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:40.495941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:40.496719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:40.497369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:40.525931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:40.559308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:40.912285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:40.941312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-576aee98-4140-491c-b1d0-965852525edc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.460470 Nov 02 13:19:40.948236 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 937/1775] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:40 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:40.958853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-57bd50a3-3ec6-47ce-af43-98f9e452fcb8 req-7894ed00-f616-4b21-a9e5-0a5919e6ed6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3", "tag": "5d56c13d-0813-4502-a471-d288abfc743b"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:40.978970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-57bd50a3-3ec6-47ce-af43-98f9e452fcb8 req-7894ed00-f616-4b21-a9e5-0a5919e6ed6f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:40.979638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-57bd50a3-3ec6-47ce-af43-98f9e452fcb8 req-7894ed00-f616-4b21-a9e5-0a5919e6ed6f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:40.980277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-57bd50a3-3ec6-47ce-af43-98f9e452fcb8 req-7894ed00-f616-4b21-a9e5-0a5919e6ed6f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.005706 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-57bd50a3-3ec6-47ce-af43-98f9e452fcb8 req-7894ed00-f616-4b21-a9e5-0a5919e6ed6f service nova] Creating event network-changed:5d56c13d-0813-4502-a471-d288abfc743b for instance 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 on n-h2-858384-19 Nov 02 13:19:41.017841 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-57bd50a3-3ec6-47ce-af43-98f9e452fcb8 req-7894ed00-f616-4b21-a9e5-0a5919e6ed6f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065700 Nov 02 13:19:41.027538 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 938/1776] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:41.033989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:41.035320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:41.047786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.048867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.050094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.051579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.052609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.053410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.200504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c675408d-8216-44cb-9f26-aa8f99785dde tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/2e5fc319-f88d-4b73-8094-4451efe6f605" status: 202 len: 0 microversion: 2.1 time: 1.536020 Nov 02 13:19:41.201479 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 839/1777] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:19:39 2022] DELETE /compute/v2.1/os-floating-ips/2e5fc319-f88d-4b73-8094-4451efe6f605 => generated 0 bytes in 1538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:19:41.213000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:41.214020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:41.236321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.237148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.237873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.239061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.248230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.249091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.283676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:41.302693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:41.309131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:41.310283 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2a4fdf3a-4f0e-4581-9b5f-19d822c05c63 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.281419 Nov 02 13:19:41.311276 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 939/1778] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:41 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:41.316831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:41.318242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:41.325155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.331811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.332363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.333197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.333805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.334307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.462580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:41.475206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-96be2a7a-cfde-412e-adaf-28e2fd14620b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1473 microversion: 2.1 time: 0.272089 Nov 02 13:19:41.476231 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 840/1779] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:41 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:41.481781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Action: 'action', calling method: .version_select at 0x7fe78d378280>, body: {"removeFloatingIp": {"address": "172.25.1.106"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:41.557003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:41.599274 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e03203d3-90d4-4ad8-8b11-c019216218f6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1716 microversion: 2.1 time: 0.286490 Nov 02 13:19:41.601955 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 940/1780] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:41 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1716 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:41.617950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-474709477", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "c0c54181-ff25-44a1-b28c-4d38baaa86cd"}, {"uuid": "57759ed7-0763-4926-8c50-0b02db0dbb04"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:41.728607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:41.735822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] validate_networks() for [('c0c54181-ff25-44a1-b28c-4d38baaa86cd', None, None, None, None, None), ('57759ed7-0763-4926-8c50-0b02db0dbb04', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:19:41.736972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.737477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.737929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:41.738655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:41.739138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:41.740262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:42.030660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:19:42.031070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquired lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:19:42.961449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:19:42.962705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:19:42.964304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:19:42.964957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:19:42.965571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:19:42.977414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:42.978072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:42.978735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:42.979729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:42.980373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:42.980807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.015394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Getting quotas for project 94a263e4d49c4d6b98ea983593d9a9f3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:19:43.024623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Getting quotas for user 93f47e9ac7784ca0963d2b1fcc3db296 and project 94a263e4d49c4d6b98ea983593d9a9f3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:19:43.042053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:19:43.044595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:19:43.066550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:43.103331 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4d6eeb8-6741-4aed-9b31-b5f5213a0331 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.498727 Nov 02 13:19:43.105625 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 941/1781] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:19:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:19:43.114367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:43.115325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:43.126841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.127494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.127941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.128656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.129106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.129533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.306885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:43.325382 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-43796ea3-ce74-41bb-8258-1373e24fecf1 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1328 microversion: 2.1 time: 0.215380 Nov 02 13:19:43.345816 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 942/1782] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:43 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1328 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:43.364173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:43.365148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:43.373380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.374223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.375535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.380083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.380897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.381560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.412459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:43.641522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:43.656194 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e671787f-c362-46f6-92cc-1526cdb89780 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.308492 Nov 02 13:19:43.658152 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 943/1783] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:43 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:43.671526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:43.681045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:43.702774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.703834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.707092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:43.718723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:43.720264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:43.721392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.008150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:44.020715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:44.022677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:44.024321 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-73c35fbf-ae51-42de-9045-0bace464163c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.364772 Nov 02 13:19:44.025190 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 944/1784] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:43 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:44.037336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:44.037965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:44.044186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.044961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.045636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.046599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.047380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.048063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.268723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:44.277458 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d7c859e8-6bca-42e3-8143-0d8c54c12f33 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1473 microversion: 2.1 time: 0.250876 Nov 02 13:19:44.279126 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 945/1785] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:44 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:44.293375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:44.294111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:44.315370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.316444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.317518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.318741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.319499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.320204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.363471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Building network info cache for instance {{(pid=120929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:19:44.596559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:44.613522 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ad75bf1-1cae-431c-9504-06d99298e2e1 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1716 microversion: 2.1 time: 0.332576 Nov 02 13:19:44.614773 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 946/1786] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:44 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1716 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:44.622045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:44.624048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:44.632519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.633332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.634422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.635700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.636492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.636947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.777079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:44.814940 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-529d8ae0-f002-46e5-9a03-b0e1a1e491d2 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1212 microversion: 2.1 time: 0.193646 Nov 02 13:19:44.821811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 947/1787] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:44 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1212 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:44.828607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7aae6968-8295-4e2f-a7ab-9b29b81c7345 req-208f31ff-c868-4586-8b48-08c3525a59f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49", "name": "network-vif-unplugged", "status": "completed", "tag": "abaa7e07-a933-4415-be82-70f57348ba75"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:44.855337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7aae6968-8295-4e2f-a7ab-9b29b81c7345 req-208f31ff-c868-4586-8b48-08c3525a59f4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.856313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7aae6968-8295-4e2f-a7ab-9b29b81c7345 req-208f31ff-c868-4586-8b48-08c3525a59f4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.856864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7aae6968-8295-4e2f-a7ab-9b29b81c7345 req-208f31ff-c868-4586-8b48-08c3525a59f4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.879433 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7aae6968-8295-4e2f-a7ab-9b29b81c7345 req-208f31ff-c868-4586-8b48-08c3525a59f4 service nova] Creating event network-vif-unplugged:abaa7e07-a933-4415-be82-70f57348ba75 for instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 on n-h2-858384-19 Nov 02 13:19:44.891481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-7aae6968-8295-4e2f-a7ab-9b29b81c7345 req-208f31ff-c868-4586-8b48-08c3525a59f4 service nova] Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:19:44.919362 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7aae6968-8295-4e2f-a7ab-9b29b81c7345 req-208f31ff-c868-4586-8b48-08c3525a59f4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094117 Nov 02 13:19:44.920479 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 948/1788] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:44.932739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:44.934459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:44.957622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.959413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.959760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:44.970077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:44.971169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:44.977303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:45.312395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:45.325516 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-915364b7-c752-4b13-854a-de5fa30b92c3 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1328 microversion: 2.1 time: 0.402237 Nov 02 13:19:45.340393 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 949/1789] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:44 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1328 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:45.348536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9c6a77a2-2fed-4d54-b805-bb432ba0f7cc req-7c7f091b-302f-4ffe-b302-7dc6afc80551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d52135d4-c308-473a-95c3-8e3493c11047", "tag": "ee5d0de9-60ad-4c8c-84f1-88f263565bc4"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:45.360559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c6a77a2-2fed-4d54-b805-bb432ba0f7cc req-7c7f091b-302f-4ffe-b302-7dc6afc80551 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:45.361020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c6a77a2-2fed-4d54-b805-bb432ba0f7cc req-7c7f091b-302f-4ffe-b302-7dc6afc80551 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:45.361462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c6a77a2-2fed-4d54-b805-bb432ba0f7cc req-7c7f091b-302f-4ffe-b302-7dc6afc80551 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:45.384158 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9c6a77a2-2fed-4d54-b805-bb432ba0f7cc req-7c7f091b-302f-4ffe-b302-7dc6afc80551 service nova] Creating event network-changed:ee5d0de9-60ad-4c8c-84f1-88f263565bc4 for instance d52135d4-c308-473a-95c3-8e3493c11047 on n-h1-858384-19 Nov 02 13:19:45.389319 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9c6a77a2-2fed-4d54-b805-bb432ba0f7cc req-7c7f091b-302f-4ffe-b302-7dc6afc80551 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047534 Nov 02 13:19:45.389945 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 950/1790] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:45.396546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:45.397284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:45.415742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:45.416243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:45.416695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:45.417511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:45.418493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:45.419051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:45.702659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:45.714686 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f859ec69-bbd0-46bf-8374-2052c4f553a9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.323506 Nov 02 13:19:45.715317 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 951/1791] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:45 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:45.735994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:45.736845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:45.745086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:45.747422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:45.750665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:45.754345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:45.755104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:45.756013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.135666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:46.146919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:46.148654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:46.149968 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf868217-187c-4bd5-a263-6ee518c21bb7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.433723 Nov 02 13:19:46.164220 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 952/1792] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:45 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:46.177292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:46.178069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:46.185065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.185763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.186310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.187147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.188662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.189351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.687033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:46.702825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f850536-4ee0-4f02-bf63-c1ffe9fb7984 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1539 microversion: 2.1 time: 0.537169 Nov 02 13:19:46.722109 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 953/1793] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:46 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1539 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:46.743771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:46.747930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:46.768006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.770522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.779556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.780560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.781850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.784343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.873987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:46.876000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:46.878043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:46.879842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lazy-loading 'fault' on Instance uuid e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:19:47.152288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67a249e060245d8a474939741a581b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27e4041951f43b6a4beb4e471cbb63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:47.162898 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be9db39a-e5ba-4af7-8f8b-21b365f7d140 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 200 len: 1358 microversion: 2.1 time: 0.443897 Nov 02 13:19:47.164848 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 954/1794] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:46 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 1358 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:47.171441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:47.179920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:47.200783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.201755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.202288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:47.203260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.204114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.205667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:47.326733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:47.337466 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05e57be1-d566-456b-9d8c-df04de5ddcea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1268 microversion: 2.1 time: 0.170907 Nov 02 13:19:47.340133 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 955/1795] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:47 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:47.350476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:47.351595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:47.358495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.358988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.360226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:47.361962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.362792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.363275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:47.436055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Updating instance_info_cache with network_info: [{"id": "ee5d0de9-60ad-4c8c-84f1-88f263565bc4", "address": "fa:16:3e:f6:27:c0", "network": {"id": "fe1f4dee-9fc9-4df4-a781-6fab6083d12c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-374743273-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "edef03bc68bb49968039c234cfd5a556", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapee5d0de9-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:19:47.454793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Releasing lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:19:47.455708 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9600b7d2-3030-488e-8571-5d00d72600a3 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action" status: 202 len: 0 microversion: 2.1 time: 5.978219 Nov 02 13:19:47.456653 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 841/1796] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:19:41 2022] POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action => generated 0 bytes in 5979 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:19:47.465186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:47.465817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:47.486407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.486919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.489624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:47.490727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.491411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.492067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:47.604671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:47.616610 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-749f40a2-813d-4712-b1a9-edada9516df5 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1328 microversion: 2.1 time: 0.274566 Nov 02 13:19:47.621834 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 956/1797] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:47 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1328 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:47.656849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:47.665469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:47.676329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.683461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.685196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:47.690720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:47.692894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:47.694528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.117207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:48.131998 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a53f226-9bd6-4471-89d8-d811b65f5698 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.674103 Nov 02 13:19:48.152172 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 842/1798] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:47 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:48.169442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-68c7e309-df0f-4377-a53e-9df99daae3bf tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '.version_select at 0x7fe78f95a0d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:48.267004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:48.294586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:48.299722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:48.304678 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c685fb3e-651e-4da0-b082-48151ac2383d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.676851 Nov 02 13:19:48.306032 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 957/1799] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:47 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:48.311402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-25447269-af63-463e-87cf-90e070f74796 req-84a1d45a-3a12-4f58-a58f-10b36e6b9dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5a4217c-1a63-48d7-9f9f-95f6dcf98a33", "name": "network-vif-deleted", "tag": "2a1d7d81-182b-49ee-9769-5410cd39d830"}, {"server_uuid": "9f8f4a4c-224d-4a42-9b89-dadf667e644b", "name": "network-vif-unplugged", "status": "completed", "tag": "9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:48.326726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-25447269-af63-463e-87cf-90e070f74796 req-84a1d45a-3a12-4f58-a58f-10b36e6b9dc2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.327666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-25447269-af63-463e-87cf-90e070f74796 req-84a1d45a-3a12-4f58-a58f-10b36e6b9dc2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.328968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-25447269-af63-463e-87cf-90e070f74796 req-84a1d45a-3a12-4f58-a58f-10b36e6b9dc2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.343441 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-25447269-af63-463e-87cf-90e070f74796 req-84a1d45a-3a12-4f58-a58f-10b36e6b9dc2 service nova] Creating event network-vif-deleted:2a1d7d81-182b-49ee-9769-5410cd39d830 for instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 on n-h2-858384-19 Nov 02 13:19:48.345956 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-25447269-af63-463e-87cf-90e070f74796 req-84a1d45a-3a12-4f58-a58f-10b36e6b9dc2 service nova] Creating event network-vif-unplugged:9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d for instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b on n-h2-858384-19 Nov 02 13:19:48.351766 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-25447269-af63-463e-87cf-90e070f74796 req-84a1d45a-3a12-4f58-a58f-10b36e6b9dc2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044233 Nov 02 13:19:48.353522 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 958/1800] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:48.358954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:48.360695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:48.379250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.379996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.380799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.381932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.382532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.382981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.616267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:48.626338 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0c47186-00fd-4304-862c-b10fba754b66 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1539 microversion: 2.1 time: 0.271254 Nov 02 13:19:48.633329 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 959/1801] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:48 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1539 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:48.647463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:48.648606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:48.659170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.660041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.660833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.662088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.662926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.663744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.693467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] HTTP exception thrown: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Request method failure captured: Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 HTTP/1.1 Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1HmGejjHE27gRTXod_suhUOhM-VM3R68Sp5DSAcO5hOIECBUoyngsVscpnR45FPeY9O5PRq55Fixgrfs0Fnx9p-_lBsfWCMU8RQ7qNEInl9athQMuWv6fxrDPQqPni0blwojl868AEuST20Xi9Ffg87OmoyyOGJSM3K5hz3d7IcTg Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:48.698024 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c67a249e060245d8a474939741a581b3 Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:48.699589 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e5a4217c-1a63-48d7-9f9f-95f6dcf98a33'} Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:48.700466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:48.701789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:48.705350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Returning 404 to user: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:48.705350 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e4c15a1-bbbc-4ad8-a3bd-db7e16ffe267 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 404 len: 111 microversion: 2.1 time: 0.065415 Nov 02 13:19:48.705350 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 960/1802] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:48 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:48.710739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-702820f9-7c45-4dc9-914d-506316ea9a7a req-2316b0d0-5242-406e-801c-7a216ccbc855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3", "name": "network-vif-plugged", "status": "completed", "tag": "5d56c13d-0813-4502-a471-d288abfc743b"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:48.729321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-702820f9-7c45-4dc9-914d-506316ea9a7a req-2316b0d0-5242-406e-801c-7a216ccbc855 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.730182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-702820f9-7c45-4dc9-914d-506316ea9a7a req-2316b0d0-5242-406e-801c-7a216ccbc855 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.730972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-702820f9-7c45-4dc9-914d-506316ea9a7a req-2316b0d0-5242-406e-801c-7a216ccbc855 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.753782 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-702820f9-7c45-4dc9-914d-506316ea9a7a req-2316b0d0-5242-406e-801c-7a216ccbc855 service nova] Creating event network-vif-plugged:5d56c13d-0813-4502-a471-d288abfc743b for instance 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 on n-h2-858384-19 Nov 02 13:19:48.762805 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-702820f9-7c45-4dc9-914d-506316ea9a7a req-2316b0d0-5242-406e-801c-7a216ccbc855 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059156 Nov 02 13:19:48.764224 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 961/1803] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:48.775735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:48.778014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:48.791668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.792802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.793806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.795347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.796402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.797950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.879466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:48.882448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:48.889622 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-85ec13a2-3c7b-4a7d-9b7b-79bd66f0680e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1274 microversion: 2.1 time: 0.122594 Nov 02 13:19:48.890140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 962/1804] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:48 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:48.896474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:48.897423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:48.913003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.913512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.913963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:48.914694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:48.915187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:48.915630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.093307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:49.102318 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a01b6fa8-9ff8-459e-a327-ef1b4dcd4a0c tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1328 microversion: 2.1 time: 0.210175 Nov 02 13:19:49.103331 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 963/1805] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:48 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1328 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:49.109706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:49.110492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:49.127245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.127769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.128195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.129051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.129595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.130027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.145941 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] HTTP exception thrown: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Request method failure captured: Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 HTTP/1.1 Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1HmGejjHE27gRTXod_suhUOhM-VM3R68Sp5DSAcO5hOIECBUoyngsVscpnR45FPeY9O5PRq55Fixgrfs0Fnx9p-_lBsfWCMU8RQ7qNEInl9athQMuWv6fxrDPQqPni0blwojl868AEuST20Xi9Ffg87OmoyyOGJSM3K5hz3d7IcTg Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:49.147596 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c67a249e060245d8a474939741a581b3 Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.149317 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a1b1c802-d2e4-4c0b-841a-f0baba14e1a0'} Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:49.154753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.156258 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.157681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Returning 404 to user: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:49.157681 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eb686ca1-74c2-4cf6-adcf-d4c6e6c2ce34 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 404 len: 111 microversion: 2.1 time: 0.045059 Nov 02 13:19:49.157681 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 964/1806] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:19:49 2022] DELETE /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:49.157963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:49.158662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:49.165037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.165530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.165971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.166855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.167430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.167876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.183507 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] HTTP exception thrown: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Request method failure captured: Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 HTTP/1.1 Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1HmGejjHE27gRTXod_suhUOhM-VM3R68Sp5DSAcO5hOIECBUoyngsVscpnR45FPeY9O5PRq55Fixgrfs0Fnx9p-_lBsfWCMU8RQ7qNEInl9athQMuWv6fxrDPQqPni0blwojl868AEuST20Xi9Ffg87OmoyyOGJSM3K5hz3d7IcTg Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:49.185076 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c67a249e060245d8a474939741a581b3 Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.193292 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a1b1c802-d2e4-4c0b-841a-f0baba14e1a0'} Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:49.194786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:49.198270 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:49.201095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Returning 404 to user: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:49.201095 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c8411da-1c22-486f-86fa-63a1c6ed88c4 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 404 len: 111 microversion: 2.1 time: 0.032686 Nov 02 13:19:49.201095 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 965/1807] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:49 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:19:49.201095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:49.201095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:49.203274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.203782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.204753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.204959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.206298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.206298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.391744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:49.409438 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2cb0647b-5c82-4351-915d-9a0228567162 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.217818 Nov 02 13:19:49.411784 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 966/1808] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:49 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:49.419566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7359f0a0-a2b1-4546-9ef8-9d9f5b46da16 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '.version_select at 0x7fe78f952ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:49.448409 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7359f0a0-a2b1-4546-9ef8-9d9f5b46da16 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877925391" status: 202 len: 0 microversion: 2.1 time: 0.034457 Nov 02 13:19:49.450451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 967/1809] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:19:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877925391 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:19:49.472821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:49.475900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:49.492530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.494689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.496258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.498855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.500350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.503496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.863754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:49.879982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:49.883901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:49.886115 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2576fa2b-c166-490c-bbf9-737d9ba44046 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.433738 Nov 02 13:19:49.887582 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 968/1810] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:49 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:49.895670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:49.897086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:49.927050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.928245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.928918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:49.929831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:49.931425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:49.932010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:50.251468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:50.263927 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2321ec9d-2f8d-4e97-ac48-0c36dc2cc53e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1539 microversion: 2.1 time: 0.374268 Nov 02 13:19:50.276582 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 969/1811] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:49 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1539 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:50.292467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:50.293557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:50.303148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:50.303642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:50.304077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:50.304798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:50.305254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:50.305703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:50.457388 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-68c7e309-df0f-4377-a53e-9df99daae3bf tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/69efdf21-a4f7-4742-b9bb-904409e189d0" status: 202 len: 0 microversion: 2.1 time: 2.303571 Nov 02 13:19:50.458803 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 843/1812] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:19:48 2022] DELETE /compute/v2.1/os-floating-ips/69efdf21-a4f7-4742-b9bb-904409e189d0 => generated 0 bytes in 2306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:19:50.474206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:50.480254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:50.501245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:50.502470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:50.503569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:50.504985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:50.505640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:50.506289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:50.660983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:50.678003 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1d68897c-7b0a-4e0c-86a7-0f84b6c15865 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1316 microversion: 2.1 time: 0.399443 Nov 02 13:19:50.691308 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 970/1813] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:50 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1316 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:50.697318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e73b8ecc-d4f4-4494-87f3-dc41f5fe50a5 req-4a3cdf43-1010-4353-ae8e-559bbc38b5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8f4a4c-224d-4a42-9b89-dadf667e644b", "tag": "9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d"}, {"name": "network-changed", "server_uuid": "6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49", "tag": "abaa7e07-a933-4415-be82-70f57348ba75"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:50.721568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e73b8ecc-d4f4-4494-87f3-dc41f5fe50a5 req-4a3cdf43-1010-4353-ae8e-559bbc38b5e4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:50.722433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e73b8ecc-d4f4-4494-87f3-dc41f5fe50a5 req-4a3cdf43-1010-4353-ae8e-559bbc38b5e4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:50.723086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e73b8ecc-d4f4-4494-87f3-dc41f5fe50a5 req-4a3cdf43-1010-4353-ae8e-559bbc38b5e4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:50.764582 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e73b8ecc-d4f4-4494-87f3-dc41f5fe50a5 req-4a3cdf43-1010-4353-ae8e-559bbc38b5e4 service nova] Creating event network-changed:9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d for instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b on n-h2-858384-19 Nov 02 13:19:50.766067 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e73b8ecc-d4f4-4494-87f3-dc41f5fe50a5 req-4a3cdf43-1010-4353-ae8e-559bbc38b5e4 service nova] Creating event network-changed:abaa7e07-a933-4415-be82-70f57348ba75 for instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 on n-h2-858384-19 Nov 02 13:19:50.778339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-e73b8ecc-d4f4-4494-87f3-dc41f5fe50a5 req-4a3cdf43-1010-4353-ae8e-559bbc38b5e4 service nova] Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:19:50.800805 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e73b8ecc-d4f4-4494-87f3-dc41f5fe50a5 req-4a3cdf43-1010-4353-ae8e-559bbc38b5e4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.116110 Nov 02 13:19:50.801605 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 971/1814] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:50.807314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:50.808073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:50.815412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:50.816454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:50.816454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:50.817062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:50.817531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:50.818329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.003350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:51.005555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:51.014396 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-158208b5-9107-49a7-aa7c-dded8f04cc87 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.211558 Nov 02 13:19:51.015154 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63751a8c-b5e9-44db-a775-66a559d4f7f4 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1328 microversion: 2.1 time: 0.553526 Nov 02 13:19:51.015532 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 972/1815] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:50 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:51.016510 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 844/1816] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:50 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1328 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:51.021249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0d899095-21c7-4f53-b52e-8ec73f39c7a9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Action: 'action', calling method: .version_select at 0x7fe78dd62dc0>, body: {"addFloatingIp": {"address": ""}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:51.022981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0f822b16-95a7-46ed-930d-7761e98b2340 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0d899095-21c7-4f53-b52e-8ec73f39c7a9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Request method failure captured: Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action HTTP/1.1 Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 34 Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm5MpzY3Az7KNRM4zHvUTHIu4U06TcV6vIYFLrws9uH75Uqs1xoyAxES1qvVxJ74-fMMBh-TWB1Z0anTOT2bkOUJkO1-LCxJoms4mjpK0iQRKA0TH9R58PQnGnubmBmiC-ER9aJYHuBhztb0kh9CO3mYEU1oRTmJChh_RF7dibOA0Rc Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:51.026171 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_edef03bc68bb49968039c234cfd5a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4ae60e4432e446cfb7b96b2a647c7161 Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: {"addFloatingIp": {"address": ""}} Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:19:51.027916 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'd52135d4-c308-473a-95c3-8e3493c11047', 'body': {'addFloatingIp': {'address': ''}}} Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi '' Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:51.028935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:19:51.030681 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:19:51.033377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 02 13:19:51.033377 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.033377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0d899095-21c7-4f53-b52e-8ec73f39c7a9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:51.035784 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0d899095-21c7-4f53-b52e-8ec73f39c7a9 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action" status: 400 len: 142 microversion: 2.1 time: 0.016213 Nov 02 13:19:51.041498 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 973/1817] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:19:51 2022] POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action => generated 142 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:19:51.048766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.050104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:51.060790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.061560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.062235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.064144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.064703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.065200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.069580 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0f822b16-95a7-46ed-930d-7761e98b2340 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1947419631" status: 202 len: 0 microversion: 2.1 time: 0.051365 Nov 02 13:19:51.070649 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 845/1818] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:19:51 2022] DELETE /compute/v2.1/flavors/1947419631 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:19:51.079569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:51.082375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:51.089372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:51.092026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.092606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.093131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.095251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.095809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.096348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.144819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:19:51.145053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquired lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:19:51.241762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:51.253012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:51.254641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:51.256660 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ddcd2b0b-cd7e-4aee-91c4-e3081f078d84 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.213533 Nov 02 13:19:51.271151 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 974/1819] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:51 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:51.271151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d692cd14-df93-43e6-94e5-5e8d31473bd5 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.295804 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d692cd14-df93-43e6-94e5-5e8d31473bd5 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5436 microversion: 2.1 time: 0.036204 Nov 02 13:19:51.297223 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 975/1820] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:19:51 2022] GET /compute/v2.1/flavors/detail => generated 5436 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:51.302328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.303071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:51.309877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.310686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.311654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.312987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.313669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.314553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.490485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:51.499285 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75f662ab-2e52-4639-806b-334dfa51f970 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1539 microversion: 2.1 time: 0.200907 Nov 02 13:19:51.500609 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 976/1821] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:51 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1539 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:51.506621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c5be69e2-5d5c-4c9b-b805-af9af00706e4 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.529948 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c5be69e2-5d5c-4c9b-b805-af9af00706e4 tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1031214878" status: 202 len: 0 microversion: 2.1 time: 0.028004 Nov 02 13:19:51.531013 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 977/1822] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:19:51 2022] DELETE /compute/v2.1/flavors/1031214878 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:19:51.542088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0f951465-4d5d-45d5-a929-2140b9d5bdce tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.569043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0f951465-4d5d-45d5-a929-2140b9d5bdce tempest-ServersWithSpecificFlavorTestJSON-1518080989 tempest-ServersWithSpecificFlavorTestJSON-1518080989-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.030917 Nov 02 13:19:51.570530 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 978/1823] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:19:51 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:51.622586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.623146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:51.632451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.633260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.633831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.634649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.635225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.635725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.654893 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] HTTP exception thrown: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Request method failure captured: Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 HTTP/1.1 Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1HmGejjHE27gRTXod_suhUOhM-VM3R68Sp5DSAcO5hOIECBUoyngsVscpnR45FPeY9O5PRq55Fixgrfs0Fnx9p-_lBsfWCMU8RQ7qNEInl9athQMuWv6fxrDPQqPni0blwojl868AEuST20Xi9Ffg87OmoyyOGJSM3K5hz3d7IcTg Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:51.657214 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c67a249e060245d8a474939741a581b3 Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.659189 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e5a4217c-1a63-48d7-9f9f-95f6dcf98a33'} Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:51.660512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.662178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.664133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Returning 404 to user: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:51.664133 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff4d9704-72cc-4e41-abc7-b13eaaac9ceb tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 404 len: 111 microversion: 2.1 time: 0.041689 Nov 02 13:19:51.664133 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 979/1824] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:19:51 2022] DELETE /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:19:51.669159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.669672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: e5a4217c-1a63-48d7-9f9f-95f6dcf98a33] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:51.678025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.678518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.678961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.679721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.680187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.680681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] HTTP exception thrown: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Request method failure captured: Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 HTTP/1.1 Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1HmGejjHE27gRTXod_suhUOhM-VM3R68Sp5DSAcO5hOIECBUoyngsVscpnR45FPeY9O5PRq55Fixgrfs0Fnx9p-_lBsfWCMU8RQ7qNEInl9athQMuWv6fxrDPQqPni0blwojl868AEuST20Xi9Ffg87OmoyyOGJSM3K5hz3d7IcTg Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:51.704017 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c67a249e060245d8a474939741a581b3 Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.707885 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e5a4217c-1a63-48d7-9f9f-95f6dcf98a33'} Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:51.708753 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. Nov 02 13:19:51.710061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.712291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Returning 404 to user: Instance e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:51.712291 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82715710-fc5c-4587-b660-4bbf6266cf65 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33" status: 404 len: 111 microversion: 2.1 time: 0.040558 Nov 02 13:19:51.712291 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 980/1825] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:51 2022] GET /compute/v2.1/servers/e5a4217c-1a63-48d7-9f9f-95f6dcf98a33 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:51.714242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.714862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:51.721717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.722213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.722659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.723402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.723865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.724292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.848631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Releasing lock "refresh_cache-d52135d4-c308-473a-95c3-8e3493c11047" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:19:51.849980 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] HTTP exception thrown: floating IP not found Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Request method failure captured: Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action HTTP/1.1 Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 41 Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm5MpzY3Az7KNRM4zHvUTHIu4U06TcV6vIYFLrws9uH75Uqs1xoyAxES1qvVxJ74-fMMBh-TWB1Z0anTOT2bkOUJkO1-LCxJoms4mjpK0iQRKA0TH9R58PQnGnubmBmiC-ER9aJYHuBhztb0kh9CO3mYEU1oRTmJChh_RF7dibOA0Rc Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:51.851931 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_edef03bc68bb49968039c234cfd5a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4ae60e4432e446cfb7b96b2a647c7161 Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: {"addFloatingIp": {"address": "0.0.0.0"}} Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:19:51.853402 n-d-858384-19 devstack@n-api.service[120929]: exception: floating IP not found Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd52135d4-c308-473a-95c3-8e3493c11047', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.854282 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Nov 02 13:19:51.855778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.857165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Returning 404 to user: floating IP not found {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:51.857165 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7c83a8c5-5817-42b2-9872-d604ac4e1b7a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action" status: 404 len: 67 microversion: 2.1 time: 0.781825 Nov 02 13:19:51.862337 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 846/1826] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:19:51 2022] POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action => generated 67 bytes in 791 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:19:51.867923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.868767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:51.875934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.876794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.877462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.878359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.878822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.879406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.901346 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] HTTP exception thrown: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Request method failure captured: Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 HTTP/1.1 Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1HmGejjHE27gRTXod_suhUOhM-VM3R68Sp5DSAcO5hOIECBUoyngsVscpnR45FPeY9O5PRq55Fixgrfs0Fnx9p-_lBsfWCMU8RQ7qNEInl9athQMuWv6fxrDPQqPni0blwojl868AEuST20Xi9Ffg87OmoyyOGJSM3K5hz3d7IcTg Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:51.903290 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: c67a249e060245d8a474939741a581b3 Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.907165 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'a1b1c802-d2e4-4c0b-841a-f0baba14e1a0'} Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:51.909462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.912779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.916413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Returning 404 to user: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:51.916413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-228ef358-608f-444e-a4ec-4b175a0bebd6 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 404 len: 111 microversion: 2.1 time: 0.041349 Nov 02 13:19:51.916413 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 847/1827] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:19:51 2022] DELETE /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:51.916413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f574721a-d12c-414b-aa42-e2cb7ae71390 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:51.920207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:51.931065 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee3c0d61-6818-4bd6-acdf-1762109a2254 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1316 microversion: 2.1 time: 0.223493 Nov 02 13:19:51.932055 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 981/1828] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:51 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:51.940635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:51.941736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] [instance: a1b1c802-d2e4-4c0b-841a-f0baba14e1a0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:51.954310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.956292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.956292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.956876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:51.957480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:51.957986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:51.977100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] HTTP exception thrown: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Request method failure captured: Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 HTTP/1.1 Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1HmGejjHE27gRTXod_suhUOhM-VM3R68Sp5DSAcO5hOIECBUoyngsVscpnR45FPeY9O5PRq55Fixgrfs0Fnx9p-_lBsfWCMU8RQ7qNEInl9athQMuWv6fxrDPQqPni0blwojl868AEuST20Xi9Ffg87OmoyyOGJSM3K5hz3d7IcTg Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:51.978731 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a27e4041951f43b6a4beb4e471cbb63b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: a27e4041951f43b6a4beb4e471cbb63b Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621 Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: c67a249e060245d8a474939741a581b3 Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1557086621-project Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.980701 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a1b1c802-d2e4-4c0b-841a-f0baba14e1a0'} Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:51.981670 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. Nov 02 13:19:51.983470 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.984892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] Returning 404 to user: Instance a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:51.984892 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3176d959-0426-4420-a446-c934b5c99c64 tempest-ServersWithSpecificFlavorTestJSON-1557086621 tempest-ServersWithSpecificFlavorTestJSON-1557086621-project] 10.222.0.113 "GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0" status: 404 len: 111 microversion: 2.1 time: 0.046655 Nov 02 13:19:51.987287 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 982/1829] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:51 2022] GET /compute/v2.1/servers/a1b1c802-d2e4-4c0b-841a-f0baba14e1a0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:51.989776 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f574721a-d12c-414b-aa42-e2cb7ae71390 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f574721a-d12c-414b-aa42-e2cb7ae71390 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Request method failure captured: Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action HTTP/1.1 Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 44 Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm5MpzY3Az7KNRM4zHvUTHIu4U06TcV6vIYFLrws9uH75Uqs1xoyAxES1qvVxJ74-fMMBh-TWB1Z0anTOT2bkOUJkO1-LCxJoms4mjpK0iQRKA0TH9R58PQnGnubmBmiC-ER9aJYHuBhztb0kh9CO3mYEU1oRTmJChh_RF7dibOA0Rc Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:51.993681 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_edef03bc68bb49968039c234cfd5a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4ae60e4432e446cfb7b96b2a647c7161 Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: {"removeFloatingIp": {"address": "0.0.0.0"}} Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:19:51.995861 n-d-858384-19 devstack@n-api.service[120929]: exception: Floating IP not found for address 0.0.0.0. Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd52135d4-c308-473a-95c3-8e3493c11047', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:51.997089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Nov 02 13:19:52.001202 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:52.003662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f574721a-d12c-414b-aa42-e2cb7ae71390 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:52.004728 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f574721a-d12c-414b-aa42-e2cb7ae71390 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action" status: 404 len: 88 microversion: 2.1 time: 0.095402 Nov 02 13:19:52.005560 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 848/1830] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:19:51 2022] POST /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047/action => generated 88 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:19:52.025750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:52.026540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:52.038289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.039102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.039996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.041354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.042096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.042808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.059088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:52.060562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:52.072852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.074412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.075882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.077426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.079102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.079328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:19:52.080427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.198954 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f7ebd24-61cf-45dd-8df6-5fab9b64c91e tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 204 len: 0 microversion: 2.1 time: 0.181763 Nov 02 13:19:52.204558 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 983/1831] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:19:52 2022] DELETE /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:19:52.207295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:52.208029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:52.211139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:52.216260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.216764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.217202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.217922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.218907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.219348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.453493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:52.463824 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-030c1996-8b39-4704-abfd-889d65ce8b11 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.263010 Nov 02 13:19:52.464700 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 984/1832] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:52 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:52.471330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:52.472018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:52.478905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.479485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.480231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.481133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.481594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.482030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.551524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:52.561876 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f690ff08-a773-4cc5-8ace-f92acc281e63 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1525 microversion: 2.1 time: 0.512028 Nov 02 13:19:52.577835 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 849/1833] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:52 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1525 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:52.584355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:52.585574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:52.592192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.592740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.593305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.594654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.595996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.596438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.754007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:52.769356 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d0ef14d-295a-4877-aac6-9e6ab54a53f4 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1545 microversion: 2.1 time: 0.297334 Nov 02 13:19:52.770859 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 985/1834] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:52 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1545 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:52.778410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:52.790087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:52.800636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.800636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.801310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.802430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:52.803811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:52.803811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:52.842070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:52.952152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:52.978666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:52.981419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:52.989206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-db51335f-49a0-4f27-bf49-355e66db4314 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.409405 Nov 02 13:19:52.990176 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 850/1835] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:52 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:52.996248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:52.997370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:53.004160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=5 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:53.005210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.005963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.006629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.007647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.008554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.009232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.036349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:53.061754 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] HTTP exception thrown: Action 999 not found Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Request method failure captured: Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3/os-instance-actions/999 HTTP/1.1 Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm5fP6ce15_y6-MvM5HVPVPP4v4rlWc7x7ZOq7Xvuh-LYCU2lvkQ3SiELPglvY2yqgLwuqqO7kN0XMNzoaCs6SFQtxH8Ii8c6128mVj_o9AVe7cO_lS-60nK1mjUrVC5kmYqcDc9_rzEU9cO-PjfGt-uAW7klO3OSMGg-QLdo1Dnr6o Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c905a294fc3f4d9cbd7e95bea56d2977 Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-293207409 Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:53.064592 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-293207409 Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c905a294fc3f4d9cbd7e95bea56d2977 Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-293207409 Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-InstanceActionsNegativeTestJSON-293207409-project Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 764311ce80524d08835261cf5ef6eff0 Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-293207409-project Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: exception: Action 999 not found Nov 02 13:19:53.066075 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': '52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3', 'id': '999'} Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Nov 02 13:19:53.066888 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:53.074182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Returning 404 to user: Action 999 not found {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:53.075313 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0fdd9af0-0ab7-4105-8c4b-f81bf6288185 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.083668 Nov 02 13:19:53.076094 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 851/1836] 10.222.0.113 () {58 vars in 1313 bytes} [Wed Nov 2 13:19:52 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3/os-instance-actions/999 => generated 66 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:19:53.084801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:53.087392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:53.106003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.106756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.107408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.108551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.109364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.110511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.138983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:53.158364 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1adc1b8-2f10-43ad-a299-11b7c4f02bee tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1539 microversion: 2.1 time: 0.383790 Nov 02 13:19:53.159603 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 986/1837] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:52 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1539 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:53.166269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-deadf574-2359-487d-9cf5-c18744aae66d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '.version_select at 0x7fe78f841c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:53.172788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-deadf574-2359-487d-9cf5-c18744aae66d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:53.194964 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-deadf574-2359-487d-9cf5-c18744aae66d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] HTTP exception thrown: Instance 9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009 could not be found. Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-deadf574-2359-487d-9cf5-c18744aae66d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Request method failure captured: Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009/os-instance-actions HTTP/1.1 Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm5fP6ce15_y6-MvM5HVPVPP4v4rlWc7x7ZOq7Xvuh-LYCU2lvkQ3SiELPglvY2yqgLwuqqO7kN0XMNzoaCs6SFQtxH8Ii8c6128mVj_o9AVe7cO_lS-60nK1mjUrVC5kmYqcDc9_rzEU9cO-PjfGt-uAW7klO3OSMGg-QLdo1Dnr6o Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c905a294fc3f4d9cbd7e95bea56d2977 Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-293207409 Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:19:53.198428 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-293207409 Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c905a294fc3f4d9cbd7e95bea56d2977 Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-293207409 Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-InstanceActionsNegativeTestJSON-293207409-project Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 764311ce80524d08835261cf5ef6eff0 Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-293207409-project Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009 could not be found. Nov 02 13:19:53.200375 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'server_id': '9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009'} Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009 could not be found. Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:53.201364 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009 could not be found. Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009 could not be found. Nov 02 13:19:53.203483 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:19:53.210757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-deadf574-2359-487d-9cf5-c18744aae66d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Returning 404 to user: Instance 9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:53.211996 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-deadf574-2359-487d-9cf5-c18744aae66d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.050744 Nov 02 13:19:53.213100 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 987/1838] 10.222.0.113 () {58 vars in 1301 bytes} [Wed Nov 2 13:19:53 2022] GET /compute/v2.1/servers/9bf3dfb8-9bdd-4ec5-8a30-b11a88b98009/os-instance-actions => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:19:53.222974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:53.223791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:53.232504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.233266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.233875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.236047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.237180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.239711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.318014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:19:53.347430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:53.356410 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-64206f8b-64a8-435c-a6b7-f6f6e33755cf tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.275372 Nov 02 13:19:53.357004 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 852/1839] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:53 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:53.463948 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-167dc68e-4bd2-48e8-8307-71e5c1a2817e tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "DELETE /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 204 len: 0 microversion: 2.1 time: 0.244503 Nov 02 13:19:53.465448 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 988/1840] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:19:53 2022] DELETE /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:19:53.475819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:53.477201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:53.485009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.492083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:53.493209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.494243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.494471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.494806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.495261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.498046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:53.511243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.513317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.518314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:53.519327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:53.522251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:53.522832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:54.006872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:54.020664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f90577dc-dcf7-450a-9f36-6bb1ed764bd1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.533239 Nov 02 13:19:54.021928 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 989/1841] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:53 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:54.043056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:54.050352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:54.067627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:54.068420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:54.068873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:54.069591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:54.070264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:54.070856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:54.076503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:54.092073 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e6fe5940-b1dc-4a2c-b3a6-647e5ddafbe6 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1531 microversion: 2.1 time: 0.621222 Nov 02 13:19:54.100253 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 853/1842] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:53 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1531 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:54.105990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:54.106870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:54.121256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:54.122009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:54.122737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:54.123907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:54.124536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:54.125172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:54.641054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:54.683241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:54.694453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:54.696886 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f7392b88-a658-4078-b1c5-8affef4a36f0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.595165 Nov 02 13:19:54.715376 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 854/1843] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:54 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:54.715376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:54.715376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:54.726426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:54.726426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:54.726426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:54.728596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:54.729527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:54.730871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:54.957845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:54.976908 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cb40f001-e0a6-4f3d-84c2-023de414963a tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1545 microversion: 2.1 time: 0.952615 Nov 02 13:19:54.981455 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 990/1844] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:54 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1545 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:54.988206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:54.989091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:54.989745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:55.004231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.004991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.005805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.007011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.008882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.009965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.013931 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7982c883-466a-4719-a9af-9ddd2499e922 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1539 microversion: 2.1 time: 0.304844 Nov 02 13:19:55.017688 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 855/1845] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:54 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1539 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:55.056835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:55.057914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:55.065178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.065965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.066601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.067364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.067822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.068460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.307824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:55.338614 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f8279aa9-8efa-4ed9-b3db-713b7f0b2346 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.285307 Nov 02 13:19:55.340462 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 856/1846] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:55 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:55.348319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:55.349394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:55.357130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.358181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.360938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.362056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.362973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.363911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.432409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:55.440377 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ebcba36-49cb-4c3f-85d9-bba76ffa6b51 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.457488 Nov 02 13:19:55.441578 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 991/1847] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:54 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:55.446377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8ab488f6-caff-4e42-a339-418e63bc6892 req-a190d880-7d54-4442-bf71-b107383e5e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ec5001-5a75-4d28-bfa2-41e143233da4", "tag": "7b9f5560-882f-41cd-b9da-8ccb8964d3ee"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:55.457999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8ab488f6-caff-4e42-a339-418e63bc6892 req-a190d880-7d54-4442-bf71-b107383e5e34 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.458731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8ab488f6-caff-4e42-a339-418e63bc6892 req-a190d880-7d54-4442-bf71-b107383e5e34 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.459391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8ab488f6-caff-4e42-a339-418e63bc6892 req-a190d880-7d54-4442-bf71-b107383e5e34 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.484059 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8ab488f6-caff-4e42-a339-418e63bc6892 req-a190d880-7d54-4442-bf71-b107383e5e34 service nova] Creating event network-changed:7b9f5560-882f-41cd-b9da-8ccb8964d3ee for instance 99ec5001-5a75-4d28-bfa2-41e143233da4 on n-h1-858384-19 Nov 02 13:19:55.491628 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8ab488f6-caff-4e42-a339-418e63bc6892 req-a190d880-7d54-4442-bf71-b107383e5e34 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048611 Nov 02 13:19:55.493844 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 992/1848] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:55.676885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-fd0ca123-8b6e-4a42-94a9-8ef65c17fb86 req-d28d9f41-ec99-4410-b6dd-ec0bbe0a1462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d52135d4-c308-473a-95c3-8e3493c11047", "name": "network-vif-deleted", "tag": "ee5d0de9-60ad-4c8c-84f1-88f263565bc4"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:55.691055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fd0ca123-8b6e-4a42-94a9-8ef65c17fb86 req-d28d9f41-ec99-4410-b6dd-ec0bbe0a1462 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.691748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fd0ca123-8b6e-4a42-94a9-8ef65c17fb86 req-d28d9f41-ec99-4410-b6dd-ec0bbe0a1462 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.692543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fd0ca123-8b6e-4a42-94a9-8ef65c17fb86 req-d28d9f41-ec99-4410-b6dd-ec0bbe0a1462 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.718858 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-fd0ca123-8b6e-4a42-94a9-8ef65c17fb86 req-d28d9f41-ec99-4410-b6dd-ec0bbe0a1462 service nova] Creating event network-vif-deleted:ee5d0de9-60ad-4c8c-84f1-88f263565bc4 for instance d52135d4-c308-473a-95c3-8e3493c11047 on n-h1-858384-19 Nov 02 13:19:55.727003 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-fd0ca123-8b6e-4a42-94a9-8ef65c17fb86 req-d28d9f41-ec99-4410-b6dd-ec0bbe0a1462 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056231 Nov 02 13:19:55.727732 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 993/1849] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:55.735941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:55.736932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:55.743785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.744817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.745450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.746981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:55.748240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:55.749218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:55.938364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:55.964393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:55.967104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:55.968440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfa9eb34-0b07-4667-9fda-d71ddde19e65 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.238363 Nov 02 13:19:55.972806 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 994/1850] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:55 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:19:56.008992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:56.009621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:56.019558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.021302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.022077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.027756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.028464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.029192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.074273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.074773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.075301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.075904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lazy-loading 'fault' on Instance uuid d52135d4-c308-473a-95c3-8e3493c11047 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:19:56.124244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae60e4432e446cfb7b96b2a647c7161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edef03bc68bb49968039c234cfd5a556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:56.132896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be1692c5-cda0-46f5-bdb4-d400606afbc2 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 200 len: 1326 microversion: 2.1 time: 0.127829 Nov 02 13:19:56.147509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 995/1851] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:56 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 1326 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:56.154340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:56.155220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:56.162991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.163932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.164831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.165736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.166494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.167218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.347171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:56.355076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0a39ffda-fb4d-4bc5-a5ab-d665e098b7df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1539 microversion: 2.1 time: 0.206484 Nov 02 13:19:56.355687 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 996/1852] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:56 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:56.370691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:56.371629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:56.378993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.379637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.380148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.380964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.381525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.382053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.451043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:56.460314 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5752052b-df51-4876-b5ee-f53f9659ae5d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1531 microversion: 2.1 time: 1.118546 Nov 02 13:19:56.461184 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 857/1853] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:55 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1531 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:56.466283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:56.467426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:56.474553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.481109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.482417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.483394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:56.484657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:56.485408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:56.542382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:56.551943 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2671162d-48cb-4cd3-96e5-785fa9c58538 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.185580 Nov 02 13:19:56.553481 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 997/1854] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:56 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:56.996425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:56.997029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:57.004662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.005144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.005584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.006290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.006745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.007185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.013539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:57.024205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7602b163-e672-4c3f-9238-83afae82f834 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.561605 Nov 02 13:19:57.025291 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 858/1855] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:56 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:57.162084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:57.162763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] [instance: d52135d4-c308-473a-95c3-8e3493c11047] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:57.169329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.169811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.170530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.172103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.172845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.173425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.178560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:57.189409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:57.191096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:57.192729 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3bdd5196-3b57-4be9-98b8-0c2f48cc9e8c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.200415 Nov 02 13:19:57.193421 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 998/1856] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:56 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:19:57.200924 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] HTTP exception thrown: Instance d52135d4-c308-473a-95c3-8e3493c11047 could not be found. Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Request method failure captured: Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 HTTP/1.1 Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm5MpzY3Az7KNRM4zHvUTHIu4U06TcV6vIYFLrws9uH75Uqs1xoyAxES1qvVxJ74-fMMBh-TWB1Z0anTOT2bkOUJkO1-LCxJoms4mjpK0iQRKA0TH9R58PQnGnubmBmiC-ER9aJYHuBhztb0kh9CO3mYEU1oRTmJChh_RF7dibOA0Rc Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:19:57.203903 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_edef03bc68bb49968039c234cfd5a556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/edef03bc68bb49968039c234cfd5a556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: edef03bc68bb49968039c234cfd5a556 Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311 Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4ae60e4432e446cfb7b96b2a647c7161 Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:19:57.205858 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance d52135d4-c308-473a-95c3-8e3493c11047 could not be found. Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd52135d4-c308-473a-95c3-8e3493c11047'} Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d52135d4-c308-473a-95c3-8e3493c11047 could not be found. Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:19:57.206765 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d52135d4-c308-473a-95c3-8e3493c11047 could not be found. Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d52135d4-c308-473a-95c3-8e3493c11047 could not be found. Nov 02 13:19:57.208331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:19:57.211261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] Returning 404 to user: Instance d52135d4-c308-473a-95c3-8e3493c11047 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:19:57.213118 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf26390a-bd24-4970-a07f-7b30165ce8f0 tempest-FloatingIPsAssociationNegativeTestJSON-8030311 tempest-FloatingIPsAssociationNegativeTestJSON-8030311-project] 10.222.0.113 "GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047" status: 404 len: 111 microversion: 2.1 time: 0.055645 Nov 02 13:19:57.217234 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 859/1857] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:57 2022] GET /compute/v2.1/servers/d52135d4-c308-473a-95c3-8e3493c11047 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:19:57.383696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:57.384159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:57.391102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.391579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.392148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.392989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.393546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.394088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.495567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:57.496599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:57.523434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.537138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.540521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.541544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.543156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.543625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.570949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:57.720288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:57.742725 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2d96926-3db5-450a-9eec-ab0bcbea96d8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1539 microversion: 2.1 time: 0.365265 Nov 02 13:19:57.755309 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 999/1858] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:57 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1539 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:57.774229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:57.774896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:57.784347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.785151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.785751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:57.786645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:57.787478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:57.788260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:58.008538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:58.023142 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-789dfe77-f6b3-431e-bc6c-129dc98e8a15 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1531 microversion: 2.1 time: 0.536688 Nov 02 13:19:58.024011 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 860/1859] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:57 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1531 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:58.033567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f883e331-6e63-4aa9-ade7-012f27e3a1bd req-e65c2a01-f611-4140-9739-c5910702259a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ec5001-5a75-4d28-bfa2-41e143233da4", "tag": "8ea20760-2efe-43bf-92b7-adb280bd5e8c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:19:58.045837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f883e331-6e63-4aa9-ade7-012f27e3a1bd req-e65c2a01-f611-4140-9739-c5910702259a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:58.047721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f883e331-6e63-4aa9-ade7-012f27e3a1bd req-e65c2a01-f611-4140-9739-c5910702259a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:58.048380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f883e331-6e63-4aa9-ade7-012f27e3a1bd req-e65c2a01-f611-4140-9739-c5910702259a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:58.071416 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f883e331-6e63-4aa9-ade7-012f27e3a1bd req-e65c2a01-f611-4140-9739-c5910702259a service nova] Creating event network-changed:8ea20760-2efe-43bf-92b7-adb280bd5e8c for instance 99ec5001-5a75-4d28-bfa2-41e143233da4 on n-h1-858384-19 Nov 02 13:19:58.074789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:58.078588 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f883e331-6e63-4aa9-ade7-012f27e3a1bd req-e65c2a01-f611-4140-9739-c5910702259a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051480 Nov 02 13:19:58.079431 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 861/1860] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:19:58.084736 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2aae43b-3ecf-4646-a2f4-d3294ce88c1e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.336169 Nov 02 13:19:58.104330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:58.106550 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1000/1861] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:57 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:58.109488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:58.129498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:58.129981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:58.130417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:58.131155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:58.131601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:58.132031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:58.228896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:58.230036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:58.246800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:58.247673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:58.248122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:58.249338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:58.250202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:58.250646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:58.398085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:58.406921 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a0f1eab-496d-460f-abb8-fa5b430f0da5 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.326057 Nov 02 13:19:58.423204 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 862/1862] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:58 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:58.584423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:58.613316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:58.616521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:58.619679 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd1a8f7b-cee8-40e7-8771-1af5dd38d7ae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.394205 Nov 02 13:19:58.635605 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1001/1863] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:19:58 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:19:58.785284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:58.785963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:58.803089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:58.803639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:58.804085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:58.808106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:58.809626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:58.810227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:59.046332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:59.047302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:59.060909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:59.061401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:59.061840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:59.070281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:59.071788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:59.072306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:59.354141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:59.368867 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-80ab30f9-5697-4da2-93d7-1790bcb0c200 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1532 microversion: 2.1 time: 0.592193 Nov 02 13:19:59.370407 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 863/1864] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:58 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1532 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:19:59.375612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:59.376589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:59.384570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:59.385311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:59.385971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:59.386889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:59.387580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:59.388365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:59.551384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:19:59.559982 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90d4668d-c3c0-4f4a-abff-99fc923069bb tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1531 microversion: 2.1 time: 0.517528 Nov 02 13:19:59.571844 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1002/1865] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:59 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1531 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:19:59.581877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:19:59.582859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:19:59.590299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:59.591050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:59.591793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:59.592767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:19:59.593494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:19:59.594168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:19:59.620245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:00.126340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:00.142868 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d78c576d-4831-4129-adba-823c8085e761 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.771130 Nov 02 13:20:00.143696 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 864/1866] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:59 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:00.149259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:00.158486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:00.174962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:00.175894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:00.176499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:00.177392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:00.178019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:00.178603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:00.470741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:00.480426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0fa503a-25a7-4138-8056-c13ffc8618a8 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.335370 Nov 02 13:20:00.487169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 865/1867] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:00 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:00.493809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:00.498391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:00.525710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:00.527822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:00.528524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:00.530274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:00.544964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:00.549558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:00.722313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:00.735659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8b800fc2-73d7-4e11-8d70-a1355c260673 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1532 microversion: 2.1 time: 1.159413 Nov 02 13:20:00.736847 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1003/1868] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:19:59 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1532 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:00.744691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-80f0cbc1-4b70-4fb5-815b-14c94b91df1f req-6cc29024-3a55-4928-a812-4c09132d8d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49", "name": "network-vif-plugged", "status": "completed", "tag": "abaa7e07-a933-4415-be82-70f57348ba75"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:00.762721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-80f0cbc1-4b70-4fb5-815b-14c94b91df1f req-6cc29024-3a55-4928-a812-4c09132d8d81 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:00.763616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-80f0cbc1-4b70-4fb5-815b-14c94b91df1f req-6cc29024-3a55-4928-a812-4c09132d8d81 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:00.764392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-80f0cbc1-4b70-4fb5-815b-14c94b91df1f req-6cc29024-3a55-4928-a812-4c09132d8d81 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:00.801119 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-80f0cbc1-4b70-4fb5-815b-14c94b91df1f req-6cc29024-3a55-4928-a812-4c09132d8d81 service nova] Creating event network-vif-plugged:abaa7e07-a933-4415-be82-70f57348ba75 for instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 on n-h2-858384-19 Nov 02 13:20:00.813046 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-80f0cbc1-4b70-4fb5-815b-14c94b91df1f req-6cc29024-3a55-4928-a812-4c09132d8d81 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071988 Nov 02 13:20:00.814541 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1004/1869] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:00.828020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:00.834844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:00.854750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:00.855720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:00.857226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:00.858479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:00.860373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:00.861492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:01.100233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:01.114709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:01.123402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:01.125191 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7ea8586-7496-474f-b846-8a863a72dba3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.636268 Nov 02 13:20:01.127933 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 866/1870] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:00 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:01.139623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-371ccd88-2a87-4f1a-b5bb-c4b00f40b262 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:01.152656 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-371ccd88-2a87-4f1a-b5bb-c4b00f40b262 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] HTTP exception thrown: Flavor eab6f2b4-4688-4663-9388-5ef7fcdc736f could not be found. Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-371ccd88-2a87-4f1a-b5bb-c4b00f40b262 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Request method failure captured: Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/flavors/eab6f2b4-4688-4663-9388-5ef7fcdc736f HTTP/1.1 Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1oHnTFFSU992EHld9llee3TLOWx7wucJ1Asgx_65Z4IPyccboWRRgz55-fvWpeWWaL9MGYEZwX9nexEJ9qVsVnEDvLZeXnTxfslBhzhrRNT__6XEPAjJeocggrxtbxz5nxXEYR6rbp6nQnwNKdBDimtpvIP9so0PVW-BDW0WkbQ3c Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 67f7da88e7a647eba214f7f9412eb94b Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-MigrationsAdminTest-1640309307 Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:20:01.168605 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/67f7da88e7a647eba214f7f9412eb94b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/67f7da88e7a647eba214f7f9412eb94b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_67f7da88e7a647eba214f7f9412eb94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/67f7da88e7a647eba214f7f9412eb94b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-MigrationsAdminTest-1640309307 Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 67f7da88e7a647eba214f7f9412eb94b Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-MigrationsAdminTest-1640309307 Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-MigrationsAdminTest-1640309307-project-admin Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 98378d3c8963463ba87042f3e7a3f89c Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-MigrationsAdminTest-1640309307-project-admin Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: exception: Flavor eab6f2b4-4688-4663-9388-5ef7fcdc736f could not be found. Nov 02 13:20:01.170181 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'eab6f2b4-4688-4663-9388-5ef7fcdc736f'} Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi flavor.destroy() Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor eab6f2b4-4688-4663-9388-5ef7fcdc736f could not be found. Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:01.171074 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor eab6f2b4-4688-4663-9388-5ef7fcdc736f could not be found. Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor eab6f2b4-4688-4663-9388-5ef7fcdc736f could not be found. Nov 02 13:20:01.173560 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:01.175614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-371ccd88-2a87-4f1a-b5bb-c4b00f40b262 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Returning 404 to user: Flavor eab6f2b4-4688-4663-9388-5ef7fcdc736f could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:01.175614 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-371ccd88-2a87-4f1a-b5bb-c4b00f40b262 tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/eab6f2b4-4688-4663-9388-5ef7fcdc736f" status: 404 len: 109 microversion: 2.1 time: 0.041310 Nov 02 13:20:01.175614 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 867/1871] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:20:01 2022] DELETE /compute/v2.1/flavors/eab6f2b4-4688-4663-9388-5ef7fcdc736f => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:01.206789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:01.209349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:01.223864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:01.224359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:01.224828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:01.225545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:01.230506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:01.230972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:01.518367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764311ce80524d08835261cf5ef6eff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c905a294fc3f4d9cbd7e95bea56d2977', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:01.543881 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e2d941f6-4aec-41f7-aad0-b63d43c12d0d tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 200 len: 1531 microversion: 2.1 time: 0.724829 Nov 02 13:20:01.549505 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1005/1872] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:00 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 1531 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:01.568437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2055016366", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:01.730028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:01.745253 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bffec9ce-8d49-4940-b54f-23222ce261ce tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.557165 Nov 02 13:20:01.745859 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 868/1873] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:01 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:01.771569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:20:01.776862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:01.776862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:01.791959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:01.794580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:01.795592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:01.800067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:01.801272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:01.801934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.324016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:02.344371 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-db538de9-49c6-4889-b8c2-cdd4cfe2e8a4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.576977 Nov 02 13:20:02.344965 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 869/1874] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:01 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:02.356511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-cd65fa24-9a1b-40e5-85a4-c60ef72c1886 req-e77a044d-094b-4c67-aca7-95bd1bf011b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3", "name": "network-vif-deleted", "tag": "5d56c13d-0813-4502-a471-d288abfc743b"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:02.389150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cd65fa24-9a1b-40e5-85a4-c60ef72c1886 req-e77a044d-094b-4c67-aca7-95bd1bf011b9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.390010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cd65fa24-9a1b-40e5-85a4-c60ef72c1886 req-e77a044d-094b-4c67-aca7-95bd1bf011b9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.391256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cd65fa24-9a1b-40e5-85a4-c60ef72c1886 req-e77a044d-094b-4c67-aca7-95bd1bf011b9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.409266 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-cd65fa24-9a1b-40e5-85a4-c60ef72c1886 req-e77a044d-094b-4c67-aca7-95bd1bf011b9 service nova] Creating event network-vif-deleted:5d56c13d-0813-4502-a471-d288abfc743b for instance 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 on n-h2-858384-19 Nov 02 13:20:02.416831 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-cd65fa24-9a1b-40e5-85a4-c60ef72c1886 req-e77a044d-094b-4c67-aca7-95bd1bf011b9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063839 Nov 02 13:20:02.417948 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 870/1875] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:02.425450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:02.426590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:02.438446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.438779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.439464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.440544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.441120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.441724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.474688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:20:02.475887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:20:02.476658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:20:02.477183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:20:02.477702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:20:02.489029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.489649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.490195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.491153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.492186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.492895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.534672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:20:02.543933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Getting quotas for user e7104fb14f5c430a8bfd7e6aa7ada5ee and project c4b5d1bcf8b043de8c000a8a7511c238. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:20:02.566288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:20:02.571639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:20:02.685569 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10a9f501-5998-4152-9222-10e75b7744f3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.132279 Nov 02 13:20:02.690198 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1006/1876] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:20:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:20:02.701548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:02.716351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] [instance: 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:02.737831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.738692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.739473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.740529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.741574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.742180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.803861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] HTTP exception thrown: Instance 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 could not be found. Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Request method failure captured: Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 HTTP/1.1 Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm5fP6ce15_y6-MvM5HVPVPP4v4rlWc7x7ZOq7Xvuh-LYCU2lvkQ3SiELPglvY2yqgLwuqqO7kN0XMNzoaCs6SFQtxH8Ii8c6128mVj_o9AVe7cO_lS-60nK1mjUrVC5kmYqcDc9_rzEU9cO-PjfGt-uAW7klO3OSMGg-QLdo1Dnr6o Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c905a294fc3f4d9cbd7e95bea56d2977 Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-293207409 Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:20:02.807568 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c905a294fc3f4d9cbd7e95bea56d2977"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-293207409 Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c905a294fc3f4d9cbd7e95bea56d2977 Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-293207409 Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-InstanceActionsNegativeTestJSON-293207409-project Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 764311ce80524d08835261cf5ef6eff0 Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-293207409-project Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 could not be found. Nov 02 13:20:02.809890 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3'} Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 could not be found. Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:02.810955 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 could not be found. Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 could not be found. Nov 02 13:20:02.813479 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:02.817978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] Returning 404 to user: Instance 52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:02.828649 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-adbac4f1-f9fa-4d9f-9e52-c045891fc716 tempest-InstanceActionsNegativeTestJSON-293207409 tempest-InstanceActionsNegativeTestJSON-293207409-project] 10.222.0.113 "GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3" status: 404 len: 111 microversion: 2.1 time: 0.126640 Nov 02 13:20:02.828649 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1007/1877] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:02 2022] GET /compute/v2.1/servers/52b9a7e1-d78b-4c15-bdf1-9611a1fea0c3 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:02.828649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca490235-1ab8-416c-b184-7b07bdab6781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:02.829262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ca490235-1ab8-416c-b184-7b07bdab6781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:02.937955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ca490235-1ab8-416c-b184-7b07bdab6781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:02.950587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:02.961997 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca490235-1ab8-416c-b184-7b07bdab6781 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1217 microversion: 2.1 time: 0.140266 Nov 02 13:20:02.962935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1008/1878] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:02 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1217 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:02.969844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:02.970616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:02.976386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:02.977921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:02.978732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.979346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.979861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.980643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:02.981176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:02.981676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:02.991030 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7dfc8a0e-b0e0-487d-99e5-65211390476c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.559853 Nov 02 13:20:02.991909 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 871/1879] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:02 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:03.396117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:03.398264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:03.427769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:03.431822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:03.432434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:03.435464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:03.437417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:03.439267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:03.440671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:03.458593 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f5d671bb-98bb-4ba7-982c-e4d4d5d5e704 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.494542 Nov 02 13:20:03.460641 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1009/1880] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:02 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:03.998703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:04.005607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:04.019148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:04.019757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:04.020341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:04.021172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:04.021711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:04.023740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:04.149201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:04.162045 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7343733-a4f6-4601-b803-1a3166430e6f tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.772247 Nov 02 13:20:04.164686 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 872/1881] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:03 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:04.172464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:04.173807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:04.183878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:04.184763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:04.185890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:04.187839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:04.188906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:04.189612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:04.203388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:04.220967 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3cd7b287-c9c2-47e9-a64e-7a7b1f8cc9cc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1269 microversion: 2.1 time: 0.232629 Nov 02 13:20:04.222729 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1010/1882] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:03 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1269 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:04.490789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:04.491686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:04.504481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:04.508332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:04.509319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:04.510436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:04.514606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:04.517087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:04.922978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:04.932064 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-46e43abe-1ab4-4972-a5c3-11f1e9a4e45b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.447023 Nov 02 13:20:04.947819 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1011/1883] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:04 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:05.189810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:05.192317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:05.200019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:05.200846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:05.201998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:05.203727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:05.204632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:05.205252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:05.424938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:05.436070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:05.439066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:05.440778 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63e18f88-63eb-4530-bc47-12be03a33367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 1.274866 Nov 02 13:20:05.442588 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 873/1884] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:04 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:05.450077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:05.451135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:05.463099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:05.465068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:05.465512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:05.466501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:05.467465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:05.468722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:05.649986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:05.654400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:05.671192 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-291f826b-c166-41db-947d-dc79d015a53d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1275 microversion: 2.1 time: 0.227134 Nov 02 13:20:05.683939 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d6faff78-3109-4418-ba92-312aafaa7524 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.501184 Nov 02 13:20:05.686562 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 874/1885] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:05 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:05.695794 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1012/1886] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:05 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:05.959612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:05.961019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:05.975451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:05.979885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:05.980707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:05.981791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:05.982492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:05.983213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:06.470144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:06.471543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:06.483349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:06.485925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:06.491896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:06.493025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:06.493746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:06.494698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:06.772612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:06.788944 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ee1bfd2-948f-4e1d-b3d0-2a2f5efd1164 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.832796 Nov 02 13:20:06.789939 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 875/1887] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:05 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:06.813392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:06.818254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:06.834394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:06.835015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:06.835599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:06.836445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:06.837575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:06.839316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:06.962811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:06.979132 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f548ede-7b5c-446f-bb88-f7a2d27c5be8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1275 microversion: 2.1 time: 0.170061 Nov 02 13:20:06.980127 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 876/1888] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:06 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:06.989742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:06.990360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:07.000782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:07.003815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:07.004484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:07.006508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:07.006982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:07.010989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:07.011821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:07.033431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:07.035827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:07.037765 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ed92457-7412-45d6-b5eb-2da9ca6ffd43 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.572684 Nov 02 13:20:07.055975 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1013/1889] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:06 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:20:07.416407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:07.430872 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b62d9f6b-e886-4747-8dec-64033d2b7784 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.449316 Nov 02 13:20:07.432046 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 877/1890] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:06 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:07.819641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:07.820268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:07.843637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:07.844176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:07.849892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:07.850701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:07.851279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:07.851723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:08.009549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:08.010737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:08.022136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:08.029913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:08.031839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:08.032976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:08.035236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:08.035866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:08.407571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:08.451395 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1dfaa53-cc12-48a1-b63e-3edeb7016ce9 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1720 microversion: 2.1 time: 0.637996 Nov 02 13:20:08.456959 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1014/1891] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:07 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1720 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:08.480249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:08.489263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:08.513917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:08.518929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:08.519636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:08.523026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:08.524963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:08.533988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:08.853023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:08.868024 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e02f5c2e-46bd-4fd7-b494-efbc459af8c0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.863549 Nov 02 13:20:08.879140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 878/1892] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:08 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:08.883796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:08.884701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:08.898751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:08.899486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:08.900206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:08.904751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:08.905255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:08.906281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:08.918508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:09.061145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:09.084597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:09.088744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:09.090950 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5893dd12-6a8e-4441-90ee-9d274872d823 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.632473 Nov 02 13:20:09.092564 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1015/1893] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:08 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:09.375916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:09.418520 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cb376cc8-879b-42b4-9b0d-b87092665f6a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.528706 Nov 02 13:20:09.426553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-2168f438-209c-4375-bfcd-bda87cb1816c req-cf648167-6807-41a1-9946-d68599e4031e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9141f9f7-e728-4dc2-b08d-896411699869", "tag": "707a33ab-8329-48d9-86bd-8bbe37d12038"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:09.440420 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 879/1894] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:08 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:09.445739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2168f438-209c-4375-bfcd-bda87cb1816c req-cf648167-6807-41a1-9946-d68599e4031e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:09.446458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2168f438-209c-4375-bfcd-bda87cb1816c req-cf648167-6807-41a1-9946-d68599e4031e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:09.449405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2168f438-209c-4375-bfcd-bda87cb1816c req-cf648167-6807-41a1-9946-d68599e4031e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:09.476825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-2168f438-209c-4375-bfcd-bda87cb1816c req-cf648167-6807-41a1-9946-d68599e4031e service nova] Creating event network-changed:707a33ab-8329-48d9-86bd-8bbe37d12038 for instance 9141f9f7-e728-4dc2-b08d-896411699869 on n-h2-858384-19 Nov 02 13:20:09.480660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:09.481586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:09.491552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-2168f438-209c-4375-bfcd-bda87cb1816c req-cf648167-6807-41a1-9946-d68599e4031e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067139 Nov 02 13:20:09.493203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:09.494448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:09.495369 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1016/1895] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:20:09.495930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:09.497205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:09.497877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:09.498519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:09.896998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:09.897710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:09.913047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:09.913047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:09.913262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:09.914789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:09.915480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:09.916122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:09.983190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:09.997436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-270f9b5a-23cc-4aa5-b0f0-b859e0395521 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1710 microversion: 2.1 time: 0.520919 Nov 02 13:20:09.998730 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 880/1896] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:09 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1710 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:10.038915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf249b71-50a7-4635-ba93-2f52124ebdfa tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '.version_select at 0x7fe78fa30670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:10.053707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf249b71-50a7-4635-ba93-2f52124ebdfa tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:10.063145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf249b71-50a7-4635-ba93-2f52124ebdfa tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:10.074074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf249b71-50a7-4635-ba93-2f52124ebdfa tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:10.139757 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf249b71-50a7-4635-ba93-2f52124ebdfa tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 3529 microversion: 2.1 time: 0.113822 Nov 02 13:20:10.142496 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 881/1897] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:20:10 2022] GET /compute/v2.1/os-migrations => generated 3529 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:10.152364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:10.154554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:10.190481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:10.191001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:10.197089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:10.197902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:10.198376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:10.198831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:10.380757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:10.404779 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a984e5da-5006-41bc-bf5a-b8cbd1eeaf12 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.511451 Nov 02 13:20:10.408527 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1017/1898] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:09 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:10.420693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ac09274-6040-4c9c-a5a6-85b06f971401 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:10.422399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ac09274-6040-4c9c-a5a6-85b06f971401 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:10.430774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac09274-6040-4c9c-a5a6-85b06f971401 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:10.431400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac09274-6040-4c9c-a5a6-85b06f971401 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:10.431926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac09274-6040-4c9c-a5a6-85b06f971401 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:10.432727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac09274-6040-4c9c-a5a6-85b06f971401 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:10.433295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac09274-6040-4c9c-a5a6-85b06f971401 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:10.433813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac09274-6040-4c9c-a5a6-85b06f971401 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:10.816923 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ac09274-6040-4c9c-a5a6-85b06f971401 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1863 microversion: 2.1 time: 0.401269 Nov 02 13:20:10.818708 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1018/1899] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:10 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1863 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:10.828876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:10.831686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:10.848448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:10.851184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:10.851928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:10.852857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:10.857871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:10.859699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:11.079498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:11.091054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:11.093083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:11.094909 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0a9221e5-5e3a-4b0a-8c69-aa527576fd8a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.949733 Nov 02 13:20:11.107963 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 882/1900] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:10 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:11.121331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e67140a4-66fe-4918-b064-c4c523519994 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:11.122323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e67140a4-66fe-4918-b064-c4c523519994 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:11.131284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e67140a4-66fe-4918-b064-c4c523519994 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:11.132045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e67140a4-66fe-4918-b064-c4c523519994 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:11.132723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e67140a4-66fe-4918-b064-c4c523519994 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:11.133811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e67140a4-66fe-4918-b064-c4c523519994 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:11.134499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e67140a4-66fe-4918-b064-c4c523519994 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:11.135168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e67140a4-66fe-4918-b064-c4c523519994 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:11.543662 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e67140a4-66fe-4918-b064-c4c523519994 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1863 microversion: 2.1 time: 0.433417 Nov 02 13:20:11.556354 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 883/1901] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:11 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1863 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:11.574237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:11.575412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:11.585474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:11.586525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:11.587068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:11.589690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:11.590748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:11.591663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:11.592628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:11.600968 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ecb45598-ac4d-41e3-9298-459f33a84d73 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.778527 Nov 02 13:20:11.604054 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1019/1902] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:10 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:11.680512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:11.681313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:11.689301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:11.690144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:11.690805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:11.692011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:11.692893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:11.693783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:11.926495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lazy-loading 'services' on Instance uuid 9f8f4a4c-224d-4a42-9b89-dadf667e644b {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:20:12.015382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:12.045765 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-230f56e7-b481-439e-98cd-580a49effb22 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.469837 Nov 02 13:20:12.052156 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 884/1903] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:11 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:12.067211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e37f7b2a-ef9b-438e-af23-673256c18267 req-2bda23a1-5da3-4543-b34f-8b89878e424a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ec5001-5a75-4d28-bfa2-41e143233da4", "name": "network-vif-plugged", "status": "completed", "tag": "7b9f5560-882f-41cd-b9da-8ccb8964d3ee"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:12.097491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e37f7b2a-ef9b-438e-af23-673256c18267 req-2bda23a1-5da3-4543-b34f-8b89878e424a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.098938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e37f7b2a-ef9b-438e-af23-673256c18267 req-2bda23a1-5da3-4543-b34f-8b89878e424a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.099638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e37f7b2a-ef9b-438e-af23-673256c18267 req-2bda23a1-5da3-4543-b34f-8b89878e424a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.119059 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e37f7b2a-ef9b-438e-af23-673256c18267 req-2bda23a1-5da3-4543-b34f-8b89878e424a service nova] Creating event network-vif-plugged:7b9f5560-882f-41cd-b9da-8ccb8964d3ee for instance 99ec5001-5a75-4d28-bfa2-41e143233da4 on n-h1-858384-19 Nov 02 13:20:12.127503 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e37f7b2a-ef9b-438e-af23-673256c18267 req-2bda23a1-5da3-4543-b34f-8b89878e424a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073153 Nov 02 13:20:12.128925 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 885/1904] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:12.135498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:12.136591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:12.145326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.146136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.146852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.147997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.148689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.149485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.185301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:20:12.242737 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-23ca1b02-1aae-4476-9cfa-aaca97376c65 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments/6a37a2cf-a744-41f4-b4fc-8c9b038f0a17" status: 202 len: 0 microversion: 2.1 time: 0.566641 Nov 02 13:20:12.243838 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1020/1905] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:20:11 2022] DELETE /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments/6a37a2cf-a744-41f4-b4fc-8c9b038f0a17 => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:20:12.261081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:12.262991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:12.283203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.287285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.289416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.301129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.304726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.306406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.416633 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7fad4cab-83fc-4418-8dea-449795395c5a tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 204 len: 0 microversion: 2.1 time: 0.285529 Nov 02 13:20:12.417642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 886/1906] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:20:12 2022] DELETE /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:20:12.440390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a931db6c-a956-41b2-bf8a-37ab2f2818ff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:12.449313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a931db6c-a956-41b2-bf8a-37ab2f2818ff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:12.462551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a931db6c-a956-41b2-bf8a-37ab2f2818ff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.466266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a931db6c-a956-41b2-bf8a-37ab2f2818ff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.467306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a931db6c-a956-41b2-bf8a-37ab2f2818ff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.470847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a931db6c-a956-41b2-bf8a-37ab2f2818ff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.471613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a931db6c-a956-41b2-bf8a-37ab2f2818ff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.473979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a931db6c-a956-41b2-bf8a-37ab2f2818ff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.511043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:12.544386 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a931db6c-a956-41b2-bf8a-37ab2f2818ff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121453 Nov 02 13:20:12.547476 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 887/1907] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:20:12 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:12.560019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:12.568399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:12.577054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.578228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.579249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.579916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.581505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.581505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.825324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:12.839412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:12.847811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:12.850991 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-884ebbd0-858a-4928-b4df-c55106668b79 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.604271 Nov 02 13:20:12.852360 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1021/1908] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:12 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:12.866377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:12.867363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:12.878527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:12.887960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.891295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.891934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.900246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:12.900982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:12.901706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:12.946041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:12.957017 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1dd4fcd2-68ae-41d1-a3b6-feba5cffe36d tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1670 microversion: 2.1 time: 0.408036 Nov 02 13:20:12.957689 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 888/1909] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:12 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1670 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:12.965459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:13.083067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:13.084118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:13.092465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:13.093656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:13.094381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:13.096815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:13.097556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:13.098788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:13.255036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:13.273196 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a0929c41-9b21-4c27-9214-7d5c0c12eab4 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.417809 Nov 02 13:20:13.273816 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1022/1910] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:12 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:13.562749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8750925-6552-4772-b777-1ebf9adc7199 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:13.572321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8750925-6552-4772-b777-1ebf9adc7199 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:13.589496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8750925-6552-4772-b777-1ebf9adc7199 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:13.590442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8750925-6552-4772-b777-1ebf9adc7199 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:13.591125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8750925-6552-4772-b777-1ebf9adc7199 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:13.592364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8750925-6552-4772-b777-1ebf9adc7199 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:13.595099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8750925-6552-4772-b777-1ebf9adc7199 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:13.595808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8750925-6552-4772-b777-1ebf9adc7199 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:13.607984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:13.610454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:13.627059 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9abbdfd8-1c9c-4e75-9ca2-227aadb4e1f1 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.548955 Nov 02 13:20:13.629005 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 889/1911] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:13 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:13.715359 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8750925-6552-4772-b777-1ebf9adc7199 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155502 Nov 02 13:20:13.718990 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1023/1912] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:20:13 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:13.885529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:13.886398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:13.897381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:13.897987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:13.899857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:13.902314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:13.903753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:13.904311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:13.983353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:13.984716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:13.999413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.003559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.004273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.005304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.006000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.007588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.236843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:14.248510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:14.250957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:14.252483 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-544ef6ff-7585-4744-ab11-960c6dc4dcaf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.372130 Nov 02 13:20:14.253295 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 890/1913] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:13 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:20:14.258294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-82c79235-cea4-48b2-9f5a-d794684037de req-89bdae8d-8994-4470-a74f-2c6b2642798a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ec5001-5a75-4d28-bfa2-41e143233da4", "name": "network-vif-plugged", "status": "completed", "tag": "8ea20760-2efe-43bf-92b7-adb280bd5e8c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:14.270267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82c79235-cea4-48b2-9f5a-d794684037de req-89bdae8d-8994-4470-a74f-2c6b2642798a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.271139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82c79235-cea4-48b2-9f5a-d794684037de req-89bdae8d-8994-4470-a74f-2c6b2642798a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.271801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82c79235-cea4-48b2-9f5a-d794684037de req-89bdae8d-8994-4470-a74f-2c6b2642798a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.285516 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-82c79235-cea4-48b2-9f5a-d794684037de req-89bdae8d-8994-4470-a74f-2c6b2642798a service nova] Creating event network-vif-plugged:8ea20760-2efe-43bf-92b7-adb280bd5e8c for instance 99ec5001-5a75-4d28-bfa2-41e143233da4 on n-h1-858384-19 Nov 02 13:20:14.292459 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-82c79235-cea4-48b2-9f5a-d794684037de req-89bdae8d-8994-4470-a74f-2c6b2642798a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037618 Nov 02 13:20:14.293674 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 891/1914] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:14.300513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:14.301565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:14.317951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.318694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.319371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.320405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.321014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.321598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.499865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:14.520979 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a546dcdb-9dfa-4a27-8950-a560e6b1e141 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1670 microversion: 2.1 time: 0.541709 Nov 02 13:20:14.521878 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1024/1915] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:13 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1670 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:14.655483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:14.658462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:14.666702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.667496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.668186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.669140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.670108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.670763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.823344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:14.836468 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6a69c2f5-e10d-448e-a678-e1333d0a3df1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.540152 Nov 02 13:20:14.838991 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 892/1916] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:14 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:14.854999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cdfeaa09-d100-4636-acef-927917806d14 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:14.861592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cdfeaa09-d100-4636-acef-927917806d14 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:14.877391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdfeaa09-d100-4636-acef-927917806d14 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.879340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdfeaa09-d100-4636-acef-927917806d14 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.880688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdfeaa09-d100-4636-acef-927917806d14 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.881801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdfeaa09-d100-4636-acef-927917806d14 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:14.883818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdfeaa09-d100-4636-acef-927917806d14 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:14.884510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdfeaa09-d100-4636-acef-927917806d14 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:14.986476 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cdfeaa09-d100-4636-acef-927917806d14 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138083 Nov 02 13:20:14.995982 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 893/1917] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:20:14 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:15.232130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:15.251025 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-24c65294-c878-4b59-9604-cc0aa1f355fc tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.599531 Nov 02 13:20:15.251763 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1025/1918] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:14 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:15.284580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:15.285417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:15.293814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:15.294871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:15.295576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:15.297219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:15.298014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:15.298676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:15.545085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:15.545713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:15.558975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:15.559509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:15.562706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:15.573987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:15.574760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:15.575466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:15.578880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:15.594666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:15.596489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:15.597927 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03369b9f-780b-4a1e-876c-4b933877de9f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.321249 Nov 02 13:20:15.599061 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 894/1919] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:15 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:15.866169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:15.866946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:15.870139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:15.878651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:15.889611 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f28dbc05-bff6-4d7e-98a4-1b70a14db084 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1670 microversion: 2.1 time: 0.348278 Nov 02 13:20:15.890080 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1026/1920] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:15 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1670 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:15.895678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:15.896205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:15.896645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:15.897359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:15.897808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:15.898234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:16.009125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df9f1cc3-c06c-453c-8415-4963fa3cf760 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:16.011973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df9f1cc3-c06c-453c-8415-4963fa3cf760 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:16.022348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9f1cc3-c06c-453c-8415-4963fa3cf760 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:16.023836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9f1cc3-c06c-453c-8415-4963fa3cf760 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:16.024618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9f1cc3-c06c-453c-8415-4963fa3cf760 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:16.025593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9f1cc3-c06c-453c-8415-4963fa3cf760 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:16.026333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9f1cc3-c06c-453c-8415-4963fa3cf760 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:16.026976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9f1cc3-c06c-453c-8415-4963fa3cf760 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:16.082910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df9f1cc3-c06c-453c-8415-4963fa3cf760 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078136 Nov 02 13:20:16.088982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1027/1921] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:20:16 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:20:16.275146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:16.277664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:16.287311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:16.288119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:16.288752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:16.289703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:16.290352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:16.290965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:16.349424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:16.360514 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cea03d47-2d0c-4a6d-a94f-cb305dd13b0c tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1337 microversion: 2.1 time: 0.499749 Nov 02 13:20:16.365885 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 895/1922] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:15 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1337 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:16.558535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:16.567261 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-646924f3-9e58-4618-a860-e8a8ae724719 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.296833 Nov 02 13:20:16.567971 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1028/1923] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:16 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:16.629235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:16.629998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:16.637030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:16.637663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:16.638922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:16.640052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:16.640990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:16.641658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:16.644871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:17.002137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2be2564-37b0-4a72-b75e-e85df07c8467 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1644421402", "ram": 512, "vcpus": 1, "disk": 10, "id": 1797049579, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:17.042902 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2be2564-37b0-4a72-b75e-e85df07c8467 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.267932 Nov 02 13:20:17.044254 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1029/1924] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:20:16 2022] POST /compute/v2.1/flavors => generated 418 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:17.051346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:17.052184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:17.061863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.062652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.063304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:17.064347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.064963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.065580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:17.145997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:17.156261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:17.166983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:17.170142 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6325d09e-af1f-4175-bee9-193de333a6d4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.545919 Nov 02 13:20:17.173052 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 896/1925] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:16 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:17.179056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60a79387-40f8-46b4-a599-622543681770 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:17.238572 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60a79387-40f8-46b4-a599-622543681770 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/1797049579/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.061682 Nov 02 13:20:17.240591 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 897/1926] 10.222.0.113 () {60 vars in 1229 bytes} [Wed Nov 2 13:20:17 2022] POST /compute/v2.1/flavors/1797049579/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:17.262584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c1496cef-c9dd-4a49-a425-13e59920ef09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:17.269613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c1496cef-c9dd-4a49-a425-13e59920ef09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:17.288079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1496cef-c9dd-4a49-a425-13e59920ef09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.288828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1496cef-c9dd-4a49-a425-13e59920ef09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.289431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1496cef-c9dd-4a49-a425-13e59920ef09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:17.290338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1496cef-c9dd-4a49-a425-13e59920ef09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.290957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1496cef-c9dd-4a49-a425-13e59920ef09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.291566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1496cef-c9dd-4a49-a425-13e59920ef09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:17.301048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:17.312937 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e2fb414e-f00c-4477-b769-f31d5a0d6e55 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1670 microversion: 2.1 time: 0.266269 Nov 02 13:20:17.313837 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1030/1927] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:17 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1670 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:17.363804 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c1496cef-c9dd-4a49-a425-13e59920ef09 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117668 Nov 02 13:20:17.364806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 898/1928] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:20:17 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:17.394242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:17.395059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:17.403376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.404091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.404802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:17.407566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.408674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.409813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:17.513296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d8d45fcf-463b-4d57-a99e-53f6297d5bab tempest-FlavorsExtraSpecsTestJSON-1343178541 tempest-FlavorsExtraSpecsTestJSON-1343178541-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:17.535294 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d8d45fcf-463b-4d57-a99e-53f6297d5bab tempest-FlavorsExtraSpecsTestJSON-1343178541 tempest-FlavorsExtraSpecsTestJSON-1343178541-project] 10.222.0.113 "GET /compute/v2.1/flavors/1797049579/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.220116 Nov 02 13:20:17.536186 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1031/1929] 10.222.0.113 () {58 vars in 1208 bytes} [Wed Nov 2 13:20:17 2022] GET /compute/v2.1/flavors/1797049579/os-extra_specs => generated 66 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:17.553462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e40ee454-92a4-4e78-aa72-1b29a026f2ca tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:17.598703 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e40ee454-92a4-4e78-aa72-1b29a026f2ca tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/1797049579/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054271 Nov 02 13:20:17.605033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1032/1930] 10.222.0.113 () {60 vars in 1229 bytes} [Wed Nov 2 13:20:17 2022] POST /compute/v2.1/flavors/1797049579/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:17.612289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:17.613752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:17.620810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.621638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.622244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:17.623287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:17.623952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:17.624606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.132550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:18.156292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47d6481e-daf2-4be9-8f62-c8629adbaf70 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.548599 Nov 02 13:20:18.187324 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1033/1931] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:17 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:18.215298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-60f5ee42-0dfa-41d5-9787-f6a6ff357a88 tempest-FlavorsExtraSpecsTestJSON-1343178541 tempest-FlavorsExtraSpecsTestJSON-1343178541-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:18.281028 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-60f5ee42-0dfa-41d5-9787-f6a6ff357a88 tempest-FlavorsExtraSpecsTestJSON-1343178541 tempest-FlavorsExtraSpecsTestJSON-1343178541-project] 10.222.0.113 "GET /compute/v2.1/flavors/1797049579/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.090972 Nov 02 13:20:18.283980 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1034/1932] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:20:18 2022] GET /compute/v2.1/flavors/1797049579/os-extra_specs/hw:numa_nodes => generated 22 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:18.314276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:18.328148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:18.353741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.354908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.356112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.357763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.360204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.361222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.399639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:18.413594 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e389c8db-2f82-49c0-9e56-5db858071900 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1670 microversion: 2.1 time: 1.024738 Nov 02 13:20:18.431669 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 899/1933] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:17 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1670 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:18.460234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8defe518-03d9-4d85-80c7-b2ab46d3dcbc tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:18.513169 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8defe518-03d9-4d85-80c7-b2ab46d3dcbc tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors/1797049579/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080204 Nov 02 13:20:18.514158 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 900/1934] 10.222.0.113 () {60 vars in 1229 bytes} [Wed Nov 2 13:20:18 2022] POST /compute/v2.1/flavors/1797049579/os-extra_specs => generated 66 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:18.519660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:18.520577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:18.537699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.538538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.539257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:18.540210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:18.551956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:18.552789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.038679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:19.057916 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ac06a5d-0dcf-42e4-b08a-02cf5def333e tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1602 microversion: 2.1 time: 0.541891 Nov 02 13:20:19.058674 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 901/1935] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:18 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1602 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:19.064254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2f12da56-a29b-43e0-b0e4-8f79f0aa1193 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:19.066541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2f12da56-a29b-43e0-b0e4-8f79f0aa1193 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:19.085188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f12da56-a29b-43e0-b0e4-8f79f0aa1193 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.085188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f12da56-a29b-43e0-b0e4-8f79f0aa1193 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.086078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f12da56-a29b-43e0-b0e4-8f79f0aa1193 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.086828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f12da56-a29b-43e0-b0e4-8f79f0aa1193 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.087418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f12da56-a29b-43e0-b0e4-8f79f0aa1193 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.087937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f12da56-a29b-43e0-b0e4-8f79f0aa1193 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.158414 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2f12da56-a29b-43e0-b0e4-8f79f0aa1193 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098539 Nov 02 13:20:19.164785 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 902/1936] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:20:19 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:19.172533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62f5dcf7-6461-4bb2-98a8-30360d884edc tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:19.173341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-62f5dcf7-6461-4bb2-98a8-30360d884edc tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:19.194157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f5dcf7-6461-4bb2-98a8-30360d884edc tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.194803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f5dcf7-6461-4bb2-98a8-30360d884edc tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.195488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f5dcf7-6461-4bb2-98a8-30360d884edc tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.196310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f5dcf7-6461-4bb2-98a8-30360d884edc tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.196847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f5dcf7-6461-4bb2-98a8-30360d884edc tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.197636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f5dcf7-6461-4bb2-98a8-30360d884edc tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.251609 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62f5dcf7-6461-4bb2-98a8-30360d884edc tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4/ips" status: 200 len: 177 microversion: 2.1 time: 0.085525 Nov 02 13:20:19.256529 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 903/1937] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:20:19 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4/ips => generated 177 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:19.268440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-179971e7-34a5-4867-b672-1aa519957661 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:19.302150 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-179971e7-34a5-4867-b672-1aa519957661 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/1797049579/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038125 Nov 02 13:20:19.305066 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 904/1938] 10.222.0.113 () {58 vars in 1208 bytes} [Wed Nov 2 13:20:19 2022] GET /compute/v2.1/flavors/1797049579/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:19.313830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:19.320073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:19.337626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.338430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.339073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.342136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.343036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.343675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.826681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:19.835716 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c9cfb20-8d69-4544-9a62-938254e06612 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.529082 Nov 02 13:20:19.840836 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 905/1939] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:19 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:19.866590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:19.868921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:19.883181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.885194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.885194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.886202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:19.886819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:19.887459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:19.925329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:19.947088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:19.948770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:20:19.954179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:19.960145 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b1cbb59f-926c-4434-859f-5561ab4f84e9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 1.670955 Nov 02 13:20:19.964141 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1035/1940] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:18 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:19.973323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-237c69b5-29d9-4403-8369-27b421322569 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:20.075387 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-237c69b5-29d9-4403-8369-27b421322569 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "PUT /compute/v2.1/flavors/1797049579/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.110051 Nov 02 13:20:20.081754 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1036/1941] 10.222.0.113 () {60 vars in 1270 bytes} [Wed Nov 2 13:20:19 2022] PUT /compute/v2.1/flavors/1797049579/os-extra_specs/hw:numa_nodes => generated 22 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:20.091834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a9f3650d-0d40-4714-9fe7-64737abbfef2 req-ce309411-82ca-4f6e-8e4e-d3f4c1ac5fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ab01f1-89f5-420d-b86d-e5acf742c5af", "name": "network-vif-deleted", "tag": "2e8c4e11-04bc-4c12-a44f-c34d5f883b06"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:20.156999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a9f3650d-0d40-4714-9fe7-64737abbfef2 req-ce309411-82ca-4f6e-8e4e-d3f4c1ac5fb6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.157526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a9f3650d-0d40-4714-9fe7-64737abbfef2 req-ce309411-82ca-4f6e-8e4e-d3f4c1ac5fb6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.166391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a9f3650d-0d40-4714-9fe7-64737abbfef2 req-ce309411-82ca-4f6e-8e4e-d3f4c1ac5fb6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:20.196414 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b18257a-7e47-4ca9-94f1-b9d55a86666a tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "DELETE /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 204 len: 0 microversion: 2.1 time: 0.353498 Nov 02 13:20:20.198809 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 906/1942] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:20:19 2022] DELETE /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:20:20.211735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cfc10f23-b232-405f-b79a-5b279af2e0a9 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:20.233256 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a9f3650d-0d40-4714-9fe7-64737abbfef2 req-ce309411-82ca-4f6e-8e4e-d3f4c1ac5fb6 service nova] Creating event network-vif-deleted:2e8c4e11-04bc-4c12-a44f-c34d5f883b06 for instance f3ab01f1-89f5-420d-b86d-e5acf742c5af on n-h2-858384-19 Nov 02 13:20:20.245840 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cfc10f23-b232-405f-b79a-5b279af2e0a9 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/1797049579/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045556 Nov 02 13:20:20.246121 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a9f3650d-0d40-4714-9fe7-64737abbfef2 req-ce309411-82ca-4f6e-8e4e-d3f4c1ac5fb6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158406 Nov 02 13:20:20.246453 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 907/1943] 10.222.0.113 () {58 vars in 1208 bytes} [Wed Nov 2 13:20:20 2022] GET /compute/v2.1/flavors/1797049579/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:20.249132 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1037/1944] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:20.266326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:20.267068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:20.270161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a5866f4e-1b9e-4a00-93d8-8661c2c95302 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:20.275604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a5866f4e-1b9e-4a00-93d8-8661c2c95302 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:20.294813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.297851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.300152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:20.301314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.304115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.304791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:20.305346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5866f4e-1b9e-4a00-93d8-8661c2c95302 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.306680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5866f4e-1b9e-4a00-93d8-8661c2c95302 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.307169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5866f4e-1b9e-4a00-93d8-8661c2c95302 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:20.311002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5866f4e-1b9e-4a00-93d8-8661c2c95302 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.311684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5866f4e-1b9e-4a00-93d8-8661c2c95302 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.312141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5866f4e-1b9e-4a00-93d8-8661c2c95302 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:20.395909 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a5866f4e-1b9e-4a00-93d8-8661c2c95302 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136039 Nov 02 13:20:20.400792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.401523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.402131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:20.403455 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1038/1945] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:20:20 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:20.404798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lazy-loading 'fault' on Instance uuid f3ab01f1-89f5-420d-b86d-e5acf742c5af {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:20:20.416568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:20.418618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:20.432020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.434172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.434943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:20.439512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:20.440327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:20.440998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:20.562581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1f45ad62823445d8db546ac71b7f6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd6b6d6701aa4a5fb5354b7b812b4f66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:20.572188 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-611c1644-b253-45ee-aa48-66b1b92d3fa3 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 200 len: 1319 microversion: 2.1 time: 0.323415 Nov 02 13:20:20.590243 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 908/1946] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:20 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:20.614404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6fa489e-7cfb-4416-83d1-450eb234ba2a tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:20.710924 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6fa489e-7cfb-4416-83d1-450eb234ba2a tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1797049579/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.104138 Nov 02 13:20:20.716087 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 909/1947] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:20:20 2022] DELETE /compute/v2.1/flavors/1797049579/os-extra_specs/hw:numa_nodes => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:20:20.724316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6baab64-ae32-473a-9736-08bbd4926dfb tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:20.795172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6baab64-ae32-473a-9736-08bbd4926dfb tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1797049579/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.074299 Nov 02 13:20:20.798362 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 910/1948] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:20:20 2022] DELETE /compute/v2.1/flavors/1797049579/os-extra_specs/hw:cpu_policy => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:20:20.814804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ac3fb09-742f-4cba-8de6-a5fa7f795dc8 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:20.839772 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ac3fb09-742f-4cba-8de6-a5fa7f795dc8 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/1797049579/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033947 Nov 02 13:20:20.847203 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 911/1949] 10.222.0.113 () {58 vars in 1208 bytes} [Wed Nov 2 13:20:20 2022] GET /compute/v2.1/flavors/1797049579/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:20.852718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3c31f5fe-0dde-43a1-8110-11a70423da51 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:20.891854 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3c31f5fe-0dde-43a1-8110-11a70423da51 tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1797049579" status: 202 len: 0 microversion: 2.1 time: 0.042792 Nov 02 13:20:20.896517 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 912/1950] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:20:20 2022] DELETE /compute/v2.1/flavors/1797049579 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:20:21.205076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:21.205702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:21.229581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.230112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.230552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.231302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.231807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.232252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.294286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:21.320126 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9359ace0-4956-47a6-8a74-3e29653e1ae7 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1676 microversion: 2.1 time: 0.915022 Nov 02 13:20:21.322645 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1039/1951] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:20 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1676 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:21.331515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff6c7674-6d7c-41bb-af23-4fadfd72343d tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:21.423153 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff6c7674-6d7c-41bb-af23-4fadfd72343d tempest-FlavorsExtraSpecsTestJSON-1262725369 tempest-FlavorsExtraSpecsTestJSON-1262725369-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.099088 Nov 02 13:20:21.424018 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1040/1952] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:20:21 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:21.451250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c1376513-1912-4313-951c-6b89494960b3 req-b5ed1121-c1af-4f02-beb3-0c3c1bf22b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9141f9f7-e728-4dc2-b08d-896411699869", "name": "network-vif-plugged", "status": "completed", "tag": "707a33ab-8329-48d9-86bd-8bbe37d12038"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:21.518652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c1376513-1912-4313-951c-6b89494960b3 req-b5ed1121-c1af-4f02-beb3-0c3c1bf22b77 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.520743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c1376513-1912-4313-951c-6b89494960b3 req-b5ed1121-c1af-4f02-beb3-0c3c1bf22b77 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.527956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c1376513-1912-4313-951c-6b89494960b3 req-b5ed1121-c1af-4f02-beb3-0c3c1bf22b77 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.583081 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c1376513-1912-4313-951c-6b89494960b3 req-b5ed1121-c1af-4f02-beb3-0c3c1bf22b77 service nova] Creating event network-vif-plugged:707a33ab-8329-48d9-86bd-8bbe37d12038 for instance 9141f9f7-e728-4dc2-b08d-896411699869 on n-h2-858384-19 Nov 02 13:20:21.604545 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c1376513-1912-4313-951c-6b89494960b3 req-b5ed1121-c1af-4f02-beb3-0c3c1bf22b77 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178035 Nov 02 13:20:21.605166 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1041/1953] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:21.611068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:21.624847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:21.629472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:21.644540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.652469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.657376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.658380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.659044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.659689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.696158 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a392bd9-4281-49fb-9217-4bdaf85ceac3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.793785 Nov 02 13:20:21.699564 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 913/1954] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:20 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:21.722833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a367425-a2f3-40c7-b2f2-ef33c7d7b601 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:21.725148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a367425-a2f3-40c7-b2f2-ef33c7d7b601 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:21.757240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a367425-a2f3-40c7-b2f2-ef33c7d7b601 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.757749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a367425-a2f3-40c7-b2f2-ef33c7d7b601 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.758198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a367425-a2f3-40c7-b2f2-ef33c7d7b601 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.758986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a367425-a2f3-40c7-b2f2-ef33c7d7b601 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.759488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a367425-a2f3-40c7-b2f2-ef33c7d7b601 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.761125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a367425-a2f3-40c7-b2f2-ef33c7d7b601 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.836660 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a367425-a2f3-40c7-b2f2-ef33c7d7b601 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133103 Nov 02 13:20:21.837761 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 914/1955] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:20:21 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:21.845952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:21.847026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] [instance: f3ab01f1-89f5-420d-b86d-e5acf742c5af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:21.863460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.863990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.865099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.865873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:21.867665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:21.869573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:21.917015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] HTTP exception thrown: Instance f3ab01f1-89f5-420d-b86d-e5acf742c5af could not be found. Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Request method failure captured: Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af HTTP/1.1 Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm4P1lkXw3Jv3JV5zoGf2pr8dtAmOIIuNYoc-RxzNy0oIpa3sKjoEJXDainXnt9jIDzR8SqcUIY_dEcp2WPjJgGidlUmX7e1Y-mf8RPwGayh4ZZEjpj4wLCNop_5QN8ay88J21fT_8pWzhyNICqKuk-QLk6b9ilyZPXx_cHFNRNNUWU Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: fd6b6d6701aa4a5fb5354b7b812b4f66 Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestFqdnHostnames-231727242 Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:20:21.921303 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fd6b6d6701aa4a5fb5354b7b812b4f66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fd6b6d6701aa4a5fb5354b7b812b4f66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_fd6b6d6701aa4a5fb5354b7b812b4f66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/fd6b6d6701aa4a5fb5354b7b812b4f66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestFqdnHostnames-231727242 Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: fd6b6d6701aa4a5fb5354b7b812b4f66 Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-231727242 Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestFqdnHostnames-231727242-project Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: b1f45ad62823445d8db546ac71b7f6af Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestFqdnHostnames-231727242-project Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f3ab01f1-89f5-420d-b86d-e5acf742c5af could not be found. Nov 02 13:20:21.922909 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f3ab01f1-89f5-420d-b86d-e5acf742c5af'} Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ab01f1-89f5-420d-b86d-e5acf742c5af could not be found. Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:21.923794 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ab01f1-89f5-420d-b86d-e5acf742c5af could not be found. Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ab01f1-89f5-420d-b86d-e5acf742c5af could not be found. Nov 02 13:20:21.925141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:21.926332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Returning 404 to user: Instance f3ab01f1-89f5-420d-b86d-e5acf742c5af could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:21.926413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6c41885-f110-4cd8-92f9-5fe4238f24f4 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af" status: 404 len: 111 microversion: 2.1 time: 0.083502 Nov 02 13:20:21.928169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 915/1956] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:21 2022] GET /compute/v2.1/servers/f3ab01f1-89f5-420d-b86d-e5acf742c5af => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:21.940315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-887c034f-1014-4130-942c-77ea4b48bf34 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] Calling method '.version_select at 0x7fe78f9fb040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:21.982400 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-887c034f-1014-4130-942c-77ea4b48bf34 tempest-ServersTestFqdnHostnames-231727242 tempest-ServersTestFqdnHostnames-231727242-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794208347" status: 202 len: 0 microversion: 2.1 time: 0.049004 Nov 02 13:20:21.983846 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 916/1957] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794208347 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:20:22.605573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d7522dbf-41dc-450c-ba5a-f7a0b2548f9f tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Action: 'create', calling method: .version_select at 0x7fe78f863ee0>, body: {"pool": null} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:22.674138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:22.688573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:22.697181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:22.698659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-843d19ae-653a-4c7f-bc14-e3e4ea2005a7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 1.083708 Nov 02 13:20:22.701406 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1042/1958] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:21 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:22.714016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:22.716591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:22.733755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:22.734011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:22.734429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:22.737375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:22.738033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:22.738666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:23.219316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:23.240374 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f5fb8ad3-27c5-4df3-899c-0eb3937e22ea tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1676 microversion: 2.1 time: 0.529720 Nov 02 13:20:23.241329 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1043/1959] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:22 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1676 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:23.258571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:23.267396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:23.285884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:23.295048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:23.302765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:23.303780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:23.304505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:23.305063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:23.623069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:23.635853 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05d43f5d-4f0a-4930-ab0d-ee7e926f97b6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1317 microversion: 2.1 time: 0.390393 Nov 02 13:20:23.637227 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1044/1960] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:23 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:23.648552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61c00a1f-52d5-412b-bbb7-a8c4b549c1ed tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:23.655746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-61c00a1f-52d5-412b-bbb7-a8c4b549c1ed tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:23.694853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61c00a1f-52d5-412b-bbb7-a8c4b549c1ed tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:23.697555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61c00a1f-52d5-412b-bbb7-a8c4b549c1ed tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:23.698020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61c00a1f-52d5-412b-bbb7-a8c4b549c1ed tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:23.700910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61c00a1f-52d5-412b-bbb7-a8c4b549c1ed tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:23.701420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61c00a1f-52d5-412b-bbb7-a8c4b549c1ed tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:23.702021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61c00a1f-52d5-412b-bbb7-a8c4b549c1ed tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:23.766904 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-61c00a1f-52d5-412b-bbb7-a8c4b549c1ed tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122833 Nov 02 13:20:23.769307 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1045/1961] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:20:23 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:23.778700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:23.783764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:23.797299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:23.800868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:23.802457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:23.804569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:23.808177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:23.809053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:24.485861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:24.500424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:24.506505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:24.508535 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d654129c-0ae5-4b4b-9be4-8452d56a08da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.737987 Nov 02 13:20:24.512395 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1046/1962] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:23 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:24.521669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:24.522677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:24.567343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:24.568320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:24.568981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:24.569921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:24.570601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:24.571302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:24.576313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:24.989558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:25.000298 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3df1cf4d-8852-4319-a3ba-115538b24c28 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1655 microversion: 2.1 time: 0.485261 Nov 02 13:20:25.009203 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1047/1963] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:24 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1655 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:25.029611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-63d82102-f258-4c99-82f5-17eeffe4218a req-dba338b5-ab28-4c2c-a83b-a4644e0cd410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ec5001-5a75-4d28-bfa2-41e143233da4", "name": "network-vif-deleted", "tag": "7b9f5560-882f-41cd-b9da-8ccb8964d3ee"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:25.076632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-63d82102-f258-4c99-82f5-17eeffe4218a req-dba338b5-ab28-4c2c-a83b-a4644e0cd410 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:25.078840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-63d82102-f258-4c99-82f5-17eeffe4218a req-dba338b5-ab28-4c2c-a83b-a4644e0cd410 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:25.079398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-63d82102-f258-4c99-82f5-17eeffe4218a req-dba338b5-ab28-4c2c-a83b-a4644e0cd410 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:25.100540 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-63d82102-f258-4c99-82f5-17eeffe4218a req-dba338b5-ab28-4c2c-a83b-a4644e0cd410 service nova] Creating event network-vif-deleted:7b9f5560-882f-41cd-b9da-8ccb8964d3ee for instance 99ec5001-5a75-4d28-bfa2-41e143233da4 on n-h1-858384-19 Nov 02 13:20:25.110270 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-63d82102-f258-4c99-82f5-17eeffe4218a req-dba338b5-ab28-4c2c-a83b-a4644e0cd410 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099478 Nov 02 13:20:25.111552 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1048/1964] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:25.121837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:25.122593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:25.130528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:25.131028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:25.131613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:25.132544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:25.133576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:25.137914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:25.601746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:25.620123 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf9fe77f-00d6-44e8-9341-8419fc15086d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1467 microversion: 2.1 time: 0.507301 Nov 02 13:20:25.623325 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1049/1965] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:25 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1467 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:25.638114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:25.641504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:25.658773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:25.663349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:25.664822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:25.665441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:25.665910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:25.667579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:26.362566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:26.377643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:26.381866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:26.385683 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e2cf5445-0839-4243-a82b-5dbe46a65568 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.760507 Nov 02 13:20:26.388584 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1050/1966] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:25 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:26.397698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-772335f8-7d49-46ec-beec-93c364f5068f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:26.399420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-772335f8-7d49-46ec-beec-93c364f5068f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:26.416791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772335f8-7d49-46ec-beec-93c364f5068f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:26.417692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772335f8-7d49-46ec-beec-93c364f5068f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:26.419690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772335f8-7d49-46ec-beec-93c364f5068f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:26.423347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772335f8-7d49-46ec-beec-93c364f5068f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:26.424159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772335f8-7d49-46ec-beec-93c364f5068f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:26.424996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772335f8-7d49-46ec-beec-93c364f5068f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:27.093051 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-772335f8-7d49-46ec-beec-93c364f5068f tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1620 microversion: 2.1 time: 0.702920 Nov 02 13:20:27.098352 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1051/1967] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:26 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1620 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:27.103537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:27.116535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:27.133738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:27.134455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:27.135137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:27.136062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:27.136788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:27.148063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:27.242275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:27.247814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:27.248708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:27.249342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lazy-loading 'fault' on Instance uuid 99ec5001-5a75-4d28-bfa2-41e143233da4 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:20:27.581877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f47e9ac7784ca0963d2b1fcc3db296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a263e4d49c4d6b98ea983593d9a9f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:27.590379 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-55150822-f3fa-4047-9dff-0a8cafcfc2fe tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 200 len: 1306 microversion: 2.1 time: 0.490663 Nov 02 13:20:27.590989 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1052/1968] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:27 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 1306 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:27.615404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:27.615989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:27.637599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:27.638106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:27.647776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:27.649550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:27.650996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:27.652317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:27.915502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '98378d3c8963463ba87042f3e7a3f89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f7da88e7a647eba214f7f9412eb94b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:27.917344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] flavor_id is None. Assuming migration. {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4197}} Nov 02 13:20:27.919602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 13:20:28.951960 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d4c43c82-208b-46ae-8d3b-477662f0e15c tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869/action" status: 202 len: 0 microversion: 2.1 time: 1.346597 Nov 02 13:20:28.956353 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1053/1969] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:20:27 2022] POST /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869/action => generated 0 bytes in 1365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:20:28.978254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b39a9052-4da4-4a79-afd5-22755e91ca92 req-a02cebbe-0374-471b-91b4-4353fd6de9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ec5001-5a75-4d28-bfa2-41e143233da4", "name": "network-vif-deleted", "tag": "8ea20760-2efe-43bf-92b7-adb280bd5e8c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:29.010070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b39a9052-4da4-4a79-afd5-22755e91ca92 req-a02cebbe-0374-471b-91b4-4353fd6de9af service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:29.018199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b39a9052-4da4-4a79-afd5-22755e91ca92 req-a02cebbe-0374-471b-91b4-4353fd6de9af service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:29.018869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b39a9052-4da4-4a79-afd5-22755e91ca92 req-a02cebbe-0374-471b-91b4-4353fd6de9af service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.050180 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b39a9052-4da4-4a79-afd5-22755e91ca92 req-a02cebbe-0374-471b-91b4-4353fd6de9af service nova] Creating event network-vif-deleted:8ea20760-2efe-43bf-92b7-adb280bd5e8c for instance 99ec5001-5a75-4d28-bfa2-41e143233da4 on n-h1-858384-19 Nov 02 13:20:29.061615 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b39a9052-4da4-4a79-afd5-22755e91ca92 req-a02cebbe-0374-471b-91b4-4353fd6de9af service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102721 Nov 02 13:20:29.064055 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1054/1970] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:29.077412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:29.079585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:29.101281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:29.107415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:29.107900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.111126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:29.111686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:29.112137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.273346 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d7522dbf-41dc-450c-ba5a-f7a0b2548f9f tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.161287 Nov 02 13:20:29.275105 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 917/1971] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:20:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:20:29.282184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:29.283319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:29.298437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:29.299334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:29.300572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.306834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:29.307834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:29.308529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.334773 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] HTTP exception thrown: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Request method failure captured: Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 HTTP/1.1 Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm4uVFvrLSNzSUBdZT53tx6SeEKZ7TiSNbncpGghEvohNEXdOBtlY_v1W7jr8ACnY9OXkkpa9mwimK4fO0GNatRB0czYiKf_kCajtvI5rT5z8Oft1lYWkbfXrvYwgwPaXzjt02UygdKkIwp4BDho7xesRq2aFk4JdOBYNsWwbmC4cHg Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:20:29.338257 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 93f47e9ac7784ca0963d2b1fcc3db296 Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:29.340066 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '99ec5001-5a75-4d28-bfa2-41e143233da4'} Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:29.340977 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:29.343089 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:29.348200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Returning 404 to user: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:29.349821 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38742dd8-c7c4-4c8d-98a1-212ce20d1ee1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 404 len: 111 microversion: 2.1 time: 0.073170 Nov 02 13:20:29.351446 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 918/1972] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:29 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:29.366483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:29.367437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:29.379389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:29.380398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:29.381293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.382546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:29.383202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:29.384122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:29.834002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:29.853723 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de51497d-c0a1-48b3-b7e6-fe682f4b712b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1476 microversion: 2.1 time: 0.496824 Nov 02 13:20:29.863170 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 919/1973] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:29 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1476 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:29.886818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-21185dc8-a85b-4a25-8b2e-f250df2d3617 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Action: 'create', calling method: .version_select at 0x7fe78f8dfca0>, body: {"pool": null} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:30.082284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:30.111859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:30.113548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:30.114896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a400ad14-3935-45b5-a5df-685f7618c012 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 1.049495 Nov 02 13:20:30.143876 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1055/1974] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:29 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:30.894844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:30.896004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:30.912384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:30.912962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:30.913628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:30.914562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:30.916251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:30.917458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:31.801689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:31.818953 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d18e0685-a744-4109-bdb5-94317e4373db tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1476 microversion: 2.1 time: 0.927287 Nov 02 13:20:31.820162 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1056/1975] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:30 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1476 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:31.833963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:31.838896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:31.854909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:31.857915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:31.862981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:31.863845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:31.864340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:31.864815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:32.754466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:32.767594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:32.775956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:32.777468 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9b34d54e-29f6-4be8-8bcd-fdbc00d246d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.954483 Nov 02 13:20:32.780792 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1057/1976] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:31 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:33.095397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e747205-7e72-46a3-a1ec-5b2e786227d3 tempest-FlavorsV255TestJSON-1052207204 tempest-FlavorsV255TestJSON-1052207204-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1456381447", "id": 365583347, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:33.123981 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1e747205-7e72-46a3-a1ec-5b2e786227d3 tempest-FlavorsV255TestJSON-1052207204 tempest-FlavorsV255TestJSON-1052207204-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.337922 Nov 02 13:20:33.133471 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1058/1977] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:20:32 2022] POST /compute/v2.1/flavors => generated 448 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:20:33.150824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:33.152471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:33.162843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:33.164963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:33.164963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:33.165939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:33.167394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:33.168130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:33.689726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:33.700162 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b562fa7e-9249-48c4-aa18-43f3c391bee4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1476 microversion: 2.1 time: 0.565858 Nov 02 13:20:33.703873 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1059/1978] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:33 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1476 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:33.957854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-342df440-6c4c-4dbe-89e0-dec125e46384 tempest-FlavorsV255TestJSON-877950256 tempest-FlavorsV255TestJSON-877950256-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:33.960700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=2,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:33.978842 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-342df440-6c4c-4dbe-89e0-dec125e46384 tempest-FlavorsV255TestJSON-877950256 tempest-FlavorsV255TestJSON-877950256-project] 10.222.0.113 "GET /compute/v2.1/flavors/365583347" status: 200 len: 448 microversion: 2.55 time: 0.273591 Nov 02 13:20:33.979810 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1060/1979] 10.222.0.113 () {60 vars in 1201 bytes} [Wed Nov 2 13:20:33 2022] GET /compute/v2.1/flavors/365583347 => generated 448 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:20:33.985836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:33.989466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:33.999707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:34.000588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:34.001219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:34.002141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:34.002786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:34.003496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:34.008050 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-21185dc8-a85b-4a25-8b2e-f250df2d3617 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.141478 Nov 02 13:20:34.018042 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 920/1980] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:20:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:34.023280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-77ee0d3c-62dd-4977-8257-1893ff6bcad2 tempest-FlavorsV255TestJSON-1052207204 tempest-FlavorsV255TestJSON-1052207204-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:34.089667 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-77ee0d3c-62dd-4977-8257-1893ff6bcad2 tempest-FlavorsV255TestJSON-1052207204 tempest-FlavorsV255TestJSON-1052207204-project-admin] 10.222.0.113 "PUT /compute/v2.1/flavors/365583347" status: 200 len: 449 microversion: 2.55 time: 0.070052 Nov 02 13:20:34.095638 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 921/1981] 10.222.0.113 () {62 vars in 1221 bytes} [Wed Nov 2 13:20:34 2022] PUT /compute/v2.1/flavors/365583347 => generated 449 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:20:34.101399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b49124e-d136-4106-9af4-b2fd26f1b0b4 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Action: 'create', calling method: .version_select at 0x7fe78f981310>, body: {"pool": null} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:34.802815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:34.813545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:34.830489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:34.832099 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-810c92bb-4c2e-4459-8708-7b05befb8930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.851165 Nov 02 13:20:34.832909 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1061/1982] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:33 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:34.847754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb28395c-2fbe-47d8-9a98-200d5c77f838 tempest-FlavorsV255TestJSON-877950256 tempest-FlavorsV255TestJSON-877950256-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:34.911478 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb28395c-2fbe-47d8-9a98-200d5c77f838 tempest-FlavorsV255TestJSON-877950256 tempest-FlavorsV255TestJSON-877950256-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5752 microversion: 2.55 time: 0.070748 Nov 02 13:20:34.913609 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1062/1983] 10.222.0.113 () {60 vars in 1192 bytes} [Wed Nov 2 13:20:34 2022] GET /compute/v2.1/flavors/detail => generated 5752 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:34.927020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:34.932457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:34.949063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:34.949877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:34.951773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:34.956601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:34.957612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:34.959310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:35.592037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:35.607517 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-888bac21-20b8-4169-8636-866f188cadf4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1476 microversion: 2.1 time: 0.692787 Nov 02 13:20:35.613778 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1063/1984] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:34 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1476 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:35.763022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-829b3ba3-90dc-4972-9b22-43256cba63f7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'create', calling method: .version_select at 0x7fe78c0ccb80>, body: {"keypair": {"name": "tempest-keypair-601789023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI3ScwDW5NVVgCpEvZh1GIFru7Uv0TgnxB7LwaCa5T8bdOGGkdRR1dDEh/ZTn2v7Y2VREGvXLPklb3LOV5gOhAyFZYd4b5Qux8W63KZhBVgiIKmK3Mdozr9JLYDqSaUQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:35.814161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-829b3ba3-90dc-4972-9b22-43256cba63f7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:20:35.832701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-829b3ba3-90dc-4972-9b22-43256cba63f7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for user fa31baf6e9c94e8393baad059544adb5 and project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:20:35.910350 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-829b3ba3-90dc-4972-9b22-43256cba63f7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.294267 Nov 02 13:20:35.911389 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1064/1985] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:20:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:35.925716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e12f25e4-fd91-4328-8f9d-c2733e1a6d83 tempest-FlavorsV255TestJSON-877950256 tempest-FlavorsV255TestJSON-877950256-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:35.988528 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e12f25e4-fd91-4328-8f9d-c2733e1a6d83 tempest-FlavorsV255TestJSON-877950256 tempest-FlavorsV255TestJSON-877950256-project] 10.222.0.113 "GET /compute/v2.1/flavors" status: 200 len: 3184 microversion: 2.55 time: 0.075579 Nov 02 13:20:35.992216 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1065/1986] 10.222.0.113 () {60 vars in 1171 bytes} [Wed Nov 2 13:20:35 2022] GET /compute/v2.1/flavors => generated 3184 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:36.006240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:36.009233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:36.023514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:36.025032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:36.026882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:36.030707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:36.034706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:36.036996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:36.464382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:36.476807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:36.478304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:36.486505 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc17e1fe-1603-413b-9edf-1be474349e08 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.491214 Nov 02 13:20:36.490180 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1066/1987] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:35 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:36.503560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fcd739a5-bf2e-4756-b45a-4f1cfbf45a0d tempest-FlavorsV255TestJSON-1052207204 tempest-FlavorsV255TestJSON-1052207204-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:36.548258 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fcd739a5-bf2e-4756-b45a-4f1cfbf45a0d tempest-FlavorsV255TestJSON-1052207204 tempest-FlavorsV255TestJSON-1052207204-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/365583347" status: 202 len: 0 microversion: 2.55 time: 0.056670 Nov 02 13:20:36.549481 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1067/1988] 10.222.0.113 () {60 vars in 1204 bytes} [Wed Nov 2 13:20:36 2022] DELETE /compute/v2.1/flavors/365583347 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:20:36.561494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-356ea587-2469-4663-9ae9-4176637c289f tempest-FlavorsV255TestJSON-1052207204 tempest-FlavorsV255TestJSON-1052207204-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:36.641667 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-356ea587-2469-4663-9ae9-4176637c289f tempest-FlavorsV255TestJSON-1052207204 tempest-FlavorsV255TestJSON-1052207204-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5313 microversion: 2.55 time: 0.088068 Nov 02 13:20:36.649575 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1068/1989] 10.222.0.113 () {60 vars in 1192 bytes} [Wed Nov 2 13:20:36 2022] GET /compute/v2.1/flavors/detail => generated 5313 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:36.658814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:36.659455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:36.678693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:36.679619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:36.680301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:36.693939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:36.695307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:36.695936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:37.031574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:37.044568 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c14a2965-7b93-4f78-95ef-484886e241be tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.393879 Nov 02 13:20:37.047306 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1069/1990] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:36 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:37.523050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:37.523703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:37.533023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:37.533869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:37.535711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:37.539356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:37.540096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:37.540751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:37.604849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:38.017013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:38.035899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:38.040728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:38.042433 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-255f96a0-f321-4022-bf4d-af103db44ac5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.523259 Nov 02 13:20:38.062118 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1070/1991] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:37 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:20:38.084610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:38.085275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:38.098044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:38.098687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:38.099197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:38.099981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:38.100496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:38.100985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:38.452811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:38.471567 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f0396e19-c9ee-4b7e-b426-3ae6bd199b4c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.390389 Nov 02 13:20:38.474139 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1071/1992] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:38 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:39.074403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:39.075781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:39.089807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:39.090510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:39.091439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:39.099980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:39.100845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:39.102330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:39.521902 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b49124e-d136-4106-9af4-b2fd26f1b0b4 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.424573 Nov 02 13:20:39.523143 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 922/1993] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:20:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:39.528809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:39.529708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:39.539306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=80,nova_api:SAVEPOINT=5,nova_api:INSERT=2,nova_api:RELEASE=5,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:39.542069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:39.543605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:39.546458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:39.548358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:39.548998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:39.550109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:39.677357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:39.694780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:39.699651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:39.701112 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eb308ec1-4ce4-45af-b47d-61fb4a60de87 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.635916 Nov 02 13:20:39.706131 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1072/1994] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:39 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:39.724514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:39.725415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:39.735896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:39.739384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:39.740192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:39.740943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:39.748199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:39.749584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:39.775563 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] HTTP exception thrown: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Request method failure captured: Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 HTTP/1.1 Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm4uVFvrLSNzSUBdZT53tx6SeEKZ7TiSNbncpGghEvohNEXdOBtlY_v1W7jr8ACnY9OXkkpa9mwimK4fO0GNatRB0czYiKf_kCajtvI5rT5z8Oft1lYWkbfXrvYwgwPaXzjt02UygdKkIwp4BDho7xesRq2aFk4JdOBYNsWwbmC4cHg Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:20:39.778835 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 93f47e9ac7784ca0963d2b1fcc3db296 Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:39.781327 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '99ec5001-5a75-4d28-bfa2-41e143233da4'} Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:39.782372 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:39.784168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:39.789537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Returning 404 to user: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:39.794512 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f168294-9791-404d-aa2c-9959eaac702e tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "DELETE /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 404 len: 111 microversion: 2.1 time: 0.085161 Nov 02 13:20:39.796885 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1073/1995] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:20:39 2022] DELETE /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:39.812745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c5d3c36-66ec-49ef-8ee9-29c8800bbcc5 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Action: 'create', calling method: .version_select at 0x7fe78c0ccb80>, body: {"pool": null} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:40.085635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:40.117087 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bb46524a-b068-4096-ac88-49ab8d687cd8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.592710 Nov 02 13:20:40.117688 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 923/1996] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:39 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:40.156077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:40.156710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 99ec5001-5a75-4d28-bfa2-41e143233da4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:40.184560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.190167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.190666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.192779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.201486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.203835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.235250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] HTTP exception thrown: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Request method failure captured: Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 HTTP/1.1 Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm4uVFvrLSNzSUBdZT53tx6SeEKZ7TiSNbncpGghEvohNEXdOBtlY_v1W7jr8ACnY9OXkkpa9mwimK4fO0GNatRB0czYiKf_kCajtvI5rT5z8Oft1lYWkbfXrvYwgwPaXzjt02UygdKkIwp4BDho7xesRq2aFk4JdOBYNsWwbmC4cHg Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:20:40.237278 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 93f47e9ac7784ca0963d2b1fcc3db296 Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:40.239032 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '99ec5001-5a75-4d28-bfa2-41e143233da4'} Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:40.240063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. Nov 02 13:20:40.241663 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.245305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Returning 404 to user: Instance 99ec5001-5a75-4d28-bfa2-41e143233da4 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:40.246651 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a21e8b09-d263-41cf-b9bc-867f51c9acb1 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4" status: 404 len: 111 microversion: 2.1 time: 0.099451 Nov 02 13:20:40.255473 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 924/1997] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:40 2022] GET /compute/v2.1/servers/99ec5001-5a75-4d28-bfa2-41e143233da4 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:40.262198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6796f897-0e5d-4bf6-a306-33ddb0ab8e64 req-99e57076-1735-4933-b29e-a887d52090f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed1faa6-e6ad-4757-992d-0750ae29a307", "name": "network-vif-unplugged", "status": "completed", "tag": "530566a3-df01-427e-bd74-d9826d6be3a7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:40.280323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6796f897-0e5d-4bf6-a306-33ddb0ab8e64 req-99e57076-1735-4933-b29e-a887d52090f5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.283755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6796f897-0e5d-4bf6-a306-33ddb0ab8e64 req-99e57076-1735-4933-b29e-a887d52090f5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.286640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6796f897-0e5d-4bf6-a306-33ddb0ab8e64 req-99e57076-1735-4933-b29e-a887d52090f5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.305287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6796f897-0e5d-4bf6-a306-33ddb0ab8e64 req-99e57076-1735-4933-b29e-a887d52090f5 service nova] Creating event network-vif-unplugged:530566a3-df01-427e-bd74-d9826d6be3a7 for instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 on n-h2-858384-19 Nov 02 13:20:40.313347 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6796f897-0e5d-4bf6-a306-33ddb0ab8e64 req-99e57076-1735-4933-b29e-a887d52090f5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056176 Nov 02 13:20:40.315080 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 925/1998] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:40.322785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:40.323918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:40.332771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.335609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.336587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.337720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.338765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.340324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.363802 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] HTTP exception thrown: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Request method failure captured: Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad HTTP/1.1 Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm4uVFvrLSNzSUBdZT53tx6SeEKZ7TiSNbncpGghEvohNEXdOBtlY_v1W7jr8ACnY9OXkkpa9mwimK4fO0GNatRB0czYiKf_kCajtvI5rT5z8Oft1lYWkbfXrvYwgwPaXzjt02UygdKkIwp4BDho7xesRq2aFk4JdOBYNsWwbmC4cHg Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:20:40.366056 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 93f47e9ac7784ca0963d2b1fcc3db296 Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.367630 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '0f440c11-aecc-456c-acf8-f3c84192c6ad'} Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:40.368527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.371818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.377898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Returning 404 to user: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:40.379247 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2c6762d-ad1d-4f8e-9e7c-82571d223517 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 404 len: 111 microversion: 2.1 time: 0.062292 Nov 02 13:20:40.384847 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 926/1999] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:20:40 2022] DELETE /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:40.392830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:40.393362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] [instance: 0f440c11-aecc-456c-acf8-f3c84192c6ad] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:40.415068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.415760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.416360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.417544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.418356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.419036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.446594 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] HTTP exception thrown: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Request method failure captured: Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad HTTP/1.1 Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm4uVFvrLSNzSUBdZT53tx6SeEKZ7TiSNbncpGghEvohNEXdOBtlY_v1W7jr8ACnY9OXkkpa9mwimK4fO0GNatRB0czYiKf_kCajtvI5rT5z8Oft1lYWkbfXrvYwgwPaXzjt02UygdKkIwp4BDho7xesRq2aFk4JdOBYNsWwbmC4cHg Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:20:40.449389 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/94a263e4d49c4d6b98ea983593d9a9f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 94a263e4d49c4d6b98ea983593d9a9f3 Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestMultiNic-1216632423 Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 93f47e9ac7784ca0963d2b1fcc3db296 Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestMultiNic-1216632423-project Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.450994 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '0f440c11-aecc-456c-acf8-f3c84192c6ad'} Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:40.452719 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. Nov 02 13:20:40.459215 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:40.461217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] Returning 404 to user: Instance 0f440c11-aecc-456c-acf8-f3c84192c6ad could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:40.461217 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a158370-33aa-4b64-961f-4f1534ce2153 tempest-ServersTestMultiNic-1216632423 tempest-ServersTestMultiNic-1216632423-project] 10.222.0.113 "GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad" status: 404 len: 111 microversion: 2.1 time: 0.072866 Nov 02 13:20:40.461217 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 927/2000] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:40 2022] GET /compute/v2.1/servers/0f440c11-aecc-456c-acf8-f3c84192c6ad => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:40.732531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:40.734995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:40.747778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.748283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.749479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.750433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:40.751059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:40.751679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:40.756597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:41.210458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:41.224240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:41.231162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:41.235707 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cdf88855-7a06-4b21-bba5-fb58b1666833 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.504622 Nov 02 13:20:41.240263 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 928/2001] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:40 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:41.255675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:41.257418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:41.266858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:41.267541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:41.268251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:41.269099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:41.269663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:41.270198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:42.066216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:42.076043 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9af16a8a-5481-4f0e-a17f-cc25ec3fec79 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.834464 Nov 02 13:20:42.083254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 929/2002] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:41 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:42.263579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:42.264609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:42.273667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:42.275533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:42.277328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:42.278301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:42.279240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:42.281189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:42.510918 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c5d3c36-66ec-49ef-8ee9-29c8800bbcc5 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.712591 Nov 02 13:20:42.512396 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1074/2003] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:20:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:42.518994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-648acfab-a120-403f-8612-4c959c628b48 req-619cd38f-1c65-4cdd-9363-20707f7d3828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed1faa6-e6ad-4757-992d-0750ae29a307", "tag": "530566a3-df01-427e-bd74-d9826d6be3a7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:42.552892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-648acfab-a120-403f-8612-4c959c628b48 req-619cd38f-1c65-4cdd-9363-20707f7d3828 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:42.553410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-648acfab-a120-403f-8612-4c959c628b48 req-619cd38f-1c65-4cdd-9363-20707f7d3828 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:42.554042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-648acfab-a120-403f-8612-4c959c628b48 req-619cd38f-1c65-4cdd-9363-20707f7d3828 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:42.573998 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-648acfab-a120-403f-8612-4c959c628b48 req-619cd38f-1c65-4cdd-9363-20707f7d3828 service nova] Creating event network-changed:530566a3-df01-427e-bd74-d9826d6be3a7 for instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 on n-h2-858384-19 Nov 02 13:20:42.588516 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-648acfab-a120-403f-8612-4c959c628b48 req-619cd38f-1c65-4cdd-9363-20707f7d3828 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074366 Nov 02 13:20:42.592237 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1075/2004] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:42.605110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22f7a300-1a32-41bc-bdf5-e1e937c17fe9 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Calling method '.version_select at 0x7fe787ebb820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:42.948725 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22f7a300-1a32-41bc-bdf5-e1e937c17fe9 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "GET /compute/v2.1/os-floating-ips/41e4e4c2-5610-4481-8629-bc96f39e1f40" status: 200 len: 142 microversion: 2.1 time: 0.352233 Nov 02 13:20:42.949522 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1076/2005] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:20:42 2022] GET /compute/v2.1/os-floating-ips/41e4e4c2-5610-4481-8629-bc96f39e1f40 => generated 142 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:42.956426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1294585226", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f49ae81-cfe3-4633-a929-56b3685d4723"}], "security_groups": [{"name": "tempest-securitygroup--399888148"}], "key_name": "tempest-keypair-601789023", "user_data": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:43.028425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:43.043025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:43.046330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:43.049741 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9739740d-cdff-482c-ba43-d06e8ca9172e tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.789746 Nov 02 13:20:43.062998 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 930/2006] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:42 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:20:43.078115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3842015-c537-474b-9269-3c51ec4624b4 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Calling method '.version_select at 0x7fe78f8b1af0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:43.183980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] validate_networks() for [('0f49ae81-cfe3-4633-a929-56b3685d4723', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:20:43.796754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:20:43.798897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:20:43.800216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:20:43.801057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:20:43.802255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:20:43.825500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:43.826349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:43.833751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:43.834872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:43.835905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:43.836567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:43.877058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:20:43.891561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for user fa31baf6e9c94e8393baad059544adb5 and project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:20:43.910183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:20:43.913687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:20:43.981292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-beebb284-4428-4969-9338-7d94c2851ee7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.030228 Nov 02 13:20:43.982632 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1077/2007] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:20:42 2022] POST /compute/v2.1/servers => generated 410 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:20:43.989431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:43.990745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:44.009719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:44.011670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:44.013143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:44.015331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:44.016272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:44.017379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:44.439847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:44.455866 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2643cb63-f747-4bdb-8878-add7cde2b10e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.471184 Nov 02 13:20:44.472942 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1078/2008] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:43 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:44.478380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84c8e62b-8f86-4671-82f5-470913adfe5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:44.479286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-84c8e62b-8f86-4671-82f5-470913adfe5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:44.742700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84c8e62b-8f86-4671-82f5-470913adfe5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:44.755495 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84c8e62b-8f86-4671-82f5-470913adfe5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1242 microversion: 2.1 time: 0.280909 Nov 02 13:20:44.772539 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1079/2009] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:44 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1242 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:44.777154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:44.777918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:44.812955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:44.813680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:44.813883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:44.814933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:44.815599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:44.816222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:45.298717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:45.310452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:45.317738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:45.319687 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.556695 Nov 02 13:20:45.320272 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1080/2010] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:44 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:45.321425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:45.333055 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff3e8b35-1443-409c-bea1-21dbc9679d70 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute//" status: 200 len: 379 microversion: - time: 0.011617 Nov 02 13:20:45.333689 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1081/2011] 10.222.0.113 () {56 vars in 891 bytes} [Wed Nov 2 13:20:45 2022] GET /compute/ => generated 379 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 13:20:45.482205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:45.483429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:45.495000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:45.495790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:45.496240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:45.498462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:45.504211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:45.504958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:45.787764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:45.802788 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77af0f1b-8bd6-45ba-9e60-979a23694d0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.324934 Nov 02 13:20:45.804256 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1082/2012] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:45 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:45.812723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:45.813678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:45.828921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:45.829854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:45.830654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:45.831716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:45.832485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:45.833474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:45.840579 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f3842015-c537-474b-9269-3c51ec4624b4 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/41e4e4c2-5610-4481-8629-bc96f39e1f40" status: 202 len: 0 microversion: 2.1 time: 2.776372 Nov 02 13:20:45.844088 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 931/2013] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:20:43 2022] DELETE /compute/v2.1/os-floating-ips/41e4e4c2-5610-4481-8629-bc96f39e1f40 => generated 0 bytes in 2780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:20:45.864689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a4f70c8-efe1-4a5a-a441-b873b5234f86 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Calling method '.version_select at 0x7fe78f8a90d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:45.978281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:45.993777 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89bfa15c-1128-4f5d-94e6-f5f9a0be8d7b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1294 microversion: 2.1 time: 0.187425 Nov 02 13:20:46.018677 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1083/2014] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:45 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1294 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:46.277255 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a4f70c8-efe1-4a5a-a441-b873b5234f86 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.425381 Nov 02 13:20:46.285598 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 932/2015] 10.222.0.113 () {58 vars in 1169 bytes} [Wed Nov 2 13:20:45 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:20:46.291291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-892cddc2-c63b-4544-85d1-b78cb420d26b tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Calling method '.version_select at 0x7fe78789c550>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:46.356040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:46.357019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:46.383186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:46.383765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:46.384277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:46.385070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:46.385612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:46.386110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:47.032194 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-892cddc2-c63b-4544-85d1-b78cb420d26b tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.744688 Nov 02 13:20:47.032809 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1084/2016] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:20:46 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:47.053127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:47.053973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:47.072817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:47.077122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:47.077997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:47.088210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:47.089762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:47.090398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:47.209174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:47.239269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:47.245974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:47.249946 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c1b26dad-d597-43ff-bce5-50e323b514ff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.904770 Nov 02 13:20:47.250892 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 933/2017] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:46 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:47.270698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:47.271581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:47.292159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:47.293721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:47.294367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:47.295997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:47.296719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:47.297335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:47.462102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:47.475211 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-08940697-f8e6-45fc-ad64-cc6c098edceb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1300 microversion: 2.1 time: 0.221692 Nov 02 13:20:47.476333 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 934/2018] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:47 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1300 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:47.492645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a19db470-7990-4d84-85c6-2cb7d0fd1873 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Calling method '.version_select at 0x7fe78f8b10d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:48.013451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:48.036423 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed0f4d6a-1588-4c25-a6aa-343e967a1b9e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.987358 Nov 02 13:20:48.038100 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1085/2019] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:47 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:48.278582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:48.279606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:48.288641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:48.292743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:48.293303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:48.294194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:48.294984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:48.295573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:48.599384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:48.614534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:48.621310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:48.622688 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-96923217-ec35-43ac-a671-28ea8802bd27 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.348051 Nov 02 13:20:48.627156 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1086/2020] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:48 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:48.647385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:48.648332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:48.658252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:48.658757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:48.660453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:48.661215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:48.661679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:48.669459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:48.808160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:48.820950 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8835b242-21f8-401a-88e7-97c38bfb5db7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1300 microversion: 2.1 time: 0.191616 Nov 02 13:20:48.822663 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1087/2021] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:48 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1300 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:49.066810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:49.069004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:49.101765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:49.105289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:49.106730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:49.109968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:49.111821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:49.114285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:49.691469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:49.701910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc94228d-105d-415b-a967-87bc0f1d134b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.643484 Nov 02 13:20:49.716019 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1088/2022] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:49 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:20:49.739449 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a19db470-7990-4d84-85c6-2cb7d0fd1873 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/3dc5c6cc-ea85-401f-99c3-2db6df09464a" status: 202 len: 0 microversion: 2.1 time: 2.260548 Nov 02 13:20:49.741798 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 935/2023] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:20:47 2022] DELETE /compute/v2.1/os-floating-ips/3dc5c6cc-ea85-401f-99c3-2db6df09464a => generated 0 bytes in 2263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:20:49.759203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:49.762895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:49.768454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ec15982-0207-432d-898d-181164ac5a36 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Calling method '.version_select at 0x7fe78f876430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:49.794484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:49.800384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:49.803006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:49.804350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:49.807452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:49.812105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:50.256758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:50.277410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:50.283336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:50.285061 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f12252d7-273f-4d6b-89c5-ed22222c7360 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.554748 Nov 02 13:20:50.288801 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1089/2024] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:49 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:50.294820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:50.296583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:50.304426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:50.305246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:50.305932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:50.306930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:50.307712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:50.308417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:51.033028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:51.048124 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b9efd40d-2742-4630-8add-75571e25a77d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1367 microversion: 2.1 time: 0.757703 Nov 02 13:20:51.049233 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1090/2025] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:50 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1367 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:51.054259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:51.055749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:51.071281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:51.074099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:51.075361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:51.077043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:51.080308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:51.081308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:51.603512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:51.621444 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-424fb1b9-1135-4490-b9d4-a83e9f5bd859 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.570963 Nov 02 13:20:51.625773 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1091/2026] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:51 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:51.635713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:51.637270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:51.650864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:51.653300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:51.655487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:51.658950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:51.659838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:51.663091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:51.992608 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ec15982-0207-432d-898d-181164ac5a36 tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/b219b7c9-7c2c-4599-872a-6ed8b6fd971e" status: 202 len: 0 microversion: 2.1 time: 2.242224 Nov 02 13:20:51.993550 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 936/2027] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:20:49 2022] DELETE /compute/v2.1/os-floating-ips/b219b7c9-7c2c-4599-872a-6ed8b6fd971e => generated 0 bytes in 2249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:20:52.003853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-817088c0-d9ba-459a-8654-70ca3282d1cb tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] Calling method '.version_select at 0x7fe78f8f9040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:52.693653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:52.707541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:52.710944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:52.713832 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c587364c-7d37-4901-9ff4-c1460a14d652 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 1.086784 Nov 02 13:20:52.718406 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1092/2028] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:51 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:52.726941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:52.730051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:52.750359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:52.751297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:52.751903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:52.752803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:52.753421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:52.754013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:53.365063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:53.367425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:53.381753 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ebbda19-a810-4902-a18f-2fae877ab46e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1367 microversion: 2.1 time: 0.661732 Nov 02 13:20:53.396680 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1093/2029] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:52 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1367 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:53.407719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d13d6197-4e5a-47fa-90e1-e24121f0b3d1 req-632b768e-ddd7-46ae-845d-1e13a287e4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:53.420385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d13d6197-4e5a-47fa-90e1-e24121f0b3d1 req-632b768e-ddd7-46ae-845d-1e13a287e4a5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:53.421654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d13d6197-4e5a-47fa-90e1-e24121f0b3d1 req-632b768e-ddd7-46ae-845d-1e13a287e4a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:53.421654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d13d6197-4e5a-47fa-90e1-e24121f0b3d1 req-632b768e-ddd7-46ae-845d-1e13a287e4a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:53.446462 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d13d6197-4e5a-47fa-90e1-e24121f0b3d1 req-632b768e-ddd7-46ae-845d-1e13a287e4a5 service nova] Creating event network-changed:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:20:53.460477 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d13d6197-4e5a-47fa-90e1-e24121f0b3d1 req-632b768e-ddd7-46ae-845d-1e13a287e4a5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076978 Nov 02 13:20:53.461570 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1094/2030] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:53.854794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:54.053451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b529f6a-86a8-4142-b99b-93464d10805c tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Calling method '.version_select at 0x7fe787ac94c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:54.058596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b529f6a-86a8-4142-b99b-93464d10805c tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.059090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b529f6a-86a8-4142-b99b-93464d10805c tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.059566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b529f6a-86a8-4142-b99b-93464d10805c tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.065211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b529f6a-86a8-4142-b99b-93464d10805c tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.067204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b529f6a-86a8-4142-b99b-93464d10805c tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.068732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b529f6a-86a8-4142-b99b-93464d10805c tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.194419 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8b529f6a-86a8-4142-b99b-93464d10805c tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.729383 Nov 02 13:20:54.202557 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1095/2031] 10.222.0.113 () {58 vars in 1133 bytes} [Wed Nov 2 13:20:53 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:20:54.243143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:54.248228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:54.265564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:54.286562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.287071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.287553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.297071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.335488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.336364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.751704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:20:54.792156 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-817088c0-d9ba-459a-8654-70ca3282d1cb tempest-FloatingIPDetailsTestJSON-733585657 tempest-FloatingIPDetailsTestJSON-733585657-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/0799d268-a4f2-4dab-ad4a-8e6a7a637dd7" status: 202 len: 0 microversion: 2.1 time: 2.794307 Nov 02 13:20:54.796685 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 937/2032] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:20:51 2022] DELETE /compute/v2.1/os-floating-ips/0799d268-a4f2-4dab-ad4a-8e6a7a637dd7 => generated 0 bytes in 2796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:20:54.798623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:54.799275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:54.819890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.820393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.820836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.821565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:54.822021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:54.822450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:54.912053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:54.933036 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ac6b319-fdda-4be6-b07a-21356adaadfb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.732862 Nov 02 13:20:54.939357 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1096/2033] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:54 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:55.497780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:55.540991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:55.554797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:55.573575 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba51c692-fe49-4759-9544-92346b88f4d3 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.775589 Nov 02 13:20:55.600666 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 938/2034] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:54 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:55.609640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.616151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:55.632171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc117adc-40cf-46e5-bd2a-fba386cc1fd7 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Calling method '.version_select at 0x7fe787b37700>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.633667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:55.634517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:55.635274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:55.639790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc117adc-40cf-46e5-bd2a-fba386cc1fd7 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'db2e7cc22e764a8ca992a22357681b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bfb638df3c747fa9ef9ba9423842b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:55.640746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:55.641392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:55.642105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc117adc-40cf-46e5-bd2a-fba386cc1fd7 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Request method failure captured: Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm6z6gxt-mBxHY0bX8m01edTGq4g7qrIcrBpPySL2NbEPlsX-Cu21w0AyudsNmbMrkpG5iYFlbt-sDBpCeDf8wBN7enS0OT2FELqy2p7h9DofHrWVqpN2Rr7hljDcJFOvJ6cKY1PGeLtFwwntWc0CGJV-PkV3RG26I2hNqbn8TxnO0c Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:20:55.661775 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: db2e7cc22e764a8ca992a22357681b6f Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: action_args: {} Nov 02 13:20:55.663722 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:55.669215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 13:20:55.671055 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.672953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc117adc-40cf-46e5-bd2a-fba386cc1fd7 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:55.672953 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc117adc-40cf-46e5-bd2a-fba386cc1fd7 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] 10.222.0.113 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.702856 Nov 02 13:20:55.672953 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1097/2035] 10.222.0.113 () {58 vars in 1133 bytes} [Wed Nov 2 13:20:54 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 724 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:55.679220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5cea80f7-7480-4f48-9028-0d622fe8ac82 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Calling method '.version_select at 0x7fe78787b550>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.693135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5cea80f7-7480-4f48-9028-0d622fe8ac82 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'db2e7cc22e764a8ca992a22357681b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bfb638df3c747fa9ef9ba9423842b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5cea80f7-7480-4f48-9028-0d622fe8ac82 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Request method failure captured: Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hosts/n-d-858384-19/reboot HTTP/1.1 Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm6z6gxt-mBxHY0bX8m01edTGq4g7qrIcrBpPySL2NbEPlsX-Cu21w0AyudsNmbMrkpG5iYFlbt-sDBpCeDf8wBN7enS0OT2FELqy2p7h9DofHrWVqpN2Rr7hljDcJFOvJ6cKY1PGeLtFwwntWc0CGJV-PkV3RG26I2hNqbn8TxnO0c Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:20:55.707826 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: db2e7cc22e764a8ca992a22357681b6f Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'n-d-858384-19'} Nov 02 13:20:55.709733 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:55.710858 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 13:20:55.712600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.716341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5cea80f7-7480-4f48-9028-0d622fe8ac82 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:55.720758 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5cea80f7-7480-4f48-9028-0d622fe8ac82 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] 10.222.0.113 "GET /compute/v2.1/os-hosts/n-d-858384-19/reboot" status: 403 len: 111 microversion: 2.1 time: 0.049837 Nov 02 13:20:55.721851 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1098/2036] 10.222.0.113 () {58 vars in 1196 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/os-hosts/n-d-858384-19/reboot => generated 111 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:55.733867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b64c4676-3aa3-44c0-9645-f7e949403073 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Calling method '.version_select at 0x7fe78787baf0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.762618 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-b64c4676-3aa3-44c0-9645-f7e949403073 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b64c4676-3aa3-44c0-9645-f7e949403073 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Request method failure captured: Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm60rAL3B8iogyV3aDTtSFGlXhzFFCK1wwPRDr1em-id_gDH99vEBBA4nFxLkKqLBht8Y4IS4JqY2i1DpC7iuXy2Kf-RKw3GT0We7g8-dWWrtc1wI5XnxZjcCWvHqWEyWpVgTvEQe5WoZgXnqQjisp56iYI59iUdwzP4XSJpiokcAsw Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:20:55.766073 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: ace02da7db7a4593a191e20eac534e9e Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'nonexistent_hostname'} Nov 02 13:20:55.768274 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:20:55.769607 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 13:20:55.772791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.774529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.777126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b64c4676-3aa3-44c0-9645-f7e949403073 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:55.778384 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b64c4676-3aa3-44c0-9645-f7e949403073 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.049507 Nov 02 13:20:55.780154 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1099/2037] 10.222.0.113 () {58 vars in 1217 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:20:55.799653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20a6f033-9819-4e2d-8785-1fd233391461 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Calling method '.version_select at 0x7fe787817940>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.803337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-20a6f033-9819-4e2d-8785-1fd233391461 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'db2e7cc22e764a8ca992a22357681b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bfb638df3c747fa9ef9ba9423842b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20a6f033-9819-4e2d-8785-1fd233391461 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Request method failure captured: Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hosts/n-d-858384-19 HTTP/1.1 Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm6z6gxt-mBxHY0bX8m01edTGq4g7qrIcrBpPySL2NbEPlsX-Cu21w0AyudsNmbMrkpG5iYFlbt-sDBpCeDf8wBN7enS0OT2FELqy2p7h9DofHrWVqpN2Rr7hljDcJFOvJ6cKY1PGeLtFwwntWc0CGJV-PkV3RG26I2hNqbn8TxnO0c Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:20:55.807971 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: db2e7cc22e764a8ca992a22357681b6f Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'n-d-858384-19'} Nov 02 13:20:55.810143 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:55.811892 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 13:20:55.813517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.817922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20a6f033-9819-4e2d-8785-1fd233391461 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:55.819168 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20a6f033-9819-4e2d-8785-1fd233391461 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] 10.222.0.113 "GET /compute/v2.1/os-hosts/n-d-858384-19" status: 403 len: 109 microversion: 2.1 time: 0.031984 Nov 02 13:20:55.820386 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1100/2038] 10.222.0.113 () {58 vars in 1175 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/os-hosts/n-d-858384-19 => generated 109 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:55.836645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-661a8a68-b52c-4d11-b944-576b3df65fc4 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Calling method '.version_select at 0x7fe787ebba60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.854261 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-661a8a68-b52c-4d11-b944-576b3df65fc4 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-661a8a68-b52c-4d11-b944-576b3df65fc4 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Request method failure captured: Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm60rAL3B8iogyV3aDTtSFGlXhzFFCK1wwPRDr1em-id_gDH99vEBBA4nFxLkKqLBht8Y4IS4JqY2i1DpC7iuXy2Kf-RKw3GT0We7g8-dWWrtc1wI5XnxZjcCWvHqWEyWpVgTvEQe5WoZgXnqQjisp56iYI59iUdwzP4XSJpiokcAsw Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:20:55.856931 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: ace02da7db7a4593a191e20eac534e9e Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'nonexistent_hostname'} Nov 02 13:20:55.859718 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.861080 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.862912 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.871210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-661a8a68-b52c-4d11-b944-576b3df65fc4 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:55.872698 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-661a8a68-b52c-4d11-b944-576b3df65fc4 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.043221 Nov 02 13:20:55.874621 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1101/2039] 10.222.0.113 () {58 vars in 1196 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:20:55.895845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91f89f43-8e80-4296-baeb-4b0e608f9ac2 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Calling method '.version_select at 0x7fe7878178b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.905834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-91f89f43-8e80-4296-baeb-4b0e608f9ac2 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'db2e7cc22e764a8ca992a22357681b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bfb638df3c747fa9ef9ba9423842b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91f89f43-8e80-4296-baeb-4b0e608f9ac2 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Request method failure captured: Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hosts/n-d-858384-19/shutdown HTTP/1.1 Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm6z6gxt-mBxHY0bX8m01edTGq4g7qrIcrBpPySL2NbEPlsX-Cu21w0AyudsNmbMrkpG5iYFlbt-sDBpCeDf8wBN7enS0OT2FELqy2p7h9DofHrWVqpN2Rr7hljDcJFOvJ6cKY1PGeLtFwwntWc0CGJV-PkV3RG26I2hNqbn8TxnO0c Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:20:55.909326 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: db2e7cc22e764a8ca992a22357681b6f Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'n-d-858384-19'} Nov 02 13:20:55.911922 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:55.913762 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 13:20:55.915633 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.919054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91f89f43-8e80-4296-baeb-4b0e608f9ac2 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:55.923666 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91f89f43-8e80-4296-baeb-4b0e608f9ac2 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] 10.222.0.113 "GET /compute/v2.1/os-hosts/n-d-858384-19/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.041878 Nov 02 13:20:55.925757 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1102/2040] 10.222.0.113 () {58 vars in 1202 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/os-hosts/n-d-858384-19/shutdown => generated 113 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:55.940324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-151f5f76-77a0-4179-acbf-89ec1d32be4d tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Calling method '.version_select at 0x7fe78787b3a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.970459 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-151f5f76-77a0-4179-acbf-89ec1d32be4d tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-151f5f76-77a0-4179-acbf-89ec1d32be4d tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Request method failure captured: Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm60rAL3B8iogyV3aDTtSFGlXhzFFCK1wwPRDr1em-id_gDH99vEBBA4nFxLkKqLBht8Y4IS4JqY2i1DpC7iuXy2Kf-RKw3GT0We7g8-dWWrtc1wI5XnxZjcCWvHqWEyWpVgTvEQe5WoZgXnqQjisp56iYI59iUdwzP4XSJpiokcAsw Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:20:55.973411 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: ace02da7db7a4593a191e20eac534e9e Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'nonexistent_hostname'} Nov 02 13:20:55.975405 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:20:55.976547 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 13:20:55.978172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:55.979874 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:55.983291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-151f5f76-77a0-4179-acbf-89ec1d32be4d tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:55.984580 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-151f5f76-77a0-4179-acbf-89ec1d32be4d tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.052318 Nov 02 13:20:55.990805 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1103/2041] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:20:55.997567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:55.999148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:56.007481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:56.008395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:56.009021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:56.010096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:56.010879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:56.011578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:56.252487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:56.263263 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a933bde2-91c5-410c-baa6-4408d0e31e92 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1367 microversion: 2.1 time: 0.660326 Nov 02 13:20:56.269848 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 939/2042] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1367 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:56.305666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90fac2e3-5ba7-4e26-b5ac-c5a6cb483333 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Calling method '.version_select at 0x7fe78fa30670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:56.307745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90fac2e3-5ba7-4e26-b5ac-c5a6cb483333 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'db2e7cc22e764a8ca992a22357681b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bfb638df3c747fa9ef9ba9423842b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90fac2e3-5ba7-4e26-b5ac-c5a6cb483333 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Request method failure captured: Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-hosts/n-d-858384-19/startup HTTP/1.1 Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm6z6gxt-mBxHY0bX8m01edTGq4g7qrIcrBpPySL2NbEPlsX-Cu21w0AyudsNmbMrkpG5iYFlbt-sDBpCeDf8wBN7enS0OT2FELqy2p7h9DofHrWVqpN2Rr7hljDcJFOvJ6cKY1PGeLtFwwntWc0CGJV-PkV3RG26I2hNqbn8TxnO0c Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:20:56.309626 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: db2e7cc22e764a8ca992a22357681b6f Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'n-d-858384-19'} Nov 02 13:20:56.312023 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:56.312967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 13:20:56.317345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.323142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90fac2e3-5ba7-4e26-b5ac-c5a6cb483333 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:56.328950 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90fac2e3-5ba7-4e26-b5ac-c5a6cb483333 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] 10.222.0.113 "GET /compute/v2.1/os-hosts/n-d-858384-19/startup" status: 403 len: 110 microversion: 2.1 time: 0.037775 Nov 02 13:20:56.329533 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 940/2043] 10.222.0.113 () {58 vars in 1199 bytes} [Wed Nov 2 13:20:56 2022] GET /compute/v2.1/os-hosts/n-d-858384-19/startup => generated 110 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:56.340108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f15a2fd-e32a-46cb-9316-5c6f39725424 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Calling method '.version_select at 0x7fe78f8789d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:56.405072 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-3f15a2fd-e32a-46cb-9316-5c6f39725424 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f15a2fd-e32a-46cb-9316-5c6f39725424 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Request method failure captured: Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm60rAL3B8iogyV3aDTtSFGlXhzFFCK1wwPRDr1em-id_gDH99vEBBA4nFxLkKqLBht8Y4IS4JqY2i1DpC7iuXy2Kf-RKw3GT0We7g8-dWWrtc1wI5XnxZjcCWvHqWEyWpVgTvEQe5WoZgXnqQjisp56iYI59iUdwzP4XSJpiokcAsw Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:20:56.408646 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: ace02da7db7a4593a191e20eac534e9e Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'nonexistent_hostname'} Nov 02 13:20:56.410528 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:20:56.411601 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 13:20:56.413152 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.414673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.416103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f15a2fd-e32a-46cb-9316-5c6f39725424 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:56.419763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f15a2fd-e32a-46cb-9316-5c6f39725424 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.084200 Nov 02 13:20:56.423833 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 941/2044] 10.222.0.113 () {58 vars in 1220 bytes} [Wed Nov 2 13:20:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:20:56.449022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c9144b1-fca0-47af-b43e-0c657d1f7779 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Action: 'update', calling method: .version_select at 0x7fe78f9fb280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c9144b1-fca0-47af-b43e-0c657d1f7779 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Request method failure captured: Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: request: PUT /compute/v2.1/os-hosts/n-d-858384-19 HTTP/1.1 Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 51 Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm60rAL3B8iogyV3aDTtSFGlXhzFFCK1wwPRDr1em-id_gDH99vEBBA4nFxLkKqLBht8Y4IS4JqY2i1DpC7iuXy2Kf-RKw3GT0We7g8-dWWrtc1wI5XnxZjcCWvHqWEyWpVgTvEQe5WoZgXnqQjisp56iYI59iUdwzP4XSJpiokcAsw Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:20:56.466477 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: ace02da7db7a4593a191e20eac534e9e Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: {"status": "enable", "maintenance_mode": "invalid"} Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:20:56.469098 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'n-d-858384-19', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance: Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.470747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.473042 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.474600 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.474600 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:20:56.474600 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:20:56.474600 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:20:56.474600 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.474600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c9144b1-fca0-47af-b43e-0c657d1f7779 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:56.476849 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c9144b1-fca0-47af-b43e-0c657d1f7779 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-hosts/n-d-858384-19" status: 400 len: 199 microversion: 2.1 time: 0.044619 Nov 02 13:20:56.476849 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 942/2045] 10.222.0.113 () {60 vars in 1195 bytes} [Wed Nov 2 13:20:56 2022] PUT /compute/v2.1/os-hosts/n-d-858384-19 => generated 199 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:20:56.489710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3be10e0e-82eb-4fb7-a52d-bc4fc82291c4 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Action: 'update', calling method: .version_select at 0x7fe78fa7d8b0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3be10e0e-82eb-4fb7-a52d-bc4fc82291c4 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Request method failure captured: Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: request: PUT /compute/v2.1/os-hosts/n-d-858384-19 HTTP/1.1 Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 51 Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm60rAL3B8iogyV3aDTtSFGlXhzFFCK1wwPRDr1em-id_gDH99vEBBA4nFxLkKqLBht8Y4IS4JqY2i1DpC7iuXy2Kf-RKw3GT0We7g8-dWWrtc1wI5XnxZjcCWvHqWEyWpVgTvEQe5WoZgXnqQjisp56iYI59iUdwzP4XSJpiokcAsw Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:20:56.503489 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: ace02da7db7a4593a191e20eac534e9e Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: {"status": "invalid", "maintenance_mode": "enable"} Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:20:56.505301 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'n-d-858384-19', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance: Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.506391 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.508606 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.510170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.510170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:20:56.510170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:20:56.510170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 13:20:56.510170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.512979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3be10e0e-82eb-4fb7-a52d-bc4fc82291c4 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:56.514135 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3be10e0e-82eb-4fb7-a52d-bc4fc82291c4 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-hosts/n-d-858384-19" status: 400 len: 189 microversion: 2.1 time: 0.032807 Nov 02 13:20:56.517034 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 943/2046] 10.222.0.113 () {60 vars in 1195 bytes} [Wed Nov 2 13:20:56 2022] PUT /compute/v2.1/os-hosts/n-d-858384-19 => generated 189 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:20:56.535006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d13f3655-d233-4423-861b-478fe201c226 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Action: 'update', calling method: .version_select at 0x7fe78fa92670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:56.543251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d13f3655-d233-4423-861b-478fe201c226 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'db2e7cc22e764a8ca992a22357681b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bfb638df3c747fa9ef9ba9423842b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d13f3655-d233-4423-861b-478fe201c226 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Request method failure captured: Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: request: PUT /compute/v2.1/os-hosts/n-d-858384-19 HTTP/1.1 Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 50 Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm6z6gxt-mBxHY0bX8m01edTGq4g7qrIcrBpPySL2NbEPlsX-Cu21w0AyudsNmbMrkpG5iYFlbt-sDBpCeDf8wBN7enS0OT2FELqy2p7h9DofHrWVqpN2Rr7hljDcJFOvJ6cKY1PGeLtFwwntWc0CGJV-PkV3RG26I2hNqbn8TxnO0c Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:20:56.552003 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2bfb638df3c747fa9ef9ba9423842b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2bfb638df3c747fa9ef9ba9423842b0a Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-911803757 Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: db2e7cc22e764a8ca992a22357681b6f Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HostsAdminNegativeTestJSON-911803757-project Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 13:20:56.553872 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'n-d-858384-19', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:56.555024 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 13:20:56.556714 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.561673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d13f3655-d233-4423-861b-478fe201c226 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:56.561954 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d13f3655-d233-4423-861b-478fe201c226 tempest-HostsAdminNegativeTestJSON-911803757 tempest-HostsAdminNegativeTestJSON-911803757-project] 10.222.0.113 "PUT /compute/v2.1/os-hosts/n-d-858384-19" status: 403 len: 111 microversion: 2.1 time: 0.037198 Nov 02 13:20:56.563051 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 944/2047] 10.222.0.113 () {60 vars in 1195 bytes} [Wed Nov 2 13:20:56 2022] PUT /compute/v2.1/os-hosts/n-d-858384-19 => generated 111 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:20:56.580432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a107cb38-20fe-4379-9907-01709db17a42 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Action: 'update', calling method: .version_select at 0x7fe78f9fb040>, body: {"status": null, "maintenance_mode": null} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a107cb38-20fe-4379-9907-01709db17a42 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Request method failure captured: Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: request: PUT /compute/v2.1/os-hosts/n-d-858384-19 HTTP/1.1 Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 42 Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm60rAL3B8iogyV3aDTtSFGlXhzFFCK1wwPRDr1em-id_gDH99vEBBA4nFxLkKqLBht8Y4IS4JqY2i1DpC7iuXy2Kf-RKw3GT0We7g8-dWWrtc1wI5XnxZjcCWvHqWEyWpVgTvEQe5WoZgXnqQjisp56iYI59iUdwzP4XSJpiokcAsw Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:20:56.586890 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: ace02da7db7a4593a191e20eac534e9e Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: {"status": null, "maintenance_mode": null} Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:20:56.588820 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'n-d-858384-19', 'body': {'status': None, 'maintenance_mode': None}} Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance: Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi None Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.590367 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.595915 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.601331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:20:56.601331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:20:56.601331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 13:20:56.601331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.603179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a107cb38-20fe-4379-9907-01709db17a42 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:56.604462 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a107cb38-20fe-4379-9907-01709db17a42 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-hosts/n-d-858384-19" status: 400 len: 127 microversion: 2.1 time: 0.036511 Nov 02 13:20:56.612803 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 945/2048] 10.222.0.113 () {60 vars in 1195 bytes} [Wed Nov 2 13:20:56 2022] PUT /compute/v2.1/os-hosts/n-d-858384-19 => generated 127 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:20:56.620210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:56.621828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:56.629671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:56.630447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:56.631182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:56.631856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:56.633030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:56.638325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:56.639809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:56.641974 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-328f916c-e88b-461e-b4c3-4ee794983875 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.646234 Nov 02 13:20:56.644694 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1104/2049] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:55 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:56.656523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-60198f69-fbb6-4eec-947f-1cd9626a96e7 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Action: 'update', calling method: .version_select at 0x7fe7878178b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:56.666116 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.hosts [None req-60198f69-fbb6-4eec-947f-1cd9626a96e7 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Enabling host nonexistent_hostname. Nov 02 13:20:56.679739 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-60198f69-fbb6-4eec-947f-1cd9626a96e7 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-60198f69-fbb6-4eec-947f-1cd9626a96e7 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Request method failure captured: Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 50 Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm60rAL3B8iogyV3aDTtSFGlXhzFFCK1wwPRDr1em-id_gDH99vEBBA4nFxLkKqLBht8Y4IS4JqY2i1DpC7iuXy2Kf-RKw3GT0We7g8-dWWrtc1wI5XnxZjcCWvHqWEyWpVgTvEQe5WoZgXnqQjisp56iYI59iUdwzP4XSJpiokcAsw Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:20:56.681883 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/90439eb51bd24fa7a4fb08a99bb35f9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 90439eb51bd24fa7a4fb08a99bb35f9f Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-673502485 Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: ace02da7db7a4593a191e20eac534e9e Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-HostsAdminNegativeTestJSON-673502485-project-admin Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.683439 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 13:20:56.684435 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:20:56.686447 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 13:20:56.692398 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:20:56.695501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-60198f69-fbb6-4eec-947f-1cd9626a96e7 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:20:56.696632 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-60198f69-fbb6-4eec-947f-1cd9626a96e7 tempest-HostsAdminNegativeTestJSON-673502485 tempest-HostsAdminNegativeTestJSON-673502485-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.050651 Nov 02 13:20:56.697769 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1105/2050] 10.222.0.113 () {60 vars in 1216 bytes} [Wed Nov 2 13:20:56 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:20:57.158677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:57.173527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:57.177475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:57.178708 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0dee53eb-ae24-4c3d-95a9-0cf5e27315c8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.564511 Nov 02 13:20:57.179306 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 946/2051] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:56 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:57.293141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:57.294033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:57.313314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:57.313886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:57.316698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:57.317553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:57.317984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:57.320630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:57.697295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:57.708584 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef710b22-ab71-435a-8bd8-b7df32f3f00a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1367 microversion: 2.1 time: 0.421733 Nov 02 13:20:57.724534 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1106/2052] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:57 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:57.736988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:57.739572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:57.760312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:57.761609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:57.762972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:57.764631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:57.767096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:57.769662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:57.780808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-477106288", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:57.871016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] validate_networks() for [('e2b62650-88d6-4596-95b0-ebba9750752f', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:20:57.999188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:58.011223 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-07d7ea7b-300a-44fe-bc76-7866a530c4df tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1481 microversion: 2.1 time: 0.286132 Nov 02 13:20:58.012208 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1107/2053] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:57 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1481 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:58.035921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2026486916", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "11ec4f6b-127c-44f1-a825-014c9ea38647"}], "block_device_mapping_v2": [{"uuid": "036f475c-ed2c-4c9a-9562-596b64051b76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:20:58.116549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] validate_networks() for [('11ec4f6b-127c-44f1-a825-014c9ea38647', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:20:58.667990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:20:58.669445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:20:58.670719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:20:58.671306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:20:58.671421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:20:58.689975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:58.691840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:58.693150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:58.693150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:58.693529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:58.693968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:58.747879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:20:58.765856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Getting quotas for user 392d81e9a1c74430a325c9ecc1dcfb44 and project 4d6fe1d935f34654baaeb1c8b48dda38. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:20:58.855999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:20:58.859921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='036f475c-ed2c-4c9a-9562-596b64051b76',volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:20:59.020311 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-18ef51c1-a217-47d3-a27d-cd1cc5cb77e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.993423 Nov 02 13:20:59.028635 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1108/2054] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:20:58 2022] POST /compute/v2.1/servers => generated 382 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:20:59.034463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:59.040217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:59.048701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.049346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.049807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:59.050758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.051221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.051707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:59.262288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:59.274303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:59.276249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:59.277859 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc258ea6-0126-4c32-9329-f4f88811126c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.247676 Nov 02 13:20:59.279029 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1109/2055] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:20:59 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:20:59.285325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:59.286317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:59.293379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.299030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.299341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:59.302433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.302433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.302433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:59.511656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:59.526901 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aeb19308-b0b1-4088-a623-333ea71acf70 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1367 microversion: 2.1 time: 0.246178 Nov 02 13:20:59.539371 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1110/2056] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:59 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:59.555619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7b27c15-b196-46f5-9037-791ad3705759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:59.556265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a7b27c15-b196-46f5-9037-791ad3705759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:59.702447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a7b27c15-b196-46f5-9037-791ad3705759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:20:59.724742 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a7b27c15-b196-46f5-9037-791ad3705759 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1056 microversion: 2.1 time: 0.183956 Nov 02 13:20:59.725401 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1111/2057] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:59 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1056 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:20:59.749381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:20:59.750111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:20:59.770787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.771505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.772255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:20:59.772776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:20:59.773695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:20:59.774854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.069799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:00.084668 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9fc81971-94a9-4ed6-bc3e-7092289544b8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1480 microversion: 2.1 time: 0.357870 Nov 02 13:21:00.095148 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1112/2058] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:20:59 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1480 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:00.310923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:00.311697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:00.319545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:00.320615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:00.321293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.322551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:00.323860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:00.324656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.633344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:00.644725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:00.646202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:00.647922 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5406a968-0a1a-4c8d-8d0f-2eb296449a71 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.342040 Nov 02 13:21:00.674567 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1113/2059] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:00 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:00.681499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:00.682712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:00.692923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:00.693723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:00.694363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.695338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:00.696004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:00.696666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.914966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:00.925069 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35bd35bb-e5b0-4dd7-bc65-286aafde2365 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1367 microversion: 2.1 time: 0.248365 Nov 02 13:21:00.925638 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1114/2060] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:00 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:00.933911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b670ea55-9100-4935-9650-a2beab66bf6d req-d2aac45a-1bb2-4e17-8326-f61344c4042d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "name": "network-vif-plugged", "status": "completed", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:00.954889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b670ea55-9100-4935-9650-a2beab66bf6d req-d2aac45a-1bb2-4e17-8326-f61344c4042d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:00.955412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b670ea55-9100-4935-9650-a2beab66bf6d req-d2aac45a-1bb2-4e17-8326-f61344c4042d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:00.955845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b670ea55-9100-4935-9650-a2beab66bf6d req-d2aac45a-1bb2-4e17-8326-f61344c4042d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:00.970184 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b670ea55-9100-4935-9650-a2beab66bf6d req-d2aac45a-1bb2-4e17-8326-f61344c4042d service nova] Creating event network-vif-plugged:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:21:00.978738 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b670ea55-9100-4935-9650-a2beab66bf6d req-d2aac45a-1bb2-4e17-8326-f61344c4042d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050067 Nov 02 13:21:00.980450 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1115/2061] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:00.989751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:00.990813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:01.000659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.001944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.002561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.004114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.005146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.005789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.112016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:01.135662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1f0d4c49-ed1a-40cd-9182-7f905223341b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1154 microversion: 2.1 time: 0.149657 Nov 02 13:21:01.141218 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1116/2062] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:00 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1154 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:01.152166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:01.156594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:01.178341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.180480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.181280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.184019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.184916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.186265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.446872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:21:01.446872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:21:01.446872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:21:01.446872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:21:01.446872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:21:01.461255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.461740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.465659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.468271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.468951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.471777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.504269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:01.514255 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9710ebd7-fdce-418e-9a1b-d59d7ac3736c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1480 microversion: 2.1 time: 0.369736 Nov 02 13:21:01.527136 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1117/2063] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:01 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1480 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:01.534030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Getting quotas for project 4541b34840b84a95aad1208579b6def7. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:21:01.556958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Getting quotas for user bec36047ed5746299791af725258d613 and project 4541b34840b84a95aad1208579b6def7. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:21:01.598204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:21:01.602578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:21:01.685925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:01.687135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:01.736956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.739070 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a64994f-e4b8-4c85-a669-2163c601d692 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.203443 Nov 02 13:21:01.740432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.740909 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 947/2064] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:20:57 2022] POST /compute/v2.1/servers => generated 385 bytes in 4206 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:21:01.744178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.745671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:01.749820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:01.750805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:01.756227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6434c96c-a543-4c96-9dcf-8117028f902c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:01.756839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6434c96c-a543-4c96-9dcf-8117028f902c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:02.049315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:02.060616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:02.063980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:02.066595 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b5e6f4e6-13a5-4e0d-ac8b-03e241bfb480 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.388334 Nov 02 13:21:02.068276 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1118/2065] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:01 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:02.074556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:02.075628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:02.087830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:02.090675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:02.091506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:02.093351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:02.095743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:02.096446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:02.210810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6434c96c-a543-4c96-9dcf-8117028f902c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:02.234952 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6434c96c-a543-4c96-9dcf-8117028f902c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1226 microversion: 2.1 time: 0.477921 Nov 02 13:21:02.236572 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 948/2066] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:01 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1226 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:02.257331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:02.258739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:02.283368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:02.288164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:02.290420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:02.291555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:02.292341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:02.293457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:02.709449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:02.726571 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31166cdc-19b9-40ee-bb66-34105cb0f3b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1367 microversion: 2.1 time: 0.656534 Nov 02 13:21:02.729119 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1119/2067] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:02 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1367 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:02.742435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-19b00432-0323-47d5-8cd9-1b81516b387a req-40cf9667-7be2-4b33-bee3-737de95bb088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9141f9f7-e728-4dc2-b08d-896411699869", "name": "network-vif-unplugged", "status": "completed", "tag": "707a33ab-8329-48d9-86bd-8bbe37d12038"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:02.768827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-19b00432-0323-47d5-8cd9-1b81516b387a req-40cf9667-7be2-4b33-bee3-737de95bb088 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:02.771222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-19b00432-0323-47d5-8cd9-1b81516b387a req-40cf9667-7be2-4b33-bee3-737de95bb088 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:02.772053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-19b00432-0323-47d5-8cd9-1b81516b387a req-40cf9667-7be2-4b33-bee3-737de95bb088 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:02.801181 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-19b00432-0323-47d5-8cd9-1b81516b387a req-40cf9667-7be2-4b33-bee3-737de95bb088 service nova] Creating event network-vif-unplugged:707a33ab-8329-48d9-86bd-8bbe37d12038 for instance 9141f9f7-e728-4dc2-b08d-896411699869 on n-h1-858384-19 Nov 02 13:21:02.822386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-19b00432-0323-47d5-8cd9-1b81516b387a req-40cf9667-7be2-4b33-bee3-737de95bb088 service nova] Instance 9141f9f7-e728-4dc2-b08d-896411699869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:21:02.866100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-19b00432-0323-47d5-8cd9-1b81516b387a req-40cf9667-7be2-4b33-bee3-737de95bb088 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134347 Nov 02 13:21:02.867820 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1120/2068] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:02.871840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:02.878635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:02.885010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:02.888002 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c468f414-9953-428e-96d7-d817132b3587 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1172 microversion: 2.1 time: 0.649172 Nov 02 13:21:02.888653 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 949/2069] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:02 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1172 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:02.907603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:02.910705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:02.913085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:02.916677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:02.920509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:02.922754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:03.101051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:03.101685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:03.130554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:03.131868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:03.133029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:03.134151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:03.136942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:03.138442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:03.328740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:03.345135 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9dab5388-5935-472b-b6d0-1ca02a5c3d2b tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1480 microversion: 2.1 time: 0.474133 Nov 02 13:21:03.345973 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1121/2070] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:02 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1480 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:03.366487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:03.367475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:03.378869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:03.386705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:03.387408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:03.388349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:03.389604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:03.390291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:03.424360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:03.544253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:03.566451 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b546dcf-f686-4c5b-9f0f-f98ef73285b3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1278 microversion: 2.1 time: 0.217092 Nov 02 13:21:03.567444 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1122/2071] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:03 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:03.756322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:03.757183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:03.773110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:03.774121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:03.775361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:03.776540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:03.778095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:03.779040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:04.405102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:04.415143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d1bb1c4-4ead-4a22-974f-dcca3d4272f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1554 microversion: 2.1 time: 0.663494 Nov 02 13:21:04.431843 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1123/2072] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:03 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1554 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:04.440446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:04.441360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:04.454022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:04.454515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:04.456565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:04.456565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:04.456565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:04.456565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:04.555040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:04.569635 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1640431-3906-429d-9124-97624fdcf116 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1172 microversion: 2.1 time: 0.136549 Nov 02 13:21:04.578133 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1124/2073] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:04 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1172 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:04.814382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:04.828276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:04.832441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:04.838395 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c3be356a-5ea7-4c65-b8ef-6105d3dfeffd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 1.747908 Nov 02 13:21:04.840315 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 950/2074] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:03 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:04.853375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:04.856153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:04.871410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:04.872184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:04.872862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:04.874142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:04.875699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:04.876866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:04.901830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-585333760", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": "none"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:05.012114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:21:05.012858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:21:05.014044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:21:05.014646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:21:05.015467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:21:05.025438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.026398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.026860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.028364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.028938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.030040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.054673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Getting quotas for project b421ad47e399459abc91a60f2ca1e103. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:21:05.062226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Getting quotas for user b9642c0b7757445ea53f2cfbd87f0f16 and project b421ad47e399459abc91a60f2ca1e103. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:21:05.083802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:21:05.087531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:21:05.160145 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a84fb163-0d93-4db1-947e-0b81c7f715c3 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.75 time: 0.580466 Nov 02 13:21:05.168563 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1125/2075] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:21:04 2022] POST /compute/v2.1/servers => generated 382 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:21:05.176206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a222b022-79b3-47f5-8516-0fb55d5998fb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:05.176993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a222b022-79b3-47f5-8516-0fb55d5998fb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:05.197942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a222b022-79b3-47f5-8516-0fb55d5998fb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.201677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a222b022-79b3-47f5-8516-0fb55d5998fb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.203972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a222b022-79b3-47f5-8516-0fb55d5998fb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.205041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a222b022-79b3-47f5-8516-0fb55d5998fb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.206148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a222b022-79b3-47f5-8516-0fb55d5998fb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.206811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a222b022-79b3-47f5-8516-0fb55d5998fb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.380958 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a222b022-79b3-47f5-8516-0fb55d5998fb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210795 Nov 02 13:21:05.382332 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1126/2076] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:21:05 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:05.393868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:05.394622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:05.405525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.410112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.410523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.411412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:05.412035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:05.412564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:05.736858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:05.769705 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-111b96b1-aec6-46a5-a0cf-a96452ff7ef8 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1284 microversion: 2.1 time: 0.382034 Nov 02 13:21:05.772171 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1127/2077] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:05 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1284 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:05.785564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a94ac2e-ad1f-4ee4-aab6-4660b6ff3c84 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:05.791575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a94ac2e-ad1f-4ee4-aab6-4660b6ff3c84 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:05.947803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:05.963004 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-44de55cd-e45f-4685-88a6-e92cc3de349c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1480 microversion: 2.1 time: 1.117348 Nov 02 13:21:05.964632 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 951/2078] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:04 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1480 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:05.976092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:05.978925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:06.000145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:06.000672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:06.001114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:06.002088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:06.002742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:06.003835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:06.312934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4a94ac2e-ad1f-4ee4-aab6-4660b6ff3c84 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:06.328452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4a94ac2e-ad1f-4ee4-aab6-4660b6ff3c84 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:06.330053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4a94ac2e-ad1f-4ee4-aab6-4660b6ff3c84 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:06.368492 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a94ac2e-ad1f-4ee4-aab6-4660b6ff3c84 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "PUT /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1361 microversion: 2.75 time: 0.593920 Nov 02 13:21:06.369131 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1128/2079] 10.222.0.113 () {62 vars in 1302 bytes} [Wed Nov 2 13:21:05 2022] PUT /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:06.390746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:06.391707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:06.415304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:06.429579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:06.430371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:06.431791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:06.432600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:06.437868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.149791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:07.164935 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16d985f2-e462-475d-8153-aaa7c3e1403d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1214 microversion: 2.1 time: 1.197951 Nov 02 13:21:07.175424 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 952/2080] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:05 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1214 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:07.175803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:07.176419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:07.202935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.203426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.203885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.204721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.205350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.205832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.376477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:07.393589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:07.396759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:07.404787 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd3e945f-99c5-498c-80ef-1663b7728825 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1413 microversion: 2.75 time: 0.237772 Nov 02 13:21:07.409222 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 953/2081] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:07 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1413 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:07.414416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:07.415605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:07.425984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.427536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.428190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.429127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.429908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.430598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.588904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:07.606342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:07.609103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:07.619314 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79e81499-639c-45be-942c-c27e1deac28a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 1.240791 Nov 02 13:21:07.621255 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1129/2082] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:06 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:07.631279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-313c5f48-7c49-4119-b481-a16229224956 req-2f15a2aa-07ae-4489-9450-5602a6ec5e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9141f9f7-e728-4dc2-b08d-896411699869", "tag": "707a33ab-8329-48d9-86bd-8bbe37d12038"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:07.652015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-313c5f48-7c49-4119-b481-a16229224956 req-2f15a2aa-07ae-4489-9450-5602a6ec5e6f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.655982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-313c5f48-7c49-4119-b481-a16229224956 req-2f15a2aa-07ae-4489-9450-5602a6ec5e6f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.657357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-313c5f48-7c49-4119-b481-a16229224956 req-2f15a2aa-07ae-4489-9450-5602a6ec5e6f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.677252 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-313c5f48-7c49-4119-b481-a16229224956 req-2f15a2aa-07ae-4489-9450-5602a6ec5e6f service nova] Creating event network-changed:707a33ab-8329-48d9-86bd-8bbe37d12038 for instance 9141f9f7-e728-4dc2-b08d-896411699869 on n-h1-858384-19 Nov 02 13:21:07.721091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-313c5f48-7c49-4119-b481-a16229224956 req-2f15a2aa-07ae-4489-9450-5602a6ec5e6f service nova] Instance 9141f9f7-e728-4dc2-b08d-896411699869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:21:07.743029 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-313c5f48-7c49-4119-b481-a16229224956 req-2f15a2aa-07ae-4489-9450-5602a6ec5e6f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120165 Nov 02 13:21:07.745418 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1130/2083] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:07.762679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:07.764068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:07.768438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:07.784690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.785794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.787164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:07.788124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:07.788894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:07.789702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:08.364670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:08.376606 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc16debf-80f8-438a-bf0e-e70052874053 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1284 microversion: 2.1 time: 0.965878 Nov 02 13:21:08.377204 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 954/2084] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:07 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1284 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:08.408071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:08.409093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:08.416649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:08.417546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:08.418286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:08.420842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:08.421564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:08.422244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:08.758257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:08.774855 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bcfc01aa-74ca-46fb-aeb8-27ae6e0e0ceb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1480 microversion: 2.1 time: 1.027986 Nov 02 13:21:08.776479 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1131/2085] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:07 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1480 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:08.783179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:08.784530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:08.792663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:08.793606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:08.804650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:08.807307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:08.807307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:08.807916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:08.943803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:08.953480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:08.955312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:08.961209 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4068fe75-66c1-4daf-8df6-2e24470885f5 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1419 microversion: 2.75 time: 0.183177 Nov 02 13:21:08.962430 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1132/2086] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:08 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1419 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:08.968548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:08.969640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:08.984482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:08.985334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:08.985972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:08.986899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:08.987550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:08.988333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.428554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:09.448115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:09.454170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:09.455752 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-017b67fe-ed3b-4a10-8132-df3ce80b61e8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.492149 Nov 02 13:21:09.459507 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1133/2087] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:08 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:09.469203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:09.469782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:09.471428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:09.487390 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-02e7f6de-870f-4ec0-9b7f-996c1069ae0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1214 microversion: 2.1 time: 1.102789 Nov 02 13:21:09.491204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.491992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.493795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.497723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.498492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.499134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.504563 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 955/2088] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:08 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1214 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:09.525038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5ebbda8f-3c0e-49d6-ace3-c733b079e01a req-48f44c4b-f0fc-4b2c-a1f7-278cbe6d8e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:09.569309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5ebbda8f-3c0e-49d6-ace3-c733b079e01a req-48f44c4b-f0fc-4b2c-a1f7-278cbe6d8e5b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.569791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5ebbda8f-3c0e-49d6-ace3-c733b079e01a req-48f44c4b-f0fc-4b2c-a1f7-278cbe6d8e5b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.570230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5ebbda8f-3c0e-49d6-ace3-c733b079e01a req-48f44c4b-f0fc-4b2c-a1f7-278cbe6d8e5b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.609435 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5ebbda8f-3c0e-49d6-ace3-c733b079e01a req-48f44c4b-f0fc-4b2c-a1f7-278cbe6d8e5b service nova] Creating event network-changed:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:21:09.625027 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5ebbda8f-3c0e-49d6-ace3-c733b079e01a req-48f44c4b-f0fc-4b2c-a1f7-278cbe6d8e5b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105339 Nov 02 13:21:09.627448 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 956/2089] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:09.694618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:09.721444 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f6f2edc3-439b-4ce1-961b-8ab519cc1d06 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1284 microversion: 2.1 time: 0.260221 Nov 02 13:21:09.743696 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1134/2090] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:09 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:09.807150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:09.808176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:09.829442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:09.831605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.832025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.832432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.848794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:09.849901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:09.852198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:09.991394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:09.993888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:10.008562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.009414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.010093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.011035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.013403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.015733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.309726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:10.329669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:10.330887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:10.342153 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6c2e342-3dfd-48a0-bb2c-d881beeade92 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1419 microversion: 2.75 time: 0.354724 Nov 02 13:21:10.342762 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1135/2091] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:09 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1419 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:10.491049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:10.491947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:10.507643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.508143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.510140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.512517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.513238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.515839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.876158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:10.881283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:10.901624 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-11ef41b9-af0a-45ad-9c22-d942215ee306 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1480 microversion: 2.1 time: 1.097753 Nov 02 13:21:10.908466 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 957/2092] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:09 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1480 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:10.922492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:10.923151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:10.943060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.945143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.945905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.946695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:10.955975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:10.957093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:10.981166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:11.000118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:11.008916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:11.012938 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-07864082-8913-48b8-b3b3-45844a172b26 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.526968 Nov 02 13:21:11.017860 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1136/2093] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:10 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:21:11.025223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:11.038304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:11.053805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:11.058487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:11.062782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:11.063811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:11.064487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:11.065577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:11.495925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:11.779742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:11.787924 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2899509-e2d1-4f08-b913-d5e817fe2737 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.768684 Nov 02 13:21:11.788523 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1137/2094] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:11 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:11.801925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:11.807553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:11.819781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:11.820345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:11.820775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:11.823862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:11.824574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:11.825180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:11.981553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.004635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.009680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.020098 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c754872c-a830-4123-9bfd-75d32de3276a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1419 microversion: 2.75 time: 0.220374 Nov 02 13:21:12.021645 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1138/2095] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:11 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1419 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:12.027914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:12.030878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:12.045733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.046716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.047526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.048628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.049131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.049872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.218799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:12.313728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.325857 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f253d9f-25ec-481b-9b20-87d1d018ff39 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1214 microversion: 2.1 time: 1.415277 Nov 02 13:21:12.327302 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 958/2096] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:10 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1214 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:12.334715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:12.336143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:12.347028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.348222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.348964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.350310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.351020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.351948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.742145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.743659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.767186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.773636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:12.774894 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e95fbd47-9b2c-4fb8-9b13-eefd51fcf2cb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1480 microversion: 2.1 time: 0.750414 Nov 02 13:21:12.777787 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1139/2097] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:12 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1480 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:12.786308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-79b50954-b9d9-4e24-b280-f6707ba1e65f req-79ba2337-4601-445d-98d4-f167bf489ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b7b1a4-c1d8-419d-81c2-24577c4a6269", "tag": "44616a73-0087-4079-9a75-1d953925b087"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:12.788628 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7da55437-9352-437c-b61c-2dce5ea313ba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1818 microversion: 2.25 time: 0.448628 Nov 02 13:21:12.798847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-79b50954-b9d9-4e24-b280-f6707ba1e65f req-79ba2337-4601-445d-98d4-f167bf489ec2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.799961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-79b50954-b9d9-4e24-b280-f6707ba1e65f req-79ba2337-4601-445d-98d4-f167bf489ec2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.800179 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 959/2098] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:12 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1818 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:12.801567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-79b50954-b9d9-4e24-b280-f6707ba1e65f req-79ba2337-4601-445d-98d4-f167bf489ec2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.820405 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-79b50954-b9d9-4e24-b280-f6707ba1e65f req-79ba2337-4601-445d-98d4-f167bf489ec2 service nova] Creating event network-changed:44616a73-0087-4079-9a75-1d953925b087 for instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 on n-h1-858384-19 Nov 02 13:21:12.849935 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-79b50954-b9d9-4e24-b280-f6707ba1e65f req-79ba2337-4601-445d-98d4-f167bf489ec2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063517 Nov 02 13:21:12.849935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1140/2099] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:12.850156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:12.850156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:12.858618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.860008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.860712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:12.861959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:12.862723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:12.863353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:13.051963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:13.052685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:13.070094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.070878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.071533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:13.072280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.072791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.073167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:13.245521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:13.279591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:13.282095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:13.289874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-92fb0ca6-8cb0-4970-8630-01f9f52f0a71 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1419 microversion: 2.75 time: 0.241818 Nov 02 13:21:13.291208 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1141/2100] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:13 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1419 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:21:13.350275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:13.352231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:13.372141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.374233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.375189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:13.376250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.377246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.377856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:13.384114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:13.638630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:13.662218 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1cad96d2-f305-4a54-95f9-210dc282f8e2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.840488 Nov 02 13:21:13.690810 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 960/2101] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:12 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:13.806229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:13.807042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:13.817294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.820016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.820557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:13.821313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.821976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.822918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:13.939551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:13.957942 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45cfaae7-5049-4ae2-b8c1-eccc82799474 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.612024 Nov 02 13:21:13.958556 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1142/2102] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:13 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:13.971812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:13.971812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:13.976606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.977385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.978013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:13.978912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:13.979572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:13.979999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.302023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.324204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.324204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.324204 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c6d8b0ad-40de-493d-aa8a-20838f6e3c30 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1808 microversion: 2.25 time: 0.361991 Nov 02 13:21:14.335837 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1143/2103] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:13 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1808 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:14.349942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:14.350957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:14.359539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.359539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.359918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.360791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.361327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.361833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.365303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.386618 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-36b17109-82ae-48b6-a651-f2e545407fb6 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1480 microversion: 2.1 time: 0.583351 Nov 02 13:21:14.388254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 961/2104] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:13 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1480 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:14.403417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1de7808d-8aab-4006-8519-e33fbdb56376 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '.version_select at 0x7fe78f93d3a0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:14.414920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1de7808d-8aab-4006-8519-e33fbdb56376 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.416031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1de7808d-8aab-4006-8519-e33fbdb56376 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.416952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1de7808d-8aab-4006-8519-e33fbdb56376 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.437474 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1de7808d-8aab-4006-8519-e33fbdb56376 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 4517 microversion: 2.25 time: 0.042804 Nov 02 13:21:14.438897 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 962/2105] 10.222.0.113 () {60 vars in 1189 bytes} [Wed Nov 2 13:21:14 2022] GET /compute/v2.1/os-migrations => generated 4517 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:14.459266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:14.460232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:14.469847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.470740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.471399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.472477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.473131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.473871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.506268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.523147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.524206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.550232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f22c51cb-c2b3-493f-b732-04aeda59262d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1440 microversion: 2.75 time: 0.201887 Nov 02 13:21:14.551374 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1144/2106] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:14 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1440 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:14.581580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:14.585281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:14.591965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.592762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.593206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.593923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.594549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.595170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.687315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:21:14.687727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:21:14.688316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:21:14.690109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:21:14.690109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:21:14.780240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:14.787604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.788373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.788994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.789945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.790410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.790846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.910175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.920631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.922654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:14.929444 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efc3ef18-949c-495c-9145-74a7986a297b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "POST /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb/action" status: 202 len: 1497 microversion: 2.75 time: 0.351645 Nov 02 13:21:14.930737 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1145/2107] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:21:14 2022] POST /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb/action => generated 1497 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 455 bytes (2 switches on core 0) Nov 02 13:21:14.936587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:14.937722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:14.953857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.955691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.956366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.957393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:14.959411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:14.960344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:14.997130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 7ed1faa6-e6ad-4757-992d-0750ae29a307 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:15.021090 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e254f407-ab2d-4dbe-b7fc-de4261ee8cdb tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 2429 microversion: 2.25 time: 0.566029 Nov 02 13:21:15.022219 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 963/2108] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:14 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 2429 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:21:15.027535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-aeebe2d9-e4d9-4ce8-9600-8be3e1dd7b89 req-68dafd29-be45-48e7-a086-8232e9640205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc8a49-5bee-4ca3-892f-52e3f1f33539", "tag": "6d336abf-e6a6-4a39-bbde-d6cb143d03d9"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:15.043493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-aeebe2d9-e4d9-4ce8-9600-8be3e1dd7b89 req-68dafd29-be45-48e7-a086-8232e9640205 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.044247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:15.045283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-aeebe2d9-e4d9-4ce8-9600-8be3e1dd7b89 req-68dafd29-be45-48e7-a086-8232e9640205 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.046584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-aeebe2d9-e4d9-4ce8-9600-8be3e1dd7b89 req-68dafd29-be45-48e7-a086-8232e9640205 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.060050 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-aeebe2d9-e4d9-4ce8-9600-8be3e1dd7b89 req-68dafd29-be45-48e7-a086-8232e9640205 service nova] Creating event network-changed:6d336abf-e6a6-4a39-bbde-d6cb143d03d9 for instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 on n-h2-858384-19 Nov 02 13:21:15.066646 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-aeebe2d9-e4d9-4ce8-9600-8be3e1dd7b89 req-68dafd29-be45-48e7-a086-8232e9640205 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042695 Nov 02 13:21:15.069488 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 964/2109] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:15.080185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:15.082173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:15.090115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.090878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.091590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.092485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.093116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.093731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.198992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:15.220581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:15.224430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:15.231602 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b59baefc-d3a2-4050-9e37-0db46dd6d0a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.160331 Nov 02 13:21:15.231987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:15.233827 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 965/2110] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:15 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:15.238994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:15.240056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:15.248600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.249414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.250219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.251716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.252385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.252998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.257561 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-58bd8119-403a-4cd1-80da-5ae0f7981a5e tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.319550 Nov 02 13:21:15.276769 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1146/2111] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:14 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:15.287378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:15.289249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:15.303868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.304586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.304842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.305665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.306135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.306569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.497870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:15.506717 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-39128c87-dbd8-4ecc-8a7a-780a780cde9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.271621 Nov 02 13:21:15.510606 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 966/2112] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:15 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:15.516983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:15.517605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:15.543597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.546423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.547062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.548242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.550762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.551917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.580044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid 7ed1faa6-e6ad-4757-992d-0750ae29a307 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:15.621099 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c8b46dc-5df2-4a0a-8129-54a6a6f24dde tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 2429 microversion: 2.25 time: 0.337989 Nov 02 13:21:15.622683 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1147/2113] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:15 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 2429 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:15.749047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:15.749554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:15.760183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.764571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.765385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.766390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:15.767513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:15.768138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:15.890317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:15.918843 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-994f16fd-0cd5-4c70-bbcd-5fc07664c910 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1478 microversion: 2.1 time: 0.404319 Nov 02 13:21:15.938688 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 967/2114] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:15 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1478 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:15.987787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lazy-loading 'services' on Instance uuid 7ed1faa6-e6ad-4757-992d-0750ae29a307 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:16.146390 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39964961-5176-44a5-b951-564fb14bed32 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments/55359b37-94d7-4c48-9969-646bd59bfc09" status: 202 len: 0 microversion: 2.25 time: 0.403776 Nov 02 13:21:16.147023 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1148/2115] 10.222.0.113 () {60 vars in 1462 bytes} [Wed Nov 2 13:21:15 2022] DELETE /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments/55359b37-94d7-4c48-9969-646bd59bfc09 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:21:16.162127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b3e1b76-1560-44a0-ac98-26012588422c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.169192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b3e1b76-1560-44a0-ac98-26012588422c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:16.183245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b76-1560-44a0-ac98-26012588422c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.186868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b76-1560-44a0-ac98-26012588422c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.187508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b76-1560-44a0-ac98-26012588422c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.188354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b76-1560-44a0-ac98-26012588422c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.189243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b76-1560-44a0-ac98-26012588422c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.189701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b76-1560-44a0-ac98-26012588422c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.217003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-494897804", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "ab09ad8a-83ac-42f7-97d8-5ec799a5bcc6"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:16.241638 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b3e1b76-1560-44a0-ac98-26012588422c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089503 Nov 02 13:21:16.252118 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1149/2116] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:16 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:21:16.276213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.279164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:16.291255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] validate_networks() for [('ab09ad8a-83ac-42f7-97d8-5ec799a5bcc6', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:21:16.295653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.296351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.296808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.297645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.298113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.298548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.317999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=16 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:16.391722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:16.407236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:16.409978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:16.419065 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eba6e9b5-41f3-4e54-809c-10bd0f0721e9 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.156208 Nov 02 13:21:16.420989 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1150/2117] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:16 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:21:16.441727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.442467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:16.453671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.454121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.454791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.455759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.456393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.457001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.684253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:16.695917 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-53d0382c-27ae-45f9-b0bb-c0ecbc1c04b2 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.269225 Nov 02 13:21:16.697924 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1151/2118] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:16 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:16.704694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.705660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:16.720555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.721945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.722633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.724066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.724775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.725595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.821773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:21:16.822271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:21:16.822846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:21:16.823340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:21:16.823996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:21:16.840212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.842933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.843669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.844700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.845365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.847544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.877535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Getting quotas for project 64d1e36587404641ac2dcc993e860a3c. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:21:16.885090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Getting quotas for user 8512848478ff4d6ea55d926bb887fa65 and project 64d1e36587404641ac2dcc993e860a3c. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:21:16.903632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:21:16.907811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:16.908077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:21:16.917469 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6aff6617-e1c9-40cc-bcc6-cc6caf2ed36b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.218216 Nov 02 13:21:16.918420 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1152/2119] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:16 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:16.946652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.947310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:16.954300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.954800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.955277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.956047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:16.956504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:16.956980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:16.972732 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60228fb0-2563-4836-a1ab-29c46fe343ea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.032593 Nov 02 13:21:16.974169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 968/2120] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:21:15 2022] POST /compute/v2.1/servers => generated 382 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:21:16.987456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20977890-99dd-4561-bfae-d51b918c2d63 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:16.988409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-20977890-99dd-4561-bfae-d51b918c2d63 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:17.065847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-20977890-99dd-4561-bfae-d51b918c2d63 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:17.075472 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20977890-99dd-4561-bfae-d51b918c2d63 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1221 microversion: 2.1 time: 0.093085 Nov 02 13:21:17.091167 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 969/2121] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:16 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:17.158043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:17.167266 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44176546-84ac-4c5e-a5c8-94316a5b3109 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1478 microversion: 2.1 time: 0.224858 Nov 02 13:21:17.168832 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1153/2122] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:16 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1478 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:17.261309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6c4747b8-3cba-4fad-a39e-92e9e8c7cfec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:17.267716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6c4747b8-3cba-4fad-a39e-92e9e8c7cfec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:17.279478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c4747b8-3cba-4fad-a39e-92e9e8c7cfec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.281045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c4747b8-3cba-4fad-a39e-92e9e8c7cfec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.281790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c4747b8-3cba-4fad-a39e-92e9e8c7cfec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.282795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c4747b8-3cba-4fad-a39e-92e9e8c7cfec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.283533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c4747b8-3cba-4fad-a39e-92e9e8c7cfec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.284050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c4747b8-3cba-4fad-a39e-92e9e8c7cfec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.322061 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6c4747b8-3cba-4fad-a39e-92e9e8c7cfec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068276 Nov 02 13:21:17.327843 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 970/2123] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:17 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:21:17.478992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:17.480156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:17.502850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.507058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.507709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.508738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.509320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.511502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.614569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:17.625245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:17.626906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:17.632383 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d8cce63-eab2-463a-a8ff-0701ae203ff6 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.171850 Nov 02 13:21:17.633275 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1154/2124] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:17 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:21:17.723906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:17.725284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:17.732339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.733332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.733947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.734864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.735703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.736311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.941408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:17.943396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:17.954459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.955437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.957807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.959467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:17.960133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:17.961093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:17.998420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:18.011437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:18.030734 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-93a1823f-e7e4-4bd8-9068-d500b6bc6b3c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.312996 Nov 02 13:21:18.032196 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 971/2125] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:17 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:18.104753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:18.105687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:18.113350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.114601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.115463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:18.116466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.117183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.117849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:18.181836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:18.191556 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e99186f6-caa3-44c1-900a-2b0e00ca8432 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.253886 Nov 02 13:21:18.193023 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1155/2126] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:17 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:18.198226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:18.199089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:18.206339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.207072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.207736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:18.208656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.209308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.210547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:18.406052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:18.416568 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edd8445c-2264-4789-8037-bfdb29b1aa96 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1478 microversion: 2.1 time: 0.222167 Nov 02 13:21:18.417177 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1156/2127] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:18 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1478 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:18.440626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c64de0fe-1163-4008-9e9d-84644cc8497f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:18.445317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c64de0fe-1163-4008-9e9d-84644cc8497f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:18.452763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64de0fe-1163-4008-9e9d-84644cc8497f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.453538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64de0fe-1163-4008-9e9d-84644cc8497f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.454169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64de0fe-1163-4008-9e9d-84644cc8497f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:18.455344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64de0fe-1163-4008-9e9d-84644cc8497f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.455998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64de0fe-1163-4008-9e9d-84644cc8497f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.456605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64de0fe-1163-4008-9e9d-84644cc8497f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:18.505752 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c64de0fe-1163-4008-9e9d-84644cc8497f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.069446 Nov 02 13:21:18.507806 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1157/2128] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:18 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:21:18.545672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:18.553806 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e8a63698-e69e-44a6-8532-09c2c19ec3d1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1225 microversion: 2.1 time: 0.452944 Nov 02 13:21:18.554651 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 972/2129] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:18 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1225 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:18.661525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:18.662250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:18.676854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.678305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.681769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:18.682572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:18.683165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:18.688370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:18.856311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:18.867479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:18.869313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:18.875921 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-649cd3e2-a978-4dfe-9132-3a1985073d41 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.218586 Nov 02 13:21:18.876825 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1158/2130] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:18 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:19.060510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:19.062302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:19.073397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.073966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.074645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.076383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.078439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.088135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.225341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:19.226361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:19.235644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.237006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.237709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.239208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.239943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.240632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.455782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:19.462201 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf864892-7a73-4524-a461-0ef4d72255ca tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.242975 Nov 02 13:21:19.482593 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1159/2131] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:19 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:19.489849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:19.491077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:19.503627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.505068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.505537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.506268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.506800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.508369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.570355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:19.607468 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-48049a98-384e-423a-b5bd-88de16e7b936 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.552578 Nov 02 13:21:19.637827 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 973/2132] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:19 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:19.661520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-391446a8-8431-43e7-b036-f4152dff6840 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:19.689369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-391446a8-8431-43e7-b036-f4152dff6840 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:19.720477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391446a8-8431-43e7-b036-f4152dff6840 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.721239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391446a8-8431-43e7-b036-f4152dff6840 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.721854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391446a8-8431-43e7-b036-f4152dff6840 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.723062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391446a8-8431-43e7-b036-f4152dff6840 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.723741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391446a8-8431-43e7-b036-f4152dff6840 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.724348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391446a8-8431-43e7-b036-f4152dff6840 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.874673 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-391446a8-8431-43e7-b036-f4152dff6840 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.231429 Nov 02 13:21:19.879070 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 974/2133] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:19 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:21:19.889810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:19.890684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:19.899382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.902143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.902935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.906785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:19.908567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:19.909579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:19.988850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:20.003596 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f9de55b8-068e-4d9f-8c9b-c3890dff8af0 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1478 microversion: 2.1 time: 0.518330 Nov 02 13:21:20.004319 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1160/2134] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:19 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1478 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:20.013966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:20.018728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:20.035320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:20.039208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:20.039947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:20.040873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:20.041499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:20.042119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:20.179645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:20.193842 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-65cf77c7-b286-4554-a09a-1bec8783d522 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1273 microversion: 2.1 time: 0.313474 Nov 02 13:21:20.196141 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 975/2135] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:19 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1273 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:20.236057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:20.252031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:20.256034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:20.268591 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b3e5c4f-6cc5-4c9f-9ccb-6a8d38378123 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.261656 Nov 02 13:21:20.271837 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1161/2136] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:20 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:20.489379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:20.490476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:20.497745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:20.498831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:20.499515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:20.500481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:20.501235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:20.501732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:20.650131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:20.650830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:20.663476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:20.664353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:20.664977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:20.668437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:20.669143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:20.670793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.103058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:21.113119 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84a98a4c-caba-455f-83e2-e0d34366ffb5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.467010 Nov 02 13:21:21.127642 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1162/2137] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:20 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:21.146728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eb295558-6bb5-4fcf-9953-64de67fc03f9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:21.149425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eb295558-6bb5-4fcf-9953-64de67fc03f9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:21.172744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:21.180102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb295558-6bb5-4fcf-9953-64de67fc03f9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.180634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb295558-6bb5-4fcf-9953-64de67fc03f9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.181176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb295558-6bb5-4fcf-9953-64de67fc03f9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.183093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bab8b084-73d7-4fa2-a374-6c421b8ef237 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.697647 Nov 02 13:21:21.185997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb295558-6bb5-4fcf-9953-64de67fc03f9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.186490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb295558-6bb5-4fcf-9953-64de67fc03f9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.186939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb295558-6bb5-4fcf-9953-64de67fc03f9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.187825 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 976/2138] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:20 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:21.192904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:21.208290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:21.225162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.235822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.236693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.237717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.238414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.239144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.242585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:21.315791 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eb295558-6bb5-4fcf-9953-64de67fc03f9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.177421 Nov 02 13:21:21.322161 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1163/2139] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:21 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:21:21.330629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:21.331550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:21.344230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.345116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.345645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.346566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.347105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.347612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.469240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:21.483078 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-776dee42-cb2e-4b25-9ea0-e3559e66e29a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1279 microversion: 2.1 time: 0.161961 Nov 02 13:21:21.484796 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1164/2140] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:21 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:21.490532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:21.491540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:21.501133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.502012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.502703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.503869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:21.504610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:21.505498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:21.592801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:21.604267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:21.606178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:21.613512 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-02a33cca-3c1e-45e1-b661-6ac016f1ef98 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.127075 Nov 02 13:21:21.614830 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1165/2141] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:21 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:22.104541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:22.119072 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1afd7be1-b5a2-4b4e-9218-9e5f7cfc183d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1475 microversion: 2.1 time: 0.929903 Nov 02 13:21:22.123098 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 977/2142] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:21 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1475 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:22.148241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ecb50cb3-5db0-469c-b9e1-1d927e3ea292 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:22.148845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ecb50cb3-5db0-469c-b9e1-1d927e3ea292 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:22.159016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:22.160130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:22.169001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb50cb3-5db0-469c-b9e1-1d927e3ea292 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.171102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb50cb3-5db0-469c-b9e1-1d927e3ea292 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.172735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.174931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb50cb3-5db0-469c-b9e1-1d927e3ea292 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.175210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.175210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.175210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.175923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb50cb3-5db0-469c-b9e1-1d927e3ea292 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.176571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb50cb3-5db0-469c-b9e1-1d927e3ea292 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.177089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecb50cb3-5db0-469c-b9e1-1d927e3ea292 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.177736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.182864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.292428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:22.390033 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ecb50cb3-5db0-469c-b9e1-1d927e3ea292 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "POST /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869/action" status: 202 len: 0 microversion: 2.1 time: 0.245559 Nov 02 13:21:22.395145 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1166/2143] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:21:22 2022] POST /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:21:22.401384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:22.402555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:22.412379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.413484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.414202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.415513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.416352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.417037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.667945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:22.677038 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ebf5c447-2024-4d38-b1aa-4a377a725cc2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.280331 Nov 02 13:21:22.677875 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1167/2144] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:22 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:22.682406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39601dbd-81ed-4f4e-9db0-27c2f205f407 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:22.684674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39601dbd-81ed-4f4e-9db0-27c2f205f407 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:22.691012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39601dbd-81ed-4f4e-9db0-27c2f205f407 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.691539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39601dbd-81ed-4f4e-9db0-27c2f205f407 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.692049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39601dbd-81ed-4f4e-9db0-27c2f205f407 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.692761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39601dbd-81ed-4f4e-9db0-27c2f205f407 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.693218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39601dbd-81ed-4f4e-9db0-27c2f205f407 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.694432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39601dbd-81ed-4f4e-9db0-27c2f205f407 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.734526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:22.742603 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39601dbd-81ed-4f4e-9db0-27c2f205f407 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.063847 Nov 02 13:21:22.743686 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1168/2145] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:22 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:21:22.748693 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40da0115-8e44-41f0-a09c-811ef8dca412 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.595375 Nov 02 13:21:22.749750 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 978/2146] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:22 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:22.763730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:22.764423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:22.771883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:22.772983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:22.777257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.777755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.778188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.779552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.779992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.780205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.780409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.780829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.781420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.783331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.783805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.784237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.926360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:22.944043 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c703bd50-089f-4524-ba1e-457cad5c0eb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1279 microversion: 2.1 time: 0.192230 Nov 02 13:21:22.944650 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 979/2147] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:22 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1279 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:22.949799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:22.950821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:22.967037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.968004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.968699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:22.969418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:22.969874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:22.970297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:23.072652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:23.111895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:23.126583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:23.140153 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f463b4e-8743-4409-9a11-f448280a5e99 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.193665 Nov 02 13:21:23.142923 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 980/2148] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:22 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:23.156796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7c75ff1f-d91d-43b7-b62d-96a352ede0be req-cd028ab9-f1a8-4a76-9ab0-5a453b0b3e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebc8a49-5bee-4ca3-892f-52e3f1f33539", "name": "network-vif-plugged", "status": "completed", "tag": "6d336abf-e6a6-4a39-bbde-d6cb143d03d9"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:23.182322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7c75ff1f-d91d-43b7-b62d-96a352ede0be req-cd028ab9-f1a8-4a76-9ab0-5a453b0b3e14 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:23.185302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7c75ff1f-d91d-43b7-b62d-96a352ede0be req-cd028ab9-f1a8-4a76-9ab0-5a453b0b3e14 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:23.187092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7c75ff1f-d91d-43b7-b62d-96a352ede0be req-cd028ab9-f1a8-4a76-9ab0-5a453b0b3e14 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:23.217195 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7c75ff1f-d91d-43b7-b62d-96a352ede0be req-cd028ab9-f1a8-4a76-9ab0-5a453b0b3e14 service nova] Creating event network-vif-plugged:6d336abf-e6a6-4a39-bbde-d6cb143d03d9 for instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 on n-h2-858384-19 Nov 02 13:21:23.227903 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7c75ff1f-d91d-43b7-b62d-96a352ede0be req-cd028ab9-f1a8-4a76-9ab0-5a453b0b3e14 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080628 Nov 02 13:21:23.230413 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 981/2149] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:23.294671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:23.328071 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-94588d4f-b9bc-47b7-8aa0-4f5779d2aa0d tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.577770 Nov 02 13:21:23.334875 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1169/2150] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:22 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:23.709645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:23.715388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:23.745452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:23.750672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:23.752002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:23.753854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:23.758917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:23.760099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:23.767575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7cc607df-f9af-43c2-b4b2-de47276aea3f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:23.789964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7cc607df-f9af-43c2-b4b2-de47276aea3f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:23.818868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cc607df-f9af-43c2-b4b2-de47276aea3f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:23.830643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cc607df-f9af-43c2-b4b2-de47276aea3f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:23.832046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cc607df-f9af-43c2-b4b2-de47276aea3f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:23.836206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cc607df-f9af-43c2-b4b2-de47276aea3f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:23.842330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cc607df-f9af-43c2-b4b2-de47276aea3f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:23.843256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cc607df-f9af-43c2-b4b2-de47276aea3f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:23.863485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:23.926869 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7cc607df-f9af-43c2-b4b2-de47276aea3f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.172318 Nov 02 13:21:23.928083 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1170/2151] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:23 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:21:23.941068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:23.942030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:23.950052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:23.951483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:23.952206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:23.953418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:23.954477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:23.956120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:24.379431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:24.394455 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce0db0a0-e733-408d-9ea8-45bba712de36 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.697346 Nov 02 13:21:24.420686 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 982/2152] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:23 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:24.426552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:24.427531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:24.442801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:24.443635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:24.444246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:24.445142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:24.445789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:24.446386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:24.792328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:24.808621 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6f468f0b-9cc0-40d6-b783-0b14fb2c9157 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.873268 Nov 02 13:21:24.824595 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1171/2153] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:23 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:24.851593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:24.853308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:24.867671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:24.869030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:24.870322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:24.871935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:24.872982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:24.874396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:24.988885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:25.000323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:25.002188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:25.008892 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-76c2e96b-2a63-4747-97fa-f998927f2261 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.181491 Nov 02 13:21:25.009746 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1172/2154] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:24 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:25.015870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:25.016798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:25.023446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:25.024213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:25.025562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:25.027180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:25.027842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:25.028507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:25.226240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:25.237644 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc643cc3-3767-486d-b348-0d189c5bd47a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.226336 Nov 02 13:21:25.249748 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1173/2155] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:25 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:25.260517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d6b0c5d9-da56-494f-98ef-02c03ac4172a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:25.269681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d6b0c5d9-da56-494f-98ef-02c03ac4172a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:25.290995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6b0c5d9-da56-494f-98ef-02c03ac4172a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:25.291824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6b0c5d9-da56-494f-98ef-02c03ac4172a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:25.292639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6b0c5d9-da56-494f-98ef-02c03ac4172a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:25.293526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6b0c5d9-da56-494f-98ef-02c03ac4172a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:25.294699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6b0c5d9-da56-494f-98ef-02c03ac4172a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:25.295337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6b0c5d9-da56-494f-98ef-02c03ac4172a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:25.340525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:25.358038 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3ae9db49-7c40-4ebc-838e-60d4e90feff6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.935911 Nov 02 13:21:25.359009 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 983/2156] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:24 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:25.381849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-db4ca0c8-f1b6-47eb-b310-7e3e3dbd047b req-85b26edc-f157-4873-bee3-10468be14b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9141f9f7-e728-4dc2-b08d-896411699869", "name": "network-vif-plugged", "status": "completed", "tag": "707a33ab-8329-48d9-86bd-8bbe37d12038"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:25.385947 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d6b0c5d9-da56-494f-98ef-02c03ac4172a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134734 Nov 02 13:21:25.387160 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1174/2157] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:25 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:21:25.400165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-db4ca0c8-f1b6-47eb-b310-7e3e3dbd047b req-85b26edc-f157-4873-bee3-10468be14b5b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:25.401871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-db4ca0c8-f1b6-47eb-b310-7e3e3dbd047b req-85b26edc-f157-4873-bee3-10468be14b5b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:25.402389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-db4ca0c8-f1b6-47eb-b310-7e3e3dbd047b req-85b26edc-f157-4873-bee3-10468be14b5b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:25.415959 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-db4ca0c8-f1b6-47eb-b310-7e3e3dbd047b req-85b26edc-f157-4873-bee3-10468be14b5b service nova] Creating event network-vif-plugged:707a33ab-8329-48d9-86bd-8bbe37d12038 for instance 9141f9f7-e728-4dc2-b08d-896411699869 on n-h1-858384-19 Nov 02 13:21:25.424058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-db4ca0c8-f1b6-47eb-b310-7e3e3dbd047b req-85b26edc-f157-4873-bee3-10468be14b5b service nova] Instance 9141f9f7-e728-4dc2-b08d-896411699869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:21:25.433902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:25.434519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:25.442279 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-db4ca0c8-f1b6-47eb-b310-7e3e3dbd047b req-85b26edc-f157-4873-bee3-10468be14b5b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073329 Nov 02 13:21:25.443317 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 984/2158] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:25.444890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:25.445502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:25.446214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:25.448248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:25.448248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:25.448248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:25.645195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:25.665888 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e628422c-ea5c-442e-8408-1a14f8108fa1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.234771 Nov 02 13:21:25.679140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1175/2159] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:25 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:25.850450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:25.851203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:25.859854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:25.860349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:25.860798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:25.861528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:25.861984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:25.862412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.050828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:26.054605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:26.066017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.068442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.069920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.072080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.074028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.074660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.183705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:26.202948 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-491c3c5b-a1e5-43db-9a4f-b9b7fbcdb69d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1326 microversion: 2.1 time: 0.356554 Nov 02 13:21:26.203650 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 985/2160] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:25 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1326 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:26.204947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:26.213415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ef717243-1c26-401b-bc7e-ecbeddcf81b4 req-11fac778-f9ad-4a67-b973-8c8324f3ad26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "679d27a4-cc40-4091-ae09-84372ff9baea", "tag": "4b53cd9d-7baa-45af-9312-e0ba2d584523"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:26.213766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:26.215643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:26.225549 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-23bb298a-a781-4a61-a244-b0fd2afebbd0 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.186236 Nov 02 13:21:26.226409 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1176/2161] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:26 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:21:26.257100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ef717243-1c26-401b-bc7e-ecbeddcf81b4 req-11fac778-f9ad-4a67-b973-8c8324f3ad26 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.257360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ef717243-1c26-401b-bc7e-ecbeddcf81b4 req-11fac778-f9ad-4a67-b973-8c8324f3ad26 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.263629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ef717243-1c26-401b-bc7e-ecbeddcf81b4 req-11fac778-f9ad-4a67-b973-8c8324f3ad26 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.280937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:26.288817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:26.300721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.301549 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ef717243-1c26-401b-bc7e-ecbeddcf81b4 req-11fac778-f9ad-4a67-b973-8c8324f3ad26 service nova] Creating event network-changed:4b53cd9d-7baa-45af-9312-e0ba2d584523 for instance 679d27a4-cc40-4091-ae09-84372ff9baea on n-h2-858384-19 Nov 02 13:21:26.305435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.305968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.307455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.307934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.308370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.319723 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ef717243-1c26-401b-bc7e-ecbeddcf81b4 req-11fac778-f9ad-4a67-b973-8c8324f3ad26 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114084 Nov 02 13:21:26.321068 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 986/2162] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:26.388094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:26.388974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:26.406419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.406927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.407411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.408138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.408601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.409030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.583786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:26.615828 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79474207-ac67-4ff3-9109-b5e4d248b2f8 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.350682 Nov 02 13:21:26.618581 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1177/2163] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:26 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:26.646756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dafaf19f-fac6-47a2-90c3-9c9aae2c53bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:26.655149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dafaf19f-fac6-47a2-90c3-9c9aae2c53bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:26.670513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dafaf19f-fac6-47a2-90c3-9c9aae2c53bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.673569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dafaf19f-fac6-47a2-90c3-9c9aae2c53bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.675074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dafaf19f-fac6-47a2-90c3-9c9aae2c53bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.678455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dafaf19f-fac6-47a2-90c3-9c9aae2c53bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.679245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dafaf19f-fac6-47a2-90c3-9c9aae2c53bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.681183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dafaf19f-fac6-47a2-90c3-9c9aae2c53bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.785822 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dafaf19f-fac6-47a2-90c3-9c9aae2c53bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.152179 Nov 02 13:21:26.786419 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1178/2164] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:26 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:21:26.798771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:26.799772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:26.806587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.807075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.807670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.808698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:26.809317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:26.811820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:26.867068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:27.031605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:27.040739 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6c229a7a-7b15-4b00-bbf5-2c143a0d71d6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.253273 Nov 02 13:21:27.041329 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1179/2165] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:26 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:27.076723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:27.234170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:27.235421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:27.250308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.251307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.251952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.252861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.253526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.254145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.328814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:27.353086 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-683099e2-b829-49c4-91fe-ab718383fe83 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.969760 Nov 02 13:21:27.356144 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 987/2166] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:26 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:27.367258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:27.370916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:27.385313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.386049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.386654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.387580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.388304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.396910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.495584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:27.503961 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74560823-ee1f-4cc6-a133-82ba11bc50e1 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1520 microversion: 2.1 time: 0.275610 Nov 02 13:21:27.504551 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1180/2167] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:27 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:27.509005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-196a2fb1-43cd-4866-b9f2-624335dcc6ed req-9fec8560-fdf8-4501-9087-59be040fbe1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b7b1a4-c1d8-419d-81c2-24577c4a6269", "name": "network-vif-plugged", "status": "completed", "tag": "44616a73-0087-4079-9a75-1d953925b087"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:27.519103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-196a2fb1-43cd-4866-b9f2-624335dcc6ed req-9fec8560-fdf8-4501-9087-59be040fbe1c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.519621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-196a2fb1-43cd-4866-b9f2-624335dcc6ed req-9fec8560-fdf8-4501-9087-59be040fbe1c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.520060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-196a2fb1-43cd-4866-b9f2-624335dcc6ed req-9fec8560-fdf8-4501-9087-59be040fbe1c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.534389 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-196a2fb1-43cd-4866-b9f2-624335dcc6ed req-9fec8560-fdf8-4501-9087-59be040fbe1c service nova] Creating event network-vif-plugged:44616a73-0087-4079-9a75-1d953925b087 for instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 on n-h1-858384-19 Nov 02 13:21:27.539639 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-196a2fb1-43cd-4866-b9f2-624335dcc6ed req-9fec8560-fdf8-4501-9087-59be040fbe1c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 Nov 02 13:21:27.540416 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1181/2168] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:27.547419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:27.549978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:27.558649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.559189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.559623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.560145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:27.560463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.560925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.561353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.569556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:27.571984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:27.579282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-642a5ebf-72e2-48ae-9afa-08b634fdf4a8 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.220312 Nov 02 13:21:27.592301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lazy-loading 'flavor' on Instance uuid 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:27.592953 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 988/2169] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:27 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:27.644439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:27.645060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:27.652686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.653260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.653912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.654553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.654963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.655460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.704070 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edf19b2e-8a8c-4da7-b408-84b58daddbaf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action" status: 200 len: 32 microversion: 2.1 time: 0.162016 Nov 02 13:21:27.705027 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1182/2170] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:21:27 2022] POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:21:27.718745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:27.719797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:27.735711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.736219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.736702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.738963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.741177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.741868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.936299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:27.949068 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a7cc0f69-1de9-4e60-9118-710a0c27d070 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.308376 Nov 02 13:21:27.953682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 989/2171] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:27 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:27.960945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90f6012c-aaab-4500-83c2-00d5ab8aa367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:27.971621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90f6012c-aaab-4500-83c2-00d5ab8aa367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:27.977227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:27.978344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f6012c-aaab-4500-83c2-00d5ab8aa367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.978841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f6012c-aaab-4500-83c2-00d5ab8aa367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.979508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f6012c-aaab-4500-83c2-00d5ab8aa367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.980418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f6012c-aaab-4500-83c2-00d5ab8aa367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:27.981043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f6012c-aaab-4500-83c2-00d5ab8aa367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:27.981729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90f6012c-aaab-4500-83c2-00d5ab8aa367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:27.987712 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8649f69-ddfd-4204-8824-9af5e48eb5a3 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.273605 Nov 02 13:21:27.989343 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1183/2172] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:27 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:28.016762 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90f6012c-aaab-4500-83c2-00d5ab8aa367 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.061721 Nov 02 13:21:28.018013 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 990/2173] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:21:27 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:28.067628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:28.068585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:28.082839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.083398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.084543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.085270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.085732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.086163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.260999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:28.270710 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-85538f30-a3bf-41f3-b72b-2b6a02516f93 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.208172 Nov 02 13:21:28.271346 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1184/2174] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:28 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:28.385064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:28.386403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:28.395382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.398304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.399167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.400785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.401355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.402171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.613697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:28.614305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:28.626002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.626672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.627137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.629417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.629889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.630328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.644599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:28.656428 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4fbc07c3-cd89-4287-84b6-b1598eb06271 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.275646 Nov 02 13:21:28.657960 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 991/2175] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:28 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:28.675666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:28.731400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:28.746351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:28.752868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:28.760636 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7eae43a9-6bac-4a4c-870b-74107a02f98c tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.151239 Nov 02 13:21:28.775141 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1185/2176] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:28 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:28.979404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:28.980902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:28.990232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.990856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.991384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:28.992839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:28.993370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:28.993859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.134818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a182b9b5-9b01-4f91-ac4c-93fcce4d202b tempest-FloatingIPDetailsNegativeTestJSON-1536678371 tempest-FloatingIPDetailsNegativeTestJSON-1536678371-project] Calling method '.version_select at 0x7fe78f83c790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:29.186285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:29.195324 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16131846-043d-47fa-8527-3ccc6f44a73f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.221221 Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG neutronclient.v2_0.client [None req-a182b9b5-9b01-4f91-ac4c-93fcce4d202b tempest-FloatingIPDetailsNegativeTestJSON-1536678371 tempest-FloatingIPDetailsNegativeTestJSON-1536678371-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ec6afb69-9c20-43b5-abbf-67eebbb95920 could not be found", "detail": ""}} {{(pid=120929) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-a182b9b5-9b01-4f91-ac4c-93fcce4d202b tempest-FloatingIPDetailsNegativeTestJSON-1536678371 tempest-FloatingIPDetailsNegativeTestJSON-1536678371-project] HTTP exception thrown: Floating IP not found for ID ec6afb69-9c20-43b5-abbf-67eebbb95920 Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a182b9b5-9b01-4f91-ac4c-93fcce4d202b tempest-FloatingIPDetailsNegativeTestJSON-1536678371 tempest-FloatingIPDetailsNegativeTestJSON-1536678371-project] Request method failure captured: Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-floating-ips/ec6afb69-9c20-43b5-abbf-67eebbb95920 HTTP/1.1 Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm7YZyg7M-CUczj8gDWUSAM80zGK_ksMJCzxeKwKpA-2J0lE_a3cSysYxKirYexSTiKFBongXaTd2lI69xJvyp2qxHJQMcWhTy9v5L2XICPdAIe91TyrtI8mo49c6gc3KQxQAJQGjSVQ4W1MILAqIxTUDJKKB2FHwnQbd2cUq2yWAyI Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 4b4a960856784c668bfcd9e5453ff464 Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1536678371 Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:21:29.207494 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4b4a960856784c668bfcd9e5453ff464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4b4a960856784c668bfcd9e5453ff464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4b4a960856784c668bfcd9e5453ff464"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4b4a960856784c668bfcd9e5453ff464"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1536678371 Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 4b4a960856784c668bfcd9e5453ff464 Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1536678371 Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1536678371-project Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 8417015656dd455ba7be50327d8e6597 Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1536678371-project Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: exception: Floating IP not found for ID ec6afb69-9c20-43b5-abbf-67eebbb95920 Nov 02 13:21:29.209395 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'ec6afb69-9c20-43b5-abbf-67eebbb95920'} Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:21:29.210698 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ec6afb69-9c20-43b5-abbf-67eebbb95920 could not be found Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-233f330a-97c6-4f88-8598-3c56b9fe9253'] Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ec6afb69-9c20-43b5-abbf-67eebbb95920. Nov 02 13:21:29.214058 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ec6afb69-9c20-43b5-abbf-67eebbb95920 Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:29.218855 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:21:29.221989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:21:29.221989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ec6afb69-9c20-43b5-abbf-67eebbb95920 Nov 02 13:21:29.221989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:29.221989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a182b9b5-9b01-4f91-ac4c-93fcce4d202b tempest-FloatingIPDetailsNegativeTestJSON-1536678371 tempest-FloatingIPDetailsNegativeTestJSON-1536678371-project] Returning 404 to user: Floating IP not found for ID ec6afb69-9c20-43b5-abbf-67eebbb95920 {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:21:29.221989 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a182b9b5-9b01-4f91-ac4c-93fcce4d202b tempest-FloatingIPDetailsNegativeTestJSON-1536678371 tempest-FloatingIPDetailsNegativeTestJSON-1536678371-project] 10.222.0.113 "GET /compute/v2.1/os-floating-ips/ec6afb69-9c20-43b5-abbf-67eebbb95920" status: 404 len: 111 microversion: 2.1 time: 0.259479 Nov 02 13:21:29.222594 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1186/2177] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:28 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:29.222818 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 992/2178] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:21:28 2022] GET /compute/v2.1/os-floating-ips/ec6afb69-9c20-43b5-abbf-67eebbb95920 => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:21:29.228826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:29.229453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:29.240909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.241409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.241866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.242581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.243040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.243503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.298215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:29.300913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:29.311047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.311583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.312023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.312812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.313277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.314416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.482569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:29.495042 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11f86f90-9727-4421-b2a8-d929d9ce2158 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.278852 Nov 02 13:21:29.496058 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1187/2179] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:29 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:29.518143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:29.539492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57554813-0579-4cea-8723-deea83e7a812 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1202 microversion: 2.1 time: 0.246488 Nov 02 13:21:29.544015 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 993/2180] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:29 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1202 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:29.681557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:29.682315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:29.695642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.696529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.697229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.698372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.699090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.700071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.793716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:29.796230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:29.817180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.817953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.818392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.819153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:29.819595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:29.820020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:29.941593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:29.964674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:29.966535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:29.978143 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bfcf31c9-a0e6-4b81-9bd4-95e61f2660dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.190710 Nov 02 13:21:29.986493 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 994/2181] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:29 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:30.065741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:30.077288 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-57d3c068-14be-4cc4-9600-3e01be768c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.400311 Nov 02 13:21:30.078264 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1188/2182] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:29 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:30.223998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:30.225127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:30.237392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:30.239336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:30.240169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:30.241196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:30.241903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:30.242539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:30.441918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:30.452770 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-525d93d9-356b-4464-8ac1-0851dd89b7a7 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.234384 Nov 02 13:21:30.470521 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 995/2183] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:30 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:30.520830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:30.521512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:30.540952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:30.540952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:30.540952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:30.540952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:30.541458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:30.543081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:30.569757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:30.571181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:30.582157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:30.584266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:30.585712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:30.587456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:30.589413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:30.589903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:30.612789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:30.923934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:30.933410 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-781a07dc-8f1b-406a-8157-96df05b74a79 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.417394 Nov 02 13:21:30.953935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1189/2184] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:30 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:30.966458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f67f0d74-a6ca-4b24-80a8-96518245a6aa req-6d997f0d-1936-4226-bced-afe5f910edd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9141f9f7-e728-4dc2-b08d-896411699869", "name": "network-vif-unplugged", "status": "completed", "tag": "707a33ab-8329-48d9-86bd-8bbe37d12038"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:31.023472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f67f0d74-a6ca-4b24-80a8-96518245a6aa req-6d997f0d-1936-4226-bced-afe5f910edd5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.035168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f67f0d74-a6ca-4b24-80a8-96518245a6aa req-6d997f0d-1936-4226-bced-afe5f910edd5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.037344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f67f0d74-a6ca-4b24-80a8-96518245a6aa req-6d997f0d-1936-4226-bced-afe5f910edd5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.111919 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f67f0d74-a6ca-4b24-80a8-96518245a6aa req-6d997f0d-1936-4226-bced-afe5f910edd5 service nova] Creating event network-vif-unplugged:707a33ab-8329-48d9-86bd-8bbe37d12038 for instance 9141f9f7-e728-4dc2-b08d-896411699869 on n-h2-858384-19 Nov 02 13:21:31.129855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-f67f0d74-a6ca-4b24-80a8-96518245a6aa req-6d997f0d-1936-4226-bced-afe5f910edd5 service nova] Instance 9141f9f7-e728-4dc2-b08d-896411699869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:21:31.180956 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f67f0d74-a6ca-4b24-80a8-96518245a6aa req-6d997f0d-1936-4226-bced-afe5f910edd5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.222433 Nov 02 13:21:31.184394 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1190/2185] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:31.230378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:31.231141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:31.233451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:31.246271 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-70852391-442c-454d-a7c8-b28404f03591 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1383 microversion: 2.1 time: 0.680638 Nov 02 13:21:31.249823 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 996/2186] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:30 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1383 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:31.259008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:31.270179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:31.271339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.275875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:31.276536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.281183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.285614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.288304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.293211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.294859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.295711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.296801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.297678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.298706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.307643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.557247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:31.593216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:31.601707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:31.637401 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b6248cb3-1b7c-4cc1-a56d-5f86ed4fae9d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.438838 Nov 02 13:21:31.642770 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1191/2187] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:31 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:31.660269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09bd9040-cc16-44d0-8a99-542f011f9121 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:31.660987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09bd9040-cc16-44d0-8a99-542f011f9121 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:31.679430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09bd9040-cc16-44d0-8a99-542f011f9121 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.681061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09bd9040-cc16-44d0-8a99-542f011f9121 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.683249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09bd9040-cc16-44d0-8a99-542f011f9121 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.684922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09bd9040-cc16-44d0-8a99-542f011f9121 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.686196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09bd9040-cc16-44d0-8a99-542f011f9121 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.688053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09bd9040-cc16-44d0-8a99-542f011f9121 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.877497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:31.886167 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b8e0b2c8-627c-465c-95f1-59afa149383a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.634483 Nov 02 13:21:31.900740 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 997/2188] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:31 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:31.919776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:31.920936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:31.929362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.930996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.938829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:31.939863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:31.941154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:31.946969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:32.760245 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09bd9040-cc16-44d0-8a99-542f011f9121 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1536 microversion: 2.1 time: 1.116141 Nov 02 13:21:32.760948 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1192/2189] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:31 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1536 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:32.776413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:32.777364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:32.801857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:32.802930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:32.803837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:32.804770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:32.805651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:32.806271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.078045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:33.088197 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fcbf6a5a-27e0-43c5-81c3-cd0737a28fe5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 1.185974 Nov 02 13:21:33.098774 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 998/2190] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:31 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:33.128485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:33.129858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:33.137463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.138360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.139256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.140236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.140926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.141600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.363062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:33.395328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:33.399440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:33.408881 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc8c88c3-e650-47d3-ac2d-35827c34e8ad tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.285285 Nov 02 13:21:33.412628 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 999/2191] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:33 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:33.426292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e0184213-6bbe-4a2e-a42a-6307a41b0065 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:33.427314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e0184213-6bbe-4a2e-a42a-6307a41b0065 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:33.461986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0184213-6bbe-4a2e-a42a-6307a41b0065 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.463242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0184213-6bbe-4a2e-a42a-6307a41b0065 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.463598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0184213-6bbe-4a2e-a42a-6307a41b0065 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.469733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0184213-6bbe-4a2e-a42a-6307a41b0065 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.470244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0184213-6bbe-4a2e-a42a-6307a41b0065 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.473202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0184213-6bbe-4a2e-a42a-6307a41b0065 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.749272 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e0184213-6bbe-4a2e-a42a-6307a41b0065 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1536 microversion: 2.1 time: 0.334468 Nov 02 13:21:33.765605 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1000/2192] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:33 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1536 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:33.772333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:33.775022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:33.785342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.786243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.787106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:33.790419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:33.791444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:33.792131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.033928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:34.047828 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cc9bd0a6-db08-485d-894a-93843f95e730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.275887 Nov 02 13:21:34.055247 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1001/2193] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:33 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:34.055247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5d4174a-422e-4e75-9bdf-c2a20c7d6bb1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:34.069444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5d4174a-422e-4e75-9bdf-c2a20c7d6bb1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.071084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5d4174a-422e-4e75-9bdf-c2a20c7d6bb1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.071735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5d4174a-422e-4e75-9bdf-c2a20c7d6bb1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.073456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5d4174a-422e-4e75-9bdf-c2a20c7d6bb1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.076668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5d4174a-422e-4e75-9bdf-c2a20c7d6bb1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.077473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5d4174a-422e-4e75-9bdf-c2a20c7d6bb1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.132234 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5d4174a-422e-4e75-9bdf-c2a20c7d6bb1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.082074 Nov 02 13:21:34.133583 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1002/2194] 10.222.0.113 () {58 vars in 1181 bytes} [Wed Nov 2 13:21:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:34.150271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:34.153926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:34.154811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:34.165802 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-477e88f5-d58f-4135-8bc6-c509b725f8ff tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 1.403689 Nov 02 13:21:34.175148 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1193/2195] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:32 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:34.181851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-19", "block_migration": false, "disk_over_commit": false}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:34.185551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.186763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.188553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.191040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.191526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:34.193011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.194890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.213021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.214289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.215473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.219565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.220483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.221046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.316287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lazy-loading 'flavor' on Instance uuid 20b7b1a4-c1d8-419d-81c2-24577c4a6269 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:34.334214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Going to try to live migrate instance to n-h2-858384-19 {{(pid=120928) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:21:34.505430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:34.516108 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90d849c3-f3c8-42b7-83b4-c40f7e14048c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.381305 Nov 02 13:21:34.516710 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1003/2196] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:34 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:34.526519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c84054d0-03dd-43b4-a24c-9de8b1e528e0 req-da70f31c-c787-4160-94a7-66934c3d4c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9141f9f7-e728-4dc2-b08d-896411699869", "tag": "707a33ab-8329-48d9-86bd-8bbe37d12038"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:34.557400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c84054d0-03dd-43b4-a24c-9de8b1e528e0 req-da70f31c-c787-4160-94a7-66934c3d4c01 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.557883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c84054d0-03dd-43b4-a24c-9de8b1e528e0 req-da70f31c-c787-4160-94a7-66934c3d4c01 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.558307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c84054d0-03dd-43b4-a24c-9de8b1e528e0 req-da70f31c-c787-4160-94a7-66934c3d4c01 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.597317 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c84054d0-03dd-43b4-a24c-9de8b1e528e0 req-da70f31c-c787-4160-94a7-66934c3d4c01 service nova] Creating event network-changed:707a33ab-8329-48d9-86bd-8bbe37d12038 for instance 9141f9f7-e728-4dc2-b08d-896411699869 on n-h2-858384-19 Nov 02 13:21:34.612363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-c84054d0-03dd-43b4-a24c-9de8b1e528e0 req-da70f31c-c787-4160-94a7-66934c3d4c01 service nova] Instance 9141f9f7-e728-4dc2-b08d-896411699869 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:21:34.645637 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c84054d0-03dd-43b4-a24c-9de8b1e528e0 req-da70f31c-c787-4160-94a7-66934c3d4c01 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114661 Nov 02 13:21:34.648406 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1004/2197] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:34.665474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:34.679174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:34.695935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.697008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.698543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.699438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:34.701448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:34.701615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:34.826192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:34.840545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:34.844650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:34.867522 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f662d14f-7773-4b6f-a3a9-2e7c22c2f196 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.216753 Nov 02 13:21:34.905899 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1005/2198] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:34 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:35.083037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:35.084183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:35.099705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.100445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.100984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.102362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.103015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.103603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.463047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:35.480992 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f33880c-a869-4ddf-9276-142e5ecc454e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.411440 Nov 02 13:21:35.482857 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1006/2199] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:35 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:35.501145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:35.501754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:35.508202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.508699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.509142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.509854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.510312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.510731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.694080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:35.703979 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3e7e1917-f002-4ae0-a6c3-87846ce2a721 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.207563 Nov 02 13:21:35.708145 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1007/2200] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:35 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:35.712868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-780de9c0-297d-4722-b802-5e4a3061b19e req-9409dfda-6278-4ece-968d-b35dcc1f7d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679d27a4-cc40-4091-ae09-84372ff9baea", "name": "network-vif-plugged", "status": "completed", "tag": "4b53cd9d-7baa-45af-9312-e0ba2d584523"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:35.724337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-780de9c0-297d-4722-b802-5e4a3061b19e req-9409dfda-6278-4ece-968d-b35dcc1f7d0b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.725740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-780de9c0-297d-4722-b802-5e4a3061b19e req-9409dfda-6278-4ece-968d-b35dcc1f7d0b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.725740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-780de9c0-297d-4722-b802-5e4a3061b19e req-9409dfda-6278-4ece-968d-b35dcc1f7d0b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.743738 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-780de9c0-297d-4722-b802-5e4a3061b19e req-9409dfda-6278-4ece-968d-b35dcc1f7d0b service nova] Creating event network-vif-plugged:4b53cd9d-7baa-45af-9312-e0ba2d584523 for instance 679d27a4-cc40-4091-ae09-84372ff9baea on n-h2-858384-19 Nov 02 13:21:35.752057 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-780de9c0-297d-4722-b802-5e4a3061b19e req-9409dfda-6278-4ece-968d-b35dcc1f7d0b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042610 Nov 02 13:21:35.752863 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1008/2201] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:35.758053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:35.758888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:35.766929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.767508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.767972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.768685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:35.769162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:35.769589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:35.979604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:35.988879 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc01b2a0-b46f-410a-8555-859b100a0ae5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.235020 Nov 02 13:21:35.991568 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1009/2202] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:35 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:35.998554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:35.999352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:36.007154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.007591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.008145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.008963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.009519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.010208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.101751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:36.114735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:36.116571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:36.124888 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-82b38b7f-2726-4a90-a371-8cc7d4c5ffdf tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.132078 Nov 02 13:21:36.125485 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1010/2203] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:35 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:36.506935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:36.508342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:36.515978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.517018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.517708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.518669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.519633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.520303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.877223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:36.886180 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9412ac48-0216-40ca-b9e2-252d7dbec401 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.383487 Nov 02 13:21:36.888032 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1011/2204] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:36 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:36.894936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:36.896073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:36.905746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.906281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.906751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:36.907877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:36.909247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:36.909939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.140614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:37.150689 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b27d7472-ad78-47a2-8c07-7f14728b7f9f tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.261324 Nov 02 13:21:37.151556 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1012/2205] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:36 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:37.158330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:37.159037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:37.165866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.166344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.166774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.167483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.168140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.168561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.360961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:37.372848 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e0474245-bf55-4d59-b037-cbfb4e593750 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.219306 Nov 02 13:21:37.373775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1013/2206] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:37 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:37.392434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:37.392967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:37.399307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.399920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.400361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.401063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.401514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.401986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.483335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:37.485645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:37.493903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:37.495775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:37.502251 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-44901906-fab4-4ef1-bae3-199027e8e940 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.113989 Nov 02 13:21:37.503238 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1014/2207] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:37 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:37.916293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:37.921498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:37.929096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.929591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.930094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:37.930805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:37.931342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:37.932063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.089326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:38.098121 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c50afb8-5796-4f5e-a5c6-0c26c7db377b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.187921 Nov 02 13:21:38.099981 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1015/2208] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:37 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:38.175745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:38.176409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:38.182262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:38.182750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:38.183225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.184225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:38.185209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:38.185926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.329361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:38.337109 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-282a6719-a68c-411b-8369-46c72e132b9b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.166223 Nov 02 13:21:38.337682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1016/2209] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:38 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:38.395882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:38.396928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:38.407028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:38.407541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:38.408044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.408817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:38.409380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:38.409694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.587577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:38.596752 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-327af974-1787-4347-a60a-6b57705c18d5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.205119 Nov 02 13:21:38.611770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1017/2210] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:38 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:38.620314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:38.620793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:38.626747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:38.627274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:38.627920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.629060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:38.629710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:38.630310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:38.700303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:38.710921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:38.712614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:38.725366 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ea8f1acd-6e78-47d7-89c2-81d480709f4a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.110307 Nov 02 13:21:38.728052 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1018/2211] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:38 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:39.127975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:39.130212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:39.155560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.156224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.157049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:39.158255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.158821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.159612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:39.361370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:39.374253 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-759f9133-83e1-4145-9ae3-af96ac8075a5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.256248 Nov 02 13:21:39.375611 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1019/2212] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:39 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:39.383999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:39.384697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:39.392839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.393429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.394121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:39.395071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.395638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.396136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:39.675032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:39.687165 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-95d22329-c384-48df-adae-ed596d3ab305 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.310148 Nov 02 13:21:39.688463 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1020/2213] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:39 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:39.694455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:39.695328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:39.703817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.704363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.705033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:39.705497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.705945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.706366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:39.908714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:39.924875 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-056f39d2-8a1e-4991-8aab-b00e7cba618c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1474 microversion: 2.1 time: 0.235061 Nov 02 13:21:39.926645 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1021/2214] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:39 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1474 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:39.931809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:39.932777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:39.940317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.941047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.941678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:39.942910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:39.943664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:39.944376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.022109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:40.035801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:40.037449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:40.046099 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57bc8dca-59f1-402a-80e6-3ca58a3249dc tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.118015 Nov 02 13:21:40.047308 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1022/2215] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:39 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:40.271788 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee7b1934-5350-4603-a192-a6537a384ba2 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269/action" status: 202 len: 0 microversion: 2.1 time: 6.101336 Nov 02 13:21:40.272721 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1194/2216] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:21:34 2022] POST /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269/action => generated 0 bytes in 6103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:21:40.283895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:40.285615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:40.303400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.304838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.306383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.310824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.312512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.313780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.403817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:40.404643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:40.416569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.420068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.420743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.425363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.426057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.426664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.754743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:40.783667 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9c73160f-a655-4b95-ab45-a17af4411f23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.503505 Nov 02 13:21:40.795158 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1023/2217] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:40 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:40.811732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:40.814221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:40.816059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:40.828888 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d3c62a0d-a815-445e-b78f-481219099c48 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1321 microversion: 2.1 time: 0.434778 Nov 02 13:21:40.830764 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1195/2218] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:40 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:40.835447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.836503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.838075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.839712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.841908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.842768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.956042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:40.958155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:40.969332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.971730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.972124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:40.972940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:40.973534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:40.973949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.582839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:41.598353 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e80b329e-8d65-498d-b68e-62d512198ca4 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1467 microversion: 2.1 time: 0.648184 Nov 02 13:21:41.600020 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1196/2219] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:40 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1467 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:41.605798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:41.607848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:41.661936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:41.662944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:41.663862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.665201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:41.666009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:41.666794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:41.772428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:41.842113 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-89faec0c-fafa-4add-98be-b0f622176f44 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 1.049851 Nov 02 13:21:41.866123 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1024/2220] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:40 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:42.301094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:42.321564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:42.333829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:42.353003 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8f738f67-1384-4b1e-bab8-31c387e92530 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.751513 Nov 02 13:21:42.359739 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1197/2221] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:41 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:42.374301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0d41c350-1a9f-4b1e-b0df-1a38644bd3be req-c499b496-0fcd-4742-a134-939fb0453761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9141f9f7-e728-4dc2-b08d-896411699869", "name": "network-vif-plugged", "status": "completed", "tag": "707a33ab-8329-48d9-86bd-8bbe37d12038"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:42.374527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-27317061-d904-4ee0-9d38-a636517f169d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:42.375315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-27317061-d904-4ee0-9d38-a636517f169d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:42.390482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27317061-d904-4ee0-9d38-a636517f169d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.394570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27317061-d904-4ee0-9d38-a636517f169d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.395215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27317061-d904-4ee0-9d38-a636517f169d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.396961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0d41c350-1a9f-4b1e-b0df-1a38644bd3be req-c499b496-0fcd-4742-a134-939fb0453761 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.397871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0d41c350-1a9f-4b1e-b0df-1a38644bd3be req-c499b496-0fcd-4742-a134-939fb0453761 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.398188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27317061-d904-4ee0-9d38-a636517f169d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.398726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27317061-d904-4ee0-9d38-a636517f169d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.399197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27317061-d904-4ee0-9d38-a636517f169d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.399480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0d41c350-1a9f-4b1e-b0df-1a38644bd3be req-c499b496-0fcd-4742-a134-939fb0453761 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.415262 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0d41c350-1a9f-4b1e-b0df-1a38644bd3be req-c499b496-0fcd-4742-a134-939fb0453761 service nova] Creating event network-vif-plugged:707a33ab-8329-48d9-86bd-8bbe37d12038 for instance 9141f9f7-e728-4dc2-b08d-896411699869 on n-h2-858384-19 Nov 02 13:21:42.422012 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0d41c350-1a9f-4b1e-b0df-1a38644bd3be req-c499b496-0fcd-4742-a134-939fb0453761 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060992 Nov 02 13:21:42.423416 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1198/2222] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:42.430942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:42.431928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:42.440755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.441646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.442360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.443744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.444472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.445416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.796330 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-27317061-d904-4ee0-9d38-a636517f169d tempest-MigrationsAdminTest-1640309307 tempest-MigrationsAdminTest-1640309307-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1620 microversion: 2.1 time: 0.926402 Nov 02 13:21:42.799275 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1025/2223] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:41 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1620 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:42.805429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:42.806421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:42.826924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.827538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.828065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.828851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.829315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.829749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.921454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:42.936104 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7cb2c418-65da-47de-872f-f747b209d9ae tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.511034 Nov 02 13:21:42.938938 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1199/2224] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:42 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:42.945728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:42.946233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:42.959360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.959874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.960313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.961020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:42.961669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:42.962261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:42.993944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:21:43.038871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:43.068718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:43.079767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b9ce1548-4570-463c-896c-3b6e798b473a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1511 microversion: 2.1 time: 0.279126 Nov 02 13:21:43.098100 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1026/2225] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:42 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:43.103088 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-124fb154-0808-49b3-b0d3-b9f632da7085 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 204 len: 0 microversion: 2.1 time: 0.162349 Nov 02 13:21:43.105153 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1200/2226] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:21:42 2022] DELETE /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:21:43.110245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:43.111032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:43.117627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:43.118355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:43.128069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.128566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.129012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.129885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.130497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.131078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.134207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.134709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.136710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.138042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.147026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.149262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.392023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:43.405313 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-628b581c-ae37-49c3-9bb5-f843d600529c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.305953 Nov 02 13:21:43.405901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:43.406451 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1027/2227] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:43 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:43.427196 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0048ff0c-0c54-45db-9d7c-8caf4db0c550 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1473 microversion: 2.1 time: 0.316536 Nov 02 13:21:43.427822 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1201/2228] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:43 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:43.428881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:43.429787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:43.432925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:43.433534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:43.440564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.441953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.443074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.444106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.447313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.448842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.465458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.466843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.469710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.470690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.471376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.472331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.570829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:43.608128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:43.613833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:43.633750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83460109-4996-4a12-8359-8431bac0de5a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.203989 Nov 02 13:21:43.634808 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1202/2229] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:43 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:43.788817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:43.798896 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d071199-4a61-4d5a-9987-69cceb4636f4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1511 microversion: 2.1 time: 0.391321 Nov 02 13:21:43.800770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1028/2230] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:43 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:43.823263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:43.827645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:43.835497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.835997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.836443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.837318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.837782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.838220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.962038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:43.962654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:43.977937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.985970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.986726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.988891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:43.990559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:43.991600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:43.998611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:21:44.009565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:21:44.010570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:21:44.011287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:21:44.011887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:21:44.085525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:44.118062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:44.140589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.141527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.143568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.146462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.148496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.149381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.215270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:44.220728 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-801dd716-c4eb-4a3c-87e3-c0a59eab4c40 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "POST /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea/action" status: 202 len: 1113 microversion: 2.1 time: 0.401490 Nov 02 13:21:44.226210 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9fe8128b-bac0-43f7-acf8-83febbfab035 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.267724 Nov 02 13:21:44.227933 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1029/2231] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:43 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:44.235297 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1203/2232] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:21:43 2022] POST /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea/action => generated 1113 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:21:44.250153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:44.251073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:44.266530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.267342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.268771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.274371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.276703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.277359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.432388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:44.433425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:44.437565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:44.449707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.451054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.457317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.458371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.459020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.459713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.616283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:44.644473 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-95eb9145-57f1-44d5-8ada-4d5abe5a55c8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.403311 Nov 02 13:21:44.648349 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1030/2233] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:44 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:44.662386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:44.666571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:44.697580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.701662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.702557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.703328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.705190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.708253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.750592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:44.784502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:44.792795 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1d48ca98-95e1-4563-b8f1-153ed0b3154a tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.364606 Nov 02 13:21:44.802471 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1204/2234] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:44 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:44.807352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:44.807968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:44.824901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.825456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.825967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.829574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:44.830065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:44.830514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:44.943957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:44.958988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:44.964042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:44.980775 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06ebac88-58b2-4910-a81e-be3a119d6a52 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.177145 Nov 02 13:21:44.983625 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1205/2235] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:44 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:45.105568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:45.118622 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3b1355b4-0a33-45c3-9b84-2a8bc519cabb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1473 microversion: 2.1 time: 0.467670 Nov 02 13:21:45.123399 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1031/2236] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:44 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1473 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:45.265932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:45.295326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:45.320709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:45.321864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:45.323758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:45.329414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:45.331649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:45.332560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:45.674686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:45.675827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:45.678220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:45.688386 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a08a86ec-9a9d-4ad1-b7e6-d97dcbb35903 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.438648 Nov 02 13:21:45.692561 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1206/2237] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:45 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:45.695579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:45.697234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:45.697883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:45.699262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:45.700555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:45.702005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:45.817954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:45.818579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:45.837022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:45.837817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:45.837998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:45.838717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:45.839612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:45.842272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.328897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:46.342943 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2bf1c61f-e219-4179-869b-bc349cf5c1e1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.672501 Nov 02 13:21:46.347945 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1032/2238] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:45 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:46.374796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:46.375443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:46.406131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.409634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.411321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.418526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.421532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.422001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.449575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:46.473312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-13f29189-49d7-4dbf-8e1f-e7569122dd73 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.659209 Nov 02 13:21:46.474264 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1207/2239] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:45 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:46.480664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:46.492862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:46.507258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.510891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.512972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.519253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.522582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.527756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.598472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:46.620192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:46.630497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:46.682332 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0ba4b371-7a67-4f44-af1d-601731ba3aca tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.328510 Nov 02 13:21:46.685999 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1033/2240] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:46 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:46.706687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.710704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.711550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.712427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lazy-loading 'fault' on Instance uuid 9141f9f7-e728-4dc2-b08d-896411699869 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:46.736670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-82c35e6c-58ae-4ddb-a297-fb9cdc183405 req-d9f23fdd-fb17-4ede-8ce5-e08f1a6bd29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9141f9f7-e728-4dc2-b08d-896411699869", "name": "network-vif-deleted", "tag": "707a33ab-8329-48d9-86bd-8bbe37d12038"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:46.795736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82c35e6c-58ae-4ddb-a297-fb9cdc183405 req-d9f23fdd-fb17-4ede-8ce5-e08f1a6bd29d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.803835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82c35e6c-58ae-4ddb-a297-fb9cdc183405 req-d9f23fdd-fb17-4ede-8ce5-e08f1a6bd29d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.804314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82c35e6c-58ae-4ddb-a297-fb9cdc183405 req-d9f23fdd-fb17-4ede-8ce5-e08f1a6bd29d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.858395 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-82c35e6c-58ae-4ddb-a297-fb9cdc183405 req-d9f23fdd-fb17-4ede-8ce5-e08f1a6bd29d service nova] Creating event network-vif-deleted:707a33ab-8329-48d9-86bd-8bbe37d12038 for instance 9141f9f7-e728-4dc2-b08d-896411699869 on n-h2-858384-19 Nov 02 13:21:46.870811 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-82c35e6c-58ae-4ddb-a297-fb9cdc183405 req-d9f23fdd-fb17-4ede-8ce5-e08f1a6bd29d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176861 Nov 02 13:21:46.874190 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1034/2241] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:46.898801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:46.899592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:46.901046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:46.919324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.921969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.924139 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-30f0c2c4-d9d2-4330-99d2-cfc8dac7c338 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 200 len: 1307 microversion: 2.1 time: 0.447103 Nov 02 13:21:46.935282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.938210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:46.938909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:46.940241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:46.945536 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1208/2242] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:46 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:47.157532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:47.169634 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3bb1c4c5-319c-4c1b-8e05-641aeb54c72e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.293985 Nov 02 13:21:47.170529 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1035/2243] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:46 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:47.373254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:47.374617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:47.389776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.391584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.393384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:47.395186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.397050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.397670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:47.500261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:47.501731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:47.515174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.515976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.516604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:47.518305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.522302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.523165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:47.797716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:47.811791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:47.840423 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a798efd0-c7a5-40be-a9d8-f71ac171ef6b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.471930 Nov 02 13:21:47.841051 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1209/2244] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:47 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:47.844963 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-53601097-57e2-4fbb-b4b5-09f0885befe5 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.348003 Nov 02 13:21:47.848214 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1036/2245] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:47 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:47.873444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:47.875830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:47.888379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.889195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.889857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:47.890778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.892173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.892805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:47.957786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:47.958404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 9141f9f7-e728-4dc2-b08d-896411699869] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:47.972459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.974317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.978073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:47.979444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:47.980404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:47.982272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:48.013168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:48.022071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:48.023593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:48.035469 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22beb821-c247-4b0e-80e7-8e8cd07e7c75 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.178473 Nov 02 13:21:48.038250 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1210/2246] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:47 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:48.051711 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] HTTP exception thrown: Instance 9141f9f7-e728-4dc2-b08d-896411699869 could not be found. Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Request method failure captured: Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 HTTP/1.1 Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm1n3nrhg-u-ueWibeVvhfd2fyWjDB464ARXNqbQvpffEfBK5L5qLPoAqP_dAYRDT_JDsB7-OMyZjJOtBnsV3vwQEHP26rh2dwAV96JDldlr_uSVulP4z_ncFnmIXhymynlJGvLQvyVbW-KPP2zley8v57FycXE6fw4cjk45QtxsN5I Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c4b5d1bcf8b043de8c000a8a7511c238 Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-MigrationsAdminTest-304925851 Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:21:48.054513 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-MigrationsAdminTest-304925851 Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c4b5d1bcf8b043de8c000a8a7511c238 Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-MigrationsAdminTest-304925851 Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-MigrationsAdminTest-304925851-project Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e7104fb14f5c430a8bfd7e6aa7ada5ee Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-MigrationsAdminTest-304925851-project Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 9141f9f7-e728-4dc2-b08d-896411699869 could not be found. Nov 02 13:21:48.056476 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '9141f9f7-e728-4dc2-b08d-896411699869'} Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9141f9f7-e728-4dc2-b08d-896411699869 could not be found. Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:21:48.057577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9141f9f7-e728-4dc2-b08d-896411699869 could not be found. Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9141f9f7-e728-4dc2-b08d-896411699869 could not be found. Nov 02 13:21:48.059973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:21:48.062006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Returning 404 to user: Instance 9141f9f7-e728-4dc2-b08d-896411699869 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:21:48.063337 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-45fd5e0f-7727-40ec-bc8f-0e5ef5c73f95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869" status: 404 len: 111 microversion: 2.1 time: 0.110628 Nov 02 13:21:48.068803 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1037/2247] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:47 2022] GET /compute/v2.1/servers/9141f9f7-e728-4dc2-b08d-896411699869 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:21:48.073335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:48.076142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:48.086271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:48.087496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:48.088028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:48.088905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:48.089560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:48.090087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:48.144493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:21:48.198826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:48.199496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:48.220207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:48.220769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:48.221221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:48.221961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:48.222419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:48.222845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:48.293109 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-67733133-89eb-4ae9-a239-078ddeaa7343 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "DELETE /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 204 len: 0 microversion: 2.1 time: 0.222726 Nov 02 13:21:48.297303 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1211/2248] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:21:48 2022] DELETE /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:21:48.415089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:48.417707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1940783675", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "32c5f792-e5f8-4b46-9c32-c4a415cb8371"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:48.428732 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-abce43c2-7a5a-43f2-95c8-220491b99823 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.235704 Nov 02 13:21:48.443151 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1038/2249] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:48 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:48.443151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:48.443151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:48.460177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:48.462079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:48.462740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:48.463324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:48.464527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:48.465171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:48.466750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:48.508175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] validate_networks() for [('32c5f792-e5f8-4b46-9c32-c4a415cb8371', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:21:48.642463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:48.650788 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a18a0742-eb58-4f21-abeb-4a737d918505 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1538 microversion: 2.1 time: 0.219349 Nov 02 13:21:48.651405 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1039/2250] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:48 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1538 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:48.870289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:48.871511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:48.878900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:48.879554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:48.880183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:48.881164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:48.881327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:48.881834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.054391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:49.066097 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-288a33e4-c252-48a3-80ca-47bfa17f59b9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.203593 Nov 02 13:21:49.067386 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1040/2251] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:48 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:49.072746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:49.073984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:49.081977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.082927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.084399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.086655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.088888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.089584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.119962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:21:49.120496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:21:49.120856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:21:49.121272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:21:49.122335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:21:49.139022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.139022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.139022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.139022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.139440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.139440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.148850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:49.164386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Getting quotas for project c59efbe08ba34532885fac52dfc8815c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:21:49.172284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Getting quotas for user cef9ffffbe2842f3b99e88046b163967 and project c59efbe08ba34532885fac52dfc8815c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:21:49.188352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:21:49.191270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:21:49.247988 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-62828661-5964-4fe0-bb5c-4f75b1492089 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.943650 Nov 02 13:21:49.249550 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1212/2252] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:21:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:21:49.256471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:49.257432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:49.282867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.283390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.286373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.301491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.305789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.306880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.345679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:49.357119 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49263dd7-6f19-4764-acd3-ea7876d29c35 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.288351 Nov 02 13:21:49.366839 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1041/2253] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:49 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:49.375797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c596e56c-5bd5-4b03-9cc4-f5a486d62e8f tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:49.380409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c596e56c-5bd5-4b03-9cc4-f5a486d62e8f tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:49.431571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:49.451637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:49.453636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:49.472891 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-becfa05d-fc88-450e-9be0-0d406374a2ee tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.221030 Nov 02 13:21:49.473880 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1213/2254] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:49 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:49.483383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:49.484021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:49.499265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.500046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.503082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.504075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.506831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.507492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.517633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c596e56c-5bd5-4b03-9cc4-f5a486d62e8f tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:49.541435 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c596e56c-5bd5-4b03-9cc4-f5a486d62e8f tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1220 microversion: 2.1 time: 0.173361 Nov 02 13:21:49.545200 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1042/2255] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:49 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:49.678486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:49.680242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:49.692230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.692986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.696103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.697046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:49.697804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:49.698764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:49.715963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:49.727054 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a01c0c1-4cc8-473c-a99c-0b4d5c4a8b80 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.251539 Nov 02 13:21:49.728255 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1214/2256] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:49 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:49.994214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:50.005099 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fc03a39d-4824-419a-84ab-679682352c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1538 microversion: 2.1 time: 0.333960 Nov 02 13:21:50.006466 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1043/2257] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:49 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1538 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:50.095621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:50.096549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:50.110583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.111781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.112264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.113100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.114689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.115870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.378757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:50.382093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:50.382720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:50.390120 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e9440a08-9ae6-4ab4-8e73-106a4ed63e33 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.300124 Nov 02 13:21:50.406080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.406080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.406080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.406080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.406604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.406604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.407485 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1215/2258] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:50 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:50.511443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:50.513086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:50.527021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.527974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.528656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.533241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.533980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.534654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.651769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:50.664956 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c3d24e9-b74c-4278-bc11-9781e2e3ddbf tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.286925 Nov 02 13:21:50.665565 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1044/2259] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:50 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:50.686393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:50.693234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:50.707050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.713231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.713993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.714999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.728269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.732887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.738748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:50.754026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:50.756386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:50.775885 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-33cebf74-8af1-44fb-aea0-be7e5f21096a tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.257168 Nov 02 13:21:50.794727 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1216/2260] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:50 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:21:50.838283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:50.839326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:50.853732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.855064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.857725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.860160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:50.861683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:50.864072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:50.888422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:50.898527 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e1315048-7fca-4d33-b194-14cea4a8b297 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1224 microversion: 2.1 time: 0.220667 Nov 02 13:21:50.899664 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1045/2261] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:50 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1224 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:51.033145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:51.035067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:51.048878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:51.056076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.057152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.058392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.059332 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29d1898c-6424-4e78-8534-2f0db5bccf9b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.257738 Nov 02 13:21:51.060598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.063758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.064522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.077271 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1217/2262] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:50 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:51.244003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:51.254126 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c5b9d27f-880a-4b1b-87bd-016be9601f4f tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1538 microversion: 2.1 time: 0.227139 Nov 02 13:21:51.257128 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1046/2263] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:51 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1538 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:51.413892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:51.414522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:51.422089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.422693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.434912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.435889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.436386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.436847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.667408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:51.677097 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d4248cb-b1e2-40ce-99b9-95d7c49344c7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.267071 Nov 02 13:21:51.678221 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1218/2264] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:51 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:51.701274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:51.702609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:51.719742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.720359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.720820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.721580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.722043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.722476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.814206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:51.814834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:51.834212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.835004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.836824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.838735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:51.842903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:51.843414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:51.997934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:52.013178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:52.014806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:52.024691 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7963ab31-f124-42f5-8355-cb892481a5de tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1449 microversion: 2.75 time: 0.215242 Nov 02 13:21:52.040046 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1219/2265] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:51 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1449 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:21:52.054268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:52.054874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:52.065538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.066531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.067664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:52.068725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.069424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.070149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:52.174177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:52.182545 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22a00867-9ba5-4cfb-b7f2-e36d556ec330 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1216 microversion: 2.1 time: 0.141005 Nov 02 13:21:52.195574 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1220/2266] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:52 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:52.208714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:52.209608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:52.223263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.224100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.224760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:52.226195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.228118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.228750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:52.524100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:52.539606 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-076a200f-d733-4420-9b9e-d41acce704bf tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.338497 Nov 02 13:21:52.540954 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1221/2267] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:52 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:52.558905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:52.561996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:52.579538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.586276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.587161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:52.589502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.590255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.591776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:52.842245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:52.852235 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5fddc767-0ce7-41e9-94b4-f5719d589cf5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1538 microversion: 2.1 time: 0.309935 Nov 02 13:21:52.853204 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1222/2268] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:52 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1538 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:52.864611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:52.867784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:52.877542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.878290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.878893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:52.880012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:52.880630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:52.881279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.086649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:53.101436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9df84eaf-0a7a-4600-a549-48dd7e06afd0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 1.405810 Nov 02 13:21:53.102326 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1047/2269] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:51 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:53.116665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:53.118619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:53.135434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.136149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.136800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.138288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.138916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.140973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.266124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:53.279803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:53.283700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:53.301320 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c8e460dd-1b51-41ae-b14b-5cffafef6880 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1455 microversion: 2.75 time: 0.195722 Nov 02 13:21:53.303801 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1048/2270] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:53 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1455 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:53.320997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:53.323876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:53.336883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.339937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.342810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.345160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.349430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.350134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.564891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:53.576272 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bf7c20ce-a64d-44ad-927e-acb5ac9459f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1278 microversion: 2.1 time: 0.270925 Nov 02 13:21:53.579933 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1049/2271] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:53 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:53.599033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:53.599033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:53.599033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.600109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.600652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.602551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.603852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.604308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.658276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:53.756260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:53.774763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dd43e07b-02de-4b82-8bdf-9c3575cb1364 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.920489 Nov 02 13:21:53.777344 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1223/2272] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:52 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:53.876565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:53.877188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:53.884796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.887802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.888293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.889045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:53.889510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:53.889945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:53.992795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:54.004000 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f44cab30-60f0-4974-996d-40503655c87c tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1496 microversion: 2.1 time: 0.131407 Nov 02 13:21:54.019173 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1224/2273] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:53 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1496 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:54.031333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:54.042136 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e85777f8-9b00-46d0-82ed-9a3671895471 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.460955 Nov 02 13:21:54.056915 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1050/2274] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:53 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:54.063375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-cff5ecef-31a7-415c-b392-00ea4cdcba2b req-7f33946a-85ec-4666-8489-56bc550f4413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49", "name": "network-vif-deleted", "tag": "abaa7e07-a933-4415-be82-70f57348ba75"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:54.077622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cff5ecef-31a7-415c-b392-00ea4cdcba2b req-7f33946a-85ec-4666-8489-56bc550f4413 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:54.077926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cff5ecef-31a7-415c-b392-00ea4cdcba2b req-7f33946a-85ec-4666-8489-56bc550f4413 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:54.078573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cff5ecef-31a7-415c-b392-00ea4cdcba2b req-7f33946a-85ec-4666-8489-56bc550f4413 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:54.119191 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-cff5ecef-31a7-415c-b392-00ea4cdcba2b req-7f33946a-85ec-4666-8489-56bc550f4413 service nova] Creating event network-vif-deleted:abaa7e07-a933-4415-be82-70f57348ba75 for instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 on n-h2-858384-19 Nov 02 13:21:54.126681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:54.130217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:54.137972 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-cff5ecef-31a7-415c-b392-00ea4cdcba2b req-7f33946a-85ec-4666-8489-56bc550f4413 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085322 Nov 02 13:21:54.141413 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1225/2275] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:54.162354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:54.169283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:54.172233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:54.174259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:54.178275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:54.179562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:54.342251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:54.353204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:54.383917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:54.385147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:54.387354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:54.389879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:54.390480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:54.391045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:54.479363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:54.506971 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e1cdb087-28e7-4694-aaa8-737d65d2b162 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1526 microversion: 2.1 time: 0.385216 Nov 02 13:21:54.514454 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1051/2276] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:54 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1526 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:54.586376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:54.598897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:54.607742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:54.609042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:54.619268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:54.625290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:54.627240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:54.627747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:54.628621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:54.629215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:54.633169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:54.653811 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0273efa2-7c6d-43b4-9898-0ae1ae18b085 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1455 microversion: 2.75 time: 0.319627 Nov 02 13:21:54.683286 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1226/2277] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:54 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1455 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:54.787511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:54.799431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-50fd6426-a537-478c-999b-e6e1bd662232 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1278 microversion: 2.1 time: 0.196467 Nov 02 13:21:54.800849 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1052/2278] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:54 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:54.802207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:54.802935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:54.813512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:54.814184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:54.815021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:54.816573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:54.817608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:54.818359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.029918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:55.030488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:55.039099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.040276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.040805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.041768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.042444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.042879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.084402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:55.085503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.086006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.086449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.086910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lazy-loading 'fault' on Instance uuid 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:55.095629 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a8d1bf8-efad-47e4-876e-88fc60386010 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.297607 Nov 02 13:21:55.096593 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1227/2279] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:54 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:55.102406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:55.103480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:55.116744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.117254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.117739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.118602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.119311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.119854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.146211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:55.157011 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-61df1b7e-17c5-46ad-b2d5-9750e72f8fae tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 200 len: 1373 microversion: 2.1 time: 0.131722 Nov 02 13:21:55.157648 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1053/2280] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:55 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 1373 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:21:55.429995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:55.442568 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7a3cd476-6a04-42a1-aeca-29f049226611 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.344645 Nov 02 13:21:55.443695 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1228/2281] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:55 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:55.535417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:55.536045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:55.552159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.553416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.557306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.558671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.559989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.561036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.691954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:55.692626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:55.707301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.707802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.708286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.709007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.709462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.709877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.798703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:55.809184 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17c9ac8e-9ab4-44d3-9a1a-7524c8ab43ab tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1506 microversion: 2.1 time: 0.277588 Nov 02 13:21:55.809965 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1054/2282] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:55 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:55.828828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:55.829448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:55.836490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.837201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.837853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.838812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:55.839662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:55.840900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:55.875968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:55.897826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:55.900600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:55.910322 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0813efa0-646f-4962-8870-61ba20268d73 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1455 microversion: 2.75 time: 0.223781 Nov 02 13:21:55.924681 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1229/2283] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:55 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1455 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:55.932903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-56a9afac-cb07-48bb-b0ef-1bd67e60ea1d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Action: 'create', calling method: .version_select at 0x7fe786bc3790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1523163515", "description": "tempest-description-1531204665"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:55.986801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:55.995853 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c407c28e-ae61-47e5-99ea-1c8bcb0aa4be tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1320 microversion: 2.1 time: 0.171133 Nov 02 13:21:56.011986 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1055/2284] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:55 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:56.123284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:56.123943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:56.130773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.131314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.131749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.132512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.133089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.133514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.257886 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-56a9afac-cb07-48bb-b0ef-1bd67e60ea1d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.338470 Nov 02 13:21:56.258827 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1230/2285] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:21:55 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:56.265336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:56.266202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:56.276396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.278478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.279283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.280380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.281083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.281777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.286905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:56.299007 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] HTTP exception thrown: Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 could not be found. Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Request method failure captured: Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 HTTP/1.1 Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1n3nrhg-u-ueWibeVvhfd2fyWjDB464ARXNqbQvpffEfBK5L5qLPoAqP_dAYRDT_JDsB7-OMyZjJOtBnsV3vwQEHP26rh2dwAV96JDldlr_uSVulP4z_ncFnmIXhymynlJGvLQvyVbW-KPP2zley8v57FycXE6fw4cjk45QtxsN5I Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c4b5d1bcf8b043de8c000a8a7511c238 Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-MigrationsAdminTest-304925851 Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:21:56.301023 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-MigrationsAdminTest-304925851 Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c4b5d1bcf8b043de8c000a8a7511c238 Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-MigrationsAdminTest-304925851 Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-MigrationsAdminTest-304925851-project Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e7104fb14f5c430a8bfd7e6aa7ada5ee Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-MigrationsAdminTest-304925851-project Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 could not be found. Nov 02 13:21:56.302801 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49'} Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 could not be found. Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:21:56.303777 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 could not be found. Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 could not be found. Nov 02 13:21:56.305207 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:21:56.312267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Returning 404 to user: Instance 6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:21:56.315532 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ddc7473-3ffb-4e1a-8a13-dc25a558bdc2 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49" status: 404 len: 111 microversion: 2.1 time: 0.054542 Nov 02 13:21:56.316421 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1231/2286] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:56 2022] GET /compute/v2.1/servers/6a8d03b1-2da2-4f7c-ac3c-97d6ecfb6c49 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:21:56.322757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1523163515"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:56.323827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:56.328283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:56.332561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.333057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.333494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.334488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.335014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.335538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.344781 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ba9a07e-7dae-45bb-bbef-cf94b801d8e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.226535 Nov 02 13:21:56.345896 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1056/2287] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:56 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:56.352962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c466c258-06a4-412e-bb64-531ce889f1a5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '.version_select at 0x7fe78704c430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:56.382815 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c466c258-06a4-412e-bb64-531ce889f1a5 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898406173" status: 202 len: 0 microversion: 2.1 time: 0.035419 Nov 02 13:21:56.383785 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1057/2288] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:21:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898406173 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:21:56.470641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:56.471276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:56.478217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.478702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.479371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.480306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.481545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.482179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.580748 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.network.security_group_api [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Adding security group fee6be38-e78e-47d7-8180-8d9b652c5709 to port 6d336abf-e6a6-4a39-bbde-d6cb143d03d9 Nov 02 13:21:56.796969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:56.805698 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22f90b03-14ce-48ac-a767-fcf2a12be8c5 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.338781 Nov 02 13:21:56.806287 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1058/2289] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:56 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:56.814671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a0236c26-3119-4c0c-b932-9d1e1599ddfc req-5a9805f2-4337-45cd-b23b-87e810c68153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d23f3c3-e0ff-4429-b3c5-52eab16da30d", "tag": "e7675843-24d8-458a-afe5-4cdcb419cf46"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:56.827542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a0236c26-3119-4c0c-b932-9d1e1599ddfc req-5a9805f2-4337-45cd-b23b-87e810c68153 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:56.828080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a0236c26-3119-4c0c-b932-9d1e1599ddfc req-5a9805f2-4337-45cd-b23b-87e810c68153 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:56.828841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a0236c26-3119-4c0c-b932-9d1e1599ddfc req-5a9805f2-4337-45cd-b23b-87e810c68153 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:56.853237 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a0236c26-3119-4c0c-b932-9d1e1599ddfc req-5a9805f2-4337-45cd-b23b-87e810c68153 service nova] Creating event network-changed:e7675843-24d8-458a-afe5-4cdcb419cf46 for instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d on n-h2-858384-19 Nov 02 13:21:56.860748 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a0236c26-3119-4c0c-b932-9d1e1599ddfc req-5a9805f2-4337-45cd-b23b-87e810c68153 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051932 Nov 02 13:21:56.862301 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1059/2290] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:56.913009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-878276312", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d4fa706d-0b70-4668-8feb-3fb6d614d14b"}], "block_device_mapping_v2": [{"uuid": "3fe22993-d5f8-413d-badf-2013451ac476", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:57.002765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] validate_networks() for [('d4fa706d-0b70-4668-8feb-3fb6d614d14b', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:21:57.213229 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8ec55a6f-02b3-46fe-87de-1a419320a597 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action" status: 202 len: 0 microversion: 2.1 time: 0.895454 Nov 02 13:21:57.214511 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1232/2291] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:21:56 2022] POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:21:57.220949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:57.222181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:57.232693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.233583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.234404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.235504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.237806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.238555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.392118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:57.403745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:57.405882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:57.412143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-678781bc-47fe-4626-babf-943e8af23e7d tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1455 microversion: 2.75 time: 0.196343 Nov 02 13:21:57.413060 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1233/2292] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:57 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1455 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:57.418139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:57.419660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:57.426410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.426899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.427455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.428170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.428703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.429211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.615059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:57.627100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b4eb2a6-e1c8-4bd0-94b9-0e2ced8537de tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1320 microversion: 2.1 time: 0.212291 Nov 02 13:21:57.639561 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1234/2293] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:57 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:57.648330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1523163515"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:57.649063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:57.656467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.656956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.657393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.658102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.658709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.659486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.695154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:21:57.696177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:21:57.696657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:21:57.697610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:21:57.697610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:21:57.707690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.708175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.708660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.709445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.709905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.710370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.729477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for project d89e00efbe3c49019171062c5e914dc9. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:21:57.736134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Getting quotas for user 4b987e6d2a814bc6b30b8191cfd5351d and project d89e00efbe3c49019171062c5e914dc9. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:21:57.799855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:21:57.802228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fe22993-d5f8-413d-badf-2013451ac476',volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:21:57.832169 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.network.security_group_api [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Removing security group fee6be38-e78e-47d7-8180-8d9b652c5709 from port 6d336abf-e6a6-4a39-bbde-d6cb143d03d9 Nov 02 13:21:57.947266 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f96aa162-c053-4e20-a014-47aecb8d9b01 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 1.039055 Nov 02 13:21:57.954687 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1060/2294] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:21:56 2022] POST /compute/v2.1/servers => generated 382 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 13:21:57.954687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:57.955083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:57.962620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.963016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.963486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:57.964189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:57.964644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:57.965180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.136735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.149250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-024e195c-5424-4985-bc8e-0580f9faa784 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.199489 Nov 02 13:21:58.150593 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1061/2295] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:57 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:58.157388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:58.158352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:58.167660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.169183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.170211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.171005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.171706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.172180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.204321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:21:58.301202 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2bf94bcf-98c2-4bb8-8120-c7f7742d3296 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 204 len: 0 microversion: 2.1 time: 0.148779 Nov 02 13:21:58.301896 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1062/2296] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:21:58 2022] DELETE /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:21:58.310556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:58.311799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:58.320238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.320829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.321348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.322192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.322478 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-341b4070-72a7-4b1c-973e-6aef280341d7 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action" status: 202 len: 0 microversion: 2.1 time: 0.678331 Nov 02 13:21:58.322888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.323394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.328291 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1235/2297] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:21:57 2022] POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:21:58.333199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b6ab4506-519f-45c4-bd71-4a8f45309811 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:58.333817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b6ab4506-519f-45c4-bd71-4a8f45309811 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:58.336809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:58.429091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b6ab4506-519f-45c4-bd71-4a8f45309811 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.441032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b6ab4506-519f-45c4-bd71-4a8f45309811 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.442881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b6ab4506-519f-45c4-bd71-4a8f45309811 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.444073 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b6ab4506-519f-45c4-bd71-4a8f45309811 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1106 microversion: 2.25 time: 0.114743 Nov 02 13:21:58.447192 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1236/2298] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:58 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1106 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:58.459089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:58.460037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:58.468940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.469555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.469818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.483712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.484579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.485645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.541401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.550550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c4558c37-0ffa-4928-a652-921721116870 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.247002 Nov 02 13:21:58.551184 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1063/2299] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:58 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:58.560257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4aa08005-80ac-473a-94c8-ad786a53a1e0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Action: 'create', calling method: .version_select at 0x7fe787060280>, body: {"pool": null} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:58.653077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.663340 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6bf3b151-d789-4176-922a-d19e0a0ad9e9 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1472 microversion: 2.1 time: 0.214798 Nov 02 13:21:58.675652 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1237/2300] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:58 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:58.686839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:58.687490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:58.693901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.694395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.694838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.695584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.696273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.696703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.768739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.780179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.781915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.788722 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6c9304ee-d05b-4330-9ca2-274d8a98553b tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1440 microversion: 2.75 time: 0.111754 Nov 02 13:21:58.799519 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1238/2301] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:58 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:58.814084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:58.814084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:58.814084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.814084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.814810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.814810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:58.814810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:58.815228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:58.972951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:58.981975 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1fa635c-a0fc-4750-9554-bfe3fc91323d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1320 microversion: 2.1 time: 0.180921 Nov 02 13:21:58.982676 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1239/2302] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:58 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:59.131280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:59.134198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:59.141309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.141896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.142411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.143177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.143668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.144164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.149608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:21:59.237674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:21:59.238092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:21:59.238575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:21:59.238964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:21:59.239541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:21:59.301613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:59.307586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.308006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.308442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.309199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.309199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.310060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.443854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:59.463695 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20dc0f3c-7f96-4f04-933a-102db0c732f5 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb/action" status: 202 len: 1945 microversion: 2.75 time: 0.479844 Nov 02 13:21:59.464729 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1240/2303] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:21:58 2022] POST /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb/action => generated 1945 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Nov 02 13:21:59.470875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a931b67a-fbed-4a6d-862f-c353dabcf28c req-eea90d0d-7bdf-4be4-924f-d558f4ec90fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc8a49-5bee-4ca3-892f-52e3f1f33539", "tag": "6d336abf-e6a6-4a39-bbde-d6cb143d03d9"}, {"name": "network-changed", "server_uuid": "3ebc8a49-5bee-4ca3-892f-52e3f1f33539", "tag": "6d336abf-e6a6-4a39-bbde-d6cb143d03d9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:21:59.482375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a931b67a-fbed-4a6d-862f-c353dabcf28c req-eea90d0d-7bdf-4be4-924f-d558f4ec90fd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.483209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a931b67a-fbed-4a6d-862f-c353dabcf28c req-eea90d0d-7bdf-4be4-924f-d558f4ec90fd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.483906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a931b67a-fbed-4a6d-862f-c353dabcf28c req-eea90d0d-7bdf-4be4-924f-d558f4ec90fd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.497370 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a931b67a-fbed-4a6d-862f-c353dabcf28c req-eea90d0d-7bdf-4be4-924f-d558f4ec90fd service nova] Creating event network-changed:6d336abf-e6a6-4a39-bbde-d6cb143d03d9 for instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 on n-h2-858384-19 Nov 02 13:21:59.498364 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a931b67a-fbed-4a6d-862f-c353dabcf28c req-eea90d0d-7bdf-4be4-924f-d558f4ec90fd service nova] Creating event network-changed:6d336abf-e6a6-4a39-bbde-d6cb143d03d9 for instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 on n-h2-858384-19 Nov 02 13:21:59.504007 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a931b67a-fbed-4a6d-862f-c353dabcf28c req-eea90d0d-7bdf-4be4-924f-d558f4ec90fd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037095 Nov 02 13:21:59.505200 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1241/2304] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:59.512391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:59.512391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:59.520949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.521465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.521886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.522598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.523230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.523658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.683700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:59.694669 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-55c4f51a-5eb5-4808-90d0-ca02816d3bc1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.187669 Nov 02 13:21:59.712563 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1242/2305] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:59 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:21:59.719472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:59.720677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:59.732880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.734153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.735725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.736658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.737232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.737962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.833277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:59.844210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:59.846401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:21:59.848347 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e228d8de-5534-4802-a8b0-375ad99a2184 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1179 microversion: 2.25 time: 0.152003 Nov 02 13:21:59.859154 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1243/2306] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:59 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:59.859154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:59.859154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:59.865301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.865301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.865301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.865301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.866219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.866219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.874312 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4aa08005-80ac-473a-94c8-ad786a53a1e0 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.321547 Nov 02 13:21:59.877164 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1064/2307] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:21:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:21:59.885141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:59.886231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:59.894666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.895266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.895870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.896581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.897226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.897697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.954385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:21:59.973672 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bca23148-598c-4959-99a2-a4583789b858 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.122988 Nov 02 13:21:59.974413 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1244/2308] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:21:59 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:21:59.979433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:21:59.980096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:21:59.987602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.987602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.988120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:21:59.988936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:21:59.989395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:21:59.989937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:00.065144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:00.073182 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f2d4517-193d-428a-bf9f-140bce69a9da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.194273 Nov 02 13:22:00.074084 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1065/2309] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:59 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:00.080227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.184"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:00.082639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:00.089503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:00.090536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:00.091154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:00.091869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:00.092541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:00.093510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:00.122849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "refresh_cache-3ebc8a49-5bee-4ca3-892f-52e3f1f33539" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:22:00.123287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquired lock "refresh_cache-3ebc8a49-5bee-4ca3-892f-52e3f1f33539" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:22:00.132980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:00.142787 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a177fe79-a94a-4b03-adc5-d1b1c0298496 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1472 microversion: 2.1 time: 0.167294 Nov 02 13:22:00.143946 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1245/2310] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:21:59 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:00.165825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:00.166443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:00.174318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:00.174810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:00.175284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:00.175985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:00.176439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:00.176877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:00.378087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:00.390464 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11ee1222-0d84-43d3-8dda-3e289837b4e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1320 microversion: 2.1 time: 0.228380 Nov 02 13:22:00.390958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1246/2311] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:00 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:00.720505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:00.721938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:00.729112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:00.729940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:00.730663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:00.731765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:00.732465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:00.733181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:01.064390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:01.073214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:01.082090 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af65e41e-88b0-4f8d-b459-059b07e66692 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.365247 Nov 02 13:22:01.098006 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1247/2312] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:00 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:01.108856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:01.108856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:01.116832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:01.117633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:01.118341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:01.119928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:01.120604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:01.121038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:01.218598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:01.228932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:01.230508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:01.232235 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ff5ffc4-35be-4ae0-b64e-6f9ee0a217a4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1235 microversion: 2.25 time: 0.134264 Nov 02 13:22:01.233016 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1248/2313] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:01 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1235 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:01.237272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:01.238033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:01.245429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:01.245930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:01.246936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:01.247857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:01.248323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:01.248752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:01.413132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:01.455892 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cccfb801-4c4e-43de-9d05-f99c511bd8bb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.221046 Nov 02 13:22:01.457128 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1249/2314] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:01 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:01.493453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:01.494394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:01.510429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:01.519579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:01.521311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:01.523087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:01.527394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:01.528654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:02.085491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:02.101881 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e52dbe3-474a-4493-85a6-e554b1a0f3da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.616512 Nov 02 13:22:02.102650 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1250/2315] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:01 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:02.115391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:02.116171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:02.123351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:02.124164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:02.124865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:02.125812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:02.126509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:02.127197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:02.167281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:02.169140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:02.170516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:02.171232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lazy-loading 'fault' on Instance uuid 2b61a6bd-c846-47b8-bc2e-1ced93a130de {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:02.638492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:02.663002 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a335d33f-b383-49d5-a10a-c81d21bf552e tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 200 len: 1306 microversion: 2.1 time: 0.559050 Nov 02 13:22:02.665006 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1251/2316] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:02 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 1306 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:02.682969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:02.693842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:02.702833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:02.703404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:02.704031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:02.705114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:02.705891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:02.706505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:02.964636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Building network info cache for instance {{(pid=120929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:22:03.085436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:03.106576 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eda8f1fc-d067-4e25-b838-98814e3b1312 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1320 microversion: 2.1 time: 0.439218 Nov 02 13:22:03.125956 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1252/2317] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:02 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:03.139773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c9ec7c67-48ac-475a-9cd4-803382f20a32 req-ac957207-0bea-4a77-9aa5-defe7ec47bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b61a6bd-c846-47b8-bc2e-1ced93a130de", "name": "network-vif-deleted", "tag": "165d7495-3fe4-430c-b934-4fffcdeadf3a"}, {"server_uuid": "20b7b1a4-c1d8-419d-81c2-24577c4a6269", "name": "network-vif-unplugged", "status": "completed", "tag": "44616a73-0087-4079-9a75-1d953925b087"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:03.165569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c9ec7c67-48ac-475a-9cd4-803382f20a32 req-ac957207-0bea-4a77-9aa5-defe7ec47bd1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:03.171512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c9ec7c67-48ac-475a-9cd4-803382f20a32 req-ac957207-0bea-4a77-9aa5-defe7ec47bd1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:03.172006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c9ec7c67-48ac-475a-9cd4-803382f20a32 req-ac957207-0bea-4a77-9aa5-defe7ec47bd1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:03.205260 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c9ec7c67-48ac-475a-9cd4-803382f20a32 req-ac957207-0bea-4a77-9aa5-defe7ec47bd1 service nova] Creating event network-vif-deleted:165d7495-3fe4-430c-b934-4fffcdeadf3a for instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de on n-h1-858384-19 Nov 02 13:22:03.205690 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c9ec7c67-48ac-475a-9cd4-803382f20a32 req-ac957207-0bea-4a77-9aa5-defe7ec47bd1 service nova] Creating event network-vif-unplugged:44616a73-0087-4079-9a75-1d953925b087 for instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 on n-h1-858384-19 Nov 02 13:22:03.219414 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c9ec7c67-48ac-475a-9cd4-803382f20a32 req-ac957207-0bea-4a77-9aa5-defe7ec47bd1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.092071 Nov 02 13:22:03.221116 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1253/2318] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:03.230368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:03.232567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:03.242074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:03.242901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:03.243880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:03.245921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:03.247797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:03.249142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:03.496114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:03.508425 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca31388f-1ac2-412e-ae41-4c89e0d2d175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.284590 Nov 02 13:22:03.509823 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1254/2319] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:03 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:03.516996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:03.517891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:03.557876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:03.560996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:03.563167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:03.565843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:03.566701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:03.568048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:03.945999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:03.968419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:03.978130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:03.979403 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d082d31e-3f08-48bf-8bd1-e228e92865b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1295 microversion: 2.25 time: 0.467714 Nov 02 13:22:03.983733 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1255/2320] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:03 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1295 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:03.991214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:03.991774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:04.009097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.010770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.011497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.013999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.015027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.015713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.173417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:04.216959 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-96d9dd71-dada-4052-8bad-da0d4b1f9d4d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.229395 Nov 02 13:22:04.220168 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1256/2321] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:03 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:04.225218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ea4a78df-a3ac-4163-9599-c716776b9f8b req-f275f17f-3a88-4e24-94fe-2795a3bead2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc8a49-5bee-4ca3-892f-52e3f1f33539", "tag": "6d336abf-e6a6-4a39-bbde-d6cb143d03d9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:04.255833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ea4a78df-a3ac-4163-9599-c716776b9f8b req-f275f17f-3a88-4e24-94fe-2795a3bead2d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.257224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ea4a78df-a3ac-4163-9599-c716776b9f8b req-f275f17f-3a88-4e24-94fe-2795a3bead2d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.257923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ea4a78df-a3ac-4163-9599-c716776b9f8b req-f275f17f-3a88-4e24-94fe-2795a3bead2d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.287869 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ea4a78df-a3ac-4163-9599-c716776b9f8b req-f275f17f-3a88-4e24-94fe-2795a3bead2d service nova] Creating event network-changed:6d336abf-e6a6-4a39-bbde-d6cb143d03d9 for instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 on n-h2-858384-19 Nov 02 13:22:04.301114 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ea4a78df-a3ac-4163-9599-c716776b9f8b req-f275f17f-3a88-4e24-94fe-2795a3bead2d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078121 Nov 02 13:22:04.302085 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1257/2322] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:04.315758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:04.320308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:04.335723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.339066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.341169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.347468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.348750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.349485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.641523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:04.654771 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-867081e3-194b-482a-862c-2d908e2fb07b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.347181 Nov 02 13:22:04.657628 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1258/2323] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:04 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:04.667972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:04.673535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: 2b61a6bd-c846-47b8-bc2e-1ced93a130de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:04.687259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.690900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.691764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.692757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.694356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.695049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.730127 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] HTTP exception thrown: Instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de could not be found. Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Request method failure captured: Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de HTTP/1.1 Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1n3nrhg-u-ueWibeVvhfd2fyWjDB464ARXNqbQvpffEfBK5L5qLPoAqP_dAYRDT_JDsB7-OMyZjJOtBnsV3vwQEHP26rh2dwAV96JDldlr_uSVulP4z_ncFnmIXhymynlJGvLQvyVbW-KPP2zley8v57FycXE6fw4cjk45QtxsN5I Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c4b5d1bcf8b043de8c000a8a7511c238 Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-MigrationsAdminTest-304925851 Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:04.737054 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-MigrationsAdminTest-304925851 Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c4b5d1bcf8b043de8c000a8a7511c238 Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-MigrationsAdminTest-304925851 Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-MigrationsAdminTest-304925851-project Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e7104fb14f5c430a8bfd7e6aa7ada5ee Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-MigrationsAdminTest-304925851-project Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de could not be found. Nov 02 13:22:04.739181 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '2b61a6bd-c846-47b8-bc2e-1ced93a130de'} Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de could not be found. Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:04.740289 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de could not be found. Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de could not be found. Nov 02 13:22:04.742014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:04.747638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Returning 404 to user: Instance 2b61a6bd-c846-47b8-bc2e-1ced93a130de could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:04.750125 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c489048f-b96e-466f-adf7-320a24e53480 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de" status: 404 len: 111 microversion: 2.1 time: 0.090091 Nov 02 13:22:04.751779 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1259/2324] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:04 2022] GET /compute/v2.1/servers/2b61a6bd-c846-47b8-bc2e-1ced93a130de => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:04.769031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:04.769496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Updating instance_info_cache with network_info: [{"id": "6d336abf-e6a6-4a39-bbde-d6cb143d03d9", "address": "fa:16:3e:4b:ca:5a", "network": {"id": "e2b62650-88d6-4596-95b0-ebba9750752f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-87405100-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4541b34840b84a95aad1208579b6def7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d336abf-e6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:22:04.770000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:04.789588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Releasing lock "refresh_cache-3ebc8a49-5bee-4ca3-892f-52e3f1f33539" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:22:04.790089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.790609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.791057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.795517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.795713 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-58b0190e-37e6-413a-8ba7-2cd1d17e6446 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action" status: 202 len: 0 microversion: 2.1 time: 4.719598 Nov 02 13:22:04.796446 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1066/2325] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:22:00 2022] POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action => generated 0 bytes in 4722 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:22:04.796946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.797576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.810837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:04.815820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:04.831734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.838153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.838878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:04.839958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:04.846634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:04.847321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.134700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:05.142981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:05.148564 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1700b475-a63b-4c8c-b995-14c696e75600 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.350137 Nov 02 13:22:05.153919 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1067/2326] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:04 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:05.173842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:05.175270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:05.190303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.190802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.192132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.192856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.193310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.193732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.252224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:05.354814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:05.364521 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-909fcb26-03d7-4d01-80ae-315b9d4868da tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1320 microversion: 2.1 time: 0.610366 Nov 02 13:22:05.367263 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1260/2327] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:04 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1320 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:05.378734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ade06898-7070-4d0d-ab6b-57da08dc3294 req-82ba85c0-bebe-4da3-a264-7bccd281a440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d23f3c3-e0ff-4429-b3c5-52eab16da30d", "name": "network-vif-plugged", "status": "completed", "tag": "e7675843-24d8-458a-afe5-4cdcb419cf46"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:05.400185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ade06898-7070-4d0d-ab6b-57da08dc3294 req-82ba85c0-bebe-4da3-a264-7bccd281a440 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.400666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ade06898-7070-4d0d-ab6b-57da08dc3294 req-82ba85c0-bebe-4da3-a264-7bccd281a440 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.401107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ade06898-7070-4d0d-ab6b-57da08dc3294 req-82ba85c0-bebe-4da3-a264-7bccd281a440 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.423201 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7312835b-e096-4138-8924-9efdfbdb3760 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 204 len: 0 microversion: 2.1 time: 0.267370 Nov 02 13:22:05.424302 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1068/2328] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:22:05 2022] DELETE /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:22:05.430706 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ade06898-7070-4d0d-ab6b-57da08dc3294 req-82ba85c0-bebe-4da3-a264-7bccd281a440 service nova] Creating event network-vif-plugged:e7675843-24d8-458a-afe5-4cdcb419cf46 for instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d on n-h2-858384-19 Nov 02 13:22:05.432480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.184"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:05.441288 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ade06898-7070-4d0d-ab6b-57da08dc3294 req-82ba85c0-bebe-4da3-a264-7bccd281a440 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072729 Nov 02 13:22:05.448705 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1261/2329] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:05.458352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:05.458894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:05.467344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.468088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.468726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.469769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.470484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.471283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.714490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:05.728550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.729048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.729485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.730190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.730681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.731100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.765516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:05.786252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:05.787875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:05.789191 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-135c0f40-4c99-4716-a1f2-139e57192c06 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1295 microversion: 2.25 time: 0.336119 Nov 02 13:22:05.789761 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1262/2330] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:05 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1295 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:05.794349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:05.795198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:05.801709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.802392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.803090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.804026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.804657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.805264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.912305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:05.930214 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a618ceab-66d1-4a7a-83fa-29d2cbd41b26 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.139218 Nov 02 13:22:05.930980 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1263/2331] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:05 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:05.936694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-03b8155e-071c-497b-9485-22e7372f4d97 req-2a82c36f-d167-4cc4-bfc4-d902bce6ca5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b7b1a4-c1d8-419d-81c2-24577c4a6269", "tag": "44616a73-0087-4079-9a75-1d953925b087"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:05.946826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-03b8155e-071c-497b-9485-22e7372f4d97 req-2a82c36f-d167-4cc4-bfc4-d902bce6ca5a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.947344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-03b8155e-071c-497b-9485-22e7372f4d97 req-2a82c36f-d167-4cc4-bfc4-d902bce6ca5a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.947785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-03b8155e-071c-497b-9485-22e7372f4d97 req-2a82c36f-d167-4cc4-bfc4-d902bce6ca5a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.960626 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-03b8155e-071c-497b-9485-22e7372f4d97 req-2a82c36f-d167-4cc4-bfc4-d902bce6ca5a service nova] Creating event network-changed:44616a73-0087-4079-9a75-1d953925b087 for instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 on n-h1-858384-19 Nov 02 13:22:05.968040 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-03b8155e-071c-497b-9485-22e7372f4d97 req-2a82c36f-d167-4cc4-bfc4-d902bce6ca5a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035400 Nov 02 13:22:05.968556 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1264/2332] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:05.974390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:05.974965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:05.982687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.983227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.983685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:05.984818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:05.984818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:05.985247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:06.001803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "refresh_cache-3ebc8a49-5bee-4ca3-892f-52e3f1f33539" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:22:06.002311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquired lock "refresh_cache-3ebc8a49-5bee-4ca3-892f-52e3f1f33539" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:22:06.172093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:06.180838 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a250eb24-beda-43ae-b802-b725e2dc1c95 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1472 microversion: 2.1 time: 0.210997 Nov 02 13:22:06.181743 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1265/2333] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:05 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1472 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:06.187639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:06.188249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:06.194786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:06.195942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:06.196389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:06.197097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:06.199779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:06.199779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:06.219350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:06.364721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:06.375814 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be99a461-e581-4193-9ae6-af33b3a7dea2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.192918 Nov 02 13:22:06.377021 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1266/2334] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:06 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:06.390294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:06.390941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:06.406622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:06.407148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:06.407593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:06.408304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:06.408759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:06.409189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:06.610565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:06.622489 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0833c72c-fa55-4da4-9578-7c916f9c44b3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.244092 Nov 02 13:22:06.640023 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1267/2335] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:06 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:06.646112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:06.646738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:06.655776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:06.656558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:06.657008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:06.657719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:06.658174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:06.658610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:06.889639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:06.898429 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-253590c5-6634-44c5-9425-9f03d447e9aa tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1320 microversion: 2.1 time: 0.256622 Nov 02 13:22:06.899386 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1268/2336] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:06 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:06.904539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:06.905356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:06.912869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:06.913642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:06.914250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:06.915145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:06.915777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:06.916418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:07.058458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:07.068901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:07.072449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:07.074243 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3fb71af0-fc16-4aaf-9e2e-13ac6de1be19 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1295 microversion: 2.25 time: 0.173622 Nov 02 13:22:07.086759 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1269/2337] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:06 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1295 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:07.086759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:07.086759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:07.093615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:07.093935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:07.096161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:07.096161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:07.096161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:07.096636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:07.186984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:07.195446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Building network info cache for instance {{(pid=120929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:22:07.241231 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f54ddc32-83d5-4fd0-83c0-ddac4c4e7930 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.165283 Nov 02 13:22:07.244587 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1270/2338] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:07 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:07.254045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:07.255692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:07.263084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:07.264279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:07.265259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:07.265751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:07.266217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:07.266647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:07.460097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:07.470352 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0e362ef2-0643-421d-bb72-dd11ca09e18a tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1472 microversion: 2.1 time: 0.224062 Nov 02 13:22:07.471247 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1271/2339] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:07 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:07.481882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-fd7b29be-9c0c-46f5-93bc-87a61b8540a0 req-9f16ae7a-5449-4c26-96be-45d646c71f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebc8a49-5bee-4ca3-892f-52e3f1f33539", "tag": "6d336abf-e6a6-4a39-bbde-d6cb143d03d9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:07.500942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fd7b29be-9c0c-46f5-93bc-87a61b8540a0 req-9f16ae7a-5449-4c26-96be-45d646c71f11 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:07.501430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fd7b29be-9c0c-46f5-93bc-87a61b8540a0 req-9f16ae7a-5449-4c26-96be-45d646c71f11 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:07.501960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fd7b29be-9c0c-46f5-93bc-87a61b8540a0 req-9f16ae7a-5449-4c26-96be-45d646c71f11 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:07.518215 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-fd7b29be-9c0c-46f5-93bc-87a61b8540a0 req-9f16ae7a-5449-4c26-96be-45d646c71f11 service nova] Creating event network-changed:6d336abf-e6a6-4a39-bbde-d6cb143d03d9 for instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 on n-h2-858384-19 Nov 02 13:22:07.523766 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-fd7b29be-9c0c-46f5-93bc-87a61b8540a0 req-9f16ae7a-5449-4c26-96be-45d646c71f11 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051581 Nov 02 13:22:07.524554 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1272/2340] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:07.530714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:07.531438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:07.538691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:07.539194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:07.539637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:07.540344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:07.540792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:07.541213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:07.715414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:07.718916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:07.729450 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17cc05f9-457a-4208-8968-26213ae688da tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.203881 Nov 02 13:22:07.743063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:07.745838 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1273/2341] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:07 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:07.758424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:07.759476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:07.768857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:07.769724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:07.770403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:07.771438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:07.772396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:07.773971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:08.085686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:08.098793 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6c06caf4-0fe2-4884-94d4-94aad712de1d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.344441 Nov 02 13:22:08.105428 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1274/2342] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:07 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:08.118668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:08.122322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:08.137688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:08.140034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:08.140846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:08.143900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:08.143900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:08.143900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:08.143900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:08.412447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:08.422125 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c8f59c4-9e7e-4428-99b7-1828afd109db tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1507 microversion: 2.1 time: 0.314751 Nov 02 13:22:08.436571 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1275/2343] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:08 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:08.446535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-38f883a4-8863-4710-8608-e8b85e62ee39 req-23bac156-baf9-4e08-9835-7ad8701224dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2530d99-e7ea-486d-b401-f89aed63c82e", "tag": "fe4a5830-b144-45ec-8ce0-87d6e72d593f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:08.454521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:08.458982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-38f883a4-8863-4710-8608-e8b85e62ee39 req-23bac156-baf9-4e08-9835-7ad8701224dc service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:08.459632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-38f883a4-8863-4710-8608-e8b85e62ee39 req-23bac156-baf9-4e08-9835-7ad8701224dc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:08.460172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-38f883a4-8863-4710-8608-e8b85e62ee39 req-23bac156-baf9-4e08-9835-7ad8701224dc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:08.475532 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-38f883a4-8863-4710-8608-e8b85e62ee39 req-23bac156-baf9-4e08-9835-7ad8701224dc service nova] Creating event network-changed:fe4a5830-b144-45ec-8ce0-87d6e72d593f for instance e2530d99-e7ea-486d-b401-f89aed63c82e on n-h1-858384-19 Nov 02 13:22:08.483100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-38f883a4-8863-4710-8608-e8b85e62ee39 req-23bac156-baf9-4e08-9835-7ad8701224dc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044936 Nov 02 13:22:08.484768 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1276/2344] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:08.490488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:08.491440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:08.499204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:08.499762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:08.500313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:08.501145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:08.501699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:08.502247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:08.991721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Updating instance_info_cache with network_info: [{"id": "6d336abf-e6a6-4a39-bbde-d6cb143d03d9", "address": "fa:16:3e:4b:ca:5a", "network": {"id": "e2b62650-88d6-4596-95b0-ebba9750752f", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-87405100-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4541b34840b84a95aad1208579b6def7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d336abf-e6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:22:09.028256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Releasing lock "refresh_cache-3ebc8a49-5bee-4ca3-892f-52e3f1f33539" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:22:09.031309 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-784dcaff-d4dc-49e7-866c-7be5fd72170d tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action" status: 202 len: 0 microversion: 2.1 time: 3.605373 Nov 02 13:22:09.032719 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1069/2345] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:22:05 2022] POST /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539/action => generated 0 bytes in 3608 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:22:09.050578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.051663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.076248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.079186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.083436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.086786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.090463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.103947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.116986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:09.128520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:09.135264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:09.136622 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5e2cf415-d7c8-4f27-a4ef-bb5cccee2bba tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1295 microversion: 2.25 time: 0.650601 Nov 02 13:22:09.141037 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1277/2346] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:08 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1295 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:09.156489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.157224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.172769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.174555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.175272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.176172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.178823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.179637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.231667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:09.235552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:09.259001 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6518e930-1403-4261-b54d-c5a37a773a0b tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.224135 Nov 02 13:22:09.260146 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1070/2347] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:09 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:09.265552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.266309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.273174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.273811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.274362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.275313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.275907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.276443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.310007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:09.315898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.316646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.317092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.317553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lazy-loading 'fault' on Instance uuid ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:09.349999 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c7da6708-bf2d-4a67-8b34-525081d9976d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 204 len: 0 microversion: 2.1 time: 0.207395 Nov 02 13:22:09.362439 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1278/2348] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:22:09 2022] DELETE /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:22:09.368737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.369506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.378103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.379359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.379810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.380822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.381464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.382807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.461106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7104fb14f5c430a8bfd7e6aa7ada5ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b5d1bcf8b043de8c000a8a7511c238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:09.470247 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a179945f-c736-457a-bf14-b6cd76fd06a3 tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 200 len: 1306 microversion: 2.1 time: 0.208791 Nov 02 13:22:09.484120 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1071/2349] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:09 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 1306 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:09.489133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b36b369-9a86-433f-ba1f-ed9c8f716425 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '.version_select at 0x7fe786fc2280>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.577498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:09.586315 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-319c5903-fc59-4439-bfd5-d02e122213ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.222370 Nov 02 13:22:09.587435 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1279/2350] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:09 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:09.592433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.593046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.599602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.600034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.600857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.601739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.602369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.602968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.769847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:09.778417 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d3250cb9-e504-4dfe-b406-512e97e3b84d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.189862 Nov 02 13:22:09.779104 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1280/2351] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:09 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:09.783946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:09.784557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:09.790579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.791063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.791539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.792236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.792693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.793778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:09.950533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:09.961128 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-08ca4cad-a23e-4be4-8cb1-1298b30fbda5 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1513 microversion: 2.1 time: 0.180930 Nov 02 13:22:09.967231 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1281/2352] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:09 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:09.972925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-00239ca2-d311-4dce-b409-0caf56e45a82 req-788bbe24-947a-4171-9a74-d96608f17886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4", "name": "network-vif-deleted", "tag": "23b3c7e1-ffaf-4afb-81a2-cf840371d46f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:09.993283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-00239ca2-d311-4dce-b409-0caf56e45a82 req-788bbe24-947a-4171-9a74-d96608f17886 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:09.993993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-00239ca2-d311-4dce-b409-0caf56e45a82 req-788bbe24-947a-4171-9a74-d96608f17886 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:09.994513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-00239ca2-d311-4dce-b409-0caf56e45a82 req-788bbe24-947a-4171-9a74-d96608f17886 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.009838 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-00239ca2-d311-4dce-b409-0caf56e45a82 req-788bbe24-947a-4171-9a74-d96608f17886 service nova] Creating event network-vif-deleted:23b3c7e1-ffaf-4afb-81a2-cf840371d46f for instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 on n-h1-858384-19 Nov 02 13:22:10.016339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-00239ca2-d311-4dce-b409-0caf56e45a82 req-788bbe24-947a-4171-9a74-d96608f17886 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052798 Nov 02 13:22:10.017448 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1282/2353] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:10.171331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:10.172046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:10.178995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.179518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.179964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.181795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.182270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.182939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.189213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:10.351380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:10.362546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:10.364633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:10.366110 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47288127-031e-4ce7-a9ad-8666fc1dcb4a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.200502 Nov 02 13:22:10.367294 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1283/2354] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:10 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:10.376099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:10.377127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:10.388817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.391670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.392100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.393048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.393551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.394191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.410220 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b36b369-9a86-433f-ba1f-ed9c8f716425 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/9ed9c09e-fbb2-47af-b030-26ceb216c060" status: 202 len: 0 microversion: 2.1 time: 0.924609 Nov 02 13:22:10.411088 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1072/2355] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:22:09 2022] DELETE /compute/v2.1/os-floating-ips/9ed9c09e-fbb2-47af-b030-26ceb216c060 => generated 0 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:22:10.422365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0ef3ad23-0e26-46d9-9070-4c9b96032d42 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '.version_select at 0x7fe78f8768b0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:10.478971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:10.497421 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8673db61-d8a6-4cd0-9281-324cbb1db3fc tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.128744 Nov 02 13:22:10.498171 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1284/2356] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:10 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:10.509619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:10.510374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] [instance: ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:10.517142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.517811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.518348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.519228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.519816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.520334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.535795 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] HTTP exception thrown: Instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 could not be found. Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Request method failure captured: Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 HTTP/1.1 Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm1n3nrhg-u-ueWibeVvhfd2fyWjDB464ARXNqbQvpffEfBK5L5qLPoAqP_dAYRDT_JDsB7-OMyZjJOtBnsV3vwQEHP26rh2dwAV96JDldlr_uSVulP4z_ncFnmIXhymynlJGvLQvyVbW-KPP2zley8v57FycXE6fw4cjk45QtxsN5I Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c4b5d1bcf8b043de8c000a8a7511c238 Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-MigrationsAdminTest-304925851 Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:10.537673 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c4b5d1bcf8b043de8c000a8a7511c238"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-MigrationsAdminTest-304925851 Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c4b5d1bcf8b043de8c000a8a7511c238 Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-MigrationsAdminTest-304925851 Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-MigrationsAdminTest-304925851-project Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e7104fb14f5c430a8bfd7e6aa7ada5ee Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-MigrationsAdminTest-304925851-project Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 could not be found. Nov 02 13:22:10.539382 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4'} Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 could not be found. Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:10.540444 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 could not be found. Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 could not be found. Nov 02 13:22:10.542205 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:10.544552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] Returning 404 to user: Instance ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:10.544552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d775f14f-73e9-4b11-a082-fb5858257efb tempest-MigrationsAdminTest-304925851 tempest-MigrationsAdminTest-304925851-project] 10.222.0.113 "GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4" status: 404 len: 111 microversion: 2.1 time: 0.034078 Nov 02 13:22:10.544552 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1285/2357] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:10 2022] GET /compute/v2.1/servers/ae7d0879-3cbe-4acf-b88f-1f59f5d19bf4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:10.613464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:10.614354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:10.621747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.622371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.623621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.624455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.625032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.625737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.656645 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0ef3ad23-0e26-46d9-9070-4c9b96032d42 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/fee6be38-e78e-47d7-8180-8d9b652c5709" status: 202 len: 0 microversion: 2.1 time: 0.240097 Nov 02 13:22:10.658103 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1073/2358] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:22:10 2022] DELETE /compute/v2.1/os-security-groups/fee6be38-e78e-47d7-8180-8d9b652c5709 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:22:10.666822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:10.667813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:10.678170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.678799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.679518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.680353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.681386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.681924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.716416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:10.816743 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-46f2a06c-e41c-4175-b382-e4bd384d1e94 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 204 len: 0 microversion: 2.1 time: 0.154019 Nov 02 13:22:10.818034 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1074/2359] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:22:10 2022] DELETE /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:22:10.827230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:10.828578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:10.836519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.837145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.837873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.838766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.839492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.840540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.841013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:10.851800 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-295c6950-4e65-46c7-88af-5e43544a4103 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.242500 Nov 02 13:22:10.867970 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1286/2360] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:10 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:10.877590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:10.878520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:10.885973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.886643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.887087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:10.887973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:10.888486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:10.888920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:11.090608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:11.100102 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d9b0782-0ea4-434f-b6c6-c2e0ca45d4ba tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1512 microversion: 2.1 time: 0.230431 Nov 02 13:22:11.101060 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1287/2361] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:10 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:11.109290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:11.110176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:11.116967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:11.117658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:11.118249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:11.119331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:11.120459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:11.120736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:11.226397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:11.235469 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-894514fb-3dff-4cc8-a858-1def66b37537 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.414476 Nov 02 13:22:11.251408 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1075/2362] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:10 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:11.283058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:11.292445 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f410077f-53f8-4f20-93fd-ef1d7f2b9263 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1513 microversion: 2.1 time: 0.188328 Nov 02 13:22:11.293187 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1288/2363] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:11 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:11.396109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:11.396735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:11.404701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:11.405197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:11.405641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:11.406390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:11.406827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:11.407288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:11.529315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:11.530195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:11.540355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:11.540979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:11.541608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:11.542396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:11.542939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:11.543462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:11.635210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:11.656563 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1af795d-ecfd-419b-b3dd-ed6307fdbb65 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.134268 Nov 02 13:22:11.657454 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1289/2364] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:11 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:11.696312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:11.706904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:11.708584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:11.709783 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4272266f-3964-4e0c-87bb-79a19b5cc2d7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.317795 Nov 02 13:22:11.710443 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1076/2365] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:11 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:11.882491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:11.883499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:11.891249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:11.891739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:11.892177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:11.892879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:11.893330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:11.893752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.053837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:12.062308 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83c6de2f-ae25-4244-93d1-3a1293229c51 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.184042 Nov 02 13:22:12.062897 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1290/2366] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:11 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:12.125134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:12.125810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:12.132347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.132830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.133270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.134167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.134627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.135056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.260879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:12.262961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:12.269232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.269726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.270169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.271121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.271588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.272381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.282199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:12.290159 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7389943-4387-43f7-b74f-afac549f5893 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1512 microversion: 2.1 time: 0.169474 Nov 02 13:22:12.290716 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1077/2367] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:12 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:12.316713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:12.317599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:12.324272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.325164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.325367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.326061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.326517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.327000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.428186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:12.438161 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17c94a1d-8f70-4e03-aebe-200e7bdd4daa tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.181487 Nov 02 13:22:12.443280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1291/2368] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:12 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:12.482893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:12.490822 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a2d703a-114e-40ff-8124-864f35b6bacf tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1513 microversion: 2.1 time: 0.177927 Nov 02 13:22:12.491775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1078/2369] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:12 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:12.686313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:12.687024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:12.693048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.693611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.694142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.694914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.695670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.696258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.737516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:12.738432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:12.745294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.746459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.750164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.750164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:12.750164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:12.750164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:12.776088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:12.797331 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01297dc5-b97c-4ed7-9391-77e538fc84c4 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.115576 Nov 02 13:22:12.798795 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1292/2370] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:12 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:12.898080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:12.907491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:12.909071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:12.910189 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-02f0e31f-bbb6-42ce-b430-5c5c521cc40f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.178145 Nov 02 13:22:12.910764 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1079/2371] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:12 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:13.085559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:13.086175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:13.093622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.094101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.094607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.095410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.095893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.096372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.236870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:13.242590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a632db7-00fb-43d1-81dd-092066ed4280 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.160964 Nov 02 13:22:13.243251 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1293/2372] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:13 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:13.313877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:13.314789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:13.321509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.322184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.322620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.323390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.324066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.324662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.462281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:13.463028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:13.463762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:13.470575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.471200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.471740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.472510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.472936 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a18d0e47-af18-457e-ac65-1b5af316b24c tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1512 microversion: 2.1 time: 0.162966 Nov 02 13:22:13.473073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.473604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.474113 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1080/2373] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:13 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:13.516454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:13.517362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:13.523605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.524289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.524722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.525592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.526080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.526518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.556614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:13.631999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:13.643079 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-94800d83-1239-43d4-9dab-b4e8b0a43a41 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.184635 Nov 02 13:22:13.644455 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1294/2374] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:13 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:13.689805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:13.697868 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b37f1db-f9e3-41f8-97d6-3fe92f4ce46d tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1513 microversion: 2.1 time: 0.185220 Nov 02 13:22:13.698454 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1081/2375] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:13 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:13.826779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:13.827602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:13.833558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.834046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.834483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.835400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.835674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.836099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.877265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c04219c-1458-4aef-92f1-bde0bbf1a1df tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Action: 'update', calling method: .version_select at 0x7fe786c2c790>, body: {"quota_set": {"ram": "5120"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:13.913505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:13.932715 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3bfe8fd4-f14a-4363-8567-e4866ab1180a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.110526 Nov 02 13:22:13.933696 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1082/2376] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:13 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:13.938226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:13.938772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:13.941150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c04219c-1458-4aef-92f1-bde0bbf1a1df tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.941822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c04219c-1458-4aef-92f1-bde0bbf1a1df tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.942255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c04219c-1458-4aef-92f1-bde0bbf1a1df tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.943206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c04219c-1458-4aef-92f1-bde0bbf1a1df tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.943991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c04219c-1458-4aef-92f1-bde0bbf1a1df tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.944889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c04219c-1458-4aef-92f1-bde0bbf1a1df tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.945028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.945503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.945943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:13.946638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:13.947137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:13.947574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.010286 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c04219c-1458-4aef-92f1-bde0bbf1a1df tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/48da56dcf8d24e589dfadf80bc1def63" status: 200 len: 240 microversion: 2.36 time: 0.267073 Nov 02 13:22:14.015167 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1295/2377] 10.222.0.113 () {62 vars in 1308 bytes} [Wed Nov 2 13:22:13 2022] PUT /compute/v2.1/os-quota-sets/48da56dcf8d24e589dfadf80bc1def63 => generated 240 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:22:14.023920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e15256b-8df7-4332-a31f-c36b8d51afee tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Calling method '.version_select at 0x7fe786c63670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:14.090460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e15256b-8df7-4332-a31f-c36b8d51afee tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.091552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e15256b-8df7-4332-a31f-c36b8d51afee tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.092264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e15256b-8df7-4332-a31f-c36b8d51afee tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.093257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e15256b-8df7-4332-a31f-c36b8d51afee tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.093945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e15256b-8df7-4332-a31f-c36b8d51afee tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.094598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e15256b-8df7-4332-a31f-c36b8d51afee tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.118962 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e15256b-8df7-4332-a31f-c36b8d51afee tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/48da56dcf8d24e589dfadf80bc1def63/detail" status: 200 len: 672 microversion: 2.36 time: 0.100526 Nov 02 13:22:14.120163 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1296/2378] 10.222.0.113 () {60 vars in 1309 bytes} [Wed Nov 2 13:22:14 2022] GET /compute/v2.1/os-quota-sets/48da56dcf8d24e589dfadf80bc1def63/detail => generated 672 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:22:14.163217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:14.182503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:14.190654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:14.194732 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e65d3fc8-5265-483d-87aa-fbe0856b54da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.260090 Nov 02 13:22:14.195438 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1083/2379] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:13 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:14.267091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:14.268087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:14.275841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.276688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.277720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.278342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Action: 'update', calling method: .version_select at 0x7fe787056ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:14.279034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.279924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.280534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.359841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.360751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.361294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.362168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.362731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.363441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.403036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.403963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.404535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.405399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.405976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.406513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.480148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:14.483707 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-911e4738-8de8-4278-a0e3-d6599ea786d9 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/48da56dcf8d24e589dfadf80bc1def63?user_id=3b4dcca157fe42fa925d866c9295b1e2" status: 200 len: 240 microversion: 2.36 time: 0.210231 Nov 02 13:22:14.491307 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1084/2380] 10.222.0.113 () {62 vars in 1389 bytes} [Wed Nov 2 13:22:14 2022] PUT /compute/v2.1/os-quota-sets/48da56dcf8d24e589dfadf80bc1def63?user_id=3b4dcca157fe42fa925d866c9295b1e2 => generated 240 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:22:14.491663 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8825f0aa-ab6c-4562-a6dd-43def59fb5fd tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.228446 Nov 02 13:22:14.491786 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1297/2381] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:14 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:14.497799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5dc81cbc-5408-416c-83f1-0ddfd38ee988 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] Calling method '.version_select at 0x7fe787061280>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:14.498608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:14.499367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:14.506686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.507416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.508000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.509030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.509499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.510016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.654431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5dc81cbc-5408-416c-83f1-0ddfd38ee988 tempest-QuotasAdminTestV236-796846182 tempest-QuotasAdminTestV236-796846182-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/48da56dcf8d24e589dfadf80bc1def63?user_id=3b4dcca157fe42fa925d866c9295b1e2" status: 200 len: 282 microversion: 2.36 time: 0.161198 Nov 02 13:22:14.655549 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1085/2382] 10.222.0.113 () {60 vars in 1369 bytes} [Wed Nov 2 13:22:14 2022] GET /compute/v2.1/os-quota-sets/48da56dcf8d24e589dfadf80bc1def63?user_id=3b4dcca157fe42fa925d866c9295b1e2 => generated 282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:22:14.669789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:14.670756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:14.677665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.678404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.679167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.680324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.681069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.681757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.773257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:14.783714 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4aef6e6a-b39a-4385-9c24-caff3b276b97 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1512 microversion: 2.1 time: 0.289939 Nov 02 13:22:14.784337 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1298/2383] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:14 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:14.789564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b1cc8dd5-8511-4d45-8964-f0e6bf941ed2 req-fa0007fc-2efd-466b-b7d9-f039a9da4bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d23f3c3-e0ff-4429-b3c5-52eab16da30d", "name": "network-vif-deleted", "tag": "e7675843-24d8-458a-afe5-4cdcb419cf46"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:14.803990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b1cc8dd5-8511-4d45-8964-f0e6bf941ed2 req-fa0007fc-2efd-466b-b7d9-f039a9da4bf2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.804914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b1cc8dd5-8511-4d45-8964-f0e6bf941ed2 req-fa0007fc-2efd-466b-b7d9-f039a9da4bf2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.805692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b1cc8dd5-8511-4d45-8964-f0e6bf941ed2 req-fa0007fc-2efd-466b-b7d9-f039a9da4bf2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.820388 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b1cc8dd5-8511-4d45-8964-f0e6bf941ed2 req-fa0007fc-2efd-466b-b7d9-f039a9da4bf2 service nova] Creating event network-vif-deleted:e7675843-24d8-458a-afe5-4cdcb419cf46 for instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d on n-h2-858384-19 Nov 02 13:22:14.828164 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b1cc8dd5-8511-4d45-8964-f0e6bf941ed2 req-fa0007fc-2efd-466b-b7d9-f039a9da4bf2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041924 Nov 02 13:22:14.829501 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1299/2384] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:14.837375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:14.838092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:14.846717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.847535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.848822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.849786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.850909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.851942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.924746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:14.925835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:14.927312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:14.927945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lazy-loading 'fault' on Instance uuid 3d23f3c3-e0ff-4429-b3c5-52eab16da30d {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:15.006720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:15.017715 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3c162f2a-f37a-4bd7-b090-0a53b5652032 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1310 microversion: 2.1 time: 0.186716 Nov 02 13:22:15.019505 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1300/2385] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:14 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1310 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:15.025075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:15.025941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:15.034234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:15.034743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:15.035248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:15.036026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:15.036492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:15.036986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:15.044881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:15.189829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:15.223155 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-acdbadd2-71a1-4c61-a774-f3a24100307f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.202174 Nov 02 13:22:15.235266 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1301/2386] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:15 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:15.243164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:15.243869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:15.263873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:15.264806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:15.266722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:15.267950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:15.269482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:15.270172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:15.448260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:15.454819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:15.459462 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3145d019-5379-4ea9-909d-2932705c95a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.794702 Nov 02 13:22:15.460582 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1086/2387] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:14 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:15.479147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:15.481148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:15.482601 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5788f466-6061-4cd3-8816-f2b14d07f9cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.245812 Nov 02 13:22:15.488048 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1302/2388] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:15 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:15.523907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:15.524586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:15.538917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:15.541446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:15.542173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:15.543908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:15.544532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:15.545044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:15.685605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-66fd0353-690d-4a94-89a6-f60854af442d req-ffa73401-5c08-4f62-a39d-9cc5acc8c421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebc8a49-5bee-4ca3-892f-52e3f1f33539", "name": "network-vif-deleted", "tag": "6d336abf-e6a6-4a39-bbde-d6cb143d03d9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:15.697754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-66fd0353-690d-4a94-89a6-f60854af442d req-ffa73401-5c08-4f62-a39d-9cc5acc8c421 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:15.698968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-66fd0353-690d-4a94-89a6-f60854af442d req-ffa73401-5c08-4f62-a39d-9cc5acc8c421 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:15.699463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-66fd0353-690d-4a94-89a6-f60854af442d req-ffa73401-5c08-4f62-a39d-9cc5acc8c421 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:15.716443 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-66fd0353-690d-4a94-89a6-f60854af442d req-ffa73401-5c08-4f62-a39d-9cc5acc8c421 service nova] Creating event network-vif-deleted:6d336abf-e6a6-4a39-bbde-d6cb143d03d9 for instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 on n-h2-858384-19 Nov 02 13:22:15.721546 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-66fd0353-690d-4a94-89a6-f60854af442d req-ffa73401-5c08-4f62-a39d-9cc5acc8c421 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044142 Nov 02 13:22:15.722463 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1303/2389] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:15.768477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:15.778156 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a5ea058e-3a44-43a2-82b5-568b516de46b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.262401 Nov 02 13:22:15.778869 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1087/2390] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:15 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:15.812450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:15.813244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:15.822197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:15.822793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:15.823532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:15.826440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:15.826954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:15.827435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:15.899832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:15.909167 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ab294a2-68e6-4c55-a266-3ccd09a65285 tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1470 microversion: 2.1 time: 0.104337 Nov 02 13:22:15.909753 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1304/2391] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:15 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1470 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:16.048902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:16.049682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:16.055761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.056255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.056724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.057436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.057894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.058374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.091523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.092549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.093005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.093548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lazy-loading 'fault' on Instance uuid 3d23f3c3-e0ff-4429-b3c5-52eab16da30d {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:16.140889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef9ffffbe2842f3b99e88046b163967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59efbe08ba34532885fac52dfc8815c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:16.149739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ef89b307-1ed8-4adf-ba8c-6f3cc37aa58e tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 200 len: 1310 microversion: 2.1 time: 0.104788 Nov 02 13:22:16.150525 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1088/2392] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:16 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:16.256848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:16.257456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:16.264124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.264615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.265052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.265960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.266379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.266993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.348021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:16.366846 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e11f5de9-f1cc-4568-8aa2-769278752242 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.113711 Nov 02 13:22:16.367167 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1305/2393] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:16 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:16.484192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:16.484759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:16.491420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.491893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.492319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.493009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.493453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.493874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.511840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:16.512471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:16.518748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.519274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.519928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.520645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.521119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.521538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.637359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:16.644564 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-072ec04a-11de-4c55-b888-da54c3846235 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1518 microversion: 2.1 time: 0.165217 Nov 02 13:22:16.645908 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1089/2394] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:16 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:16.740648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:16.750011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:16.751540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:16.752670 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-92905e06-c7d3-418a-8b7e-d5a0f3e4cb49 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.245073 Nov 02 13:22:16.753441 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1306/2395] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:16 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:16.804240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:16.804930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:16.811472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.811957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.812396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.813097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.813554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.813978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.932821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:16.933476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:16.941867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.942356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.942794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.943521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:16.944154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:16.944751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:16.983414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:16.991367 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da4f7c3d-5824-42c2-a322-77e4b340893c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1393 microversion: 2.1 time: 0.191073 Nov 02 13:22:16.991860 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1090/2396] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:16 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1393 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:17.026664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bec36047ed5746299791af725258d613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4541b34840b84a95aad1208579b6def7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:17.035248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c131d820-8aa8-4a92-80e9-2709cddec1fe tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 200 len: 1297 microversion: 2.1 time: 0.106300 Nov 02 13:22:17.035836 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1307/2397] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:16 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:17.175986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:17.177365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:17.185827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.186780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.187284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.188181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.188941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.189565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.211427 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] HTTP exception thrown: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Request method failure captured: Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d HTTP/1.1 Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm7ru2_wtFgh6MpDsPOrA6ZhQ4sFgdx7v8DCef8lix1w_Ldv6iEhSyrNn_WSdFve3mekD_ntfPkH95cibvetudqRGzm9nAF9c4NjLSBR2zOWA840VSTIkWlb2CcZvvlILTN2IVa1DLMrFN2uSzqV-bLgjArVU2XvaL3WItCm80TSAvk Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:22:17.213700 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: cef9ffffbe2842f3b99e88046b163967 Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.215754 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '3d23f3c3-e0ff-4429-b3c5-52eab16da30d'} Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:17.216809 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.218511 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.224545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Returning 404 to user: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:17.225817 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-33bd531b-4c31-492c-a4f7-ab17128016fe tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 404 len: 111 microversion: 2.1 time: 0.056293 Nov 02 13:22:17.226991 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1091/2398] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:17 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:17.235809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1052499940", "metadata": {"image_type": "test"}}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:17.238706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:17.243610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:17.250328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.250822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.251309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.252026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.252489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.252924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.271694 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] HTTP exception thrown: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Request method failure captured: Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d/action HTTP/1.1 Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 112 Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm7ru2_wtFgh6MpDsPOrA6ZhQ4sFgdx7v8DCef8lix1w_Ldv6iEhSyrNn_WSdFve3mekD_ntfPkH95cibvetudqRGzm9nAF9c4NjLSBR2zOWA840VSTIkWlb2CcZvvlILTN2IVa1DLMrFN2uSzqV-bLgjArVU2XvaL3WItCm80TSAvk Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:17.273433 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: cef9ffffbe2842f3b99e88046b163967 Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1052499940", "metadata": {"image_type": "test"}}} Nov 02 13:22:17.275437 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '3d23f3c3-e0ff-4429-b3c5-52eab16da30d', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1052499940', 'metadata': {'image_type': 'test'}}}} Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.276803 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.279980 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.282458 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.282458 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:17.282458 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:17.282458 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.282458 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.282458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Returning 404 to user: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:17.282458 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b49371a-f653-4eba-b1de-ede0f69a585a tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "POST /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d/action" status: 404 len: 111 microversion: 2.1 time: 0.043748 Nov 02 13:22:17.282458 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1308/2399] 10.222.0.113 () {60 vars in 1284 bytes} [Wed Nov 2 13:22:17 2022] POST /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:17.295454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe2f4768-dc67-43af-957a-f55ceeb25835 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1189093854", "metadata": {"image_type": "test"}}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:17.298881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe2f4768-dc67-43af-957a-f55ceeb25835 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Failed to fetch instance by id tempest-invalid-1552366126 {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:22:17.299450 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-fe2f4768-dc67-43af-957a-f55ceeb25835 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] HTTP exception thrown: Instance tempest-invalid-1552366126 could not be found. Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe2f4768-dc67-43af-957a-f55ceeb25835 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Request method failure captured: Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/tempest-invalid-1552366126/action HTTP/1.1 Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 112 Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm7ru2_wtFgh6MpDsPOrA6ZhQ4sFgdx7v8DCef8lix1w_Ldv6iEhSyrNn_WSdFve3mekD_ntfPkH95cibvetudqRGzm9nAF9c4NjLSBR2zOWA840VSTIkWlb2CcZvvlILTN2IVa1DLMrFN2uSzqV-bLgjArVU2XvaL3WItCm80TSAvk Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:22:17.301581 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: cef9ffffbe2842f3b99e88046b163967 Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1189093854", "metadata": {"image_type": "test"}}} Nov 02 13:22:17.303713 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance tempest-invalid-1552366126 could not be found. Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'tempest-invalid-1552366126', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1189093854', 'metadata': {'image_type': 'test'}}}} Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1552366126 could not be found. Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:17.304858 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1552366126 could not be found. Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1552366126 could not be found. Nov 02 13:22:17.306789 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.310068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe2f4768-dc67-43af-957a-f55ceeb25835 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Returning 404 to user: Instance tempest-invalid-1552366126 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:17.310068 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe2f4768-dc67-43af-957a-f55ceeb25835 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "POST /compute/v2.1/servers/tempest-invalid-1552366126/action" status: 404 len: 101 microversion: 2.1 time: 0.016211 Nov 02 13:22:17.321123 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1092/2400] 10.222.0.113 () {60 vars in 1254 bytes} [Wed Nov 2 13:22:17 2022] POST /compute/v2.1/servers/tempest-invalid-1552366126/action => generated 101 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:17.326705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-185d0919-27a1-4351-af0f-301a3219d0cd tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-843794332"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:17.332537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-185d0919-27a1-4351-af0f-301a3219d0cd tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:22:17.333066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-185d0919-27a1-4351-af0f-301a3219d0cd tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-185d0919-27a1-4351-af0f-301a3219d0cd tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Request method failure captured: Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 56 Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm7ru2_wtFgh6MpDsPOrA6ZhQ4sFgdx7v8DCef8lix1w_Ldv6iEhSyrNn_WSdFve3mekD_ntfPkH95cibvetudqRGzm9nAF9c4NjLSBR2zOWA840VSTIkWlb2CcZvvlILTN2IVa1DLMrFN2uSzqV-bLgjArVU2XvaL3WItCm80TSAvk Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:17.334625 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: cef9ffffbe2842f3b99e88046b163967 Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: {"createImage": {"name": "tempest-test-snap-843794332"}} Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:17.336557 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-843794332'}}} Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:17.338177 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.341540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.343436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-185d0919-27a1-4351-af0f-301a3219d0cd tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:17.343436 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-185d0919-27a1-4351-af0f-301a3219d0cd tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.018636 Nov 02 13:22:17.343436 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1309/2401] 10.222.0.113 () {60 vars in 1280 bytes} [Wed Nov 2 13:22:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:17.346931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe61341d-403a-4284-bd66-6d0de1a40c61 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-74450546"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:17.350090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe61341d-403a-4284-bd66-6d0de1a40c61 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:22:17.350612 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-fe61341d-403a-4284-bd66-6d0de1a40c61 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe61341d-403a-4284-bd66-6d0de1a40c61 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Request method failure captured: Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 55 Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm7ru2_wtFgh6MpDsPOrA6ZhQ4sFgdx7v8DCef8lix1w_Ldv6iEhSyrNn_WSdFve3mekD_ntfPkH95cibvetudqRGzm9nAF9c4NjLSBR2zOWA840VSTIkWlb2CcZvvlILTN2IVa1DLMrFN2uSzqV-bLgjArVU2XvaL3WItCm80TSAvk Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:22:17.352405 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: cef9ffffbe2842f3b99e88046b163967 Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: {"createImage": {"name": "tempest-test-snap-74450546"}} Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:22:17.353986 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-74450546'}}} Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:17.356048 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 13:22:17.357693 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.362917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe61341d-403a-4284-bd66-6d0de1a40c61 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:17.362917 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe61341d-403a-4284-bd66-6d0de1a40c61 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010726 Nov 02 13:22:17.362917 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1093/2402] 10.222.0.113 () {60 vars in 1286 bytes} [Wed Nov 2 13:22:17 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:17.363897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:17.364363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:17.372735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.373234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.373709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.374395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.374917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.375388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.391056 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] HTTP exception thrown: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.399412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:17.400046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Request method failure captured: Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d HTTP/1.1 Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm7ru2_wtFgh6MpDsPOrA6ZhQ4sFgdx7v8DCef8lix1w_Ldv6iEhSyrNn_WSdFve3mekD_ntfPkH95cibvetudqRGzm9nAF9c4NjLSBR2zOWA840VSTIkWlb2CcZvvlILTN2IVa1DLMrFN2uSzqV-bLgjArVU2XvaL3WItCm80TSAvk Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:17.405050 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: cef9ffffbe2842f3b99e88046b163967 Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.406902 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '3d23f3c3-e0ff-4429-b3c5-52eab16da30d'} Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:17.407942 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.409623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.411333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Returning 404 to user: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:17.411333 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09f9d665-587e-4b66-8554-aed6b9d774f9 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 404 len: 111 microversion: 2.1 time: 0.046566 Nov 02 13:22:17.413655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.414280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1310/2403] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:22:17 2022] DELETE /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:17.415570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.416067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.416833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.417301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.418352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.426880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:17.427651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] [instance: 3d23f3c3-e0ff-4429-b3c5-52eab16da30d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:17.440809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.441468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.442014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.442824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.443702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.444371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.466401 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] HTTP exception thrown: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Request method failure captured: Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d HTTP/1.1 Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm7ru2_wtFgh6MpDsPOrA6ZhQ4sFgdx7v8DCef8lix1w_Ldv6iEhSyrNn_WSdFve3mekD_ntfPkH95cibvetudqRGzm9nAF9c4NjLSBR2zOWA840VSTIkWlb2CcZvvlILTN2IVa1DLMrFN2uSzqV-bLgjArVU2XvaL3WItCm80TSAvk Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:17.469543 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c59efbe08ba34532885fac52dfc8815c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c59efbe08ba34532885fac52dfc8815c Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1460649363 Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: cef9ffffbe2842f3b99e88046b163967 Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesNegativeTestJSON-1460649363-project Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.471094 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '3d23f3c3-e0ff-4429-b3c5-52eab16da30d'} Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:17.472214 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. Nov 02 13:22:17.473655 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:17.478753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] Returning 404 to user: Instance 3d23f3c3-e0ff-4429-b3c5-52eab16da30d could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:17.480052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ec6268d6-89a4-408f-9dce-38244c50e5e3 tempest-ImagesNegativeTestJSON-1460649363 tempest-ImagesNegativeTestJSON-1460649363-project] 10.222.0.113 "GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d" status: 404 len: 111 microversion: 2.1 time: 0.064622 Nov 02 13:22:17.481978 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1311/2404] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:17 2022] GET /compute/v2.1/servers/3d23f3c3-e0ff-4429-b3c5-52eab16da30d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:17.559210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:17.583845 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e47d1320-fc73-4012-9de9-f7413dad38ab tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.191115 Nov 02 13:22:17.585011 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1094/2405] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:17 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:17.684179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:17.685646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:17.692393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.693448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.694440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.696091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.696745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.697384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.779216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:17.780205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:17.796097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.796937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.797579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:17.798491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:17.799156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:17.800411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.030369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:18.044464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:18.047378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:18.048575 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2804fb81-40aa-455f-9d1c-561aac9fd944 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.274280 Nov 02 13:22:18.052133 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1095/2406] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:17 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:18.069044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:18.070213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:18.078212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:18.078942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:18.079420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.080136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:18.080596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:18.081023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.164795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:18.175742 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-835946dc-ccc9-4009-9d13-bd8685b488a9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1524 microversion: 2.1 time: 0.501068 Nov 02 13:22:18.177505 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1312/2407] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:17 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1524 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:18.184434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:18.185266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] [instance: 3ebc8a49-5bee-4ca3-892f-52e3f1f33539] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:18.191740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:18.201037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:18.201536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.202297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:18.202775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:18.203246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.219884 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] HTTP exception thrown: Instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 could not be found. Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Request method failure captured: Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 HTTP/1.1 Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm65Q7LG_YCedkfQUW4Skh7pqMzMWlHFHAD-VE__jdoHs7yLLzHD7G1KOGs-b0nqvhyXZJOQTCF-4Otd5HERO7SOHsByhcwgWi_FTi5BnpUDt-FnQ_bj2wSC28idEq-9Yr1L7y00Cx_QTNDXMtB8HVskBZPwuwugJphBgH50SbsUttU Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4541b34840b84a95aad1208579b6def7 Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-49493203 Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:18.221464 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4541b34840b84a95aad1208579b6def7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4541b34840b84a95aad1208579b6def7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4541b34840b84a95aad1208579b6def7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4541b34840b84a95aad1208579b6def7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-49493203 Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4541b34840b84a95aad1208579b6def7 Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-49493203 Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerRescueTestJSONUnderV235-49493203-project Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: bec36047ed5746299791af725258d613 Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-49493203-project Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 could not be found. Nov 02 13:22:18.223295 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '3ebc8a49-5bee-4ca3-892f-52e3f1f33539'} Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 could not be found. Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:18.224880 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 could not be found. Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 could not be found. Nov 02 13:22:18.226467 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:18.229277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] Returning 404 to user: Instance 3ebc8a49-5bee-4ca3-892f-52e3f1f33539 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:18.229277 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b69b8b56-6e9b-4858-9993-29eda835312b tempest-ServerRescueTestJSONUnderV235-49493203 tempest-ServerRescueTestJSONUnderV235-49493203-project] 10.222.0.113 "GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539" status: 404 len: 111 microversion: 2.1 time: 0.042654 Nov 02 13:22:18.229277 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1313/2408] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:18 2022] GET /compute/v2.1/servers/3ebc8a49-5bee-4ca3-892f-52e3f1f33539 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:18.321552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:18.330896 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ba77a00-92fc-4e83-91a4-7eb2ace1b286 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1383 microversion: 2.1 time: 0.276396 Nov 02 13:22:18.332065 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1096/2409] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:18 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1383 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:18.356243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e2e1a263-d636-411e-b83d-197b3d770cc1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '.version_select at 0x7fe786c6f700>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:18.360277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2e1a263-d636-411e-b83d-197b3d770cc1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:18.360777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2e1a263-d636-411e-b83d-197b3d770cc1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:18.361268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2e1a263-d636-411e-b83d-197b3d770cc1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.378962 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e2e1a263-d636-411e-b83d-197b3d770cc1 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 2731 microversion: 2.1 time: 0.026814 Nov 02 13:22:18.380038 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1314/2410] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 13:22:18 2022] GET /compute/v2.1/os-migrations => generated 2731 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:18.396100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dae0abf8-cc53-47ba-ad81-1210b7644ad6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:18.396719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dae0abf8-cc53-47ba-ad81-1210b7644ad6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:18.403204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dae0abf8-cc53-47ba-ad81-1210b7644ad6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:18.403691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dae0abf8-cc53-47ba-ad81-1210b7644ad6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:18.404593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dae0abf8-cc53-47ba-ad81-1210b7644ad6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.405518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dae0abf8-cc53-47ba-ad81-1210b7644ad6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:18.406145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dae0abf8-cc53-47ba-ad81-1210b7644ad6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:18.406765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dae0abf8-cc53-47ba-ad81-1210b7644ad6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.615022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:18.615926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:18.628798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:18.629499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:18.630133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.641227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:18.641995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:18.642616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:18.763525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:18.798360 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-21d7178b-f8cb-47fd-ac2b-f9abd4153144 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.187271 Nov 02 13:22:18.799389 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1315/2411] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:18 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:18.969648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1995025522", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:19.023868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:22:19.047140 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dae0abf8-cc53-47ba-ad81-1210b7644ad6 tempest-LiveMigrationTest-1592357682 tempest-LiveMigrationTest-1592357682-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1536 microversion: 2.1 time: 0.654586 Nov 02 13:22:19.047910 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1097/2412] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:18 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1536 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:19.085457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:19.086158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:19.093639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.094122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.094773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:19.095547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.096232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.096668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:19.379049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:19.388223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:19.390781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:19.392243 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-584fe71e-6773-4663-abf1-71192ce02930 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.312329 Nov 02 13:22:19.410178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:19.410178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:19.410178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:19.410178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:19.410178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:19.411521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.411521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.411521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:19.412265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.412937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.413104 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1098/2413] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:19 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:19.413721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:19.422587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:19.424078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:19.432020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.432517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.433304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:19.434042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.434502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.434932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:19.437476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Getting quotas for project a09bfd47abf24e90b9f9467161add600. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:19.444814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Getting quotas for user 840589ef49c84995a89cf2b2c33f3e45 and project a09bfd47abf24e90b9f9467161add600. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:19.460976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:22:19.463724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:22:19.467840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:19.524240 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6eecdabf-4569-4209-aa5a-1dab556e5f66 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.723660 Nov 02 13:22:19.526031 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1316/2414] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:22:18 2022] POST /compute/v2.1/servers => generated 382 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:22:19.545551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:19.546491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:19.570382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.571720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.572747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:19.575201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.578087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.580748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:19.591694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:19.641495 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-64efed6c-8142-496e-8207-44bb04326943 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "DELETE /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 204 len: 0 microversion: 2.1 time: 0.226933 Nov 02 13:22:19.642209 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1099/2415] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:22:19 2022] DELETE /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:22:19.650558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e8a7ea7-d147-4a31-b599-9b1df0b59c72 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:19.651408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8e8a7ea7-d147-4a31-b599-9b1df0b59c72 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:19.757602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8e8a7ea7-d147-4a31-b599-9b1df0b59c72 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:19.765954 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e8a7ea7-d147-4a31-b599-9b1df0b59c72 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1226 microversion: 2.1 time: 0.122170 Nov 02 13:22:19.767720 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1100/2416] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:19 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:19.781422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:19.782445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:19.800603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.801216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.801830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:19.802772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:19.804280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:19.804827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:20.069573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:20.078116 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16482c8d-e92c-4daf-ab06-ab86b2311c85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1524 microversion: 2.1 time: 0.550812 Nov 02 13:22:20.081741 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1317/2417] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:19 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1524 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:20.089081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:20.092418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:20.110359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:20.111245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:20.113749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:20.114523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:20.114998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:20.116842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:20.118602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:20.130316 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5faf05cd-11b6-4c2a-8ffb-d63df0bcab0c tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1389 microversion: 2.1 time: 0.357998 Nov 02 13:22:20.145410 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1101/2418] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:19 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1389 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:20.156831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-80362b28-d5b2-459e-8c58-e72cf2647969 req-2babb746-3f1d-432f-9a62-51d817c95778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2530d99-e7ea-486d-b401-f89aed63c82e", "name": "network-vif-plugged", "status": "completed", "tag": "fe4a5830-b144-45ec-8ce0-87d6e72d593f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:20.168238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:20.172807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-80362b28-d5b2-459e-8c58-e72cf2647969 req-2babb746-3f1d-432f-9a62-51d817c95778 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:20.173554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-80362b28-d5b2-459e-8c58-e72cf2647969 req-2babb746-3f1d-432f-9a62-51d817c95778 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:20.174530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-80362b28-d5b2-459e-8c58-e72cf2647969 req-2babb746-3f1d-432f-9a62-51d817c95778 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:20.194137 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-80362b28-d5b2-459e-8c58-e72cf2647969 req-2babb746-3f1d-432f-9a62-51d817c95778 service nova] Creating event network-vif-plugged:fe4a5830-b144-45ec-8ce0-87d6e72d593f for instance e2530d99-e7ea-486d-b401-f89aed63c82e on n-h1-858384-19 Nov 02 13:22:20.210992 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-80362b28-d5b2-459e-8c58-e72cf2647969 req-2babb746-3f1d-432f-9a62-51d817c95778 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064160 Nov 02 13:22:20.213634 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1102/2419] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:20.283258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:20.320341 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a45fcb2-9138-4fe4-9f5c-becdfb344fae tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.236598 Nov 02 13:22:20.327158 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1318/2420] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:20 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:20.427154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:20.428224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:20.438313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:20.438961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:20.439435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:20.440242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:20.440684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:20.441114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:20.790281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:20.791722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:20.804313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:20.805561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:20.807738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:20.809438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:20.814316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:20.816779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:20.817541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:20.819589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:20.827234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:20.828403 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f7c9153-89a2-4603-b5e8-d84a014375bf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.405796 Nov 02 13:22:20.833864 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1103/2421] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:20 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:21.004193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:21.017309 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-897f0d0f-3173-4483-94e8-1955a34e2bd3 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1222 microversion: 2.1 time: 0.230522 Nov 02 13:22:21.018655 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1319/2422] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:20 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1222 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:21.113969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:21.115163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:21.125920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:21.127757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:21.128488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:21.129313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:21.129854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:21.130364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:21.160940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:21.162378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:21.174480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:21.177060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:21.178602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:21.179866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:21.182819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:21.184560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:21.437042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:21.451138 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94547962-576c-46ab-9da9-f8567b0a6bca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1524 microversion: 2.1 time: 0.346187 Nov 02 13:22:21.456098 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1104/2423] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:21 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1524 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:21.460792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:21.461406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:21.478920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:21.479427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:21.479848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:21.481102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:21.481590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:21.481986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:21.483699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:21.495410 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a098249a-c879-4cb1-b7c9-86ac8f6979be tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1389 microversion: 2.1 time: 0.339539 Nov 02 13:22:21.499291 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1320/2424] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:21 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1389 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:21.804581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:21.841894 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-abeeb24d-79d0-4e2f-8e74-77cb76606653 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.384629 Nov 02 13:22:21.854795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:21.856758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:21.863837 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1105/2425] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:21 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:21.869436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:21.874919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:21.877928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:21.881731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:21.882312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:21.882782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:22.044394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:22.045043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:22.063032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:22.069022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:22.069326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:22.070498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:22.071223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:22.071864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:22.382471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:22.394264 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5afc2107-94ad-477a-b5e3-84ce4a4b71ef tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1296 microversion: 2.1 time: 0.354773 Nov 02 13:22:22.395324 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1106/2426] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:22 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1296 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:22.402621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-2346a938-5c8f-4ce2-8a90-1c50ee08f9f0 req-21872ca8-f28c-4eaa-becb-edfb6cd4ddb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679d27a4-cc40-4091-ae09-84372ff9baea", "name": "network-vif-unplugged", "status": "completed", "tag": "4b53cd9d-7baa-45af-9312-e0ba2d584523"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:22.410333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:22.427796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2346a938-5c8f-4ce2-8a90-1c50ee08f9f0 req-21872ca8-f28c-4eaa-becb-edfb6cd4ddb0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:22.429097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2346a938-5c8f-4ce2-8a90-1c50ee08f9f0 req-21872ca8-f28c-4eaa-becb-edfb6cd4ddb0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:22.430115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2346a938-5c8f-4ce2-8a90-1c50ee08f9f0 req-21872ca8-f28c-4eaa-becb-edfb6cd4ddb0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:22.436617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:22.439269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:22.444523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cbca482d-fde0-44d4-9c5a-cb2e7fec5b67 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1283 microversion: 2.25 time: 0.594424 Nov 02 13:22:22.445334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1321/2427] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:21 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1283 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:22.454205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-2346a938-5c8f-4ce2-8a90-1c50ee08f9f0 req-21872ca8-f28c-4eaa-becb-edfb6cd4ddb0 service nova] Creating event network-vif-unplugged:4b53cd9d-7baa-45af-9312-e0ba2d584523 for instance 679d27a4-cc40-4091-ae09-84372ff9baea on n-h2-858384-19 Nov 02 13:22:22.465116 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-2346a938-5c8f-4ce2-8a90-1c50ee08f9f0 req-21872ca8-f28c-4eaa-becb-edfb6cd4ddb0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067785 Nov 02 13:22:22.466418 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1107/2428] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:22.477821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:22.478441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:22.486279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:22.487049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:22.487723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:22.488633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:22.489255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:22.489848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:22.495809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:22.524977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:22.525950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:22.542396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:22.543731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:22.544194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:22.544937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:22.545396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:22.553320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:22.828890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:22.856728 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b831eaa4-4647-4d43-b8df-ff973a4a6df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1524 microversion: 2.1 time: 0.382770 Nov 02 13:22:22.857427 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1322/2429] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:22 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1524 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:22.904025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:22.905205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:22.923828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:22.924637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:22.925318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:22.926288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:22.927634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:22.928273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:23.141386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:23.169003 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4bd4cbac-c0a5-44bf-8deb-5f8bcbad1a73 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.271513 Nov 02 13:22:23.170223 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1323/2430] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:22 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:23.426408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:23.427239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:23.446439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:23.447350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:23.447981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:23.449810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:23.450526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:23.451190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:23.471561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:23.484308 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4492b49c-4dc2-49af-a090-e6c645d3baff tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1389 microversion: 2.1 time: 0.964282 Nov 02 13:22:23.485718 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1108/2431] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:22 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1389 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:23.501294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:23.503435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:23.514899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:23.515830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:23.516508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:23.517545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:23.518248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:23.519564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:23.560646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:23.569633 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47e0bfba-b047-4cba-b761-3a624ccec795 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1284 microversion: 2.1 time: 0.150150 Nov 02 13:22:23.583881 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1324/2432] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:23 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:23.823793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:23.832989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:23.834960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:23.836304 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e6e4e44f-b10b-4626-aad1-7a48ebeb5146 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1479 microversion: 2.25 time: 0.346832 Nov 02 13:22:23.837220 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1109/2433] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:23 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1479 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:23.863405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:23.864568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:23.871531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:23.872318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:23.872942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:23.873846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:23.874476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:23.875092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:23.881674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:23.882644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:23.900591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:23.901278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:23.902542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:23.913499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:23.915785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:23.916215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:24.137782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid e2530d99-e7ea-486d-b401-f89aed63c82e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:24.166818 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2ed39868-8e7f-408f-978b-976d1bcdacf8 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1973 microversion: 2.25 time: 0.307034 Nov 02 13:22:24.172650 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1325/2434] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:23 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1973 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:24.194965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7d709f28-9f70-4d22-bcbb-b83b0fb2a464 req-fc758039-0197-4558-9025-60594adca42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b7b1a4-c1d8-419d-81c2-24577c4a6269", "name": "network-vif-deleted", "tag": "44616a73-0087-4079-9a75-1d953925b087"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:24.217141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7d709f28-9f70-4d22-bcbb-b83b0fb2a464 req-fc758039-0197-4558-9025-60594adca42c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:24.217724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7d709f28-9f70-4d22-bcbb-b83b0fb2a464 req-fc758039-0197-4558-9025-60594adca42c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:24.219917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7d709f28-9f70-4d22-bcbb-b83b0fb2a464 req-fc758039-0197-4558-9025-60594adca42c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:24.256239 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7d709f28-9f70-4d22-bcbb-b83b0fb2a464 req-fc758039-0197-4558-9025-60594adca42c service nova] Creating event network-vif-deleted:44616a73-0087-4079-9a75-1d953925b087 for instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 on n-h2-858384-19 Nov 02 13:22:24.267236 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7d709f28-9f70-4d22-bcbb-b83b0fb2a464 req-fc758039-0197-4558-9025-60594adca42c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081302 Nov 02 13:22:24.268227 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1326/2435] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:22:24.295091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:24.296314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:24.316785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:24.317285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:24.317939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:24.318882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:24.319702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:24.320532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:24.419989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=5 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:24.648438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid e2530d99-e7ea-486d-b401-f89aed63c82e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:24.665286 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be71b9e2-c2a7-4f48-9705-72061f4149e1 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1973 microversion: 2.25 time: 0.393885 Nov 02 13:22:24.676314 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1327/2436] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:24 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1973 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:24.687097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:24.700991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:24.701617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:24.708810 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc8f10a2-8d38-4594-861a-c0c788e011a1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1524 microversion: 2.1 time: 0.830770 Nov 02 13:22:24.712549 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1110/2437] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:23 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1524 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:24.747503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:24.748123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:24.753519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:24.754273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:24.756486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:24.757433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:24.759673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:24.760315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:24.780659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:24.781176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:24.788272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:24.790224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:24.795840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:24.798744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:24.990426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:25.000609 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9275af50-9ead-43b0-a1ba-8f5c805ced9d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1187 microversion: 2.1 time: 0.262979 Nov 02 13:22:25.017171 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1111/2438] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:24 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1187 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:25.022392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-72e6d7d8-a780-43dd-a8f3-2ca29c2af7aa req-34088276-71f7-4be3-b868-b36870f782eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679d27a4-cc40-4091-ae09-84372ff9baea", "name": "network-vif-plugged", "status": "completed", "tag": "4b53cd9d-7baa-45af-9312-e0ba2d584523"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:25.026520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:25.042820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-72e6d7d8-a780-43dd-a8f3-2ca29c2af7aa req-34088276-71f7-4be3-b868-b36870f782eb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:25.044363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-72e6d7d8-a780-43dd-a8f3-2ca29c2af7aa req-34088276-71f7-4be3-b868-b36870f782eb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:25.047463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-72e6d7d8-a780-43dd-a8f3-2ca29c2af7aa req-34088276-71f7-4be3-b868-b36870f782eb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:25.069913 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-72e6d7d8-a780-43dd-a8f3-2ca29c2af7aa req-34088276-71f7-4be3-b868-b36870f782eb service nova] Creating event network-vif-plugged:4b53cd9d-7baa-45af-9312-e0ba2d584523 for instance 679d27a4-cc40-4091-ae09-84372ff9baea on n-h2-858384-19 Nov 02 13:22:25.081504 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-40a7136a-4c1b-4976-9844-ded722e5df4a tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.402368 Nov 02 13:22:25.085411 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1328/2439] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:24 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:25.114632 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-72e6d7d8-a780-43dd-a8f3-2ca29c2af7aa req-34088276-71f7-4be3-b868-b36870f782eb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095845 Nov 02 13:22:25.123095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:25.126546 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1112/2440] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:25.127955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:25.137044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc7806e2-b4ac-45ed-b8bb-0dbe7a184707 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:25.148673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:25.149184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:25.149632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:25.150351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:25.151017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7806e2-b4ac-45ed-b8bb-0dbe7a184707 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:25.153403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:25.153877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:25.154463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7806e2-b4ac-45ed-b8bb-0dbe7a184707 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:25.155173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7806e2-b4ac-45ed-b8bb-0dbe7a184707 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:25.156540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7806e2-b4ac-45ed-b8bb-0dbe7a184707 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:25.159145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7806e2-b4ac-45ed-b8bb-0dbe7a184707 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:25.160032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7806e2-b4ac-45ed-b8bb-0dbe7a184707 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:25.241468 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc7806e2-b4ac-45ed-b8bb-0dbe7a184707 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.113187 Nov 02 13:22:25.243709 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1113/2441] 10.222.0.113 () {60 vars in 1222 bytes} [Wed Nov 2 13:22:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:22:25.259170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-19", "block_migration": "auto"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:25.266540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:25.277677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:25.279187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:25.279756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:25.281290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:25.281290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:25.281867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:25.362727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'flavor' on Instance uuid e2530d99-e7ea-486d-b401-f89aed63c82e {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:25.385812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Going to try to live migrate instance to n-h2-858384-19 {{(pid=120929) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:22:25.594058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:25.605705 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d76d712-cbdc-4967-abc1-640597773419 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.515699 Nov 02 13:22:25.613904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1329/2442] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:25 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:25.927076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39f583e5-e421-435a-a1f4-5b2312da4a67 tempest-AbsoluteLimitsTestJSON-830423769 tempest-AbsoluteLimitsTestJSON-830423769-project] Calling method '.version_select at 0x7fe786e41670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:25.954728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39f583e5-e421-435a-a1f4-5b2312da4a67 tempest-AbsoluteLimitsTestJSON-830423769 tempest-AbsoluteLimitsTestJSON-830423769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:25.955493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39f583e5-e421-435a-a1f4-5b2312da4a67 tempest-AbsoluteLimitsTestJSON-830423769 tempest-AbsoluteLimitsTestJSON-830423769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:25.956109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39f583e5-e421-435a-a1f4-5b2312da4a67 tempest-AbsoluteLimitsTestJSON-830423769 tempest-AbsoluteLimitsTestJSON-830423769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:25.957461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39f583e5-e421-435a-a1f4-5b2312da4a67 tempest-AbsoluteLimitsTestJSON-830423769 tempest-AbsoluteLimitsTestJSON-830423769-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:25.959711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39f583e5-e421-435a-a1f4-5b2312da4a67 tempest-AbsoluteLimitsTestJSON-830423769 tempest-AbsoluteLimitsTestJSON-830423769-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:25.960354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39f583e5-e421-435a-a1f4-5b2312da4a67 tempest-AbsoluteLimitsTestJSON-830423769 tempest-AbsoluteLimitsTestJSON-830423769-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.006346 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39f583e5-e421-435a-a1f4-5b2312da4a67 tempest-AbsoluteLimitsTestJSON-830423769 tempest-AbsoluteLimitsTestJSON-830423769-project] 10.222.0.113 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.390723 Nov 02 13:22:26.008974 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1330/2443] 10.222.0.113 () {58 vars in 1127 bytes} [Wed Nov 2 13:22:25 2022] GET /compute/v2.1/limits => generated 511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:26.014771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:26.015636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:26.025093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.025792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.026502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.028137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.034131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.036394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.376318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:26.401112 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-470924c8-042a-479d-8112-2b0a3b16fe29 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1524 microversion: 2.1 time: 0.389345 Nov 02 13:22:26.404509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1331/2444] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:26 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1524 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:26.413727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:26.415002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:26.423738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.424732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.425431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.426414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.438291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.440224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.534387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:26.545086 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e75de56-82fd-43fd-9208-ca9b0c32c1a0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1187 microversion: 2.1 time: 0.138339 Nov 02 13:22:26.546153 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1332/2445] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:26 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1187 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:26.560340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:26.561200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:26.567892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.568592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.569294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.570166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.570830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.571457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.695032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:26.723342 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-839ebc03-bf9a-4b43-8893-8c0eb663d8b3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.175907 Nov 02 13:22:26.724428 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1333/2446] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:26 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:26.731600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5d53f5c3-896a-44d9-aca6-751784a62e8d req-573c72ab-a005-4494-9984-dc9a215e080d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49efb73e-85c5-419b-8ff0-9e1acd3921af", "tag": "95fee841-9ace-4f66-9aa6-6c27f8f4632c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:26.743226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5d53f5c3-896a-44d9-aca6-751784a62e8d req-573c72ab-a005-4494-9984-dc9a215e080d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.743673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5d53f5c3-896a-44d9-aca6-751784a62e8d req-573c72ab-a005-4494-9984-dc9a215e080d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.744323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5d53f5c3-896a-44d9-aca6-751784a62e8d req-573c72ab-a005-4494-9984-dc9a215e080d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.759458 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5d53f5c3-896a-44d9-aca6-751784a62e8d req-573c72ab-a005-4494-9984-dc9a215e080d service nova] Creating event network-changed:95fee841-9ace-4f66-9aa6-6c27f8f4632c for instance 49efb73e-85c5-419b-8ff0-9e1acd3921af on n-h2-858384-19 Nov 02 13:22:26.766125 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5d53f5c3-896a-44d9-aca6-751784a62e8d req-573c72ab-a005-4494-9984-dc9a215e080d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040302 Nov 02 13:22:26.767034 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1334/2447] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:26.773565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:26.774265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:26.781665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.782164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.782598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:26.783552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:26.784180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:26.784609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:27.127630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:27.144125 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9db7f8e4-fa84-481e-bf01-0f964f196139 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.374436 Nov 02 13:22:27.144125 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1335/2448] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:26 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:27.426936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:27.427783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:27.441683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:27.442602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:27.443278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:27.444460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:27.445386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:27.446026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.018997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:28.029743 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0cc3e879-1004-4787-b90d-5e20672dea97 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1509 microversion: 2.1 time: 0.608029 Nov 02 13:22:28.044275 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1336/2449] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:27 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1509 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:28.053601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:28.054230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:28.061038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.061791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.061948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.062837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.063484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.064096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.069033 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-690a754d-61a3-4ebe-9c84-f46032b62fe9 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e/action" status: 202 len: 0 microversion: 2.25 time: 2.814963 Nov 02 13:22:28.071742 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1114/2450] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:22:25 2022] POST /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e/action => generated 0 bytes in 2818 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:22:28.082293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:28.087588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:28.106868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.107759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.108531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.109538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.110167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.110759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.164392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:28.175550 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-789c62c7-0620-4ce2-b8a4-f5065e2a214b tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1187 microversion: 2.1 time: 0.129927 Nov 02 13:22:28.176237 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1337/2451] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:28 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1187 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:28.184523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:28.185490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:28.192602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.193431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.194167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.195251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.195944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.196611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.228344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:28.253407 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c419384b-2237-4852-aa2e-3f34f2f92030 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.180045 Nov 02 13:22:28.254140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1115/2452] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:28 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:28.259926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:28.260544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:28.267844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.268694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.269340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.271059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.271848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.272452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.388502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:28.399771 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b0c7039-0a1a-4982-b34c-30d42f9ebbd5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 200 len: 1509 microversion: 2.1 time: 0.222105 Nov 02 13:22:28.400370 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1338/2453] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:28 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:28.486607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:28.498700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:28.500251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:28.501782 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-709ab1bc-870c-48d5-ba62-bba0034e38df tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.246358 Nov 02 13:22:28.502314 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1116/2454] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:28 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:28.507180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:28.507567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:28.524683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.525546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.528366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.529657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.530578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.531256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.539641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:28.731725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:28.741614 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2ad8b1ee-9652-4abf-896a-dab41977fb4d tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.238274 Nov 02 13:22:28.755482 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1117/2455] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:28 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:28.759622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-468885318", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": "none"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:28.771465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:28.772298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:28.779759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.781102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.783678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.784954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.785448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.786008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.817644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:28.826311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:28.826746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:28.827729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:28.828200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:28.828623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:28.842760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.843605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.844381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.845605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:28.846273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:28.846902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:28.859437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:28.876837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Getting quotas for project eba590922db34f0ea123d02c6a5f941a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:28.888705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Getting quotas for user b74e791b27834967907219a598d774c6 and project eba590922db34f0ea123d02c6a5f941a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:28.913460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:22:28.917050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:22:28.935470 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c11759e5-27b4-4b44-be4f-97b6e375e34a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "DELETE /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 204 len: 0 microversion: 2.1 time: 0.177672 Nov 02 13:22:28.936478 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1118/2456] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:22:28 2022] DELETE /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:22:28.971882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:28.998409 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34bb4fb9-f7bb-4047-9f2b-ddfcb23f4d60 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.54 time: 0.596694 Nov 02 13:22:28.999758 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1339/2457] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:22:28 2022] POST /compute/v2.1/servers => generated 382 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:22:29.012515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62345045-2958-403c-95d2-f5892eb3559e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:29.013616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-62345045-2958-403c-95d2-f5892eb3559e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:29.095979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1818158270", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "ab09ad8a-83ac-42f7-97d8-5ec799a5bcc6"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:29.125333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-62345045-2958-403c-95d2-f5892eb3559e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:29.141266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-62345045-2958-403c-95d2-f5892eb3559e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:29.145203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-62345045-2958-403c-95d2-f5892eb3559e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:29.151258 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62345045-2958-403c-95d2-f5892eb3559e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1280 microversion: 2.54 time: 0.139811 Nov 02 13:22:29.152507 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1119/2458] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:29 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1280 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:29.157319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] validate_networks() for [('ab09ad8a-83ac-42f7-97d8-5ec799a5bcc6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:22:29.201614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:29.202435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:29.210836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.212339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.213018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.214322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.214968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.215659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.314644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:29.323354 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-074f5b08-38d9-4f6d-99d1-263363ece81d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1187 microversion: 2.1 time: 0.126074 Nov 02 13:22:29.324680 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1120/2459] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:29 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1187 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:29.330444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:29.331388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:29.338332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.339358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.340737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.342077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.343551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.344376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.439242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:29.469625 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c9e8d7e7-1864-4d38-a0f5-d3444b123fd0 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.142864 Nov 02 13:22:29.471733 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1121/2460] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:29 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:29.531270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:29.531928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:29.543755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.544434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.545512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.556734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.557638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.558354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.811507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:29.820376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:29.822053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:29.823250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-740c1d6c-a13a-4970-9dad-6cb7b3d770de tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.297945 Nov 02 13:22:29.824057 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1122/2461] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:29 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:29.828954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:29.829973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:29.836500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.837226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.837915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.840136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.841000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.841665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.977541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:29.977964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:29.978425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:29.978849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:29.979271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:29.989993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.990734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.991371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:29.992292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:29.992904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:29.993666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:30.006828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:30.018631 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5927c14f-b911-4d7f-bb6c-ee71b7ca3939 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.191171 Nov 02 13:22:30.019624 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1123/2462] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:29 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:30.040912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Getting quotas for project 64d1e36587404641ac2dcc993e860a3c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:30.051204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Getting quotas for user 8512848478ff4d6ea55d926bb887fa65 and project 64d1e36587404641ac2dcc993e860a3c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:30.069524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:22:30.072452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:22:30.140749 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a22810fd-e705-4152-8392-c77bfe6a0d54 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.048296 Nov 02 13:22:30.143327 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1340/2463] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:22:29 2022] POST /compute/v2.1/servers => generated 382 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:22:30.155989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5d3083d-1eb1-4b82-9c5e-5743e1cf5165 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:30.156609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f5d3083d-1eb1-4b82-9c5e-5743e1cf5165 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:30.177944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:30.178622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:30.192718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:30.193644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:30.196940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:30.199902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:30.201876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:30.202376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:30.302954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5d3083d-1eb1-4b82-9c5e-5743e1cf5165 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:30.315444 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5d3083d-1eb1-4b82-9c5e-5743e1cf5165 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1222 microversion: 2.1 time: 0.164971 Nov 02 13:22:30.320820 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1124/2464] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:30 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:30.349470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:30.351784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:30.366928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:30.367873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:30.371731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:30.373142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:30.374056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:30.375639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:30.418382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:30.429162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:30.430839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:30.432163 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bec94651-189e-4159-9d3a-1268f1b3efba tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1284 microversion: 2.54 time: 0.258393 Nov 02 13:22:30.440571 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1341/2465] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:30 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:30.505305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:30.507013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:30.515561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:30.516610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:30.517435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:30.518460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:30.519714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:30.520438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:30.549411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:30.560400 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc77b03a-7522-401f-9e11-b761b4133d7f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1187 microversion: 2.1 time: 0.217049 Nov 02 13:22:30.566853 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1125/2466] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:30 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1187 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:30.629142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:30.650234 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45e9ad15-d897-4c9c-b021-8da64f4a2af6 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.149617 Nov 02 13:22:30.650838 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1342/2467] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:30 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:30.853377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:30.854045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:30.867870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:30.872000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:30.872847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:30.875538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:30.876634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:30.877335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.043796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:31.044692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:31.064682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.067334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.067802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.072372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.072884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.073349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.345901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:31.358050 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aeff2ada-8dd3-4cb2-841e-a87aeeac2b45 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.318528 Nov 02 13:22:31.360601 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1343/2468] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:31 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:31.371555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:31.373011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:31.388170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.388734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.389312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.390191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.390644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.391083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.664257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:31.676798 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-690f2207-4472-4044-8c3f-3c2b6b04ca49 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1226 microversion: 2.1 time: 0.314087 Nov 02 13:22:31.678298 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1344/2469] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:31 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1226 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:31.685573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:31.689049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:31.709792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.712099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.712575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.714751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.716339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.716800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.797976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:31.812238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:31.814068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:31.815370 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-09379717-d994-44bd-a88f-903fc5bbfb7f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.966962 Nov 02 13:22:31.833165 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1126/2470] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:30 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:31.867181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:31.874127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:31.887539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.888798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.889592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.890658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.891011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:31.891652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:31.892445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:31.914730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:31.924456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:31.925667 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45279cd8-faac-48a8-9ba0-adccc56f9e6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1276 microversion: 2.54 time: 0.244617 Nov 02 13:22:31.926254 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1345/2471] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:31 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:31.967758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:31.969575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:31.996345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:31.999205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:32.000014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:32.002589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:32.002945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:32.003452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:32.003933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lazy-loading 'fault' on Instance uuid 20b7b1a4-c1d8-419d-81c2-24577c4a6269 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:32.004326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:32.006800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:32.009092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:32.162790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:32.214970 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89c7fbdc-0d38-4cc5-ada5-843e36ba954d tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1932 microversion: 2.75 time: 0.286216 Nov 02 13:22:32.215689 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1346/2472] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:31 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1932 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:32.381903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:32.382546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:32.397659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:32.398466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:32.398696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:32.399459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:32.399921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:32.400356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.041274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.063633 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74540f68-4ace-4d7f-b3a4-0162c264cb0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.684689 Nov 02 13:22:33.076898 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1347/2473] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:32 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:33.089025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.099256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:33.099879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:33.101410 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e4d6b09-1fe2-4429-bfcc-657c66067996 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 200 len: 1192 microversion: 2.1 time: 1.265891 Nov 02 13:22:33.111682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1127/2474] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:31 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 1192 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:33.131952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:33.132386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:33.133815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.139501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:33.139745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:33.140828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:33.153909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:33.156686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.157433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:33.158230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:33.159885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.162410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:33.163271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:33.164175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.326273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.350244 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-695b1804-364f-4421-9cf5-582415cb43a4 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1218 microversion: 2.1 time: 0.266738 Nov 02 13:22:33.356891 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1348/2475] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:33 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:33.378082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:33.381718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:33.389105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:33.389682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:33.390580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.391137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:33.391921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:33.392403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.491069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.507603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.508544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.509925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4db84a3d-cecc-4393-859d-89e7c7644e47 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1332 microversion: 2.54 time: 0.151182 Nov 02 13:22:33.510587 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1349/2476] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:33 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1332 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:33.527348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7ee9305f-a091-481c-93fa-926878220fb4 req-2ceff7aa-ea9f-44f3-9731-17a07ce8dc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679d27a4-cc40-4091-ae09-84372ff9baea", "name": "network-vif-deleted", "tag": "4b53cd9d-7baa-45af-9312-e0ba2d584523"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:33.540166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7ee9305f-a091-481c-93fa-926878220fb4 req-2ceff7aa-ea9f-44f3-9731-17a07ce8dc10 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:33.540773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7ee9305f-a091-481c-93fa-926878220fb4 req-2ceff7aa-ea9f-44f3-9731-17a07ce8dc10 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:33.541317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7ee9305f-a091-481c-93fa-926878220fb4 req-2ceff7aa-ea9f-44f3-9731-17a07ce8dc10 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.581678 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7ee9305f-a091-481c-93fa-926878220fb4 req-2ceff7aa-ea9f-44f3-9731-17a07ce8dc10 service nova] Creating event network-vif-deleted:4b53cd9d-7baa-45af-9312-e0ba2d584523 for instance 679d27a4-cc40-4091-ae09-84372ff9baea on n-h2-858384-19 Nov 02 13:22:33.596547 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7ee9305f-a091-481c-93fa-926878220fb4 req-2ceff7aa-ea9f-44f3-9731-17a07ce8dc10 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084883 Nov 02 13:22:33.597813 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1350/2477] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:33.614947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:33.620069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:33.631656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:33.634824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:33.635606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.637246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:33.638209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:33.639617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:33.785780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:33.842290 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-30f7e97a-dc4d-4e6c-bdd3-fe489c2a930f tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1938 microversion: 2.75 time: 0.238548 Nov 02 13:22:33.853962 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1351/2478] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:33 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1938 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:33.880322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.892959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.900686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:33.903879 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe3ace4d-c59b-4309-8d27-67203f382bae tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.775224 Nov 02 13:22:33.905920 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1128/2479] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:33 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:34.094258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:34.095042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:34.110894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.111496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.112891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.114570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.115949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.117188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.130454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:34.131547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 20b7b1a4-c1d8-419d-81c2-24577c4a6269] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:34.142611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.146815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.148139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.149493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.151057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.154772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.208229 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] HTTP exception thrown: Instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 could not be found. Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Request method failure captured: Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 HTTP/1.1 Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0ZVeR7l59VgYfTuPmGoNwXlnTzUi5gTPV7amlO4g0iKLNdzbiDKhb0WDUMbUS430dmoRNS8hqS33LuvUfaJYQh3xsP6W8LhYMkz_r0OZfOvhdPELXnMx0Yi7Sx1C8wlxtO_nb7yzG6OzSamzNQkugrf4Hb9obUWcivgRacgh7q58k Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 4d6fe1d935f34654baaeb1c8b48dda38 Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-LiveMigrationTest-49999660 Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:22:34.216185 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-LiveMigrationTest-49999660 Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 4d6fe1d935f34654baaeb1c8b48dda38 Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-LiveMigrationTest-49999660 Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-LiveMigrationTest-49999660-project Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 392d81e9a1c74430a325c9ecc1dcfb44 Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-LiveMigrationTest-49999660-project Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 could not be found. Nov 02 13:22:34.218425 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '20b7b1a4-c1d8-419d-81c2-24577c4a6269'} Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 could not be found. Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:34.219799 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 could not be found. Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 could not be found. Nov 02 13:22:34.223695 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:34.228351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Returning 404 to user: Instance 20b7b1a4-c1d8-419d-81c2-24577c4a6269 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:34.230195 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2d0195b8-4976-4c8f-bc51-8f56fd954185 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269" status: 404 len: 111 microversion: 2.1 time: 0.104520 Nov 02 13:22:34.231748 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1129/2480] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:34 2022] GET /compute/v2.1/servers/20b7b1a4-c1d8-419d-81c2-24577c4a6269 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:34.395798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:34.407223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:34.450839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.453406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.454518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.458180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.460544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.468876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.715276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:34.735805 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-52b608f5-5103-4340-8dd9-d77707b01355 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1274 microversion: 2.1 time: 0.356223 Nov 02 13:22:34.737173 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1130/2481] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:34 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1274 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:34.763225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:34.767662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:34.780776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:34.782933 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34b35022-6d8c-4c98-a9da-ba552fa38b46 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.691873 Nov 02 13:22:34.783862 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1352/2482] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:34 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:34.808935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.811060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.812981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.817288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.818005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.820777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.874364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:34.874918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:34.886993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.887516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.887966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:34.888689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:34.889153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:34.907973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:35.178648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:35.219303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:35.224176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:35.234489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:35.237782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:35.243204 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c767028f-bef2-4c74-9132-b02a902b4396 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1338 microversion: 2.54 time: 0.504017 Nov 02 13:22:35.247928 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1131/2483] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:34 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1338 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:35.265742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:35.266922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:35.272302 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3a3b2a92-d4f1-4429-af66-a3fae0d8c5e1 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1938 microversion: 2.75 time: 0.403307 Nov 02 13:22:35.272915 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1353/2484] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:34 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1938 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:35.280902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:35.282773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:35.283335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9d78aa41-b6f2-4e47-a54c-5896ecaa6520 req-9014d7b1-2580-4073-91e6-0eecff18e2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49efb73e-85c5-419b-8ff0-9e1acd3921af", "name": "network-vif-plugged", "status": "completed", "tag": "95fee841-9ace-4f66-9aa6-6c27f8f4632c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:35.286980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:35.288224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:35.288967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:35.289646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:35.305905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9d78aa41-b6f2-4e47-a54c-5896ecaa6520 req-9014d7b1-2580-4073-91e6-0eecff18e2ab service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:35.306602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9d78aa41-b6f2-4e47-a54c-5896ecaa6520 req-9014d7b1-2580-4073-91e6-0eecff18e2ab service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:35.307269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9d78aa41-b6f2-4e47-a54c-5896ecaa6520 req-9014d7b1-2580-4073-91e6-0eecff18e2ab service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:35.332216 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9d78aa41-b6f2-4e47-a54c-5896ecaa6520 req-9014d7b1-2580-4073-91e6-0eecff18e2ab service nova] Creating event network-vif-plugged:95fee841-9ace-4f66-9aa6-6c27f8f4632c for instance 49efb73e-85c5-419b-8ff0-9e1acd3921af on n-h2-858384-19 Nov 02 13:22:35.349938 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9d78aa41-b6f2-4e47-a54c-5896ecaa6520 req-9014d7b1-2580-4073-91e6-0eecff18e2ab service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075407 Nov 02 13:22:35.351034 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1354/2485] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:35.612302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:35.626010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:35.627531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:35.640976 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-26e4aef9-8ddd-4c9f-8180-2f95a69565e5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.391611 Nov 02 13:22:35.641571 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1132/2486] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:35 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:35.764105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:35.764823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:35.777233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:35.781086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:35.781744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:35.782662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:35.785278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:35.785944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:35.814195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:35.815305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:35.826576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:35.831028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:35.831780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:35.832731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:35.833375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:35.833993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:36.019042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:36.033836 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-799e1a73-cff0-4e57-b997-3b20f1bfd067 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1282 microversion: 2.1 time: 0.274746 Nov 02 13:22:36.041708 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1355/2487] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:35 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:36.052728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:36.066705 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5351b76-1e19-42e9-b404-51ee995070ad tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.261111 Nov 02 13:22:36.067926 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1133/2488] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:35 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:36.286482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:36.287539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:36.297745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:36.298749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:36.299482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:36.301872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:36.302738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:36.303575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:36.309686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:36.310315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:36.323089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:36.324487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:36.325142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:36.327258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:36.329328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:36.329958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:36.333140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:36.454156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:36.472580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:36.474392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:36.480324 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d311402c-6377-407d-b242-702aea549c11 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1338 microversion: 2.54 time: 0.196529 Nov 02 13:22:36.488717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:36.502522 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1356/2489] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:36 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1338 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:36.534082 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0dbd5513-0107-4c42-b318-b49bd46f7acb tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1938 microversion: 2.75 time: 0.230928 Nov 02 13:22:36.536903 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1134/2490] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:36 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1938 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:36.674985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:36.675796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:36.685310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:36.686111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:36.686664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:36.687635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:36.688220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:36.688760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:36.697204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:36.945028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:36.961018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:36.966588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:36.985833 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2e4d7da-7272-46f4-ba8e-f0737bf4eef2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.319760 Nov 02 13:22:36.988341 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1357/2491] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:36 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:36.992090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:36.992716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:36.999932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.000422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.000863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.001577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.002151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.002584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.066071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:37.066484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:37.074520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.075690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.076394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.077511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.078189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.079081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.306751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:37.319571 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-55bc8f38-5904-4848-a2b5-946474cd3cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.331487 Nov 02 13:22:37.321137 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1135/2492] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:36 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:37.330347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:37.332464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:37.350779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.353895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.355869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.356877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.359705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.360374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.381555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:37.395533 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-49c7a4cc-929a-4f47-9ea0-f6dd302d5b67 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1282 microversion: 2.1 time: 0.334095 Nov 02 13:22:37.415388 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1358/2493] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:37 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1282 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:37.440621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:37.442482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:37.456828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.461489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.462284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.463408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.464619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.467007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.659321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:37.669584 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4feda7c6-b171-4475-ab6b-e0df531e7887 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.347167 Nov 02 13:22:37.674258 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1136/2494] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:37 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:37.680374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:37.681379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:37.704596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.708282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.708948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.710960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.711589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.712324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.748041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:37.771465 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b781b524-a760-47a5-9e89-0b450df8e8d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.354677 Nov 02 13:22:37.779899 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1359/2495] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:37 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:37.794799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:37.799806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:37.825067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.825876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.829634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:37.830728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:37.843020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:37.843897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.149025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:38.160297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:38.174402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:38.179081 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9f6c675-03c6-4566-af56-026be1588f36 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1338 microversion: 2.54 time: 0.502406 Nov 02 13:22:38.182292 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1137/2496] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:37 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1338 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:38.204508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:38.205141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:38.222057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.222556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.224497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.225262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.229560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.230439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.415171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] Lazy-loading 'services' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:38.507519 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-911afdd4-a3d7-4364-b0bf-ead432b026c3 tempest-ServersAdmin275Test-1118919544 tempest-ServersAdmin275Test-1118919544-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1923 microversion: 2.75 time: 0.722950 Nov 02 13:22:38.508503 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1360/2497] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:37 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1923 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:38.514159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:38.519470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:38.532421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.544249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.545514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.546462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.547103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.547760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.665320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:38.679215 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce1e14d4-0142-4ac6-8607-1550b97c0992 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.493971 Nov 02 13:22:38.704916 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1138/2498] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:38 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:38.713376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:38.714485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:38.730639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.731411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.731869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.732619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.733087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.733520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.893986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:38.909931 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-becaa095-6715-4fb4-827a-eeae1d0f64cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1280 microversion: 2.1 time: 0.203715 Nov 02 13:22:38.910441 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1139/2499] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:38 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:38.929941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:38.930452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:38.938463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:38.944151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.946200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.947139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:38.951176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:38.955059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:38.957158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:39.036957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:39.037871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:39.051228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:39.056076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:39.060940 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a6b33ae-8b3a-447f-be47-f69833dea75c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.550596 Nov 02 13:22:39.064306 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1361/2500] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:38 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:39.075915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:39.079336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:39.093851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:39.094361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:39.100764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:39.101682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:39.102183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:39.102642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:39.202327 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6252753b-288b-4c3e-a5c7-6b23cb7fe641 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 204 len: 0 microversion: 2.75 time: 0.288912 Nov 02 13:22:39.203409 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1140/2501] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:22:38 2022] DELETE /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:22:39.214623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe17264e-9bd5-4208-82bb-1b7c9eae36ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-971191361"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:39.218126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe17264e-9bd5-4208-82bb-1b7c9eae36ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:39.236362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe17264e-9bd5-4208-82bb-1b7c9eae36ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:39.240077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe17264e-9bd5-4208-82bb-1b7c9eae36ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:39.247635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe17264e-9bd5-4208-82bb-1b7c9eae36ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:39.248838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe17264e-9bd5-4208-82bb-1b7c9eae36ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:39.249696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe17264e-9bd5-4208-82bb-1b7c9eae36ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:39.250139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe17264e-9bd5-4208-82bb-1b7c9eae36ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:39.722483 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe17264e-9bd5-4208-82bb-1b7c9eae36ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.516967 Nov 02 13:22:39.727410 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1141/2502] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:22:39 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 457 bytes (1 switches on core 0) Nov 02 13:22:39.741303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:39.743921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:39.761459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:39.762516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:39.763866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:39.765125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:39.769868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:39.772128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:39.921359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:39.955998 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-332f317d-bfaf-4b29-853b-8a8f4689ff59 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.887934 Nov 02 13:22:39.967583 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1362/2503] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:39 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:39.979658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:39.980269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:39.981185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:40.009066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:40.010570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:40.018531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:40.021820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.022320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.023449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.023568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.023935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.024364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.037050 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83268f78-24ad-45ed-ba5a-7127012857fa tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1446 microversion: 2.75 time: 0.304535 Nov 02 13:22:40.037660 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1142/2504] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:39 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1446 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:40.055860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:40.056496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:40.081012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.083035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.083760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.084846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.085571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.086181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.114001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=30 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:40.311594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=22 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:40.332258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:40.342656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:40.348782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:40.350006 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-454ea448-fc46-4672-bd6d-964d837d3cd7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1359 microversion: 2.54 time: 0.376251 Nov 02 13:22:40.350583 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1363/2505] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:39 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1359 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:40.371634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:40.371937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:40.371937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:40.381898 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7644549d-f8ac-4439-bdaf-eba8b8ebc3cc tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1322 microversion: 2.1 time: 0.338826 Nov 02 13:22:40.381898 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1143/2506] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:40 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:40.387570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:40.392042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:40.398621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.399184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.400090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.400831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.402650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.403090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.405457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.408261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.408834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.409691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.412617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.413186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.523343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:40.676919 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-effdba56-78eb-4920-8838-1b416cb904fb tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 204 len: 0 microversion: 2.1 time: 0.295711 Nov 02 13:22:40.686544 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1144/2507] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:22:40 2022] DELETE /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:22:40.693201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eddfe3e6-0b85-4f01-87c6-a55d42c110b3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Action: 'create', calling method: .version_select at 0x7fe78f8dfdc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-244583278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT9e19o5xJsgV97OvvyS2jXlxKwrppQ8QM+QNZ0ONVibTdEqLoFKBbOXcvaTf/au1vCV1egrPQFojktKFiVJaKw2OanG3frvEAE1+NBGBQIPeO/jWoz407L3ZmJf485ZA=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:40.737775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-eddfe3e6-0b85-4f01-87c6-a55d42c110b3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Getting quotas for project eba590922db34f0ea123d02c6a5f941a. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:40.746047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-eddfe3e6-0b85-4f01-87c6-a55d42c110b3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Getting quotas for user b74e791b27834967907219a598d774c6 and project eba590922db34f0ea123d02c6a5f941a. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:40.803358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eddfe3e6-0b85-4f01-87c6-a55d42c110b3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.114770 Nov 02 13:22:40.804626 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1145/2508] 10.222.0.113 () {62 vars in 1205 bytes} [Wed Nov 2 13:22:40 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:22:40.815644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:40.818947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:40.836540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.837302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.838924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:40.840449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:40.842808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:40.843580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.174738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:41.189393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:41.193367 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe1758d2-a1a9-45a8-88e1-8b20395f92dc tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1670 microversion: 2.1 time: 0.382508 Nov 02 13:22:41.217940 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1146/2509] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:40 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1670 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:41.227076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-244583278", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:41.232110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:41.243050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.243973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.247723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.248761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.249898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.250938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.281669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:41.291808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:41.293942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:41.295314 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8a98a58-2aad-491b-b403-00adafb55e36 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.943736 Nov 02 13:22:41.332824 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1364/2510] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:40 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:41.340522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:41.347412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:41.366729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.369535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.371501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.372503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.374807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.375532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.434457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:41.435621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:41.437426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:41.439295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:41.441019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:41.609964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:41.618947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.619475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.620978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.630686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.631365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.631675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.708123 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-017ba5cd-e024-4f4f-a906-458b44e4ef25 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "POST /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59/action" status: 202 len: 1141 microversion: 2.54 time: 0.487874 Nov 02 13:22:41.729931 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1147/2511] 10.222.0.113 () {62 vars in 1325 bytes} [Wed Nov 2 13:22:41 2022] POST /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59/action => generated 1141 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Nov 02 13:22:41.736062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:41.737042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:41.759009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.760367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.761088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.763856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.766128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.770134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.777326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:41.786612 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-50ee8dee-8ae5-4a25-909d-a97d0393df0e tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1326 microversion: 2.1 time: 0.452039 Nov 02 13:22:41.787562 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1365/2512] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:41 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1326 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:41.793983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:41.794986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:41.801737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.802555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.803319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.804266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:41.804933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:41.805636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:41.971538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:41.986561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:41.991245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.005426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-415bda2d-0ca3-4017-a1ed-676cd1aad150 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1446 microversion: 2.75 time: 0.273855 Nov 02 13:22:42.007689 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1148/2513] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:41 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1446 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:42.075813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.087940 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5097ebd4-e4cb-4aef-8331-c65c0a20fd74 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1322 microversion: 2.1 time: 0.298421 Nov 02 13:22:42.088554 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1366/2514] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:41 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:42.106136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:42.108653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:42.119181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.120807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.122502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.123510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.124147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.125214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.132036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-540b1aa2-e3a7-4a8b-ab84-567cf3c2f7f8 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Action: 'create', calling method: .version_select at 0x7fe78f90e0d0>, body: {"keypair": {"name": "tempest-keypair-1459764396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJdUEZDWfczwTNCTeEtHU0DzcQrmWbk0sdWVybmQJNFjdbPQvablJTYaDs6ZoHq+bqFzdivKjI1mxTPinmzkjxZlfQ7gg6dPsmHTSXzJS+7LhO1CWgQ4OfgtOWERR9tkA=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:42.191533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-540b1aa2-e3a7-4a8b-ab84-567cf3c2f7f8 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Getting quotas for project 6607f7935f1b4f3a820f53ae3d8474ea. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:42.205313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-540b1aa2-e3a7-4a8b-ab84-567cf3c2f7f8 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Getting quotas for user 4fea8089e4b648b39c33daa3bd1e1d56 and project 6607f7935f1b4f3a820f53ae3d8474ea. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:42.269521 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-540b1aa2-e3a7-4a8b-ab84-567cf3c2f7f8 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.260441 Nov 02 13:22:42.279269 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1149/2515] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:22:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:42.279476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.289459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.291794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.293812 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-72b24194-c86e-4c19-ad26-590c2b7a4f00 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.203553 Nov 02 13:22:42.294296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:42.294840 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1367/2516] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:42 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:42.295001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:42.320365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.320857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.321298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.322015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.322471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.322894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.328845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:42.329870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:42.349027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.351663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.352472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.357708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.358529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.362405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.797956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.813339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.817827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.818986 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7755f99-7e6a-4c00-9ffc-bc2ff98cf90b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.494146 Nov 02 13:22:42.819645 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1368/2517] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:42 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:42.835849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:42.836651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:42.857507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.858440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.858883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.859739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:42.860491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:42.861262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:42.941791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:42.959025 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0a1d3e8e-9ee5-4c35-9f59-947fbdb5f054 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1670 microversion: 2.1 time: 0.678433 Nov 02 13:22:42.972453 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1150/2518] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:42 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1670 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:43.036727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:43.037455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:43.044222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.045118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.045745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.046712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.047438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.048043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.105384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.106029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.112240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.113671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lazy-loading 'fault' on Instance uuid 9f3d004b-3990-4eda-afd5-ef6f868162eb {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:43.199001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:43.217873 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6de5a717-f0e9-406b-971b-cd7384f80713 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1475 microversion: 2.1 time: 0.390843 Nov 02 13:22:43.220072 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1369/2519] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:42 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1475 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:43.234004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5710cc63-5779-4ee3-89e9-34761df6b526 req-f029c40b-c49a-4296-bb73-be29b306f0bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b185e99-0344-4ba1-afba-41b3fb39a207", "tag": "9e988ccd-f6e6-4ec9-b69c-a6646d66183d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:43.261493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:43.264450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5710cc63-5779-4ee3-89e9-34761df6b526 req-f029c40b-c49a-4296-bb73-be29b306f0bd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.269382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5710cc63-5779-4ee3-89e9-34761df6b526 req-f029c40b-c49a-4296-bb73-be29b306f0bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.270033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5710cc63-5779-4ee3-89e9-34761df6b526 req-f029c40b-c49a-4296-bb73-be29b306f0bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.273511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:43.279061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9642c0b7757445ea53f2cfbd87f0f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b421ad47e399459abc91a60f2ca1e103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:43.295575 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d058dbc-dd39-4573-bc09-1401e9f20048 tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 200 len: 1451 microversion: 2.75 time: 0.263169 Nov 02 13:22:43.296338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1151/2520] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:43 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 1451 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:43.298279 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5710cc63-5779-4ee3-89e9-34761df6b526 req-f029c40b-c49a-4296-bb73-be29b306f0bd service nova] Creating event network-changed:9e988ccd-f6e6-4ec9-b69c-a6646d66183d for instance 5b185e99-0344-4ba1-afba-41b3fb39a207 on n-h2-858384-19 Nov 02 13:22:43.306234 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5710cc63-5779-4ee3-89e9-34761df6b526 req-f029c40b-c49a-4296-bb73-be29b306f0bd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084816 Nov 02 13:22:43.307049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:43.307852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:43.308113 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1370/2521] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:43.324023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.324922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.325779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.328136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.328841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.332741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.549433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a80041e7-d289-43d8-a3fd-4d48008d69c9 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:43.550239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a80041e7-d289-43d8-a3fd-4d48008d69c9 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] [instance: ef52eab5-cb94-4333-94e1-cc14a950124d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:43.568316 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-a80041e7-d289-43d8-a3fd-4d48008d69c9 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] HTTP exception thrown: Instance ef52eab5-cb94-4333-94e1-cc14a950124d could not be found. Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a80041e7-d289-43d8-a3fd-4d48008d69c9 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Request method failure captured: Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/ef52eab5-cb94-4333-94e1-cc14a950124d/action HTTP/1.1 Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 15 Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm8Kr20fkTQhhqZgZft7fl1egevmQ2tqIWzabiBdiBC3RbKaV3UcxLMN-f0RHtSmOzo1K6DLlXc1ygUkNt732N22rv5A4sXvbETNUnOR7o3JNRcYkP3znt_m02BUJbtSwj_ZK0LI3FNcSFfNi8SUa7cqTt-YzVVoX1iA6_fuVPt9Kdc Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:22:43.574450 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_f6f52a52515a476ba0763ec67f758772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e60fb02bdc914cf49cba17952e363a94 Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: {"migrate": {}} Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:43.576644 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance ef52eab5-cb94-4333-94e1-cc14a950124d could not be found. Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'ef52eab5-cb94-4333-94e1-cc14a950124d', 'body': {'migrate': {}}} Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef52eab5-cb94-4333-94e1-cc14a950124d could not be found. Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:43.577621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef52eab5-cb94-4333-94e1-cc14a950124d could not be found. Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef52eab5-cb94-4333-94e1-cc14a950124d could not be found. Nov 02 13:22:43.579308 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:43.581204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a80041e7-d289-43d8-a3fd-4d48008d69c9 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Returning 404 to user: Instance ef52eab5-cb94-4333-94e1-cc14a950124d could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:43.581204 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a80041e7-d289-43d8-a3fd-4d48008d69c9 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/ef52eab5-cb94-4333-94e1-cc14a950124d/action" status: 404 len: 111 microversion: 2.1 time: 0.263750 Nov 02 13:22:43.581204 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1371/2522] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:22:43 2022] POST /compute/v2.1/servers/ef52eab5-cb94-4333-94e1-cc14a950124d/action => generated 111 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:43.592101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:43.594007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:43.606152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.606653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.607094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.608197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:43.608965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:43.609402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:43.731716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:43.744509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:43.748877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:43.750115 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bcaa208c-bab6-4730-9f6d-a301679658a7 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.168871 Nov 02 13:22:43.753688 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1372/2523] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:43 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:43.770986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1460875522", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:43.864418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:22:44.006451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:44.016821 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f2dfc859-4faf-4839-a70e-84d770c8617e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1322 microversion: 2.1 time: 0.719330 Nov 02 13:22:44.017418 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1152/2524] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:43 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1322 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:44.030205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:44.034575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:44.048444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.049434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.050232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.052006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.052666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.053270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.246240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:44.246891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:44.247677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:44.248475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:44.249479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:44.313985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.314619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.314963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.315901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.316403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.316833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.343954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Getting quotas for project a09bfd47abf24e90b9f9467161add600. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:44.349665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Getting quotas for user 840589ef49c84995a89cf2b2c33f3e45 and project a09bfd47abf24e90b9f9467161add600. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:44.352210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:44.376170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:22:44.378512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:22:44.444768 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2796a3c6-1c9d-4b55-b6c3-e85be99a4c0b tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.679651 Nov 02 13:22:44.450036 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1373/2525] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:22:43 2022] POST /compute/v2.1/servers => generated 382 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:22:44.471725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:44.472633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:44.487406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.488371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.489098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.490057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.490756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.491452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.646428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:44.663839 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d8e5f455-9e32-485c-b2c6-1caf2d3ae272 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1602 microversion: 2.1 time: 0.212372 Nov 02 13:22:44.665192 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1374/2526] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:44 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1602 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:44.671768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:44.672554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] [instance: 9f3d004b-3990-4eda-afd5-ef6f868162eb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:44.679322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.679943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.680631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.681703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.682296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.683597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.726450 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] HTTP exception thrown: Instance 9f3d004b-3990-4eda-afd5-ef6f868162eb could not be found. Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Request method failure captured: Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb HTTP/1.1 Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm6-BAKoVkkymUfIDat5UcBpWPKSmnFBqm_zyCXeQjMuaSbOfLBZfuoBDiJbAC9_v9pp_N6exdSygn479Q0h6vCt2-0IN3WKNnIEjs6JCkac7c7Lw2o9rOd06YjYLUBa7xvwnvH1gSwpkA97L-jeVAWMnyAT4lL8DaHDQL-J4T9RA1w Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.75 Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b421ad47e399459abc91a60f2ca1e103 Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersAdmin275Test-465879193 Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:44.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b421ad47e399459abc91a60f2ca1e103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b421ad47e399459abc91a60f2ca1e103"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b421ad47e399459abc91a60f2ca1e103"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b421ad47e399459abc91a60f2ca1e103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersAdmin275Test-465879193 Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b421ad47e399459abc91a60f2ca1e103 Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersAdmin275Test-465879193 Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersAdmin275Test-465879193-project Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: b9642c0b7757445ea53f2cfbd87f0f16 Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersAdmin275Test-465879193-project Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 9f3d004b-3990-4eda-afd5-ef6f868162eb could not be found. Nov 02 13:22:44.739944 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '9f3d004b-3990-4eda-afd5-ef6f868162eb'} Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3d004b-3990-4eda-afd5-ef6f868162eb could not be found. Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:44.740881 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3d004b-3990-4eda-afd5-ef6f868162eb could not be found. Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3d004b-3990-4eda-afd5-ef6f868162eb could not be found. Nov 02 13:22:44.742433 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:44.743786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:44.750080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] Returning 404 to user: Instance 9f3d004b-3990-4eda-afd5-ef6f868162eb could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:44.752576 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-64609462-d840-40b2-913e-c3012d15d5db tempest-ServersAdmin275Test-465879193 tempest-ServersAdmin275Test-465879193-project] 10.222.0.113 "GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb" status: 404 len: 111 microversion: 2.75 time: 0.086101 Nov 02 13:22:44.755729 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1375/2527] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:44 2022] GET /compute/v2.1/servers/9f3d004b-3990-4eda-afd5-ef6f868162eb => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:22:44.772172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:44.772931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93aabf9d-f865-473a-9150-fae226f9ed9f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:44.774238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93aabf9d-f865-473a-9150-fae226f9ed9f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:44.784277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:44.785572 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f28b0af4-5790-43d6-bae4-0a5b62b885bc tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.760587 Nov 02 13:22:44.799327 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1153/2528] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:44 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:44.816918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:44.817543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:44.849352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.850228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.850897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:44.851843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:44.852466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:44.853140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:45.096724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-93aabf9d-f865-473a-9150-fae226f9ed9f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:45.101285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:45.113776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93aabf9d-f865-473a-9150-fae226f9ed9f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1226 microversion: 2.1 time: 0.353159 Nov 02 13:22:45.115608 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1376/2529] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:44 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1226 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:45.135290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:45.138197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:45.141111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:45.143941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:45.164550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:45.170344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:45.171786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:45.172710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:45.173424 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-504372ef-c8fe-4321-bc36-c310605264b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.360953 Nov 02 13:22:45.174044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:45.175086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:45.176806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1154/2530] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:44 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:45.259985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:45.578078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:45.588560 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a6a53fc3-14d9-4bfa-90c5-464c334f3082 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1322 microversion: 2.1 time: 0.468355 Nov 02 13:22:45.596556 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1377/2531] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:45 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:45.601713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-441190743", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a136fd26-a209-474a-9d1a-7c430ce83bf2"}], "security_groups": [{"name": "tempest-securitygroup--1041764185"}], "key_name": "tempest-keypair-1459764396", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:45.655279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9f1276a3-f552-440a-bb21-86d385c75e57 req-401f9f0f-e858-440f-8f87-9ac120fa3262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8f4a4c-224d-4a42-9b89-dadf667e644b", "name": "network-vif-deleted", "tag": "9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:45.670084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9f1276a3-f552-440a-bb21-86d385c75e57 req-401f9f0f-e858-440f-8f87-9ac120fa3262 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:45.671068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9f1276a3-f552-440a-bb21-86d385c75e57 req-401f9f0f-e858-440f-8f87-9ac120fa3262 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:45.671748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9f1276a3-f552-440a-bb21-86d385c75e57 req-401f9f0f-e858-440f-8f87-9ac120fa3262 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:45.704038 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9f1276a3-f552-440a-bb21-86d385c75e57 req-401f9f0f-e858-440f-8f87-9ac120fa3262 service nova] Creating event network-vif-deleted:9dd08a7d-ab09-4e66-8be8-ad7bf22e9e0d for instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b on n-h1-858384-19 Nov 02 13:22:45.717185 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9f1276a3-f552-440a-bb21-86d385c75e57 req-401f9f0f-e858-440f-8f87-9ac120fa3262 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062775 Nov 02 13:22:45.725280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1378/2532] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:22:45.750488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:45.752566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:45.777605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:45.778094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:45.787294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:45.788251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:45.793414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:45.797299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:45.905319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] validate_networks() for [('a136fd26-a209-474a-9d1a-7c430ce83bf2', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:22:46.041898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:46.087867 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e6769cf-966a-428e-8286-462b93629b23 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1323 microversion: 2.1 time: 0.336855 Nov 02 13:22:46.095912 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1379/2533] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:45 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1323 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:46.106431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:46.121267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:46.150317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.150871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.158454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.159763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.160507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.161117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.615308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:46.627326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:46.628845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:46.630064 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f28500d1-04ec-4209-8448-9443618891fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.531598 Nov 02 13:22:46.655084 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1380/2534] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:46 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:46.662029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:46.662944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:46.677037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.677547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.677999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.678745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.679290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.679734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.736719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Getting quotas for project 6607f7935f1b4f3a820f53ae3d8474ea. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:46.747063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Getting quotas for user 4fea8089e4b648b39c33daa3bd1e1d56 and project 6607f7935f1b4f3a820f53ae3d8474ea. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:46.774179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:46.775641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:46.777079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:46.777976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:46.778784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:46.795045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.796098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.796996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.798519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.799249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.800184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.812198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:46.836983 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-52390405-938f-4cca-a847-21e5623248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1222 microversion: 2.1 time: 0.178711 Nov 02 13:22:46.840188 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1381/2535] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:46 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1222 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:46.848786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:46.850223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:46.872216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Getting quotas for project 6607f7935f1b4f3a820f53ae3d8474ea. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:22:46.883435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Getting quotas for user 4fea8089e4b648b39c33daa3bd1e1d56 and project 6607f7935f1b4f3a820f53ae3d8474ea. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:22:46.898290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.900881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.905035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.908652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:46.911463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:46.913372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:46.935856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:22:46.942045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:22:47.042730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:47.068421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:47.081196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:47.084224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:47.085948 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0e65b76-aa70-4326-8758-fc8a3343acca tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.243101 Nov 02 13:22:47.087286 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1382/2536] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:46 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:47.094222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:47.095105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:47.116159 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-233c8be0-a0a9-48dd-9991-8f9c1a91811b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.520580 Nov 02 13:22:47.119047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.122501 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1155/2537] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:22:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:22:47.128889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.131865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.132815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:47.135365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.136416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:47.137136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.138952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.175398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.177776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.181849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.183863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.184605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.185351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.343001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.343602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.348293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.351798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lazy-loading 'fault' on Instance uuid 9f8f4a4c-224d-4a42-9b89-dadf667e644b {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:47.485486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:47.498027 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-039806fc-4d29-46d6-a3ee-b2ab2388281f tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 200 len: 1328 microversion: 2.1 time: 0.373892 Nov 02 13:22:47.503844 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1156/2538] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:47 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 1328 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:47.520129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-06720988-4020-4deb-86e8-9032c3c82ad4 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:47.520778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-06720988-4020-4deb-86e8-9032c3c82ad4 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:47.653135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-06720988-4020-4deb-86e8-9032c3c82ad4 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:47.666460 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-06720988-4020-4deb-86e8-9032c3c82ad4 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1273 microversion: 2.1 time: 0.160748 Nov 02 13:22:47.668538 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1157/2539] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:47 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:47.679419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:47.681046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:47.686274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:47.701441 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0a1652fc-9084-482c-9d07-6b3b1bcf1925 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1322 microversion: 2.1 time: 0.611363 Nov 02 13:22:47.704625 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1383/2540] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:47 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1322 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:47.727310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.727310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.727310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.728777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.728777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.728777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.769016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-bfef7461-cfef-417d-8580-58d55292e709 req-9d7033c4-c551-43e5-b756-d5c8dff1fb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "name": "network-vif-plugged", "status": "completed", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:47.799048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bfef7461-cfef-417d-8580-58d55292e709 req-9d7033c4-c551-43e5-b756-d5c8dff1fb6b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.806116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bfef7461-cfef-417d-8580-58d55292e709 req-9d7033c4-c551-43e5-b756-d5c8dff1fb6b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.806582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bfef7461-cfef-417d-8580-58d55292e709 req-9d7033c4-c551-43e5-b756-d5c8dff1fb6b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.847527 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-bfef7461-cfef-417d-8580-58d55292e709 req-9d7033c4-c551-43e5-b756-d5c8dff1fb6b service nova] Creating event network-vif-plugged:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:22:47.863513 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-bfef7461-cfef-417d-8580-58d55292e709 req-9d7033c4-c551-43e5-b756-d5c8dff1fb6b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097759 Nov 02 13:22:47.865117 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1384/2541] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:47.880485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:47.882526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:47.913541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.921304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.922320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:47.925076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:47.927474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:47.928200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.065945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:48.115754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:48.127064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:48.137643 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-769948cc-5ae0-4dfe-ac79-a1df742e289c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.461409 Nov 02 13:22:48.138511 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1158/2542] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:47 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:48.151990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:48.152470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:48.153192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:48.162698 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5921c8c0-0130-47fa-8762-226777205e31 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1278 microversion: 2.1 time: 0.295196 Nov 02 13:22:48.166093 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1385/2543] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:47 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1278 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:48.171710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.189879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.191286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.193799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.197573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.198105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.498954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:48.521903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:48.528247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:48.532770 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-80b4abb1-04ef-4baf-9514-38565b3477c2 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.393197 Nov 02 13:22:48.534338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1159/2544] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:48 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:48.561244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:48.564085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 9f8f4a4c-224d-4a42-9b89-dadf667e644b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:48.580905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.581495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.582842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.583147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.584751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.585311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.621691 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] HTTP exception thrown: Instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b could not be found. Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Request method failure captured: Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b HTTP/1.1 Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0ZVeR7l59VgYfTuPmGoNwXlnTzUi5gTPV7amlO4g0iKLNdzbiDKhb0WDUMbUS430dmoRNS8hqS33LuvUfaJYQh3xsP6W8LhYMkz_r0OZfOvhdPELXnMx0Yi7Sx1C8wlxtO_nb7yzG6OzSamzNQkugrf4Hb9obUWcivgRacgh7q58k Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4d6fe1d935f34654baaeb1c8b48dda38 Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-LiveMigrationTest-49999660 Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:48.634117 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-LiveMigrationTest-49999660 Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4d6fe1d935f34654baaeb1c8b48dda38 Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-LiveMigrationTest-49999660 Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-LiveMigrationTest-49999660-project Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 392d81e9a1c74430a325c9ecc1dcfb44 Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-LiveMigrationTest-49999660-project Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b could not be found. Nov 02 13:22:48.636922 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '9f8f4a4c-224d-4a42-9b89-dadf667e644b'} Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b could not be found. Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:48.638134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b could not be found. Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b could not be found. Nov 02 13:22:48.640049 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:48.641979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Returning 404 to user: Instance 9f8f4a4c-224d-4a42-9b89-dadf667e644b could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:48.641979 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-99342bdb-14a9-4c99-b17c-25095ed6199d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b" status: 404 len: 111 microversion: 2.1 time: 0.106799 Nov 02 13:22:48.644960 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1386/2545] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:48 2022] GET /compute/v2.1/servers/9f8f4a4c-224d-4a42-9b89-dadf667e644b => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:22:48.649775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-769f9b11-9b01-455f-ac7a-914e04b4edc6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '.version_select at 0x7fe78f90c430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:48.699697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:48.700664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:48.711508 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-769f9b11-9b01-455f-ac7a-914e04b4edc6 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-414931152" status: 202 len: 0 microversion: 2.1 time: 0.063625 Nov 02 13:22:48.715190 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1160/2546] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-414931152 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:22:48.721467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.722074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.722602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.731071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.733409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.741122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.742933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:48.748677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:48.780451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.780960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.781406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:48.782122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:48.782574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:48.787393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:49.023476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:49.035138 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d45d7c9e-0742-4a55-a8c7-82c8b4645a45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1277 microversion: 2.1 time: 0.345490 Nov 02 13:22:49.036533 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1387/2547] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:48 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1277 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:49.170549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:49.171857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:49.183838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:49.184510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:49.184879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:49.185805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:49.186268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:49.186939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:49.710256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:49.732824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:49.737971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:49.745695 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d7e8f602-0142-481c-909a-f833b75439ec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.576876 Nov 02 13:22:49.746888 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1388/2548] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:49 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:22:49.761162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:49.763999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:49.779756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:49.781489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:49.782630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:49.784136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:49.785626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:49.786542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:49.787388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:49.792989 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f37dff31-6fda-4305-aed2-4d3299d52ef9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1322 microversion: 2.1 time: 1.065784 Nov 02 13:22:49.815573 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1161/2549] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:48 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1322 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:49.827745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:49.828397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:49.845309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:49.846205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:49.846846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:49.847824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:49.848444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:49.849166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:49.966202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:49.978087 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-278a8657-333a-4f6e-891c-a2562e482972 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1284 microversion: 2.1 time: 0.229112 Nov 02 13:22:49.981724 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1389/2550] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:49 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:50.058261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:50.071439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:50.073123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:50.073882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:50.074607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:50.074895 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8d403c5b-b33d-4c8a-a5d3-cc1bf6009fa3 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.258063 Nov 02 13:22:50.089642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.090563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.091315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.093611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.095186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.097498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.098840 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1162/2551] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:49 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:50.243362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:50.258328 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b6c75ae8-f1c8-459a-9cff-84042eac845d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1325 microversion: 2.1 time: 0.198200 Nov 02 13:22:50.261361 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1390/2552] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:50 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:50.337408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:50.338920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:50.351894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.352855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.354694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.355788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.356405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.357107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.392382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:50.409798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:50.493181 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16fd50e7-306a-459e-9c71-0530c0b51865 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "DELETE /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 204 len: 0 microversion: 2.1 time: 0.170277 Nov 02 13:22:50.498661 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1163/2553] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:22:50 2022] DELETE /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:22:50.508353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:50.512232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:50.526755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.527743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.528477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.530455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.531688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.532422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.723054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:50.733007 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f06365e7-0264-4a71-bbf0-3164cabab226 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1488 microversion: 2.1 time: 0.232387 Nov 02 13:22:50.733622 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1391/2554] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:50 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1488 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:50.784874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:50.786433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:50.794173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.794966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.795688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.796667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.797276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.797810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.833290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:50.834783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:50.848703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.851595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.852234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:50.853153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:50.856110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:50.858358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.050136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.058859 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b9c46580-62df-4257-a176-e4bbf2e81fd6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1322 microversion: 2.1 time: 0.230070 Nov 02 13:22:51.059780 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1392/2555] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:50 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:51.140721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.156385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.157867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.159579 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c7234c9-fc50-424e-a27e-b61b5e42c464 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.380009 Nov 02 13:22:51.160517 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1164/2556] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:50 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:51.164642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:51.165234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:51.173745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.174465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.175224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.176062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.176591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.177262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.225825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-14751a64-dfd9-49a9-83f1-a3a9fdb58dcf tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:51.230260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14751a64-dfd9-49a9-83f1-a3a9fdb58dcf tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.231691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14751a64-dfd9-49a9-83f1-a3a9fdb58dcf tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.232944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14751a64-dfd9-49a9-83f1-a3a9fdb58dcf tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.234194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14751a64-dfd9-49a9-83f1-a3a9fdb58dcf tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.234993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14751a64-dfd9-49a9-83f1-a3a9fdb58dcf tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.235822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14751a64-dfd9-49a9-83f1-a3a9fdb58dcf tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.271613 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-14751a64-dfd9-49a9-83f1-a3a9fdb58dcf tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.210194 Nov 02 13:22:51.272223 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1393/2557] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:22:51 2022] GET /compute/v2.1/os-services => generated 949 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:51.284347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:51.285381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:51.292506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.293278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.293775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.294443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.294907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.295406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.363415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.366180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.373339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dfe9f149-3a51-4b14-ac2e-78ecb417fed9 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.212137 Nov 02 13:22:51.374844 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1165/2558] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:51 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:51.376626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.378121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.379347 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7096ce47-1901-4bdf-935e-54fb6719aa28 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.106156 Nov 02 13:22:51.379687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63d31132-eeca-4610-a0a5-30d7d8548d91 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:51.380167 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1394/2559] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:51 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:51.383713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d31132-eeca-4610-a0a5-30d7d8548d91 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.384408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d31132-eeca-4610-a0a5-30d7d8548d91 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.384545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:51.384952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d31132-eeca-4610-a0a5-30d7d8548d91 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.385116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:51.387725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d31132-eeca-4610-a0a5-30d7d8548d91 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.388196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d31132-eeca-4610-a0a5-30d7d8548d91 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.388826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d31132-eeca-4610-a0a5-30d7d8548d91 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.391861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.392442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.392893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.393671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.394110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.394548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.418721 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63d31132-eeca-4610-a0a5-30d7d8548d91 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?host=n-d-858384-19" status: 200 len: 581 microversion: 2.1 time: 0.042609 Nov 02 13:22:51.422862 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1166/2560] 10.222.0.113 () {58 vars in 1179 bytes} [Wed Nov 2 13:22:51 2022] GET /compute/v2.1/os-services?host=n-d-858384-19 => generated 581 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:51.431973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fee5f657-690f-4371-af24-16cbb24b6b1a tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:51.436711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee5f657-690f-4371-af24-16cbb24b6b1a tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.437267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee5f657-690f-4371-af24-16cbb24b6b1a tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.437738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee5f657-690f-4371-af24-16cbb24b6b1a tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.438512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee5f657-690f-4371-af24-16cbb24b6b1a tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.438968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee5f657-690f-4371-af24-16cbb24b6b1a tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.439418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee5f657-690f-4371-af24-16cbb24b6b1a tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.465194 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fee5f657-690f-4371-af24-16cbb24b6b1a tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.036998 Nov 02 13:22:51.466117 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1167/2561] 10.222.0.113 () {58 vars in 1181 bytes} [Wed Nov 2 13:22:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:22:51.473557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:51.480376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-238fa286-da26-4b47-a074-68c3577c2064 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:51.485029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238fa286-da26-4b47-a074-68c3577c2064 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.485892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238fa286-da26-4b47-a074-68c3577c2064 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.486656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238fa286-da26-4b47-a074-68c3577c2064 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.487615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238fa286-da26-4b47-a074-68c3577c2064 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.488236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238fa286-da26-4b47-a074-68c3577c2064 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.488992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238fa286-da26-4b47-a074-68c3577c2064 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.510430 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-40080235-ce3b-41c8-a69b-881864996444 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1331 microversion: 2.1 time: 0.129278 Nov 02 13:22:51.511980 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1395/2562] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:51 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:51.521499 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-238fa286-da26-4b47-a074-68c3577c2064 tempest-ServicesAdminTestJSON-538252409 tempest-ServicesAdminTestJSON-538252409-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.045462 Nov 02 13:22:51.531078 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1168/2563] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:22:51 2022] GET /compute/v2.1/os-services => generated 949 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:22:51.762677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:51.763758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:51.823227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.823227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.823227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.826322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6ef97ce8-d2ff-43e0-820c-fbab592f7039 req-5632ef59-9dc1-481b-8152-8e8003981245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b185e99-0344-4ba1-afba-41b3fb39a207", "name": "network-vif-plugged", "status": "completed", "tag": "9e988ccd-f6e6-4ec9-b69c-a6646d66183d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:51.827971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.827971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.827971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.831145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6ef97ce8-d2ff-43e0-820c-fbab592f7039 req-5632ef59-9dc1-481b-8152-8e8003981245 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:51.835455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6ef97ce8-d2ff-43e0-820c-fbab592f7039 req-5632ef59-9dc1-481b-8152-8e8003981245 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:51.840855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6ef97ce8-d2ff-43e0-820c-fbab592f7039 req-5632ef59-9dc1-481b-8152-8e8003981245 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:51.864463 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6ef97ce8-d2ff-43e0-820c-fbab592f7039 req-5632ef59-9dc1-481b-8152-8e8003981245 service nova] Creating event network-vif-plugged:9e988ccd-f6e6-4ec9-b69c-a6646d66183d for instance 5b185e99-0344-4ba1-afba-41b3fb39a207 on n-h2-858384-19 Nov 02 13:22:51.881104 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6ef97ce8-d2ff-43e0-820c-fbab592f7039 req-5632ef59-9dc1-481b-8152-8e8003981245 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100064 Nov 02 13:22:51.881872 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1169/2564] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:52.083804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:52.084741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:52.092265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.093010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.093580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.094431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.095019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.095625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.106134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:52.109742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:52.117857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3f96299f-5f1d-49aa-b904-d506d96aa2d0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1488 microversion: 2.1 time: 0.362254 Nov 02 13:22:52.118467 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1396/2565] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:51 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1488 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:52.197040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:52.198173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:52.209997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.211167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.212688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.214372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.215244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.216019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.622021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:52.637364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:52.641123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:52.646157 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce44c350-07fa-4d0d-8444-5d0196b8b588 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.457353 Nov 02 13:22:52.647614 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1397/2566] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:52 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:52.672645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:52.675085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:52.684396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.686902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.688038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.689340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.690589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.691646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.831614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:52.846292 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c30960f7-8226-4663-86ca-fc464c0921b7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1322 microversion: 2.1 time: 0.766446 Nov 02 13:22:52.847516 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1170/2567] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:52 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1322 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:22:52.854241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:52.855431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:52.867709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.868751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.869469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:52.871913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:52.873043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:52.875073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.034988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:53.056449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:53.062102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:53.063551 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04404417-9cdb-4180-8054-d9d8851b43f0 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.214900 Nov 02 13:22:53.079231 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1171/2568] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:52 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:53.079231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b9d8a6b2-ffdf-42ac-b275-2383bc3527f7 req-aa95bc58-3e7c-4e45-b41a-4727055e0900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbd976e-6935-43e4-b29b-767d119733f8", "name": "network-vif-deleted", "tag": "613e5fac-e26d-4c56-84b7-c232722f889f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:53.109903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9d8a6b2-ffdf-42ac-b275-2383bc3527f7 req-aa95bc58-3e7c-4e45-b41a-4727055e0900 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.110398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9d8a6b2-ffdf-42ac-b275-2383bc3527f7 req-aa95bc58-3e7c-4e45-b41a-4727055e0900 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.115327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9d8a6b2-ffdf-42ac-b275-2383bc3527f7 req-aa95bc58-3e7c-4e45-b41a-4727055e0900 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.146705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:53.161506 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-32c6cc8b-6662-4281-9c8d-1cc90715a502 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.512052 Nov 02 13:22:53.168345 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b9d8a6b2-ffdf-42ac-b275-2383bc3527f7 req-aa95bc58-3e7c-4e45-b41a-4727055e0900 service nova] Creating event network-vif-deleted:613e5fac-e26d-4c56-84b7-c232722f889f for instance 4fbd976e-6935-43e4-b29b-767d119733f8 on n-h1-858384-19 Nov 02 13:22:53.179284 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b9d8a6b2-ffdf-42ac-b275-2383bc3527f7 req-aa95bc58-3e7c-4e45-b41a-4727055e0900 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108081 Nov 02 13:22:53.183345 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1172/2569] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:53.192215 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1398/2570] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:52 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:53.201985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:53.203852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:53.209510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:53.214829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:53.215884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.216558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.217782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.218726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.219383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.219956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.230464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.230982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.231957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.236578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.238911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.240200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.300891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.301410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.306360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.307327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lazy-loading 'fault' on Instance uuid 4fbd976e-6935-43e4-b29b-767d119733f8 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:22:53.387967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:53.403554 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97b94413-0b95-4c11-8fa4-6e9d24c2146d tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 200 len: 1305 microversion: 2.1 time: 0.209893 Nov 02 13:22:53.411652 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1399/2571] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:53 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 1305 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:53.491899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:53.503822 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6423f4fc-289c-4f41-9e77-7457d504d83e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1331 microversion: 2.1 time: 0.317220 Nov 02 13:22:53.504809 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1173/2572] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:53 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1331 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:53.679912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:53.682856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:53.702781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.704440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.705892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.708707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.709356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.711340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.873502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:53.874708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:53.895812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.899978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.901437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:53.905792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:53.906430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:53.906938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.192888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.206229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.208448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.209858 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ffc5ed1f-746f-4f66-8dfa-5b6eeeead5fb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.539278 Nov 02 13:22:54.211470 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1400/2573] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:53 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:54.219883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:54.221627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:54.229692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.231268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.231962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.233008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.233714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.234357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.330597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.343727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.345753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.348036 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82703e0a-5991-4db3-97e9-dacbcb951f5a tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.134585 Nov 02 13:22:54.349878 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1401/2574] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:54 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:54.357918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:54.359091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:54.368137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.369392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.372219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.373600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.374427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.375296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.626931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.640358 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a5f76b65-497c-42d7-993a-583a38fabfcd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.285531 Nov 02 13:22:54.641903 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1402/2575] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:54 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:54.660720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:54.662172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: 4fbd976e-6935-43e4-b29b-767d119733f8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:54.675032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.676688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.677165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.678357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.678836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.679373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.699694 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] HTTP exception thrown: Instance 4fbd976e-6935-43e4-b29b-767d119733f8 could not be found. Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Request method failure captured: Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 HTTP/1.1 Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0ZVeR7l59VgYfTuPmGoNwXlnTzUi5gTPV7amlO4g0iKLNdzbiDKhb0WDUMbUS430dmoRNS8hqS33LuvUfaJYQh3xsP6W8LhYMkz_r0OZfOvhdPELXnMx0Yi7Sx1C8wlxtO_nb7yzG6OzSamzNQkugrf4Hb9obUWcivgRacgh7q58k Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4d6fe1d935f34654baaeb1c8b48dda38 Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-LiveMigrationTest-49999660 Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:22:54.701285 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-LiveMigrationTest-49999660 Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4d6fe1d935f34654baaeb1c8b48dda38 Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-LiveMigrationTest-49999660 Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-LiveMigrationTest-49999660-project Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 392d81e9a1c74430a325c9ecc1dcfb44 Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-LiveMigrationTest-49999660-project Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 4fbd976e-6935-43e4-b29b-767d119733f8 could not be found. Nov 02 13:22:54.702329 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '4fbd976e-6935-43e4-b29b-767d119733f8'} Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fbd976e-6935-43e4-b29b-767d119733f8 could not be found. Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:54.702948 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fbd976e-6935-43e4-b29b-767d119733f8 could not be found. Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fbd976e-6935-43e4-b29b-767d119733f8 could not be found. Nov 02 13:22:54.704061 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:54.704926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Returning 404 to user: Instance 4fbd976e-6935-43e4-b29b-767d119733f8 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:54.704926 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-100e2d23-5ffe-4fd5-849c-646d61eb75e0 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8" status: 404 len: 111 microversion: 2.1 time: 0.059503 Nov 02 13:22:54.704926 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1403/2576] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:54 2022] GET /compute/v2.1/servers/4fbd976e-6935-43e4-b29b-767d119733f8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:22:54.711102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:54.711684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:54.720131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.722163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.722163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.722163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.722445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.723468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.821900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.834082 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f25b2120-3fb6-41cc-a290-b713ed69b68b tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1331 microversion: 2.1 time: 0.127834 Nov 02 13:22:54.835440 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1404/2577] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:54 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:54.841570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:54.842265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:54.849240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.850019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.850616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.852083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:54.852913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:54.853668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:54.898066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:22:54.929410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:54.950468 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0bfe50e-9bf5-498e-98a1-34199b8312f6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1322 microversion: 2.1 time: 1.084101 Nov 02 13:22:54.968445 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1174/2578] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:53 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1322 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:55.041406 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc993f27-e2c1-4d23-8a28-f7a2620015c7 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "DELETE /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 204 len: 0 microversion: 2.1 time: 0.203654 Nov 02 13:22:55.042949 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1405/2579] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:22:54 2022] DELETE /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:22:55.051456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:55.051998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:55.059212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.059889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.060441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.061389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.061842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.062279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.252039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:55.255055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:55.273179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:55.281806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.282725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.283475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.285701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.288135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.291324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.646103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:55.661590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:55.663876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:55.666088 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e82b4b74-c546-4e21-84e5-eaab1c552eca tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.426787 Nov 02 13:22:55.668446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:55.668664 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1406/2580] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:55 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:55.675781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:55.676787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:55.689255 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b50f6545-74b6-45b6-8783-485bbc846428 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1501 microversion: 2.1 time: 0.640946 Nov 02 13:22:55.697547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.697547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.697547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.697547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.700063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.700063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.704702 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1175/2581] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:55 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1501 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:55.724004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-55f8ec07-b0dc-40c1-8779-47b6cb05bdb1 req-2ff563ac-fb25-466b-87e6-ae7d243dd51f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb18f5b-6460-4586-bad8-2aef82839483", "tag": "6871b849-1b22-4f92-a5f2-404b61481d3b"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:55.746087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-55f8ec07-b0dc-40c1-8779-47b6cb05bdb1 req-2ff563ac-fb25-466b-87e6-ae7d243dd51f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.750891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-55f8ec07-b0dc-40c1-8779-47b6cb05bdb1 req-2ff563ac-fb25-466b-87e6-ae7d243dd51f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.751617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-55f8ec07-b0dc-40c1-8779-47b6cb05bdb1 req-2ff563ac-fb25-466b-87e6-ae7d243dd51f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.777062 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-55f8ec07-b0dc-40c1-8779-47b6cb05bdb1 req-2ff563ac-fb25-466b-87e6-ae7d243dd51f service nova] Creating event network-changed:6871b849-1b22-4f92-a5f2-404b61481d3b for instance 5bb18f5b-6460-4586-bad8-2aef82839483 on n-h1-858384-19 Nov 02 13:22:55.784907 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-55f8ec07-b0dc-40c1-8779-47b6cb05bdb1 req-2ff563ac-fb25-466b-87e6-ae7d243dd51f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074731 Nov 02 13:22:55.786523 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1176/2582] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:55.794816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:55.804131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:55.817726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.818454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.819844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.820945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.823780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.824632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.923157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:55.934187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:55.936141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:55.937645 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cfa2d222-9e01-4221-9e91-3abad3b972b5 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.267770 Nov 02 13:22:55.948600 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1407/2583] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:55 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:55.966636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:55.967321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:55.981313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.983408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.988305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:55.989294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:55.990606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:55.991055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:56.191877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:56.219723 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-95d21682-b2dd-4165-bbfd-d407309d7244 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.266814 Nov 02 13:22:56.221244 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1408/2584] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:55 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:56.227152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:56.227872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:56.236535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:56.236710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:56.237438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:56.239263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:56.240470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:56.241014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:56.554197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:56.569967 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4950b951-a615-4b8e-84f9-701a62a3f54a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1513 microversion: 2.1 time: 0.347499 Nov 02 13:22:56.584503 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1409/2585] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:56 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1513 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:56.597705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:56.602149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:56.629219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:56.629914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:56.630381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:56.631206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:56.631657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:56.634978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:56.661585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:56.679373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3adaec7e-b5a6-480a-999b-9325148e3a2f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.886539 Nov 02 13:22:56.680442 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1177/2586] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:55 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:56.708560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:56.722614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:56.743436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:56.743956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:56.747077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:56.749717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:56.750616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:56.751076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:56.957383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:56.972060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77a8b018-0604-4342-b66e-45aebe807e7d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1513 microversion: 2.1 time: 0.378305 Nov 02 13:22:56.983142 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1410/2587] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:56 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1513 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:56.994138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:56.994138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:57.003339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.004112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.008678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.008678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.009305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.010035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.228607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:57.241221 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-265f118c-a959-4865-a4ae-c78bfa2152e2 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1501 microversion: 2.1 time: 0.266360 Nov 02 13:22:57.242201 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1411/2588] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:56 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1501 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:57.249855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:57.250596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:57.261560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.262559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.263342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.264440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.264835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.265354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.299249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:57.400163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:57.410990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:57.414940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:57.416938 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f40cecb3-3088-46e0-9e8f-0c7399ed361d tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.172240 Nov 02 13:22:57.431143 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1412/2589] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:57 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:57.431143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-43f7f999-a546-4acd-b4c1-04ae717c3881 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:57.431143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-43f7f999-a546-4acd-b4c1-04ae717c3881 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:57.439089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43f7f999-a546-4acd-b4c1-04ae717c3881 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.439089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43f7f999-a546-4acd-b4c1-04ae717c3881 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.439089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43f7f999-a546-4acd-b4c1-04ae717c3881 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.439089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43f7f999-a546-4acd-b4c1-04ae717c3881 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.439537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43f7f999-a546-4acd-b4c1-04ae717c3881 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.439537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43f7f999-a546-4acd-b4c1-04ae717c3881 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.582874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-43f7f999-a546-4acd-b4c1-04ae717c3881 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "PUT /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1085 microversion: 2.1 time: 0.163695 Nov 02 13:22:57.583870 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1413/2590] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:22:57 2022] PUT /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1085 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:57.605738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:57.606343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:57.613918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:57.615457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.615936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.616385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.617108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.617634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.618134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.659367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=20 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:57.717677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:57.734380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:57.735907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:57.737102 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d246975-4555-434d-9074-b57addec46bb tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 1.037680 Nov 02 13:22:57.738193 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1178/2591] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:56 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:57.752026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:57.753378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:57.766153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.766806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.767611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.774023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.774794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.775469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.834681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:57.848355 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17805d78-c150-4716-a37e-fe681197a65d tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.247225 Nov 02 13:22:57.864634 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1414/2592] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:57 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:57.872532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:57.873362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:57.880301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.880897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.881418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:57.882336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:57.882876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:57.883791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.114071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.124665 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd863523-2626-4e8a-b76d-26eb758c59bb tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.258482 Nov 02 13:22:58.138886 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1415/2593] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:57 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:58.321801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Action: 'update', calling method: .version_select at 0x7fe78c035940>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:58.340235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.341033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.341757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.356461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.357264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.357880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.377384 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] HTTP exception thrown: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Request method failure captured: Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/os-services/bdab611c-b2fb-4dfd-8208-96fab052d3d5 HTTP/1.1 Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 56 Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm8xuUv4TvSbO9bKJ1e9y7MK7cxvKjdNdm-2C7IPPhEsby8jDJb6v-hspEucDgi4pQq291JrevLkGLEbyeIh0su7AZwJPYx8SaQ4dE3tS64ihkp2pDdVIvm7svBxkc6hL2SjdoSvd4jEjoxb1Tqyz30Ywx_vYZ-ZZjG4ugs9P9dQamE Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cec6ce217fc74a02bfd3f6a7b14c90b1 Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1351643995 Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:22:58.379467 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1351643995 Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cec6ce217fc74a02bfd3f6a7b14c90b1 Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1351643995 Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: af97305b750b4f5fbaf9334b106edd3c Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: {"status": "disabled", "disabled_reason": "maintenance"} Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:22:58.380625 n-d-858384-19 devstack@n-api.service[120928]: exception: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'bdab611c-b2fb-4dfd-8208-96fab052d3d5', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.381284 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:58.382301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:58.383290 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:58.383290 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.383290 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.383290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Returning 404 to user: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:58.383290 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d45ef2b-10eb-4927-9c64-d153274559e7 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-services/bdab611c-b2fb-4dfd-8208-96fab052d3d5" status: 404 len: 110 microversion: 2.53 time: 0.240870 Nov 02 13:22:58.383290 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1416/2594] 10.222.0.113 () {62 vars in 1314 bytes} [Wed Nov 2 13:22:58 2022] PUT /compute/v2.1/os-services/bdab611c-b2fb-4dfd-8208-96fab052d3d5 => generated 110 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:22:58.390662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:58.391329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:58.405720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.406785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.407293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.408039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.409069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.411050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.497339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.507104 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4457bb17-d807-44ed-928e-96ed57cc8f5f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1511 microversion: 2.1 time: 0.767812 Nov 02 13:22:58.512095 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1179/2595] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:57 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1511 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:58.517318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Action: 'update', calling method: .version_select at 0x7fe78fa710d0>, body: {"status": "disabled"} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:58.532929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.536970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.537740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.560259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.561052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.561681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.575681 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] HTTP exception thrown: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Request method failure captured: Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: request: PUT /compute/v2.1/os-services/bdab611c-b2fb-4dfd-8208-96fab052d3d5 HTTP/1.1 Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 22 Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm8xuUv4TvSbO9bKJ1e9y7MK7cxvKjdNdm-2C7IPPhEsby8jDJb6v-hspEucDgi4pQq291JrevLkGLEbyeIh0su7AZwJPYx8SaQ4dE3tS64ihkp2pDdVIvm7svBxkc6hL2SjdoSvd4jEjoxb1Tqyz30Ywx_vYZ-ZZjG4ugs9P9dQamE Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cec6ce217fc74a02bfd3f6a7b14c90b1 Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1351643995 Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:22:58.578121 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1351643995 Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cec6ce217fc74a02bfd3f6a7b14c90b1 Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1351643995 Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: af97305b750b4f5fbaf9334b106edd3c Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: {"status": "disabled"} Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: exception: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.579274 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'bdab611c-b2fb-4dfd-8208-96fab052d3d5', 'body': {'status': 'disabled'}} Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.579967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:58.580952 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:58.581884 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.581884 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.584261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Returning 404 to user: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:58.585386 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e937d607-4ee4-442e-9d46-f5a81cb4d3ef tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-services/bdab611c-b2fb-4dfd-8208-96fab052d3d5" status: 404 len: 110 microversion: 2.53 time: 0.071992 Nov 02 13:22:58.586535 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1180/2596] 10.222.0.113 () {62 vars in 1314 bytes} [Wed Nov 2 13:22:58 2022] PUT /compute/v2.1/os-services/bdab611c-b2fb-4dfd-8208-96fab052d3d5 => generated 110 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:22:58.593504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:58.594598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:58.601238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.602068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.602772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.603787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.604970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.605200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.716854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.773119 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-477b1678-dff7-41f7-823b-f904deea0603 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1501 microversion: 2.1 time: 0.386921 Nov 02 13:22:58.777166 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1417/2597] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:58 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1501 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:58.789068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.794379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:58.801096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.801572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:58.803428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:58.805543 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dd86a2ee-c931-42da-af23-f6a130cf2b4e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.217288 Nov 02 13:22:58.806883 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1181/2598] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:58 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:58.815001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.816585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.817242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.818178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.818873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.824138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4635f00e-a8ec-4c6d-9909-b9e6242d028d req-e2eebf87-a805-4f19-bb95-c58f6519b8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2530d99-e7ea-486d-b401-f89aed63c82e", "name": "network-vif-unplugged", "status": "completed", "tag": "fe4a5830-b144-45ec-8ce0-87d6e72d593f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:58.827965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.844059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4635f00e-a8ec-4c6d-9909-b9e6242d028d req-e2eebf87-a805-4f19-bb95-c58f6519b8c9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.852286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4635f00e-a8ec-4c6d-9909-b9e6242d028d req-e2eebf87-a805-4f19-bb95-c58f6519b8c9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.853206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4635f00e-a8ec-4c6d-9909-b9e6242d028d req-e2eebf87-a805-4f19-bb95-c58f6519b8c9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.890557 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4635f00e-a8ec-4c6d-9909-b9e6242d028d req-e2eebf87-a805-4f19-bb95-c58f6519b8c9 service nova] Creating event network-vif-unplugged:fe4a5830-b144-45ec-8ce0-87d6e72d593f for instance e2530d99-e7ea-486d-b401-f89aed63c82e on n-h1-858384-19 Nov 02 13:22:58.905834 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4635f00e-a8ec-4c6d-9909-b9e6242d028d req-e2eebf87-a805-4f19-bb95-c58f6519b8c9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094183 Nov 02 13:22:58.906829 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1182/2599] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:22:58.928180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Action: 'update', calling method: .version_select at 0x7fe78fa7d310>, body: {"status": "enabled"} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:58.938908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.939808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.940497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.951734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:58.952402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:58.952883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:58.962472 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] HTTP exception thrown: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Request method failure captured: Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: request: PUT /compute/v2.1/os-services/bdab611c-b2fb-4dfd-8208-96fab052d3d5 HTTP/1.1 Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 21 Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm8xuUv4TvSbO9bKJ1e9y7MK7cxvKjdNdm-2C7IPPhEsby8jDJb6v-hspEucDgi4pQq291JrevLkGLEbyeIh0su7AZwJPYx8SaQ4dE3tS64ihkp2pDdVIvm7svBxkc6hL2SjdoSvd4jEjoxb1Tqyz30Ywx_vYZ-ZZjG4ugs9P9dQamE Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cec6ce217fc74a02bfd3f6a7b14c90b1 Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1351643995 Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:22:58.964960 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cec6ce217fc74a02bfd3f6a7b14c90b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1351643995 Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cec6ce217fc74a02bfd3f6a7b14c90b1 Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1351643995 Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: af97305b750b4f5fbaf9334b106edd3c Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: {"status": "enabled"} Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: exception: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.966102 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'bdab611c-b2fb-4dfd-8208-96fab052d3d5', 'body': {'status': 'enabled'}} Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.966905 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:22:58.968256 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:22:58.969641 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. Nov 02 13:22:58.969641 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:22:58.975337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Returning 404 to user: Service bdab611c-b2fb-4dfd-8208-96fab052d3d5 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:22:58.976234 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7db54a4d-adb5-4e13-a26b-cd73f3dc884a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-services/bdab611c-b2fb-4dfd-8208-96fab052d3d5" status: 404 len: 110 microversion: 2.53 time: 0.064734 Nov 02 13:22:58.981774 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1183/2600] 10.222.0.113 () {62 vars in 1314 bytes} [Wed Nov 2 13:22:58 2022] PUT /compute/v2.1/os-services/bdab611c-b2fb-4dfd-8208-96fab052d3d5 => generated 110 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:22:58.988742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:58.989384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.008052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.013388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.016491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.021006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.024476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.025578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.093210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:59.105649 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9da81e63-d389-4923-a847-34e306a1d248 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1511 microversion: 2.1 time: 0.327518 Nov 02 13:22:59.106490 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1418/2601] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:58 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:59.112487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:59.113492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.122544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.123339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.123960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.125053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.125528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.125969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.361260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:59.372893 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b9557690-e165-442e-bb97-857d00fb84e0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.265068 Nov 02 13:22:59.373921 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1419/2602] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:59 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:22:59.378921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-37476dfa-10da-464b-b8af-de96afe7551a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:59.382853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37476dfa-10da-464b-b8af-de96afe7551a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.402390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37476dfa-10da-464b-b8af-de96afe7551a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.402390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37476dfa-10da-464b-b8af-de96afe7551a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.402390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37476dfa-10da-464b-b8af-de96afe7551a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.404465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37476dfa-10da-464b-b8af-de96afe7551a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.404465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37476dfa-10da-464b-b8af-de96afe7551a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.443873 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-37476dfa-10da-464b-b8af-de96afe7551a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.068697 Nov 02 13:22:59.444906 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1420/2603] 10.222.0.113 () {60 vars in 1183 bytes} [Wed Nov 2 13:22:59 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:59.450832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:22:59.454197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.461259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.462231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.462813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.468500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.468944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.469535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.495304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:59.508712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:59.515421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:22:59.516788 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-98d34ab9-b47c-4519-a2cd-d67e18940c54 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.538465 Nov 02 13:22:59.517737 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1184/2604] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:22:58 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:59.539422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:59.540160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.549191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.549901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.550493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.551417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.552030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.552679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.558855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:22:59.626953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:22:59.627841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:22:59.628574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:22:59.629184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:22:59.629756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:22:59.728423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.740215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.741113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.741893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.742960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.743966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.745208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.782763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d538f0e-72b9-4d92-b4e9-6a0e29d80b26 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "POST /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207/action" status: 202 len: 1117 microversion: 2.1 time: 0.336416 Nov 02 13:22:59.784698 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1421/2605] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:22:59 2022] POST /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207/action => generated 1117 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 13:22:59.790786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ffcee04c-04c3-4559-b3a7-b1c462baefc8 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:59.795836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffcee04c-04c3-4559-b3a7-b1c462baefc8 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.796547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffcee04c-04c3-4559-b3a7-b1c462baefc8 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.797191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffcee04c-04c3-4559-b3a7-b1c462baefc8 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.798112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffcee04c-04c3-4559-b3a7-b1c462baefc8 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.798733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffcee04c-04c3-4559-b3a7-b1c462baefc8 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.799358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffcee04c-04c3-4559-b3a7-b1c462baefc8 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.831036 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ffcee04c-04c3-4559-b3a7-b1c462baefc8 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.045023 Nov 02 13:22:59.839188 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1422/2606] 10.222.0.113 () {60 vars in 1216 bytes} [Wed Nov 2 13:22:59 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:22:59.845882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:22:59.846515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:22:59.854806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.855543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.855934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.856958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:22:59.858522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:22:59.859312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:22:59.997496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.008811 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d3bfe4d3-0f19-4c93-bf08-c79bce1e90ee tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1459 microversion: 2.1 time: 0.173539 Nov 02 13:23:00.023144 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1423/2607] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:59 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1459 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.040108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.041964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.054639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.055527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.056074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.056884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.057995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.058513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.269055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.285108 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3e815405-ef36-4f48-8ddf-053c22cb33d5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.273268 Nov 02 13:23:00.286120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1424/2608] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.293970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.294993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.312256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.312629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.313688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.314457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.315529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.316212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.316650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.328527 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74f2b56e-728e-4ab0-9ab4-4375ef3231ca tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.807520 Nov 02 13:23:00.330809 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1185/2609] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:22:59 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.343459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d590f312-5799-4d46-89a0-44647a947622 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.353310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d590f312-5799-4d46-89a0-44647a947622 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.355176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d590f312-5799-4d46-89a0-44647a947622 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.356576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d590f312-5799-4d46-89a0-44647a947622 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.358787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d590f312-5799-4d46-89a0-44647a947622 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.360982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d590f312-5799-4d46-89a0-44647a947622 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.361481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d590f312-5799-4d46-89a0-44647a947622 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.425230 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d590f312-5799-4d46-89a0-44647a947622 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.092000 Nov 02 13:23:00.427845 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1186/2610] 10.222.0.113 () {60 vars in 1183 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:00.448763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.450505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.465175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.466414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.467898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.469159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.470045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.471783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.481525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.507210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.508656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.509856 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dd81b2b7-b3d1-4616-a458-efbc47cbb84b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.222548 Nov 02 13:23:00.510476 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1425/2611] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:00.534334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09cc08be-1d5f-4f1b-8119-893b6e540f9f tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.539162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09cc08be-1d5f-4f1b-8119-893b6e540f9f tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.539564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09cc08be-1d5f-4f1b-8119-893b6e540f9f tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.540008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09cc08be-1d5f-4f1b-8119-893b6e540f9f tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.540873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09cc08be-1d5f-4f1b-8119-893b6e540f9f tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.542035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09cc08be-1d5f-4f1b-8119-893b6e540f9f tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.542780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09cc08be-1d5f-4f1b-8119-893b6e540f9f tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.570111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09cc08be-1d5f-4f1b-8119-893b6e540f9f tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?host=n-d-858384-19&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.041611 Nov 02 13:23:00.571076 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1426/2612] 10.222.0.113 () {60 vars in 1242 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/os-services?host=n-d-858384-19&binary=xxx => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.576728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.578902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:00.586574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.587095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.587694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.588962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.589426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.589935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.770069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.780203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.788000 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1998423-7adc-4d56-973d-fe2f230f36bc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.349655 Nov 02 13:23:00.788935 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1187/2613] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.790940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.793829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:00.794747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cc8915a4-b455-4c70-94f2-00bee9e20b5a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.795033 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16205496-c07e-4a92-88c4-c0278f7c77d9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.222800 Nov 02 13:23:00.807164 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1427/2614] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:00.807365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc8915a4-b455-4c70-94f2-00bee9e20b5a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.807365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc8915a4-b455-4c70-94f2-00bee9e20b5a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.807365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc8915a4-b455-4c70-94f2-00bee9e20b5a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.807671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc8915a4-b455-4c70-94f2-00bee9e20b5a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.807671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc8915a4-b455-4c70-94f2-00bee9e20b5a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.807671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc8915a4-b455-4c70-94f2-00bee9e20b5a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.832519 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cc8915a4-b455-4c70-94f2-00bee9e20b5a tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.042489 Nov 02 13:23:00.842738 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1188/2615] 10.222.0.113 () {60 vars in 1183 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:00.848525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-62f598d9-b38e-4b10-a06b-f29e15fcf846 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:00.854534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f598d9-b38e-4b10-a06b-f29e15fcf846 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.855068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f598d9-b38e-4b10-a06b-f29e15fcf846 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.855878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f598d9-b38e-4b10-a06b-f29e15fcf846 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.856649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f598d9-b38e-4b10-a06b-f29e15fcf846 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.857116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f598d9-b38e-4b10-a06b-f29e15fcf846 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.857548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f598d9-b38e-4b10-a06b-f29e15fcf846 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:00.888270 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-62f598d9-b38e-4b10-a06b-f29e15fcf846 tempest-ServicesAdminNegativeV253TestJSON-1351643995 tempest-ServicesAdminNegativeV253TestJSON-1351643995-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.044091 Nov 02 13:23:00.889477 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1428/2616] 10.222.0.113 () {60 vars in 1244 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:00.975486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b35979d7-f8a7-495a-8cd7-5771080863be req-49111b38-3106-4e29-9e83-c9790edd9458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca7fedf-baa0-4492-8c62-61a6452889a9", "name": "network-vif-deleted", "tag": "0e82bbfc-811d-44dc-84ed-e4ab1baebc95"}, {"name": "network-changed", "server_uuid": "bc3bac6c-ee78-42bb-bec5-d234e99c4f4a", "tag": "80f8ad8e-c5fe-4f0d-a64c-27e7e46de62e"}, {"name": "network-changed", "server_uuid": "e2530d99-e7ea-486d-b401-f89aed63c82e", "tag": "fe4a5830-b144-45ec-8ce0-87d6e72d593f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:00.995186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b35979d7-f8a7-495a-8cd7-5771080863be req-49111b38-3106-4e29-9e83-c9790edd9458 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:00.996718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b35979d7-f8a7-495a-8cd7-5771080863be req-49111b38-3106-4e29-9e83-c9790edd9458 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:00.997187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b35979d7-f8a7-495a-8cd7-5771080863be req-49111b38-3106-4e29-9e83-c9790edd9458 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.017945 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b35979d7-f8a7-495a-8cd7-5771080863be req-49111b38-3106-4e29-9e83-c9790edd9458 service nova] Creating event network-vif-deleted:0e82bbfc-811d-44dc-84ed-e4ab1baebc95 for instance cca7fedf-baa0-4492-8c62-61a6452889a9 on n-h1-858384-19 Nov 02 13:23:01.018976 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b35979d7-f8a7-495a-8cd7-5771080863be req-49111b38-3106-4e29-9e83-c9790edd9458 service nova] Creating event network-changed:80f8ad8e-c5fe-4f0d-a64c-27e7e46de62e for instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a on n-h1-858384-19 Nov 02 13:23:01.020388 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b35979d7-f8a7-495a-8cd7-5771080863be req-49111b38-3106-4e29-9e83-c9790edd9458 service nova] Creating event network-changed:fe4a5830-b144-45ec-8ce0-87d6e72d593f for instance e2530d99-e7ea-486d-b401-f89aed63c82e on n-h1-858384-19 Nov 02 13:23:01.030937 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b35979d7-f8a7-495a-8cd7-5771080863be req-49111b38-3106-4e29-9e83-c9790edd9458 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.061769 Nov 02 13:23:01.031875 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1429/2617] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:01.034662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c323f02e-0c43-400a-a4a3-88f02ecd3eac tempest-ServicesAdminNegativeV253TestJSON-70006613 tempest-ServicesAdminNegativeV253TestJSON-70006613-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.038701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c323f02e-0c43-400a-a4a3-88f02ecd3eac tempest-ServicesAdminNegativeV253TestJSON-70006613 tempest-ServicesAdminNegativeV253TestJSON-70006613-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4e9e3ea7dfec44529c3b4183a11c97c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7f3b306bc5745bcb1401f3e68b990ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c323f02e-0c43-400a-a4a3-88f02ecd3eac tempest-ServicesAdminNegativeV253TestJSON-70006613 tempest-ServicesAdminNegativeV253TestJSON-70006613-project] Request method failure captured: Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm8wbBJRQT8yIXRq6REX1_sMKw3z_P7U2d7POoDageg9XVIG2-lYXr9ijB1NizZ7mh55MvysbYLbhlEf9jUwkMQp4M-0ZaULRRr5nuRALT77L82ZGEnCdXyW9sD-TSlF9vIoJUIuT5UHC1yZEoSgBsauGPJV3Kpiv14iWcVpc8PD8C4 Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d7f3b306bc5745bcb1401f3e68b990ab Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-70006613 Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:23:01.040840 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d7f3b306bc5745bcb1401f3e68b990ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d7f3b306bc5745bcb1401f3e68b990ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d7f3b306bc5745bcb1401f3e68b990ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d7f3b306bc5745bcb1401f3e68b990ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-70006613 Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d7f3b306bc5745bcb1401f3e68b990ab Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-70006613 Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServicesAdminNegativeV253TestJSON-70006613-project Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4e9e3ea7dfec44529c3b4183a11c97c4 Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-70006613-project Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:23:01.042346 n-d-858384-19 devstack@n-api.service[120929]: action_args: {} Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:23:01.043102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 13:23:01.044255 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:01.046644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c323f02e-0c43-400a-a4a3-88f02ecd3eac tempest-ServicesAdminNegativeV253TestJSON-70006613 tempest-ServicesAdminNegativeV253TestJSON-70006613-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:01.046644 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c323f02e-0c43-400a-a4a3-88f02ecd3eac tempest-ServicesAdminNegativeV253TestJSON-70006613 tempest-ServicesAdminNegativeV253TestJSON-70006613-project] 10.222.0.113 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.143639 Nov 02 13:23:01.048949 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1189/2618] 10.222.0.113 () {60 vars in 1183 bytes} [Wed Nov 2 13:23:00 2022] GET /compute/v2.1/os-services => generated 112 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:23:01.051611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.052522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:01.061421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.061926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.062456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.063205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.063669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.064173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.070468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:01.147161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:01.159253 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c30c1529-dab1-4047-b356-84e9054ad98e tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1459 microversion: 2.1 time: 0.119685 Nov 02 13:23:01.160041 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1430/2619] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:01 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1459 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:01.311144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.311800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:01.324911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.326099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.326099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.326544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.330161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.330591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.359769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.360372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:01.367458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.367946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.368387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.369384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.370336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.371004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.653401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:01.662189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1a0f034e-837c-4881-a404-03f81c83aa05 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.306066 Nov 02 13:23:01.663099 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1431/2620] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:01 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:01.668939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.669351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:01.675480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.675979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.676561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.677115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.677563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.678259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.697373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:01.710523 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7085573c-6e11-469c-8cf7-eabbbb36abb0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.404349 Nov 02 13:23:01.711541 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1190/2621] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:01 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:01.784020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:01.797646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:01.800479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:01.801932 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-442ae518-61ec-44a6-951a-2fbc92f8a817 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.137773 Nov 02 13:23:01.816437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.816437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:01.819835 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1432/2622] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:01 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:01.825424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.827164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:01.828032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:01.831714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.832297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.833430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.834010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.835197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.835315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.835864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.836313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:01.837872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:01.838370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:01.839198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.056769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:02.070565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:02.074080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:02.076706 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6c5f84f-56f8-4582-8ca6-bf9150b251d6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.255343 Nov 02 13:23:02.079039 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1433/2623] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:01 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:02.200403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:02.203442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:02.222238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.224960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.225560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.226338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.228388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.229582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.325291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.325952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.326493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.327074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lazy-loading 'fault' on Instance uuid cca7fedf-baa0-4492-8c62-61a6452889a9 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:23:02.414170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:02.415764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392d81e9a1c74430a325c9ecc1dcfb44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6fe1d935f34654baaeb1c8b48dda38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:02.426940 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf4f5f32-c476-4edd-b127-1dfe9d63a034 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.616480 Nov 02 13:23:02.435625 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1191/2624] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:01 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:02.437780 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cb38b87d-e3c2-4738-aacd-d9961ca15bb1 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 200 len: 1303 microversion: 2.1 time: 0.249935 Nov 02 13:23:02.437905 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1434/2625] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:02 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:02.688794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:02.689617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:02.699435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.700283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.700739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.701468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.702404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.702929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.738709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:02.741503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:02.757924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.758435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.761679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:02.766403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:02.767100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:02.767647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.039152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.051766 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8475185b-0dab-4cd0-a49d-7a5cb49c4df6 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.365891 Nov 02 13:23:03.063303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.067952 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1192/2626] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:02 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:03.074061 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2a17502-749a-43d9-ba68-ab4638cd9758 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.339637 Nov 02 13:23:03.079043 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1435/2627] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:02 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:03.089177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:03.090036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:03.106134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.106872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.107986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.109375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.110004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.110609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.111911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:03.112695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:03.129836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.130559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.131359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.134005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.136865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.137533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.340701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.359971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.361605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.363010 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d6e31876-0155-42da-8919-18d1cfd3963b tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.293741 Nov 02 13:23:03.371860 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1193/2628] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:03 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:03.453345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:03.454029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:03.462408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.469009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.469589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.470065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.470758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.473075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.473555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.473883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.475689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:03.477761 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bad1adc9-bad7-40ba-b22f-6ad4246c27d8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.373478 Nov 02 13:23:03.492391 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1436/2629] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:03 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:23:03.506176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:03.507937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] [instance: cca7fedf-baa0-4492-8c62-61a6452889a9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:03.518132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.519431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.520030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.522276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:03.523420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:03.524011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:03.552936 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] HTTP exception thrown: Instance cca7fedf-baa0-4492-8c62-61a6452889a9 could not be found. Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Request method failure captured: Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 HTTP/1.1 Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0ZVeR7l59VgYfTuPmGoNwXlnTzUi5gTPV7amlO4g0iKLNdzbiDKhb0WDUMbUS430dmoRNS8hqS33LuvUfaJYQh3xsP6W8LhYMkz_r0OZfOvhdPELXnMx0Yi7Sx1C8wlxtO_nb7yzG6OzSamzNQkugrf4Hb9obUWcivgRacgh7q58k Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4d6fe1d935f34654baaeb1c8b48dda38 Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-LiveMigrationTest-49999660 Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:03.554927 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4d6fe1d935f34654baaeb1c8b48dda38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-LiveMigrationTest-49999660 Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4d6fe1d935f34654baaeb1c8b48dda38 Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-LiveMigrationTest-49999660 Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-LiveMigrationTest-49999660-project Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 392d81e9a1c74430a325c9ecc1dcfb44 Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-LiveMigrationTest-49999660-project Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance cca7fedf-baa0-4492-8c62-61a6452889a9 could not be found. Nov 02 13:23:03.556285 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'cca7fedf-baa0-4492-8c62-61a6452889a9'} Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca7fedf-baa0-4492-8c62-61a6452889a9 could not be found. Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:03.557151 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca7fedf-baa0-4492-8c62-61a6452889a9 could not be found. Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca7fedf-baa0-4492-8c62-61a6452889a9 could not be found. Nov 02 13:23:03.558784 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:03.560728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] Returning 404 to user: Instance cca7fedf-baa0-4492-8c62-61a6452889a9 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:03.561964 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-598ca9cc-008d-4e3b-846c-949e448be733 tempest-LiveMigrationTest-49999660 tempest-LiveMigrationTest-49999660-project] 10.222.0.113 "GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9" status: 404 len: 111 microversion: 2.1 time: 0.060179 Nov 02 13:23:03.563433 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1437/2630] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:03 2022] GET /compute/v2.1/servers/cca7fedf-baa0-4492-8c62-61a6452889a9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:23:04.089032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:04.090233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:04.128825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.131293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.133908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:04.137536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.141982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.144753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:04.204617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:04.231049 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-977a18d8-147a-4999-a4a5-e61807cccf5e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.782830 Nov 02 13:23:04.240428 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1194/2631] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:03 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:04.263877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:04.266897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:04.296312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.299135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.299972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:04.301321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.302077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.302832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:04.863997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:04.876385 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99f669ac-2839-4420-9f96-d6c689d4e8ca tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.633239 Nov 02 13:23:04.893574 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1195/2632] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:04 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:04.901788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:04.902958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:04.909606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.910579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.911380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:04.912278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:04.912883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:04.913456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:05.163428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:05.191419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:05.193278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:05.199254 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9735929a-59ba-42c0-a271-a26fe26ef646 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.302644 Nov 02 13:23:05.201404 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1196/2633] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:04 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:05.220784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:05.227566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:05.250976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:05.251561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:05.261277 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef1ca022-4ed4-40e8-95aa-43ec39c5be4c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 1.181893 Nov 02 13:23:05.262274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:05.262906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:05.263670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:05.264676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:05.265452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:05.265564 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1438/2634] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:04 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:05.266803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:05.274691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:05.275331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:05.294634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:05.295347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:05.295880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:05.296584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:05.299031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:05.299545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:05.501096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:05.511178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:05.512915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:05.514432 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d55d8292-e0b3-4042-8bfc-c9524a666b13 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.308740 Nov 02 13:23:05.519850 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1197/2635] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:05 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:05.673019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:05.684365 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-795c351f-c1fd-4c58-a289-088756e0a1f3 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.417697 Nov 02 13:23:05.687191 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1439/2636] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:05 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:05.908034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:05.909648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:05.927400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:05.929483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:05.930113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:05.931072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:05.931890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:05.932608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.233253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:06.235220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:06.249927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.251040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.253564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.254707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.255403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.256955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.342936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:06.363970 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-02aea6e7-6e3f-4b21-8d48-0759eda51f21 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.460322 Nov 02 13:23:06.365044 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1198/2637] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:05 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:06.379416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:06.380873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:06.411955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.415768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.418166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.430754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.431527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.432801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.458735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:06.475802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:06.477903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:06.483457 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e67b7867-a91f-4643-9371-9a32168ef7cc tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.254154 Nov 02 13:23:06.484595 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1440/2638] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:06 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:06.546687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:06.562828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:06.575172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.576018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.576955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.577936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.578608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.579326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.739627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:06.755911 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7427e1ce-599e-402f-96f1-78f95ade6369 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.389578 Nov 02 13:23:06.784967 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1199/2639] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:06 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:06.800154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:06.800823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:06.813825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.814897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.815669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.816634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:06.817973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:06.818696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:06.977723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:07.009209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:07.011513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:07.013539 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90d01b63-f363-4eea-aa5d-ce0d61a208e6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.475118 Nov 02 13:23:07.023247 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1441/2640] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:06 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:07.031210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ba06ce79-2658-4346-be70-7bd75fe78bae req-8c728ded-1c67-4ae0-a807-698f0bdc9f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb18f5b-6460-4586-bad8-2aef82839483", "name": "network-vif-plugged", "status": "completed", "tag": "6871b849-1b22-4f92-a5f2-404b61481d3b"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:07.047394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ba06ce79-2658-4346-be70-7bd75fe78bae req-8c728ded-1c67-4ae0-a807-698f0bdc9f68 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:07.053646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ba06ce79-2658-4346-be70-7bd75fe78bae req-8c728ded-1c67-4ae0-a807-698f0bdc9f68 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:07.054229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ba06ce79-2658-4346-be70-7bd75fe78bae req-8c728ded-1c67-4ae0-a807-698f0bdc9f68 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:07.075890 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ba06ce79-2658-4346-be70-7bd75fe78bae req-8c728ded-1c67-4ae0-a807-698f0bdc9f68 service nova] Creating event network-vif-plugged:6871b849-1b22-4f92-a5f2-404b61481d3b for instance 5bb18f5b-6460-4586-bad8-2aef82839483 on n-h1-858384-19 Nov 02 13:23:07.091779 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ba06ce79-2658-4346-be70-7bd75fe78bae req-8c728ded-1c67-4ae0-a807-698f0bdc9f68 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076253 Nov 02 13:23:07.092451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1442/2641] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:07.274782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:07.293010 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eab826d7-62cf-4e9a-be22-4caa8743deeb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.505666 Nov 02 13:23:07.298595 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1200/2642] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:06 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:07.392884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:07.394302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:07.405223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:07.408720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:07.409436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:07.411199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:07.413630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:07.415644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:07.513820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:07.514914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:07.527587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:07.529409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:07.531835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:07.533967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:07.534670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:07.536996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:07.735364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:07.747546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:07.753052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:07.754284 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-824c6a04-2223-40c5-b798-4afed6d48757 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.245164 Nov 02 13:23:07.771152 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1201/2643] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:07 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:07.792215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:07.792844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:07.804710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:07.806488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:07.807903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:07.812253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:07.815549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:07.816171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:07.890647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:07.908333 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1f4cfbaa-15af-42ef-b20c-d2f97bc3bdb9 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.519751 Nov 02 13:23:07.910135 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1443/2644] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:07 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:08.050553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:08.052798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:08.073113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:08.075337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:08.076178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:08.077331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:08.077906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:08.078590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:08.595667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:08.624098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:08.625730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:08.639624 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd737a97-5f40-4d89-8387-8aaba2a91ffa tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.596400 Nov 02 13:23:08.640251 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1444/2645] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:08 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:08.666783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:08.672432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:08.693673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:08.694664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:08.695431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:08.697502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:08.698371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:08.699017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:08.989947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:08.999913 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-03240dcb-4ffc-4b35-bcbe-dedcf2997147 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.353180 Nov 02 13:23:09.003329 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1445/2646] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:08 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:09.028452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:09.031774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:09.048107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:09.048614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:09.049069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:09.050472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:09.050945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:09.053097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:09.212375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:09.236003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:09.250015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b5684392-967d-4c5b-80ec-95e480119586 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 1.458457 Nov 02 13:23:09.252529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:09.255159 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1202/2647] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:07 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:09.275238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:09.280250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:09.280932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:09.281668 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d4812f0d-8c6d-497d-9cfc-538a3060fc35 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.266453 Nov 02 13:23:09.283318 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1446/2648] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:09 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:09.318267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:09.321784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:09.322225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:09.325266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:09.325903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:09.326492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:09.668646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:09.669273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:09.684114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:09.686742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:09.687744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:09.689235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:09.691998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:09.692927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:09.862468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:09.884564 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3c1128bc-ffa3-4cd4-860d-973929707981 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.626397 Nov 02 13:23:09.889066 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1203/2649] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:09 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:09.988932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:09.995272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:10.007066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:10.009341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:10.011656 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6abcb9be-d984-4311-967e-4725d16e0cf5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.350660 Nov 02 13:23:10.013324 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1447/2650] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:09 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:10.027615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:10.028257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:10.038672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.039214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.039667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:10.040394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.040860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.041916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:10.094342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:10.280322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:10.281021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:10.293399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.301605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.302988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:10.308381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.309331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.312329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:10.720183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:10.732268 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7bde22d9-4b1c-4e80-aa43-ebe401477c7c tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1326 microversion: 2.1 time: 0.456788 Nov 02 13:23:10.757982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1448/2651] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:10 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1326 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:10.765221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:10.766391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:10.778533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.779733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.780785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:10.782266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.783256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.784106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:10.811942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:10.815578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=16 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:10.833632 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d60564ad-044c-4d2b-b5a4-50d13167d1c9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.810012 Nov 02 13:23:10.836054 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1204/2652] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:10 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:10.885888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=14 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:10.929126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:10.934030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:10.963148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.965197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.966639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:10.975823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:10.978116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:10.980462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:11.021499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:11.039515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:11.054204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:11.060444 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6c231b06-68aa-4e9f-a18b-22209e2720da tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.300071 Nov 02 13:23:11.086077 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1449/2653] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:10 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:11.122413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:11.123321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:11.174510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:11.175429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:11.176260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:11.177501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:11.183982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:11.184656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:11.818569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:11.836763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-518f3dc0-9de6-4624-a68e-389ea7930175 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.917593 Nov 02 13:23:11.839363 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1205/2654] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:10 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:11.851159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:11.859368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:11.875235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:11.876583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:11.884371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:11.885534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:11.885779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:11.886505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:11.886672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:11.903103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:11.907143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:11.908356 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e2ae27a-da4a-4bc2-85d4-34b77836276c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.827988 Nov 02 13:23:11.909124 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1450/2655] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:11 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:11.919170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:11.919785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:11.937112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:11.937791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:11.938141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:11.938839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:11.944408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:11.945071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.149706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:12.191244 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d1f52371-ae77-4357-9476-253a30356a97 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1476 microversion: 2.1 time: 0.344847 Nov 02 13:23:12.195499 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1206/2656] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:11 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:12.201522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:12.213216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:12.247480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.258516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.259480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.263645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.264347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.265967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.282944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:12.321801 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e82ad2f0-36b5-4e85-8242-164b3f3c6684 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.409658 Nov 02 13:23:12.322478 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1451/2657] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:11 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:12.333758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:12.337559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:12.350752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.351697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.356018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.356960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.357708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.358293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.428834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lazy-loading 'flavor' on Instance uuid 5bb18f5b-6460-4586-bad8-2aef82839483 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:23:12.515958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:12.531658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:12.537143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:12.539821 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c117f0c-c6f7-44a5-9293-d2e5d6edbd74 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.342723 Nov 02 13:23:12.544308 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1207/2658] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:12 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:12.595134 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0dceef3b-0b63-410a-a58d-b49826f9bb4c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483/action" status: 202 len: 0 microversion: 2.1 time: 0.269057 Nov 02 13:23:12.600812 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1452/2659] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:23:12 2022] POST /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:23:12.604965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fb0445d8-ea4e-43c2-8ce2-09e4c8ff959f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:12.605780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fb0445d8-ea4e-43c2-8ce2-09e4c8ff959f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:12.621671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb0445d8-ea4e-43c2-8ce2-09e4c8ff959f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.623836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb0445d8-ea4e-43c2-8ce2-09e4c8ff959f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.626713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb0445d8-ea4e-43c2-8ce2-09e4c8ff959f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.627750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb0445d8-ea4e-43c2-8ce2-09e4c8ff959f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.630424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb0445d8-ea4e-43c2-8ce2-09e4c8ff959f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.631067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb0445d8-ea4e-43c2-8ce2-09e4c8ff959f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.866140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:12.867105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:12.884361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.889589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.890721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:12.892155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:12.893816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:12.894486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:13.596094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:13.611872 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd4ef0f1-a794-4a2a-99eb-adaecfa7edcb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.751719 Nov 02 13:23:13.612834 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1453/2660] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:12 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:13.622400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:13.623375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:13.636285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:13.639972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:13.645834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:13.648143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:13.648781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:13.655897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:13.800145 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fb0445d8-ea4e-43c2-8ce2-09e4c8ff959f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1637 microversion: 2.1 time: 1.199978 Nov 02 13:23:13.821159 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1208/2661] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:12 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1637 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:13.834832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a38360ab-6f13-4a0f-a664-326512731845 req-d607ab1a-1092-4127-8e12-11cebe1338ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3bac6c-ee78-42bb-bec5-d234e99c4f4a", "name": "network-vif-plugged", "status": "completed", "tag": "80f8ad8e-c5fe-4f0d-a64c-27e7e46de62e"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:13.865995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a38360ab-6f13-4a0f-a664-326512731845 req-d607ab1a-1092-4127-8e12-11cebe1338ad service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:13.866824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a38360ab-6f13-4a0f-a664-326512731845 req-d607ab1a-1092-4127-8e12-11cebe1338ad service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:13.867793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a38360ab-6f13-4a0f-a664-326512731845 req-d607ab1a-1092-4127-8e12-11cebe1338ad service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:13.885528 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a38360ab-6f13-4a0f-a664-326512731845 req-d607ab1a-1092-4127-8e12-11cebe1338ad service nova] Creating event network-vif-plugged:80f8ad8e-c5fe-4f0d-a64c-27e7e46de62e for instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a on n-h1-858384-19 Nov 02 13:23:13.905869 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a38360ab-6f13-4a0f-a664-326512731845 req-d607ab1a-1092-4127-8e12-11cebe1338ad service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082627 Nov 02 13:23:13.907263 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1209/2662] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:13.923139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:13.930260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:13.941783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:13.944909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:13.954865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:13.956389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:13.959986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:13.960675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:14.362066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:14.377646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:14.381847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:14.387258 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-98839495-c5ac-4589-b7c5-c169f21b59da tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.769848 Nov 02 13:23:14.389275 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1454/2663] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:13 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:14.395025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:14.395949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:14.404638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:14.405839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:14.406873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:14.408359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:14.413697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:14.414383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:14.614399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:14.637957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:14.648181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:14.649246 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11799acc-736d-44c6-8d49-a603afa18403 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.258707 Nov 02 13:23:14.658530 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1455/2664] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:14 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:14.688129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:14.689020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:14.696151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:14.698169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:14.698922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:14.699891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:14.700507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:14.701096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:14.827403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:14.840591 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c63c94fb-9ade-423f-bc89-4ec5c06b89cb tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.931134 Nov 02 13:23:14.842028 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1210/2665] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:13 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:14.846983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6ad9f702-f412-4239-9c55-171eb4900306 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:14.847826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6ad9f702-f412-4239-9c55-171eb4900306 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:14.855751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ad9f702-f412-4239-9c55-171eb4900306 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:14.856463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ad9f702-f412-4239-9c55-171eb4900306 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:14.857046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ad9f702-f412-4239-9c55-171eb4900306 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:14.857918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ad9f702-f412-4239-9c55-171eb4900306 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:14.858530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ad9f702-f412-4239-9c55-171eb4900306 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:14.859231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ad9f702-f412-4239-9c55-171eb4900306 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.026880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:15.038240 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da64f0b8-a22b-4d40-83af-7f934e9de103 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.378076 Nov 02 13:23:15.040447 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1456/2666] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:14 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:15.428062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:15.437374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:15.453927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.456046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.456991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.470147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.472024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.472739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.568440 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6ad9f702-f412-4239-9c55-171eb4900306 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1620 microversion: 2.1 time: 0.724822 Nov 02 13:23:15.569497 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1211/2667] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:14 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1620 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:15.593898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:15.596777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:15.605769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.606574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.607324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.608139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.609213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.610617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.683610 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] HTTP exception thrown: Cannot 'migrate' instance 5bb18f5b-6460-4586-bad8-2aef82839483 while it is in vm_state suspended Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Request method failure captured: Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483/action HTTP/1.1 Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 15 Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm8Kr20fkTQhhqZgZft7fl1egevmQ2tqIWzabiBdiBC3RbKaV3UcxLMN-f0RHtSmOzo1K6DLlXc1ygUkNt732N22rv5A4sXvbETNUnOR7o3JNRcYkP3znt_m02BUJbtSwj_ZK0LI3FNcSFfNi8SUa7cqTt-YzVVoX1iA6_fuVPt9Kdc Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:23:15.692886 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_f6f52a52515a476ba0763ec67f758772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e60fb02bdc914cf49cba17952e363a94 Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: {"migrate": {}} Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:23:15.694321 n-d-858384-19 devstack@n-api.service[120929]: exception: Cannot 'migrate' instance 5bb18f5b-6460-4586-bad8-2aef82839483 while it is in vm_state suspended Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '5bb18f5b-6460-4586-bad8-2aef82839483', 'body': {'migrate': {}}} Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bb18f5b-6460-4586-bad8-2aef82839483 in vm_state suspended. Cannot resize while the instance is in this state. Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:15.695198 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 5bb18f5b-6460-4586-bad8-2aef82839483 while it is in vm_state suspended Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:15.696460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:15.697673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:15.697673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:15.697673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 5bb18f5b-6460-4586-bad8-2aef82839483 while it is in vm_state suspended Nov 02 13:23:15.697673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:15.697673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Returning 409 to user: Cannot 'migrate' instance 5bb18f5b-6460-4586-bad8-2aef82839483 while it is in vm_state suspended {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:15.700489 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed5cb7c1-ca89-47ae-a601-5f1300909ad7 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483/action" status: 409 len: 148 microversion: 2.1 time: 0.109027 Nov 02 13:23:15.702784 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1212/2668] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:23:15 2022] POST /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483/action => generated 148 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:23:15.719862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:15.720679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:15.737946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.738440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.738881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.739836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.740521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.741133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.870139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:15.885648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:15.907876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:15.914419 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc35db11-ecda-46e1-ac5f-50bf6784af1d tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.494557 Nov 02 13:23:15.916741 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1457/2669] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:15 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:15.933134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:15.935424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:15.954324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:15.962139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.965629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:15.967997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.970740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.972640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:15.983139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:15.983868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:15.996200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:15.999059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:16.000334 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b71338be-322a-4418-aa13-b798c1bd0e5c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.295298 Nov 02 13:23:16.000899 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1213/2670] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:15 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:16.007466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-435e6d0d-b768-4a8c-8002-48d3afc2426c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-435e6d0d-b768-4a8c-8002-48d3afc2426c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Request method failure captured: Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af/action HTTP/1.1 Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 39 Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm8Kr20fkTQhhqZgZft7fl1egevmQ2tqIWzabiBdiBC3RbKaV3UcxLMN-f0RHtSmOzo1K6DLlXc1ygUkNt732N22rv5A4sXvbETNUnOR7o3JNRcYkP3znt_m02BUJbtSwj_ZK0LI3FNcSFfNi8SUa7cqTt-YzVVoX1iA6_fuVPt9Kdc Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:23:16.016992 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_f6f52a52515a476ba0763ec67f758772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e60fb02bdc914cf49cba17952e363a94 Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: {"os-resetState": {"state": "invalid"}} Nov 02 13:23:16.018411 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '49efb73e-85c5-419b-8ff0-9e1acd3921af', 'body': {'os-resetState': {'state': 'invalid'}}} Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:16.020689 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:23:16.021835 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 13:23:16.022817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.024474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-435e6d0d-b768-4a8c-8002-48d3afc2426c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:16.026189 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-435e6d0d-b768-4a8c-8002-48d3afc2426c tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af/action" status: 400 len: 144 microversion: 2.1 time: 0.023076 Nov 02 13:23:16.028327 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1214/2671] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:23:16 2022] POST /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af/action => generated 144 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:23:16.054595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:16.056835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:16.086619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:16.094327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:16.095539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:16.102789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:16.103920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:16.104427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:16.562923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:16.583026 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-331b0cb0-cfb7-47fe-92c6-0d06ff3f2174 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1399 microversion: 2.1 time: 0.553195 Nov 02 13:23:16.586485 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1215/2672] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:16 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1399 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:16.594033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-67d6ace3-d1fd-4357-bf90-efee46213c62 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-67d6ace3-d1fd-4357-bf90-efee46213c62 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Request method failure captured: Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af/action HTTP/1.1 Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 31 Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm8Kr20fkTQhhqZgZft7fl1egevmQ2tqIWzabiBdiBC3RbKaV3UcxLMN-f0RHtSmOzo1K6DLlXc1ygUkNt732N22rv5A4sXvbETNUnOR7o3JNRcYkP3znt_m02BUJbtSwj_ZK0LI3FNcSFfNi8SUa7cqTt-YzVVoX1iA6_fuVPt9Kdc Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:23:16.597846 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_f6f52a52515a476ba0763ec67f758772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e60fb02bdc914cf49cba17952e363a94 Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: {"os-resetState": {"state": 1}} Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:23:16.599880 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '49efb73e-85c5-419b-8ff0-9e1acd3921af', 'body': {'os-resetState': {'state': 1}}} Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 1 Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:16.600756 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 13:23:16.602126 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.612591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-67d6ace3-d1fd-4357-bf90-efee46213c62 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:16.615723 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-67d6ace3-d1fd-4357-bf90-efee46213c62 tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af/action" status: 400 len: 120 microversion: 2.1 time: 0.026036 Nov 02 13:23:16.623666 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1216/2673] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:23:16 2022] POST /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af/action => generated 120 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:23:16.637444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:16.642909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:16.678014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:16.678763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:16.679420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:16.680835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:16.682281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:16.684412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:16.815105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:16.828319 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd88aa26-ef37-498a-b7b2-026735bf63be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.906156 Nov 02 13:23:16.829365 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1458/2674] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:15 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:16.871765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5da2ba48-011a-43a9-890e-13402078cf8f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:16.878271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5da2ba48-011a-43a9-890e-13402078cf8f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Failed to fetch instance by id 999 {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:23:16.879312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-5da2ba48-011a-43a9-890e-13402078cf8f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5da2ba48-011a-43a9-890e-13402078cf8f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Request method failure captured: Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 37 Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm8Kr20fkTQhhqZgZft7fl1egevmQ2tqIWzabiBdiBC3RbKaV3UcxLMN-f0RHtSmOzo1K6DLlXc1ygUkNt732N22rv5A4sXvbETNUnOR7o3JNRcYkP3znt_m02BUJbtSwj_ZK0LI3FNcSFfNi8SUa7cqTt-YzVVoX1iA6_fuVPt9Kdc Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:23:16.892563 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_f6f52a52515a476ba0763ec67f758772"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/f6f52a52515a476ba0763ec67f758772"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: f6f52a52515a476ba0763ec67f758772 Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-165315983 Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e60fb02bdc914cf49cba17952e363a94 Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersAdminNegativeTestJSON-165315983-project-admin Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: {"os-resetState": {"state": "error"}} Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:23:16.893888 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 999 could not be found. Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:23:16.894562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 13:23:16.896107 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:16.899273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5da2ba48-011a-43a9-890e-13402078cf8f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:16.900275 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5da2ba48-011a-43a9-890e-13402078cf8f tempest-ServersAdminNegativeTestJSON-165315983 tempest-ServersAdminNegativeTestJSON-165315983-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.069629 Nov 02 13:23:16.901897 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1459/2675] 10.222.0.113 () {60 vars in 1184 bytes} [Wed Nov 2 13:23:16 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:23:16.907746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fbd4463d-09a7-4c61-b2f7-cf976ef852e2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-518662270"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:16.910396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fbd4463d-09a7-4c61-b2f7-cf976ef852e2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:16.919466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd4463d-09a7-4c61-b2f7-cf976ef852e2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:16.920304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd4463d-09a7-4c61-b2f7-cf976ef852e2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:16.920927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd4463d-09a7-4c61-b2f7-cf976ef852e2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:16.921870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd4463d-09a7-4c61-b2f7-cf976ef852e2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:16.922514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd4463d-09a7-4c61-b2f7-cf976ef852e2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:16.923257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd4463d-09a7-4c61-b2f7-cf976ef852e2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:17.219235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:17.235392 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0551f245-b624-4265-888b-e361afcf0dde tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.607697 Nov 02 13:23:17.236845 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1217/2676] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:16 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:17.245318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:17.246123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:17.255325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:17.256119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:17.256837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:17.257929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:17.259159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:17.260077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:17.294175 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fbd4463d-09a7-4c61-b2f7-cf976ef852e2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.390282 Nov 02 13:23:17.319461 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1460/2677] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:23:16 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 457 bytes (1 switches on core 0) Nov 02 13:23:17.351232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:17.357454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:17.373057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:23:17.411485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:17.413082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:17.414225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:17.416868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:17.418694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:17.421363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:17.574315 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6ff805fd-47f9-4477-9749-083d51a248c1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "DELETE /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 204 len: 0 microversion: 2.1 time: 0.333000 Nov 02 13:23:17.577352 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1218/2678] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:23:17 2022] DELETE /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:23:17.589139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:17.589894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:17.598145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:17.598723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:17.599264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:17.600057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:17.600519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:17.600949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:17.720737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:17.748636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:17.751483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:17.755340 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-76d2ad95-380b-43ba-b335-9c42f250422e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.172677 Nov 02 13:23:17.759593 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1219/2679] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:17 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:17.773868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:17.774764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:17.782591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:17.783370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:17.784206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:17.785235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:17.785864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:17.786614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:17.890173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:17.927149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:17.949647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:17.951824 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e36f9a2a-8ccd-447a-b83c-5f1d6184915a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.629997 Nov 02 13:23:17.964331 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1461/2680] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:17 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:17.993847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:17.995258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:18.054593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.055468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.056291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.057709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.058556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.059361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.151953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:18.223788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:18.237933 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e9e09603-f9bb-4066-bd0b-de5c13868dc5 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1473 microversion: 2.1 time: 0.475636 Nov 02 13:23:18.251827 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1220/2681] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:17 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1473 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:18.270217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:18.271101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:18.289736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.290373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.291406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.292258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.292615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.293071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.469818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:18.479777 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1f1960e3-de7b-4d08-85eb-10d38554ab03 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1580 microversion: 2.1 time: 0.496337 Nov 02 13:23:18.481438 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1462/2682] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:17 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1580 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:18.526567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca178d2a-d814-4e4e-87b5-4e1f7655c12f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:18.527901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ca178d2a-d814-4e4e-87b5-4e1f7655c12f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:18.540081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca178d2a-d814-4e4e-87b5-4e1f7655c12f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.542696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca178d2a-d814-4e4e-87b5-4e1f7655c12f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.544555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca178d2a-d814-4e4e-87b5-4e1f7655c12f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.547278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca178d2a-d814-4e4e-87b5-4e1f7655c12f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.550491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca178d2a-d814-4e4e-87b5-4e1f7655c12f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.551958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca178d2a-d814-4e4e-87b5-4e1f7655c12f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.763967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:18.777726 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a751f00-613f-4d8f-9af4-f7fdd6dd74f3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.512474 Nov 02 13:23:18.778495 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1221/2683] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:18 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:18.809156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:18.810007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:18.835655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.836410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.837214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.838892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:18.839807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:18.840497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:18.908529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:18.930613 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca178d2a-d814-4e4e-87b5-4e1f7655c12f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.412490 Nov 02 13:23:18.931614 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1463/2684] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:23:18 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a/os-interface => generated 284 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:23:19.000940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:19.001585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:19.011574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:19.013834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:19.014462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:19.018256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:19.018944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:19.019571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:19.121298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:19.143000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:19.144990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:19.146606 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff098e68-2fbc-4e9d-8b35-417adb89faac tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1410 microversion: 2.54 time: 0.343404 Nov 02 13:23:19.160572 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1222/2685] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:18 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1410 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:19.264497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:19.266272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:19.283944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:19.284822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:19.285482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:19.286440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:19.287373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:19.288027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:19.628326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:19.645265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:19.647038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:19.660681 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b7ba62e-e447-4230-87ab-2bb7169441b6 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1489 microversion: 2.25 time: 0.663739 Nov 02 13:23:19.661853 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1464/2686] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:18 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1489 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:23:19.750560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:19.763701 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b5aac37f-23d1-4d43-915d-eb83d056a60f tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1473 microversion: 2.1 time: 0.501391 Nov 02 13:23:19.767443 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1223/2687] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:19 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1473 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:19.785839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c7b03c62-c36b-4f94-8dec-b6ac0ee24367 req-c49e3d34-61e5-461d-b4b5-58803a6b6017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "name": "network-vif-unplugged", "status": "completed", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:19.827684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c7b03c62-c36b-4f94-8dec-b6ac0ee24367 req-c49e3d34-61e5-461d-b4b5-58803a6b6017 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:19.837206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c7b03c62-c36b-4f94-8dec-b6ac0ee24367 req-c49e3d34-61e5-461d-b4b5-58803a6b6017 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:19.838291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c7b03c62-c36b-4f94-8dec-b6ac0ee24367 req-c49e3d34-61e5-461d-b4b5-58803a6b6017 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:19.879668 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c7b03c62-c36b-4f94-8dec-b6ac0ee24367 req-c49e3d34-61e5-461d-b4b5-58803a6b6017 service nova] Creating event network-vif-unplugged:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:23:19.888807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68f68026-51ee-4e33-8a6a-280cca78b8dc tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] Calling method '.version_select at 0x7fe7879c9d30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:19.900180 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c7b03c62-c36b-4f94-8dec-b6ac0ee24367 req-c49e3d34-61e5-461d-b4b5-58803a6b6017 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130674 Nov 02 13:23:19.901876 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1224/2688] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:19.910013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:19.910933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:19.921854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:19.922611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:19.923317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:19.924238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:19.925667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:19.926443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.023258 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68f68026-51ee-4e33-8a6a-280cca78b8dc tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] 10.222.0.113 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.360030 Nov 02 13:23:20.024628 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1465/2689] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:23:19 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:20.038670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3a81920d-561a-47e0-b98f-74483315f8bc tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] Action: 'create', calling method: .version_select at 0x7fe787605940>, body: {"pool": "non_exist_pool"} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:20.125585 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3a81920d-561a-47e0-b98f-74483315f8bc tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] HTTP exception thrown: Floating IP pool not found. Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3a81920d-561a-47e0-b98f-74483315f8bc tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] Request method failure captured: Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 26 Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm9HNL_1rmxOCjDv-0DtiWHNAu2R9Wbzmy-3a08c3zBPT0Gm5hohTshYIkQAIblo31rIevWzhBSQwD9OwmRYA326goUqDdLLR5pMaMo5UnLpw461fm-hqoDm8dJI7asbX-_ugM8cJOOPuchKiO9I1CLN9i3Wf3J9OzdummHMPhanoCs Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 735ce29796264e2fb484fad0e494fb06 Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-449527742 Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:20.128145 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/735ce29796264e2fb484fad0e494fb06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/735ce29796264e2fb484fad0e494fb06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_735ce29796264e2fb484fad0e494fb06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/735ce29796264e2fb484fad0e494fb06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-449527742 Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 735ce29796264e2fb484fad0e494fb06 Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-449527742 Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FloatingIPsNegativeTestJSON-449527742-project Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: b51f64888b544c04a3acf475efa9f3b1 Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-449527742-project Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: {"pool": "non_exist_pool"} Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: exception: Floating IP pool not found. Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'pool': 'non_exist_pool'}} Nov 02 13:23:20.129592 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:20.130526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Nov 02 13:23:20.131907 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.133407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3a81920d-561a-47e0-b98f-74483315f8bc tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] Returning 404 to user: Floating IP pool not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:20.134473 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3a81920d-561a-47e0-b98f-74483315f8bc tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.099869 Nov 02 13:23:20.136194 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1466/2690] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:23:20 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:23:20.147460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff40b541-d25f-4f5a-9c5e-ff3d281d3a3d tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] Calling method '.version_select at 0x7fe78f97e0d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:20.195386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:20.204918 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-61277d94-6b4e-4b60-b6a9-807fdde1d39d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.301411 Nov 02 13:23:20.205534 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1225/2691] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:19 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:20.236905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:20.237951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:20.248932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-ff40b541-d25f-4f5a-9c5e-ff3d281d3a3d tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3908d472-3169-469d-8f24-84b1e7a4f2b7 could not be found", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:23:20.249992 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ff40b541-d25f-4f5a-9c5e-ff3d281d3a3d tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] HTTP exception thrown: Floating IP not found for ID 3908d472-3169-469d-8f24-84b1e7a4f2b7 Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff40b541-d25f-4f5a-9c5e-ff3d281d3a3d tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] Request method failure captured: Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-floating-ips/3908d472-3169-469d-8f24-84b1e7a4f2b7 HTTP/1.1 Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm9HNL_1rmxOCjDv-0DtiWHNAu2R9Wbzmy-3a08c3zBPT0Gm5hohTshYIkQAIblo31rIevWzhBSQwD9OwmRYA326goUqDdLLR5pMaMo5UnLpw461fm-hqoDm8dJI7asbX-_ugM8cJOOPuchKiO9I1CLN9i3Wf3J9OzdummHMPhanoCs Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 735ce29796264e2fb484fad0e494fb06 Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-449527742 Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:20.253578 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/735ce29796264e2fb484fad0e494fb06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/735ce29796264e2fb484fad0e494fb06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_735ce29796264e2fb484fad0e494fb06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/735ce29796264e2fb484fad0e494fb06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-449527742 Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 735ce29796264e2fb484fad0e494fb06 Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-449527742 Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FloatingIPsNegativeTestJSON-449527742-project Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: b51f64888b544c04a3acf475efa9f3b1 Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-449527742-project Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: exception: Floating IP not found for ID 3908d472-3169-469d-8f24-84b1e7a4f2b7 Nov 02 13:23:20.256127 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '3908d472-3169-469d-8f24-84b1e7a4f2b7'} Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:23:20.257459 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3908d472-3169-469d-8f24-84b1e7a4f2b7 could not be found Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-148f59d2-e5a7-464c-b273-ca0bf687575d'] Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3908d472-3169-469d-8f24-84b1e7a4f2b7. Nov 02 13:23:20.267220 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3908d472-3169-469d-8f24-84b1e7a4f2b7 Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:20.268579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:20.269843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:20.269843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3908d472-3169-469d-8f24-84b1e7a4f2b7 Nov 02 13:23:20.269843 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:20.269843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff40b541-d25f-4f5a-9c5e-ff3d281d3a3d tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] Returning 404 to user: Floating IP not found for ID 3908d472-3169-469d-8f24-84b1e7a4f2b7 {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:20.269843 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff40b541-d25f-4f5a-9c5e-ff3d281d3a3d tempest-FloatingIPsNegativeTestJSON-449527742 tempest-FloatingIPsNegativeTestJSON-449527742-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/3908d472-3169-469d-8f24-84b1e7a4f2b7" status: 404 len: 111 microversion: 2.1 time: 0.113050 Nov 02 13:23:20.269843 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1467/2692] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:23:20 2022] DELETE /compute/v2.1/os-floating-ips/3908d472-3169-469d-8f24-84b1e7a4f2b7 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:23:20.270234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.270234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.270234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.270792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.271896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.272340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.456499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:20.473027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:20.476463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:20.479427 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d636ea0-db06-46e7-8e34-aee3299bac08 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1416 microversion: 2.54 time: 0.252410 Nov 02 13:23:20.491605 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1226/2693] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:20 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1416 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:20.690060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:20.690972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:20.697685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.698633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.699265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.700198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.700810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.701392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.787812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:20.788511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:20.807253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.807761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.808215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:20.809877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:20.810392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:20.810840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.084812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:21.097291 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99056543-ecc2-4af8-824f-1173eb2939e8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 200 len: 1431 microversion: 2.1 time: 0.313373 Nov 02 13:23:21.098111 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1227/2694] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:20 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 1431 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:21.134554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-fdaf64f5-f06e-4633-825f-43efaf9df6ac req-6d96b2f3-0933-4495-9420-f974b3c69813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb18f5b-6460-4586-bad8-2aef82839483", "name": "network-vif-deleted", "tag": "6871b849-1b22-4f92-a5f2-404b61481d3b"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:21.146127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fdaf64f5-f06e-4633-825f-43efaf9df6ac req-6d96b2f3-0933-4495-9420-f974b3c69813 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.146863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fdaf64f5-f06e-4633-825f-43efaf9df6ac req-6d96b2f3-0933-4495-9420-f974b3c69813 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.147517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fdaf64f5-f06e-4633-825f-43efaf9df6ac req-6d96b2f3-0933-4495-9420-f974b3c69813 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.163516 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-fdaf64f5-f06e-4633-825f-43efaf9df6ac req-6d96b2f3-0933-4495-9420-f974b3c69813 service nova] Creating event network-vif-deleted:6871b849-1b22-4f92-a5f2-404b61481d3b for instance 5bb18f5b-6460-4586-bad8-2aef82839483 on n-h1-858384-19 Nov 02 13:23:21.169759 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-fdaf64f5-f06e-4633-825f-43efaf9df6ac req-6d96b2f3-0933-4495-9420-f974b3c69813 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039432 Nov 02 13:23:21.170964 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1228/2695] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:23:21.229899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:21.230856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:21.239780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.240435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.241058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.242239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.242971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.243710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.284594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:21.305425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:21.313428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:21.316879 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6125cdf3-53f9-4815-9379-f779ce0a8d3c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1479 microversion: 2.25 time: 0.631162 Nov 02 13:23:21.327163 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1468/2696] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:20 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1479 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:21.355420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-02da0c3d-9ce5-43a5-8ddb-b393e4237828 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '.version_select at 0x7fe787817790>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:21.361341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02da0c3d-9ce5-43a5-8ddb-b393e4237828 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.361834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02da0c3d-9ce5-43a5-8ddb-b393e4237828 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.362282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02da0c3d-9ce5-43a5-8ddb-b393e4237828 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.404129 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-02da0c3d-9ce5-43a5-8ddb-b393e4237828 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/os-migrations" status: 200 len: 1961 microversion: 2.25 time: 0.061037 Nov 02 13:23:21.416563 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1469/2697] 10.222.0.113 () {60 vars in 1189 bytes} [Wed Nov 2 13:23:21 2022] GET /compute/v2.1/os-migrations => generated 1961 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:21.436937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:21.437568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:21.456098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.467923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.469845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.471961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.472632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.473811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.517742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:21.532865 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2a6951ff-3d8c-4c46-a2cd-cd5d062085ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.308513 Nov 02 13:23:21.538579 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1229/2698] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:21 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:21.546414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:21.552938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:21.574370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.580249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.580881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.583963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:21.585373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:21.587136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:21.961971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] Lazy-loading 'services' on Instance uuid e2530d99-e7ea-486d-b401-f89aed63c82e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:23:21.995435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2cff643-b16d-498c-8238-74f54eb16900 tempest-LiveAutoBlockMigrationV225Test-30440270 tempest-LiveAutoBlockMigrationV225Test-30440270-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1973 microversion: 2.25 time: 0.574837 Nov 02 13:23:21.996371 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1470/2699] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:21 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1973 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:22.001174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:22.001778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:22.016521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.017341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.017906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.019443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.027697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.028303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.332425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:22.346484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:22.348364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:22.350182 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bbbd47a3-ac32-4643-bf0c-52ffe7beed67 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1416 microversion: 2.54 time: 0.810369 Nov 02 13:23:22.352035 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1230/2700] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:21 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1416 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:22.362442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-53b6f92e-e1f1-4a52-861d-1cbcfad650d6 req-a41c41b7-9a29-42fe-b4d5-adca121628a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3bac6c-ee78-42bb-bec5-d234e99c4f4a", "tag": "80f8ad8e-c5fe-4f0d-a64c-27e7e46de62e"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:22.365076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:22.378728 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b203e20e-a0aa-44e9-a077-77e64dcc8cb9 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1580 microversion: 2.1 time: 0.381239 Nov 02 13:23:22.379940 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1471/2701] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:21 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1580 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:22.392673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-53b6f92e-e1f1-4a52-861d-1cbcfad650d6 req-a41c41b7-9a29-42fe-b4d5-adca121628a5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.393932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:22.394584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-53b6f92e-e1f1-4a52-861d-1cbcfad650d6 req-a41c41b7-9a29-42fe-b4d5-adca121628a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.395151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-53b6f92e-e1f1-4a52-861d-1cbcfad650d6 req-a41c41b7-9a29-42fe-b4d5-adca121628a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.395462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:22.408053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.408806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.413096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.419485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.419980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.420426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.429014 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-53b6f92e-e1f1-4a52-861d-1cbcfad650d6 req-a41c41b7-9a29-42fe-b4d5-adca121628a5 service nova] Creating event network-changed:80f8ad8e-c5fe-4f0d-a64c-27e7e46de62e for instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a on n-h1-858384-19 Nov 02 13:23:22.446015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-53b6f92e-e1f1-4a52-861d-1cbcfad650d6 req-a41c41b7-9a29-42fe-b4d5-adca121628a5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092523 Nov 02 13:23:22.451238 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1231/2702] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:22.454200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:23:22.472866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:22.480539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 5bb18f5b-6460-4586-bad8-2aef82839483] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:22.499289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.500095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.502317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.504737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.506724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.507426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.552601 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] HTTP exception thrown: Instance 5bb18f5b-6460-4586-bad8-2aef82839483 could not be found. Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Request method failure captured: Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 HTTP/1.1 Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm8J-LhRsfhELHXO5YHcXHKfwyhtuP_bgB6RBVWkT_lIG3q8GVQ9kNNhHKRQLqCh4Kco9mAmOd3YaRAKYKGDFvx6TuKgdz5az-PsHcBSb5S1ojNxm9LLNXJ6yoFM3xxiBw1q5DCpn7KJsbL78CIIDhimfc1VIVGEp5BCvxCZNuQmpLE Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: a09bfd47abf24e90b9f9467161add600 Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1329914092 Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:23:22.555091 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a09bfd47abf24e90b9f9467161add600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a09bfd47abf24e90b9f9467161add600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a09bfd47abf24e90b9f9467161add600"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a09bfd47abf24e90b9f9467161add600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1329914092 Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: a09bfd47abf24e90b9f9467161add600 Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1329914092 Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersAdminNegativeTestJSON-1329914092-project Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 840589ef49c84995a89cf2b2c33f3e45 Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1329914092-project Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 5bb18f5b-6460-4586-bad8-2aef82839483 could not be found. Nov 02 13:23:22.556662 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '5bb18f5b-6460-4586-bad8-2aef82839483'} Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb18f5b-6460-4586-bad8-2aef82839483 could not be found. Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:22.557460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb18f5b-6460-4586-bad8-2aef82839483 could not be found. Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb18f5b-6460-4586-bad8-2aef82839483 could not be found. Nov 02 13:23:22.560497 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:22.568938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Returning 404 to user: Instance 5bb18f5b-6460-4586-bad8-2aef82839483 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:22.570014 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a356076c-e290-42df-aaa1-883d091602f8 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483" status: 404 len: 111 microversion: 2.1 time: 0.116784 Nov 02 13:23:22.574228 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1232/2703] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:22 2022] GET /compute/v2.1/servers/5bb18f5b-6460-4586-bad8-2aef82839483 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:23:22.583951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:22.595560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:22.617856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.618360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.621033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.621875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.622364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.622802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.656705 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0e001522-bbc2-47af-b7a1-aec3753f8853 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 204 len: 0 microversion: 2.25 time: 0.274255 Nov 02 13:23:22.669643 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1472/2704] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:22 2022] DELETE /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:23:22.694572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:22.695510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:22.711020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.711694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.712224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.715819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.716397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.716925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.752279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:23:22.903307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4df39bf1-1378-4b1c-8269-ec621e5e95bd tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "DELETE /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 204 len: 0 microversion: 2.1 time: 0.231888 Nov 02 13:23:22.904236 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1473/2705] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:23:22 2022] DELETE /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:23:22.910041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:22.910972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:22.921534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.923612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.924065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:22.924804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:22.925266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:22.925699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.196101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.206217 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6944629b-2144-4851-8e8e-241e0fb3b581 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.630700 Nov 02 13:23:23.206927 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1233/2706] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:22 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:23.221017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:23.222425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:23.236529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.237002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.241683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.242678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.243364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.244587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.319874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.330069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.338856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.341638 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a54ae7b4-6482-441e-a39d-539a117ca7b2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1485 microversion: 2.25 time: 0.436078 Nov 02 13:23:23.349697 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1474/2707] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:22 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1485 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:23.377971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:23.387598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:23.399921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.401564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.402160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.405133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:23.405800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:23.406410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:23.510382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.523059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.524894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.526485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8dfd34d-240e-4bd1-93d7-d50683054c26 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1416 microversion: 2.54 time: 0.152569 Nov 02 13:23:23.527664 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1475/2708] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:23 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1416 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:23.795671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:23.805239 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-59689d66-4462-455f-8671-dc938876f9fa tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1481 microversion: 2.1 time: 0.594532 Nov 02 13:23:23.815054 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1234/2709] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:23 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1481 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:24.254265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:24.262879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:24.307544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.308063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.308896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:24.309844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.313980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.318897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:24.376749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:24.377366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:24.389726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.390228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.392514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:24.394376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.395774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.397317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:24.689052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:24.710129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:24.720379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:24.721946 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-23020f86-c6da-42a4-a109-eb6120eb6019 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1485 microversion: 2.25 time: 0.349374 Nov 02 13:23:24.725019 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1235/2710] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:24 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1485 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:24.739504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:24.740392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:24.750813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.751358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.751795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:24.752519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.753121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.753703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:24.829063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:24.839846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:24.843670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:24.845111 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d7a6d9c-28f3-44d6-844d-c2ec45fa2dd6 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1416 microversion: 2.54 time: 0.118970 Nov 02 13:23:24.846109 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1236/2711] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:24 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1416 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:24.851102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:24.851890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:24.864632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.866241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.866758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:24.868392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:24.871454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:24.872775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:24.949231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:24.958340 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71887efd-b142-4c6b-bc50-2f00fdfbc86f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.731385 Nov 02 13:23:24.959409 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1476/2712] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:24 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:25.109650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:25.123456 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-70d9654d-ba14-4a19-bb12-d785dad1bf15 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1481 microversion: 2.1 time: 0.276094 Nov 02 13:23:25.124292 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1237/2713] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:24 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1481 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:25.752453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:25.753341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:25.780200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:25.780797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:25.781638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:25.782712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:25.784675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:25.785444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:25.873210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:25.873840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:25.887792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:25.888580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:25.889237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:25.890167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:25.890812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:25.891507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:26.001234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:26.010815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:26.017220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:26.021249 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb55ea86-161b-4e75-b461-50128d4709bd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1485 microversion: 2.25 time: 0.271248 Nov 02 13:23:26.023754 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1477/2714] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:25 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1485 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:26.035750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:26.037530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:26.053390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:26.053893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:26.054340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:26.055169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:26.055621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:26.056016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:26.097163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:26.112759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:26.114867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:26.116324 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b3e88f0c-1410-472a-be86-85f418889794 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1416 microversion: 2.54 time: 0.248087 Nov 02 13:23:26.116892 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1238/2715] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:25 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1416 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:26.148769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:26.149656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:26.164940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:26.165642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:26.166905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:26.180469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:26.181126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:26.183051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:26.235175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:26.245186 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9a78fdbf-d880-4757-97a8-6f658d3982ad tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.220072 Nov 02 13:23:26.247061 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1478/2716] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:26 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:26.285085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f147f5d4-3249-4837-9087-3cc8895b342d req-b46a53ba-f98b-484c-aa35-7803dd7860ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "name": "network-vif-plugged", "status": "completed", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:26.295313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f147f5d4-3249-4837-9087-3cc8895b342d req-b46a53ba-f98b-484c-aa35-7803dd7860ea service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:26.295797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f147f5d4-3249-4837-9087-3cc8895b342d req-b46a53ba-f98b-484c-aa35-7803dd7860ea service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:26.296545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f147f5d4-3249-4837-9087-3cc8895b342d req-b46a53ba-f98b-484c-aa35-7803dd7860ea service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:26.310019 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f147f5d4-3249-4837-9087-3cc8895b342d req-b46a53ba-f98b-484c-aa35-7803dd7860ea service nova] Creating event network-vif-plugged:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:23:26.316072 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f147f5d4-3249-4837-9087-3cc8895b342d req-b46a53ba-f98b-484c-aa35-7803dd7860ea service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035559 Nov 02 13:23:26.317230 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1479/2717] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:23:26.500891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:26.518866 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0979893a-2472-4923-ab29-8e59b00ea7db tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1481 microversion: 2.1 time: 0.373369 Nov 02 13:23:26.518866 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1239/2718] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:26 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1481 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:26.660529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6af9d274-0ff6-4236-a7b6-35cce3c4b4e3 tempest-NetworksTest-1958549863 tempest-NetworksTest-1958549863-project-admin] Calling method '.version_select at 0x7fe786e84160>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:26.990236 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6af9d274-0ff6-4236-a7b6-35cce3c4b4e3 tempest-NetworksTest-1958549863 tempest-NetworksTest-1958549863-project-admin] 10.222.0.113 "GET /compute/v2.1/os-networks" status: 200 len: 6055 microversion: 2.1 time: 0.578539 Nov 02 13:23:26.999227 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1480/2719] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:23:26 2022] GET /compute/v2.1/os-networks => generated 6055 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:27.001012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-955bc7fa-1cae-414e-b55b-f99c79969caf tempest-NetworksTest-1958549863 tempest-NetworksTest-1958549863-project-admin] Calling method '.version_select at 0x7fe787cd10d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:27.055256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:27.059812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:27.073456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.074775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.075909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.077494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.078880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.080442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.102900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:27.280450 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-955bc7fa-1cae-414e-b55b-f99c79969caf tempest-NetworksTest-1958549863 tempest-NetworksTest-1958549863-project-admin] 10.222.0.113 "GET /compute/v2.1/os-networks/0f797fad-face-4759-a2f5-da28966ec454" status: 200 len: 652 microversion: 2.1 time: 0.284026 Nov 02 13:23:27.281241 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1240/2720] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:23:26 2022] GET /compute/v2.1/os-networks/0f797fad-face-4759-a2f5-da28966ec454 => generated 652 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:23:27.298881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:27.299586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:27.306157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.307291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.313534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.314420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.314916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.315388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.436418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:27.448876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:27.450851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:27.452635 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5be3cca8-63c3-4108-ae94-7d6f588c6608 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1416 microversion: 2.54 time: 0.160283 Nov 02 13:23:27.453581 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1241/2721] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:27 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1416 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:27.474107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:27.475564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:27.483390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.484112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.484640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.485441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.486133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.486680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.504120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:27.529183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:27.539363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:27.541806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:27.543351 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-52bfbe37-03a7-4ba1-a82a-6d436c6951f7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1485 microversion: 2.25 time: 0.496922 Nov 02 13:23:27.543927 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1481/2722] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:27 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1485 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:27.549290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1fdcba4f-582c-4508-ac13-7e9315281b6d tempest-NetworksTest-1958549863 tempest-NetworksTest-1958549863-project-admin] Calling method '.version_select at 0x7fe787bb5af0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:27.725420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:27.735501 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ade7daa0-56e5-4a17-b930-8e09f3fac029 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.280510 Nov 02 13:23:27.751145 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1242/2723] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:27 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:27.751373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:27.751946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:27.758918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.760482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.761016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.762975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.763537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.763984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.870688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:27.880530 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af1eb274-dc0e-4f95-a143-51ea06070146 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1439 microversion: 2.1 time: 0.133821 Nov 02 13:23:27.881873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1243/2724] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:27 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1439 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:27.906045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-73aba5c0-6a86-4676-9302-bfa6b5db2623 req-ee2291ad-cfc6-4fe4-bf9b-47e4f509650d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49efb73e-85c5-419b-8ff0-9e1acd3921af", "name": "network-vif-deleted", "tag": "95fee841-9ace-4f66-9aa6-6c27f8f4632c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:27.920343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-73aba5c0-6a86-4676-9302-bfa6b5db2623 req-ee2291ad-cfc6-4fe4-bf9b-47e4f509650d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:27.920888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-73aba5c0-6a86-4676-9302-bfa6b5db2623 req-ee2291ad-cfc6-4fe4-bf9b-47e4f509650d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:27.921823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-73aba5c0-6a86-4676-9302-bfa6b5db2623 req-ee2291ad-cfc6-4fe4-bf9b-47e4f509650d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:27.936007 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-73aba5c0-6a86-4676-9302-bfa6b5db2623 req-ee2291ad-cfc6-4fe4-bf9b-47e4f509650d service nova] Creating event network-vif-deleted:95fee841-9ace-4f66-9aa6-6c27f8f4632c for instance 49efb73e-85c5-419b-8ff0-9e1acd3921af on n-h2-858384-19 Nov 02 13:23:27.941479 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-73aba5c0-6a86-4676-9302-bfa6b5db2623 req-ee2291ad-cfc6-4fe4-bf9b-47e4f509650d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039832 Nov 02 13:23:27.945721 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1244/2725] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:28.217400 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1fdcba4f-582c-4508-ac13-7e9315281b6d tempest-NetworksTest-1958549863 tempest-NetworksTest-1958549863-project-admin] 10.222.0.113 "GET /compute/v2.1/os-networks" status: 200 len: 6055 microversion: 2.1 time: 0.671005 Nov 02 13:23:28.218158 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1482/2726] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:23:27 2022] GET /compute/v2.1/os-networks => generated 6055 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:28.487492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:28.489886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:28.491560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-86e50f21-9d43-4e7a-ad7f-b45286d739bb req-069e58fc-fa63-45c8-96d2-17d6fe435a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2530d99-e7ea-486d-b401-f89aed63c82e", "name": "network-vif-deleted", "tag": "fe4a5830-b144-45ec-8ce0-87d6e72d593f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:28.518548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-86e50f21-9d43-4e7a-ad7f-b45286d739bb req-069e58fc-fa63-45c8-96d2-17d6fe435a5d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:28.518767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:28.518869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-86e50f21-9d43-4e7a-ad7f-b45286d739bb req-069e58fc-fa63-45c8-96d2-17d6fe435a5d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:28.519087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-86e50f21-9d43-4e7a-ad7f-b45286d739bb req-069e58fc-fa63-45c8-96d2-17d6fe435a5d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:28.519608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:28.521436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:28.522839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:28.524668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:28.525354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:28.536493 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-86e50f21-9d43-4e7a-ad7f-b45286d739bb req-069e58fc-fa63-45c8-96d2-17d6fe435a5d service nova] Creating event network-vif-deleted:fe4a5830-b144-45ec-8ce0-87d6e72d593f for instance e2530d99-e7ea-486d-b401-f89aed63c82e on n-h2-858384-19 Nov 02 13:23:28.558771 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-86e50f21-9d43-4e7a-ad7f-b45286d739bb req-069e58fc-fa63-45c8-96d2-17d6fe435a5d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071526 Nov 02 13:23:28.560120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1483/2727] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:28.588631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:28.594442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:28.626429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:28.627349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:28.629373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:28.630540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:28.632301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:28.632856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:28.669835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:28.682875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:28.685072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:28.714170 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d756949-8409-4b2e-98f0-66b4aeffea38 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1401 microversion: 2.54 time: 0.232531 Nov 02 13:23:28.724781 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1245/2728] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:28 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1401 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:23:28.756944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a45eb02d-43aa-42de-9cbe-6dc981f97f45 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '.version_select at 0x7fe78fa8c4c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:28.773827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:28.794620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:28.798997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:28.803130 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a45eb02d-43aa-42de-9cbe-6dc981f97f45 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-244583278" status: 204 len: 0 microversion: 2.54 time: 0.050129 Nov 02 13:23:28.806847 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1246/2729] 10.222.0.113 () {60 vars in 1321 bytes} [Wed Nov 2 13:23:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-244583278 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:23:28.810819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:28.814322 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c7680fc2-6645-4cf9-8ca1-9cc26dcefb07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1268 microversion: 2.25 time: 0.233466 Nov 02 13:23:28.823896 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1484/2730] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:28 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1268 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:28.831848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:28.833259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:28.847318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:28.853339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:28.856709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:28.857264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:28.857417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:28.858968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:28.862375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:28.867399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:28.868098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:28.868635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:28.869426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:28.870490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:28.871019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:28.875912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:28.966787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:23:29.167349 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f23ddd5c-0457-434f-a74a-8fa01c016b6c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "DELETE /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 204 len: 0 microversion: 2.54 time: 0.340842 Nov 02 13:23:29.167970 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1485/2731] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:28 2022] DELETE /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:23:29.194922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:29.196457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:29.207513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:29.208390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:29.211482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:29.213271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:29.214025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:29.215097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:29.272592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:29.273229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:29.274700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:29.275754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lazy-loading 'fault' on Instance uuid 49efb73e-85c5-419b-8ff0-9e1acd3921af {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:23:29.386223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:29.409872 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-898a855a-60e9-40ca-919c-7fa9888d8576 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1316 microversion: 2.1 time: 0.232449 Nov 02 13:23:29.410904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1486/2732] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:29 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:29.454758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:29.456318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:29.484384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:29.509189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:29.510007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:29.510613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:29.512100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:29.512818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:29.513413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:29.522410 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-82bd3f6c-781a-4680-b7eb-7964bf57d348 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.711326 Nov 02 13:23:29.524810 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1247/2733] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:28 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:29.605650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:29.618380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:29.621498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:29.623282 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2537fbd-3db3-4e6c-8a63-289345916925 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1407 microversion: 2.54 time: 0.197814 Nov 02 13:23:29.624792 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1487/2734] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:29 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:29.859637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:29.860531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:29.868183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:29.868806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:29.869476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:29.870767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:29.871473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:29.872106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:29.973305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:29.984603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:29.986948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:29.989444 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5bbd6c90-d0ca-47c4-95cd-cd5c253112c9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1268 microversion: 2.25 time: 0.134572 Nov 02 13:23:29.991483 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1248/2735] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:29 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1268 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:23:30.452264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:30.452950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:30.461275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.461764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.462196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.464075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.464831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.465744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.504609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.505716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.506412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.507032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lazy-loading 'fault' on Instance uuid 49efb73e-85c5-419b-8ff0-9e1acd3921af {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:23:30.546042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:30.547700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:30.562271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.565023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.565594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.567357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.569607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.572595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.593159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '840589ef49c84995a89cf2b2c33f3e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09bfd47abf24e90b9f9467161add600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:30.602796 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f83066f9-bc88-4a8c-80ec-3f0ac2b07c64 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 200 len: 1316 microversion: 2.1 time: 0.156903 Nov 02 13:23:30.604421 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1488/2736] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:30 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:30.656214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:30.657231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:30.664103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.665270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.666015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.667243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:30.667939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:30.668743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:30.801586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:30.816176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:30.823337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:30.825762 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8868a0c-6e78-43e7-bcfb-a5be437c806c tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1407 microversion: 2.54 time: 0.176051 Nov 02 13:23:30.847207 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1489/2737] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:30 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:30.850192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:30.861839 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c1c450ff-48ec-4be2-844f-80035235917e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.319982 Nov 02 13:23:30.867763 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1249/2738] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:30 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:31.031834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:31.032641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:31.050128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:31.050581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:31.051057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:31.051808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:31.052269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:31.052704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:31.138542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:31.139216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-146a1c7f-65d3-4b99-9855-d8d26086580d tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Calling method '.version_select at 0x7fe78fa3f160>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:31.149240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:31.152400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:31.153567 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e49adf25-6a5b-4bdb-8e58-c62d181d7099 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1268 microversion: 2.25 time: 0.126549 Nov 02 13:23:31.154471 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1490/2739] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:31 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1268 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:31.200512 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-146a1c7f-65d3-4b99-9855-d8d26086580d tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b" status: 200 len: 640 microversion: 2.1 time: 0.065564 Nov 02 13:23:31.201290 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1250/2740] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:23:31 2022] GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b => generated 640 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:31.218324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93c7de54-950c-44e2-a186-098c36a2c8b5 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Action: 'update_all', calling method: .version_select at 0x7fe78f955700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:31.280008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-93c7de54-950c-44e2-a186-098c36a2c8b5 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:31.286910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-93c7de54-950c-44e2-a186-098c36a2c8b5 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for user 7a3a6277ea6f44f192e46cec7850d3ce and project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:31.450921 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:23:31.451453 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 13:23:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata (ip 10.222.0.113) !!! Nov 02 13:23:31.627860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:31.628487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] [instance: 49efb73e-85c5-419b-8ff0-9e1acd3921af] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:31.643008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:31.645135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:31.645853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:31.650825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:31.652019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:31.652951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:31.703391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] HTTP exception thrown: Instance 49efb73e-85c5-419b-8ff0-9e1acd3921af could not be found. Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Request method failure captured: Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af HTTP/1.1 Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm8J-LhRsfhELHXO5YHcXHKfwyhtuP_bgB6RBVWkT_lIG3q8GVQ9kNNhHKRQLqCh4Kco9mAmOd3YaRAKYKGDFvx6TuKgdz5az-PsHcBSb5S1ojNxm9LLNXJ6yoFM3xxiBw1q5DCpn7KJsbL78CIIDhimfc1VIVGEp5BCvxCZNuQmpLE Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: a09bfd47abf24e90b9f9467161add600 Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1329914092 Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:23:31.715680 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a09bfd47abf24e90b9f9467161add600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a09bfd47abf24e90b9f9467161add600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a09bfd47abf24e90b9f9467161add600"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a09bfd47abf24e90b9f9467161add600"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1329914092 Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: a09bfd47abf24e90b9f9467161add600 Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1329914092 Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersAdminNegativeTestJSON-1329914092-project Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 840589ef49c84995a89cf2b2c33f3e45 Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1329914092-project Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 49efb73e-85c5-419b-8ff0-9e1acd3921af could not be found. Nov 02 13:23:31.717977 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '49efb73e-85c5-419b-8ff0-9e1acd3921af'} Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49efb73e-85c5-419b-8ff0-9e1acd3921af could not be found. Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:31.720226 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49efb73e-85c5-419b-8ff0-9e1acd3921af could not be found. Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49efb73e-85c5-419b-8ff0-9e1acd3921af could not be found. Nov 02 13:23:31.725832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:23:31.733203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] Returning 404 to user: Instance 49efb73e-85c5-419b-8ff0-9e1acd3921af could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:31.734917 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8dc89ef1-0641-4ce9-b25e-6386e548fda1 tempest-ServersAdminNegativeTestJSON-1329914092 tempest-ServersAdminNegativeTestJSON-1329914092-project] 10.222.0.113 "GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af" status: 404 len: 111 microversion: 2.1 time: 0.111078 Nov 02 13:23:31.738362 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1251/2741] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:31 2022] GET /compute/v2.1/servers/49efb73e-85c5-419b-8ff0-9e1acd3921af => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:23:31.745677 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93c7de54-950c-44e2-a186-098c36a2c8b5 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.532436 Nov 02 13:23:31.753637 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1491/2742] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:31 2022] PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 61 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:31.798354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a119397-052e-4da4-ab42-73edab2d3e89 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Calling method '.version_select at 0x7fe78fa86dc0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:31.872189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:31.888557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:31.917312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:31.917756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:31.918191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:31.940621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:31.941427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:31.942158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:32.104823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:32.105385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:32.105917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:32.106516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lazy-loading 'fault' on Instance uuid cc7b03a6-c0f3-44db-8844-e264df56fa59 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:23:32.269546 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a119397-052e-4da4-ab42-73edab2d3e89 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "DELETE /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.507124 Nov 02 13:23:32.270745 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1252/2743] 10.222.0.113 () {58 vars in 1301 bytes} [Wed Nov 2 13:23:31 2022] DELETE /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata/os_version => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:23:32.277332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:32.278620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:32.286935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:32.287459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:32.288151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:32.289038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:32.289496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:32.289922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:32.521686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:32.543899 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-64645b56-cf58-4c12-b5d6-79c02150ee4e tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.270721 Nov 02 13:23:32.544936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:32.546926 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1253/2744] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:32 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:32.567806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:32.573941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:32.576916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:32.578324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b74e791b27834967907219a598d774c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eba590922db34f0ea123d02c6a5f941a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:32.579808 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-08d3bd94-a773-48db-a4ec-fc7421545e6e tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 200 len: 1412 microversion: 2.54 time: 0.726510 Nov 02 13:23:32.580526 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1492/2745] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:31 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 1412 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:32.584234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:32.584720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:32.585159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:32.585921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:32.586628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:32.586878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b5af6ea-2b4e-4e9e-aec0-0ccdf9e767ac tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Calling method '.version_select at 0x7fe78f93fee0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:32.587126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:32.663804 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b5af6ea-2b4e-4e9e-aec0-0ccdf9e767ac tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 37 microversion: 2.1 time: 0.081978 Nov 02 13:23:32.672714 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1493/2746] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:23:32 2022] GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 37 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:32.677980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6d9f27e-37c0-4dad-a2f7-c69bed81df6b tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Action: 'update_all', calling method: .version_select at 0x7fe787cd4c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:32.742249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:32.806323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:32.810640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:32.820479 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cdafcef6-1e82-4acb-af73-c5f08af89a07 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1268 microversion: 2.25 time: 0.260195 Nov 02 13:23:32.822154 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1254/2747] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:32 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1268 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:32.824853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e6d9f27e-37c0-4dad-a2f7-c69bed81df6b tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:32.840012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e6d9f27e-37c0-4dad-a2f7-c69bed81df6b tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for user 7a3a6277ea6f44f192e46cec7850d3ce and project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:33.434558 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6d9f27e-37c0-4dad-a2f7-c69bed81df6b tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.759376 Nov 02 13:23:33.434558 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1494/2748] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:32 2022] PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 61 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:33.445910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ca7272b-610b-483a-991b-d85d72c4b69e tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Calling method '.version_select at 0x7fe787c13dc0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:33.501319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ca7272b-610b-483a-991b-d85d72c4b69e tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.061034 Nov 02 13:23:33.502484 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1255/2749] 10.222.0.113 () {58 vars in 1295 bytes} [Wed Nov 2 13:23:33 2022] GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata/os_distro => generated 33 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:33.521790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74b9b25e-6071-4e03-a134-7ff1e8107928 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Action: 'update_all', calling method: .version_select at 0x7fe78f93f4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:33.576234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:33.576864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:33.587230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:33.587666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:33.588226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-74b9b25e-6071-4e03-a134-7ff1e8107928 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:33.588313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:33.588932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:33.589392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:33.589819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:33.596685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-74b9b25e-6071-4e03-a134-7ff1e8107928 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for user 7a3a6277ea6f44f192e46cec7850d3ce and project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:33.630212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:33.847690 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74b9b25e-6071-4e03-a134-7ff1e8107928 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.337983 Nov 02 13:23:33.852516 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1495/2750] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:33 2022] PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 61 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:33.858347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:33.860694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] [instance: cc7b03a6-c0f3-44db-8844-e264df56fa59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:33.874739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:33.875286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:33.875750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:33.879506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:33.880405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:33.881436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:33.882841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:33.905726 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e7e4fb57-0977-4fc2-9e66-0f4143911957 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.323569 Nov 02 13:23:33.907344 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] HTTP exception thrown: Instance cc7b03a6-c0f3-44db-8844-e264df56fa59 could not be found. Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Request method failure captured: Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 HTTP/1.1 Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm8Td8gx1ScGSroyathqT6P6jsHOBZnnpl3oVhiuAxw5kgC3wTC8ZkrZhaCYb4jb68MzjtU6bovIN6ujz5868bS9mN--3dOVME3Zl_EBfGyiZGmCwWmfbN4Au9O_gshR8A8J0waR4QKp5PuHqlJyt9jiws2gosXU_WQTGO5HkogPUXw Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.54 Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: eba590922db34f0ea123d02c6a5f941a Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerShowV254Test-669837190 Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:33.909544 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/eba590922db34f0ea123d02c6a5f941a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/eba590922db34f0ea123d02c6a5f941a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_eba590922db34f0ea123d02c6a5f941a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/eba590922db34f0ea123d02c6a5f941a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerShowV254Test-669837190 Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: eba590922db34f0ea123d02c6a5f941a Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerShowV254Test-669837190 Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerShowV254Test-669837190-project Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: b74e791b27834967907219a598d774c6 Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerShowV254Test-669837190-project Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance cc7b03a6-c0f3-44db-8844-e264df56fa59 could not be found. Nov 02 13:23:33.911042 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'cc7b03a6-c0f3-44db-8844-e264df56fa59'} Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7b03a6-c0f3-44db-8844-e264df56fa59 could not be found. Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:33.912086 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7b03a6-c0f3-44db-8844-e264df56fa59 could not be found. Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7b03a6-c0f3-44db-8844-e264df56fa59 could not be found. Nov 02 13:23:33.913423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:33.916358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] Returning 404 to user: Instance cc7b03a6-c0f3-44db-8844-e264df56fa59 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:33.917979 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0a94ff94-1fb9-4f64-8de9-caa0415c8016 tempest-ServerShowV254Test-669837190 tempest-ServerShowV254Test-669837190-project] 10.222.0.113 "GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59" status: 404 len: 111 microversion: 2.54 time: 0.063453 Nov 02 13:23:33.920725 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1496/2751] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:33 2022] GET /compute/v2.1/servers/cc7b03a6-c0f3-44db-8844-e264df56fa59 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:23:33.925556 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1256/2752] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:33 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:33.929340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:33.930415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:33.937121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:33.937623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:33.938067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:33.938799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:33.939365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:33.939945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:33.940858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1afbd413-9853-407d-9f11-d57ae2d89ada tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Calling method '.version_select at 0x7fe78fa7d430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:34.044619 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1afbd413-9853-407d-9f11-d57ae2d89ada tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.113670 Nov 02 13:23:34.046806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1257/2753] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:23:33 2022] GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 61 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:34.060505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a4319df-75f0-4a65-906d-5af7f71e584f tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Action: 'update_all', calling method: .version_select at 0x7fe78fa3f160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:34.086242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:34.100136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:34.102550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:34.104841 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-451e03c4-ed53-4758-82a4-0f1ec0b72eff tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1268 microversion: 2.25 time: 0.182893 Nov 02 13:23:34.105762 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1497/2754] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:33 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:34.818463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4a4319df-75f0-4a65-906d-5af7f71e584f tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:34.842116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4a4319df-75f0-4a65-906d-5af7f71e584f tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for user 7a3a6277ea6f44f192e46cec7850d3ce and project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:34.938239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:34.939020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:34.970802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:34.971726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:34.975039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:34.980020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:34.980875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:34.984352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:35.176695 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a4319df-75f0-4a65-906d-5af7f71e584f tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 61 microversion: 2.1 time: 1.120681 Nov 02 13:23:35.183553 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1258/2755] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:34 2022] PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 61 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 13:23:35.189894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:35.190900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:35.202302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:35.203190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:35.203868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:35.205479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:35.206168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:35.207356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:35.345061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:35.374193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:35.384740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:35.388940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:35.391641 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7ec10be-9a99-4da1-8921-29872a78e142 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1268 microversion: 2.25 time: 0.206068 Nov 02 13:23:35.411244 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1259/2756] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:35 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1268 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:35.415980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-28d54d75-7dee-4c45-9902-2aafa45f4b58 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Action: 'update_all', calling method: .version_select at 0x7fe787d104c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:35.420274 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3d2ce02d-8919-4d44-bbee-9813dc56b4b5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1522 microversion: 2.1 time: 0.482819 Nov 02 13:23:35.422964 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1498/2757] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:34 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:35.541007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-28d54d75-7dee-4c45-9902-2aafa45f4b58 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:35.566945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-28d54d75-7dee-4c45-9902-2aafa45f4b58 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for user 7a3a6277ea6f44f192e46cec7850d3ce and project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:36.348377 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-28d54d75-7dee-4c45-9902-2aafa45f4b58 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.949544 Nov 02 13:23:36.348986 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1260/2758] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:35 2022] PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 64 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:36.360204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b39526e8-7502-44d9-8c5b-efce75c1680c tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Calling method '.version_select at 0x7fe786e56af0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:36.427355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:36.427994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:36.443552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b39526e8-7502-44d9-8c5b-efce75c1680c tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.087700 Nov 02 13:23:36.445102 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1499/2759] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:23:36 2022] GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 64 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:36.456281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:36.460131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:36.462040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:36.464100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:36.464620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:36.465396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:36.465878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:36.466324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:36.473505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:36.474582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:36.475772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:36.476760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:36.477477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:36.478923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:36.521306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:36.522026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:36.522628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:36.523322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lazy-loading 'fault' on Instance uuid e2530d99-e7ea-486d-b401-f89aed63c82e {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:23:36.642604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:36.675837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:36.678229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:36.680346 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8dde37c9-f1ee-4944-9c49-cbbddd8aceb1 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1273 microversion: 2.25 time: 0.256994 Nov 02 13:23:36.682617 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1261/2760] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:36 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1273 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:36.689836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f441099-2372-401d-87c9-5519c2f0e7ef tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Action: 'update_all', calling method: .version_select at 0x7fe787ef4c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:36.806306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:36.813137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1f441099-2372-401d-87c9-5519c2f0e7ef tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:36.818074 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17d68feb-6fe7-46ac-a432-9dd8a818efe8 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1528 microversion: 2.1 time: 0.368957 Nov 02 13:23:36.819320 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1500/2761] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:36 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1528 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:36.825925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1f441099-2372-401d-87c9-5519c2f0e7ef tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for user 7a3a6277ea6f44f192e46cec7850d3ce and project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:37.642092 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1f441099-2372-401d-87c9-5519c2f0e7ef tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.956594 Nov 02 13:23:37.643687 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1262/2762] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:36 2022] PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 61 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:37.657728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5495de73-73a7-48dc-866d-a5ba32a0e3ff tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Action: 'update', calling method: .version_select at 0x7fe78f9261f0>, body: {"meta": {"os_version": "alt"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:37.715646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:37.716283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:37.750285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:37.750787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:37.753023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:37.753845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:37.754319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:37.760293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:37.782747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5495de73-73a7-48dc-866d-a5ba32a0e3ff tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:37.805069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5495de73-73a7-48dc-866d-a5ba32a0e3ff tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for user 7a3a6277ea6f44f192e46cec7850d3ce and project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:37.903560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:37.905989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:37.908604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:37.910263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lazy-loading 'fault' on Instance uuid e2530d99-e7ea-486d-b401-f89aed63c82e {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:23:38.402559 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5495de73-73a7-48dc-866d-a5ba32a0e3ff tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.753945 Nov 02 13:23:38.409632 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1501/2763] 10.222.0.113 () {60 vars in 1318 bytes} [Wed Nov 2 13:23:37 2022] PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata/os_version => generated 31 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:38.409632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:38.409632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:38.427011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:38.427709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:38.428195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:38.432250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:38.432339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:38.432862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:38.813424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:38.833011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:38.844894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:38.848405 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2594e7c7-d945-4584-b365-a3644c5fb1a9 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 200 len: 1273 microversion: 2.25 time: 1.140873 Nov 02 13:23:38.851795 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1263/2764] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:37 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 1273 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:38.869543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f403ebd7-fc3e-4814-9b93-c588c94d058d tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Calling method '.version_select at 0x7fe787d1d700>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:38.979812 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f403ebd7-fc3e-4814-9b93-c588c94d058d tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 58 microversion: 2.1 time: 0.122344 Nov 02 13:23:38.980758 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1264/2765] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:23:38 2022] GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 58 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:38.994040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-df2f82ed-c722-449b-9a03-0becae8c3bfd tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Action: 'update_all', calling method: .version_select at 0x7fe78fa3f550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:39.098247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-df2f82ed-c722-449b-9a03-0becae8c3bfd tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:39.115904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-df2f82ed-c722-449b-9a03-0becae8c3bfd tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for user 7a3a6277ea6f44f192e46cec7850d3ce and project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:39.349860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:39.373084 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-49c200ea-03db-465c-acac-5de7674689e3 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1528 microversion: 2.1 time: 0.963828 Nov 02 13:23:39.374139 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1502/2766] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:38 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1528 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:39.888350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:39.889308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: e2530d99-e7ea-486d-b401-f89aed63c82e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:39.921564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:39.924576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:39.926803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:39.940080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:39.941071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:39.947778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:39.993820 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-df2f82ed-c722-449b-9a03-0becae8c3bfd tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 61 microversion: 2.1 time: 1.004642 Nov 02 13:23:39.995262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1265/2767] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:38 2022] PUT /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 61 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 13:23:40.074690 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] HTTP exception thrown: Instance e2530d99-e7ea-486d-b401-f89aed63c82e could not be found. Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Request method failure captured: Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e HTTP/1.1 Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0YwuYBpLxr4nHoXC6wyvjodLwPr85DS4H4BB-N6xNZc5Zt2VkYEPkphpE4jmqg5PKDz3QshgNU1AQeBUWmiErv2NsarP5o7KpWYIlYGzdT2A19aBjuN-ccC35-vgMpp1Q3EHrLAlplR9IJKmH7O9IcBcRCeNpAYxykcHDR7T6eXTQ Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d89e00efbe3c49019171062c5e914dc9 Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:40.085313 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d89e00efbe3c49019171062c5e914dc9 Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-LiveAutoBlockMigrationV225Test-1798740618-project Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4b987e6d2a814bc6b30b8191cfd5351d Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618-project Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e2530d99-e7ea-486d-b401-f89aed63c82e could not be found. Nov 02 13:23:40.089001 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e2530d99-e7ea-486d-b401-f89aed63c82e'} Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2530d99-e7ea-486d-b401-f89aed63c82e could not be found. Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:40.090450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2530d99-e7ea-486d-b401-f89aed63c82e could not be found. Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2530d99-e7ea-486d-b401-f89aed63c82e could not be found. Nov 02 13:23:40.092871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:40.096889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0117ddd4-4b9a-43fd-9343-24d88af2db0c tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Action: 'create', calling method: .version_select at 0x7fe787c503a0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:40.101125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Returning 404 to user: Instance e2530d99-e7ea-486d-b401-f89aed63c82e could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:40.104363 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88fed00c-1954-4521-bc63-cd76ceef278c tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e" status: 404 len: 111 microversion: 2.25 time: 0.223464 Nov 02 13:23:40.106988 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1503/2768] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:39 2022] GET /compute/v2.1/servers/e2530d99-e7ea-486d-b401-f89aed63c82e => generated 111 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:23:40.209913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0117ddd4-4b9a-43fd-9343-24d88af2db0c tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:40.239002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0117ddd4-4b9a-43fd-9343-24d88af2db0c tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Getting quotas for user 7a3a6277ea6f44f192e46cec7850d3ce and project 578935444feb432599bacda799b14089. Resources: dict_keys(['metadata_items']) {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:40.412863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:40.420775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:40.461011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:40.462863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:40.465700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:40.468327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:40.474085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:40.490458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:40.632876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:40.918587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:40.928064 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b589ec6a-b9d9-41d6-87fe-7f4b49e9aa77 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1528 microversion: 2.1 time: 0.526357 Nov 02 13:23:40.928811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1504/2769] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:40 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1528 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:40.962849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b0f0000d-48ad-4e57-b541-9fc3756ac9bc req-593d591a-a938-4d3b-ba6b-e15895be5fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b185e99-0344-4ba1-afba-41b3fb39a207", "name": "network-vif-unplugged", "status": "completed", "tag": "9e988ccd-f6e6-4ec9-b69c-a6646d66183d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:41.006754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b0f0000d-48ad-4e57-b541-9fc3756ac9bc req-593d591a-a938-4d3b-ba6b-e15895be5fc0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:41.007503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b0f0000d-48ad-4e57-b541-9fc3756ac9bc req-593d591a-a938-4d3b-ba6b-e15895be5fc0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:41.008109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b0f0000d-48ad-4e57-b541-9fc3756ac9bc req-593d591a-a938-4d3b-ba6b-e15895be5fc0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:41.050951 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b0f0000d-48ad-4e57-b541-9fc3756ac9bc req-593d591a-a938-4d3b-ba6b-e15895be5fc0 service nova] Creating event network-vif-unplugged:9e988ccd-f6e6-4ec9-b69c-a6646d66183d for instance 5b185e99-0344-4ba1-afba-41b3fb39a207 on n-h2-858384-19 Nov 02 13:23:41.065840 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b0f0000d-48ad-4e57-b541-9fc3756ac9bc req-593d591a-a938-4d3b-ba6b-e15895be5fc0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122809 Nov 02 13:23:41.069642 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1505/2770] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:41.511339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0117ddd4-4b9a-43fd-9343-24d88af2db0c tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "POST /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 85 microversion: 2.1 time: 1.436907 Nov 02 13:23:41.516658 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1266/2771] 10.222.0.113 () {60 vars in 1286 bytes} [Wed Nov 2 13:23:40 2022] POST /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 85 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:41.526528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ef67c2b0-2dd9-404f-aef0-c999902cfb76 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] Calling method '.version_select at 0x7fe787c50820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:41.724743 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ef67c2b0-2dd9-404f-aef0-c999902cfb76 tempest-ImagesMetadataTestJSON-1572703640 tempest-ImagesMetadataTestJSON-1572703640-project] 10.222.0.113 "GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.205893 Nov 02 13:23:41.732883 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1267/2772] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:23:41 2022] GET /compute/v2.1/images/8c328454-d31b-462c-9e40-a272cfcc785b/metadata => generated 85 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:23:41.996758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:42.001692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:42.011775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1143003487", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:42.069095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:42.072401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:42.073713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:42.076762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:42.079027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:42.083744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:42.422997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:42.437406 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3d730512-9b5f-4e3a-8530-384411dbbd75 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1528 microversion: 2.1 time: 0.484123 Nov 02 13:23:42.442532 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1268/2773] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:41 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:43.472712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:43.473671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:43.486244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:43.499821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:43.500352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:43.501103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:43.511855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:43.512272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:44.326996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:23:44.355287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:44.372503 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05e6a385-2994-4873-a216-17667c58958c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1528 microversion: 2.1 time: 0.904369 Nov 02 13:23:44.393084 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1269/2774] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:43 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1528 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:45.135399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:23:45.136076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:23:45.136708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:23:45.137457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:23:45.138499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:23:45.162179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:45.163073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:45.163698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:45.164769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:45.166499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:45.167610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:45.225104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Getting quotas for project 1163cf0cef504bb4a19e9ba31e19532a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:45.241512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Getting quotas for user 79a17b6690584dc29038247dea07ac26 and project 1163cf0cef504bb4a19e9ba31e19532a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:45.277104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:23:45.302647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:23:45.398813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:45.399669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:45.421888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:45.422399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:45.422844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:45.442128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:45.445922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:45.449119 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d8443f1b-e6ec-421d-b70c-a133e57ba929 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.298044 Nov 02 13:23:45.460376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:45.464172 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1506/2775] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:23:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 4314 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:23:45.488460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22848ca8-e5ce-46e5-b9ed-0a9826282691 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:45.498310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22848ca8-e5ce-46e5-b9ed-0a9826282691 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:45.812665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22848ca8-e5ce-46e5-b9ed-0a9826282691 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:45.832214 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22848ca8-e5ce-46e5-b9ed-0a9826282691 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1218 microversion: 2.1 time: 0.360654 Nov 02 13:23:45.847144 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1507/2776] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:45 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1218 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:45.891317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:45.917524 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-69d48635-d67e-40bb-8de0-ce2bc554bdc6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1528 microversion: 2.1 time: 0.516720 Nov 02 13:23:45.918235 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1270/2777] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:45 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1528 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:46.630616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0050ff6a-ee4f-41d1-ac15-fb5f9b4146e5 req-6803651a-40e9-4cf4-ae28-1f4afba81943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b185e99-0344-4ba1-afba-41b3fb39a207", "name": "network-vif-plugged", "status": "completed", "tag": "9e988ccd-f6e6-4ec9-b69c-a6646d66183d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:46.686815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0050ff6a-ee4f-41d1-ac15-fb5f9b4146e5 req-6803651a-40e9-4cf4-ae28-1f4afba81943 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:46.687302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0050ff6a-ee4f-41d1-ac15-fb5f9b4146e5 req-6803651a-40e9-4cf4-ae28-1f4afba81943 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:46.688108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0050ff6a-ee4f-41d1-ac15-fb5f9b4146e5 req-6803651a-40e9-4cf4-ae28-1f4afba81943 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:46.758865 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0050ff6a-ee4f-41d1-ac15-fb5f9b4146e5 req-6803651a-40e9-4cf4-ae28-1f4afba81943 service nova] Creating event network-vif-plugged:9e988ccd-f6e6-4ec9-b69c-a6646d66183d for instance 5b185e99-0344-4ba1-afba-41b3fb39a207 on n-h2-858384-19 Nov 02 13:23:46.784855 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0050ff6a-ee4f-41d1-ac15-fb5f9b4146e5 req-6803651a-40e9-4cf4-ae28-1f4afba81943 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163631 Nov 02 13:23:46.792197 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1508/2778] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:46.859844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d8118d3f-846c-4b41-9a82-8cf5c19365b8 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:46.860594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d8118d3f-846c-4b41-9a82-8cf5c19365b8 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:46.944625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:46.945456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:46.969667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:46.970611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:46.978326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:46.988509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:46.992553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:46.994305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:47.112768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d8118d3f-846c-4b41-9a82-8cf5c19365b8 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:47.180585 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d8118d3f-846c-4b41-9a82-8cf5c19365b8 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1218 microversion: 2.1 time: 0.323391 Nov 02 13:23:47.182826 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1271/2779] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:46 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1218 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:48.209110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:48.209956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:48.233629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:48.238131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:48.239898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:48.244298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:48.246967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:48.249213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:48.394436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:48.406809 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-25dfa889-0b41-49b4-b674-ce628f48c451 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1528 microversion: 2.1 time: 1.466300 Nov 02 13:23:48.407526 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1509/2780] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:46 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1528 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:48.469814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:48.476809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:48.484346 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5735e446-a8b0-4691-b80f-6f1e706e3c9e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1214 microversion: 2.1 time: 0.275119 Nov 02 13:23:48.491662 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1272/2781] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:48 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1214 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:49.448778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:49.449733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:49.488401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:49.488929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:49.490919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:49.495415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:49.495933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:49.496661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:49.523290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:49.525742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:49.567289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:49.572860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:49.573771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:49.577113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:49.577614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:49.578063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:50.183356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:50.192839 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-63782aea-5fdb-4af5-adee-56628d63abab tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1528 microversion: 2.1 time: 0.750811 Nov 02 13:23:50.209977 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1510/2782] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:49 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1528 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:50.213136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:50.233653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:50.236769 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-53a141a1-d397-4b80-b6e1-d619e8427a36 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1278 microversion: 2.1 time: 0.718684 Nov 02 13:23:50.240638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:50.262269 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1273/2783] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:49 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1278 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:50.274584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:50.275703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:50.276347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:50.277373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:50.278482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:50.279367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:50.328960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:23:50.438739 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-269ea7ed-db4a-4a25-b11f-e54972049d62 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 204 len: 0 microversion: 2.25 time: 0.226907 Nov 02 13:23:50.439836 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1511/2784] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:23:50 2022] DELETE /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:23:50.450951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:50.452671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:50.460540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:50.466391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:50.467338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:50.468385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:50.469149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:50.469819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:51.193846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:51.212355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:51.223972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:51.234528 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-01543e90-dfd4-4579-9ec7-b74d986048b8 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1736 microversion: 2.25 time: 0.789382 Nov 02 13:23:51.235766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:51.237389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:51.247003 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1274/2785] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:50 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1736 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:51.253715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:51.257408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:51.258109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:51.261295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:51.263370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:51.267575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:51.285223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:51.285872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:51.306684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:51.307473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:51.308166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:51.309695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:51.315457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:51.316363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:51.591441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:51.607466 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62f36515-8bf7-473b-ae50-4877ba306ef5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1276 microversion: 2.1 time: 0.331225 Nov 02 13:23:51.608952 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1275/2786] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:51 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1276 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:52.196683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:52.216932 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e0ffaa9e-5a3a-4af8-a64b-2551f40ae4d7 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1513 microversion: 2.1 time: 0.983998 Nov 02 13:23:52.228787 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1512/2787] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:51 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1513 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:52.258232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:52.260202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:52.283042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:52.286405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:52.288840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:52.291187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:52.292014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:52.295646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:52.359237 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9eacc3a2-c1f8-42d9-9648-7883446fc0a1 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] 10.222.0.113 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.462345 Nov 02 13:23:52.360083 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1276/2788] 10.222.0.113 () {58 vars in 1133 bytes} [Wed Nov 2 13:23:51 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 13:23:52.385302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:52.387181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:52.421126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:52.421640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:52.426453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:52.427278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:52.427769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:52.428220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:52.957014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:52.968743 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bd22ecc3-8591-442e-ae87-324b630d4915 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 200 len: 1513 microversion: 2.1 time: 0.716150 Nov 02 13:23:52.969335 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1513/2789] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:52 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 1513 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:23:53.018387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f06e774e-4fbd-493a-b9dc-a8dba09c0e59 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Calling method '.version_select at 0x7fe7878679d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:53.151244 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-f06e774e-4fbd-493a-b9dc-a8dba09c0e59 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] HTTP exception thrown: Image not found. Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f06e774e-4fbd-493a-b9dc-a8dba09c0e59 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Request method failure captured: Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm9nkp9qsMOtyeDxFPrEEzlRiatRoaiuYnWBrEcE7nxFmPpc04rwbB9Y5-HidT9DpkW7VVHUJiLOfEMIjQA_IrsJ4OZJguv17--ZI5a-8m9N45tw8_dDy5DevAGSPTn4VGC3OyWQOyKgAgRY3K6sMDCsBQ-9e71Wjn79azsJtAvVQF8 Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:53.153163 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d105d4d8baea4e6780d80a789859f348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4d65f8e27f4444ab992a1fdbbea98e16 Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '-1'} Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:53.154601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:53.155579 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:53.156859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f06e774e-4fbd-493a-b9dc-a8dba09c0e59 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f06e774e-4fbd-493a-b9dc-a8dba09c0e59 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] 10.222.0.113 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.152655 Nov 02 13:23:53.158186 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1514/2790] 10.222.0.113 () {58 vars in 1139 bytes} [Wed Nov 2 13:23:53 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:23:53.160261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:53.172994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:53.197125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:53.197621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:53.198066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:53.198794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:53.199288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:53.199724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:53.548787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:53.569019 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d40d256-494a-45c3-9d50-5e5cb5efc5e9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1276 microversion: 2.1 time: 0.410749 Nov 02 13:23:53.574135 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1515/2791] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:53 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1276 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:53.581557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:53.582055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:53.616759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:53.617532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:53.618630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:53.619544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:53.620257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:53.620744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:53.795149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:23:54.171780 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce39c74f-9cf0-41b6-8933-aabfba662290 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "DELETE /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 204 len: 0 microversion: 2.1 time: 0.595434 Nov 02 13:23:54.174553 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1516/2792] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:23:53 2022] DELETE /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:23:54.202789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-acef87a0-03e0-4a8b-8538-00ba755fb70d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Calling method '.version_select at 0x7fe7878678b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:54.251803 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-acef87a0-03e0-4a8b-8538-00ba755fb70d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] HTTP exception thrown: Image not found. Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-acef87a0-03e0-4a8b-8538-00ba755fb70d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Request method failure captured: Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/96c5c526-2e67-452c-92dd-8ad32af01c3j HTTP/1.1 Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm9nkp9qsMOtyeDxFPrEEzlRiatRoaiuYnWBrEcE7nxFmPpc04rwbB9Y5-HidT9DpkW7VVHUJiLOfEMIjQA_IrsJ4OZJguv17--ZI5a-8m9N45tw8_dDy5DevAGSPTn4VGC3OyWQOyKgAgRY3K6sMDCsBQ-9e71Wjn79azsJtAvVQF8 Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:54.253886 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d105d4d8baea4e6780d80a789859f348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4d65f8e27f4444ab992a1fdbbea98e16 Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '96c5c526-2e67-452c-92dd-8ad32af01c3j'} Nov 02 13:23:54.255354 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 96c5c526-2e67-452c-92dd-8ad32af01c3j to delete Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.256129 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 96c5c526-2e67-452c-92dd-8ad32af01c3j could not be found. Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:54.257355 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:23:54.258623 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.261016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-acef87a0-03e0-4a8b-8538-00ba755fb70d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:54.262877 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-acef87a0-03e0-4a8b-8538-00ba755fb70d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] 10.222.0.113 "DELETE /compute/v2.1/images/96c5c526-2e67-452c-92dd-8ad32af01c3j" status: 404 len: 62 microversion: 2.1 time: 0.085654 Nov 02 13:23:54.265435 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1517/2793] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:54 2022] DELETE /compute/v2.1/images/96c5c526-2e67-452c-92dd-8ad32af01c3j => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:23:54.276918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fcff35ec-b435-4f52-b3b9-1ba0b3903950 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Calling method '.version_select at 0x7fe787817790>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:54.344397 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-fcff35ec-b435-4f52-b3b9-1ba0b3903950 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] HTTP exception thrown: Image not found. Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fcff35ec-b435-4f52-b3b9-1ba0b3903950 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Request method failure captured: Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/a5964b1b-99db-4099-84ad-ed047ab3c18a1 HTTP/1.1 Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm9nkp9qsMOtyeDxFPrEEzlRiatRoaiuYnWBrEcE7nxFmPpc04rwbB9Y5-HidT9DpkW7VVHUJiLOfEMIjQA_IrsJ4OZJguv17--ZI5a-8m9N45tw8_dDy5DevAGSPTn4VGC3OyWQOyKgAgRY3K6sMDCsBQ-9e71Wjn79azsJtAvVQF8 Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:54.347385 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d105d4d8baea4e6780d80a789859f348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4d65f8e27f4444ab992a1fdbbea98e16 Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a5964b1b-99db-4099-84ad-ed047ab3c18a1'} Nov 02 13:23:54.348899 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a5964b1b-99db-4099-84ad-ed047ab3c18a1 to delete Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.349795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a5964b1b-99db-4099-84ad-ed047ab3c18a1 could not be found. Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:54.351052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:23:54.352946 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.360300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fcff35ec-b435-4f52-b3b9-1ba0b3903950 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:54.361428 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fcff35ec-b435-4f52-b3b9-1ba0b3903950 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] 10.222.0.113 "DELETE /compute/v2.1/images/a5964b1b-99db-4099-84ad-ed047ab3c18a1" status: 404 len: 62 microversion: 2.1 time: 0.090438 Nov 02 13:23:54.364085 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1518/2794] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:23:54 2022] DELETE /compute/v2.1/images/a5964b1b-99db-4099-84ad-ed047ab3c18a1 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:23:54.378848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-647a4437-0fc2-4093-88f0-ae55f4aa7dc0 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Calling method '.version_select at 0x7fe78f955040>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:54.444525 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-647a4437-0fc2-4093-88f0-ae55f4aa7dc0 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] HTTP exception thrown: Image not found. Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-647a4437-0fc2-4093-88f0-ae55f4aa7dc0 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Request method failure captured: Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/tempest-invalid-168196625 HTTP/1.1 Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm9nkp9qsMOtyeDxFPrEEzlRiatRoaiuYnWBrEcE7nxFmPpc04rwbB9Y5-HidT9DpkW7VVHUJiLOfEMIjQA_IrsJ4OZJguv17--ZI5a-8m9N45tw8_dDy5DevAGSPTn4VGC3OyWQOyKgAgRY3K6sMDCsBQ-9e71Wjn79azsJtAvVQF8 Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:54.447516 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d105d4d8baea4e6780d80a789859f348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4d65f8e27f4444ab992a1fdbbea98e16 Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'tempest-invalid-168196625'} Nov 02 13:23:54.448813 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-168196625 to delete Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.449525 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-168196625 could not be found. Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:54.450529 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:23:54.452029 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.454146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-647a4437-0fc2-4093-88f0-ae55f4aa7dc0 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:54.464498 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-647a4437-0fc2-4093-88f0-ae55f4aa7dc0 tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] 10.222.0.113 "DELETE /compute/v2.1/images/tempest-invalid-168196625" status: 404 len: 62 microversion: 2.1 time: 0.089618 Nov 02 13:23:54.472847 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1519/2795] 10.222.0.113 () {58 vars in 1208 bytes} [Wed Nov 2 13:23:54 2022] DELETE /compute/v2.1/images/tempest-invalid-168196625 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:23:54.500190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20926c1b-f8b1-45a4-b791-33831426763d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Calling method '.version_select at 0x7fe78f9554c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:54.620233 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-20926c1b-f8b1-45a4-b791-33831426763d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] HTTP exception thrown: Image not found. Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20926c1b-f8b1-45a4-b791-33831426763d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Request method failure captured: Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/b947cc78-4881-4934-8a01-635912f54b97 HTTP/1.1 Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm9nkp9qsMOtyeDxFPrEEzlRiatRoaiuYnWBrEcE7nxFmPpc04rwbB9Y5-HidT9DpkW7VVHUJiLOfEMIjQA_IrsJ4OZJguv17--ZI5a-8m9N45tw8_dDy5DevAGSPTn4VGC3OyWQOyKgAgRY3K6sMDCsBQ-9e71Wjn79azsJtAvVQF8 Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:23:54.622657 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d105d4d8baea4e6780d80a789859f348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d105d4d8baea4e6780d80a789859f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d105d4d8baea4e6780d80a789859f348 Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-713450628 Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4d65f8e27f4444ab992a1fdbbea98e16 Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-713450628-project Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'b947cc78-4881-4934-8a01-635912f54b97'} Nov 02 13:23:54.624416 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b947cc78-4881-4934-8a01-635912f54b97 to delete Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.625251 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b947cc78-4881-4934-8a01-635912f54b97 could not be found. Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:23:54.626468 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:23:54.628236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20926c1b-f8b1-45a4-b791-33831426763d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:23:54.630569 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20926c1b-f8b1-45a4-b791-33831426763d tempest-ImagesDeleteNegativeTestJSON-713450628 tempest-ImagesDeleteNegativeTestJSON-713450628-project] 10.222.0.113 "DELETE /compute/v2.1/images/b947cc78-4881-4934-8a01-635912f54b97" status: 404 len: 62 microversion: 2.1 time: 0.141530 Nov 02 13:23:54.630569 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1520/2796] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:54 2022] DELETE /compute/v2.1/images/b947cc78-4881-4934-8a01-635912f54b97 => generated 62 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:23:54.643693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:54.649576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:54.676834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:54.677711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:54.679831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:54.688406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:54.689626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:54.693822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:54.903990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:54.924148 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fcf20a1a-83d2-455c-b1f7-3a25f964651c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1276 microversion: 2.1 time: 0.291857 Nov 02 13:23:54.926301 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1521/2797] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:54 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1276 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:54.945316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1932558355", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "ab09ad8a-83ac-42f7-97d8-5ec799a5bcc6"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:55.116787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] validate_networks() for [('ab09ad8a-83ac-42f7-97d8-5ec799a5bcc6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:23:55.192306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:55.442013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:55.465282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:55.467039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:55.468363 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a93b4319-e6ad-410f-a136-cb452104d3fd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1736 microversion: 2.25 time: 3.107308 Nov 02 13:23:55.510721 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1277/2798] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:52 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1736 bytes in 3150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:55.817460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=24 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:55.961134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:55.963067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:55.985219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:55.995316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:55.996016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:55.997171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:55.997930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:55.999336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:56.481273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:56.531824 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a87d3be8-bd6d-4093-97ce-230ac3120c1d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1276 microversion: 2.1 time: 0.575212 Nov 02 13:23:56.544134 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1278/2799] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:55 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1276 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:23:56.562144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:56.562761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:56.648888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:56.653789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:56.657927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:56.663868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:56.670201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:56.677443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:57.174795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=22 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:58.257792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:58.284455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:58.301188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:23:58.304315 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05143db7-d03c-4d42-a76b-c5dec108ed6f tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1736 microversion: 2.25 time: 1.745930 Nov 02 13:23:58.308948 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1279/2800] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:23:56 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1736 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:23:58.321697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:58.326915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:23:58.344899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:58.348642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:58.351970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:58.355976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:58.376512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:58.380063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:58.789171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:23:58.790321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:23:58.790657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:23:58.791158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:23:58.791820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:23:58.824551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:58.824940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:58.839303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:58.840554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:58.841505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:58.842180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:58.904283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Getting quotas for project 64d1e36587404641ac2dcc993e860a3c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:23:58.926484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Getting quotas for user 8512848478ff4d6ea55d926bb887fa65 and project 64d1e36587404641ac2dcc993e860a3c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:23:58.952720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:23:58.955432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:23:59.085770 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de90a963-1431-4785-8f74-18c14a8bdbc0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.155797 Nov 02 13:23:59.085770 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1522/2801] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:23:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 4159 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:23:59.708780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-cf268113-3c9b-4f3a-a51d-56490be92597 req-33447397-51ac-40b9-8502-7ae1f7dbd58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b185e99-0344-4ba1-afba-41b3fb39a207", "name": "network-vif-deleted", "tag": "9e988ccd-f6e6-4ec9-b69c-a6646d66183d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:23:59.750491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cf268113-3c9b-4f3a-a51d-56490be92597 req-33447397-51ac-40b9-8502-7ae1f7dbd58f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:23:59.754446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cf268113-3c9b-4f3a-a51d-56490be92597 req-33447397-51ac-40b9-8502-7ae1f7dbd58f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:23:59.754926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cf268113-3c9b-4f3a-a51d-56490be92597 req-33447397-51ac-40b9-8502-7ae1f7dbd58f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:23:59.817301 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-cf268113-3c9b-4f3a-a51d-56490be92597 req-33447397-51ac-40b9-8502-7ae1f7dbd58f service nova] Creating event network-vif-deleted:9e988ccd-f6e6-4ec9-b69c-a6646d66183d for instance 5b185e99-0344-4ba1-afba-41b3fb39a207 on n-h2-858384-19 Nov 02 13:23:59.869024 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-cf268113-3c9b-4f3a-a51d-56490be92597 req-33447397-51ac-40b9-8502-7ae1f7dbd58f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.780589 Nov 02 13:23:59.870290 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1523/2802] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:23:59.887647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-281c9ad8-2c8a-458b-9843-ae2f8e2569af tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:23:59.888868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-281c9ad8-2c8a-458b-9843-ae2f8e2569af tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:00.058632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-281c9ad8-2c8a-458b-9843-ae2f8e2569af tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:00.082851 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-281c9ad8-2c8a-458b-9843-ae2f8e2569af tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1222 microversion: 2.1 time: 0.208368 Nov 02 13:24:00.083919 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1524/2803] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:59 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1222 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:00.113572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:00.117246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:00.144706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:00.145264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:00.146590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:00.147747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:00.151141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:00.152964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:00.458225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:00.474891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:00.483621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:00.485438 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6b9c3043-d24a-4594-a4a8-cde63535b1d5 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1669 microversion: 2.25 time: 0.399014 Nov 02 13:24:00.499909 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1525/2804] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:00 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1669 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:24:00.960683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:01.046447 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57b91e19-4f0e-44b3-a959-2330625b6fb5 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1318 microversion: 2.1 time: 2.735426 Nov 02 13:24:01.054448 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1280/2805] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:23:58 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1318 bytes in 2744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:01.124960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:01.128786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:01.153150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:01.161414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:01.162789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:01.165918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:01.168743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:01.171278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:01.176271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:01.728527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:01.754491 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3f7b8a7-bf76-4e89-a526-c1a76dddc344 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1274 microversion: 2.1 time: 0.635337 Nov 02 13:24:01.761626 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1526/2806] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:01 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1274 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:01.804045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:01.808204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:01.855668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:01.864602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:01.868108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:01.880462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:01.884293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:01.896366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:02.030430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-36f370f5-e34d-4fc7-adb7-497f0d07e409 req-73c0f23b-0dc6-400c-a6b8-85666d2d9a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed1faa6-e6ad-4757-992d-0750ae29a307", "name": "network-vif-deleted", "tag": "530566a3-df01-427e-bd74-d9826d6be3a7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:02.105983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=91 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:02.130341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-36f370f5-e34d-4fc7-adb7-497f0d07e409 req-73c0f23b-0dc6-400c-a6b8-85666d2d9a5f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:02.130839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-36f370f5-e34d-4fc7-adb7-497f0d07e409 req-73c0f23b-0dc6-400c-a6b8-85666d2d9a5f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:02.131314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-36f370f5-e34d-4fc7-adb7-497f0d07e409 req-73c0f23b-0dc6-400c-a6b8-85666d2d9a5f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:02.189886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:02.190497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:02.207904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:02.224184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lazy-loading 'fault' on Instance uuid 7ed1faa6-e6ad-4757-992d-0750ae29a307 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:24:02.238652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:02.247044 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-36f370f5-e34d-4fc7-adb7-497f0d07e409 req-73c0f23b-0dc6-400c-a6b8-85666d2d9a5f service nova] Creating event network-vif-deleted:530566a3-df01-427e-bd74-d9826d6be3a7 for instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 on n-h1-858384-19 Nov 02 13:24:02.276396 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-36f370f5-e34d-4fc7-adb7-497f0d07e409 req-73c0f23b-0dc6-400c-a6b8-85666d2d9a5f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.822675 Nov 02 13:24:02.279215 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1281/2807] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:02.292954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:02.293674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:02.315664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:02.316270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:02.316610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:02.317351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:02.317823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:02.318271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:02.672761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:02.702803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:02.714309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:02.715847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:02.721902 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f118c62-b9d2-4dc7-bea9-ea4001e5d6f2 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 200 len: 1380 microversion: 2.25 time: 0.957050 Nov 02 13:24:02.724884 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dafdae7a-1006-4075-b264-85aa777f4f5e tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1318 microversion: 2.1 time: 0.444315 Nov 02 13:24:02.727602 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1527/2808] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:01 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 1380 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:24:02.735612 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1282/2809] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:02 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:02.790747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:02.791485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:02.800171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:02.800952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:02.801641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:02.802526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:02.803307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:02.805207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:03.228450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:03.246111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7608bc6b-1d56-4e87-9daa-25b8a7b40d85 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1280 microversion: 2.1 time: 0.461982 Nov 02 13:24:03.247475 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1528/2810] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:02 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1280 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:03.763403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:03.764022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 7ed1faa6-e6ad-4757-992d-0750ae29a307] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:03.765848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:03.766654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:03.783861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:03.784448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:03.785021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:03.785534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:03.786042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:03.786425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:03.786955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:03.787656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:03.788198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:03.790754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:03.793240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:03.794197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:03.840845 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] HTTP exception thrown: Instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 could not be found. Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Request method failure captured: Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 HTTP/1.1 Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm0YwuYBpLxr4nHoXC6wyvjodLwPr85DS4H4BB-N6xNZc5Zt2VkYEPkphpE4jmqg5PKDz3QshgNU1AQeBUWmiErv2NsarP5o7KpWYIlYGzdT2A19aBjuN-ccC35-vgMpp1Q3EHrLAlplR9IJKmH7O9IcBcRCeNpAYxykcHDR7T6eXTQ Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d89e00efbe3c49019171062c5e914dc9 Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:24:03.849027 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d89e00efbe3c49019171062c5e914dc9 Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-LiveAutoBlockMigrationV225Test-1798740618-project Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4b987e6d2a814bc6b30b8191cfd5351d Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618-project Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 could not be found. Nov 02 13:24:03.850402 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7ed1faa6-e6ad-4757-992d-0750ae29a307'} Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 could not be found. Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:03.851101 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 could not be found. Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 could not be found. Nov 02 13:24:03.854205 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:03.857939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Returning 404 to user: Instance 7ed1faa6-e6ad-4757-992d-0750ae29a307 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:03.860713 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b17419c-cda6-40fc-b657-125cd83274c0 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307" status: 404 len: 111 microversion: 2.25 time: 0.103575 Nov 02 13:24:03.863319 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1283/2811] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:03 2022] GET /compute/v2.1/servers/7ed1faa6-e6ad-4757-992d-0750ae29a307 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:24:03.885842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-56eac4f7-c287-4e18-a051-7d031a63f9dd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '.version_select at 0x7fe787891ee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:03.970181 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-56eac4f7-c287-4e18-a051-7d031a63f9dd tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519404356" status: 204 len: 0 microversion: 2.25 time: 0.100566 Nov 02 13:24:03.972636 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1284/2812] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:24:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519404356 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:24:04.277005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:04.277935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:04.291819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:04.292633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:04.293446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:04.294417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:04.297547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:04.298255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:04.571985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:04.584537 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f2678ee0-6581-482b-862a-19decce3dadb tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1318 microversion: 2.1 time: 0.825506 Nov 02 13:24:04.587942 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1529/2813] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:03 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:04.637877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d539b11a-be4b-4412-9bf0-da0c8d6f33b6 req-096d30da-055f-43fd-9bb4-e3f208da6a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a655cb-cc68-4a7e-83d8-13ee7f71ff23", "tag": "e06dd19b-48d1-4525-bd2e-82b5fa0202ca"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:04.641165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:04.652808 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22d8a915-89fb-492e-bea4-db3c96ed0730 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1280 microversion: 2.1 time: 0.380711 Nov 02 13:24:04.653435 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1285/2814] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:04 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1280 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:04.659307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d539b11a-be4b-4412-9bf0-da0c8d6f33b6 req-096d30da-055f-43fd-9bb4-e3f208da6a35 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:04.659967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d539b11a-be4b-4412-9bf0-da0c8d6f33b6 req-096d30da-055f-43fd-9bb4-e3f208da6a35 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:04.662009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d539b11a-be4b-4412-9bf0-da0c8d6f33b6 req-096d30da-055f-43fd-9bb4-e3f208da6a35 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:04.693447 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d539b11a-be4b-4412-9bf0-da0c8d6f33b6 req-096d30da-055f-43fd-9bb4-e3f208da6a35 service nova] Creating event network-changed:e06dd19b-48d1-4525-bd2e-82b5fa0202ca for instance 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 on n-h1-858384-19 Nov 02 13:24:04.701911 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d539b11a-be4b-4412-9bf0-da0c8d6f33b6 req-096d30da-055f-43fd-9bb4-e3f208da6a35 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085308 Nov 02 13:24:04.704303 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1530/2815] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:05.616517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:05.617244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:05.655614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:05.656713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:05.657670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:05.658899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:05.660143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:05.660971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:05.677545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:05.678259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:05.703255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:05.712653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:05.713480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:05.714560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:05.715262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:05.715919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:06.258392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:06.271830 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da20f390-0d3c-4eb8-907b-5995a16b0a8d tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1318 microversion: 2.1 time: 0.660324 Nov 02 13:24:06.273109 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1286/2816] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:05 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:06.502924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:06.503709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:06.517902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:06.529648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:06.530491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:06.531821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:06.532497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:06.533163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:06.588579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:24:06.881591 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1db86871-46c1-46b7-b5ee-1a276c4683cf tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 204 len: 0 microversion: 2.25 time: 0.382120 Nov 02 13:24:06.887750 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1287/2817] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:24:06 2022] DELETE /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:24:06.903718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:06.905333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:06.922390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:06.927941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:06.930771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:06.940591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:06.941513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:06.944677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:07.102494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:07.114762 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc5cd0e5-2e5b-4b8f-b7bc-38f3d6181ea2 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 1.441903 Nov 02 13:24:07.116862 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1531/2818] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:05 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:07.296996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:07.298769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:07.313558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:07.314987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:07.326809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:07.328880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:07.346550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:07.347745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:07.975757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:08.004658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:08.008714 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35db9ffd-acf6-4d5f-8a16-25bc6d2f2783 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1318 microversion: 2.1 time: 0.713230 Nov 02 13:24:08.011756 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1532/2819] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:07 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:08.035968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:08.037480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:08.050265 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90a204fb-86ae-476e-9737-4bad0ce2a490 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1554 microversion: 2.25 time: 1.156265 Nov 02 13:24:08.064645 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1288/2820] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:06 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1554 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:24:08.145984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:08.147544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:08.175606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:08.176114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:08.176568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:08.177309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:08.177763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:08.178191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:08.890428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:09.043471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:09.045242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:09.065925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:09.066716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:09.067377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:09.068881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:09.070961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:09.078042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:09.346327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:09.371964 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-54717a44-48a1-4a82-8020-c5ec2c49e977 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 1.230088 Nov 02 13:24:09.372772 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1533/2821] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:08 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:09.415668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:09.419750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:09.445339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:09.447936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:09.450918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:09.453558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:09.459743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:09.461838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:10.064062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:10.149746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:10.173659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:10.176409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:10.178489 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b4c9a89-5fc1-43fe-949c-04f4c3d8b2e7 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1554 microversion: 2.25 time: 0.791216 Nov 02 13:24:10.189049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:10.205719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dee26824-5aab-498d-8445-7eccc70ce1b9 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1318 microversion: 2.1 time: 1.167580 Nov 02 13:24:10.206693 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1289/2822] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:09 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1318 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:10.207561 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1534/2823] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:09 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1554 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:24:10.213648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:10.220248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:10.236594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:10.237574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:10.240046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:10.241152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:10.248011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:10.248754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:10.397814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:10.398427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:10.413052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:10.413658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:10.415227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:10.420764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:10.421678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:10.422463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:10.829969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:10.848269 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-07d12b56-a0f1-435f-a60e-5fb10fb217c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.639810 Nov 02 13:24:10.852857 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1290/2824] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:10 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:10.880448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d1c79221-2426-405c-9f13-97065b69e886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1096551302"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:10.886333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d1c79221-2426-405c-9f13-97065b69e886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:10.898563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c79221-2426-405c-9f13-97065b69e886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:10.900732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c79221-2426-405c-9f13-97065b69e886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:10.901348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c79221-2426-405c-9f13-97065b69e886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:10.903301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c79221-2426-405c-9f13-97065b69e886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:10.903959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c79221-2426-405c-9f13-97065b69e886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:10.904606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1c79221-2426-405c-9f13-97065b69e886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:10.909345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:11.188510 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d1c79221-2426-405c-9f13-97065b69e886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.313030 Nov 02 13:24:11.191523 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1291/2825] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:24:10 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 457 bytes (2 switches on core 0) Nov 02 13:24:11.205172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-8ac46355-f689-4d06-8f54-4f097cb11b62 req-7c087c07-a23a-453c-b89c-c2cd506a1fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e466d0e-a517-440d-a860-46bdb84b883a", "name": "network-vif-deleted", "tag": "97246982-73ce-4b56-989e-35e7f8e74360"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:11.225863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8ac46355-f689-4d06-8f54-4f097cb11b62 req-7c087c07-a23a-453c-b89c-c2cd506a1fa8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.231061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8ac46355-f689-4d06-8f54-4f097cb11b62 req-7c087c07-a23a-453c-b89c-c2cd506a1fa8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.231986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8ac46355-f689-4d06-8f54-4f097cb11b62 req-7c087c07-a23a-453c-b89c-c2cd506a1fa8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.267650 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-8ac46355-f689-4d06-8f54-4f097cb11b62 req-7c087c07-a23a-453c-b89c-c2cd506a1fa8 service nova] Creating event network-vif-deleted:97246982-73ce-4b56-989e-35e7f8e74360 for instance 0e466d0e-a517-440d-a860-46bdb84b883a on n-h1-858384-19 Nov 02 13:24:11.281034 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-8ac46355-f689-4d06-8f54-4f097cb11b62 req-7c087c07-a23a-453c-b89c-c2cd506a1fa8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087332 Nov 02 13:24:11.281654 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1292/2826] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:11.292486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:11.299101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:11.319776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.321100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.321694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.322720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.324841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.326233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.346502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:11.385751 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-235e3b3e-9ca8-45b3-aeff-63555faa14b1 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.971011 Nov 02 13:24:11.390916 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1535/2827] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:10 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:11.404498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:11.405833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:11.413295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.414074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.415332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.416264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.416912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.417540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.478262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.479581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.480204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.480668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lazy-loading 'fault' on Instance uuid 0e466d0e-a517-440d-a860-46bdb84b883a {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:24:11.673935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:11.691191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:11.697956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:11.699843 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-292f052d-e844-46da-8b16-8bdb04365c56 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 200 len: 1356 microversion: 2.25 time: 0.307332 Nov 02 13:24:11.700833 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1536/2828] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:11 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 1356 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:24:11.706651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:11.707867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:11.715858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.716800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.717386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.718587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:11.719247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:11.719823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:11.822965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:11.890487 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-68a2f62e-a540-48f6-91c3-e66b89440e90 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.605979 Nov 02 13:24:11.893165 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1293/2829] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:11 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:11.964209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-bfe4846c-cbea-42c0-afe5-dff02b7772aa req-130bd429-5f68-4e20-baa0-6f3c5559b7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34", "tag": "9891b1df-fb74-444a-a5e0-404fa6b836fd"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:12.009889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bfe4846c-cbea-42c0-afe5-dff02b7772aa req-130bd429-5f68-4e20-baa0-6f3c5559b7c0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.010809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bfe4846c-cbea-42c0-afe5-dff02b7772aa req-130bd429-5f68-4e20-baa0-6f3c5559b7c0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.011469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bfe4846c-cbea-42c0-afe5-dff02b7772aa req-130bd429-5f68-4e20-baa0-6f3c5559b7c0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.033324 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-bfe4846c-cbea-42c0-afe5-dff02b7772aa req-130bd429-5f68-4e20-baa0-6f3c5559b7c0 service nova] Creating event network-changed:9891b1df-fb74-444a-a5e0-404fa6b836fd for instance e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 on n-h2-858384-19 Nov 02 13:24:12.045905 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-bfe4846c-cbea-42c0-afe5-dff02b7772aa req-130bd429-5f68-4e20-baa0-6f3c5559b7c0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142531 Nov 02 13:24:12.049964 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1294/2830] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:12.078116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d7933866-ff22-4c34-87bf-f9950a906c99 req-e9a292b8-933d-47a0-98d9-02e4a9d93753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a655cb-cc68-4a7e-83d8-13ee7f71ff23", "name": "network-vif-plugged", "status": "completed", "tag": "e06dd19b-48d1-4525-bd2e-82b5fa0202ca"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:12.095431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d7933866-ff22-4c34-87bf-f9950a906c99 req-e9a292b8-933d-47a0-98d9-02e4a9d93753 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.096806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d7933866-ff22-4c34-87bf-f9950a906c99 req-e9a292b8-933d-47a0-98d9-02e4a9d93753 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.097650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d7933866-ff22-4c34-87bf-f9950a906c99 req-e9a292b8-933d-47a0-98d9-02e4a9d93753 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.118165 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d7933866-ff22-4c34-87bf-f9950a906c99 req-e9a292b8-933d-47a0-98d9-02e4a9d93753 service nova] Creating event network-vif-plugged:e06dd19b-48d1-4525-bd2e-82b5fa0202ca for instance 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 on n-h1-858384-19 Nov 02 13:24:12.128660 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d7933866-ff22-4c34-87bf-f9950a906c99 req-e9a292b8-933d-47a0-98d9-02e4a9d93753 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074884 Nov 02 13:24:12.138392 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1295/2831] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:12.396645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:12.412896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e97d5b2b-7c7b-4697-8b46-470c11674a53 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1318 microversion: 2.1 time: 0.710727 Nov 02 13:24:12.415283 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1537/2832] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:11 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:12.419165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:12.420007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:12.437359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.439802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.442919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.443937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.448297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.449590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.726805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:12.728095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 0e466d0e-a517-440d-a860-46bdb84b883a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:12.745473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.745848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.746308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.748961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.749761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.750212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.788975 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] HTTP exception thrown: Instance 0e466d0e-a517-440d-a860-46bdb84b883a could not be found. Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Request method failure captured: Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a HTTP/1.1 Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0YwuYBpLxr4nHoXC6wyvjodLwPr85DS4H4BB-N6xNZc5Zt2VkYEPkphpE4jmqg5PKDz3QshgNU1AQeBUWmiErv2NsarP5o7KpWYIlYGzdT2A19aBjuN-ccC35-vgMpp1Q3EHrLAlplR9IJKmH7O9IcBcRCeNpAYxykcHDR7T6eXTQ Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d89e00efbe3c49019171062c5e914dc9 Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:24:12.801781 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d89e00efbe3c49019171062c5e914dc9 Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-LiveAutoBlockMigrationV225Test-1798740618-project Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4b987e6d2a814bc6b30b8191cfd5351d Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618-project Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0e466d0e-a517-440d-a860-46bdb84b883a could not be found. Nov 02 13:24:12.805809 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0e466d0e-a517-440d-a860-46bdb84b883a'} Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e466d0e-a517-440d-a860-46bdb84b883a could not be found. Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:12.807601 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e466d0e-a517-440d-a860-46bdb84b883a could not be found. Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e466d0e-a517-440d-a860-46bdb84b883a could not be found. Nov 02 13:24:12.811198 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:12.813677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Returning 404 to user: Instance 0e466d0e-a517-440d-a860-46bdb84b883a could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:12.813677 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-327cfc9a-8deb-4264-8188-72344c30cb77 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a" status: 404 len: 111 microversion: 2.25 time: 0.080488 Nov 02 13:24:12.813677 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1538/2833] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:12 2022] GET /compute/v2.1/servers/0e466d0e-a517-440d-a860-46bdb84b883a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:24:12.813677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:12.813677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:12.828006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.828499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.828939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.829652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.830106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.830530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.895646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:12.910650 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-52ff53a8-9ec0-42df-99f9-ab24c07cff03 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.497381 Nov 02 13:24:12.912956 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1296/2834] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:12 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:12.928538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:12.929151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:12.940434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:24:12.940954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.941866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.942631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:12.943831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:12.944294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:12.944720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:13.115280 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-78c07cfb-7cbd-42ff-9e24-c6d9b3d6ca9b tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "DELETE /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 204 len: 0 microversion: 2.25 time: 0.306396 Nov 02 13:24:13.115893 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1539/2835] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:24:12 2022] DELETE /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 13:24:13.141333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:13.142058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:13.167167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:13.167793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:13.170606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:13.173328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:13.173855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:13.174311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:13.698588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:13.718383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:13.720579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:13.727181 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-04cf3562-e495-43e2-a875-a642bc9f733a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1568 microversion: 2.25 time: 0.597917 Nov 02 13:24:13.750825 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1540/2836] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:13 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1568 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:24:13.759635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:13.763648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:13.769318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:13.784285 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c9571313-5156-4675-97f2-baa43262d9a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.859539 Nov 02 13:24:13.784890 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1297/2837] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:12 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:13.793311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:13.793808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:13.794276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:13.799993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:13.802751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:13.806831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:13.955996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:13.957577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:13.965203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:13.965769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:13.966322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:13.967348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:13.967940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:13.968472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:14.218058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:14.237516 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2bc70082-83ac-4b40-83fe-c6c4fc2af450 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1318 microversion: 2.1 time: 0.485187 Nov 02 13:24:14.238355 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1541/2838] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:13 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:14.390550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:14.412962 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-377dbe8e-8c38-4c64-aa32-60b463850e50 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.465286 Nov 02 13:24:14.433702 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1298/2839] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:13 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:14.761887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:14.763078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:14.806004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:14.813048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:14.828464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:14.829529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e3625606-b458-4f6f-955d-b557928ade88 req-57ffa396-f3c8-44d4-bced-a256a30ef28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "name": "network-vif-unplugged", "status": "completed", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:14.832331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:14.833712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:14.834853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:14.868828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e3625606-b458-4f6f-955d-b557928ade88 req-57ffa396-f3c8-44d4-bced-a256a30ef28d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:14.886964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e3625606-b458-4f6f-955d-b557928ade88 req-57ffa396-f3c8-44d4-bced-a256a30ef28d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:14.887777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e3625606-b458-4f6f-955d-b557928ade88 req-57ffa396-f3c8-44d4-bced-a256a30ef28d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:14.912933 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e3625606-b458-4f6f-955d-b557928ade88 req-57ffa396-f3c8-44d4-bced-a256a30ef28d service nova] Creating event network-vif-unplugged:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:24:14.924767 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e3625606-b458-4f6f-955d-b557928ade88 req-57ffa396-f3c8-44d4-bced-a256a30ef28d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.563919 Nov 02 13:24:14.931366 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1542/2840] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:24:14.938254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:14.939198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:14.949152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:14.949911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:14.951170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:14.952472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:14.953184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:14.953782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:15.179075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:15.189999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:15.191985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:15.193378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e44fb6aa-46ca-4fbc-97c6-bbf37d05b24a tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1568 microversion: 2.25 time: 0.439258 Nov 02 13:24:15.208591 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1299/2841] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:14 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1568 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:24:15.270542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:15.271785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:15.282641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:15.283837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:15.284856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:15.286429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:15.287193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:15.288120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:15.586688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:15.615527 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e4d31b7f-07c6-402a-bff1-2872e931c0cc tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1468 microversion: 2.1 time: 0.352380 Nov 02 13:24:15.619405 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1300/2842] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:15 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1468 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:15.640949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:15.645530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:15.666379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:15.667419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:15.668462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:15.669886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:15.670730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:15.671741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:15.934986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:15.939703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:15.951701 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d5952bc1-8671-4018-9a55-99a102c55866 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.330154 Nov 02 13:24:15.952663 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1301/2843] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:15 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:15.957700 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0c47026-6c73-4216-8de5-6dbc24d27ad7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 1.023252 Nov 02 13:24:15.963605 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1543/2844] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:14 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:16.433967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8d4f887a-1d03-4130-ab37-7dc0e0833b5e tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Calling method '.version_select at 0x7fe787ef8b80>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:16.466997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d4f887a-1d03-4130-ab37-7dc0e0833b5e tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:16.471079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d4f887a-1d03-4130-ab37-7dc0e0833b5e tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:16.471846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d4f887a-1d03-4130-ab37-7dc0e0833b5e tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:16.529496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d4f887a-1d03-4130-ab37-7dc0e0833b5e tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:16.530504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d4f887a-1d03-4130-ab37-7dc0e0833b5e tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:16.531281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d4f887a-1d03-4130-ab37-7dc0e0833b5e tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:16.613358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8d4f887a-1d03-4130-ab37-7dc0e0833b5e tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] 10.222.0.113 "GET /compute/v2.1/os-simple-tenant-usage/1163cf0cef504bb4a19e9ba31e19532a?start=2022-11-01T13%3A24%3A15.638340&end=2022-11-03T13%3A24%3A15.638340" status: 200 len: 695 microversion: 2.1 time: 0.655801 Nov 02 13:24:16.615747 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1302/2845] 10.222.0.113 () {58 vars in 1417 bytes} [Wed Nov 2 13:24:15 2022] GET /compute/v2.1/os-simple-tenant-usage/1163cf0cef504bb4a19e9ba31e19532a?start=2022-11-01T13%3A24%3A15.638340&end=2022-11-03T13%3A24%3A15.638340 => generated 695 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:16.639543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5fc7cc4-554b-479f-9ade-07e10b180a7c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '.version_select at 0x7fe787e0c550>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:16.657110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:16.658470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:16.684141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:16.689506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:16.690110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:16.693817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:16.694060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5fc7cc4-554b-479f-9ade-07e10b180a7c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:16.694060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5fc7cc4-554b-479f-9ade-07e10b180a7c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:16.694349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:16.694442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5fc7cc4-554b-479f-9ade-07e10b180a7c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:16.694518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:16.708517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:16.730686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5fc7cc4-554b-479f-9ade-07e10b180a7c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:16.733659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5fc7cc4-554b-479f-9ade-07e10b180a7c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:16.734525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5fc7cc4-554b-479f-9ade-07e10b180a7c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:16.762104 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5fc7cc4-554b-479f-9ade-07e10b180a7c tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/os-simple-tenant-usage/1163cf0cef504bb4a19e9ba31e19532a?start=2022-11-01T13%3A24%3A15.638340&end=2022-11-03T13%3A24%3A15.638340" status: 200 len: 695 microversion: 2.1 time: 0.131410 Nov 02 13:24:16.764171 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1303/2846] 10.222.0.113 () {58 vars in 1417 bytes} [Wed Nov 2 13:24:16 2022] GET /compute/v2.1/os-simple-tenant-usage/1163cf0cef504bb4a19e9ba31e19532a?start=2022-11-01T13%3A24%3A15.638340&end=2022-11-03T13%3A24%3A15.638340 => generated 695 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:24:16.781594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75beb4de-42f5-4813-abd3-fcdad97b4f6b tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Calling method '.version_select at 0x7fe78791d430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:16.812449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75beb4de-42f5-4813-abd3-fcdad97b4f6b tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:16.817754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75beb4de-42f5-4813-abd3-fcdad97b4f6b tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:16.818426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75beb4de-42f5-4813-abd3-fcdad97b4f6b tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:16.857785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75beb4de-42f5-4813-abd3-fcdad97b4f6b tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:16.863057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75beb4de-42f5-4813-abd3-fcdad97b4f6b tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:16.864487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75beb4de-42f5-4813-abd3-fcdad97b4f6b tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:17.267461 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75beb4de-42f5-4813-abd3-fcdad97b4f6b tempest-TenantUsagesTestJSON-742209242 tempest-TenantUsagesTestJSON-742209242-project-admin] 10.222.0.113 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A24%3A15.638340&end=2022-11-03T13%3A24%3A15.638340&detailed=1" status: 200 len: 26891 microversion: 2.1 time: 0.489022 Nov 02 13:24:17.271005 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1304/2847] 10.222.0.113 () {58 vars in 1340 bytes} [Wed Nov 2 13:24:16 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T13%3A24%3A15.638340&end=2022-11-03T13%3A24%3A15.638340&detailed=1 => generated 26891 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:24:17.281041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:17.282576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:17.311151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:17.311924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:17.312734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:17.314689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:17.315420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:17.321424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:17.697513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:17.723416 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7c1fce93-baab-452f-ac37-175616a1f95c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.450618 Nov 02 13:24:17.724025 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1305/2848] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:17 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:17.744165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:17.750031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:17.772925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:17.779221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:17.784111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:17.793496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:17.794315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:17.794967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:18.053208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:18.096119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:18.099709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:18.102083 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-685918f5-3613-46ca-a424-be2667c0aff4 tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1568 microversion: 2.25 time: 1.883207 Nov 02 13:24:18.143013 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1544/2849] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:16 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1568 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:24:18.165337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:18.165972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:18.199700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:18.201523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:18.204286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:18.220242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:18.220736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:18.231940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:18.406710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:24:18.776006 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8b973cdb-d135-42e0-9b8b-8fbb2ead95f1 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "DELETE /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 204 len: 0 microversion: 2.1 time: 0.631566 Nov 02 13:24:18.781064 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1545/2850] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:24:18 2022] DELETE /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:24:18.798728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:18.819323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:18.839939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:18.856950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:18.857825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:18.858295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:18.859096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:18.859708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:18.860153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:18.883642 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c28ad62-a27c-47a7-9022-90580aba3497 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1691 microversion: 2.1 time: 1.145478 Nov 02 13:24:18.906111 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1306/2851] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:17 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1691 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:18.934948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:18.951961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:18.982794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:18.984048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:18.986756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:18.990920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:18.992248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:18.995329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:19.465086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:19.475853 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-264496a8-0f21-4ef7-9b87-a4cae84f1c14 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1474 microversion: 2.1 time: 0.563418 Nov 02 13:24:19.480106 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1307/2852] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:18 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1474 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:19.493246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:19.506753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:19.528288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:19.528288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:19.528288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:19.528288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:19.528798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:19.528798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:20.168921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:20.190351 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b1e2420f-d1f0-4502-b9e4-baabc8bd1df6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 1.403897 Nov 02 13:24:20.192536 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1546/2853] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:18 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:20.214842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:20.216460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:20.230587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:20.244225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:20.246317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:20.250754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:20.253026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:20.254955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:20.260885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:20.261071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4b987e6d2a814bc6b30b8191cfd5351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd89e00efbe3c49019171062c5e914dc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:20.261753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:20.264510 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8af437a6-c0b0-4fd3-bf55-9dbed056a6ac tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 200 len: 1568 microversion: 2.25 time: 0.782991 Nov 02 13:24:20.266871 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1308/2854] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:19 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 1568 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:24:20.513403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:20.514315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:20.579087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:20.582542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:20.583478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:20.585705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:20.588275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:20.595765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:20.723032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:20.733014 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b782738c-de05-454b-b76c-65317ad7a117 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1691 microversion: 2.1 time: 0.535370 Nov 02 13:24:20.756575 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1547/2855] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:20 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1691 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:20.774344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5c8e20e3-ac49-4e8f-9463-dea4f29164d0 req-2d9f96af-1c2e-4cc6-a208-0aa0a74613bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7e88a9-99ef-4852-9e10-1c55a1ded715", "name": "network-vif-deleted", "tag": "88c1f69b-6cdf-4c29-8632-fbddd4fe544c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:20.819689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5c8e20e3-ac49-4e8f-9463-dea4f29164d0 req-2d9f96af-1c2e-4cc6-a208-0aa0a74613bc service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:20.821037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5c8e20e3-ac49-4e8f-9463-dea4f29164d0 req-2d9f96af-1c2e-4cc6-a208-0aa0a74613bc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:20.823733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5c8e20e3-ac49-4e8f-9463-dea4f29164d0 req-2d9f96af-1c2e-4cc6-a208-0aa0a74613bc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:20.886734 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5c8e20e3-ac49-4e8f-9463-dea4f29164d0 req-2d9f96af-1c2e-4cc6-a208-0aa0a74613bc service nova] Creating event network-vif-deleted:88c1f69b-6cdf-4c29-8632-fbddd4fe544c for instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 on n-h2-858384-19 Nov 02 13:24:20.933486 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5c8e20e3-ac49-4e8f-9463-dea4f29164d0 req-2d9f96af-1c2e-4cc6-a208-0aa0a74613bc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175236 Nov 02 13:24:20.943863 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1548/2856] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:21.221809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:21.222782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:21.263323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:21.263826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:21.286092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:21.287041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:21.287829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:21.288370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:22.034062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:22.050885 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-503c574f-75ec-47fd-9af4-250b887882e6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.836598 Nov 02 13:24:22.055832 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1549/2857] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:21 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:22.066112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:22.066962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] [instance: 8d7e88a9-99ef-4852-9e10-1c55a1ded715] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:22.082801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:22.084567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:22.086462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:22.092334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:22.094490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:22.095127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:22.145018 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] HTTP exception thrown: Instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 could not be found. Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Request method failure captured: Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 HTTP/1.1 Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm0YwuYBpLxr4nHoXC6wyvjodLwPr85DS4H4BB-N6xNZc5Zt2VkYEPkphpE4jmqg5PKDz3QshgNU1AQeBUWmiErv2NsarP5o7KpWYIlYGzdT2A19aBjuN-ccC35-vgMpp1Q3EHrLAlplR9IJKmH7O9IcBcRCeNpAYxykcHDR7T6eXTQ Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d89e00efbe3c49019171062c5e914dc9 Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:24:22.147189 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d89e00efbe3c49019171062c5e914dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d89e00efbe3c49019171062c5e914dc9 Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618 Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-LiveAutoBlockMigrationV225Test-1798740618-project Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4b987e6d2a814bc6b30b8191cfd5351d Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1798740618-project Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 could not be found. Nov 02 13:24:22.149014 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '8d7e88a9-99ef-4852-9e10-1c55a1ded715'} Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 could not be found. Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:22.149700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 could not be found. Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 could not be found. Nov 02 13:24:22.151215 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:24:22.153833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] Returning 404 to user: Instance 8d7e88a9-99ef-4852-9e10-1c55a1ded715 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:22.154929 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7b565b0-f96d-4882-9b4b-ddc2adedceec tempest-LiveAutoBlockMigrationV225Test-1798740618 tempest-LiveAutoBlockMigrationV225Test-1798740618-project] 10.222.0.113 "GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715" status: 404 len: 111 microversion: 2.25 time: 0.097902 Nov 02 13:24:22.156072 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1550/2858] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:24:22 2022] GET /compute/v2.1/servers/8d7e88a9-99ef-4852-9e10-1c55a1ded715 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:24:22.166201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:22.167612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:22.174404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:22.175324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:22.176168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:22.178190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:22.178899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:22.180143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:22.360239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:22.379077 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83124479-25e8-424e-a5e0-6f193a2e186a tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1474 microversion: 2.1 time: 1.871593 Nov 02 13:24:22.379951 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1309/2859] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:20 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1474 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:22.800432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:22.815628 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-21a4c693-51f7-49e8-bdd0-ef74d970e193 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1691 microversion: 2.1 time: 0.657133 Nov 02 13:24:22.816838 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1551/2860] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:22 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1691 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:23.086872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:23.088075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:23.113795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ad9ab788-0960-44db-b14d-84a0c2e00385 req-dd76fc9a-a728-4ccd-9444-47e7d9338fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a655cb-cc68-4a7e-83d8-13ee7f71ff23", "name": "network-vif-deleted", "tag": "e06dd19b-48d1-4525-bd2e-82b5fa0202ca"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:23.119104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:23.130882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:23.132291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:23.135189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:23.136722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:23.137538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:23.149655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ad9ab788-0960-44db-b14d-84a0c2e00385 req-dd76fc9a-a728-4ccd-9444-47e7d9338fbb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:23.156392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ad9ab788-0960-44db-b14d-84a0c2e00385 req-dd76fc9a-a728-4ccd-9444-47e7d9338fbb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:23.156994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ad9ab788-0960-44db-b14d-84a0c2e00385 req-dd76fc9a-a728-4ccd-9444-47e7d9338fbb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:23.186275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:23.202060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ad9ab788-0960-44db-b14d-84a0c2e00385 req-dd76fc9a-a728-4ccd-9444-47e7d9338fbb service nova] Creating event network-vif-deleted:e06dd19b-48d1-4525-bd2e-82b5fa0202ca for instance 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 on n-h1-858384-19 Nov 02 13:24:23.219087 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ad9ab788-0960-44db-b14d-84a0c2e00385 req-dd76fc9a-a728-4ccd-9444-47e7d9338fbb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110362 Nov 02 13:24:23.224232 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1552/2861] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:23.418042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:23.419353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:23.449199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:23.449701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:23.450145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:23.450865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:23.454278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:23.454909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:23.482958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:23.494193 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-64061477-178b-4ffd-88ad-6b660fafc397 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.413058 Nov 02 13:24:23.506956 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1310/2862] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:23 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:23.564493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:23.565443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:23.566124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:23.566809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lazy-loading 'fault' on Instance uuid 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:24:23.854046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:23.856302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:23.881951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:23.888875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:23.890464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:23.892294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:23.893708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:23.895024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:24.120408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:24.142353 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e170188-fa52-4579-bb06-eeec424d52b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1691 microversion: 2.1 time: 0.292607 Nov 02 13:24:24.152520 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1311/2863] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:23 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:24.259751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a17b6690584dc29038247dea07ac26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1163cf0cef504bb4a19e9ba31e19532a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:24.282456 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-264a5e2e-fa70-42c1-b5bc-c6cb294e4e34 tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 200 len: 1308 microversion: 2.1 time: 0.871144 Nov 02 13:24:24.285583 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1553/2864] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:23 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 1308 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:24.529201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:24.530422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:24.543170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:24.543932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:24.546886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:24.556989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:24.557481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:24.557928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:25.014049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:25.025823 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04584cda-b414-4f07-a701-a3162f7dcd6f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.501545 Nov 02 13:24:25.027326 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1312/2865] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:24 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:25.176721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:25.177428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:25.200688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:25.201948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:25.203203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:25.204158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:25.204977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:25.225834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:25.314339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:25.315561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] [instance: 33a655cb-cc68-4a7e-83d8-13ee7f71ff23] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:25.341240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:25.342500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:25.343174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:25.348040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:25.350002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:25.350623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:25.376652 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] HTTP exception thrown: Instance 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 could not be found. Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Request method failure captured: Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 HTTP/1.1 Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm9amoCvKREHghaaUrGTiDUTjuLAgqXfLC6S9KAuF3dsNNoHtM0jxewT6G8U_9F7QRv0AG3vM0OVXyv0qGGTmpdehN1JGUL7FiGtd8EeT1Bq4zZQIDz2pDBDPgRikUWzrP7UhJbvILCOJ16e3oPK0Qn2SxHluIPBlk4X4oRwMq1_P78 Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 1163cf0cef504bb4a19e9ba31e19532a Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TenantUsagesTestJSON-1881644101 Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:24:25.379192 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/1163cf0cef504bb4a19e9ba31e19532a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/1163cf0cef504bb4a19e9ba31e19532a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_1163cf0cef504bb4a19e9ba31e19532a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/1163cf0cef504bb4a19e9ba31e19532a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TenantUsagesTestJSON-1881644101 Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 1163cf0cef504bb4a19e9ba31e19532a Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1881644101 Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TenantUsagesTestJSON-1881644101-project Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 79a17b6690584dc29038247dea07ac26 Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TenantUsagesTestJSON-1881644101-project Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 could not be found. Nov 02 13:24:25.380818 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '33a655cb-cc68-4a7e-83d8-13ee7f71ff23'} Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 could not be found. Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:25.382103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 could not be found. Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 could not be found. Nov 02 13:24:25.384244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:25.386902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] Returning 404 to user: Instance 33a655cb-cc68-4a7e-83d8-13ee7f71ff23 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:25.389676 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c3e7bed2-b658-447b-a145-9bfb118e787b tempest-TenantUsagesTestJSON-1881644101 tempest-TenantUsagesTestJSON-1881644101-project] 10.222.0.113 "GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23" status: 404 len: 111 microversion: 2.1 time: 0.079604 Nov 02 13:24:25.390951 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1313/2866] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:25 2022] GET /compute/v2.1/servers/33a655cb-cc68-4a7e-83d8-13ee7f71ff23 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:24:25.758870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:25.774843 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12ac9d9f-926c-4b4e-9be7-3dc77c398da1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.604851 Nov 02 13:24:25.777464 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1554/2867] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:25 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:26.063065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:26.063724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:26.077988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:26.078495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:26.078943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:26.083373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:26.083892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:26.086418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:26.850176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:26.870356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1072080746", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "1d4f643a-cb15-4b23-b27a-06cbc62da1dd"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:27.004799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:27.020276 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0d3f36cd-f431-4d74-98bc-b2ab5bdd6f28 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.961272 Nov 02 13:24:27.020893 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1555/2868] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:26 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:27.064354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3989d03c-56d1-4eea-8888-de9b0187c7dc req-86a6c71c-2882-4d10-8f57-8a861d5d35ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "name": "network-vif-plugged", "status": "completed", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:27.138701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] validate_networks() for [('1d4f643a-cb15-4b23-b27a-06cbc62da1dd', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:24:27.146759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3989d03c-56d1-4eea-8888-de9b0187c7dc req-86a6c71c-2882-4d10-8f57-8a861d5d35ab service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:27.150193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3989d03c-56d1-4eea-8888-de9b0187c7dc req-86a6c71c-2882-4d10-8f57-8a861d5d35ab service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:27.151066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3989d03c-56d1-4eea-8888-de9b0187c7dc req-86a6c71c-2882-4d10-8f57-8a861d5d35ab service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:27.198995 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3989d03c-56d1-4eea-8888-de9b0187c7dc req-86a6c71c-2882-4d10-8f57-8a861d5d35ab service nova] Creating event network-vif-plugged:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:24:27.216372 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3989d03c-56d1-4eea-8888-de9b0187c7dc req-86a6c71c-2882-4d10-8f57-8a861d5d35ab service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166050 Nov 02 13:24:27.219771 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1556/2869] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:27.235567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:27.239089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:27.274787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:27.276329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:27.277325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:27.279235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:27.279934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:27.280735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:28.236564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:28.253156 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e0b7150f-8821-4527-8cb0-3cb574462bfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 1.030262 Nov 02 13:24:28.262555 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1557/2870] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:27 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:28.341211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:28.346370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:28.347099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:24:28.348541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:24:28.349322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:24:28.349880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:24:28.350450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:24:28.398825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:28.399658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:28.400725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:28.401830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:28.402445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:28.405940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:28.412358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:28.412942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:28.419434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:28.426014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:28.430814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:28.432154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:28.441470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Getting quotas for project e23d91dc30354049bb22462413ae5a15. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:24:28.449268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Getting quotas for user 0935d05ae9274e9ba65f45b637e2ea66 and project e23d91dc30354049bb22462413ae5a15. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:24:28.466862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:24:28.486586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:24:28.575538 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e559c4b1-0642-46ba-9eeb-26e45490fe8e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.538800 Nov 02 13:24:28.580474 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1314/2871] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:24:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 2546 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:24:28.595816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf663e94-1995-4ca1-ba7c-ab82a32e61ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:28.599255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf663e94-1995-4ca1-ba7c-ab82a32e61ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:28.808233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cf663e94-1995-4ca1-ba7c-ab82a32e61ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:28.837601 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf663e94-1995-4ca1-ba7c-ab82a32e61ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1229 microversion: 2.1 time: 0.243984 Nov 02 13:24:28.856083 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1315/2872] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:28 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1229 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:29.299883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:29.303489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:29.330867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:29.332243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:29.334249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:29.338189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:29.340352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:29.341910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:29.517574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:29.534176 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d5a208a1-e5b6-464d-83db-29e17bac1d61 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 1.236302 Nov 02 13:24:29.570377 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1558/2873] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:28 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:29.593318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f59abc44-c3f2-48b6-bf39-a5c0cf32b765 req-fe1dc213-f995-418a-9340-5e05bda54a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34", "name": "network-vif-plugged", "status": "completed", "tag": "9891b1df-fb74-444a-a5e0-404fa6b836fd"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:29.648729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f59abc44-c3f2-48b6-bf39-a5c0cf32b765 req-fe1dc213-f995-418a-9340-5e05bda54a7c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:29.650129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f59abc44-c3f2-48b6-bf39-a5c0cf32b765 req-fe1dc213-f995-418a-9340-5e05bda54a7c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:29.652749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f59abc44-c3f2-48b6-bf39-a5c0cf32b765 req-fe1dc213-f995-418a-9340-5e05bda54a7c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:29.709467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f59abc44-c3f2-48b6-bf39-a5c0cf32b765 req-fe1dc213-f995-418a-9340-5e05bda54a7c service nova] Creating event network-vif-plugged:9891b1df-fb74-444a-a5e0-404fa6b836fd for instance e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 on n-h2-858384-19 Nov 02 13:24:29.727405 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f59abc44-c3f2-48b6-bf39-a5c0cf32b765 req-fe1dc213-f995-418a-9340-5e05bda54a7c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151396 Nov 02 13:24:29.728288 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1559/2874] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:29.883503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b401cd03-8ef6-4557-8459-621ab9b0fddb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:29.884328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b401cd03-8ef6-4557-8459-621ab9b0fddb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:30.170146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b401cd03-8ef6-4557-8459-621ab9b0fddb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:30.178232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b401cd03-8ef6-4557-8459-621ab9b0fddb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1229 microversion: 2.1 time: 0.301213 Nov 02 13:24:30.185941 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1560/2875] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:29 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1229 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:30.202307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:30.214633 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-76e92613-b457-4d4e-8821-2e9083168a87 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.920399 Nov 02 13:24:30.218681 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1316/2876] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:29 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:30.566209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:30.567423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:30.586454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:30.590263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:30.593252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:30.596336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:30.597271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:30.602535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:31.184733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:31.215701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:31.216304 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a30aa8a1-f5cd-46ae-91b2-8b8414d04b5b tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1322 microversion: 2.1 time: 0.651209 Nov 02 13:24:31.217101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:31.227145 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1561/2877] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:30 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1322 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:31.249349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:31.250663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:31.252225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:31.253346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:31.254121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:31.256024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:31.263865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:31.265218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:31.267757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:31.278089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:31.278747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:31.279396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:31.280503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:31.283579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:31.284814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:31.609734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:31.653020 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d4481d9-8a71-4992-ab92-20548aa17cba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1281 microversion: 2.1 time: 0.441182 Nov 02 13:24:31.662284 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1317/2878] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:31 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1281 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:31.674189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:31.693211 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d37fb58c-b266-43c5-af2f-d0e72171f0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.445660 Nov 02 13:24:31.693851 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1562/2879] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:31 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:32.250631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:32.252072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:32.270568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:32.275063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:32.276017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:32.276614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:32.277519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:32.278143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:32.278725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:32.542680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:32.553064 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6d47ddfd-1644-441e-8fd1-3f871f2ffdb5 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1512 microversion: 2.1 time: 0.306669 Nov 02 13:24:32.561184 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1318/2880] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:32 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:32.589304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:32.590233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:32.603027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:32.603939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:32.604868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:32.607382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:32.608538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:32.609200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:32.624862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:32.703391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:32.704443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:32.739082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:32.746557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:32.752354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:32.760305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:32.764396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:32.764883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:32.973841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:32.995997 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11917dff-6753-408f-897c-3d8abcdbe2cb tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1512 microversion: 2.1 time: 0.412854 Nov 02 13:24:32.997139 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1563/2881] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:32 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:33.002348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:33.003319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:33.009675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:33.010368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:33.010986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:33.011891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:33.012494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:33.013066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:33.231533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:33.251276 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf4dcc4b-cb19-4044-bc71-f6f5c9ac5483 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1287 microversion: 2.1 time: 0.556513 Nov 02 13:24:33.265147 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1319/2882] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:32 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1287 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:33.283590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60d876b7-c2ed-4847-aa6c-ccd894e9ca47 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:33.296294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60d876b7-c2ed-4847-aa6c-ccd894e9ca47 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:33.340238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d876b7-c2ed-4847-aa6c-ccd894e9ca47 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:33.340736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d876b7-c2ed-4847-aa6c-ccd894e9ca47 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:33.341185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d876b7-c2ed-4847-aa6c-ccd894e9ca47 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:33.341911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d876b7-c2ed-4847-aa6c-ccd894e9ca47 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:33.347970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d876b7-c2ed-4847-aa6c-ccd894e9ca47 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:33.357035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d876b7-c2ed-4847-aa6c-ccd894e9ca47 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:33.394890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:33.411590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c300f8a7-a74d-4b74-8b1e-c3b0b1acd3bc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.408206 Nov 02 13:24:33.412585 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1564/2883] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:32 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:33.626453 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60d876b7-c2ed-4847-aa6c-ccd894e9ca47 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "PUT /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1084 microversion: 2.1 time: 0.356484 Nov 02 13:24:33.640070 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1320/2884] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:24:33 2022] PUT /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1084 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:33.648691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:33.649317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:33.665758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:33.666253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:33.666697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:33.717346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:33.717896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.050s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:33.718352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:34.186042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:34.197273 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68146d71-e908-4f63-b82c-c517c0105256 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1510 microversion: 2.1 time: 0.552578 Nov 02 13:24:34.207240 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1565/2885] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:33 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1510 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:34.232357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:34.233079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:34.250367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:34.262832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:34.263558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:34.268597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:34.271314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:34.277761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:34.278525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:34.284958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:34.305433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:34.308992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:34.310460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:34.316906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:34.324349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:34.327198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:34.818199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:34.827226 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-27657c49-bf6b-4ff4-b606-f414754c008f tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 0.554166 Nov 02 13:24:34.849704 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1566/2886] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:34 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:34.862868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:34.863846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:34.880068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:34.880799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:34.882034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:34.885307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:34.886032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:34.888719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:35.236447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:35.252107 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dcc0c260-44b1-4d86-bbee-05e9457dedb9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.401001 Nov 02 13:24:35.278052 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1567/2887] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:34 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:35.446670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:35.484156 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a370330-1e96-4416-8dbb-782aa6674808 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1510 microversion: 2.1 time: 1.255604 Nov 02 13:24:35.484781 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1321/2888] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:34 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1510 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:35.508895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3e16fc4f-11a0-40e1-9243-255722796f2c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:35.511256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3e16fc4f-11a0-40e1-9243-255722796f2c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:35.520447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e16fc4f-11a0-40e1-9243-255722796f2c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:35.521507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e16fc4f-11a0-40e1-9243-255722796f2c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:35.525003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e16fc4f-11a0-40e1-9243-255722796f2c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:35.526514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e16fc4f-11a0-40e1-9243-255722796f2c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:35.539756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e16fc4f-11a0-40e1-9243-255722796f2c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:35.541058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e16fc4f-11a0-40e1-9243-255722796f2c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:35.765565 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3e16fc4f-11a0-40e1-9243-255722796f2c tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "PUT /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1086 microversion: 2.1 time: 0.262077 Nov 02 13:24:35.766685 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1568/2889] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:24:35 2022] PUT /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1086 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:35.790434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:35.792652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:35.808060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:35.810175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:35.811003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:35.814886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:35.815770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:35.818118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:35.865369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:35.869367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:35.934545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:35.935858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:35.936696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:35.949201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:35.950032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:35.965377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:36.221919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:36.232887 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88df99c1-98e1-4b8d-bbda-d56778db0e66 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 0.372771 Nov 02 13:24:36.244594 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1569/2890] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:35 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:36.290038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:36.295823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:36.321380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:36.325885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:36.329741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:36.332012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:36.332816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:36.333462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:36.599726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:36.611381 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-07065a33-03c7-4aeb-ae9a-175dc38847d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.329585 Nov 02 13:24:36.627233 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1570/2891] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:36 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:36.962054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:36.985885 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2a02f6eb-e7be-40c6-8df0-0cd906ab529a tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1512 microversion: 2.1 time: 1.199944 Nov 02 13:24:37.006203 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1322/2892] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:35 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1512 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:37.017892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:37.018525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:37.038187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:37.038842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:37.045517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:37.046608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:37.049543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:37.063348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:37.266527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:37.267173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:37.290324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:37.290820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:37.291292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:37.292009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:37.292465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:37.300004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:37.559438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:37.573016 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6a54d275-5824-40c3-8b66-ad965121469f tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1512 microversion: 2.1 time: 0.558943 Nov 02 13:24:37.604278 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1571/2893] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:37 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1512 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:37.620530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:37.622082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:37.641784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:37.644331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:37.647500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:37.649646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:37.651721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:37.652464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:37.702004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:24:37.988112 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79e1088c-ede4-442a-9cbd-e9d5e5d43471 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 204 len: 0 microversion: 2.1 time: 0.372667 Nov 02 13:24:37.989093 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1572/2894] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:24:37 2022] DELETE /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:24:38.011342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:38.013074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:38.035225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:38.036027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:38.036709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:38.041407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:38.041900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:38.042350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:38.381619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:38.393053 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c6b04946-917e-42a5-8fae-5f0b4e44bff3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 1.131543 Nov 02 13:24:38.416554 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1323/2895] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:37 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:38.429478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:38.434500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:38.455493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:38.459606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:38.461553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:38.464221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:38.467008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:38.467738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:38.470494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:38.472988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:38.512450 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bdda1e14-d24c-4b5b-94fb-9984007aa0df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.511832 Nov 02 13:24:38.517925 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1573/2896] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:37 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:38.586804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:24:38.757924 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.api [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Instance is already in deleting state, ignoring this request Nov 02 13:24:38.758843 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a83b245a-cea4-448e-a68b-8ab8b75ec979 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 204 len: 0 microversion: 2.1 time: 0.340886 Nov 02 13:24:38.769608 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1324/2897] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:24:38 2022] DELETE /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:24:38.777763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:38.778392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:38.818301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:38.820696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:38.827568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:38.832842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:38.837067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:38.838828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:39.332164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:39.345933 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79236aa8-9d0f-4db9-b561-913b5fc84438 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1518 microversion: 2.1 time: 0.574316 Nov 02 13:24:39.346856 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1574/2898] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:38 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1518 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:39.421547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:39.422178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:39.426342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:39.452453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:39.453231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:39.453835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:39.456905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:39.457619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:39.463840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:39.563718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:39.566857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:39.612642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:39.613356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:39.613987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:39.614902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:39.616826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:39.617480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:40.175465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:40.325041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:40.337389 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f877fe22-b0c0-4130-b22e-d64b8da248a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.800306 Nov 02 13:24:40.342541 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1575/2899] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:39 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:40.378061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:40.379414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:40.412054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:40.413937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:40.421393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:40.423430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:40.425210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:40.428968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:40.894265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:40.906624 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a4f25862-fb58-45e8-a61d-4d73a24837ea tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 1.489267 Nov 02 13:24:40.913009 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1325/2900] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:39 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:40.938295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c9149811-5b3f-43c0-858e-f2fa42ed6a93 req-f1851405-4e4d-457f-a076-c0e0584e7f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c8c5ad-c591-4d99-8c79-4e3515b774a8", "tag": "25421f7a-a58d-4954-9280-d650667346d2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:40.973376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c9149811-5b3f-43c0-858e-f2fa42ed6a93 req-f1851405-4e4d-457f-a076-c0e0584e7f89 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:40.974369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c9149811-5b3f-43c0-858e-f2fa42ed6a93 req-f1851405-4e4d-457f-a076-c0e0584e7f89 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:40.975050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c9149811-5b3f-43c0-858e-f2fa42ed6a93 req-f1851405-4e4d-457f-a076-c0e0584e7f89 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:41.027093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c9149811-5b3f-43c0-858e-f2fa42ed6a93 req-f1851405-4e4d-457f-a076-c0e0584e7f89 service nova] Creating event network-changed:25421f7a-a58d-4954-9280-d650667346d2 for instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 on n-h1-858384-19 Nov 02 13:24:41.045933 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c9149811-5b3f-43c0-858e-f2fa42ed6a93 req-f1851405-4e4d-457f-a076-c0e0584e7f89 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124558 Nov 02 13:24:41.047341 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1326/2901] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:41.180809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:41.204817 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a56fce90-0be3-4858-8554-e58e04364d84 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1518 microversion: 2.1 time: 0.830349 Nov 02 13:24:41.206167 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1576/2902] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:40 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1518 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:41.378867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:41.390384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:41.435991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:41.437500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:41.439653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:41.441208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:41.442666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:41.443802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:41.939013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:41.940050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:41.959212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:41.962837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:41.971375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:41.979867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:41.981035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:41.981760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:42.062328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:42.094766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:42.105246 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90fd826e-876b-48a1-83e2-e3b997c5825f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.740070 Nov 02 13:24:42.111325 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1327/2903] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:41 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:42.242940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:42.243630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:42.276155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:42.276749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:42.278812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:42.279600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:42.280057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:42.280478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:42.387868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:42.573196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:42.584839 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-326136ba-8827-4838-8431-48f80ac97af6 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1476 microversion: 2.1 time: 0.346621 Nov 02 13:24:42.606171 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1328/2904] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:42 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1476 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:43.107957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-99b43c71-b75f-4dda-8cda-9a666f424fc5 req-09950d0b-04ad-472b-80e3-c929c37fd4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34", "name": "network-vif-deleted", "tag": "9891b1df-fb74-444a-a5e0-404fa6b836fd"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:43.140796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-99b43c71-b75f-4dda-8cda-9a666f424fc5 req-09950d0b-04ad-472b-80e3-c929c37fd4bd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:43.147397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-99b43c71-b75f-4dda-8cda-9a666f424fc5 req-09950d0b-04ad-472b-80e3-c929c37fd4bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:43.149821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-99b43c71-b75f-4dda-8cda-9a666f424fc5 req-09950d0b-04ad-472b-80e3-c929c37fd4bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:43.216023 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-99b43c71-b75f-4dda-8cda-9a666f424fc5 req-09950d0b-04ad-472b-80e3-c929c37fd4bd service nova] Creating event network-vif-deleted:9891b1df-fb74-444a-a5e0-404fa6b836fd for instance e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 on n-h2-858384-19 Nov 02 13:24:43.236940 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-99b43c71-b75f-4dda-8cda-9a666f424fc5 req-09950d0b-04ad-472b-80e3-c929c37fd4bd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132896 Nov 02 13:24:43.251033 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1329/2905] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:43.277704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:43.280571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:43.317694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:43.318502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:43.325793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:43.326710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:43.327225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:43.337334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:43.546091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:43.561206 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-abe5ec73-4d13-4eb3-8202-1378f6b3109d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 1.626272 Nov 02 13:24:43.566844 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1577/2906] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:41 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:43.623774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:43.625110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:43.658191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:43.658704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:43.659323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:43.708861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:43.709555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:43.723598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:43.868940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:43.871471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:43.872418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:43.874440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lazy-loading 'fault' on Instance uuid e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:24:43.904978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:43.933844 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a1ab869c-1b52-44c6-be19-7710b3898484 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.667107 Nov 02 13:24:43.938819 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1330/2907] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:43 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:44.129212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8512848478ff4d6ea55d926bb887fa65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e36587404641ac2dcc993e860a3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:44.141431 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f9fc7b35-80cb-48ff-8f88-8354adac6990 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 200 len: 1312 microversion: 2.1 time: 0.522475 Nov 02 13:24:44.144162 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1578/2908] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:43 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 1312 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:44.592597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:44.593775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:44.605059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:44.607449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:44.608161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:44.609123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:44.610556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:44.612136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:44.964420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:44.965791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:44.980073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:44.985499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:44.986934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:44.989145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:44.992093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:44.992751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.051565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:45.063764 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-debec1f4-2b91-4c3b-aab5-cb14a4a9e715 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 0.475202 Nov 02 13:24:45.075520 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1331/2909] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:44 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:45.167011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:45.167664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:45.176879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.177371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.177828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.178557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.179679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.189452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.229909 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] HTTP exception thrown: Instance e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 could not be found. Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Request method failure captured: Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 HTTP/1.1 Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm7LG-up69Z20bF6XE8JDPO6QgleGInC2VYwfuy4QNehpIll6_NvP5hOiQU3QBJHrTETT2Qpb2FqKZf22RAQDSAfPHY-nsHgtsyEPRx-YPizLeh3b6qm0cqHw1tq67--GgMYLunyMG1io829gNq48te1TYjlipBnXZqHKt0gX-SfjTU Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:24:45.232790 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 8512848478ff4d6ea55d926bb887fa65 Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 could not be found. Nov 02 13:24:45.234402 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34'} Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 could not be found. Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:45.235307 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 could not be found. Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 could not be found. Nov 02 13:24:45.236733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.238851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Returning 404 to user: Instance e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:45.240035 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c9569138-84b6-47bb-92a1-e2ab02724964 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34" status: 404 len: 111 microversion: 2.1 time: 0.077791 Nov 02 13:24:45.245990 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1332/2910] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:45 2022] GET /compute/v2.1/servers/e3b62a0b-0ee8-48f3-aeb6-0ef9272d5d34 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:24:45.251741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:45.252756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:45.263454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.264124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.264867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.265758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.266406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.266995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.302060 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] HTTP exception thrown: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Request method failure captured: Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 HTTP/1.1 Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm7LG-up69Z20bF6XE8JDPO6QgleGInC2VYwfuy4QNehpIll6_NvP5hOiQU3QBJHrTETT2Qpb2FqKZf22RAQDSAfPHY-nsHgtsyEPRx-YPizLeh3b6qm0cqHw1tq67--GgMYLunyMG1io829gNq48te1TYjlipBnXZqHKt0gX-SfjTU Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:24:45.304794 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 8512848478ff4d6ea55d926bb887fa65 Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.306219 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '5b185e99-0344-4ba1-afba-41b3fb39a207'} Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:45.306906 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.309117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.312247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Returning 404 to user: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:45.313482 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b78aee28-398a-421c-b91a-21ab43265f04 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "DELETE /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 404 len: 111 microversion: 2.1 time: 0.066334 Nov 02 13:24:45.317357 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1333/2911] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:24:45 2022] DELETE /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:24:45.322728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:45.323788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 5b185e99-0344-4ba1-afba-41b3fb39a207] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:45.330250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.331101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.331839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.332774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.333661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.334450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.365855 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] HTTP exception thrown: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Request method failure captured: Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 HTTP/1.1 Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm7LG-up69Z20bF6XE8JDPO6QgleGInC2VYwfuy4QNehpIll6_NvP5hOiQU3QBJHrTETT2Qpb2FqKZf22RAQDSAfPHY-nsHgtsyEPRx-YPizLeh3b6qm0cqHw1tq67--GgMYLunyMG1io829gNq48te1TYjlipBnXZqHKt0gX-SfjTU Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:24:45.368558 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 8512848478ff4d6ea55d926bb887fa65 Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.370053 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '5b185e99-0344-4ba1-afba-41b3fb39a207'} Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:45.370732 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. Nov 02 13:24:45.371864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.374404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Returning 404 to user: Instance 5b185e99-0344-4ba1-afba-41b3fb39a207 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:45.375314 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c7785de-e59c-4711-9dec-0c8b4ef1c23d tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207" status: 404 len: 111 microversion: 2.1 time: 0.056784 Nov 02 13:24:45.391872 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1334/2912] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:45 2022] GET /compute/v2.1/servers/5b185e99-0344-4ba1-afba-41b3fb39a207 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:24:45.396648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:45.397416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:45.407020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.407554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.408001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.408715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.409175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.409606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.453976 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] HTTP exception thrown: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Request method failure captured: Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea HTTP/1.1 Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm7LG-up69Z20bF6XE8JDPO6QgleGInC2VYwfuy4QNehpIll6_NvP5hOiQU3QBJHrTETT2Qpb2FqKZf22RAQDSAfPHY-nsHgtsyEPRx-YPizLeh3b6qm0cqHw1tq67--GgMYLunyMG1io829gNq48te1TYjlipBnXZqHKt0gX-SfjTU Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:24:45.455565 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 8512848478ff4d6ea55d926bb887fa65 Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.456856 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '679d27a4-cc40-4091-ae09-84372ff9baea'} Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:45.457548 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.458647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.459950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Returning 404 to user: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:45.459950 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cd0db973-e0f5-4ce8-a357-60a2fd22a9a0 tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "DELETE /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 404 len: 111 microversion: 2.1 time: 0.064391 Nov 02 13:24:45.459950 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1335/2913] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:24:45 2022] DELETE /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:24:45.476871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:45.477497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] [instance: 679d27a4-cc40-4091-ae09-84372ff9baea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:45.496322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.496830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.497280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.498017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:45.498479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:45.498912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:45.527228 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] HTTP exception thrown: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Request method failure captured: Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea HTTP/1.1 Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm7LG-up69Z20bF6XE8JDPO6QgleGInC2VYwfuy4QNehpIll6_NvP5hOiQU3QBJHrTETT2Qpb2FqKZf22RAQDSAfPHY-nsHgtsyEPRx-YPizLeh3b6qm0cqHw1tq67--GgMYLunyMG1io829gNq48te1TYjlipBnXZqHKt0gX-SfjTU Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:24:45.529062 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/64d1e36587404641ac2dcc993e860a3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 64d1e36587404641ac2dcc993e860a3c Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-50469234 Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 8512848478ff4d6ea55d926bb887fa65 Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerDiskConfigTestJSON-50469234-project Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.530540 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '679d27a4-cc40-4091-ae09-84372ff9baea'} Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:24:45.531319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. Nov 02 13:24:45.532413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:24:45.537341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] Returning 404 to user: Instance 679d27a4-cc40-4091-ae09-84372ff9baea could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:24:45.539423 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-29ec04c7-7553-49fe-8d9d-2dc00203ffea tempest-ServerDiskConfigTestJSON-50469234 tempest-ServerDiskConfigTestJSON-50469234-project] 10.222.0.113 "GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea" status: 404 len: 111 microversion: 2.1 time: 0.067050 Nov 02 13:24:45.561027 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1336/2914] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:45 2022] GET /compute/v2.1/servers/679d27a4-cc40-4091-ae09-84372ff9baea => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:24:45.709650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:45.733562 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c114a00d-fa8a-4fc7-85d6-395029ea9180 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.768968 Nov 02 13:24:45.734812 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1579/2915] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:44 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:46.094068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:46.094813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:46.104933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:46.113639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:46.114216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:46.115746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:46.117149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:46.117763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:46.761975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:46.762513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:46.775629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:46.775982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:46.784853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:46.801914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:46.811446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:46.812160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:46.886723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:46.901076 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-959765ef-ca6e-447a-89d6-2d6ac20e2756 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 0.812525 Nov 02 13:24:46.920325 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1337/2916] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:46 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:47.937146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:47.940180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:47.958291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:47.959659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:47.961584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:47.963145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:47.964312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:47.965342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:48.067165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:48.077435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3de43582-a5d6-4301-a6ee-7dfff3387681 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 1.319377 Nov 02 13:24:48.099140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1580/2917] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:46 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:48.885841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:48.893877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:48.894973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Searching by: {'deleted': False, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:24:48.912489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:48.917547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:48.918670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:48.919699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:48.920347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:48.927287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:49.004148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:24:49.095422 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e0309eba-6098-46f6-bfd4-0d20cc317ed2 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 335 microversion: 2.1 time: 0.209473 Nov 02 13:24:49.097053 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1581/2918] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:24:48 2022] GET /compute/v2.1/servers => generated 335 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:24:49.117564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:49.134001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:49.135958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Searching by: {'deleted': False, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:24:49.166925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:49.169473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:49.169926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:49.176148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:49.176660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:49.177074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:49.208010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:49.218301 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8cbf1902-307a-4689-836d-806b0a92ab35 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 1.290515 Nov 02 13:24:49.224217 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1338/2919] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:47 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:49.236417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:49.247663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:49.255410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:24:49.265277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:49.272195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:49.275880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:49.276977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:49.280031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:49.280759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:49.440670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:49.454877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:49.455391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:49.455847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:50.012643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:50.023721 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-64935948-942d-43bf-a242-0aafad5f1b64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.798059 Nov 02 13:24:50.025238 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1339/2920] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:49 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:50.253562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:50.254344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:50.267434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:50.271730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:50.273228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:50.274755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:50.275508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:50.279692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:50.683128 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1504031e-4414-4145-8437-0a3f6b848703 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/detail" status: 200 len: 1702 microversion: 2.1 time: 1.574899 Nov 02 13:24:50.695417 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1582/2921] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:24:49 2022] GET /compute/v2.1/servers/detail => generated 1702 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:50.713367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f70c5a8-8f5d-40cd-b1a3-c34d574ac47f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:50.741508 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f70c5a8-8f5d-40cd-b1a3-c34d574ac47f tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.021554 Nov 02 13:24:50.749505 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1583/2922] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:24:50 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:51.056219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:51.056860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:51.069275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:51.069978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:51.070433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:51.079937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:51.080831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:51.091933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:51.793542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:51.801895 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2127c31-03de-4e37-865f-1ded1a4928d2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 1.558802 Nov 02 13:24:51.806788 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1340/2923] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:50 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:51.822504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:51.823026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:51.862582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:51.863081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:51.869227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:51.871643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:51.872288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:51.879379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:51.886090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:51.896181 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2c52c6c9-6b5d-48ae-b17f-ec99fbbec4c7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.846965 Nov 02 13:24:51.907799 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1584/2924] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:51 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:52.040214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:24:52.411424 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-91d8ca36-fd42-46e6-88af-4f4e35d96641 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "DELETE /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 204 len: 0 microversion: 2.1 time: 0.603170 Nov 02 13:24:52.422704 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1341/2925] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:24:51 2022] DELETE /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:24:52.431786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:52.446898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:52.489466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:52.490315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:52.491655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:52.492904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:52.493716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:52.494519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:52.528814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-2eba8a37-366e-4912-9945-1889ffef5b7f req-c93ebf6d-462b-4ff4-b6b9-9af0c9859a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c8c5ad-c591-4d99-8c79-4e3515b774a8", "name": "network-vif-plugged", "status": "completed", "tag": "25421f7a-a58d-4954-9280-d650667346d2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:52.600325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2eba8a37-366e-4912-9945-1889ffef5b7f req-c93ebf6d-462b-4ff4-b6b9-9af0c9859a81 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:52.611236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2eba8a37-366e-4912-9945-1889ffef5b7f req-c93ebf6d-462b-4ff4-b6b9-9af0c9859a81 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:52.612829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2eba8a37-366e-4912-9945-1889ffef5b7f req-c93ebf6d-462b-4ff4-b6b9-9af0c9859a81 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:52.707028 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-2eba8a37-366e-4912-9945-1889ffef5b7f req-c93ebf6d-462b-4ff4-b6b9-9af0c9859a81 service nova] Creating event network-vif-plugged:25421f7a-a58d-4954-9280-d650667346d2 for instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 on n-h1-858384-19 Nov 02 13:24:52.739586 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-2eba8a37-366e-4912-9945-1889ffef5b7f req-c93ebf6d-462b-4ff4-b6b9-9af0c9859a81 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215178 Nov 02 13:24:52.739806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1342/2926] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:52.829321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:52.830044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:52.841162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:52.854419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:52.855005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:52.855820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:52.856297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:52.856731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:53.799858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:53.825470 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-014f194b-48cf-4eb0-a254-179703ee4285 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1705 microversion: 2.1 time: 1.386145 Nov 02 13:24:53.825470 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1585/2927] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:52 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1705 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:53.825775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:53.825874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:53.826242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:53.832988 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-42db55d5-6a85-4a4b-9a04-0f0640180a16 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 1.010118 Nov 02 13:24:53.833803 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1343/2928] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:52 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:53.845207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:53.845893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:53.846496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:53.847471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:53.863983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:53.864557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:54.642752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:54.651523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b58261d3-dafd-4dc2-99af-a5044dd9a823 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.841795 Nov 02 13:24:54.652120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1586/2929] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:53 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:54.833927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:54.836089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:54.846518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:54.851977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:54.852787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:54.854250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:54.856868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:54.857608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:54.864717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:54.866135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:54.885032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:54.890302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:54.891676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:54.895424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:54.896191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:54.903799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:55.618124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:55.633028 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a3a2ea58-8102-44a3-83a5-f23015eefce7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 0.770605 Nov 02 13:24:55.640207 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1587/2930] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:54 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:55.675841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:55.676731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:55.691439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:55.692287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:55.694999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:55.696350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:55.698292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:55.698904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:56.260843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:56.275396 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d6e20d8-334d-4a03-a7fb-34518b07f08d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1686 microversion: 2.1 time: 0.605122 Nov 02 13:24:56.297989 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1588/2931] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:55 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1686 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:56.650726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:56.665330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:56.665961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:56.667944 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8faa300f-8530-4fda-90e7-6337ba6a55cc tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1705 microversion: 2.1 time: 1.838279 Nov 02 13:24:56.682479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:56.682964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:56.687568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:56.688320 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1344/2932] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:54 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1705 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:56.689763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:56.690262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:56.694912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:57.302707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:57.304856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:57.323987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:57.324995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:57.325597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:57.326482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:57.327324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:57.328033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:57.368962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:57.395718 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4732574a-2cb8-4838-90dc-e0e301a1b2ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1329 microversion: 2.1 time: 0.735194 Nov 02 13:24:57.417742 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1589/2933] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:56 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1329 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:57.697340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:57.698354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:57.709256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:57.713018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:57.714174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:57.719915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:57.720878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:57.722842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:58.053366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:58.070585 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4fa8dbf-dc10-4e03-b102-5e61621e00ed tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1637 microversion: 2.1 time: 0.378211 Nov 02 13:24:58.071604 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1590/2934] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:57 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1637 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:58.426365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:58.427162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:58.438473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:58.439058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:58.441125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:58.442080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:58.445334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:58.449900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:58.778720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:58.793231 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d6025da3-22a3-492f-b9dc-b982917704d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 1.495220 Nov 02 13:24:58.795483 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1345/2935] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:57 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:59.188405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:59.332674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83bae06a-81be-460e-94ac-a8f2fb7add68 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Action: 'create', calling method: .version_select at 0x7fe78773d430>, body: {"keypair": {"name": "tempest-keypair-2014336364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbupECdlA5+aX3o+VWqMQ1LXCzXV2OyY76cCro/tLm20VDqMrltpNSpQlHhgtU60zp/WKqXB51ZtOoH0h66orG9ucuw9Vl/1hAQyM8G68tYZx08ODGaccl/XyPJMFDgAA=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:59.400652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-83bae06a-81be-460e-94ac-a8f2fb7add68 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Getting quotas for project 26d4814779354fb6be0cfd8213a1ef83. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:24:59.424162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-83bae06a-81be-460e-94ac-a8f2fb7add68 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Getting quotas for user f635fead26c9417c9781b527efc9353e and project 26d4814779354fb6be0cfd8213a1ef83. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:24:59.435486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:24:59.481795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:59.484024 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83bae06a-81be-460e-94ac-a8f2fb7add68 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.686853 Nov 02 13:24:59.484805 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1346/2936] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:24:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:59.490327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:59.493497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:59.517897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.518567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.519013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.519817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.520276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.520728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.536994 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9dcb8dc4-3d0b-47e6-ad44-311e083c4286 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1526 microversion: 2.1 time: 1.113206 Nov 02 13:24:59.554208 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1591/2937] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:58 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1526 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:24:59.579803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:59.585828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:59.614757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.617736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.618608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.619918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.621016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.622445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.698986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.699858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.700919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.702203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lazy-loading 'fault' on Instance uuid bc3bac6c-ee78-42bb-bec5-d234e99c4f4a {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:24:59.874413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fea8089e4b648b39c33daa3bd1e1d56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6607f7935f1b4f3a820f53ae3d8474ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:24:59.882625 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e568d289-d3ac-453a-b477-a16b3e982d45 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 200 len: 1363 microversion: 2.1 time: 0.326836 Nov 02 13:24:59.885509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1592/2938] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:59 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:24:59.890551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b4c2fca2-f4cd-4054-bb85-88a8066c6829 req-09ee19c5-dca1-43c8-930e-3e0e87d54ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3bac6c-ee78-42bb-bec5-d234e99c4f4a", "name": "network-vif-deleted", "tag": "80f8ad8e-c5fe-4f0d-a64c-27e7e46de62e"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:24:59.918046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b4c2fca2-f4cd-4054-bb85-88a8066c6829 req-09ee19c5-dca1-43c8-930e-3e0e87d54ad1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.918914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b4c2fca2-f4cd-4054-bb85-88a8066c6829 req-09ee19c5-dca1-43c8-930e-3e0e87d54ad1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.919587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b4c2fca2-f4cd-4054-bb85-88a8066c6829 req-09ee19c5-dca1-43c8-930e-3e0e87d54ad1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.943646 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b4c2fca2-f4cd-4054-bb85-88a8066c6829 req-09ee19c5-dca1-43c8-930e-3e0e87d54ad1 service nova] Creating event network-vif-deleted:80f8ad8e-c5fe-4f0d-a64c-27e7e46de62e for instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a on n-h1-858384-19 Nov 02 13:24:59.956711 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b4c2fca2-f4cd-4054-bb85-88a8066c6829 req-09ee19c5-dca1-43c8-930e-3e0e87d54ad1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069660 Nov 02 13:24:59.961741 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1593/2939] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:24:59.967429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:24:59.970414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:24:59.988701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.992336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.993117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:24:59.996171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:24:59.996810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:24:59.997414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:00.004067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:00.318631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:00.327973 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-353294f8-1447-42d7-b72f-94dded565e02 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.841794 Nov 02 13:25:00.334607 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1347/2940] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:59 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:00.742673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:00.785688 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11449ead-b701-4117-bc4d-b9f401d22497 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1526 microversion: 2.1 time: 0.822331 Nov 02 13:25:00.786309 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1594/2941] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:24:59 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1526 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:00.818108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53dfe86e-95fb-40c2-9a8a-381536337a02 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-752354785", "metadata": {"": ""}}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53dfe86e-95fb-40c2-9a8a-381536337a02 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action HTTP/1.1 Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 106 Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:25:00.823743 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-752354785", "metadata": {"": ""}}} Nov 02 13:25:00.825054 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '71c8c5ad-c591-4d99-8c79-4e3515b774a8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-752354785', 'metadata': {'': ''}}}} Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'': ''} Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:00.825818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.827245 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:00.828614 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:00.828614 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:00.828614 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:25:00.828614 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:25:00.828614 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:25:00.828614 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.830913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53dfe86e-95fb-40c2-9a8a-381536337a02 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:00.831919 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-53dfe86e-95fb-40c2-9a8a-381536337a02 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action" status: 400 len: 170 microversion: 2.1 time: 0.023572 Nov 02 13:25:00.833317 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1348/2942] 10.222.0.113 () {60 vars in 1284 bytes} [Wed Nov 2 13:25:00 2022] POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:25:00.848202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:00.849464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:00.861615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:00.862516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:00.864717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:00.865802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:00.866438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:00.867290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:00.907757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:00.908897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] [instance: bc3bac6c-ee78-42bb-bec5-d234e99c4f4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:00.920425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:00.927586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:00.929574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:00.930841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:00.933065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:00.935197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:00.971729 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] HTTP exception thrown: Instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a could not be found. Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Request method failure captured: Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a HTTP/1.1 Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm8hZo50ZWLZ2DQHuJZbyg8bUBGKvotLMV72dMBnDeR5uWbjAjTin7HWwe2eFzs6L3kf2I2vxZIyeIAKZs6ru_2Zu6NXXzPjLrg0yvIlKO9u_778Tb038CyehzPjV0UYYgsUaFr3pdf1a5Oflf8VNds0wevPRgBbbDh3lumTgy_bubY Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 6607f7935f1b4f3a820f53ae3d8474ea Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-364335444 Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:25:00.974344 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6607f7935f1b4f3a820f53ae3d8474ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6607f7935f1b4f3a820f53ae3d8474ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_6607f7935f1b4f3a820f53ae3d8474ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/6607f7935f1b4f3a820f53ae3d8474ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-364335444 Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 6607f7935f1b4f3a820f53ae3d8474ea Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-364335444 Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-364335444-project Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4fea8089e4b648b39c33daa3bd1e1d56 Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-364335444-project Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a could not be found. Nov 02 13:25:00.975779 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'bc3bac6c-ee78-42bb-bec5-d234e99c4f4a'} Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a could not be found. Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:00.976761 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a could not be found. Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a could not be found. Nov 02 13:25:00.977918 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:00.980567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Returning 404 to user: Instance bc3bac6c-ee78-42bb-bec5-d234e99c4f4a could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:00.981749 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75aab779-9542-4678-b805-fe44d8608d4e tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a" status: 404 len: 111 microversion: 2.1 time: 0.079223 Nov 02 13:25:00.982609 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1349/2943] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:00 2022] GET /compute/v2.1/servers/bc3bac6c-ee78-42bb-bec5-d234e99c4f4a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:25:00.996353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2af4df1-1966-4baf-86e5-4dc02045deb0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] Calling method '.version_select at 0x7fe786fd6550>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:01.035433 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2af4df1-1966-4baf-86e5-4dc02045deb0 tempest-ServersTestJSON-364335444 tempest-ServersTestJSON-364335444-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459764396" status: 202 len: 0 microversion: 2.1 time: 0.048123 Nov 02 13:25:01.039913 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1350/2944] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:25:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459764396 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:25:01.270698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:01.285155 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f87b0809-6186-47a4-8b87-8cb55f183607 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1526 microversion: 2.1 time: 0.445426 Nov 02 13:25:01.291474 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1595/2945] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:00 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1526 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:01.318381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:01.319046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:01.338546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:01.339058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:01.341842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:01.344310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:01.345530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:01.346923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:01.414665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:01.608696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-993e23cd-657c-4fcd-85cc-457754bf729a req-2527bbd1-0fbf-42c3-95fb-a1c4b3bbfeff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "name": "network-vif-unplugged", "status": "completed", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:01.634717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:01.639750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-993e23cd-657c-4fcd-85cc-457754bf729a req-2527bbd1-0fbf-42c3-95fb-a1c4b3bbfeff service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:01.640250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-993e23cd-657c-4fcd-85cc-457754bf729a req-2527bbd1-0fbf-42c3-95fb-a1c4b3bbfeff service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:01.644175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-993e23cd-657c-4fcd-85cc-457754bf729a req-2527bbd1-0fbf-42c3-95fb-a1c4b3bbfeff service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:01.685848 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-993e23cd-657c-4fcd-85cc-457754bf729a req-2527bbd1-0fbf-42c3-95fb-a1c4b3bbfeff service nova] Creating event network-vif-unplugged:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:25:01.697676 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-993e23cd-657c-4fcd-85cc-457754bf729a req-2527bbd1-0fbf-42c3-95fb-a1c4b3bbfeff service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092810 Nov 02 13:25:01.700385 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1596/2946] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:02.138351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:02.162272 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-21bc5d52-4e21-43c1-a7ba-e7ccb2e6a0fb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1526 microversion: 2.1 time: 0.842645 Nov 02 13:25:02.167757 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1351/2947] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:01 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1526 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:02.193201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2bc1167b-21d4-44ac-b650-7e4f36a55df2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-548873602", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2bc1167b-21d4-44ac-b650-7e4f36a55df2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action HTTP/1.1 Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 618 Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:25:02.198696 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:02.200306 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:25:02.200990 n-d-858384-19 devstack@n-api.service[120928]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-548873602", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Nov 02 13:25:02.200990 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:25:02.200990 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '71c8c5ad-c591-4d99-8c79-4e3515b774a8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-548873602', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 02 13:25:02.201256 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:02.201975 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:02.203332 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:02.204081 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:02.204081 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:02.204081 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:25:02.204081 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:25:02.204081 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:25:02.204081 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:02.204506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2bc1167b-21d4-44ac-b650-7e4f36a55df2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:02.204506 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2bc1167b-21d4-44ac-b650-7e4f36a55df2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action" status: 400 len: 938 microversion: 2.1 time: 0.013381 Nov 02 13:25:02.204665 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1597/2948] 10.222.0.113 () {60 vars in 1284 bytes} [Wed Nov 2 13:25:02 2022] POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:25:02.210189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:02.210818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:02.221654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:02.225075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:02.241190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:02.241995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:02.242542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:02.242922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:02.704717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:02.725642 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ab2ae1e1-2ecf-409f-8d26-86c0565e53c9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1526 microversion: 2.1 time: 0.511161 Nov 02 13:25:02.726970 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1352/2949] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:02 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1526 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:02.757330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:02.758057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:02.790358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:02.790859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:02.791335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:02.794861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:02.802388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:02.802938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:03.321714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:03.336405 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79ea16e9-ff84-45e4-b5fb-80dd591c3de8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1526 microversion: 2.1 time: 0.583894 Nov 02 13:25:03.337269 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1598/2950] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:02 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1526 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:03.364582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aa2f9aec-7fa0-4069-ba86-e80fdaedea62 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aa2f9aec-7fa0-4069-ba86-e80fdaedea62 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action HTTP/1.1 Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 285 Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:25:03.374316 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:03.375881 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '71c8c5ad-c591-4d99-8c79-4e3515b774a8', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:25:03.376516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:03.377490 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:03.379004 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:03.380041 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:25:03.380041 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:25:03.380041 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:25:03.380041 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:25:03.380041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aa2f9aec-7fa0-4069-ba86-e80fdaedea62 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:03.380399 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aa2f9aec-7fa0-4069-ba86-e80fdaedea62 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action" status: 400 len: 619 microversion: 2.1 time: 0.016273 Nov 02 13:25:03.391787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:03.392444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:03.395805 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1353/2951] 10.222.0.113 () {60 vars in 1284 bytes} [Wed Nov 2 13:25:03 2022] POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:25:03.399381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:03.399869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:03.400305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:03.401007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:03.401460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:03.401880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:03.969720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:03.970347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:03.986388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:03.989172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:03.989677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:03.990120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:03.990899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:03.991379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:03.991804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:04.144365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:04.157550 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10d001be-346f-45ae-8de7-89316f0279aa tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1526 microversion: 2.1 time: 0.775624 Nov 02 13:25:04.163641 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1599/2952] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:03 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1526 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:04.198039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:04.199294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:04.215749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:04.235514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:04.236410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:04.237313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:04.237959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:04.238604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:04.695422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:04.707008 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-81b01bda-d944-4637-b34f-9a5fb27779ec tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.743298 Nov 02 13:25:04.709979 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1354/2953] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:03 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:04.714925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-901803037", "imageRef": "bdefdd6f-a641-48a6-a32d-30e92755cfe3", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cb953b27-0be4-4c39-8737-a73e03573ca3"}], "security_groups": [{"name": "tempest-securitygroup--1420960024"}], "key_name": "tempest-keypair-2014336364", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:04.719237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:04.742845 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8692f6ab-f270-4d11-b293-4592fb2e731e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1526 microversion: 2.1 time: 0.547089 Nov 02 13:25:04.755585 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1600/2954] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:04 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1526 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:04.756097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:04.759214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:04.772338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:04.775493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:04.776125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:04.779443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:04.780081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:04.782368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:05.172611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:05.182635 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11547b52-064c-4f99-851f-0f752a693381 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.436586 Nov 02 13:25:05.195535 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1601/2955] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:04 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:05.211002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f3325b78-dded-47fb-a035-f406680c9cc8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-300489871"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:05.215700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f3325b78-dded-47fb-a035-f406680c9cc8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:05.222582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3325b78-dded-47fb-a035-f406680c9cc8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:05.223328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3325b78-dded-47fb-a035-f406680c9cc8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:05.224018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3325b78-dded-47fb-a035-f406680c9cc8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:05.225541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3325b78-dded-47fb-a035-f406680c9cc8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:05.226248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3325b78-dded-47fb-a035-f406680c9cc8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:05.226908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3325b78-dded-47fb-a035-f406680c9cc8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:05.578623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] validate_networks() for [('cb953b27-0be4-4c39-8737-a73e03573ca3', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:05.735206 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f3325b78-dded-47fb-a035-f406680c9cc8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action" status: 202 len: 0 microversion: 2.1 time: 0.537860 Nov 02 13:25:05.740244 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1602/2956] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:25:05 2022] POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:25:05.760812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:05.766843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:05.782465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:05.783751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:05.788461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:05.789542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:05.790198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:05.790848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:06.402106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:06.414968 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5c07e134-e923-4bd5-84b1-63a2f014a0c4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.672486 Nov 02 13:25:06.433958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1603/2957] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:05 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:06.456893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1132839759"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:06.484034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:06.510144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:06.511839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:06.515704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:06.517289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:06.517837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:06.518400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:06.614969 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Cannot 'createImage' instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 while it is in task_state image_snapshot Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action HTTP/1.1 Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 85 Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:25:06.626558 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1132839759"}} Nov 02 13:25:06.627939 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot 'createImage' instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 while it is in task_state image_snapshot Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '71c8c5ad-c591-4d99-8c79-4e3515b774a8', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1132839759'}}} Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:06.628628 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 while it is in task_state image_snapshot Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 while it is in task_state image_snapshot Nov 02 13:25:06.629728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:06.633739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 409 to user: Cannot 'createImage' instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 while it is in task_state image_snapshot {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:06.637443 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15643d08-af76-4e5f-abf9-6a9b2e617e59 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action" status: 409 len: 159 microversion: 2.1 time: 0.198908 Nov 02 13:25:06.638652 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1604/2958] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:25:06 2022] POST /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8/action => generated 159 bytes in 204 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:25:06.657018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cf0eb2db-61f7-413a-91b2-176d33a3302b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:06.660057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cf0eb2db-61f7-413a-91b2-176d33a3302b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:06.670991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf0eb2db-61f7-413a-91b2-176d33a3302b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:06.671813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf0eb2db-61f7-413a-91b2-176d33a3302b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:06.672809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf0eb2db-61f7-413a-91b2-176d33a3302b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:06.677112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf0eb2db-61f7-413a-91b2-176d33a3302b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:06.678460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf0eb2db-61f7-413a-91b2-176d33a3302b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:06.679385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf0eb2db-61f7-413a-91b2-176d33a3302b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:06.797422 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cf0eb2db-61f7-413a-91b2-176d33a3302b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.157269 Nov 02 13:25:06.798128 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1605/2959] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:25:06 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:25:06.807572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f01b23f8-e7ca-4d0a-bdcc-5b1de9696581 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '.version_select at 0x7fe786bbb310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:06.973164 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f01b23f8-e7ca-4d0a-bdcc-5b1de9696581 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/images/0c2bc0f1-2805-415c-b5c3-28c1c4c33d71" status: 204 len: 0 microversion: 2.1 time: 0.173127 Nov 02 13:25:06.973772 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1606/2960] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:06 2022] DELETE /compute/v2.1/images/0c2bc0f1-2805-415c-b5c3-28c1c4c33d71 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:25:06.983588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:06.984722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:06.998944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:07.000564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:07.001951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:07.005073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:07.005926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:07.007333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:07.353180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:07.370436 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8cd3a166-74e1-40d1-9e58-bdd5c413a500 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1675 microversion: 2.1 time: 0.394908 Nov 02 13:25:07.371040 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1607/2961] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:06 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1675 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:07.387451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:07.388302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:07.395729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:07.396487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:07.397906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:07.398934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:07.399604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:07.402723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:07.590254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:07.591325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:07.591974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:07.592542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:07.593125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:07.614837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:07.615285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:07.616255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:07.617236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:07.617891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:07.618509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:07.663561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Getting quotas for project 26d4814779354fb6be0cfd8213a1ef83. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:07.681035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Getting quotas for user f635fead26c9417c9781b527efc9353e and project 26d4814779354fb6be0cfd8213a1ef83. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:07.703287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:07.705606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdefdd6f-a641-48a6-a32d-30e92755cfe3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:07.787962 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-59c4f66e-33db-4d86-93b2-e86fbd08a3d6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.076038 Nov 02 13:25:07.788734 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1355/2962] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:25:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 3078 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:25:07.805149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42e03809-3e90-47be-b65f-336600d0b823 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:07.805793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-42e03809-3e90-47be-b65f-336600d0b823 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:07.880783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:07.894688 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a248937d-d336-4751-ab3a-91c2892a3ae7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1538 microversion: 2.1 time: 0.515907 Nov 02 13:25:07.896119 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1608/2963] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:07 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1538 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:07.986414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-42e03809-3e90-47be-b65f-336600d0b823 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:08.000698 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-42e03809-3e90-47be-b65f-336600d0b823 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1249 microversion: 2.1 time: 0.199413 Nov 02 13:25:08.015156 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1356/2964] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:07 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1249 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:08.402216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:08.403029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:08.415907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:08.418651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:08.419131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:08.427213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:08.428854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:08.431368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:09.052365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-498669815", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "77332e98-06d7-4068-a32b-3be1288b5a76"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:09.062135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:09.084502 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ada69319-0ecd-4e2d-8232-0070810c8b75 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1675 microversion: 2.1 time: 0.685470 Nov 02 13:25:09.089026 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1609/2965] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:08 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1675 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:09.109291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:09.110195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:09.146448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:09.147023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:09.147503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:09.169477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:09.170219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:09.171895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:09.232928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] validate_networks() for [('77332e98-06d7-4068-a32b-3be1288b5a76', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:09.529278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:09.541939 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a9f44489-52d0-4b32-87d7-b1df8a32146a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1544 microversion: 2.1 time: 0.444977 Nov 02 13:25:09.544348 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1610/2966] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:09 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1544 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:09.555487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:09.556929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:09.566748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:09.568052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:09.569065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:09.570502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:09.571564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:09.572380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:09.630073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:09.736374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:09.750092 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d67a3932-8652-448e-92e5-b9fc32282f12 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1301 microversion: 2.1 time: 0.202841 Nov 02 13:25:09.763856 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1611/2967] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:09 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1301 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:10.113885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:10.117247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:10.136404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:10.137217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:10.139029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:10.140125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:10.141910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:10.142930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:10.469273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:10.485190 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34401b8a-2beb-4023-b169-a0cab15c269c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1680 microversion: 2.1 time: 0.378780 Nov 02 13:25:10.505974 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1612/2968] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:10 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1680 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:10.572433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:10.574387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:10.590454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:10.591080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:10.591570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:10.592330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:10.592799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:10.593238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:10.915294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:10.925055 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cbc0e5ea-9956-4c92-94ca-c310af9465ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1544 microversion: 2.1 time: 0.358859 Nov 02 13:25:10.949591 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1613/2969] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:10 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1544 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:10.955266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:10.956020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:10.964357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:10.965352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:10.966015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:10.966912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:10.967582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:10.968458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:11.063560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:11.077694 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aada6317-cfbd-40b5-b38f-09fecd920870 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1307 microversion: 2.1 time: 0.127569 Nov 02 13:25:11.079469 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1614/2970] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:10 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:11.518676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:11.520068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:11.531844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:11.532809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:11.536655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:11.538861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:11.539641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:11.541194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:11.640652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:11.641922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:11.642973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:11.643894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:11.644547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:11.658792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:11.659845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:11.660775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:11.663647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:11.664759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:11.665656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:11.694167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Getting quotas for project 72c5872e73074f02b439a49d48ee3a57. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:11.701155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Getting quotas for user 10a41deca4164409ae7fd55c52029c72 and project 72c5872e73074f02b439a49d48ee3a57. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:11.720575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:11.723740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:11.826859 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-93bd1874-4054-4dde-8a78-59f3c3e491c2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.034100 Nov 02 13:25:11.829285 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1357/2971] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:25:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 3039 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:25:11.954926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:11.955744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:11.970001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:11.971164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:11.974072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:11.975868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:11.979920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:11.981628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:12.401791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:12.415812 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41ee5b5b-26e8-4acd-bccc-ae4d9adba520 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.901888 Nov 02 13:25:12.420889 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1615/2972] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:11 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:12.426830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1527915517", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "77332e98-06d7-4068-a32b-3be1288b5a76"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:12.533961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] validate_networks() for [('77332e98-06d7-4068-a32b-3be1288b5a76', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:13.337169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:13.338283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:13.339207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:13.340660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:13.342323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:13.361321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:13.362362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:13.363018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:13.364782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:13.366873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:13.368231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:13.401789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Getting quotas for project 72c5872e73074f02b439a49d48ee3a57. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:13.410387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Getting quotas for user 10a41deca4164409ae7fd55c52029c72 and project 72c5872e73074f02b439a49d48ee3a57. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:13.438066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:13.442604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:13.581590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b11a9df-cf32-435e-8cef-18c58a14a614 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.156460 Nov 02 13:25:13.584198 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1616/2973] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:25:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:25:13.628567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:13.631815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:13.676719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:13.680221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:13.680971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:13.685122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:13.686095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:13.686781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:13.941464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:13.953336 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83240cf6-b0ed-458a-b2b1-099154a650d9 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1307 microversion: 2.1 time: 0.364429 Nov 02 13:25:13.969598 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1617/2974] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:13 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:14.010177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-01fb6094-813a-4d5a-9c58-7ecfb0812165 req-075f6b39-b3b7-41d6-9c47-6590d110326d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c8c5ad-c591-4d99-8c79-4e3515b774a8", "name": "network-vif-plugged", "status": "completed", "tag": "25421f7a-a58d-4954-9280-d650667346d2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:14.039988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-01fb6094-813a-4d5a-9c58-7ecfb0812165 req-075f6b39-b3b7-41d6-9c47-6590d110326d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.042160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-01fb6094-813a-4d5a-9c58-7ecfb0812165 req-075f6b39-b3b7-41d6-9c47-6590d110326d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.043854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-01fb6094-813a-4d5a-9c58-7ecfb0812165 req-075f6b39-b3b7-41d6-9c47-6590d110326d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.079300 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-01fb6094-813a-4d5a-9c58-7ecfb0812165 req-075f6b39-b3b7-41d6-9c47-6590d110326d service nova] Creating event network-vif-plugged:25421f7a-a58d-4954-9280-d650667346d2 for instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 on n-h1-858384-19 Nov 02 13:25:14.104941 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-01fb6094-813a-4d5a-9c58-7ecfb0812165 req-075f6b39-b3b7-41d6-9c47-6590d110326d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113244 Nov 02 13:25:14.107667 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1618/2975] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:14.124530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-745dfb37-4a45-442a-858d-dd122bdda1c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:14.139907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-745dfb37-4a45-442a-858d-dd122bdda1c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:14.160340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-745dfb37-4a45-442a-858d-dd122bdda1c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.160750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-745dfb37-4a45-442a-858d-dd122bdda1c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.161208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-745dfb37-4a45-442a-858d-dd122bdda1c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.164402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-745dfb37-4a45-442a-858d-dd122bdda1c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.167053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-745dfb37-4a45-442a-858d-dd122bdda1c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.167784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-745dfb37-4a45-442a-858d-dd122bdda1c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.227186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:14.239813 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b56679a6-57c9-44cd-b0af-4667b2fa1f6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1544 microversion: 2.1 time: 2.290768 Nov 02 13:25:14.258568 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1358/2976] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:11 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1544 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:14.263787 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-745dfb37-4a45-442a-858d-dd122bdda1c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 200 len: 324 microversion: 2.1 time: 0.154462 Nov 02 13:25:14.264785 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1619/2977] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:25:14 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 324 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:14.273175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-522751342", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "451", "networks": [{"uuid": "77332e98-06d7-4068-a32b-3be1288b5a76"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:14.277284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:14.278180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:14.307746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.313097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.314360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.314468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.314867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.315716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.379666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] validate_networks() for [('77332e98-06d7-4068-a32b-3be1288b5a76', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:14.840743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:14.853606 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1f660c1-382c-4ea2-96eb-9ea62e497a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.582733 Nov 02 13:25:14.854206 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1620/2978] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:14 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:14.894646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:14.903064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:14.927154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.930403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.931091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:14.933527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:14.934492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:14.935688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:15.478410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:15.516882 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af72be62-18bf-476d-a60d-3d3957175a99 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.629220 Nov 02 13:25:15.520341 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1621/2979] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:14 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:15.545413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:15.547405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:15.572038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:15.573341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:15.576141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:15.578555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:15.580348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:15.581878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:16.504478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:16.518590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7139ff73-a5c1-4aa7-a5d0-55c3f5a4cdf3 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 0.991946 Nov 02 13:25:16.523439 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1622/2980] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:15 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:16.534166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:16.535214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:16.553937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:16.554835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:16.555535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:16.558248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:16.558971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:16.559644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:17.993953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:18.009511 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f6c12375-55ac-4b57-8070-101c0f4b4496 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1544 microversion: 2.1 time: 1.484728 Nov 02 13:25:18.010127 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1623/2981] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:16 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1544 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:18.034344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:18.035300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:18.059287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.059827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.061528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:18.065371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.066377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.067173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:18.197384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:18.198166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:18.199092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:18.199949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:18.200647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:18.219609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.220850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.221821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:18.225883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.226378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.226848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:18.284971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Getting quotas for project 72c5872e73074f02b439a49d48ee3a57. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:18.302139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Getting quotas for user 10a41deca4164409ae7fd55c52029c72 and project 72c5872e73074f02b439a49d48ee3a57. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:18.333818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:18.344395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:18.434417 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-73bffd7d-e4a3-4b1c-bf16-4126a875e450 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.174334 Nov 02 13:25:18.442246 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1359/2982] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:25:14 2022] POST /compute/v2.1/servers => generated 382 bytes in 4183 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:25:18.455724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:18.456511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:18.470891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.476523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.478093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:18.481114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:18.482881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:18.491297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:19.483793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:19.533838 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a85b28d-b131-43c6-9653-2c614062b074 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 1.522614 Nov 02 13:25:19.542482 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1624/2983] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:18 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:19.550101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9157ca24-e06b-46d2-80c8-91d1b2c53ecf tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:19.557473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9157ca24-e06b-46d2-80c8-91d1b2c53ecf tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:19.948157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9157ca24-e06b-46d2-80c8-91d1b2c53ecf tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:19.975765 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9157ca24-e06b-46d2-80c8-91d1b2c53ecf tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1224 microversion: 2.1 time: 0.427341 Nov 02 13:25:19.993039 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1625/2984] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:19 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1224 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:20.000643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:20.001560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:20.015771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.016278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.016790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:20.017479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.017944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.018380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:20.831511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:20.847403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:20.849339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-99bc1dc3-b9dd-4be6-8ab0-7e769b4dd461 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1526 microversion: 2.1 time: 0.853462 Nov 02 13:25:20.870382 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1626/2985] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:19 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1526 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:20.870993 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-11ec7a62-e2fb-40bb-8b8f-e563b8266554 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 2.427405 Nov 02 13:25:20.872127 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1360/2986] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:18 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:20.882290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:20.883546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:20.890706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:20.891719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:20.892323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.894566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.895432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:20.896737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.898072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.899532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:20.918690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.921286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.924223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:20.931601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:20.933205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:20.936478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:21.049410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:25:21.439338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce854af9-2a02-48fa-a6fc-5aff14bc1a4d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 204 len: 0 microversion: 2.1 time: 0.558202 Nov 02 13:25:21.444331 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1361/2987] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:25:20 2022] DELETE /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:25:21.460561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:21.461302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:21.472904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:21.479823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:21.480370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:21.483502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:21.484083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:21.485333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:21.573377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:21.583689 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-43109184-6752-4043-b0ed-56800efa443d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.711662 Nov 02 13:25:21.595567 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1627/2988] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:20 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:21.600861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:21.613196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:21.640488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:21.641348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:21.642068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:21.642997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:21.643888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:21.644479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:22.058751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:22.072900 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6bfc433c-3e60-469a-a1d0-43d6bd45431b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1294 microversion: 2.1 time: 0.620312 Nov 02 13:25:22.074433 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1362/2989] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:21 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1294 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:22.087481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:22.091363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:22.106353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:22.107254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:22.108007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:22.109163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:22.109899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:22.111132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:23.387091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:23.623935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:23.647715 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c2e20417-efe0-4c21-936f-9b774031125a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1532 microversion: 2.1 time: 2.050612 Nov 02 13:25:23.648391 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1628/2990] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:21 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1532 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:23.675084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1694035494", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0f49ae81-cfe3-4633-a929-56b3685d4723"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:23.772144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] validate_networks() for [('0f49ae81-cfe3-4633-a929-56b3685d4723', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:24.036775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:24.046257 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-908e2591-4774-4259-b4cd-9fefe5887e5a tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 1.969471 Nov 02 13:25:24.061274 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1363/2991] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:22 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:24.072037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d9db5ef0-bfc8-47f1-8e4d-5a8b65a0ce4e req-cae7e730-29d9-48f1-ad0e-e711cbb8e6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c8c5ad-c591-4d99-8c79-4e3515b774a8", "name": "network-vif-unplugged", "status": "completed", "tag": "25421f7a-a58d-4954-9280-d650667346d2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:24.104909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d9db5ef0-bfc8-47f1-8e4d-5a8b65a0ce4e req-cae7e730-29d9-48f1-ad0e-e711cbb8e6cd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.105794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d9db5ef0-bfc8-47f1-8e4d-5a8b65a0ce4e req-cae7e730-29d9-48f1-ad0e-e711cbb8e6cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.106439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d9db5ef0-bfc8-47f1-8e4d-5a8b65a0ce4e req-cae7e730-29d9-48f1-ad0e-e711cbb8e6cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.138224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d9db5ef0-bfc8-47f1-8e4d-5a8b65a0ce4e req-cae7e730-29d9-48f1-ad0e-e711cbb8e6cd service nova] Creating event network-vif-unplugged:25421f7a-a58d-4954-9280-d650667346d2 for instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 on n-h1-858384-19 Nov 02 13:25:24.150036 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d9db5ef0-bfc8-47f1-8e4d-5a8b65a0ce4e req-cae7e730-29d9-48f1-ad0e-e711cbb8e6cd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087118 Nov 02 13:25:24.154043 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1364/2992] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:24.167827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:24.168917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:24.191592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.192670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.193627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.194663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.195323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.196095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.813267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:24.837887 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a2259ba8-2f0f-4cd0-8c76-63314155f3a2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1282 microversion: 2.1 time: 0.682223 Nov 02 13:25:24.841927 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1365/2993] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:24 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1282 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:24.850889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:24.852065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:24.860479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.861049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.861441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:24.862126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:24.862582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:24.863010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:25.431029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:25.432170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:25.432860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:25.433839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:25.434526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:25.445802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:25.446652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:25.447310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:25.448118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:25.448779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:25.449272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:25.469821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:25.476998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for user fa31baf6e9c94e8393baad059544adb5 and project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:25.497584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:25.500037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:25.568846 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-906ad18b-a157-4a8d-b61f-a0b3257a0e62 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.899190 Nov 02 13:25:25.571535 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1629/2994] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:25:23 2022] POST /compute/v2.1/servers => generated 382 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:25:25.584552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:25.587198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:25.603144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:25.603662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:25.604723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:25.606600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:25.607064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:25.607911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:25.920675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:25.937462 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5ff15591-9961-4dee-b7a9-21ea08072d5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1532 microversion: 2.1 time: 1.094159 Nov 02 13:25:25.938678 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1366/2995] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:24 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1532 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:25.946171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a4fb992e-d968-46ea-b218-cdccef9f6d20 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:25.951089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a4fb992e-d968-46ea-b218-cdccef9f6d20 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:26.086996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:26.100913 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31bfb895-5087-4f88-940d-534e0e0a57d2 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 0.526945 Nov 02 13:25:26.101796 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1630/2996] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:25 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:26.112703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:26.116028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:26.128335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:26.129050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:26.139850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:26.140622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:26.141282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:26.141881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:26.148008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:26.177288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a4fb992e-d968-46ea-b218-cdccef9f6d20 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:26.187405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=25 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:26.190128 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a4fb992e-d968-46ea-b218-cdccef9f6d20 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1219 microversion: 2.1 time: 0.249916 Nov 02 13:25:26.214596 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1367/2997] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:25 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1219 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:26.233327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-aea6f3fb-1ac9-4b07-b47d-2eb2d5d7ce45 req-0f155b90-32ab-43e7-ae2f-2575025ae194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1839e8d-7af9-46b2-a7f4-bc09f7585d3c", "tag": "58cad526-c321-4747-8c01-e8fdb18337d9"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:26.280703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-aea6f3fb-1ac9-4b07-b47d-2eb2d5d7ce45 req-0f155b90-32ab-43e7-ae2f-2575025ae194 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:26.281193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-aea6f3fb-1ac9-4b07-b47d-2eb2d5d7ce45 req-0f155b90-32ab-43e7-ae2f-2575025ae194 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:26.281628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-aea6f3fb-1ac9-4b07-b47d-2eb2d5d7ce45 req-0f155b90-32ab-43e7-ae2f-2575025ae194 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:26.299836 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-aea6f3fb-1ac9-4b07-b47d-2eb2d5d7ce45 req-0f155b90-32ab-43e7-ae2f-2575025ae194 service nova] Creating event network-changed:58cad526-c321-4747-8c01-e8fdb18337d9 for instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c on n-h2-858384-19 Nov 02 13:25:26.301622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:26.309060 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-aea6f3fb-1ac9-4b07-b47d-2eb2d5d7ce45 req-0f155b90-32ab-43e7-ae2f-2575025ae194 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090519 Nov 02 13:25:26.311249 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1368/2998] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:26.313332 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9dbf6b2f-4fd2-4d9e-9a8a-9dffadb846be tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1282 microversion: 2.1 time: 0.210171 Nov 02 13:25:26.316851 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1631/2999] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:26 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:26.966807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:26.968375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:26.995330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-bff2cc99-d3d3-44fc-8b87-faeba236c9cf req-a879fd7c-3044-4c09-b878-c8ca05be92d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad394d79-7e89-4e24-9d74-0e8c597f7679", "tag": "7b1abc42-2ca6-4734-87c3-beae5db4e4b6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:27.000193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.001005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.006051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.009201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.014061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.014711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.032421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bff2cc99-d3d3-44fc-8b87-faeba236c9cf req-a879fd7c-3044-4c09-b878-c8ca05be92d7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.041057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bff2cc99-d3d3-44fc-8b87-faeba236c9cf req-a879fd7c-3044-4c09-b878-c8ca05be92d7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.043034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bff2cc99-d3d3-44fc-8b87-faeba236c9cf req-a879fd7c-3044-4c09-b878-c8ca05be92d7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.080535 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-bff2cc99-d3d3-44fc-8b87-faeba236c9cf req-a879fd7c-3044-4c09-b878-c8ca05be92d7 service nova] Creating event network-changed:7b1abc42-2ca6-4734-87c3-beae5db4e4b6 for instance ad394d79-7e89-4e24-9d74-0e8c597f7679 on n-h2-858384-19 Nov 02 13:25:27.094750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-bff2cc99-d3d3-44fc-8b87-faeba236c9cf req-a879fd7c-3044-4c09-b878-c8ca05be92d7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107433 Nov 02 13:25:27.095735 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1632/3000] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:27.108743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.109940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.110388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.110899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lazy-loading 'fault' on Instance uuid 71c8c5ad-c591-4d99-8c79-4e3515b774a8 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:25:27.131989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:27.134120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:27.154839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:27.158252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.159411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.160009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.161237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.162756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.164154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.368796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:27.384416 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-02cf7011-e055-4dc5-8a02-a4322c653101 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 200 len: 1319 microversion: 2.1 time: 0.423894 Nov 02 13:25:27.385538 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1369/3001] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:26 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:27.392591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:27.404080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:27.410449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.411188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.411997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.412912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.413519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.414107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.622076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:27.627704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:27.630973 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8fdff242-8fb7-4cb4-981c-4da8d3195ed9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1271 microversion: 2.1 time: 0.244108 Nov 02 13:25:27.644265 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e3f8967d-54a5-4359-858d-828e6cf25e67 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 0.515073 Nov 02 13:25:27.644794 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1370/3002] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:27 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:27.650736 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1633/3003] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:27 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:27.654869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:27.655787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:27.663279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.664110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.664835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:27.665770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:27.666425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:27.667041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.056517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-deb513d8-2146-4638-8f34-e8447600f542 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Action: 'create', calling method: .version_select at 0x7fe786ad0b80>, body: {"keypair": {"name": "tempest-keypair-205426712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDQnIO2Bx9cnO6z2ftqbw2XPxi1XoyQGGVU5LwursOiKCMknzGds0FRyyHiaRyV0HMbrQ/0G8U4KyuzOZWvUXKLfBh65W4Z4ymZ9NpPtI2ql9TgGkGdk5/IuEaz/UlLLQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:28.095586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-deb513d8-2146-4638-8f34-e8447600f542 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Getting quotas for project 09d9c87a17af442bab426aaef8e4ce27. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:28.112107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-deb513d8-2146-4638-8f34-e8447600f542 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Getting quotas for user 5e151fa8ebc04ad286fc9ee20fc122f7 and project 09d9c87a17af442bab426aaef8e4ce27. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:28.181237 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-deb513d8-2146-4638-8f34-e8447600f542 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.531498 Nov 02 13:25:28.182020 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1634/3004] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:25:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:28.260825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:28.376153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5022bcd1-580f-42cb-9f18-c6f7ab7a71ba req-5c30155f-3efa-48da-b3b2-e5786c313d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c8c5ad-c591-4d99-8c79-4e3515b774a8", "name": "network-vif-deleted", "tag": "25421f7a-a58d-4954-9280-d650667346d2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:28.390340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5022bcd1-580f-42cb-9f18-c6f7ab7a71ba req-5c30155f-3efa-48da-b3b2-e5786c313d28 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.395722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5022bcd1-580f-42cb-9f18-c6f7ab7a71ba req-5c30155f-3efa-48da-b3b2-e5786c313d28 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.397204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5022bcd1-580f-42cb-9f18-c6f7ab7a71ba req-5c30155f-3efa-48da-b3b2-e5786c313d28 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.425149 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5022bcd1-580f-42cb-9f18-c6f7ab7a71ba req-5c30155f-3efa-48da-b3b2-e5786c313d28 service nova] Creating event network-vif-deleted:25421f7a-a58d-4954-9280-d650667346d2 for instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 on n-h1-858384-19 Nov 02 13:25:28.445729 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5022bcd1-580f-42cb-9f18-c6f7ab7a71ba req-5c30155f-3efa-48da-b3b2-e5786c313d28 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078164 Nov 02 13:25:28.451326 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1635/3005] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:25:28.466332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:28.470033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:28.486811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.487546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.491750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.492638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.493214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.494153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.523701 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 HTTP/1.1 Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:25:28.528085 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:25:28.529449 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '71c8c5ad-c591-4d99-8c79-4e3515b774a8'} Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:25:28.530173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:25:28.531415 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:25:28.551560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:25:28.554635 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-823b01c0-6157-46fb-ba74-d037bc6a407c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 404 len: 111 microversion: 2.1 time: 0.101978 Nov 02 13:25:28.559736 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1636/3006] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:28 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:25:28.578492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8af8f8ae-014a-46f3-b830-370569ae62b3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'create', calling method: .version_select at 0x7fe786a780d0>, body: {"keypair": {"name": "tempest-keypair-460397315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBtz5NSUrgqybGpXT7a8gCDEYg5dz3X57hzlyyy10B8p6IZJnF4cpm0WicyHDA8jA57HB7BSF2rcjSJi93B9chG9fMaUtnTvwMSLsdqe294T3XbBLLtSMgOhYn3Bs/5bA=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:28.621410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8af8f8ae-014a-46f3-b830-370569ae62b3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Getting quotas for project e23d91dc30354049bb22462413ae5a15. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:28.628573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:28.637356 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f8eb32c6-7186-479b-94c6-1de4a50f133b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.991165 Nov 02 13:25:28.647029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8af8f8ae-014a-46f3-b830-370569ae62b3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Getting quotas for user 0935d05ae9274e9ba65f45b637e2ea66 and project e23d91dc30354049bb22462413ae5a15. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:28.648571 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1371/3007] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:27 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:28.657629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:28.658669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:28.671904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.672644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.673269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.674152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.674764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.675937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.711783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8af8f8ae-014a-46f3-b830-370569ae62b3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139235 Nov 02 13:25:28.716701 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1637/3008] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:25:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:25:28.718235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:28.721030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:28.721030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:28.734567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.736351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.736904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:28.741229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:28.741850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:28.748248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:29.419935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:29.429222 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47e4e494-8b85-4a4b-99e4-a4eee2fdab7d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 0.715389 Nov 02 13:25:29.429829 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1638/3009] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:28 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:29.679561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:29.680613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:29.687489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:29.688212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:29.688990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:29.690482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:29.694830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:29.695806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:29.764319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:29.786294 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0eeab7c-c22b-403c-b86f-8e4ce88ea0cc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1277 microversion: 2.1 time: 1.132365 Nov 02 13:25:29.795469 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1372/3010] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:28 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1277 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:30.196629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:30.230973 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-777d8c65-c264-4a7b-9365-6ca39eee149a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.557632 Nov 02 13:25:30.243879 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1639/3011] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:29 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:30.456147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:30.456527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:30.474731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.475801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.476430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.477594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.478091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.478731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.822755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:30.824199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:30.866116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.867026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.868391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:30.869381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:30.870372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:30.871035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:31.426742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:31.440771 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f2b270f-0c1a-468e-a823-8415558f3e71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 0.623012 Nov 02 13:25:31.444192 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1640/3012] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:30 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:31.449408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:31.457211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:31.475152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:31.475920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:31.476546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:31.477620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:31.479779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:31.480399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:31.568266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:31.595513 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-379c5766-6f30-4af1-a378-e690c60cae93 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 1.143558 Nov 02 13:25:31.598466 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1373/3013] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:30 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:31.866174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:31.884488 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-85539e72-1760-486a-a55c-a65f816d2b44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.438801 Nov 02 13:25:31.885079 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1641/3014] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:31 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:32.322273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-39bc69ff-a179-4643-9032-51c347c1bdc8 req-db1094d4-6415-47e5-a4d7-51ecab172d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7313a25-9bac-4ae5-a496-f446706ba248", "tag": "14f12c2c-f18e-4850-908d-91c3b3bfe40c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:32.354343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-39bc69ff-a179-4643-9032-51c347c1bdc8 req-db1094d4-6415-47e5-a4d7-51ecab172d58 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.357257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-39bc69ff-a179-4643-9032-51c347c1bdc8 req-db1094d4-6415-47e5-a4d7-51ecab172d58 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.359598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-39bc69ff-a179-4643-9032-51c347c1bdc8 req-db1094d4-6415-47e5-a4d7-51ecab172d58 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:32.386209 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-39bc69ff-a179-4643-9032-51c347c1bdc8 req-db1094d4-6415-47e5-a4d7-51ecab172d58 service nova] Creating event network-changed:14f12c2c-f18e-4850-908d-91c3b3bfe40c for instance f7313a25-9bac-4ae5-a496-f446706ba248 on n-h1-858384-19 Nov 02 13:25:32.401972 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-39bc69ff-a179-4643-9032-51c347c1bdc8 req-db1094d4-6415-47e5-a4d7-51ecab172d58 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085873 Nov 02 13:25:32.404719 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1374/3015] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:32.470040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:32.470662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:32.485303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.485809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.486256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:32.487022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.492069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.492529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:32.634318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:32.644643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:32.666830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.667507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.668227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:32.669053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:32.669614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:32.670782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:33.361789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:33.375659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29a4cfb1-7e37-4896-9855-8092f7ed5a7d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 0.907445 Nov 02 13:25:33.376927 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1642/3016] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:32 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:33.386870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:33.387885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:33.401744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:33.403074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:33.405271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:33.407634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:33.408340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:33.408990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:34.071504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:34.087894 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4f8cf113-b956-43ca-bb29-2cc08e504635 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 1.465443 Nov 02 13:25:34.088873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1375/3017] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:32 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:34.405132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:34.405861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:34.409676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:34.422078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:34.424722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:34.425026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:34.425781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:34.426251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:34.426680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:34.522171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:34.558889 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71e8b173-e727-4107-b0f9-65f39e58bab2 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 1.176899 Nov 02 13:25:34.560162 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1643/3018] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:33 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:34.590123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e38d7e26-9ac6-4bd8-8da2-413a0e425a75 req-d84fd34d-aef9-4dba-9edb-2752f8afc8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6391e9d-ce41-430a-bda7-69cb0a6273d9", "tag": "e7911ead-a098-4b45-b540-132a702cf5f9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:34.618422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e38d7e26-9ac6-4bd8-8da2-413a0e425a75 req-d84fd34d-aef9-4dba-9edb-2752f8afc8e9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:34.619877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e38d7e26-9ac6-4bd8-8da2-413a0e425a75 req-d84fd34d-aef9-4dba-9edb-2752f8afc8e9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:34.620561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e38d7e26-9ac6-4bd8-8da2-413a0e425a75 req-d84fd34d-aef9-4dba-9edb-2752f8afc8e9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:34.652479 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e38d7e26-9ac6-4bd8-8da2-413a0e425a75 req-d84fd34d-aef9-4dba-9edb-2752f8afc8e9 service nova] Creating event network-changed:e7911ead-a098-4b45-b540-132a702cf5f9 for instance c6391e9d-ce41-430a-bda7-69cb0a6273d9 on n-h1-858384-19 Nov 02 13:25:34.661109 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e38d7e26-9ac6-4bd8-8da2-413a0e425a75 req-d84fd34d-aef9-4dba-9edb-2752f8afc8e9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099468 Nov 02 13:25:34.663358 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1644/3019] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:34.669778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1513971778", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:34.744912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] validate_networks() for [('1d4f643a-cb15-4b23-b27a-06cbc62da1dd', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:35.382837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:35.405869 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c14e2be6-68a2-41b1-a253-06a0454f189a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 1.005423 Nov 02 13:25:35.406972 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1376/3020] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:34 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:35.425902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:35.426578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:35.443281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:35.452971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:35.453875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:35.455202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:35.456443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:35.456934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:35.461154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:35.797464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:35.798539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:35.799196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:35.799758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:35.800366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:35.815664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:35.820188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:35.820895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:35.821863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:35.828524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:35.829152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:35.872772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Getting quotas for project e23d91dc30354049bb22462413ae5a15. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:35.884437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Getting quotas for user 0935d05ae9274e9ba65f45b637e2ea66 and project e23d91dc30354049bb22462413ae5a15. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:35.915790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:35.921467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:36.053453 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-870e22a1-a9b0-445f-a381-8c7b43c7dff6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.385462 Nov 02 13:25:36.054387 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1645/3021] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:25:34 2022] POST /compute/v2.1/servers => generated 385 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:25:36.070446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:36.071493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:36.076900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:36.085921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.087186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.089249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.090195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.092662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.093284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.104889 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ab2176ac-a68f-46f8-aaba-274bc73ea117 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 0.691437 Nov 02 13:25:36.108861 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1377/3022] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:35 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:36.129493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1bcc8430-3f2d-4274-a2d6-1770e87ac423 req-5cfdf711-955f-4e6b-abb0-65703bfe717a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9788658-3399-4fa6-b84d-f611bcf47d64", "tag": "f11ebcd1-70a5-407a-b4f5-0fd48037f949"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:36.151754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1bcc8430-3f2d-4274-a2d6-1770e87ac423 req-5cfdf711-955f-4e6b-abb0-65703bfe717a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.162544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1bcc8430-3f2d-4274-a2d6-1770e87ac423 req-5cfdf711-955f-4e6b-abb0-65703bfe717a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.163001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1bcc8430-3f2d-4274-a2d6-1770e87ac423 req-5cfdf711-955f-4e6b-abb0-65703bfe717a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.181186 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1bcc8430-3f2d-4274-a2d6-1770e87ac423 req-5cfdf711-955f-4e6b-abb0-65703bfe717a service nova] Creating event network-changed:f11ebcd1-70a5-407a-b4f5-0fd48037f949 for instance f9788658-3399-4fa6-b84d-f611bcf47d64 on n-h2-858384-19 Nov 02 13:25:36.193549 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1bcc8430-3f2d-4274-a2d6-1770e87ac423 req-5cfdf711-955f-4e6b-abb0-65703bfe717a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082008 Nov 02 13:25:36.194540 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1378/3023] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:36.205581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9c9be006-b744-4e37-8af8-7b1aa84a2832 req-12e0262f-d926-4d29-9c72-fdacf8c1b7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad394d79-7e89-4e24-9d74-0e8c597f7679", "name": "network-vif-plugged", "status": "completed", "tag": "7b1abc42-2ca6-4734-87c3-beae5db4e4b6"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:36.227782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9c9be006-b744-4e37-8af8-7b1aa84a2832 req-12e0262f-d926-4d29-9c72-fdacf8c1b7d0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.228267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9c9be006-b744-4e37-8af8-7b1aa84a2832 req-12e0262f-d926-4d29-9c72-fdacf8c1b7d0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.228707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9c9be006-b744-4e37-8af8-7b1aa84a2832 req-12e0262f-d926-4d29-9c72-fdacf8c1b7d0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.267488 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9c9be006-b744-4e37-8af8-7b1aa84a2832 req-12e0262f-d926-4d29-9c72-fdacf8c1b7d0 service nova] Creating event network-vif-plugged:7b1abc42-2ca6-4734-87c3-beae5db4e4b6 for instance ad394d79-7e89-4e24-9d74-0e8c597f7679 on n-h2-858384-19 Nov 02 13:25:36.287293 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9c9be006-b744-4e37-8af8-7b1aa84a2832 req-12e0262f-d926-4d29-9c72-fdacf8c1b7d0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090734 Nov 02 13:25:36.288993 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1379/3024] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:36.297998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1076102417", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "8d1f5df2-f82c-47a1-9ba6-7643b938dfa7"}], "security_groups": [{"name": "tempest-securitygroup--1819411616"}], "key_name": "tempest-keypair-205426712", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:36.321219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:36.493179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:36.508325 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7800308f-d02f-4d8c-bcb8-b99afe414092 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.447760 Nov 02 13:25:36.509900 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1646/3025] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:36 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:36.523022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-335c6da8-39b5-4739-a61a-1d0f703ccbc4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:36.524024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-335c6da8-39b5-4739-a61a-1d0f703ccbc4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:36.684238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-335c6da8-39b5-4739-a61a-1d0f703ccbc4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:36.697232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-335c6da8-39b5-4739-a61a-1d0f703ccbc4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1229 microversion: 2.1 time: 0.185691 Nov 02 13:25:36.697832 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1647/3026] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:36 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1229 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:36.926521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:36.928538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:36.954133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.954639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.955085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:36.955841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:36.956304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:36.956745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:37.265073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] validate_networks() for [('8d1f5df2-f82c-47a1-9ba6-7643b938dfa7', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:37.448650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:37.456367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a42c99ae-d957-48aa-b8b4-7a31d070c597 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 0.754204 Nov 02 13:25:37.471734 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1648/3027] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:36 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:37.478390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:37.479376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:37.486666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:37.487180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:37.487801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:37.488725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:37.489338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:37.490001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:37.643695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:37.652634 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-54d3a5af-6d23-4e63-860b-eb40f6a5b1ee tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 0.179569 Nov 02 13:25:37.653235 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1649/3028] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:37 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:37.674919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:37.675608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:37.682225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:37.682913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:37.683574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:37.684775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:37.685424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:37.686018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:37.921518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:37.931076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e2cfad6-7c77-4201-ab3e-9cfd5d273e2c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.260180 Nov 02 13:25:37.935318 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1650/3029] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:37 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:37.940242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:37.941052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:37.949696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:37.950389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:37.950866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:37.951605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:37.952059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:37.952510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:38.025341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:38.034987 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2a2d18e0-8209-451e-94c0-2539b1ce07df tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1233 microversion: 2.1 time: 0.098283 Nov 02 13:25:38.035499 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1651/3030] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:37 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:38.483775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:38.484398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:38.511937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:38.512437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:38.512881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:38.522327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:38.524125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:38.526336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:38.888819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:38.899376 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d06fde5-c02a-47ec-9eda-b4830fb01959 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 0.419622 Nov 02 13:25:38.903984 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1652/3031] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:38 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:38.917466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:38.918910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:38.937045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:38.938326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:38.940657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:38.941621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:38.943080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:38.945912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.312834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:39.313823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:39.314551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:39.315191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:39.315771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:39.340677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.341641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.342195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.343002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.343504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.343933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.378627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Getting quotas for project 09d9c87a17af442bab426aaef8e4ce27. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:39.387530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Getting quotas for user 5e151fa8ebc04ad286fc9ee20fc122f7 and project 09d9c87a17af442bab426aaef8e4ce27. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:39.405001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:39.408191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:39.429181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:39.445159 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-468e3c21-7598-4a89-ba92-0bcf70f8f99e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 0.537024 Nov 02 13:25:39.446725 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1653/3032] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:38 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:39.452108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:39.453724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:39.472898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.475446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.476416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.477987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.479277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.480549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.503196 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-450db631-b78c-4017-a79e-bd5d75b33d62 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.212787 Nov 02 13:25:39.507399 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1380/3033] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:25:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 3218 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:25:39.519483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:39.520375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:39.535158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.538990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.540200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.542251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:39.542747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:39.543214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:39.563099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:39.874017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:39.884021 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-823c99fa-fe45-4d13-bd75-3b57a376c961 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.435922 Nov 02 13:25:39.889441 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1654/3034] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:39 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:39.904663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a38c07d-8e78-4d87-8fa6-3ebdfc3e540c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:39.904663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0a38c07d-8e78-4d87-8fa6-3ebdfc3e540c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:40.002434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:40.013981 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a9bbd6b6-7404-486c-822b-eb2e8f776005 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1233 microversion: 2.1 time: 0.502775 Nov 02 13:25:40.016007 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1381/3035] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:39 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1233 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:40.027779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:40.028555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:40.035738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:40.036720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:40.037448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.038379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:40.039016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:40.040227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.056158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a38c07d-8e78-4d87-8fa6-3ebdfc3e540c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:40.064765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=31 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:40.090005 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0a38c07d-8e78-4d87-8fa6-3ebdfc3e540c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1245 microversion: 2.1 time: 0.199370 Nov 02 13:25:40.090839 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1655/3036] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:39 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1245 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:40.221972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a682323a-6a36-4b19-8fe1-42efee2073e6 req-ec051149-eee7-40f9-9030-be18091911c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1839e8d-7af9-46b2-a7f4-bc09f7585d3c", "name": "network-vif-plugged", "status": "completed", "tag": "58cad526-c321-4747-8c01-e8fdb18337d9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:40.247149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a682323a-6a36-4b19-8fe1-42efee2073e6 req-ec051149-eee7-40f9-9030-be18091911c4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:40.247738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a682323a-6a36-4b19-8fe1-42efee2073e6 req-ec051149-eee7-40f9-9030-be18091911c4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:40.248249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a682323a-6a36-4b19-8fe1-42efee2073e6 req-ec051149-eee7-40f9-9030-be18091911c4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.279750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a682323a-6a36-4b19-8fe1-42efee2073e6 req-ec051149-eee7-40f9-9030-be18091911c4 service nova] Creating event network-vif-plugged:58cad526-c321-4747-8c01-e8fdb18337d9 for instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c on n-h2-858384-19 Nov 02 13:25:40.286461 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a682323a-6a36-4b19-8fe1-42efee2073e6 req-ec051149-eee7-40f9-9030-be18091911c4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068518 Nov 02 13:25:40.290387 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1656/3037] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:25:40.473691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:40.475102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:40.484766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:40.489556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:40.490249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.491222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:40.491850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:40.492441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.821268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:40.831561 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dcdfe068-712d-44e2-bb03-06829f77588a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 0.814219 Nov 02 13:25:40.834330 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1382/3038] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:40 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:40.922739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:40.937189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:40.937826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:40.948952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:40.949469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:40.949949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.950674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:40.952634 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d48a855-639e-4e49-8150-f9bd1724bb73 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 0.482982 Nov 02 13:25:40.954695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:40.955266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:40.956086 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1657/3039] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:40 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:41.050239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:41.050965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:41.071373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.072002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.073753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.073753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.073753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.074003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.324008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:41.343509 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f7289c0-1782-4578-82bb-834431a6f62d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1281 microversion: 2.1 time: 0.304824 Nov 02 13:25:41.360936 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1658/3040] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:41 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1281 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:41.371106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:41.372620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:41.379015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.379552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.380032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.382468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.382949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.383437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.751304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:41.765930 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-244992bf-7bf3-447b-8ba1-ef1cadeb3e04 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.847437 Nov 02 13:25:41.779421 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1383/3041] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:40 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:41.866539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:41.867232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:41.885847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.888381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.889061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:41.889971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:41.890591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:41.891209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:42.145690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:42.169367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a7f19bd8-b8d5-4cf7-bb2e-4507c520e4d3 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1297 microversion: 2.1 time: 0.807130 Nov 02 13:25:42.174399 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1659/3042] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:41 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1297 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:42.195497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:42.196333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:42.213834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:42.214544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:42.215217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:42.216109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:42.218662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:42.219419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:42.845825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:42.872227 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2e31a9bd-2b96-4325-90fe-56ff2dd744fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 1.017953 Nov 02 13:25:42.874954 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1384/3043] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:41 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:42.892603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1a837daf-1402-4ff2-8bbd-c9c8be5e5c56 req-e8d9b400-0007-403b-b42c-0ff8f37ae6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7313a25-9bac-4ae5-a496-f446706ba248", "name": "network-vif-plugged", "status": "completed", "tag": "14f12c2c-f18e-4850-908d-91c3b3bfe40c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:42.924269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1a837daf-1402-4ff2-8bbd-c9c8be5e5c56 req-e8d9b400-0007-403b-b42c-0ff8f37ae6fe service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:42.925492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1a837daf-1402-4ff2-8bbd-c9c8be5e5c56 req-e8d9b400-0007-403b-b42c-0ff8f37ae6fe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:42.929035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1a837daf-1402-4ff2-8bbd-c9c8be5e5c56 req-e8d9b400-0007-403b-b42c-0ff8f37ae6fe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:42.945436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1a837daf-1402-4ff2-8bbd-c9c8be5e5c56 req-e8d9b400-0007-403b-b42c-0ff8f37ae6fe service nova] Creating event network-vif-plugged:14f12c2c-f18e-4850-908d-91c3b3bfe40c for instance f7313a25-9bac-4ae5-a496-f446706ba248 on n-h1-858384-19 Nov 02 13:25:42.952068 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1a837daf-1402-4ff2-8bbd-c9c8be5e5c56 req-e8d9b400-0007-403b-b42c-0ff8f37ae6fe service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072792 Nov 02 13:25:42.953262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1385/3044] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:42.960848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:42.961772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:42.969661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:42.970602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:42.971266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:42.972569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:42.974998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:42.975958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:43.477702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:43.490460 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b26779a1-e359-4938-b870-ac2cd5a72517 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1287 microversion: 2.1 time: 0.532214 Nov 02 13:25:43.491794 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1386/3045] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:42 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1287 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:43.499623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:43.506104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:43.522337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:43.524323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:43.526487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:43.527573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:43.529621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:43.530968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:43.749488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:43.766441 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-075a4049-77cb-465e-8be7-9adb66db0dcb tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1375 microversion: 2.1 time: 1.590745 Nov 02 13:25:43.774587 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1660/3046] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:42 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1375 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:43.789094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:43.790060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:43.826443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:43.831674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:43.834527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:43.837030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:43.839341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:43.841235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:44.110788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:44.124298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:44.125323 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d355450d-38e4-47bd-8760-4a836ea89236 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.630827 Nov 02 13:25:44.128559 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1387/3047] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:43 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:44.139743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:44.140380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:44.147850 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10dbf3cb-e3bf-4eab-a50a-5bfd7edfbc85 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1303 microversion: 2.1 time: 0.371422 Nov 02 13:25:44.148752 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1661/3048] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:43 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1303 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:44.158711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:44.159300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:44.159905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:44.161937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:44.162702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:44.164113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:44.522872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:44.523627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:44.541345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:44.542137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:44.542751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:44.543766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:44.544409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:44.545758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:45.010241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:45.027723 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b802806-189f-4296-b1ff-b2a98541627c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1287 microversion: 2.1 time: 0.509271 Nov 02 13:25:45.028818 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1662/3049] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:44 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1287 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:45.049511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:45.050148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:45.066772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:45.068185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:45.069026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:45.069920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:45.070544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:45.071161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:45.543947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:45.576161 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b94f493-f0e5-4e62-823d-9698e3e7af39 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 1.434825 Nov 02 13:25:45.577528 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1388/3050] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:44 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:45.584282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:45.585519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:45.595748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:45.596463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:45.597060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:45.597937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:45.599813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:45.600753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:45.753237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:45.781105 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e173c5b9-848e-4321-9289-29acc342df76 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1559 microversion: 2.1 time: 0.750932 Nov 02 13:25:45.789465 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1663/3051] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:45 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1559 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:45.833993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:45.835766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:45.850729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:45.860514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:45.868012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:45.872284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:45.874207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:45.879611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:45.888764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:45.889462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.354460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:46.368479 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74bd9ada-35de-4854-9b32-c395dadcf91c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.786957 Nov 02 13:25:46.369435 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1389/3052] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:45 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:46.379869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-59c08938-5002-413a-8f31-2aff424ce99d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:46.380383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-59c08938-5002-413a-8f31-2aff424ce99d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:46.399236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c08938-5002-413a-8f31-2aff424ce99d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.399823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c08938-5002-413a-8f31-2aff424ce99d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.400353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c08938-5002-413a-8f31-2aff424ce99d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.405531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c08938-5002-413a-8f31-2aff424ce99d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.406021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c08938-5002-413a-8f31-2aff424ce99d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.408390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59c08938-5002-413a-8f31-2aff424ce99d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.469210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:46.483713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c41806a-36db-492a-9dc6-99b05304adee tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.688273 Nov 02 13:25:46.495211 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1664/3053] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:45 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:46.509117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:46.515100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:46.529491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.530340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.531826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.532726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.533398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.533988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.635148 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-59c08938-5002-413a-8f31-2aff424ce99d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.263915 Nov 02 13:25:46.636060 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1390/3054] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:25:46 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-interface => generated 284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:46.641948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-98147bb2-88ae-4343-95b9-da53d4ba9530 req-e72434a2-3403-401f-a320-0dbc4e65e610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6391e9d-ce41-430a-bda7-69cb0a6273d9", "name": "network-vif-plugged", "status": "completed", "tag": "e7911ead-a098-4b45-b540-132a702cf5f9"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:46.676228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-98147bb2-88ae-4343-95b9-da53d4ba9530 req-e72434a2-3403-401f-a320-0dbc4e65e610 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.679471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-98147bb2-88ae-4343-95b9-da53d4ba9530 req-e72434a2-3403-401f-a320-0dbc4e65e610 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.680990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-98147bb2-88ae-4343-95b9-da53d4ba9530 req-e72434a2-3403-401f-a320-0dbc4e65e610 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.725984 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-98147bb2-88ae-4343-95b9-da53d4ba9530 req-e72434a2-3403-401f-a320-0dbc4e65e610 service nova] Creating event network-vif-plugged:e7911ead-a098-4b45-b540-132a702cf5f9 for instance c6391e9d-ce41-430a-bda7-69cb0a6273d9 on n-h1-858384-19 Nov 02 13:25:46.735741 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-98147bb2-88ae-4343-95b9-da53d4ba9530 req-e72434a2-3403-401f-a320-0dbc4e65e610 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097712 Nov 02 13:25:46.738607 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1391/3055] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:46.752766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:46.755247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:46.788700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.807407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.809011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:46.811904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:46.820635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:46.821273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:47.069247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:47.080796 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4c586708-d16e-4b78-9ab9-030ec1698aab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.583720 Nov 02 13:25:47.096225 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1665/3056] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:46 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:47.392714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:47.393686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:47.402810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:47.415001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:47.415789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:47.416702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:47.417320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:47.417910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:47.469785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:47.479007 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3809a584-4762-4c1e-90ed-64882865e989 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 0.737130 Nov 02 13:25:47.515299 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1392/3057] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:46 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:47.522080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:47.522973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:47.530068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:47.530762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:47.531398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:47.532272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:47.532886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:47.533470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:47.558042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:47.773714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:47.791440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-23699d5f-846c-45ea-9862-17494bfeee3d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.402739 Nov 02 13:25:47.792746 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1666/3058] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:47 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:48.109261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:48.110179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:48.117318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:48.118190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:48.118638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:48.119985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:48.120772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:48.121441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:48.208140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:48.220173 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7dcac20f-df51-4015-83fe-97e204026d1a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.703426 Nov 02 13:25:48.221143 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1393/3059] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:47 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:48.520146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:48.521439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:48.534268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:48.539078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:48.539679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:48.540461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:48.540940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:48.541444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:48.619543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:48.629418 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-03bcbf2f-4ecd-4c3a-b78c-db081374c9d1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.523935 Nov 02 13:25:48.631664 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1667/3060] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:48 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:48.810395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-882c9e21-5265-4a39-bf1d-c220e1638c92 req-52b34b7f-5622-4d65-b318-1d3d194ba654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9788658-3399-4fa6-b84d-f611bcf47d64", "name": "network-vif-plugged", "status": "completed", "tag": "f11ebcd1-70a5-407a-b4f5-0fd48037f949"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:48.829703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-882c9e21-5265-4a39-bf1d-c220e1638c92 req-52b34b7f-5622-4d65-b318-1d3d194ba654 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:48.834509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-882c9e21-5265-4a39-bf1d-c220e1638c92 req-52b34b7f-5622-4d65-b318-1d3d194ba654 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:48.834818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-882c9e21-5265-4a39-bf1d-c220e1638c92 req-52b34b7f-5622-4d65-b318-1d3d194ba654 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:48.859854 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-882c9e21-5265-4a39-bf1d-c220e1638c92 req-52b34b7f-5622-4d65-b318-1d3d194ba654 service nova] Creating event network-vif-plugged:f11ebcd1-70a5-407a-b4f5-0fd48037f949 for instance f9788658-3399-4fa6-b84d-f611bcf47d64 on n-h2-858384-19 Nov 02 13:25:48.876020 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-882c9e21-5265-4a39-bf1d-c220e1638c92 req-52b34b7f-5622-4d65-b318-1d3d194ba654 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070778 Nov 02 13:25:48.883537 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1668/3061] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:25:48.889101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:48.889815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:48.907249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:48.907748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:48.908199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:48.908927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:48.909386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:48.909822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:49.363406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:49.366761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:49.374249 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c7e198a7-747c-4506-8401-cc9c3bb4a2df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1324 microversion: 2.1 time: 0.489323 Nov 02 13:25:49.375537 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1669/3062] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:48 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1324 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:49.382426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:49.383909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:49.391372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:49.392155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:49.392919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:49.393862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:49.395170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:49.396421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:49.398882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:49.638149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:49.649726 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-15b5cfb4-2240-4c2e-af92-b1d1910a87bf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 1.132937 Nov 02 13:25:49.650261 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1394/3063] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:48 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:49.660167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3229c662-e34d-48f7-918b-626e615f2ac2 req-0d36b23b-9e77-47c9-bd29-48969bdad483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05", "tag": "fe56ff1e-7166-4c49-b12f-1ded03e755d5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:49.671878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3229c662-e34d-48f7-918b-626e615f2ac2 req-0d36b23b-9e77-47c9-bd29-48969bdad483 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:49.672709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3229c662-e34d-48f7-918b-626e615f2ac2 req-0d36b23b-9e77-47c9-bd29-48969bdad483 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:49.673349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3229c662-e34d-48f7-918b-626e615f2ac2 req-0d36b23b-9e77-47c9-bd29-48969bdad483 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:49.695070 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3229c662-e34d-48f7-918b-626e615f2ac2 req-0d36b23b-9e77-47c9-bd29-48969bdad483 service nova] Creating event network-changed:fe56ff1e-7166-4c49-b12f-1ded03e755d5 for instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 on n-h1-858384-19 Nov 02 13:25:49.701383 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3229c662-e34d-48f7-918b-626e615f2ac2 req-0d36b23b-9e77-47c9-bd29-48969bdad483 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047398 Nov 02 13:25:49.702718 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1395/3064] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:49.709644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:49.710975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:49.721427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:49.722264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:49.724114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:49.725185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:49.725870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:49.726511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:49.771610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:49.786873 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89eabb4c-7f60-4902-8000-14d3482078c4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.409464 Nov 02 13:25:49.788088 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1670/3065] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:49 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:49.838980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6f609585-c33a-4bfd-a091-1253ceb8058a req-8cf107d4-8077-4359-bf44-f76d5d8062e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619ae303-88ce-4e79-a7da-111b4bd31c15", "tag": "ed6286e8-0dcb-4508-8927-6b34145c1be8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:49.850774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6f609585-c33a-4bfd-a091-1253ceb8058a req-8cf107d4-8077-4359-bf44-f76d5d8062e5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:49.851514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6f609585-c33a-4bfd-a091-1253ceb8058a req-8cf107d4-8077-4359-bf44-f76d5d8062e5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:49.852333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6f609585-c33a-4bfd-a091-1253ceb8058a req-8cf107d4-8077-4359-bf44-f76d5d8062e5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:49.866459 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6f609585-c33a-4bfd-a091-1253ceb8058a req-8cf107d4-8077-4359-bf44-f76d5d8062e5 service nova] Creating event network-changed:ed6286e8-0dcb-4508-8927-6b34145c1be8 for instance 619ae303-88ce-4e79-a7da-111b4bd31c15 on n-h1-858384-19 Nov 02 13:25:49.873717 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6f609585-c33a-4bfd-a091-1253ceb8058a req-8cf107d4-8077-4359-bf44-f76d5d8062e5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038354 Nov 02 13:25:49.876457 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1671/3066] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:50.408628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:50.409337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:50.412627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:50.424135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:50.425005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:50.425665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:50.426586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:50.427353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:50.428891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:50.625651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:50.648011 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b24f2a69-17ac-4c2e-ba24-9a9f43383511 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.943620 Nov 02 13:25:50.648763 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1396/3067] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:49 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:50.850226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:50.859955 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1927930b-b92f-4c9a-ae59-20168dfb89d4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1514 microversion: 2.1 time: 0.455606 Nov 02 13:25:50.860455 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1672/3068] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:50 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1514 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:50.891354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:50.892580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:50.915314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:50.917203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:50.917879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:50.918973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:50.919848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:50.920509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:50.964446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2038676271", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "37c549b8-fcca-4ed8-94a6-1e15dc2811d6"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:51.093530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] validate_networks() for [('37c549b8-fcca-4ed8-94a6-1e15dc2811d6', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:25:51.507772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:51.513673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:51.529480 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fbd8c974-5f6e-4c34-91e2-78c10fab13ff tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1319 microversion: 2.1 time: 0.642387 Nov 02 13:25:51.531849 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1673/3069] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:50 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1319 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:51.549583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:51.553319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:51.576563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:51.578561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:51.580534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:51.581637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:51.582264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:51.583004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:51.819217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:51.834660 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74dbc4e9-b43c-4d6b-85e0-18c1e64e1d5d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.301341 Nov 02 13:25:51.835303 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1674/3070] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:51 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:51.840004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:51.840614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:51.853184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:51.858979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:51.859570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:51.860341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:51.860808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:51.861236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:52.141085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:52.153847 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6dcace01-9101-4c2b-8d31-8880240822ee tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1514 microversion: 2.1 time: 0.315748 Nov 02 13:25:52.154467 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1675/3071] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:51 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1514 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:52.159502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:52.160117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:52.187078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:52.190644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:52.191297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:52.192105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:52.192642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:52.197199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:52.474929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:52.484368 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3bab3bee-9f27-4ac2-8863-ab00c5274ddf tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.328835 Nov 02 13:25:52.487669 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1676/3072] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:52 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:52.507730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:52.512583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:52.525329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:52.525910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:52.526614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:52.527436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:52.529906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:52.530420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:52.805965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:25:52.807168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:25:52.808848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:25:52.809510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:25:52.810212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:25:52.874875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:52.875845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:52.877593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:52.878811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:52.880862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:52.887641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:52.920204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:25:52.937180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for user 4228809f65b74c90b1d34cecc1b4d30e and project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:25:52.963474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:25:52.967086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:25:53.077660 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-198ec68f-cf71-4adc-adae-0805f1a7e65c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.427710 Nov 02 13:25:53.078341 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1397/3073] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:25:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:25:53.092129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3c25ca9a-d905-48a5-b5d1-723b310b3ffc req-ab5c2e40-d779-401f-84da-b41585237487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1839e8d-7af9-46b2-a7f4-bc09f7585d3c", "tag": "58cad526-c321-4747-8c01-e8fdb18337d9"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:53.152956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3c25ca9a-d905-48a5-b5d1-723b310b3ffc req-ab5c2e40-d779-401f-84da-b41585237487 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:53.155550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3c25ca9a-d905-48a5-b5d1-723b310b3ffc req-ab5c2e40-d779-401f-84da-b41585237487 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:53.159874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3c25ca9a-d905-48a5-b5d1-723b310b3ffc req-ab5c2e40-d779-401f-84da-b41585237487 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:53.228616 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3c25ca9a-d905-48a5-b5d1-723b310b3ffc req-ab5c2e40-d779-401f-84da-b41585237487 service nova] Creating event network-changed:58cad526-c321-4747-8c01-e8fdb18337d9 for instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c on n-h2-858384-19 Nov 02 13:25:53.236194 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3c25ca9a-d905-48a5-b5d1-723b310b3ffc req-ab5c2e40-d779-401f-84da-b41585237487 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147736 Nov 02 13:25:53.237024 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1398/3074] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:53.244008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:53.245446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:53.273161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:53.275262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:53.276329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:53.279770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:53.280581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:53.281256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:53.806183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:53.818370 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4d643af3-c9c5-4134-9850-256469dafa16 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 200 len: 1514 microversion: 2.1 time: 1.326890 Nov 02 13:25:53.820176 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1677/3075] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:52 2022] GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 1514 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:53.827468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:53.832255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:53.848268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:53.850079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:53.850743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:53.852686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:53.853381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:53.855711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:54.136298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:54.148334 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9999875d-5812-4985-a200-bc967d52d2c6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1507 microversion: 2.1 time: 0.909929 Nov 02 13:25:54.155339 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1399/3076] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:53 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1507 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:54.170177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:54.171346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:54.186833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:54.187786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:54.188453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:54.189414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:54.190131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:54.190786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:54.330507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:54.341818 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4501c4d4-b00f-4c56-a7f3-0459ef03fbfc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1223 microversion: 2.1 time: 0.184697 Nov 02 13:25:54.342669 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1400/3077] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:54 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1223 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:54.360386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:54.361004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:54.376747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:54.377484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:54.378114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:54.379015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:54.379726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:54.380315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:54.653616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:54.670720 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a9a6f20-0845-4f26-93f9-145f133a1638 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.326918 Nov 02 13:25:54.671341 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1401/3078] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:54 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:54.674154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:54.681112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:54.687093 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-30d563d6-521a-406d-881f-833b8e61426b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.865559 Nov 02 13:25:54.690982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1678/3079] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:53 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:54.693917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:54.700786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bc4b470a-b3f1-42c5-84fe-2fe8a3b94424 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:54.702051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:54.718324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc4b470a-b3f1-42c5-84fe-2fe8a3b94424 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:54.720143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc4b470a-b3f1-42c5-84fe-2fe8a3b94424 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:54.722152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc4b470a-b3f1-42c5-84fe-2fe8a3b94424 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:54.736672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:54.737499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:54.745650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:54.756683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:54.757382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:54.758014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:54.971426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:25:55.116902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:55.130673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:55.143332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:55.149142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:55.284017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bc4b470a-b3f1-42c5-84fe-2fe8a3b94424 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Going to try to stop instance {{(pid=120928) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:25:55.379272 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bc4b470a-b3f1-42c5-84fe-2fe8a3b94424 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64/action" status: 202 len: 0 microversion: 2.1 time: 0.684181 Nov 02 13:25:55.383794 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1679/3080] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:25:54 2022] POST /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:25:55.392476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:55.393605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:55.404496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:55.405001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:55.405452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:55.411743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:55.412771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:55.413429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:55.526000 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-885d4c78-5d53-4044-a536-013565a44800 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1517 microversion: 2.1 time: 0.853235 Nov 02 13:25:55.527007 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1402/3081] 10.222.0.113 () {58 vars in 1172 bytes} [Wed Nov 2 13:25:54 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1517 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:55.560027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:55.563987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:55.588185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:55.589819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:55.597899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:55.599862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:55.602333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:55.603029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:55.604276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:55.607202 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e43f68a1-ebcd-4ebe-956d-ae84b1440c9d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1271 microversion: 2.1 time: 0.221961 Nov 02 13:25:55.607824 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1680/3082] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:55 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:55.625377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:55.633701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:55.646028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-498669815', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:55.678242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:55.678989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:55.681075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:55.683441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:55.686163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:55.686860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:55.922235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:25:56.017492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:56.025155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.025760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.026291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.152128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:56.160222 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d375fbe6-886e-4d6e-85c2-4ca4b18484a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.624364 Nov 02 13:25:56.183959 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1403/3083] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:55 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:56.190101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:56.196054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:56.206730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.207423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.208765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.209666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.210296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.210876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.226600 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2bd30dc3-afc5-41b3-8f0c-14388a0a5573 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-498669815" status: 200 len: 1517 microversion: 2.1 time: 0.617639 Nov 02 13:25:56.239138 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1681/3084] 10.222.0.113 () {58 vars in 1266 bytes} [Wed Nov 2 13:25:55 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-498669815 => generated 1517 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:56.239138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:56.239138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:56.249323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.250056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.250570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.251405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.251944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.252450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.434795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:56.444964 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88d59bfb-5d7d-4e3c-8495-c8d3aaf33779 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.215942 Nov 02 13:25:56.445633 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1682/3085] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:56 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:56.467990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:56.480481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:56.483057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:56.493493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.496070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.496915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.497968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.498879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.499808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.594433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:56.608268 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f1d1787e-dbab-47a8-b4be-0c459225634b tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.422923 Nov 02 13:25:56.608880 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1404/3086] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:56 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:56.632764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:56.633797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:56.638715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:25:56.641805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.643168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.643168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.644215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.645013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.645860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.755374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:56.765803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:56.766286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:56.767059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:56.838715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:56.860189 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de210092-3a17-4128-8e3d-9f71984dedbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1277 microversion: 2.1 time: 0.231595 Nov 02 13:25:56.862717 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1405/3087] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:56 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:57.072591 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae5279e4-2bb5-4dfe-9edd-0362ed91080e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4525 microversion: 2.1 time: 0.625979 Nov 02 13:25:57.087515 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1683/3088] 10.222.0.113 () {58 vars in 1178 bytes} [Wed Nov 2 13:25:56 2022] GET /compute/v2.1/servers/detail?status=active => generated 4525 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:57.106415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:57.112010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:57.112774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.compute.servers [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Removing options 'limit' from query {{(pid=120929) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 13:25:57.114315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:57.120693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.121577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.122944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.123978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.124634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.125256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.171516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:57.182299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.182799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.183295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.191766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:57.192441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:57.199031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.202888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.206569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.207660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.209828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.211153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.512983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:57.529718 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dbf8d94b-eb6e-4859-97ef-47c6c37f71ae tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.342168 Nov 02 13:25:57.533943 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1684/3089] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:57 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:25:57.540056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:57.542194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:57.549061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.549556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.549998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.550713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.551229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.552723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.709641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:57.716677 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75697ef7-5085-40d9-9a5d-70ff74017f13 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.181378 Nov 02 13:25:57.730529 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1685/3090] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:57 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:57.734715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:57.735560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:57.743629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.744117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.744822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.745700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.746152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.746617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.914178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:57.923556 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4841e6d2-3d89-4b19-8c0d-6f9e2597d02d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.193167 Nov 02 13:25:57.924632 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1686/3091] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:57 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:57.932013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:57.932969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:57.940151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.940897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.941426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:57.942809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:57.942997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:57.943854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:58.024433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:58.037344 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19e90572-c696-4652-8040-019aa298b2de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1277 microversion: 2.1 time: 0.109147 Nov 02 13:25:58.041435 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1687/3092] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:57 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:58.265877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-431e0dd2-60fa-45c5-8943-3c8a5778c0b7 req-c4354cc3-5f2c-41e4-9aa4-73091d0ec344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05", "name": "network-vif-plugged", "status": "completed", "tag": "fe56ff1e-7166-4c49-b12f-1ded03e755d5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:25:58.279663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-431e0dd2-60fa-45c5-8943-3c8a5778c0b7 req-c4354cc3-5f2c-41e4-9aa4-73091d0ec344 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:58.280420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-431e0dd2-60fa-45c5-8943-3c8a5778c0b7 req-c4354cc3-5f2c-41e4-9aa4-73091d0ec344 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:58.281050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-431e0dd2-60fa-45c5-8943-3c8a5778c0b7 req-c4354cc3-5f2c-41e4-9aa4-73091d0ec344 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:58.298247 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0388f11b-d7ba-4ca1-93b2-ddcfea7b1a2f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1664 microversion: 2.1 time: 1.196714 Nov 02 13:25:58.299075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:58.304111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-431e0dd2-60fa-45c5-8943-3c8a5778c0b7 req-c4354cc3-5f2c-41e4-9aa4-73091d0ec344 service nova] Creating event network-vif-plugged:fe56ff1e-7166-4c49-b12f-1ded03e755d5 for instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 on n-h1-858384-19 Nov 02 13:25:58.304413 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1406/3093] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:25:57 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1664 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:58.315064 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-431e0dd2-60fa-45c5-8943-3c8a5778c0b7 req-c4354cc3-5f2c-41e4-9aa4-73091d0ec344 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052940 Nov 02 13:25:58.316420 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1688/3094] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:25:58.336087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:58.343546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:58.344288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:58.351166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:58.351574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:58.352011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:58.356036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:58.356523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:58.357166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:58.498178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:25:58.566177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:58.567814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:58.577019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:58.577508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:58.577946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:58.581818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:58.585179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:58.586009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:58.595451 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0953a628-2e47-4491-8c5c-2de646f3971b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?status=active" status: 200 len: 1016 microversion: 2.1 time: 0.265407 Nov 02 13:25:58.596379 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1407/3095] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:25:58 2022] GET /compute/v2.1/servers?status=active => generated 1016 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:58.641746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:58.655194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:58.655194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.compute.servers [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Removing options 'limit' from query {{(pid=120929) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 13:25:58.674301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:58.680838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:25:58.694084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:58.694571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:58.702816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:58.703864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:58.704616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:58.705064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:58.893522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:58.903861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-587f0f4d-3616-40b7-abd1-2774485dd00c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.344397 Nov 02 13:25:58.904784 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1689/3096] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:58 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:58.916370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:58.917074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:58.927167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:58.928136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:58.928916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:58.929898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:58.930508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:58.931205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.021408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:25:59.121392 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-028d8d2a-e5c0-4e0d-b18b-fc9095bf8e9c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1016 microversion: 2.1 time: 0.509768 Nov 02 13:25:59.131044 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1408/3097] 10.222.0.113 () {58 vars in 1155 bytes} [Wed Nov 2 13:25:58 2022] GET /compute/v2.1/servers?limit=100000 => generated 1016 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:59.139343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:59.139919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:59.146458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.146950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.147510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.148141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.148649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.149011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.177223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:59.192642 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-56b48cd2-7e84-4072-9140-684f617126b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.285784 Nov 02 13:25:59.193796 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1690/3098] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:58 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:59.199965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:59.200748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:59.213329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.213821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.214256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.214959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.215473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.215930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.405373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:59.416269 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2378c808-7d9b-4ad2-944f-969b533787ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1319 microversion: 2.1 time: 0.221239 Nov 02 13:25:59.440666 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1691/3099] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:59 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:59.446812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:59.452860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:59.454577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:59.475580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.483386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.484154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.485643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.486450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.491662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.550846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:25:59.586605 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31e8f0ff-32ec-4332-9215-b47e85f17f60 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 1016 microversion: 2.1 time: 0.144486 Nov 02 13:25:59.587988 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1692/3100] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:25:59 2022] GET /compute/v2.1/servers => generated 1016 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:59.604940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:59.614670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:59.616862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:59.627642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:59.636233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.638665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.639575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.640593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.640814 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3b86a97a-26e3-49da-b648-cc704d4e5d42 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.508350 Nov 02 13:25:59.641439 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1409/3101] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:59 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:25:59.642185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.642967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.743103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:25:59.826306 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9acf7994-ee36-4971-b19e-9cdb132af3c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 347 microversion: 2.1 time: 0.228890 Nov 02 13:25:59.827553 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1693/3102] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:25:59 2022] GET /compute/v2.1/servers?flavor=451 => generated 347 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:59.842694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:59.847931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:59.849201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.compute.servers [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Removing options 'limit' from query {{(pid=120929) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 13:25:59.850098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:59.855902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.857408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.858379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.860823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.861477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.862082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.911987 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-064c7c7e-9aaf-46b4-a07f-0915d563ae2d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?limit=1" status: 200 len: 487 microversion: 2.1 time: 0.073014 Nov 02 13:25:59.920860 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1410/3103] 10.222.0.113 () {58 vars in 1145 bytes} [Wed Nov 2 13:25:59 2022] GET /compute/v2.1/servers?limit=1 => generated 487 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:25:59.929263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:59.938044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:25:59.938700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:25:59.944529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:25:59.945243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-498669815', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:25:59.960390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.960881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.961326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.962067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.962523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.962959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.966456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.966955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.967469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:25:59.968108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:25:59.968643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:25:59.968969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.023300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:00.158188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:00.258377 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4aa70a0-d94b-4174-bd36-2f384f5fa8f4 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-498669815" status: 200 len: 347 microversion: 2.1 time: 0.336262 Nov 02 13:26:00.259509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1694/3104] 10.222.0.113 () {58 vars in 1245 bytes} [Wed Nov 2 13:25:59 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-498669815 => generated 347 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:00.266188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:00.266877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:00.275163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.275714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.276279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.276989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.277693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.278311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.479996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:00.488087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:00.490874 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1847a5e4-a986-4d77-8425-184a1a539be5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.556779 Nov 02 13:26:00.492397 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1411/3105] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:25:59 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:00.498759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7603c8f5-f684-4ed2-a146-8f30f3775460 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:00.502236 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d79f1e8-6154-4671-834b-5e40834211b4 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.240970 Nov 02 13:26:00.506052 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1695/3106] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:00 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:00.511936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:00.512823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:00.524779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.525276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.526304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.527176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.527662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.533983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.548911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7603c8f5-f684-4ed2-a146-8f30f3775460 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.550415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7603c8f5-f684-4ed2-a146-8f30f3775460 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.559298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7603c8f5-f684-4ed2-a146-8f30f3775460 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.662080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7603c8f5-f684-4ed2-a146-8f30f3775460 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Going to try to stop instance {{(pid=120929) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:26:00.715370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:00.729515 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-85492ccb-806e-4b6e-82e1-de6b928948d8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1319 microversion: 2.1 time: 0.221737 Nov 02 13:26:00.730442 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1696/3107] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:00 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:00.736026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:00.736769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:00.750248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.751482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.752608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.755133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.755814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.756675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.767244 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7603c8f5-f684-4ed2-a146-8f30f3775460 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "POST /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248/action" status: 202 len: 0 microversion: 2.1 time: 0.273172 Nov 02 13:26:00.773426 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1412/3108] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:00 2022] POST /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:26:00.787233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:00.787969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:00.800699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.803280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.805642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.806410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:00.806988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:00.807336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:00.951514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:00.965030 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-756feccd-6831-4264-8c4a-ec3a712b7ac3 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.232044 Nov 02 13:26:00.967232 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1697/3109] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:00 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:01.527838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:01.528883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:01.544255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:01.545273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:01.545945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:01.548027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:01.548704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:01.550748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:01.651960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:01.664490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f72122b-4a6d-4994-be61-babe9bba266b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.889287 Nov 02 13:26:01.684503 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1413/3110] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:00 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:01.690740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:01.692826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:01.707787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:01.708538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:01.709187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:01.710070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:01.710688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:01.711315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:01.938043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:01.954511 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93a8a311-b882-4524-a977-236de5d68563 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.433948 Nov 02 13:26:01.955139 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1698/3111] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:01 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:01.965417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:01.966050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:01.986540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:01.987371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:01.987986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:01.989460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:01.990438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:01.991023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.187572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:02.201827 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-09320687-8a6b-4ec0-85c1-a143fd9767df tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1371 microversion: 2.1 time: 0.515553 Nov 02 13:26:02.212969 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1414/3112] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:01 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1371 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:02.221905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:02.222864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:02.230890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.231692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.232252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.233055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.233741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.234346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.393800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:02.408176 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a3929061-266c-42c0-8798-48c7d3daf78b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1319 microversion: 2.1 time: 0.451899 Nov 02 13:26:02.408929 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1699/3113] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:01 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:02.423096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d86d6f17-529d-460f-8270-9140cc5e57fa req-f7430f30-5d94-4705-8676-a78836ca4b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de59311-9e6e-4ca3-9c85-58f04c65a5e1", "tag": "1b9adfb2-a559-4c17-9100-d60169f872d3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:02.436642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d86d6f17-529d-460f-8270-9140cc5e57fa req-f7430f30-5d94-4705-8676-a78836ca4b41 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.448091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d86d6f17-529d-460f-8270-9140cc5e57fa req-f7430f30-5d94-4705-8676-a78836ca4b41 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.448891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d86d6f17-529d-460f-8270-9140cc5e57fa req-f7430f30-5d94-4705-8676-a78836ca4b41 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.471402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d86d6f17-529d-460f-8270-9140cc5e57fa req-f7430f30-5d94-4705-8676-a78836ca4b41 service nova] Creating event network-changed:1b9adfb2-a559-4c17-9100-d60169f872d3 for instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 on n-h2-858384-19 Nov 02 13:26:02.480882 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d86d6f17-529d-460f-8270-9140cc5e57fa req-f7430f30-5d94-4705-8676-a78836ca4b41 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070338 Nov 02 13:26:02.481997 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1700/3114] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:02.634902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:02.642629 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b9413f44-e4eb-4fd5-9cf0-892c076c3b33 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.427151 Nov 02 13:26:02.646839 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1415/3115] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:02 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:02.665841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8f0cffb1-da16-48a9-a822-43233d384972 req-d5ee8a99-1fdd-4c1b-ac52-43a54f7c09f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619ae303-88ce-4e79-a7da-111b4bd31c15", "name": "network-vif-plugged", "status": "completed", "tag": "ed6286e8-0dcb-4508-8927-6b34145c1be8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:02.681752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8f0cffb1-da16-48a9-a822-43233d384972 req-d5ee8a99-1fdd-4c1b-ac52-43a54f7c09f0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.689052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8f0cffb1-da16-48a9-a822-43233d384972 req-d5ee8a99-1fdd-4c1b-ac52-43a54f7c09f0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.689798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8f0cffb1-da16-48a9-a822-43233d384972 req-d5ee8a99-1fdd-4c1b-ac52-43a54f7c09f0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.691480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:02.693179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:02.706829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.706829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.706829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.706829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.707196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.707196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.711460 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8f0cffb1-da16-48a9-a822-43233d384972 req-d5ee8a99-1fdd-4c1b-ac52-43a54f7c09f0 service nova] Creating event network-vif-plugged:ed6286e8-0dcb-4508-8927-6b34145c1be8 for instance 619ae303-88ce-4e79-a7da-111b4bd31c15 on n-h1-858384-19 Nov 02 13:26:02.728608 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8f0cffb1-da16-48a9-a822-43233d384972 req-d5ee8a99-1fdd-4c1b-ac52-43a54f7c09f0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068976 Nov 02 13:26:02.734655 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1701/3116] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:02.980422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:02.981039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:02.987540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.988033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.988655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:02.989667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:02.990127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:02.990727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.074372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:03.084388 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2abb5cb0-3fda-44df-bd03-fec5115423b0 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.396950 Nov 02 13:26:03.101019 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1416/3117] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:02 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:03.231939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:03.232942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:03.241244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.241742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.242185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.242901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.243571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.244278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.556280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:03.561795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:03.565203 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-728538fe-fc8a-4ae6-8800-992a8d3748d7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.590130 Nov 02 13:26:03.568489 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1702/3118] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:02 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:03.570980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:03.571917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:03.577129 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-96cb1a4b-e444-464f-ae85-0719eafb525a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1561 microversion: 2.1 time: 0.350102 Nov 02 13:26:03.578242 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1417/3119] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:03 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1561 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:03.578787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.579732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.580471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.581715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.582978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.583673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.602980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-acb7a0f1-f0bf-4359-8851-9315a89527a9 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:03.603643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-acb7a0f1-f0bf-4359-8851-9315a89527a9 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:03.609895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acb7a0f1-f0bf-4359-8851-9315a89527a9 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.610671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acb7a0f1-f0bf-4359-8851-9315a89527a9 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.611354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acb7a0f1-f0bf-4359-8851-9315a89527a9 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.612297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acb7a0f1-f0bf-4359-8851-9315a89527a9 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.613143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acb7a0f1-f0bf-4359-8851-9315a89527a9 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.614397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acb7a0f1-f0bf-4359-8851-9315a89527a9 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.739537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:03.741515 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-acb7a0f1-f0bf-4359-8851-9315a89527a9 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143327 Nov 02 13:26:03.743142 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1418/3120] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:26:03 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:03.748517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:03.749290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:03.756302 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c37b4d2-ff44-457d-9f19-88ddc1d9def7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1319 microversion: 2.1 time: 0.188987 Nov 02 13:26:03.766728 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1703/3121] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:03 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:03.774409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.775381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.776212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.777310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:03.778015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:03.778771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:03.954903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:03.966035 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c950271a-3933-4d09-be5b-3c628547c0a2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1329 microversion: 2.1 time: 0.221424 Nov 02 13:26:03.967410 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1419/3122] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:03 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1329 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:04.110367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:04.111046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:04.120437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:04.121349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:04.123078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:04.124424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:04.125340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:04.126199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:04.486783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:04.498968 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-27cd7d38-d1c9-4141-b399-bc762666c044 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.392681 Nov 02 13:26:04.507056 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1704/3123] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:04 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:04.592359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:04.592966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:04.606119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:04.609986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:04.610448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:04.614067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:04.617713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:04.618241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:04.783952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:04.784987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:04.799798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:04.805963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:04.806672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:04.807624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:04.808241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:04.808858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.010818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:05.026924 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1af20a67-735b-4a26-8c43-67b53dbfe0a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.437427 Nov 02 13:26:05.029029 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1420/3124] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:04 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:05.050695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:05.053701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:05.064494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.068318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.069180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.071035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.071596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.072286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.167534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:05.175439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:05.179776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-198a589a-c801-435e-bc25-c13123dfe341 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1319 microversion: 2.1 time: 0.401060 Nov 02 13:26:05.181018 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1705/3125] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:04 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:05.375899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:05.389220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-60a7c76b-3a55-4334-9b99-4766cd53afd4 req-6164161f-50bf-4e9a-9af3-710c618f67b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05", "tag": "fe56ff1e-7166-4c49-b12f-1ded03e755d5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:05.402944 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9e5c9b1-c175-40ef-9550-4319cea9dd93 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1525 microversion: 2.1 time: 0.369265 Nov 02 13:26:05.408193 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1421/3126] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:05 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1525 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:05.421103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-60a7c76b-3a55-4334-9b99-4766cd53afd4 req-6164161f-50bf-4e9a-9af3-710c618f67b8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.421596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-60a7c76b-3a55-4334-9b99-4766cd53afd4 req-6164161f-50bf-4e9a-9af3-710c618f67b8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.422045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-60a7c76b-3a55-4334-9b99-4766cd53afd4 req-6164161f-50bf-4e9a-9af3-710c618f67b8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.445358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:05.446584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:05.447996 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-60a7c76b-3a55-4334-9b99-4766cd53afd4 req-6164161f-50bf-4e9a-9af3-710c618f67b8 service nova] Creating event network-changed:fe56ff1e-7166-4c49-b12f-1ded03e755d5 for instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 on n-h1-858384-19 Nov 02 13:26:05.461603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.463619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.467741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.469127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.470502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.472932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.481312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-60a7c76b-3a55-4334-9b99-4766cd53afd4 req-6164161f-50bf-4e9a-9af3-710c618f67b8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096233 Nov 02 13:26:05.481946 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1706/3127] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:05.531978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:05.532680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:05.545519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.547052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.552934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.556522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.557182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.557788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.810249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:05.826058 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b03725ea-0d78-4e31-9be2-e7f7fdd4f840 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1525 microversion: 2.1 time: 0.382252 Nov 02 13:26:05.827302 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1422/3128] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:05 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1525 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:05.854215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a7322348-f2fb-4c85-ba4d-979e593319ba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1100771454"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:05.856973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a7322348-f2fb-4c85-ba4d-979e593319ba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:05.868712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7322348-f2fb-4c85-ba4d-979e593319ba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.869194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7322348-f2fb-4c85-ba4d-979e593319ba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.874321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7322348-f2fb-4c85-ba4d-979e593319ba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.875343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7322348-f2fb-4c85-ba4d-979e593319ba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:05.875972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7322348-f2fb-4c85-ba4d-979e593319ba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:05.876566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7322348-f2fb-4c85-ba4d-979e593319ba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:05.890015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:05.901060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ad250aab-89c5-4ef6-9ed7-1e2b5ad53dbe tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.373853 Nov 02 13:26:05.901675 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1707/3129] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:05 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:06.055549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:06.056466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:06.078168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:06.078752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:06.079426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:06.080343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:06.080956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:06.081556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:06.288975 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a7322348-f2fb-4c85-ba4d-979e593319ba tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15/action" status: 202 len: 0 microversion: 2.1 time: 0.434869 Nov 02 13:26:06.291393 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1423/3130] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:05 2022] POST /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:26:06.309546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:06.314526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:06.362605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:06.370814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:06.371714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:06.376075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:06.382678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:06.388676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:06.554554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:06.582291 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aa461ceb-5cc5-4149-9047-8ed311673a74 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.519909 Nov 02 13:26:06.587858 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1708/3131] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:06 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:06.601755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c9331493-f6ce-4bb1-9b0a-a2a0765aeec1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '.version_select at 0x7fe78f98e5e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:06.755019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:06.890112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:06.921859 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f23bc96e-9ed8-4366-964a-a9648928a5a7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1319 microversion: 2.1 time: 0.628917 Nov 02 13:26:06.926047 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1424/3132] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:06 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1319 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:06.934136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:06.935047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:06.965583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:06.967664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:06.970407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:06.972123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:06.974572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:06.975350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:07.015727 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c9331493-f6ce-4bb1-9b0a-a2a0765aeec1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/images/89204d3e-8d6b-4e89-aecf-4b0c231198f7" status: 204 len: 0 microversion: 2.1 time: 0.425666 Nov 02 13:26:07.016929 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1709/3133] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:06 2022] DELETE /compute/v2.1/images/89204d3e-8d6b-4e89-aecf-4b0c231198f7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:07.029443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af85cc2d-210c-41e5-a3ff-ed504cb4fbd5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '.version_select at 0x7fe78f926430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:07.099224 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-af85cc2d-210c-41e5-a3ff-ed504cb4fbd5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Image not found. Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af85cc2d-210c-41e5-a3ff-ed504cb4fbd5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/images/89204d3e-8d6b-4e89-aecf-4b0c231198f7 HTTP/1.1 Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:07.104548 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '89204d3e-8d6b-4e89-aecf-4b0c231198f7'} Nov 02 13:26:07.107552 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:26:07.109330 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 89204d3e-8d6b-4e89-aecf-4b0c231198f7 Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:26:07.111679 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 89204d3e-8d6b-4e89-aecf-4b0c231198f7 could not be found. Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:07.117282 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:07.120381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af85cc2d-210c-41e5-a3ff-ed504cb4fbd5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:07.127444 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af85cc2d-210c-41e5-a3ff-ed504cb4fbd5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/images/89204d3e-8d6b-4e89-aecf-4b0c231198f7" status: 404 len: 62 microversion: 2.1 time: 0.103786 Nov 02 13:26:07.136094 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1710/3134] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:26:07 2022] GET /compute/v2.1/images/89204d3e-8d6b-4e89-aecf-4b0c231198f7 => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:26:07.149198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:07.151570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:07.163590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:07.164760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:07.165756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:07.167531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:07.168574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:07.169565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:07.170091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:07.307532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:07.323408 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0fb1f3d9-950b-429a-972e-c97c4765f077 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.391070 Nov 02 13:26:07.340346 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1425/3135] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:06 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:07.467016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:07.479808 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d73334dc-513f-4f91-bf5d-d3381fa36bad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1537 microversion: 2.1 time: 0.341915 Nov 02 13:26:07.481179 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1711/3136] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:07 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1537 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:07.607195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:07.608427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:07.623020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:07.623536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:07.623974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:07.624687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:07.625138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:07.625560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:07.634051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:07.909999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:07.922939 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-867b08e6-1c5e-4136-b650-f548ba37c924 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.319230 Nov 02 13:26:07.940869 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1426/3137] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:07 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:07.949355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:07.950030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:07.961227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:07.962934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:07.964096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:07.964859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:07.965326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:07.965789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:08.349521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:08.351859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:08.368324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:08.370034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:08.371396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:08.374053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:08.376605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:08.377280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:08.607380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:08.618257 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb7ff06b-4182-4bc5-b636-d359caa2e467 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1319 microversion: 2.1 time: 0.673769 Nov 02 13:26:08.619417 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1712/3138] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:07 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1319 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:08.632680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:08.635330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:08.636418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:08.638518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:08.647573 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a5b8e3d-8746-4a30-bc33-7e82d495bba9 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.301770 Nov 02 13:26:08.649228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:08.663152 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1427/3139] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:08 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:08.664724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:08.665509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:08.666959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:08.667644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:08.670406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:08.956722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:08.958167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:08.967629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:08.967772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:08.974644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:08.975387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:08.976515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:08.979585 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9316da50-8c85-40cd-879c-b3d687899242 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1537 microversion: 2.1 time: 0.355846 Nov 02 13:26:08.982064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:08.982707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:09.007246 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1713/3140] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:08 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1537 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:09.271972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:09.291238 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f55de15b-4072-4e87-be31-66e79f9b3d33 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.335725 Nov 02 13:26:09.292208 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1428/3141] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:08 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:09.644552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:09.646018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:09.653506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:09.654417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:09.655085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:09.656188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:09.657024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:09.657691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:09.678158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:09.678792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:09.690909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:09.693867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:09.694508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:09.696239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:09.698235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:09.699669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:09.880752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:09.988790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:10.009983 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-50fa014c-525a-4f85-b498-7542a68672e7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.334735 Nov 02 13:26:10.011764 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1429/3142] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:09 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:10.021055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:10.022978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:10.026786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:10.036036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:10.036628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:10.037360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:10.039251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:10.039723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:10.040312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:10.078257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:10.088527 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ca827a0-646f-41f0-be7e-b5e004941480 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1319 microversion: 2.1 time: 0.447966 Nov 02 13:26:10.100200 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1714/3143] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:09 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:10.194519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ab714650-8d09-4df0-8386-d37572512552 req-a28fd508-6081-4020-a72d-6b312a1b2be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de59311-9e6e-4ca3-9c85-58f04c65a5e1", "name": "network-vif-plugged", "status": "completed", "tag": "1b9adfb2-a559-4c17-9100-d60169f872d3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:10.212309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ab714650-8d09-4df0-8386-d37572512552 req-a28fd508-6081-4020-a72d-6b312a1b2be8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:10.212782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ab714650-8d09-4df0-8386-d37572512552 req-a28fd508-6081-4020-a72d-6b312a1b2be8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:10.215773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ab714650-8d09-4df0-8386-d37572512552 req-a28fd508-6081-4020-a72d-6b312a1b2be8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:10.233220 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ab714650-8d09-4df0-8386-d37572512552 req-a28fd508-6081-4020-a72d-6b312a1b2be8 service nova] Creating event network-vif-plugged:1b9adfb2-a559-4c17-9100-d60169f872d3 for instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 on n-h2-858384-19 Nov 02 13:26:10.246097 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ab714650-8d09-4df0-8386-d37572512552 req-a28fd508-6081-4020-a72d-6b312a1b2be8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056045 Nov 02 13:26:10.247322 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1715/3144] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:10.319478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:10.320408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:10.339193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:10.339706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:10.340153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:10.345774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:10.346253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:10.347458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:10.499930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:10.514203 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e44fbc2b-bbb5-4566-a306-f916023144f8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1543 microversion: 2.1 time: 0.500236 Nov 02 13:26:10.516567 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1430/3145] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:10 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1543 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:10.662281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:10.672251 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0aac10f0-66d9-4526-ab84-15957a66e84a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.359451 Nov 02 13:26:10.674019 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1716/3146] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:10 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:11.037533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:11.043510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:11.060279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:11.062742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:11.063781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.064764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:11.065446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:11.069567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.121141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:11.121806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:11.138672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:11.139185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:11.139626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.140787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:11.141252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:11.141681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.355866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:11.367739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d415ca3a-0765-4304-a75d-83f06bc0d78c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.337620 Nov 02 13:26:11.368942 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1431/3147] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:11 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:11.470169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:11.484721 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eeeaf6ee-237a-4b63-8ec3-f156c03f954d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1319 microversion: 2.1 time: 0.365276 Nov 02 13:26:11.485655 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1717/3148] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:11 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:11.540987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:11.541674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:11.547856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:11.548349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:11.548794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.549658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:11.550124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:11.550553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.698042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:11.698931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:11.705493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:11.706151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:11.707492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.708769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:11.709445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:11.710121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:11.783875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:11.792809 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-78e85a86-5942-4b7a-935f-719bb199d4e1 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1543 microversion: 2.1 time: 0.258539 Nov 02 13:26:11.793960 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1432/3149] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:11 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1543 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:11.861166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:11.870436 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f8035ae-b2a2-4ec1-9920-2be7d880dfa6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.176525 Nov 02 13:26:11.871029 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1718/3150] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:11 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:12.392034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:12.393723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:12.406527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.407018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.407583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.408297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.408770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.409190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.510436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:12.511290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:12.525737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.528661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.529167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.530001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.531875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.532573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.711230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:12.722362 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ef44c35-1804-459e-9144-3560a5e74276 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.334036 Nov 02 13:26:12.723275 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1433/3151] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:12 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:12.728490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9437d046-9632-424f-8765-988a5047bf72 req-7cd5e73e-f8d2-43f2-8c2d-e0854268491b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619ae303-88ce-4e79-a7da-111b4bd31c15", "name": "network-vif-plugged", "status": "completed", "tag": "ed6286e8-0dcb-4508-8927-6b34145c1be8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:12.739061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9437d046-9632-424f-8765-988a5047bf72 req-7cd5e73e-f8d2-43f2-8c2d-e0854268491b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.739910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9437d046-9632-424f-8765-988a5047bf72 req-7cd5e73e-f8d2-43f2-8c2d-e0854268491b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.740550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9437d046-9632-424f-8765-988a5047bf72 req-7cd5e73e-f8d2-43f2-8c2d-e0854268491b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.755058 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9437d046-9632-424f-8765-988a5047bf72 req-7cd5e73e-f8d2-43f2-8c2d-e0854268491b service nova] Creating event network-vif-plugged:ed6286e8-0dcb-4508-8927-6b34145c1be8 for instance 619ae303-88ce-4e79-a7da-111b4bd31c15 on n-h1-858384-19 Nov 02 13:26:12.760975 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9437d046-9632-424f-8765-988a5047bf72 req-7cd5e73e-f8d2-43f2-8c2d-e0854268491b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036011 Nov 02 13:26:12.761828 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1434/3152] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:12.784469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:12.796114 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35cbe2db-440c-4a45-9f43-3ee665770cb4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1506 microversion: 2.1 time: 0.290776 Nov 02 13:26:12.797151 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1719/3153] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:12 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:12.821914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:12.822839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:12.829357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:12.831891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:12.838310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.841613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.842324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.844937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.849152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.851644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.852145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.852595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.853322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:12.853788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:12.854228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.855998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:12.888981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:26:12.996036 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dca486d5-ee0d-4fc1-b5e1-e27a20e1d066 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 204 len: 0 microversion: 2.1 time: 0.171271 Nov 02 13:26:13.001641 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1720/3154] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:26:12 2022] DELETE /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:13.007784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:13.008494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:13.014477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:13.014970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:13.015461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:13.016168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:13.016630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:13.017061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:13.087027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:13.094826 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d97ccd11-ffd2-45a7-b1f4-eca140b4a87a tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1543 microversion: 2.1 time: 0.281789 Nov 02 13:26:13.095755 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1435/3155] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:12 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1543 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:13.101100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:13.101707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:13.107737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:13.108220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:13.108659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:13.109500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:13.109961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:13.110385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:13.173008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:13.184585 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84a0c840-7858-4353-8542-9691aec5d557 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.180435 Nov 02 13:26:13.184585 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1721/3156] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:13 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:13.681544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:13.704522 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-06b7ab7c-ec31-4b88-8054-0707b254ce25 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1512 microversion: 2.1 time: 0.607205 Nov 02 13:26:13.705678 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1436/3157] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:13 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1512 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:13.750230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:13.751686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:13.760474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:13.761338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:13.761864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:13.762894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:13.763650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:13.764315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:14.024992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:14.037316 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ad4c053-ebfa-4f0d-9073-06eb7b2ecbff tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.291128 Nov 02 13:26:14.051177 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1722/3158] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:13 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:14.126573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:14.127421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:14.135932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:14.136577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:14.137116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:14.137954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:14.138513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:14.139425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:14.209190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:14.210200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:14.217389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:14.218299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:14.219085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:14.220068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:14.220734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:14.221374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:14.353934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:14.364689 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ea726430-0810-4a36-a333-44865f9042fd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1543 microversion: 2.1 time: 0.243879 Nov 02 13:26:14.380775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1437/3159] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:14 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1543 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:14.549231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:14.560919 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b5823e2e-9100-48cb-a12a-d6a7ef7a2d06 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.356898 Nov 02 13:26:14.562120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1723/3160] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:14 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:14.731255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:14.731933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:14.740313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:14.741058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:14.742013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:14.743221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:14.744077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:14.745177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:14.751515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:14.857958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe861250-7b24-404b-868c-79f80c390fd3 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Calling method '.version_select at 0x7fe786d203a0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:14.940537 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe861250-7b24-404b-868c-79f80c390fd3 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/4d211aa031794b8ba202b3e70c8067b3" status: 200 len: 371 microversion: 2.1 time: 0.247647 Nov 02 13:26:14.942087 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1438/3161] 10.222.0.113 () {58 vars in 1247 bytes} [Wed Nov 2 13:26:14 2022] GET /compute/v2.1/os-quota-sets/4d211aa031794b8ba202b3e70c8067b3 => generated 371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:14.958817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eb8b638f-a3aa-41f3-b9f7-54179b0722ff tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Action: 'update', calling method: .version_select at 0x7fe786d20310>, body: {"quota_set": {"ram": "5120"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:15.018752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:15.033431 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7942525b-9d3e-45b2-96de-69cc80c988a2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1512 microversion: 2.1 time: 0.307818 Nov 02 13:26:15.035155 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1724/3162] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:14 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:15.050528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb8b638f-a3aa-41f3-b9f7-54179b0722ff tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:15.053436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb8b638f-a3aa-41f3-b9f7-54179b0722ff tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:15.053914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb8b638f-a3aa-41f3-b9f7-54179b0722ff tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:15.055254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb8b638f-a3aa-41f3-b9f7-54179b0722ff tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:15.055254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb8b638f-a3aa-41f3-b9f7-54179b0722ff tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:15.057341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb8b638f-a3aa-41f3-b9f7-54179b0722ff tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:15.064400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:15.065337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:15.076149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:15.076642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:15.077348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:15.079441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:15.080282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:15.081085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:15.182137 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eb8b638f-a3aa-41f3-b9f7-54179b0722ff tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/4d211aa031794b8ba202b3e70c8067b3" status: 200 len: 328 microversion: 2.1 time: 0.231104 Nov 02 13:26:15.184269 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1439/3163] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:26:14 2022] PUT /compute/v2.1/os-quota-sets/4d211aa031794b8ba202b3e70c8067b3 => generated 328 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:15.198117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-98e46cb3-99e6-4143-a26b-25828d6c80a9 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:15.212094 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-98e46cb3-99e6-4143-a26b-25828d6c80a9 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-quota-sets/4d211aa031794b8ba202b3e70c8067b3" status: 202 len: 0 microversion: 2.1 time: 0.019008 Nov 02 13:26:15.212701 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1440/3164] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:26:15 2022] DELETE /compute/v2.1/os-quota-sets/4d211aa031794b8ba202b3e70c8067b3 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:26:15.220969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-813cb146-7975-432c-b210-948a9b3acf29 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Calling method '.version_select at 0x7fe786d1a160>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:15.323976 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-813cb146-7975-432c-b210-948a9b3acf29 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/4d211aa031794b8ba202b3e70c8067b3" status: 200 len: 371 microversion: 2.1 time: 0.106731 Nov 02 13:26:15.325863 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1441/3165] 10.222.0.113 () {58 vars in 1247 bytes} [Wed Nov 2 13:26:15 2022] GET /compute/v2.1/os-quota-sets/4d211aa031794b8ba202b3e70c8067b3 => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:15.377256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:15.389445 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1244fb74-fc35-464f-9dee-08fee9123af5 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.331183 Nov 02 13:26:15.390248 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1725/3166] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:15 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:15.401166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:15.401841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:15.419332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:15.420208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:15.420733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:15.424213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:15.424761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:15.425202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:15.519961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c03c037c-f080-4fb2-9574-21e3fd8854a7 req-5bc706d2-b187-445b-9749-55e5d1a83682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de59311-9e6e-4ca3-9c85-58f04c65a5e1", "name": "network-vif-deleted", "tag": "1b9adfb2-a559-4c17-9100-d60169f872d3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:15.540793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c03c037c-f080-4fb2-9574-21e3fd8854a7 req-5bc706d2-b187-445b-9749-55e5d1a83682 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:15.545918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c03c037c-f080-4fb2-9574-21e3fd8854a7 req-5bc706d2-b187-445b-9749-55e5d1a83682 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:15.546660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c03c037c-f080-4fb2-9574-21e3fd8854a7 req-5bc706d2-b187-445b-9749-55e5d1a83682 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:15.571074 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c03c037c-f080-4fb2-9574-21e3fd8854a7 req-5bc706d2-b187-445b-9749-55e5d1a83682 service nova] Creating event network-vif-deleted:1b9adfb2-a559-4c17-9100-d60169f872d3 for instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 on n-h2-858384-19 Nov 02 13:26:15.577727 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c03c037c-f080-4fb2-9574-21e3fd8854a7 req-5bc706d2-b187-445b-9749-55e5d1a83682 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063063 Nov 02 13:26:15.580314 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1726/3167] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:15.594813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d276e460-9800-444c-8474-1ca4b6fba2ef tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Calling method '.version_select at 0x7fe7876053a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:15.680631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:15.689003 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-730d6b74-896e-483a-bf01-e783445c54b6 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1543 microversion: 2.1 time: 0.300416 Nov 02 13:26:15.689811 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1442/3168] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:15 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1543 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:15.699348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:15.700186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:15.707770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:15.708473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:15.709090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:15.709944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:15.710544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:15.711138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:15.902708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:15.903472 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d276e460-9800-444c-8474-1ca4b6fba2ef tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/1ecb051705f64c5a950d4cca929f2b6b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.321573 Nov 02 13:26:15.904166 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1727/3169] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:26:15 2022] GET /compute/v2.1/os-quota-sets/1ecb051705f64c5a950d4cca929f2b6b/defaults => generated 371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:15.927435 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-696447aa-c94a-4949-8075-68b6ad9bf333 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.234737 Nov 02 13:26:15.943776 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1443/3170] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:15 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:16.061643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:16.062866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:16.072216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.072718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.073157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.074025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.074722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.075170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.118760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.119906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.120497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.121130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lazy-loading 'fault' on Instance uuid 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:26:16.176062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:16.186340 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4912ae19-2ead-4a0a-9a5a-b2768deb03b7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 200 len: 1309 microversion: 2.1 time: 0.132130 Nov 02 13:26:16.187320 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1728/3171] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:16 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 1309 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:16.245711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04312c9a-1400-462f-8415-721ff97f9ad4 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Action: 'update', calling method: .version_select at 0x7fe786fdee50>, body: {"quota_set": {"ram": "5120"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:16.427620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:16.428721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:16.433293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04312c9a-1400-462f-8415-721ff97f9ad4 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.433776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04312c9a-1400-462f-8415-721ff97f9ad4 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.434266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04312c9a-1400-462f-8415-721ff97f9ad4 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.434997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04312c9a-1400-462f-8415-721ff97f9ad4 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.435475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04312c9a-1400-462f-8415-721ff97f9ad4 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.436009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04312c9a-1400-462f-8415-721ff97f9ad4 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.438316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.439087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.439815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.440933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.442234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.443281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.479460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:16.500856 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04312c9a-1400-462f-8415-721ff97f9ad4 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/54dac3bcb43e4fa884f4a1f8b1d61771" status: 200 len: 328 microversion: 2.1 time: 0.255065 Nov 02 13:26:16.505286 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1444/3172] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:26:16 2022] PUT /compute/v2.1/os-quota-sets/54dac3bcb43e4fa884f4a1f8b1d61771 => generated 328 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:16.510779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62ecc741-9382-48ce-a0a6-883809dfd8cf tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Calling method '.version_select at 0x7fe787790040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:16.578784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ecc741-9382-48ce-a0a6-883809dfd8cf tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.579426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ecc741-9382-48ce-a0a6-883809dfd8cf tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.579937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ecc741-9382-48ce-a0a6-883809dfd8cf tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.580866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ecc741-9382-48ce-a0a6-883809dfd8cf tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.581426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ecc741-9382-48ce-a0a6-883809dfd8cf tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.581958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ecc741-9382-48ce-a0a6-883809dfd8cf tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.602775 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62ecc741-9382-48ce-a0a6-883809dfd8cf tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/54dac3bcb43e4fa884f4a1f8b1d61771/detail" status: 200 len: 916 microversion: 2.1 time: 0.096122 Nov 02 13:26:16.603555 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1445/3173] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:26:16 2022] GET /compute/v2.1/os-quota-sets/54dac3bcb43e4fa884f4a1f8b1d61771/detail => generated 916 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:16.719990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:16.720690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:16.730753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.731288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.731729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.732624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.733080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.733586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.880722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:16.888844 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-737a8af0-6047-400a-a153-c9b3405b00eb tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1538 microversion: 2.1 time: 0.172978 Nov 02 13:26:16.889437 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1446/3174] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:16 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1538 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:16.894009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Action: 'update', calling method: .version_select at 0x7fe786d1f670>, body: {"quota_set": {"ram": "2048"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:16.966283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.966922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.967227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:16.967960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:16.968420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:16.968850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:17.007510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:17.007999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:17.008444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:17.009178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:17.010123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:17.010575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:17.055269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:17.064313 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d829318-695f-443a-b41e-8d7987757362 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.642390 Nov 02 13:26:17.065112 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1729/3175] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:16 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:17.071184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:17.071989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:17.073758 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8b08e76a-4ea6-4aaa-a57a-ba3a095e823e tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/54dac3bcb43e4fa884f4a1f8b1d61771?user_id=47d6b88a208844b680d3b28632ea38e3" status: 200 len: 328 microversion: 2.1 time: 0.183213 Nov 02 13:26:17.074641 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1447/3176] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:26:16 2022] PUT /compute/v2.1/os-quota-sets/54dac3bcb43e4fa884f4a1f8b1d61771?user_id=47d6b88a208844b680d3b28632ea38e3 => generated 328 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:17.078525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:17.079063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:17.079550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:17.080254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:17.080728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:17.081135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:17.087127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38046c24-5b6a-4615-8a81-adfbdd0ad65f tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Calling method '.version_select at 0x7fe786d20040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:17.235803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:17.244856 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e0a9977-ce82-443f-b7d5-9e994d26fa5a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.177853 Nov 02 13:26:17.248992 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1730/3177] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:17 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:17.256575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:17.257393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:17.263457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:17.264144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:17.264743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:17.265604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:17.266215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:17.267739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38046c24-5b6a-4615-8a81-adfbdd0ad65f tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/54dac3bcb43e4fa884f4a1f8b1d61771?user_id=47d6b88a208844b680d3b28632ea38e3" status: 200 len: 370 microversion: 2.1 time: 0.184398 Nov 02 13:26:17.275197 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1448/3178] 10.222.0.113 () {58 vars in 1328 bytes} [Wed Nov 2 13:26:17 2022] GET /compute/v2.1/os-quota-sets/54dac3bcb43e4fa884f4a1f8b1d61771?user_id=47d6b88a208844b680d3b28632ea38e3 => generated 370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:17.282508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:17.307064 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 HTTP/1.1 Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:17.309800 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:26:17.311501 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7de59311-9e6e-4ca3-9c85-58f04c65a5e1'} Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:17.312512 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:26:17.313933 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:17.315266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:17.315266 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6414fcff-2c87-4de8-be51-8991ebaf0f93 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 404 len: 111 microversion: 2.1 time: 0.060512 Nov 02 13:26:17.315266 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1731/3179] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:17 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:17.491098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1065412840", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "37c549b8-fcca-4ed8-94a6-1e15dc2811d6"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:17.561242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] validate_networks() for [('37c549b8-fcca-4ed8-94a6-1e15dc2811d6', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:26:17.674715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22fe5ee4-d98c-453e-acce-b57c0d9733c8 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Calling method '.version_select at 0x7fe78f988310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:17.865179 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22fe5ee4-d98c-453e-acce-b57c0d9733c8 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/1ecb051705f64c5a950d4cca929f2b6b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.194097 Nov 02 13:26:17.865883 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1732/3180] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:26:17 2022] GET /compute/v2.1/os-quota-sets/1ecb051705f64c5a950d4cca929f2b6b/defaults => generated 371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:17.881416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-395f7dc7-746d-4552-b3c6-685b1477ab44 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Action: 'update', calling method: .version_select at 0x7fe78f988ca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:17.950386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395f7dc7-746d-4552-b3c6-685b1477ab44 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:17.950876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395f7dc7-746d-4552-b3c6-685b1477ab44 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:17.951358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395f7dc7-746d-4552-b3c6-685b1477ab44 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:17.952096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395f7dc7-746d-4552-b3c6-685b1477ab44 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:17.952553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395f7dc7-746d-4552-b3c6-685b1477ab44 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:17.952984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395f7dc7-746d-4552-b3c6-685b1477ab44 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.142861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-395f7dc7-746d-4552-b3c6-685b1477ab44 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/1ecb051705f64c5a950d4cca929f2b6b" status: 200 len: 329 microversion: 2.1 time: 0.266849 Nov 02 13:26:18.143860 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1733/3181] 10.222.0.113 () {60 vars in 1268 bytes} [Wed Nov 2 13:26:17 2022] PUT /compute/v2.1/os-quota-sets/1ecb051705f64c5a950d4cca929f2b6b => generated 329 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:18.154766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:18.155407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:18.162076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.162558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.162997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.163729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.164799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.165228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.299443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:18.307707 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb9d965b-e88b-41e7-a1fc-6ac7ba3bc7c2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1525 microversion: 2.1 time: 0.162167 Nov 02 13:26:18.308292 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1734/3182] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:18 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:18.319469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:18.319469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:18.321625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.322097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.322611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.323347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.323798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.324231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.370041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:26:18.370548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:26:18.370962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:26:18.371421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:26:18.372019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:26:18.382029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.382518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.382961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.383743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.384199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.384635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.403538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:18.411004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for user 4228809f65b74c90b1d34cecc1b4d30e and project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:18.425380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:26:18.428812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:26:18.469551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:18.477842 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3cd767ce-4202-42ec-a39a-2661d073d9b7 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.168530 Nov 02 13:26:18.478438 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1735/3183] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:18 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:18.482928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb5ba8b0-37e8-49bb-93f7-26bec3b60a48 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Action: 'update', calling method: .version_select at 0x7fe786e84160>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:18.492933 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a433f705-0fe6-4978-a641-1a9c2ded5ab5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.006710 Nov 02 13:26:18.495392 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1449/3184] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:26:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:26:18.500674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:18.501352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:18.510692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.511207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.511760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.512585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.513040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.513591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.517834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:18.594049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5ba8b0-37e8-49bb-93f7-26bec3b60a48 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.594567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5ba8b0-37e8-49bb-93f7-26bec3b60a48 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.595003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5ba8b0-37e8-49bb-93f7-26bec3b60a48 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.595861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5ba8b0-37e8-49bb-93f7-26bec3b60a48 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.596311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5ba8b0-37e8-49bb-93f7-26bec3b60a48 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.596912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5ba8b0-37e8-49bb-93f7-26bec3b60a48 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.636110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=14 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:18.817534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:18.826293 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bcc63a83-a45a-4739-ac88-64b8c39acc40 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.329817 Nov 02 13:26:18.827216 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1450/3185] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:18 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:18.845574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:18.849726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:18.862890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.864279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.865260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.867612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:18.869767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:18.870722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:18.944906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:26:19.069394 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb5ba8b0-37e8-49bb-93f7-26bec3b60a48 tempest-QuotasAdminTestJSON-1386675254 tempest-QuotasAdminTestJSON-1386675254-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/1ecb051705f64c5a950d4cca929f2b6b" status: 200 len: 329 microversion: 2.1 time: 0.589689 Nov 02 13:26:19.073554 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1736/3186] 10.222.0.113 () {60 vars in 1268 bytes} [Wed Nov 2 13:26:18 2022] PUT /compute/v2.1/os-quota-sets/1ecb051705f64c5a950d4cca929f2b6b => generated 329 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:19.083357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a9f61b39-d7a2-489c-8b30-7fa2068b7336 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:19.084840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a9f61b39-d7a2-489c-8b30-7fa2068b7336 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:19.193063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a9f61b39-d7a2-489c-8b30-7fa2068b7336 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:19.206650 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a9f61b39-d7a2-489c-8b30-7fa2068b7336 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1219 microversion: 2.1 time: 0.131550 Nov 02 13:26:19.211166 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1737/3187] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:19 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:19.307492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8001d431-d667-46f4-8aa8-e0ef4786d7ad tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 204 len: 0 microversion: 2.1 time: 0.478433 Nov 02 13:26:19.307858 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1451/3188] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:26:18 2022] DELETE /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:19.328108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:19.328967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:19.346044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:19.346547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:19.346993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:19.349320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:19.350006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:19.350460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:19.504788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:19.505598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:19.519452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:19.520764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:19.521763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:19.523140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:19.524004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:19.524450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:19.538141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:19.551400 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e19d90e-9572-4a40-b990-2b74c5121a0d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1531 microversion: 2.1 time: 0.237925 Nov 02 13:26:19.551969 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1738/3189] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:19 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1531 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:19.770935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:19.786502 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c6e90e9d-6136-44ef-ad7b-019365c5ffdd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.286981 Nov 02 13:26:19.787006 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1452/3190] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:19 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:19.879670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:19.880784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:19.893265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:19.894093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:19.895385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:19.896260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:19.896856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:19.897425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:20.139346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:20.148790 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5da15411-c130-46be-adc2-841679e288b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.281219 Nov 02 13:26:20.149662 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1739/3191] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:19 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:20.239148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:20.239983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:20.247851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:20.248347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:20.248789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:20.249502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:20.250321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:20.250830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:20.572995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e23b0903-1f91-4644-9cce-1db4662b9c62 req-9b5d0683-ba0d-4ea2-80d4-a74201e760a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619ae303-88ce-4e79-a7da-111b4bd31c15", "name": "network-vif-unplugged", "status": "completed", "tag": "ed6286e8-0dcb-4508-8927-6b34145c1be8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:20.594775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e23b0903-1f91-4644-9cce-1db4662b9c62 req-9b5d0683-ba0d-4ea2-80d4-a74201e760a5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:20.596056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e23b0903-1f91-4644-9cce-1db4662b9c62 req-9b5d0683-ba0d-4ea2-80d4-a74201e760a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:20.596997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e23b0903-1f91-4644-9cce-1db4662b9c62 req-9b5d0683-ba0d-4ea2-80d4-a74201e760a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:20.623965 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e23b0903-1f91-4644-9cce-1db4662b9c62 req-9b5d0683-ba0d-4ea2-80d4-a74201e760a5 service nova] Creating event network-vif-unplugged:ed6286e8-0dcb-4508-8927-6b34145c1be8 for instance 619ae303-88ce-4e79-a7da-111b4bd31c15 on n-h1-858384-19 Nov 02 13:26:20.630581 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e23b0903-1f91-4644-9cce-1db4662b9c62 req-9b5d0683-ba0d-4ea2-80d4-a74201e760a5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063235 Nov 02 13:26:20.631837 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1740/3192] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:20.638549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:20.639658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:20.648878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:20.649678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:20.650592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:20.650734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:20.652023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:20.652643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:20.653373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:20.666111 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-18e5eec9-5556-4b79-a9d9-864f6b706d6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1223 microversion: 2.1 time: 0.431871 Nov 02 13:26:20.670184 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1453/3193] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:20 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1223 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:20.811893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:20.812683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:20.820510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:20.820726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:20.821243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:20.822219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:20.822798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:20.823413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:20.871016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:20.882180 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d4233e3-d5dd-4a5e-ab7d-312bcfa6b2b2 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1531 microversion: 2.1 time: 0.248706 Nov 02 13:26:20.882931 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1741/3194] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:20 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1531 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:21.079185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:21.090220 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-87f38417-4f4c-43aa-9f08-69b022dec23d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1524 microversion: 2.1 time: 0.282596 Nov 02 13:26:21.090860 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1454/3195] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:20 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1524 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:21.176297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:21.177187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:21.184162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:21.184866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:21.185305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:21.186005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:21.186459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:21.186881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:21.359656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:21.388305 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-727915ca-e55c-4764-8e00-6c4317ccd6ab tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.217888 Nov 02 13:26:21.392368 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1742/3196] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:21 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:21.695765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:21.697016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:21.704616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:21.705105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:21.705541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:21.706308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:21.706797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:21.707285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:21.811088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:21.828591 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-89ac9f16-3401-424a-8d95-015f1f58e862 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1271 microversion: 2.1 time: 0.138292 Nov 02 13:26:21.829960 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1455/3197] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:21 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:21.906097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:21.907231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:21.917802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:21.918397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:21.919097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:21.919853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:21.920322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:21.920849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:22.115286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:22.116685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:22.125037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:22.126035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:22.126904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:22.127872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:22.128507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:22.129137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:22.163852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:22.171662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3456fd16-402f-48bf-8247-eb7062f645e7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1531 microversion: 2.1 time: 0.269545 Nov 02 13:26:22.172447 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1743/3198] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:21 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1531 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:22.385528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:22.415773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:22.416493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:22.419087 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22210ce3-a398-40db-985c-05c2406bc97c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1501 microversion: 2.1 time: 0.309577 Nov 02 13:26:22.432793 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1456/3199] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:22 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1501 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:22.433880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:22.437719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:22.438170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:22.438888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:22.439535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:22.439963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:22.492248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:22.511653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:22.514291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:22.535809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:22.536965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:22.537559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:22.538507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:22.539143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:22.539731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:22.583459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:22.631965 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c24fa78-9c05-4f22-a3f0-110eac6417cd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 347 microversion: 2.1 time: 0.184515 Nov 02 13:26:22.635399 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1457/3200] 10.222.0.113 () {58 vars in 1159 bytes} [Wed Nov 2 13:26:22 2022] GET /compute/v2.1/servers?status=shutoff => generated 347 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:22.645429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6c01cca5-d572-40b4-9339-7f54f09111d8 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:22.652652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c01cca5-d572-40b4-9339-7f54f09111d8 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:22.653423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c01cca5-d572-40b4-9339-7f54f09111d8 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:22.654038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c01cca5-d572-40b4-9339-7f54f09111d8 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:22.701647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6c01cca5-d572-40b4-9339-7f54f09111d8 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Going to try to start instance {{(pid=120929) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 13:26:22.822915 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6c01cca5-d572-40b4-9339-7f54f09111d8 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "POST /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248/action" status: 202 len: 0 microversion: 2.1 time: 0.181507 Nov 02 13:26:22.823200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:22.824352 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1458/3201] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:22 2022] POST /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:26:22.851191 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d3c68ac2-0086-4d7f-9d0f-7bbcd812add8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.435911 Nov 02 13:26:22.853895 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1744/3202] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:22 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:22.870366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b84ee298-aebb-4f69-9a56-2c854bffab3c req-9a3b7d82-81a8-4895-8daa-397996150a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619ae303-88ce-4e79-a7da-111b4bd31c15", "name": "network-vif-deleted", "tag": "ed6286e8-0dcb-4508-8927-6b34145c1be8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:22.931711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b84ee298-aebb-4f69-9a56-2c854bffab3c req-9a3b7d82-81a8-4895-8daa-397996150a9a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:22.935754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b84ee298-aebb-4f69-9a56-2c854bffab3c req-9a3b7d82-81a8-4895-8daa-397996150a9a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:22.936948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b84ee298-aebb-4f69-9a56-2c854bffab3c req-9a3b7d82-81a8-4895-8daa-397996150a9a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:22.975560 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b84ee298-aebb-4f69-9a56-2c854bffab3c req-9a3b7d82-81a8-4895-8daa-397996150a9a service nova] Creating event network-vif-deleted:ed6286e8-0dcb-4508-8927-6b34145c1be8 for instance 619ae303-88ce-4e79-a7da-111b4bd31c15 on n-h1-858384-19 Nov 02 13:26:22.992813 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b84ee298-aebb-4f69-9a56-2c854bffab3c req-9a3b7d82-81a8-4895-8daa-397996150a9a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130345 Nov 02 13:26:22.993879 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1745/3203] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:23.005063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:23.006563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:23.018118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.020210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.021477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.023639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.023862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.024637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.070397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5549e9e0-b631-4da1-859a-23ffa61fe5f1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Calling method '.version_select at 0x7fe786ff2ee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:23.154762 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5549e9e0-b631-4da1-859a-23ffa61fe5f1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 200 len: 371 microversion: 2.1 time: 0.328356 Nov 02 13:26:23.156209 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1459/3204] 10.222.0.113 () {58 vars in 1247 bytes} [Wed Nov 2 13:26:22 2022] GET /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:23.165650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:23.166522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:23.173399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.173966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.174617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.177297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.177870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.178414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.280332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:23.292647 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-722e0fb3-1d1d-4299-acb5-6786b23defec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1277 microversion: 2.1 time: 0.134767 Nov 02 13:26:23.306431 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1460/3205] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:23 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:23.312542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e9e7b02-08a9-4e2b-98b4-46c6da75cb19 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Action: 'update', calling method: .version_select at 0x7fe786fd6f70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:23.315804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:23.328232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-019bae98-9a5b-4ef8-9e19-a73b0526994f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1510 microversion: 2.1 time: 0.332137 Nov 02 13:26:23.328824 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1746/3206] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:22 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:23.334343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:23.334960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:23.356156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.356640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.357080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.357786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.358236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.358664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.387406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:23.413953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.414865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.415603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.416409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lazy-loading 'fault' on Instance uuid 619ae303-88ce-4e79-a7da-111b4bd31c15 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:26:23.423864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e9e7b02-08a9-4e2b-98b4-46c6da75cb19 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.424858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e9e7b02-08a9-4e2b-98b4-46c6da75cb19 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.426129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e9e7b02-08a9-4e2b-98b4-46c6da75cb19 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.427801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e9e7b02-08a9-4e2b-98b4-46c6da75cb19 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.428455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e9e7b02-08a9-4e2b-98b4-46c6da75cb19 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.429202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e9e7b02-08a9-4e2b-98b4-46c6da75cb19 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.478466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:23.489506 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-796c7d31-6e09-4d3b-b67e-8e11413aa19d tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 200 len: 1319 microversion: 2.1 time: 0.159598 Nov 02 13:26:23.490581 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1747/3207] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:23 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:23.495719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e9e7b02-08a9-4e2b-98b4-46c6da75cb19 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 200 len: 328 microversion: 2.1 time: 0.187898 Nov 02 13:26:23.506478 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1461/3208] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:26:23 2022] PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:23.710454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1625056068", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:23.817077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:26:23.881075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:23.881743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:23.888055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:23.890117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.890864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.891777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:23.892696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:23.893379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:23.894537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.176427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:26:24.177567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:26:24.178198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:26:24.178757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:26:24.179375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:26:24.188897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.189627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.190259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.191732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.192342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.192922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.213497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Getting quotas for project 3ac3367685034206bee3f8148867c469. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:24.218089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:24.220024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Getting quotas for user 0415c50b2cc0438ebbafe994fd21aca0 and project 3ac3367685034206bee3f8148867c469. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:24.227097 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0ced56d-5619-48c0-b89f-5adaa6c7d2be tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.350156 Nov 02 13:26:24.230877 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1462/3209] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:23 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:24.233572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.utils [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] cores quota exceeded for 3ac3367685034206bee3f8148867c469, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120928) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 13:26:24.234561 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Request method failure captured: Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 145 Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_9DM3jxc8B3VUNX3JdlEz65uRJmgnZgaKwdw-xRcbtrp3lxkgCFBAAmcY46ZEZ23uYEV-nEQLWBQREOa_SGI5lyzR9PliluCcJjHHjzFx9mdwY5ofrWVR61DKZMwe1JXvySOTzT5rTMq85QdQQnqPE-8eW9wokRbPsNzVDK6qqTKk Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 3ac3367685034206bee3f8148867c469 Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:24.257626 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ac3367685034206bee3f8148867c469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ac3367685034206bee3f8148867c469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3ac3367685034206bee3f8148867c469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3ac3367685034206bee3f8148867c469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 3ac3367685034206bee3f8148867c469 Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-QuotasAdminNegativeTest-385516814-project Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0415c50b2cc0438ebbafe994fd21aca0 Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-QuotasAdminNegativeTest-385516814-project Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1625056068", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} Nov 02 13:26:24.259297 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1625056068', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452'}}} Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:26:24.260449 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:24.261859 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.263585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:24.265145 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:24.265145 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:24.265145 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:24.265145 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:24.265145 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 13:26:24.265145 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.265145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:24.265145 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45fe35e8-23fa-44f5-aed6-640dba724a16 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.641118 Nov 02 13:26:24.265145 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1748/3210] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:26:23 2022] POST /compute/v2.1/servers => generated 111 bytes in 643 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:24.272144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-86ec19ca-694f-42e9-8c94-d0b1fca78323 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Action: 'update', calling method: .version_select at 0x7fe786d618b0>, body: {"quota_set": {"cores": 20}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:24.316763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:24.317705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:24.337059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.337584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.338038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.338780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.342975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.346511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.402190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86ec19ca-694f-42e9-8c94-d0b1fca78323 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.402685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86ec19ca-694f-42e9-8c94-d0b1fca78323 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.406717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86ec19ca-694f-42e9-8c94-d0b1fca78323 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.408058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86ec19ca-694f-42e9-8c94-d0b1fca78323 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.412162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86ec19ca-694f-42e9-8c94-d0b1fca78323 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.413286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86ec19ca-694f-42e9-8c94-d0b1fca78323 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.498796 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-86ec19ca-694f-42e9-8c94-d0b1fca78323 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 200 len: 329 microversion: 2.1 time: 0.232864 Nov 02 13:26:24.499431 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1463/3211] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:26:24 2022] PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 329 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:24.514662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:24.515611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:24.525055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.525769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.526380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.527337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.527955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.528546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.749168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:24.758133 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82f4ee8e-2591-416a-bd90-0b45cb208940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1319 microversion: 2.1 time: 0.445801 Nov 02 13:26:24.758716 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1749/3212] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:24 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:24.786189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a88b2490-0726-478d-9ef5-27fd4f5acb0a tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Calling method '.version_select at 0x7fe78f97e820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:24.792613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:24.802693 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf8b4b4e-ae2a-4e0d-9bd2-8d4bbc6c2afd tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1510 microversion: 2.1 time: 0.292428 Nov 02 13:26:24.805246 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1464/3213] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:24 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:24.825134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:24.825979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:24.837309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.840933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.841610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.843534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:24.847889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:24.849247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:24.875041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:INSERT=14,nova_api:SELECT=72,nova_api:UPDATE=14 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:24.881503 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 HTTP/1.1 Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:26:24.886571 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:24.888405 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '619ae303-88ce-4e79-a7da-111b4bd31c15'} Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:24.889170 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:24.890381 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:24.897087 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a88b2490-0726-478d-9ef5-27fd4f5acb0a tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 200 len: 371 microversion: 2.1 time: 0.115118 Nov 02 13:26:24.904525 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1750/3214] 10.222.0.113 () {58 vars in 1247 bytes} [Wed Nov 2 13:26:24 2022] GET /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:24.905494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:24.906674 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b52e1fb5-e6fe-44d7-bf3b-42c30bb359ab tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 404 len: 111 microversion: 2.1 time: 0.100285 Nov 02 13:26:24.907772 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1465/3215] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:24 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:24.911560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77f9e039-8123-493c-9883-e35089845408 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Action: 'update', calling method: .version_select at 0x7fe787a98c10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:25.047890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77f9e039-8123-493c-9883-e35089845408 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:25.048524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77f9e039-8123-493c-9883-e35089845408 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:25.049803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77f9e039-8123-493c-9883-e35089845408 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:25.053000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77f9e039-8123-493c-9883-e35089845408 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:25.054066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77f9e039-8123-493c-9883-e35089845408 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:25.054729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77f9e039-8123-493c-9883-e35089845408 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:25.137342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1166386385", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:25.150988 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77f9e039-8123-493c-9883-e35089845408 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 200 len: 328 microversion: 2.1 time: 0.239464 Nov 02 13:26:25.152140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1751/3216] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:26:24 2022] PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 328 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:25.220126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] validate_networks() for [('1d4f643a-cb15-4b23-b27a-06cbc62da1dd', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:26:25.252790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1149898438", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:25.319903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:26:25.997448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:26:26.000119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:26:26.000624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:26:26.001190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:26:26.001856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:26:26.023659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.024405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.025030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.025957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.026928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.027577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.067967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Getting quotas for project e23d91dc30354049bb22462413ae5a15. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:26.081371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Getting quotas for user 0935d05ae9274e9ba65f45b637e2ea66 and project e23d91dc30354049bb22462413ae5a15. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:26.099090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:26:26.101102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:26:26.101612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:26:26.102162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:26:26.102546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:26:26.102840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:26:26.103387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:26:26.121899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.126896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.127528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.128521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.129073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.129647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.165924 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-65dd3983-f1aa-4d2f-a540-e99d186c2726 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.033585 Nov 02 13:26:26.167145 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1466/3217] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:26:25 2022] POST /compute/v2.1/servers => generated 385 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:26:26.172533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:26.173805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:26.181268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.182118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.182750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.183884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.184542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.185204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.205178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Getting quotas for project 3ac3367685034206bee3f8148867c469. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:26.214770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Getting quotas for user 0415c50b2cc0438ebbafe994fd21aca0 and project 3ac3367685034206bee3f8148867c469. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:26.217193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:26.256107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.utils [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] instances quota exceeded for 3ac3367685034206bee3f8148867c469, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120928) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 13:26:26.256938 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Request method failure captured: Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 145 Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_9DM3jxc8B3VUNX3JdlEz65uRJmgnZgaKwdw-xRcbtrp3lxkgCFBAAmcY46ZEZ23uYEV-nEQLWBQREOa_SGI5lyzR9PliluCcJjHHjzFx9mdwY5ofrWVR61DKZMwe1JXvySOTzT5rTMq85QdQQnqPE-8eW9wokRbPsNzVDK6qqTKk Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 3ac3367685034206bee3f8148867c469 Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:26.258630 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ac3367685034206bee3f8148867c469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ac3367685034206bee3f8148867c469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3ac3367685034206bee3f8148867c469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3ac3367685034206bee3f8148867c469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 3ac3367685034206bee3f8148867c469 Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-QuotasAdminNegativeTest-385516814-project Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0415c50b2cc0438ebbafe994fd21aca0 Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-QuotasAdminNegativeTest-385516814-project Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1149898438", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} Nov 02 13:26:26.260780 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1149898438', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452'}}} Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:26:26.261918 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:26.264968 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:26.269820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8b7ad7db-6365-4604-b115-306394dedb05 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.013276 Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1752/3218] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:26:25 2022] POST /compute/v2.1/servers => generated 119 bytes in 1018 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:26.276209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:26.278091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:26.286063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.291010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.291507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.292276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.292744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.293179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.526689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:26.574779 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-95aafd49-54b6-4ff6-9503-862ed1969d82 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1517 microversion: 2.1 time: 0.404464 Nov 02 13:26:26.577172 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1467/3219] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:26 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1517 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:26.583058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:26.584711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:26.600739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.604500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.605459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.606586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.607361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.608038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.695602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:26.714689 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3aa2fa36-bff7-42cb-9e26-de41b61cf2cd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1319 microversion: 2.1 time: 0.447036 Nov 02 13:26:26.715886 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1753/3220] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:26 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:26.724919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-21e2d86a-4430-4e31-bfb7-1fd42f475013 req-a357487b-a91b-48b9-aff8-f194631bd51b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "265a2907-ff73-412a-ae89-aaafbddd4781", "tag": "b5ffdfa0-61de-4f95-b5dd-018ce78fa368"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:26.741426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-21e2d86a-4430-4e31-bfb7-1fd42f475013 req-a357487b-a91b-48b9-aff8-f194631bd51b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.742562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-21e2d86a-4430-4e31-bfb7-1fd42f475013 req-a357487b-a91b-48b9-aff8-f194631bd51b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.743711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-21e2d86a-4430-4e31-bfb7-1fd42f475013 req-a357487b-a91b-48b9-aff8-f194631bd51b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.763212 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-21e2d86a-4430-4e31-bfb7-1fd42f475013 req-a357487b-a91b-48b9-aff8-f194631bd51b service nova] Creating event network-changed:b5ffdfa0-61de-4f95-b5dd-018ce78fa368 for instance 265a2907-ff73-412a-ae89-aaafbddd4781 on n-h1-858384-19 Nov 02 13:26:26.779238 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-21e2d86a-4430-4e31-bfb7-1fd42f475013 req-a357487b-a91b-48b9-aff8-f194631bd51b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060468 Nov 02 13:26:26.780408 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1754/3221] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:26.788912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f3e1ee09-a4c8-410e-92c7-1c5b59fcafce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:26.789763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f3e1ee09-a4c8-410e-92c7-1c5b59fcafce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:26.898285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f3e1ee09-a4c8-410e-92c7-1c5b59fcafce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:26.907636 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f3e1ee09-a4c8-410e-92c7-1c5b59fcafce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1229 microversion: 2.1 time: 0.125339 Nov 02 13:26:26.909038 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1755/3222] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:26 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1229 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:26.919827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-56714d11-5b5d-42f6-809f-2a1dd5722fca tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Action: 'update', calling method: .version_select at 0x7fe787a98430>, body: {"quota_set": {"instances": 10}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:26.946125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:26.954753 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d3d5ea6-a5e7-4bb4-aa36-59dbb4cc2e8e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1514 microversion: 2.1 time: 0.376468 Nov 02 13:26:26.955700 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1468/3223] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:26 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:26.982711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:26.989549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:26.990243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.compute.servers [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Removing options 'limit' from query {{(pid=120929) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 13:26:26.991819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:26.992927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.993864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.994409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.995663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:26.996120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:26.996548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:26.998028 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-778d01f2-fb38-40ed-87fe-83397df5644a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.020017 Nov 02 13:26:26.999236 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1469/3224] 10.222.0.113 () {58 vars in 1145 bytes} [Wed Nov 2 13:26:26 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:26:27.013578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:27.014613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:27.024874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.025833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.026446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.027365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.028197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.028858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.055344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56714d11-5b5d-42f6-809f-2a1dd5722fca tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.055832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56714d11-5b5d-42f6-809f-2a1dd5722fca tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.056275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56714d11-5b5d-42f6-809f-2a1dd5722fca tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.057005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56714d11-5b5d-42f6-809f-2a1dd5722fca tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.057461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56714d11-5b5d-42f6-809f-2a1dd5722fca tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.057887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56714d11-5b5d-42f6-809f-2a1dd5722fca tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.091813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:27.126604 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-56714d11-5b5d-42f6-809f-2a1dd5722fca tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 200 len: 329 microversion: 2.1 time: 0.216265 Nov 02 13:26:27.127566 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1756/3225] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:26:26 2022] PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 329 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:27.143534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b96efbbf-cbf8-40dd-ae16-fd33ebb08d99 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Calling method '.version_select at 0x7fe78766ec10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:27.209121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:27.217874 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6d1340a-a557-4609-9f14-846425032821 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1514 microversion: 2.1 time: 0.208278 Nov 02 13:26:27.227419 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1470/3226] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:27 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:27.242951 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b96efbbf-cbf8-40dd-ae16-fd33ebb08d99 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 200 len: 371 microversion: 2.1 time: 0.103314 Nov 02 13:26:27.243446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:27.244222 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1757/3227] 10.222.0.113 () {58 vars in 1247 bytes} [Wed Nov 2 13:26:27 2022] GET /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:27.244381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:27.257560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-772e3309-e95c-41ca-bdd4-93c8ab515cc1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Action: 'update', calling method: .version_select at 0x7fe787a98d30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:27.260925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.261501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.262011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.263215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.264029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.264675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.346064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772e3309-e95c-41ca-bdd4-93c8ab515cc1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.347065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772e3309-e95c-41ca-bdd4-93c8ab515cc1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.355551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772e3309-e95c-41ca-bdd4-93c8ab515cc1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.356608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772e3309-e95c-41ca-bdd4-93c8ab515cc1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.357249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772e3309-e95c-41ca-bdd4-93c8ab515cc1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.357853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-772e3309-e95c-41ca-bdd4-93c8ab515cc1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.488631 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-772e3309-e95c-41ca-bdd4-93c8ab515cc1 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 200 len: 325 microversion: 2.1 time: 0.235398 Nov 02 13:26:27.489446 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1758/3228] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:26:27 2022] PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:27.495165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:27.510363 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2a72b3b4-45e8-4054-80a3-4d82c3dcdf4f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 200 len: 1514 microversion: 2.1 time: 0.272058 Nov 02 13:26:27.511318 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1471/3229] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:27 2022] GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:27.545002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:27.548541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:27.559096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.560945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.561762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.563344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.564025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.564539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.585290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1754248558", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:27.695468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] validate_networks() for None {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:26:27.897432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:27.907582 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e76e186c-1b19-44d4-b188-089f77c1c582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1514 microversion: 2.1 time: 0.376238 Nov 02 13:26:27.910281 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1759/3230] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:27 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1514 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:27.918889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:27.919502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:27.938622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.939437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.940066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.941521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:27.942130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:27.942713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:27.991674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:26:27.992094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:26:27.992565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:26:27.992970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:26:27.993381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:26:28.013609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.014290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.014504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.015480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.015936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.016354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.034949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Getting quotas for project 3ac3367685034206bee3f8148867c469. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:28.040644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Getting quotas for user 0415c50b2cc0438ebbafe994fd21aca0 and project 3ac3367685034206bee3f8148867c469. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:28.054233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.utils [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] ram quota exceeded for 3ac3367685034206bee3f8148867c469, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120929) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 13:26:28.055338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Request method failure captured: Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 145 Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_9DM3jxc8B3VUNX3JdlEz65uRJmgnZgaKwdw-xRcbtrp3lxkgCFBAAmcY46ZEZ23uYEV-nEQLWBQREOa_SGI5lyzR9PliluCcJjHHjzFx9mdwY5ofrWVR61DKZMwe1JXvySOTzT5rTMq85QdQQnqPE-8eW9wokRbPsNzVDK6qqTKk Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 3ac3367685034206bee3f8148867c469 Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:26:28.060049 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ac3367685034206bee3f8148867c469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ac3367685034206bee3f8148867c469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3ac3367685034206bee3f8148867c469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3ac3367685034206bee3f8148867c469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 3ac3367685034206bee3f8148867c469 Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-QuotasAdminNegativeTest-385516814-project Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0415c50b2cc0438ebbafe994fd21aca0 Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-QuotasAdminNegativeTest-385516814-project Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1754248558", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} Nov 02 13:26:28.061331 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1754248558', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452'}}} Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 13:26:28.062050 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:28.063140 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.064362 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:28.065593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:28.065593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:28.065593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:28.065593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:28.065593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 13:26:28.065593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.068544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:28.069648 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2b59993c-a155-4553-ae41-27ae25286981 tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.492985 Nov 02 13:26:28.070412 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1472/3231] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:26:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 495 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:28.075909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:28.076123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:28.086983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.087696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.088231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.089035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.089596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.090087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.156693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:28.176313 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1add4f60-7f5e-406b-95fa-2146701bbf09 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1494 microversion: 2.1 time: 0.262711 Nov 02 13:26:28.177673 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1760/3232] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:27 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1494 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:28.185211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:28.186194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:28.196712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.197334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.198398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.199289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.200394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.201671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.254551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:28.267507 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe6f6fe4-3719-498a-9224-60d284c6a885 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1319 microversion: 2.1 time: 0.195719 Nov 02 13:26:28.268111 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1473/3233] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:28 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:28.273616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:28.280852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:28.281902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:28.311363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:28.328076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-81e66839-d55b-4ded-b4fa-63b8eba49fdd tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1233 microversion: 2.1 time: 0.147934 Nov 02 13:26:28.329110 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1761/3234] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:28 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1233 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:28.356959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91d5517c-c6ef-415b-861b-783c9acb2370 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Action: 'update', calling method: .version_select at 0x7fe787bb5700>, body: {"quota_set": {"ram": 51200}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:28.397354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.397947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.398485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.399457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.400014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.400562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.442882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91d5517c-c6ef-415b-861b-783c9acb2370 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.443410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91d5517c-c6ef-415b-861b-783c9acb2370 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.443853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91d5517c-c6ef-415b-861b-783c9acb2370 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.444745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91d5517c-c6ef-415b-861b-783c9acb2370 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.445205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91d5517c-c6ef-415b-861b-783c9acb2370 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.452146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91d5517c-c6ef-415b-861b-783c9acb2370 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.525210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:28.554029 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91d5517c-c6ef-415b-861b-783c9acb2370 tempest-QuotasAdminNegativeTest-297937679 tempest-QuotasAdminNegativeTest-297937679-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 200 len: 329 microversion: 2.1 time: 0.194533 Nov 02 13:26:28.554029 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1762/3235] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:26:28 2022] PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 329 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:28.560691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-872e53a9-77c5-41df-ab5f-10dd9a199e3d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:28.562559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-872e53a9-77c5-41df-ab5f-10dd9a199e3d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:28.569872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-872e53a9-77c5-41df-ab5f-10dd9a199e3d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.570357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-872e53a9-77c5-41df-ab5f-10dd9a199e3d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.570791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-872e53a9-77c5-41df-ab5f-10dd9a199e3d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.571519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-872e53a9-77c5-41df-ab5f-10dd9a199e3d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.571968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-872e53a9-77c5-41df-ab5f-10dd9a199e3d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.572395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-872e53a9-77c5-41df-ab5f-10dd9a199e3d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.597699 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-54f90a31-154e-4d07-87e7-f21c65c89467 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 347 microversion: 2.1 time: 0.327861 Nov 02 13:26:28.598366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1474/3236] 10.222.0.113 () {58 vars in 1159 bytes} [Wed Nov 2 13:26:28 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 347 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:28.603125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a9882323-2382-4049-a832-bce37c11109e tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Action: 'update', calling method: .version_select at 0x7fe786d61670>, body: {"quota_set": {"ram": 0}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:28.608226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a9882323-2382-4049-a832-bce37c11109e tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '0415c50b2cc0438ebbafe994fd21aca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3367685034206bee3f8148867c469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a9882323-2382-4049-a832-bce37c11109e tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Request method failure captured: Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: request: PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 HTTP/1.1 Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 25 Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_9DM3jxc8B3VUNX3JdlEz65uRJmgnZgaKwdw-xRcbtrp3lxkgCFBAAmcY46ZEZ23uYEV-nEQLWBQREOa_SGI5lyzR9PliluCcJjHHjzFx9mdwY5ofrWVR61DKZMwe1JXvySOTzT5rTMq85QdQQnqPE-8eW9wokRbPsNzVDK6qqTKk Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 3ac3367685034206bee3f8148867c469 Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:26:28.620332 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ac3367685034206bee3f8148867c469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3ac3367685034206bee3f8148867c469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3ac3367685034206bee3f8148867c469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3ac3367685034206bee3f8148867c469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 3ac3367685034206bee3f8148867c469 Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-385516814 Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-QuotasAdminNegativeTest-385516814-project Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0415c50b2cc0438ebbafe994fd21aca0 Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-QuotasAdminNegativeTest-385516814-project Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: {"quota_set": {"ram": 0}} Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 13:26:28.621953 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '3ac3367685034206bee3f8148867c469', 'body': {'quota_set': {'ram': 0}}} Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:26:28.622852 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.624116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:28.630356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:28.630356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:28.630356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 13:26:28.630356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 13:26:28.630356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 13:26:28.630356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:28.630356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a9882323-2382-4049-a832-bce37c11109e tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:28.630356 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a9882323-2382-4049-a832-bce37c11109e tempest-QuotasAdminNegativeTest-385516814 tempest-QuotasAdminNegativeTest-385516814-project] 10.222.0.113 "PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469" status: 403 len: 116 microversion: 2.1 time: 0.022862 Nov 02 13:26:28.630356 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1475/3237] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:26:28 2022] PUT /compute/v2.1/os-quota-sets/3ac3367685034206bee3f8148867c469 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:28.631107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:28.631107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:28.634993 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-872e53a9-77c5-41df-ab5f-10dd9a199e3d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 200 len: 190 microversion: 2.1 time: 0.087752 Nov 02 13:26:28.636370 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1763/3238] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:28 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 190 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:28.637296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.637952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.638399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.639161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.639593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.640366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.648873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:28.649878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:28.658005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.658508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.658956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.660290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.661126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.661825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.829069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:28.843677 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-34d1a1ed-e584-48af-8c08-7411b7ef0582 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1514 microversion: 2.1 time: 0.219761 Nov 02 13:26:28.844459 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1476/3239] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:28 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:28.869102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:28.870540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:28.879854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.880636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.881288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.882926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:28.883639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:28.884280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:28.978158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:28.989913 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-33010118-b8cf-4968-b98b-2fcf233b7b94 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.346751 Nov 02 13:26:28.990704 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1764/3240] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:28 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:29.026891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:29.029422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:29.047334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.048493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.049608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.050476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.051080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.051547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.105542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:29.116923 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8528215a-bc04-4572-adc3-be35c5666989 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 200 len: 1514 microversion: 2.1 time: 0.252950 Nov 02 13:26:29.117522 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1477/3241] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:28 2022] GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:29.139704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:29.140327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:29.146620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.147144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.147582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.148289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.148741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.149340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.304174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:29.324504 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3b3debc4-2c02-472d-ae17-ecc8b5f7698b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.292598 Nov 02 13:26:29.324504 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1765/3242] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:29 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:29.324504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:29.324504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:29.326588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:29.344569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.345415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.346079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.347767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.348735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.349712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.386619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:29.395665 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3d4143ae-4000-49be-b004-20f2f646fd0a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1514 microversion: 2.1 time: 0.259744 Nov 02 13:26:29.406031 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1478/3243] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:29 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:29.421113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:29.421871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:29.445673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.450776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.451430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.452515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.453512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.455535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.577652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:29.589881 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-983489b8-6d9e-4848-b0c2-93d7f38cf89f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1319 microversion: 2.1 time: 0.272398 Nov 02 13:26:29.606940 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1766/3244] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:29 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:29.614518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:29.615804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:29.622773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.623582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.624967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.626190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.627235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.627835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.697525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:29.710167 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba8f6a1a-72a5-4465-8b0e-d5abed07652c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.302711 Nov 02 13:26:29.711675 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1479/3245] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:29 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:29.717479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:29.724579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:29.725970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:29.736097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.737248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.737940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.745011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:29.752835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.759208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.759949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.766666 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84bb3490-4fea-4911-b4f1-b25b61035b60 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1233 microversion: 2.1 time: 0.159906 Nov 02 13:26:29.770463 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1767/3246] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:29 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1233 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:29.778707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:29.779615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:29.794188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.794689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.795239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.796102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.796556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.798124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:29.828222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:29.872014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:29.882834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:29.883761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:29.884749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:30.068449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:30.077828 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1121560-d2e3-4155-9fd4-64d2bea8bc5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.306049 Nov 02 13:26:30.081951 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1768/3247] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:29 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:30.209432 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6dc484ff-7d66-4e68-9a7e-f669b5f8ef81 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/detail" status: 200 len: 4525 microversion: 2.1 time: 0.496381 Nov 02 13:26:30.210810 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1480/3248] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:26:29 2022] GET /compute/v2.1/servers/detail => generated 4525 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:30.246231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:30.254176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:30.256051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:30.321184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1001552484", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0f49ae81-cfe3-4633-a929-56b3685d4723"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:30.402884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] validate_networks() for [('0f49ae81-cfe3-4633-a929-56b3685d4723', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:26:30.660858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:30.661503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:30.662127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:30.663089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:30.663909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:30.664525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:30.876033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:31.024523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-caee7791-d3ae-4c95-84fc-2e52ed7da1d1 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1016 microversion: 2.1 time: 0.789552 Nov 02 13:26:31.026294 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1769/3249] 10.222.0.113 () {58 vars in 1155 bytes} [Wed Nov 2 13:26:30 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1016 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:31.043938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:31.044901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:31.056390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:31.057835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:31.058785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:31.059816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:31.060431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:31.062606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:31.334709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:31.345286 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34422e63-481d-46d1-ade9-4c2a6b40e2e7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1319 microversion: 2.1 time: 0.317845 Nov 02 13:26:31.357009 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1770/3250] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:31 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:31.371084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:31.372153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:31.379406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:31.379884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:31.380327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:31.381034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:31.381491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:31.382531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:31.406432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:31.784419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:26:31.785672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:26:31.786394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:26:31.786817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:26:31.787266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:26:31.797488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:31.797981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:31.798425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:31.799200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:31.799669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:31.800402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:31.820528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:31.825900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for user fa31baf6e9c94e8393baad059544adb5 and project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:31.841142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:26:31.843397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:26:31.858610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:31.886051 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8133a705-c5cb-4d10-bc85-84fced0383f5 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1287 microversion: 2.1 time: 0.527519 Nov 02 13:26:31.887652 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1771/3251] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:31 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1287 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:31.897436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:31.907013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:31.907936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:31.908846 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c35c74e2-4b83-4d0a-8e05-5f37e01c87dc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.593045 Nov 02 13:26:31.913904 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1481/3252] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:26:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:26:31.914809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:31.915337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:31.915950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:31.917450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:31.918060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:31.918672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:31.932833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba46d358-6930-48be-8572-30edff4469f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:31.933733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ba46d358-6930-48be-8572-30edff4469f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:32.054181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:32.058442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba46d358-6930-48be-8572-30edff4469f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:32.068442 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba46d358-6930-48be-8572-30edff4469f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1219 microversion: 2.1 time: 0.143332 Nov 02 13:26:32.069517 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1482/3253] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:31 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:32.200480 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-267701c6-d98b-4417-80f0-3a3d6565ea63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1016 microversion: 2.1 time: 0.308399 Nov 02 13:26:32.203010 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1772/3254] 10.222.0.113 () {58 vars in 1217 bytes} [Wed Nov 2 13:26:31 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1016 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:32.216089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:32.222542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:32.223696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:32.232407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:32.233874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:32.234924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:32.236119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:32.236835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:32.238384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:32.375342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:32.376401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:32.392172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:32.395260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:32.396216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:32.397026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:32.397166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:32.398315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:32.398730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:32.495872 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-026e8591-63d8-4c57-90ef-dc90c2a6945e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1016 microversion: 2.1 time: 0.284111 Nov 02 13:26:32.505579 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1483/3255] 10.222.0.113 () {58 vars in 1201 bytes} [Wed Nov 2 13:26:32 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1016 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:32.515465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:32.545482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:32.546328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'name': '-498669815', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:32.565429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:32.569779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:32.570502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:32.571523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:32.573539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:32.574246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:32.796442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:32.887668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:32.909521 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cfda11c5-884b-403d-adc5-670109b27d2c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1319 microversion: 2.1 time: 0.540479 Nov 02 13:26:32.930095 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1773/3256] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:32 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:32.937569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-efce1d51-b61c-47ea-b183-3d822399a686 req-c5386fb1-e0fb-46aa-8abf-2e35726eaa03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265a2907-ff73-412a-ae89-aaafbddd4781", "name": "network-vif-plugged", "status": "completed", "tag": "b5ffdfa0-61de-4f95-b5dd-018ce78fa368"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:32.945678 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-52c09f16-5ed9-43ea-ad64-782e59cee6ba tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?name=-498669815" status: 200 len: 347 microversion: 2.1 time: 0.438938 Nov 02 13:26:32.949617 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1484/3257] 10.222.0.113 () {58 vars in 1161 bytes} [Wed Nov 2 13:26:32 2022] GET /compute/v2.1/servers?name=-498669815 => generated 347 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:32.966835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:32.968557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:32.971450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-efce1d51-b61c-47ea-b183-3d822399a686 req-c5386fb1-e0fb-46aa-8abf-2e35726eaa03 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:32.972815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-efce1d51-b61c-47ea-b183-3d822399a686 req-c5386fb1-e0fb-46aa-8abf-2e35726eaa03 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:32.973490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-efce1d51-b61c-47ea-b183-3d822399a686 req-c5386fb1-e0fb-46aa-8abf-2e35726eaa03 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:32.992658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:32.994793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:32.997024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:32.997793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:32.999668 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-efce1d51-b61c-47ea-b183-3d822399a686 req-c5386fb1-e0fb-46aa-8abf-2e35726eaa03 service nova] Creating event network-vif-plugged:b5ffdfa0-61de-4f95-b5dd-018ce78fa368 for instance 265a2907-ff73-412a-ae89-aaafbddd4781 on n-h1-858384-19 Nov 02 13:26:33.000031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.000502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.014243 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-efce1d51-b61c-47ea-b183-3d822399a686 req-c5386fb1-e0fb-46aa-8abf-2e35726eaa03 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082380 Nov 02 13:26:33.015654 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1774/3258] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:33.022169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.035660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:33.042851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:33.056613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.057358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.058087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.059212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.060502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.063747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.207904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:33.274788 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7d9621e-076a-496a-87b3-b28a309faa85 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1016 microversion: 2.1 time: 0.257685 Nov 02 13:26:33.275934 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1775/3259] 10.222.0.113 () {58 vars in 1159 bytes} [Wed Nov 2 13:26:33 2022] GET /compute/v2.1/servers?name=-instance => generated 1016 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:33.281105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.282653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:33.289797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.290500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.291134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.292192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.292994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.293946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.394602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:33.404116 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf037d47-c90a-4fea-90c1-8ee9c4e2c8a3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1271 microversion: 2.1 time: 0.126803 Nov 02 13:26:33.424928 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1776/3260] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:33 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:33.431895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.437814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:33.439144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-49866981', 'deleted': False, 'project_id': '72c5872e73074f02b439a49d48ee3a57'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:26:33.445378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.445988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.446523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.447660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.448044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.449095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.449856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:33.464096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51a8ae14-025c-443a-9b89-268954e5afb9 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.512794 Nov 02 13:26:33.464706 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1485/3261] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:32 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:33.584759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:26:33.663093 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c2e2cadc-99a7-4fe3-9386-3541a33d258a tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-49866981" status: 200 len: 347 microversion: 2.1 time: 0.236055 Nov 02 13:26:33.664013 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1777/3262] 10.222.0.113 () {58 vars in 1231 bytes} [Wed Nov 2 13:26:33 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-49866981 => generated 347 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:33.676636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.677222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:33.688617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.689450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.690228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.691601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.692309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.692756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.740710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:26:33.792325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3dc312e5-67b2-4574-bce1-454e8fb4cd7c tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.810500 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3dc312e5-67b2-4574-bce1-454e8fb4cd7c tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.212127 Nov 02 13:26:33.821556 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1486/3263] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:33 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:33.827080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-229ce97c-d4aa-4579-83a4-30788ba1eb0b tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.838779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:33.853947 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68135e58-8c83-417e-8cd4-5688a83d8a73 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 204 len: 0 microversion: 2.1 time: 0.181216 Nov 02 13:26:33.855315 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1778/3264] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:26:33 2022] DELETE /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:33.857872 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-229ce97c-d4aa-4579-83a4-30788ba1eb0b tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors" status: 200 len: 2622 microversion: 2.1 time: 0.034934 Nov 02 13:26:33.858708 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1487/3265] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:26:33 2022] GET /compute/v2.1/flavors => generated 2622 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:33.874968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.875775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:33.876067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7cab2d7a-4e7f-4dc8-8d25-13b1cf7a5437 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.889262 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7cab2d7a-4e7f-4dc8-8d25-13b1cf7a5437 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.017953 Nov 02 13:26:33.889538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.890065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.890587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.891624 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1488/3266] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:33 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:33.900776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.901490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.901957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.908995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-09e32ade-0d7f-4d8b-afe4-9dbed3c832e2 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.933151 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-09e32ade-0d7f-4d8b-afe4-9dbed3c832e2 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.029555 Nov 02 13:26:33.934484 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1489/3267] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:33 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:33.947658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:33.948432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:33.974166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.974753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.975307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:33.976059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:33.981224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:33.982854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:34.122466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:34.132413 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8791462-b741-4b15-941b-14056e6a9a63 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1520 microversion: 2.1 time: 0.273081 Nov 02 13:26:34.146176 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1779/3268] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:33 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:34.146176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-923ca617-f593-45ae-8c5f-1b529a81636a tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.175151 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-923ca617-f593-45ae-8c5f-1b529a81636a tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3227 microversion: 2.1 time: 0.040279 Nov 02 13:26:34.176938 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1780/3269] 10.222.0.113 () {58 vars in 1170 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3227 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:34.194351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0cbaecf-9318-495c-a63e-1356aef1a492 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.202280 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0cbaecf-9318-495c-a63e-1356aef1a492 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.012740 Nov 02 13:26:34.202861 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1781/3270] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:34.215606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4ec4a3df-9ac2-4885-8440-958f49f35e82 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.244188 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4ec4a3df-9ac2-4885-8440-958f49f35e82 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2157 microversion: 2.1 time: 0.032631 Nov 02 13:26:34.255317 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1782/3271] 10.222.0.113 () {58 vars in 1174 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2157 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:34.262740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a2bccd3-8c3e-4b3a-bd58-3dfb7bb12bf6 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.289037 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a2bccd3-8c3e-4b3a-bd58-3dfb7bb12bf6 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 479 microversion: 2.1 time: 0.029723 Nov 02 13:26:34.289757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:34.290705 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1783/3272] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 479 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:34.298082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:34.315221 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-821ccb06-217a-4afa-8d81-a3d81368d3bd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1319 microversion: 2.1 time: 0.379890 Nov 02 13:26:34.328206 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1490/3273] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:33 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:34.328401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6172d8f-86c9-41d0-945c-1539e6a29f86 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.342435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6172d8f-86c9-41d0-945c-1539e6a29f86 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.038078 Nov 02 13:26:34.343309 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1784/3274] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:34.357092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d964d048-605a-4447-a940-b3ffe8d515be tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.361337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-18bb2267-59cc-4aa9-819a-e7c5aca90e86 req-a8a2e022-2d7b-461f-9ddb-44e2920f8645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a3ef5b-a3a3-4dd8-b872-40a7323a6694", "tag": "8e2b9fb9-e70b-47c5-a0ce-76ed61df5150"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:34.388034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-18bb2267-59cc-4aa9-819a-e7c5aca90e86 req-a8a2e022-2d7b-461f-9ddb-44e2920f8645 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:34.388935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-18bb2267-59cc-4aa9-819a-e7c5aca90e86 req-a8a2e022-2d7b-461f-9ddb-44e2920f8645 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:34.390657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-18bb2267-59cc-4aa9-819a-e7c5aca90e86 req-a8a2e022-2d7b-461f-9ddb-44e2920f8645 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:34.400656 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d964d048-605a-4447-a940-b3ffe8d515be tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2514 microversion: 2.1 time: 0.048229 Nov 02 13:26:34.407833 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1491/3275] 10.222.0.113 () {58 vars in 1172 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2514 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:34.415670 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-18bb2267-59cc-4aa9-819a-e7c5aca90e86 req-a8a2e022-2d7b-461f-9ddb-44e2920f8645 service nova] Creating event network-changed:8e2b9fb9-e70b-47c5-a0ce-76ed61df5150 for instance 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 on n-h1-858384-19 Nov 02 13:26:34.418387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-69a15941-46fc-4253-a220-313f6353a952 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.424134 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-18bb2267-59cc-4aa9-819a-e7c5aca90e86 req-a8a2e022-2d7b-461f-9ddb-44e2920f8645 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065707 Nov 02 13:26:34.428221 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1785/3276] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:34.435443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.436440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:34.440913 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-69a15941-46fc-4253-a220-313f6353a952 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.026242 Nov 02 13:26:34.441975 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1492/3277] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:34.454162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:34.455685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:34.456867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:34.457899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:34.458407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a939263c-30c3-42af-bf63-893a7c6ff9ed tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.459229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:34.460093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:34.490395 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a939263c-30c3-42af-bf63-893a7c6ff9ed tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1681 microversion: 2.1 time: 0.039820 Nov 02 13:26:34.491633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1493/3278] 10.222.0.113 () {58 vars in 1149 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1681 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:34.497497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.498288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:34.506059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:34.507100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:34.507568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:34.508547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:34.509720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:34.510650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:34.588813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:34.598088 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a343d4fb-44d2-419a-9682-008f6c0328af tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1277 microversion: 2.1 time: 0.167481 Nov 02 13:26:34.598888 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1786/3279] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:34.603932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d6159eab-856d-47be-8f54-2e90e1f22063 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.625901 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d6159eab-856d-47be-8f54-2e90e1f22063 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.025802 Nov 02 13:26:34.626832 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1787/3280] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:34.649374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e48805f-f5e4-4853-bcb5-208f7051cde6 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.672419 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e48805f-f5e4-4853-bcb5-208f7051cde6 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1123 microversion: 2.1 time: 0.026948 Nov 02 13:26:34.680974 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1788/3281] 10.222.0.113 () {58 vars in 1153 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1123 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:34.688933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edd864c4-b363-42d7-8a0a-e718fd31ab8f tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.708673 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edd864c4-b363-42d7-8a0a-e718fd31ab8f tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 302 microversion: 2.1 time: 0.024386 Nov 02 13:26:34.709185 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1789/3282] 10.222.0.113 () {58 vars in 1145 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors?limit=1 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:34.725211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-831258ac-04b9-4eb0-997b-b49f28c3787d tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.739579 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-831258ac-04b9-4eb0-997b-b49f28c3787d tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.021868 Nov 02 13:26:34.740583 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1790/3283] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:34.754017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e544b63-0ee2-4e99-8a8f-abc36f637128 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.762053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:34.778648 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-404120a9-d505-4125-859c-938023a71f91 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.285233 Nov 02 13:26:34.781384 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1494/3284] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:34.824296 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e544b63-0ee2-4e99-8a8f-abc36f637128 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1314 microversion: 2.1 time: 0.074565 Nov 02 13:26:34.825246 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1791/3285] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors?marker=452 => generated 1314 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:34.839703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4e3c9a5-3c42-4669-80b2-a5ec6494df6b tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.866845 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c4e3c9a5-3c42-4669-80b2-a5ec6494df6b tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.030880 Nov 02 13:26:34.868528 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1495/3286] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:34.893158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82ff776a-2f32-47ff-850c-7a3a003814d2 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:34.906209 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82ff776a-2f32-47ff-850c-7a3a003814d2 tempest-FlavorsV2TestJSON-94815181 tempest-FlavorsV2TestJSON-94815181-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.014853 Nov 02 13:26:34.909982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1792/3287] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:34 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:35.165654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:35.167958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:35.191739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:35.193874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:35.194571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:35.195656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:35.197100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:35.197771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:35.341322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:35.342979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:35.357844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:35.358592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:35.359232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:35.361452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:35.363082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:35.364532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:35.573495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:35.585223 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f03637d8-3458-4547-b44f-6baeece6d401 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1520 microversion: 2.1 time: 0.429593 Nov 02 13:26:35.585912 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1496/3288] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:35 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1520 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:35.621387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:35.622409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:35.633381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:35.635273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:35.636702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:35.639150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:35.639932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:35.640765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:35.643417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:35.653590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-72f1d349-f977-4cb8-9f31-a01d894ccdee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1319 microversion: 2.1 time: 0.317689 Nov 02 13:26:35.665546 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1793/3289] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:35 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:35.806247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:35.806885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:35.819701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:35.820241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:35.820688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:35.821881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:35.822376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:35.822832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:35.925984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:35.943701 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60d8e2ef-a079-4943-a8a5-fe1e9e9c4bcc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.322283 Nov 02 13:26:35.945532 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1497/3290] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:35 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:36.418812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:36.428259 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c52eb964-a12e-4d9b-9449-d0f8468fa58e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.628107 Nov 02 13:26:36.428870 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1794/3291] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:35 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:36.614623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:36.615570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:36.624882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:36.625768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:36.626381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:36.627536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:36.629214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:36.630216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:36.679607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:36.680286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:36.687407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:36.688005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:36.688523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:36.689313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:36.689844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:36.690349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:36.845984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:36.860014 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c2f0c28-e361-48a2-9325-baa2d09cf146 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1505 microversion: 2.1 time: 0.185464 Nov 02 13:26:36.860658 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1795/3292] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:36 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:36.976357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:36.977433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:36.986943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:36.988408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:36.989803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:36.990789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:36.991474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:36.992079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:37.165277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:37.174173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a50a2f20-7be8-4906-8abb-0d8876fa74b2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.205194 Nov 02 13:26:37.176095 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1796/3293] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:36 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:37.389097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:37.403437 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d35a8102-0dfc-406e-8b06-f1c2b0b44f6e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1520 microversion: 2.1 time: 0.791438 Nov 02 13:26:37.404775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1498/3294] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:36 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1520 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:37.453262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:37.453885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:37.470783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:37.471575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:37.472841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:37.473955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:37.474592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:37.475227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:37.812449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:37.819582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:37.828058 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-310771f9-dfbc-4b29-bc27-9acea571ddc7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.378560 Nov 02 13:26:37.830616 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1797/3295] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:37 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:38.131610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9e77f1d4-fa96-4964-b1f6-23cc6b4af067 req-d30af31c-fb35-4884-9c3b-14807bbed9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5", "tag": "25f11a79-0efc-47bc-a160-afb66b8dfa92"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:38.156206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9e77f1d4-fa96-4964-b1f6-23cc6b4af067 req-d30af31c-fb35-4884-9c3b-14807bbed9e9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:38.156792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9e77f1d4-fa96-4964-b1f6-23cc6b4af067 req-d30af31c-fb35-4884-9c3b-14807bbed9e9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:38.157258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9e77f1d4-fa96-4964-b1f6-23cc6b4af067 req-d30af31c-fb35-4884-9c3b-14807bbed9e9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:38.184293 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9e77f1d4-fa96-4964-b1f6-23cc6b4af067 req-d30af31c-fb35-4884-9c3b-14807bbed9e9 service nova] Creating event network-changed:25f11a79-0efc-47bc-a160-afb66b8dfa92 for instance 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 on n-h2-858384-19 Nov 02 13:26:38.198852 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9e77f1d4-fa96-4964-b1f6-23cc6b4af067 req-d30af31c-fb35-4884-9c3b-14807bbed9e9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071564 Nov 02 13:26:38.199842 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1499/3296] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:38.204737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:38.205387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:38.243096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:38.243559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:38.245434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:38.246432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:38.249920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:38.255641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:38.435196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:38.435746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:38.451940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:38.458096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:38.458851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:38.460120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:38.462967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:38.463679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:38.528712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=20 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:38.697307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:38.707650 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b90ae88-9679-4686-9767-05465ee973d4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.511229 Nov 02 13:26:38.721500 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1798/3297] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:38 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:38.820224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:38.829114 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1f44738e-644d-4497-ab83-0f479e18831f tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 200 len: 1478 microversion: 2.1 time: 0.400089 Nov 02 13:26:38.834642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1500/3298] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:38 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 1478 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:38.859863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:38.861427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:38.874744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:38.875284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:38.876569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:38.878172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:38.879344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:38.880306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:39.015102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e70ab39f-6515-419a-b827-64cadf86b746 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Action: 'create', calling method: .version_select at 0x7fe787a98d30>, body: {"keypair": {"name": "tempest-keypair-1327910798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7VkfcVHo2m+i3VQt4aiao4UcUxF7sVZSqBgCzjUlmDcWi6J6ujtMS2Bf3jd84nFODxu+ZRhQ4mQ6JeuQQG9C2/xPBzMZukUFrrA1zU3/EjCry6PF8ZvbYeAnUhfPKVPg=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:39.034892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e70ab39f-6515-419a-b827-64cadf86b746 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:39.042344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e70ab39f-6515-419a-b827-64cadf86b746 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for user f490a8a37cd54ea1aaea658a69624924 and project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:39.073771 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e70ab39f-6515-419a-b827-64cadf86b746 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.350177 Nov 02 13:26:39.075047 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1799/3299] 10.222.0.113 () {62 vars in 1204 bytes} [Wed Nov 2 13:26:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 353 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:26:39.086925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-929f2e07-8051-4f08-95cc-1c22ac632db6 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe787745ee0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:39.096593 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-929f2e07-8051-4f08-95cc-1c22ac632db6 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "GET /compute/v2.1/os-keypairs/tempest-keypair-1327910798" status: 200 len: 513 microversion: 2.2 time: 0.014302 Nov 02 13:26:39.097968 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1800/3300] 10.222.0.113 () {60 vars in 1263 bytes} [Wed Nov 2 13:26:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1327910798 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:39.110929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c3ea5cd1-09d9-45a2-a7a5-05fc6bb7fa92 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe78772c820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:39.134180 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c3ea5cd1-09d9-45a2-a7a5-05fc6bb7fa92 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327910798" status: 204 len: 0 microversion: 2.2 time: 0.027594 Nov 02 13:26:39.135286 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1801/3301] 10.222.0.113 () {60 vars in 1266 bytes} [Wed Nov 2 13:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327910798 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:26:39.149360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-beba271d-f99b-4782-ab03-9cb63365a955 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Action: 'create', calling method: .version_select at 0x7fe7876239d0>, body: {"keypair": {"name": "tempest-keypair-840877930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCsRlDGbUQddP8FGHlncvERHLVD1vG1DrIZOTpvsmw/4BR1j9NWukuskbxCPIZ7kY+qKQSazeZ8o4cZpgX/sndiJdg0oIAmO4Y2CuZLoNPjYdvI2FXQ+vnDDilAA4nnBw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:39.171767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-beba271d-f99b-4782-ab03-9cb63365a955 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:39.178489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-beba271d-f99b-4782-ab03-9cb63365a955 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for user f490a8a37cd54ea1aaea658a69624924 and project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:39.198844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:39.210881 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-beba271d-f99b-4782-ab03-9cb63365a955 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.066818 Nov 02 13:26:39.211769 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1802/3302] 10.222.0.113 () {62 vars in 1204 bytes} [Wed Nov 2 13:26:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:26:39.232807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd14e808-91dc-4cd6-ba0e-ec7283c7db3b tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe78761e820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:39.257073 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd14e808-91dc-4cd6-ba0e-ec7283c7db3b tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-840877930" status: 204 len: 0 microversion: 2.2 time: 0.029411 Nov 02 13:26:39.258239 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1803/3303] 10.222.0.113 () {60 vars in 1263 bytes} [Wed Nov 2 13:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-840877930 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:39.264888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:39.275627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e32ab00-ed90-4fcf-94c4-ef4574efb457 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Action: 'create', calling method: .version_select at 0x7fe787642c10>, body: {"keypair": {"name": "tempest-keypair-1338129683", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:39.278653 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7bcf497e-b1c3-4373-93be-c3ce58bcccf4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.423334 Nov 02 13:26:39.279594 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1501/3304] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:38 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:39.294136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4e32ab00-ed90-4fcf-94c4-ef4574efb457 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:39.302177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4e32ab00-ed90-4fcf-94c4-ef4574efb457 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for user f490a8a37cd54ea1aaea658a69624924 and project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:39.331574 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e32ab00-ed90-4fcf-94c4-ef4574efb457 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.060667 Nov 02 13:26:39.332298 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1804/3305] 10.222.0.113 () {62 vars in 1204 bytes} [Wed Nov 2 13:26:39 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:26:39.343727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dfa1529e-4cc8-4cc7-9733-0320c4679bbc tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe78791de50>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:39.381356 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dfa1529e-4cc8-4cc7-9733-0320c4679bbc tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338129683" status: 204 len: 0 microversion: 2.2 time: 0.041559 Nov 02 13:26:39.390182 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1502/3306] 10.222.0.113 () {60 vars in 1266 bytes} [Wed Nov 2 13:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338129683 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:39.397496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-860539c0-56fe-4bb0-9e0e-80098e796e89 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Action: 'create', calling method: .version_select at 0x7fe78772c8b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-856667604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFnPvgvDszazZZs9Wj7MoVMmdW0/1vDCR4RIgIZPcYUT1RmnXEPVPsiUq49eJL5ajO/smAJQCKmftwXOoViFdjEmpdADkoFCKYHS/4nDFtb6BC2slzNcWL6LpOksN1CgA=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:39.478681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-860539c0-56fe-4bb0-9e0e-80098e796e89 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:39.490351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-860539c0-56fe-4bb0-9e0e-80098e796e89 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for user f490a8a37cd54ea1aaea658a69624924 and project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:39.544278 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-860539c0-56fe-4bb0-9e0e-80098e796e89 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.153432 Nov 02 13:26:39.545429 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1805/3307] 10.222.0.113 () {62 vars in 1204 bytes} [Wed Nov 2 13:26:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:26:39.560196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8061a171-12de-4d06-b908-62abd45f006c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16da775c-0a93-4c43-ac19-180d5568a850"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:39.562578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8061a171-12de-4d06-b908-62abd45f006c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:39.569579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5de50c6-4b33-4ca6-83cd-c954c63c542d tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Action: 'create', calling method: .version_select at 0x7fe787a8bd30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-521277860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRheKky5wcvs4pG02SQ8n3iM0ZWM614HPLmQIq71SMwC/txoV8Sb3XCu8O6FOidB6SXd8KCAPzfE4tUJEfgHcJiE8o83xdm4lpexHvzgWN7oYZbvSPxeY2K3nsYRjvihw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:39.575296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8061a171-12de-4d06-b908-62abd45f006c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:39.575798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8061a171-12de-4d06-b908-62abd45f006c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:39.576426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8061a171-12de-4d06-b908-62abd45f006c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:39.577165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8061a171-12de-4d06-b908-62abd45f006c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:39.577609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8061a171-12de-4d06-b908-62abd45f006c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:39.578032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8061a171-12de-4d06-b908-62abd45f006c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:39.591287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b5de50c6-4b33-4ca6-83cd-c954c63c542d tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:39.600628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b5de50c6-4b33-4ca6-83cd-c954c63c542d tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for user f490a8a37cd54ea1aaea658a69624924 and project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:39.631295 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b5de50c6-4b33-4ca6-83cd-c954c63c542d tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.065690 Nov 02 13:26:39.632511 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1806/3308] 10.222.0.113 () {62 vars in 1204 bytes} [Wed Nov 2 13:26:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:26:39.648491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-805c29c7-4850-4090-8d86-adee4dd8a551 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Action: 'create', calling method: .version_select at 0x7fe78f9603a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1202556451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBII8BCsAht6bnOSct9OOt/Gst1bFXNJxINufxbo7ihIIz2ZR6od+QmGecJf9V3GEyHdY0b8HHT4l59d8dU1DAYAzXM3qqrhejPt6KAhWlggS8cEZAKpQ7yCT/ERKsL1hNw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:39.674350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-805c29c7-4850-4090-8d86-adee4dd8a551 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:39.680713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-805c29c7-4850-4090-8d86-adee4dd8a551 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for user f490a8a37cd54ea1aaea658a69624924 and project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:39.713004 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-805c29c7-4850-4090-8d86-adee4dd8a551 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.070422 Nov 02 13:26:39.713629 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1807/3309] 10.222.0.113 () {62 vars in 1204 bytes} [Wed Nov 2 13:26:39 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 02 13:26:39.724717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4c72f71b-62e5-4591-ba9d-7916ce83490c tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe787642d30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:39.728647 n-d-858384-19 devstack@n-api.service[120928]: WARNING oslo_db.sqlalchemy.utils [None req-4c72f71b-62e5-4591-ba9d-7916ce83490c tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:26:39.734272 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4c72f71b-62e5-4591-ba9d-7916ce83490c tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.014007 Nov 02 13:26:39.734852 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1808/3310] 10.222.0.113 () {60 vars in 1182 bytes} [Wed Nov 2 13:26:39 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:39.747150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2ebcd8c-742d-4233-9dda-fe5bc0d18bb1 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe78772cca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:39.766604 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2ebcd8c-742d-4233-9dda-fe5bc0d18bb1 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1202556451" status: 204 len: 0 microversion: 2.2 time: 0.023426 Nov 02 13:26:39.767367 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1809/3311] 10.222.0.113 () {60 vars in 1326 bytes} [Wed Nov 2 13:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1202556451 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:26:39.773435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:39.774054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:39.781320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:39.781730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:39.782173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:39.782891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:39.783376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:39.783807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:39.974582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:39.982599 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6471279a-265f-4fa8-ad70-27be44ff4cc7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.214226 Nov 02 13:26:39.984944 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1810/3312] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:39 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:39.990462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f219e1f1-8b72-42bd-a538-9219281f4265 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe787817dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:40.013353 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f219e1f1-8b72-42bd-a538-9219281f4265 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-521277860" status: 204 len: 0 microversion: 2.2 time: 0.028610 Nov 02 13:26:40.014007 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1811/3313] 10.222.0.113 () {60 vars in 1323 bytes} [Wed Nov 2 13:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-521277860 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:40.020911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:40.021550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: c6391e9d-ce41-430a-bda7-69cb0a6273d9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:40.028178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:40.028657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:40.029096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:40.029862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:40.030765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:40.031394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:40.048497 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] HTTP exception thrown: Instance c6391e9d-ce41-430a-bda7-69cb0a6273d9 could not be found. Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Request method failure captured: Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 HTTP/1.1 Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-0801rEO4eT-K_VyqzLip5FfJDgVAYcxNCCL_PuC235XKKGkrV9QV2OeiwtXwH5LklgcVkMNhf-UsIsycFIuepHyBvtpG8EceusrnqtiAEiFWzaflYIZ8TvQcimJLKf8KWygVnws7GNNz20KCHvJqcWnBOqKMxgQ5HJVuxPu0ocy4 Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 72c5872e73074f02b439a49d48ee3a57 Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ListServerFiltersTestJSON-680551824 Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:40.051250 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ListServerFiltersTestJSON-680551824 Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 72c5872e73074f02b439a49d48ee3a57 Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-680551824 Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ListServerFiltersTestJSON-680551824-project Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 10a41deca4164409ae7fd55c52029c72 Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ListServerFiltersTestJSON-680551824-project Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance c6391e9d-ce41-430a-bda7-69cb0a6273d9 could not be found. Nov 02 13:26:40.053017 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'c6391e9d-ce41-430a-bda7-69cb0a6273d9'} Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6391e9d-ce41-430a-bda7-69cb0a6273d9 could not be found. Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:40.056543 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6391e9d-ce41-430a-bda7-69cb0a6273d9 could not be found. Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6391e9d-ce41-430a-bda7-69cb0a6273d9 could not be found. Nov 02 13:26:40.057969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:40.059158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Returning 404 to user: Instance c6391e9d-ce41-430a-bda7-69cb0a6273d9 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:40.059158 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af81be04-dcba-49bb-abf7-fd105997a80b tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9" status: 404 len: 111 microversion: 2.1 time: 0.037723 Nov 02 13:26:40.059158 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1812/3314] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:40 2022] GET /compute/v2.1/servers/c6391e9d-ce41-430a-bda7-69cb0a6273d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:40.059158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fcea68e7-9dc8-4df0-90f9-dd732c84f3ec tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe78f960f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:40.080906 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fcea68e7-9dc8-4df0-90f9-dd732c84f3ec tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-856667604" status: 204 len: 0 microversion: 2.2 time: 0.026193 Nov 02 13:26:40.082396 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1813/3315] 10.222.0.113 () {60 vars in 1323 bytes} [Wed Nov 2 13:26:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-856667604 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:40.090539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:40.091053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:40.099471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:40.099983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:40.100412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:40.101132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:40.101588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:40.102019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:40.131605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:26:40.213284 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5874d7c7-1cc3-4552-89b8-da2960bbd9c6 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 204 len: 0 microversion: 2.1 time: 0.129627 Nov 02 13:26:40.213888 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1814/3316] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:26:40 2022] DELETE /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:40.220726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d54156e-c589-4362-ac74-77d6a66e6c93 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Action: 'create', calling method: .version_select at 0x7fe787745dc0>, body: {"keypair": {"name": "tempest-keypair-2111640293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSTICXxdQs3xldqcEZ52LvRbpeY/rLYebmONqvNErpCUzhYL27v+QFz97UJYn2ti6KZeXRPAKLh3enL6Wx/ubXMYbSEQN9XaNLxYXMBTQEkVQ/AltxmY/FW3f0xo3KnWQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:40.236171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-3d54156e-c589-4362-ac74-77d6a66e6c93 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:40.242704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-3d54156e-c589-4362-ac74-77d6a66e6c93 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for user f490a8a37cd54ea1aaea658a69624924 and project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:40.269259 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3d54156e-c589-4362-ac74-77d6a66e6c93 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.053636 Nov 02 13:26:40.270190 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1815/3317] 10.222.0.113 () {62 vars in 1204 bytes} [Wed Nov 2 13:26:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:26:40.275924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:40.276286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:40.282917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:40.283492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:40.283950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:40.284712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:40.285310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:40.285737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:40.541195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:40.549312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ad98d075-0eac-42a9-a33b-5ad97d56ea20 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 200 len: 1520 microversion: 2.1 time: 0.278096 Nov 02 13:26:40.550578 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1816/3318] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:40 2022] GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:40.569992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-be2b275b-e03c-4368-8209-118d2227be80 req-91ccf041-2623-489e-9ca6-482c55115b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6391e9d-ce41-430a-bda7-69cb0a6273d9", "name": "network-vif-deleted", "tag": "e7911ead-a098-4b45-b540-132a702cf5f9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:40.580009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-be2b275b-e03c-4368-8209-118d2227be80 req-91ccf041-2623-489e-9ca6-482c55115b5e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:40.580475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-be2b275b-e03c-4368-8209-118d2227be80 req-91ccf041-2623-489e-9ca6-482c55115b5e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:40.580912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-be2b275b-e03c-4368-8209-118d2227be80 req-91ccf041-2623-489e-9ca6-482c55115b5e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:40.593070 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-be2b275b-e03c-4368-8209-118d2227be80 req-91ccf041-2623-489e-9ca6-482c55115b5e service nova] Creating event network-vif-deleted:e7911ead-a098-4b45-b540-132a702cf5f9 for instance c6391e9d-ce41-430a-bda7-69cb0a6273d9 on n-h1-858384-19 Nov 02 13:26:40.598825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-be2b275b-e03c-4368-8209-118d2227be80 req-91ccf041-2623-489e-9ca6-482c55115b5e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033782 Nov 02 13:26:40.599820 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1817/3319] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:40.606363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df2245f1-959d-4cfd-a583-f883799d9b33 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe78761e5e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:40.616138 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df2245f1-959d-4cfd-a583-f883799d9b33 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "GET /compute/v2.1/os-keypairs/tempest-keypair-2111640293" status: 200 len: 513 microversion: 2.2 time: 0.014939 Nov 02 13:26:40.616721 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1818/3320] 10.222.0.113 () {60 vars in 1263 bytes} [Wed Nov 2 13:26:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2111640293 => generated 513 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:40.621864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:40.622665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:40.630359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:40.630959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:40.631438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:40.632236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:40.632708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:40.633141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:40.820645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:40.830125 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9aef9ea2-2edf-47dd-8f4a-758cca42de5e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.212384 Nov 02 13:26:40.830777 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1819/3321] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:40 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:40.852702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fab9d289-f866-4e07-abe5-2dff36a04b27 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe787745dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:40.858081 n-d-858384-19 devstack@n-api.service[120928]: WARNING oslo_db.sqlalchemy.utils [None req-fab9d289-f866-4e07-abe5-2dff36a04b27 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:26:40.861492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:40.868272 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fab9d289-f866-4e07-abe5-2dff36a04b27 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.035580 Nov 02 13:26:40.868905 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1820/3322] 10.222.0.113 () {60 vars in 1182 bytes} [Wed Nov 2 13:26:40 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:40.882687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d9eba56-08ae-4efe-a7c8-d801bf600c4a tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe78761eee0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:40.906890 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d9eba56-08ae-4efe-a7c8-d801bf600c4a tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111640293" status: 204 len: 0 microversion: 2.2 time: 0.030559 Nov 02 13:26:40.907516 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1821/3323] 10.222.0.113 () {60 vars in 1266 bytes} [Wed Nov 2 13:26:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111640293 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:40.918108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Action: 'create', calling method: .version_select at 0x7fe787893e50>, body: {"keypair": {"name": "tempest-keypair-701820718", "type": "x509"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:40.935235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:40.940530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for user f490a8a37cd54ea1aaea658a69624924 and project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:40.963858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.processutils [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpno583i66/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpno583i66/temp.key -subj /CN=f490a8a37cd54ea1aaea658a69624924 -extensions v3_req_client {{(pid=120928) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 13:26:41.246936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.processutils [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpno583i66/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpno583i66/temp.key -subj /CN=f490a8a37cd54ea1aaea658a69624924 -extensions v3_req_client" returned: 0 in 0.283s {{(pid=120928) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 13:26:41.248654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.processutils [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpno583i66/temp.key -password pass: {{(pid=120928) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 13:26:41.273019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.processutils [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpno583i66/temp.key -password pass:" returned: 0 in 0.024s {{(pid=120928) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 13:26:41.328808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:26:41.335357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Getting quotas for user f490a8a37cd54ea1aaea658a69624924 and project cc789b7f029b4911b723071806d7453e. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:26:41.352143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a6c9861-b9f1-4689-bd9e-102be86e1465 tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.437992 Nov 02 13:26:41.353311 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1822/3324] 10.222.0.113 () {62 vars in 1203 bytes} [Wed Nov 2 13:26:40 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 440 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:41.358821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:41.359552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:41.367762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:41.368301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:41.368731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:41.369768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:41.370211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:41.370982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:41.756175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:41.764399 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c2742a8-2189-4e64-be2c-653cca686457 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.410079 Nov 02 13:26:41.765022 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1823/3325] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:41 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:41.770770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-32028cd9-ef41-42ff-be98-067d5a9d697d tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe78772c790>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:41.781101 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-32028cd9-ef41-42ff-be98-067d5a9d697d tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "GET /compute/v2.1/os-keypairs/tempest-keypair-701820718" status: 200 len: 1533 microversion: 2.2 time: 0.014781 Nov 02 13:26:41.781684 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1824/3326] 10.222.0.113 () {60 vars in 1260 bytes} [Wed Nov 2 13:26:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-701820718 => generated 1533 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:41.787635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:41.788251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:41.794406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:41.794891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:41.795362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:41.796069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:41.796519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:41.796945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:41.936748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:41.945620 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20b7cace-d655-4369-a2b9-819dfe2a7137 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 200 len: 1520 microversion: 2.1 time: 0.162844 Nov 02 13:26:41.946335 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1825/3327] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:41 2022] GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:41.950926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7c8d18e-dff1-4b69-8b80-732ca6c30f9f tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe787893a60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:41.954913 n-d-858384-19 devstack@n-api.service[120928]: WARNING oslo_db.sqlalchemy.utils [None req-d7c8d18e-dff1-4b69-8b80-732ca6c30f9f tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:26:41.966358 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d7c8d18e-dff1-4b69-8b80-732ca6c30f9f tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.018909 Nov 02 13:26:41.967071 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1826/3328] 10.222.0.113 () {60 vars in 1182 bytes} [Wed Nov 2 13:26:41 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:41.971806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:41.973094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:41.979278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:41.979759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:41.980191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:41.981080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:41.981534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:41.981988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:42.067570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=84 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:42.134173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:42.143255 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-37c2f924-6d35-44bf-9c11-aaeb547a04ce tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.174817 Nov 02 13:26:42.143891 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1827/3329] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:41 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:42.148936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff66e977-2002-4abe-b2b9-8b462e464fbf tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] Calling method '.version_select at 0x7fe787893820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:42.170242 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff66e977-2002-4abe-b2b9-8b462e464fbf tempest-KeyPairsV22TestJSON-2121122922 tempest-KeyPairsV22TestJSON-2121122922-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-701820718" status: 204 len: 0 microversion: 2.2 time: 0.025136 Nov 02 13:26:42.170859 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1828/3330] 10.222.0.113 () {60 vars in 1263 bytes} [Wed Nov 2 13:26:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-701820718 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:42.565285 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8061a171-12de-4d06-b908-62abd45f006c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.008024 Nov 02 13:26:42.567414 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1503/3331] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:26:39 2022] POST /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781/os-volume_attachments => generated 194 bytes in 3012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:42.789876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:42.791725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:42.799013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:42.800285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:42.800917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:42.801974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:42.802694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:42.803339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:42.970161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:42.972037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:42.984303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=33 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:42.985721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:42.990075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:42.993280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:42.993954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:42.998656 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-32e48f4a-68d2-4b70-a3ee-f207a89d7449 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.212323 Nov 02 13:26:42.999580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:43.000145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:43.000757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:43.017774 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1829/3332] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:42 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:43.168021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:43.168906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:43.179211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:43.180679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:43.181447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:43.182861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:43.183601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:43.184381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:43.468991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:43.494052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5fbb5374-e195-400e-ae6b-b787f6e080d4 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.331179 Nov 02 13:26:43.495569 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1830/3333] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:43 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:43.526863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:43.564352 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99755205-bdb2-4c2d-b1c0-338f2c7663df tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 200 len: 1520 microversion: 2.1 time: 0.598809 Nov 02 13:26:43.579584 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1504/3334] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:42 2022] GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 1520 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:44.027355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:44.028633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:44.030969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=24 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:44.046855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:44.047640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:44.048314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:44.049233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:44.051958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:44.052793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:44.474984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:44.484664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-04cdaddc-0c1e-4207-b377-80b267ec2c8e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.462148 Nov 02 13:26:44.486019 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1831/3335] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:44 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:44.520847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:44.521697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:44.537734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:44.539820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:44.541195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:44.542554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:44.545966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:44.546667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:44.591802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:44.592570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:44.602515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:44.608233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:44.608866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:44.609728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:44.610303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:44.611173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:45.021149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:45.021599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:45.037947 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-36ef6f69-3c79-4324-acaf-8ac03f41fe99 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.520286 Nov 02 13:26:45.038200 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71ef7a6a-e5d7-491f-9831-5aba2164401d tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 200 len: 1520 microversion: 2.1 time: 0.450935 Nov 02 13:26:45.038971 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1832/3336] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:44 2022] GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 1520 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:45.041444 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1505/3337] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:44 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:45.513222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:45.514277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:45.531442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:45.535638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:45.536845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:45.541611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:45.543556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:45.544500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:45.605097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c4d1a7fd-a2cf-4861-bcb2-26b9be38494e req-1cc3e346-7ca9-4f1e-b86a-af92f538bd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad394d79-7e89-4e24-9d74-0e8c597f7679", "name": "network-vif-deleted", "tag": "7b1abc42-2ca6-4734-87c3-beae5db4e4b6"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:45.641730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c4d1a7fd-a2cf-4861-bcb2-26b9be38494e req-1cc3e346-7ca9-4f1e-b86a-af92f538bd87 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:45.642244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c4d1a7fd-a2cf-4861-bcb2-26b9be38494e req-1cc3e346-7ca9-4f1e-b86a-af92f538bd87 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:45.642696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c4d1a7fd-a2cf-4861-bcb2-26b9be38494e req-1cc3e346-7ca9-4f1e-b86a-af92f538bd87 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:45.691336 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c4d1a7fd-a2cf-4861-bcb2-26b9be38494e req-1cc3e346-7ca9-4f1e-b86a-af92f538bd87 service nova] Creating event network-vif-deleted:7b1abc42-2ca6-4734-87c3-beae5db4e4b6 for instance ad394d79-7e89-4e24-9d74-0e8c597f7679 on n-h2-858384-19 Nov 02 13:26:45.701194 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c4d1a7fd-a2cf-4861-bcb2-26b9be38494e req-1cc3e346-7ca9-4f1e-b86a-af92f538bd87 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103808 Nov 02 13:26:45.706441 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1506/3338] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:45.776333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d7662bb7-2e06-4ae0-8af2-6049c2aa577f req-d935a105-135e-457d-8cce-96d3cd75aa70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3ef5b-a3a3-4dd8-b872-40a7323a6694", "name": "network-vif-plugged", "status": "completed", "tag": "8e2b9fb9-e70b-47c5-a0ce-76ed61df5150"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:45.793520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d7662bb7-2e06-4ae0-8af2-6049c2aa577f req-d935a105-135e-457d-8cce-96d3cd75aa70 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:45.795492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d7662bb7-2e06-4ae0-8af2-6049c2aa577f req-d935a105-135e-457d-8cce-96d3cd75aa70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:45.795923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d7662bb7-2e06-4ae0-8af2-6049c2aa577f req-d935a105-135e-457d-8cce-96d3cd75aa70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:45.825566 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d7662bb7-2e06-4ae0-8af2-6049c2aa577f req-d935a105-135e-457d-8cce-96d3cd75aa70 service nova] Creating event network-vif-plugged:8e2b9fb9-e70b-47c5-a0ce-76ed61df5150 for instance 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 on n-h1-858384-19 Nov 02 13:26:45.831984 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d7662bb7-2e06-4ae0-8af2-6049c2aa577f req-d935a105-135e-457d-8cce-96d3cd75aa70 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059261 Nov 02 13:26:45.833230 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1507/3339] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:46.062943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:46.063814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:46.075343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:46.075844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:46.076295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:46.077018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:46.077482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:46.077917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:46.170554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:46.171063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:46.173823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:46.174359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lazy-loading 'fault' on Instance uuid ad394d79-7e89-4e24-9d74-0e8c597f7679 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:26:46.208136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:46.231947 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ebfaaf1-3e69-4c67-b8bd-f69f342be9c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.722686 Nov 02 13:26:46.248407 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1833/3340] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:45 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:46.282701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:46.285881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:46.304677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:46.305777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:46.312649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:46.316802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:46.317491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:46.318342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:46.356029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:46.372363 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9523b2c-dcfd-447f-a925-9b73bf8bdd4e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 200 len: 1315 microversion: 2.1 time: 0.312937 Nov 02 13:26:46.374690 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1508/3341] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:46 2022] GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:46.916763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:46.943880 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1fa8338-5e56-4afb-a90d-604897b6e807 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.683008 Nov 02 13:26:46.944671 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1834/3342] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:46 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:47.265039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:47.266230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:47.275853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:47.276872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:47.277914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:47.278863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:47.279798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:47.280389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:47.398045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:47.399283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: ad394d79-7e89-4e24-9d74-0e8c597f7679] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:47.414467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:47.417049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:47.417710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:47.418687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:47.419101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:47.419745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:47.431381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:47.453451 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] HTTP exception thrown: Instance ad394d79-7e89-4e24-9d74-0e8c597f7679 could not be found. Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Request method failure captured: Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 HTTP/1.1 Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-0801rEO4eT-K_VyqzLip5FfJDgVAYcxNCCL_PuC235XKKGkrV9QV2OeiwtXwH5LklgcVkMNhf-UsIsycFIuepHyBvtpG8EceusrnqtiAEiFWzaflYIZ8TvQcimJLKf8KWygVnws7GNNz20KCHvJqcWnBOqKMxgQ5HJVuxPu0ocy4 Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 72c5872e73074f02b439a49d48ee3a57 Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ListServerFiltersTestJSON-680551824 Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:47.457624 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ListServerFiltersTestJSON-680551824 Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 72c5872e73074f02b439a49d48ee3a57 Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-680551824 Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ListServerFiltersTestJSON-680551824-project Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 10a41deca4164409ae7fd55c52029c72 Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ListServerFiltersTestJSON-680551824-project Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance ad394d79-7e89-4e24-9d74-0e8c597f7679 could not be found. Nov 02 13:26:47.459265 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'ad394d79-7e89-4e24-9d74-0e8c597f7679'} Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad394d79-7e89-4e24-9d74-0e8c597f7679 could not be found. Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:47.460172 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad394d79-7e89-4e24-9d74-0e8c597f7679 could not be found. Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad394d79-7e89-4e24-9d74-0e8c597f7679 could not be found. Nov 02 13:26:47.461599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:47.465387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Returning 404 to user: Instance ad394d79-7e89-4e24-9d74-0e8c597f7679 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:47.466618 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10318ac0-da07-4d3d-a526-51d8412d304e tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679" status: 404 len: 111 microversion: 2.1 time: 0.074258 Nov 02 13:26:47.479997 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1835/3343] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:47 2022] GET /compute/v2.1/servers/ad394d79-7e89-4e24-9d74-0e8c597f7679 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:47.492223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:47.498830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:47.519255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:47.520313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:47.521736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:47.522722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:47.525963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:47.526608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:47.569131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:47.590006 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-868a0059-5b32-45a8-83d1-ff3c5ee96018 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.328859 Nov 02 13:26:47.593146 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1509/3344] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:47 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:47.608196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:26:47.786046 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41177d9a-b3ab-4494-a546-dd549285a1ea tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 204 len: 0 microversion: 2.1 time: 0.302034 Nov 02 13:26:47.791491 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1836/3345] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:26:47 2022] DELETE /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:47.795757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:47.796609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:47.804084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:47.805256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:47.805890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:47.806787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:47.807448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:47.808048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:47.902778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7387994f-57f1-43e5-8749-c3e0d828ce6c req-4218490b-0cd6-4541-979a-5dfeba24aaef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5", "name": "network-vif-plugged", "status": "completed", "tag": "25f11a79-0efc-47bc-a160-afb66b8dfa92"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:47.925269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7387994f-57f1-43e5-8749-c3e0d828ce6c req-4218490b-0cd6-4541-979a-5dfeba24aaef service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:47.928190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7387994f-57f1-43e5-8749-c3e0d828ce6c req-4218490b-0cd6-4541-979a-5dfeba24aaef service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:47.928898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7387994f-57f1-43e5-8749-c3e0d828ce6c req-4218490b-0cd6-4541-979a-5dfeba24aaef service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:47.956339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7387994f-57f1-43e5-8749-c3e0d828ce6c req-4218490b-0cd6-4541-979a-5dfeba24aaef service nova] Creating event network-vif-plugged:25f11a79-0efc-47bc-a160-afb66b8dfa92 for instance 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 on n-h2-858384-19 Nov 02 13:26:47.963422 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7387994f-57f1-43e5-8749-c3e0d828ce6c req-4218490b-0cd6-4541-979a-5dfeba24aaef service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065274 Nov 02 13:26:47.964819 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1837/3346] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:26:48.000370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:48.001879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:48.028102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:48.028970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:48.030337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:48.030337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:48.031276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:48.031893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:48.148046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:48.173066 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5655ebb6-6945-4df0-93ee-e1ddf6380f01 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1520 microversion: 2.1 time: 0.381501 Nov 02 13:26:48.173686 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1510/3347] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:47 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:48.603883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:48.624452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:48.625175 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2631a29d-5281-49ea-bbb2-fe7993888824 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1329 microversion: 2.1 time: 0.653705 Nov 02 13:26:48.625869 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1838/3348] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:47 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1329 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:48.626106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:48.641399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:48.643509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:48.644168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:48.644988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:48.647065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:48.647526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:48.802208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:48.813622 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc6199ab-b4fb-47c4-bc1f-de7ef3d6b349 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.195912 Nov 02 13:26:48.818954 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1511/3349] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:48 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:49.206813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:49.208018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:49.217746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:49.218494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:49.219157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:49.220042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:49.220714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:49.221386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:49.480658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:49.491862 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71e3ea6d-fbb4-418c-87eb-4b217c8f2f44 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1520 microversion: 2.1 time: 0.298273 Nov 02 13:26:49.495468 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1839/3350] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:49 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:49.652312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:49.652924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:49.666224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:49.671339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:49.672083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:49.676128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:49.678928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:49.679660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:49.838114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:49.839553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:49.855305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:49.856170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:49.856868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:49.861075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:49.862551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:49.863311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:49.930317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:49.945389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:49.996134 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-61e94001-b47e-4c0f-8ab1-937311004050 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1526 microversion: 2.1 time: 0.336198 Nov 02 13:26:50.012703 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1512/3351] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:49 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1526 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:50.031443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:50.042595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:50.057179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:50.058347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:50.059789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:50.060794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:50.061477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:50.062128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:50.120128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:26:50.251610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:50.268986 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c9f2d90d-f2a9-4df1-ac02-f6b5eb286027 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1319 microversion: 2.1 time: 0.434448 Nov 02 13:26:50.272407 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1840/3352] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:49 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:50.323824 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7279e953-a335-492c-a0c8-107b64e9559e tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 204 len: 0 microversion: 2.1 time: 0.298003 Nov 02 13:26:50.329303 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1513/3353] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:26:50 2022] DELETE /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:50.334518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:50.335540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:50.344084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:50.345438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:50.345838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:50.347790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:50.348552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:50.349270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:50.525489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:50.526280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:50.534395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:50.539406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:50.540162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:50.541099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:50.541819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:50.542432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:50.569720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:50.580758 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3573d006-f755-419e-865b-8eedc0eeacd8 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1532 microversion: 2.1 time: 0.250250 Nov 02 13:26:50.586363 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1841/3354] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:50 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1532 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:50.959358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:50.967845 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a83bdc4-d3c8-4434-b721-1d275b87bf96 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1520 microversion: 2.1 time: 0.449329 Nov 02 13:26:50.969477 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1514/3355] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:50 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:51.303903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:51.305774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:51.311539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:51.312803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:51.313511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:51.314679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:51.316209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:51.316987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:51.344453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=36 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:51.512865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:51.524113 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a77afc2-69f5-43f3-afee-38be4e4f356c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1506 microversion: 2.1 time: 0.226125 Nov 02 13:26:51.539982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1842/3356] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:51 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:51.551679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04e57f6c-0ca2-400b-b39c-d2375078578b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:51.554853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04e57f6c-0ca2-400b-b39c-d2375078578b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:51.563685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e57f6c-0ca2-400b-b39c-d2375078578b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:51.564471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e57f6c-0ca2-400b-b39c-d2375078578b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:51.565199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e57f6c-0ca2-400b-b39c-d2375078578b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:51.583478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e57f6c-0ca2-400b-b39c-d2375078578b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:51.584638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e57f6c-0ca2-400b-b39c-d2375078578b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:51.585265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04e57f6c-0ca2-400b-b39c-d2375078578b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:51.613247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:51.613988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:51.631697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:51.632302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:51.632886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:51.633986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:51.634136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:51.635527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:51.661884 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04e57f6c-0ca2-400b-b39c-d2375078578b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.115051 Nov 02 13:26:51.663603 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1515/3357] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:51 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 13:26:51.819932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:51.829695 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6f0b9188-0f1d-436d-98ec-3b1239ae1d21 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1532 microversion: 2.1 time: 0.223105 Nov 02 13:26:51.831265 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1843/3358] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:51 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1532 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:51.999238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:51.999954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:52.008190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:52.008678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:52.009120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:52.009824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:52.010280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:52.010709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:52.579819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:52.591204 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-641b21d8-3a4e-4f72-813f-d0e444d9313c tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1520 microversion: 2.1 time: 0.601092 Nov 02 13:26:52.611182 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1516/3359] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:51 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1520 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:52.677563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10db82ba-2f40-4b45-a2e1-2ac903df7348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:52.679933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10db82ba-2f40-4b45-a2e1-2ac903df7348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:52.697368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10db82ba-2f40-4b45-a2e1-2ac903df7348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:52.697781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10db82ba-2f40-4b45-a2e1-2ac903df7348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:52.701023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10db82ba-2f40-4b45-a2e1-2ac903df7348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:52.701981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10db82ba-2f40-4b45-a2e1-2ac903df7348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:52.703515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10db82ba-2f40-4b45-a2e1-2ac903df7348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:52.704151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10db82ba-2f40-4b45-a2e1-2ac903df7348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:52.794878 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10db82ba-2f40-4b45-a2e1-2ac903df7348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.123483 Nov 02 13:26:52.796365 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1844/3360] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:52 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:26:52.858200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:52.859685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:52.874476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:52.875294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:52.876093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:52.877175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:52.878493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:52.879210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:53.138562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9c97ebdf-2e5d-49e1-8924-1b55a27bca0a req-645df7a3-40d4-4f1c-836a-92225339766d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7313a25-9bac-4ae5-a496-f446706ba248", "name": "network-vif-deleted", "tag": "14f12c2c-f18e-4850-908d-91c3b3bfe40c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:53.153396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c97ebdf-2e5d-49e1-8924-1b55a27bca0a req-645df7a3-40d4-4f1c-836a-92225339766d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:53.154254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c97ebdf-2e5d-49e1-8924-1b55a27bca0a req-645df7a3-40d4-4f1c-836a-92225339766d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:53.154968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c97ebdf-2e5d-49e1-8924-1b55a27bca0a req-645df7a3-40d4-4f1c-836a-92225339766d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:53.173169 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9c97ebdf-2e5d-49e1-8924-1b55a27bca0a req-645df7a3-40d4-4f1c-836a-92225339766d service nova] Creating event network-vif-deleted:14f12c2c-f18e-4850-908d-91c3b3bfe40c for instance f7313a25-9bac-4ae5-a496-f446706ba248 on n-h1-858384-19 Nov 02 13:26:53.180458 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9c97ebdf-2e5d-49e1-8924-1b55a27bca0a req-645df7a3-40d4-4f1c-836a-92225339766d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047257 Nov 02 13:26:53.182952 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1845/3361] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:53.381111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:53.405680 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ac283f6f-49f6-443a-be2c-78d2c6dcd8be tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1532 microversion: 2.1 time: 0.552904 Nov 02 13:26:53.413897 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1517/3362] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:52 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1532 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:53.621289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:53.621925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:53.629370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:53.629857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:53.630309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:53.631043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:53.631704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:53.632145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:53.803423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:53.804969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:53.805809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:53.806588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lazy-loading 'fault' on Instance uuid f7313a25-9bac-4ae5-a496-f446706ba248 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:26:53.808016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52fc274a-ed3f-4a20-a1c1-1b3cf3398162 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:53.810760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-52fc274a-ed3f-4a20-a1c1-1b3cf3398162 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:53.851143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52fc274a-ed3f-4a20-a1c1-1b3cf3398162 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:53.851896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52fc274a-ed3f-4a20-a1c1-1b3cf3398162 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:53.852453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52fc274a-ed3f-4a20-a1c1-1b3cf3398162 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:53.853516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52fc274a-ed3f-4a20-a1c1-1b3cf3398162 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:53.854095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52fc274a-ed3f-4a20-a1c1-1b3cf3398162 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:53.855656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52fc274a-ed3f-4a20-a1c1-1b3cf3398162 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:53.953122 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-52fc274a-ed3f-4a20-a1c1-1b3cf3398162 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.150146 Nov 02 13:26:53.954906 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1518/3363] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:53 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:26:54.037646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a41deca4164409ae7fd55c52029c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c5872e73074f02b439a49d48ee3a57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:54.052757 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a7228d56-f314-441a-997c-80b3037b2224 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 200 len: 1314 microversion: 2.1 time: 0.437148 Nov 02 13:26:54.072118 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1846/3364] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:53 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:54.439156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:54.440407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:54.450447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:54.451249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:54.451876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:54.452756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:54.453373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:54.453967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:54.496996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:54.497746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:54.498355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:54.498979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lazy-loading 'fault' on Instance uuid 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:26:54.605258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0935d05ae9274e9ba65f45b637e2ea66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e23d91dc30354049bb22462413ae5a15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:54.642484 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-09b5549e-1a65-4db2-b29a-79081d843ac7 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 200 len: 1319 microversion: 2.1 time: 0.206054 Nov 02 13:26:54.644420 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1519/3365] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:54 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:54.966188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91b0f953-fe28-45fa-883b-0de22e3053f2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:54.969417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91b0f953-fe28-45fa-883b-0de22e3053f2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:54.980709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91b0f953-fe28-45fa-883b-0de22e3053f2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:54.981204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91b0f953-fe28-45fa-883b-0de22e3053f2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:54.982057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91b0f953-fe28-45fa-883b-0de22e3053f2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:54.982717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91b0f953-fe28-45fa-883b-0de22e3053f2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:54.983401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91b0f953-fe28-45fa-883b-0de22e3053f2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:54.983988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91b0f953-fe28-45fa-883b-0de22e3053f2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.027170 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91b0f953-fe28-45fa-883b-0de22e3053f2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.064778 Nov 02 13:26:55.027877 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1847/3366] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:54 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:26:55.081494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:55.082267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] [instance: f7313a25-9bac-4ae5-a496-f446706ba248] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:55.090197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:55.090950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:55.091505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.092269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:55.092726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:55.093157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.108736 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] HTTP exception thrown: Instance f7313a25-9bac-4ae5-a496-f446706ba248 could not be found. Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Request method failure captured: Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 HTTP/1.1 Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm-0801rEO4eT-K_VyqzLip5FfJDgVAYcxNCCL_PuC235XKKGkrV9QV2OeiwtXwH5LklgcVkMNhf-UsIsycFIuepHyBvtpG8EceusrnqtiAEiFWzaflYIZ8TvQcimJLKf8KWygVnws7GNNz20KCHvJqcWnBOqKMxgQ5HJVuxPu0ocy4 Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 72c5872e73074f02b439a49d48ee3a57 Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ListServerFiltersTestJSON-680551824 Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:26:55.110787 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/72c5872e73074f02b439a49d48ee3a57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ListServerFiltersTestJSON-680551824 Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 72c5872e73074f02b439a49d48ee3a57 Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-680551824 Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ListServerFiltersTestJSON-680551824-project Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 10a41deca4164409ae7fd55c52029c72 Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ListServerFiltersTestJSON-680551824-project Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f7313a25-9bac-4ae5-a496-f446706ba248 could not be found. Nov 02 13:26:55.112918 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f7313a25-9bac-4ae5-a496-f446706ba248'} Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7313a25-9bac-4ae5-a496-f446706ba248 could not be found. Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:55.113684 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7313a25-9bac-4ae5-a496-f446706ba248 could not be found. Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7313a25-9bac-4ae5-a496-f446706ba248 could not be found. Nov 02 13:26:55.114863 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.116031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] Returning 404 to user: Instance f7313a25-9bac-4ae5-a496-f446706ba248 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:55.116031 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2c1160f4-cb6b-45cb-b0b9-579589652768 tempest-ListServerFiltersTestJSON-680551824 tempest-ListServerFiltersTestJSON-680551824-project] 10.222.0.113 "GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248" status: 404 len: 111 microversion: 2.1 time: 0.037595 Nov 02 13:26:55.117699 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1520/3367] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:55 2022] GET /compute/v2.1/servers/f7313a25-9bac-4ae5-a496-f446706ba248 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:55.232525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-59e25214-57a8-4fec-8cdb-abb3d5c07c0f req-fc8b794f-a5cb-4d2d-9189-1ea2a8a80fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3ef5b-a3a3-4dd8-b872-40a7323a6694", "name": "network-vif-deleted", "tag": "8e2b9fb9-e70b-47c5-a0ce-76ed61df5150"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:55.246081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-59e25214-57a8-4fec-8cdb-abb3d5c07c0f req-fc8b794f-a5cb-4d2d-9189-1ea2a8a80fb5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:55.246598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-59e25214-57a8-4fec-8cdb-abb3d5c07c0f req-fc8b794f-a5cb-4d2d-9189-1ea2a8a80fb5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:55.247040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-59e25214-57a8-4fec-8cdb-abb3d5c07c0f req-fc8b794f-a5cb-4d2d-9189-1ea2a8a80fb5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.260131 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-59e25214-57a8-4fec-8cdb-abb3d5c07c0f req-fc8b794f-a5cb-4d2d-9189-1ea2a8a80fb5 service nova] Creating event network-vif-deleted:8e2b9fb9-e70b-47c5-a0ce-76ed61df5150 for instance 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 on n-h1-858384-19 Nov 02 13:26:55.265247 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-59e25214-57a8-4fec-8cdb-abb3d5c07c0f req-fc8b794f-a5cb-4d2d-9189-1ea2a8a80fb5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038288 Nov 02 13:26:55.266473 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1848/3368] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:55.676375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:55.679777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 14a3ef5b-a3a3-4dd8-b872-40a7323a6694] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:55.692724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:55.693717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:55.694434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.695450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:55.696143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:55.696796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.714246 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Instance 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 could not be found. Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 HTTP/1.1 Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:55.716426 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 could not be found. Nov 02 13:26:55.717867 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '14a3ef5b-a3a3-4dd8-b872-40a7323a6694'} Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 could not be found. Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:55.718614 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 could not be found. Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 could not be found. Nov 02 13:26:55.720357 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.722848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Instance 14a3ef5b-a3a3-4dd8-b872-40a7323a6694 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:55.725121 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6c7fbdb6-12b8-4e76-8e6a-215747349b6c tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694" status: 404 len: 111 microversion: 2.1 time: 0.059815 Nov 02 13:26:55.726522 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1849/3369] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:55 2022] GET /compute/v2.1/servers/14a3ef5b-a3a3-4dd8-b872-40a7323a6694 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:55.736552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1667b46a-65a5-465c-b00f-0194283a4439 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '.version_select at 0x7fe786c633a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:55.774156 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-1667b46a-65a5-465c-b00f-0194283a4439 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Image not found. Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1667b46a-65a5-465c-b00f-0194283a4439 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/89204d3e-8d6b-4e89-aecf-4b0c231198f7 HTTP/1.1 Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:55.776819 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '89204d3e-8d6b-4e89-aecf-4b0c231198f7'} Nov 02 13:26:55.778379 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 89204d3e-8d6b-4e89-aecf-4b0c231198f7 to delete Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.779382 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 89204d3e-8d6b-4e89-aecf-4b0c231198f7 could not be found. Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:55.780802 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.782240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1667b46a-65a5-465c-b00f-0194283a4439 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:55.784718 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1667b46a-65a5-465c-b00f-0194283a4439 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/images/89204d3e-8d6b-4e89-aecf-4b0c231198f7" status: 404 len: 62 microversion: 2.1 time: 0.052053 Nov 02 13:26:55.785661 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1850/3370] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:55 2022] DELETE /compute/v2.1/images/89204d3e-8d6b-4e89-aecf-4b0c231198f7 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:26:55.794404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:55.798566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:55.814339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:55.820246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:55.820902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.824765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:55.825404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:55.826077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.861097 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 HTTP/1.1 Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:55.863949 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.865535 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '619ae303-88ce-4e79-a7da-111b4bd31c15'} Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:55.866656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.868121 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.876743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:55.878477 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e1782ff-18d0-4340-8639-29fbb90ccb12 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 404 len: 111 microversion: 2.1 time: 0.087917 Nov 02 13:26:55.881135 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1851/3371] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:26:55 2022] DELETE /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:26:55.890527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:55.894605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 619ae303-88ce-4e79-a7da-111b4bd31c15] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:55.909741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:55.910761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:55.911470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.914158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:55.917172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:55.918094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:55.963179 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 HTTP/1.1 Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:55.967709 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.969729 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '619ae303-88ce-4e79-a7da-111b4bd31c15'} Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:55.970626 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. Nov 02 13:26:55.972552 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:55.973969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Instance 619ae303-88ce-4e79-a7da-111b4bd31c15 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:55.976114 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79af6b36-b01f-44f5-b834-635c46bcb343 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15" status: 404 len: 111 microversion: 2.1 time: 0.091105 Nov 02 13:26:55.980295 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1852/3372] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:55 2022] GET /compute/v2.1/servers/619ae303-88ce-4e79-a7da-111b4bd31c15 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:26:55.991633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a630e7dc-9276-416a-8d93-7eacd8e92319 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '.version_select at 0x7fe786e41d30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:56.042808 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a630e7dc-9276-416a-8d93-7eacd8e92319 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460397315" status: 202 len: 0 microversion: 2.1 time: 0.057945 Nov 02 13:26:56.045614 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1853/3373] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:26:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460397315 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:26:56.048937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b545deca-03dc-458c-a2ef-bf4c1ae7ff4e tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe78fa8c700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-78998057", "description": "tempest-description-1711894649"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:56.056259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3221dbfe-cfc5-4933-8e25-886a22fd4f98 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:56.062112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3221dbfe-cfc5-4933-8e25-886a22fd4f98 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:56.079830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:56.083133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3221dbfe-cfc5-4933-8e25-886a22fd4f98 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:56.083645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3221dbfe-cfc5-4933-8e25-886a22fd4f98 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:56.084102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3221dbfe-cfc5-4933-8e25-886a22fd4f98 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:56.088335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3221dbfe-cfc5-4933-8e25-886a22fd4f98 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:56.090057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3221dbfe-cfc5-4933-8e25-886a22fd4f98 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:56.090521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3221dbfe-cfc5-4933-8e25-886a22fd4f98 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:56.182662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3221dbfe-cfc5-4933-8e25-886a22fd4f98 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.135612 Nov 02 13:26:56.183410 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1854/3374] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:56 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:26:56.776329 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b545deca-03dc-458c-a2ef-bf4c1ae7ff4e tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.112841 Nov 02 13:26:56.779069 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1521/3375] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:26:55 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:56.797789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2eabdb12-b778-4ac0-806e-8c229e0c188d tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe786e41b80>, body: {"security_group_rule": {"parent_group_id": "6a7bb7dd-8006-4563-b92f-a95898f141b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:57.106329 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2eabdb12-b778-4ac0-806e-8c229e0c188d tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.313311 Nov 02 13:26:57.120650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2ed8745-786a-4c80-a92a-89a8f7fa94da tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe78fa3f8b0>, body: {"security_group_rule": {"parent_group_id": "6a7bb7dd-8006-4563-b92f-a95898f141b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:57.121782 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1855/3376] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:26:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:57.196123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-714c7e81-529d-4863-9dca-f958fd11fa43 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:57.200372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-714c7e81-529d-4863-9dca-f958fd11fa43 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:57.208245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c7e81-529d-4863-9dca-f958fd11fa43 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:57.209061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c7e81-529d-4863-9dca-f958fd11fa43 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:57.209687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c7e81-529d-4863-9dca-f958fd11fa43 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:57.210682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c7e81-529d-4863-9dca-f958fd11fa43 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:57.211372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c7e81-529d-4863-9dca-f958fd11fa43 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:57.211973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c7e81-529d-4863-9dca-f958fd11fa43 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:57.258521 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-714c7e81-529d-4863-9dca-f958fd11fa43 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.067418 Nov 02 13:26:57.259501 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1856/3377] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:57 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:26:57.267403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:57.268104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:57.275826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:57.276322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:57.276765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:57.278324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:57.278793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:57.279295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:57.316308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:26:57.360923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:26:57.378617 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b2ed8745-786a-4c80-a92a-89a8f7fa94da tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] HTTP exception thrown: This rule already exists in group 6a7bb7dd-8006-4563-b92f-a95898f141b6 Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2ed8745-786a-4c80-a92a-89a8f7fa94da tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Request method failure captured: Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 138 Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAfheKaeH5FuS5aQaVJD3n4zXVCsHM9_x7eDVhWjunga2D-HIsF_DJanMEbCZ6y44wefeuYUbzXNlLGbUPIhvhSB86O3mQU5EXd7_Mbw3zYbmyllXOdQVMkwlnS7Z4Z0Uj9WQ1KX39ZtGMC59RKrlc_UIv7CAizK7dU3C8wJdNMfN0 Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:26:57.382486 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0ce5c7a5652441793591e3847455734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0ce5c7a5652441793591e3847455734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 538c80c1cde64def881af3846ab6758c Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: {"security_group_rule": {"parent_group_id": "6a7bb7dd-8006-4563-b92f-a95898f141b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 13:26:57.384439 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: exception: This rule already exists in group 6a7bb7dd-8006-4563-b92f-a95898f141b6 Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6a7bb7dd-8006-4563-b92f-a95898f141b6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 6a7bb7dd-8006-4563-b92f-a95898f141b6 Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:57.385516 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 6a7bb7dd-8006-4563-b92f-a95898f141b6 Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 6a7bb7dd-8006-4563-b92f-a95898f141b6 Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:57.387065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2ed8745-786a-4c80-a92a-89a8f7fa94da tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Returning 400 to user: This rule already exists in group 6a7bb7dd-8006-4563-b92f-a95898f141b6 {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:57.391432 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2ed8745-786a-4c80-a92a-89a8f7fa94da tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.272835 Nov 02 13:26:57.394000 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1522/3378] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:26:57 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:26:57.421111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c57298f-786f-4286-975e-b39cad755213 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Calling method '.version_select at 0x7fe78c212ee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:57.427985 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00e9063e-1d6c-4d26-b82a-85f0f6faa215 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 204 len: 0 microversion: 2.1 time: 0.166041 Nov 02 13:26:57.429433 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1857/3379] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:26:57 2022] DELETE /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:26:57.444868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:57.445585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:57.453053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:57.453838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:57.454433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:57.455187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:57.459982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:57.460520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:57.762440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:57.780050 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff6c4bc3-3015-406b-affd-b9bcb1f82399 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1557 microversion: 2.1 time: 0.345093 Nov 02 13:26:57.795147 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1858/3380] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:57 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1557 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:26:58.072114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6339b879-313a-44ba-8a68-aa2f14cb8067 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '.version_select at 0x7fe786ebed30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:58.099866 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c57298f-786f-4286-975e-b39cad755213 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-group-rules/8de03ed5-b347-4b72-9691-cb4ab8f05237" status: 202 len: 0 microversion: 2.1 time: 0.697640 Nov 02 13:26:58.112682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1523/3381] 10.222.0.113 () {58 vars in 1292 bytes} [Wed Nov 2 13:26:57 2022] DELETE /compute/v2.1/os-security-group-rules/8de03ed5-b347-4b72-9691-cb4ab8f05237 => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:26:58.129425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-86b09d14-f8d8-4e25-9a4d-b2e2d2607e48 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe786d61670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1562057028", "description": "tempest-description-1955514937"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:58.148243 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6339b879-313a-44ba-8a68-aa2f14cb8067 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Image not found. Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6339b879-313a-44ba-8a68-aa2f14cb8067 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/0c2bc0f1-2805-415c-b5c3-28c1c4c33d71 HTTP/1.1 Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:58.150176 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0c2bc0f1-2805-415c-b5c3-28c1c4c33d71'} Nov 02 13:26:58.151926 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0c2bc0f1-2805-415c-b5c3-28c1c4c33d71 to delete Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.152888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c2bc0f1-2805-415c-b5c3-28c1c4c33d71 could not be found. Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:58.154199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6339b879-313a-44ba-8a68-aa2f14cb8067 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:58.155514 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6339b879-313a-44ba-8a68-aa2f14cb8067 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/images/0c2bc0f1-2805-415c-b5c3-28c1c4c33d71" status: 404 len: 62 microversion: 2.1 time: 0.085539 Nov 02 13:26:58.156572 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1859/3382] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:58 2022] DELETE /compute/v2.1/images/0c2bc0f1-2805-415c-b5c3-28c1c4c33d71 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:26:58.162180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:58.162679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:58.171323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.171833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.172277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.173009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.173532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.174198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.201751 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 HTTP/1.1 Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:58.205956 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.207621 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '71c8c5ad-c591-4d99-8c79-4e3515b774a8'} Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:58.208621 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.210194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.212245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:58.212245 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-391a760f-3f05-4f83-9457-1a895238d843 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "DELETE /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 404 len: 111 microversion: 2.1 time: 0.050681 Nov 02 13:26:58.213697 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1860/3383] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:26:58 2022] DELETE /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:58.229024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:58.230435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] [instance: 71c8c5ad-c591-4d99-8c79-4e3515b774a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:58.253361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.254135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.256000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.258303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.267462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.268878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.295729 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] HTTP exception thrown: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Request method failure captured: Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 HTTP/1.1 Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm-JJusaLawx2eQenVB_ei2xUOvb8TVTaW901OwkXZZhQFohFOfHmpJZ_2xB0A1JjMsrgSyP6YNXdoQe4GU4KHYYFnJNoDJGRXm4IfXcr-hgQoSzgdhNimIeIBmZDS6N-pA_fszj8XTKrelnK2iXH9-ges-YZkeT1tYkM-eTWax7eio Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:58.297935 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e23d91dc30354049bb22462413ae5a15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e23d91dc30354049bb22462413ae5a15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e23d91dc30354049bb22462413ae5a15 Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-181425177 Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0935d05ae9274e9ba65f45b637e2ea66 Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-181425177-project Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.300075 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '71c8c5ad-c591-4d99-8c79-4e3515b774a8'} Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:58.301206 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. Nov 02 13:26:58.305005 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.306361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] Returning 404 to user: Instance 71c8c5ad-c591-4d99-8c79-4e3515b774a8 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:58.306361 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12b7b623-cc27-4290-bf27-8b442c694a85 tempest-ImagesOneServerNegativeTestJSON-181425177 tempest-ImagesOneServerNegativeTestJSON-181425177-project] 10.222.0.113 "GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8" status: 404 len: 111 microversion: 2.1 time: 0.084049 Nov 02 13:26:58.306361 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1861/3384] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:58 2022] GET /compute/v2.1/servers/71c8c5ad-c591-4d99-8c79-4e3515b774a8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:58.306361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d2c5a52d-a327-4c6e-9cd5-17d23bb78d47 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:58.308999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d2c5a52d-a327-4c6e-9cd5-17d23bb78d47 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:58.317048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2c5a52d-a327-4c6e-9cd5-17d23bb78d47 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.317843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2c5a52d-a327-4c6e-9cd5-17d23bb78d47 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.318290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2c5a52d-a327-4c6e-9cd5-17d23bb78d47 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.319017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2c5a52d-a327-4c6e-9cd5-17d23bb78d47 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.319518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2c5a52d-a327-4c6e-9cd5-17d23bb78d47 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.319953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2c5a52d-a327-4c6e-9cd5-17d23bb78d47 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.374307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d2c5a52d-a327-4c6e-9cd5-17d23bb78d47 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.072353 Nov 02 13:26:58.385580 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1862/3385] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:58 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:26:58.553343 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-86b09d14-f8d8-4e25-9a4d-b2e2d2607e48 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.436669 Nov 02 13:26:58.554527 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1524/3386] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:26:58 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:58.570925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-210fdd12-db01-48c5-8839-40040334981a tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe7875111f0>, body: {"security_group_rule": {"parent_group_id": "4fec0993-a02b-4bad-be10-8bd4ce20c2e1", "ip_protocol": "tcp", "from_port": 1251518400, "to_port": 22}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:58.682734 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-210fdd12-db01-48c5-8839-40040334981a tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] HTTP exception thrown: Invalid port range 1251518400:22. Former value cannot be greater than the later Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-210fdd12-db01-48c5-8839-40040334981a tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Request method failure captured: Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 146 Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAfheKaeH5FuS5aQaVJD3n4zXVCsHM9_x7eDVhWjunga2D-HIsF_DJanMEbCZ6y44wefeuYUbzXNlLGbUPIhvhSB86O3mQU5EXd7_Mbw3zYbmyllXOdQVMkwlnS7Z4Z0Uj9WQ1KX39ZtGMC59RKrlc_UIv7CAizK7dU3C8wJdNMfN0 Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:58.685626 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0ce5c7a5652441793591e3847455734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0ce5c7a5652441793591e3847455734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 538c80c1cde64def881af3846ab6758c Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: {"security_group_rule": {"parent_group_id": "4fec0993-a02b-4bad-be10-8bd4ce20c2e1", "ip_protocol": "tcp", "from_port": 1251518400, "to_port": 22}} Nov 02 13:26:58.686999 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid port range 1251518400:22. Former value cannot be greater than the later Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4fec0993-a02b-4bad-be10-8bd4ce20c2e1', 'ip_protocol': 'tcp', 'from_port': 1251518400, 'to_port': 22}}} Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1251518400:22. Former value cannot be greater than the later Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.687765 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1251518400:22. Former value cannot be greater than the later Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1251518400:22. Former value cannot be greater than the later Nov 02 13:26:58.689636 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.693664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-210fdd12-db01-48c5-8839-40040334981a tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Returning 400 to user: Invalid port range 1251518400:22. Former value cannot be greater than the later {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:58.698131 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-210fdd12-db01-48c5-8839-40040334981a tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.132496 Nov 02 13:26:58.704323 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1863/3387] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:26:58 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:26:58.716667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42df4511-e5e6-4dae-a863-fbea974b87bb tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe78fa7dd30>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1796281743", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:58.719015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-42df4511-e5e6-4dae-a863-fbea974b87bb tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] HTTP exception thrown: Security group id should be uuid Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42df4511-e5e6-4dae-a863-fbea974b87bb tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Request method failure captured: Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 131 Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAfheKaeH5FuS5aQaVJD3n4zXVCsHM9_x7eDVhWjunga2D-HIsF_DJanMEbCZ6y44wefeuYUbzXNlLGbUPIhvhSB86O3mQU5EXd7_Mbw3zYbmyllXOdQVMkwlnS7Z4Z0Uj9WQ1KX39ZtGMC59RKrlc_UIv7CAizK7dU3C8wJdNMfN0 Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:26:58.721371 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0ce5c7a5652441793591e3847455734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0ce5c7a5652441793591e3847455734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 538c80c1cde64def881af3846ab6758c Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1796281743", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:26:58.723403 n-d-858384-19 devstack@n-api.service[120929]: exception: Security group id should be uuid Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1796281743', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:58.724431 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42df4511-e5e6-4dae-a863-fbea974b87bb tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Returning 400 to user: Security group id should be uuid {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:58.725944 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-42df4511-e5e6-4dae-a863-fbea974b87bb tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016124 Nov 02 13:26:58.727163 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1525/3388] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:26:58 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:26:58.736248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f962e842-23e4-405b-b532-4e46af8a9eab tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe786e56ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-329080152", "description": "tempest-description-456324882"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:58.812201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:58.812832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:58.827808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.829759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.837625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:58.839449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:58.840143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:58.840738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:59.181902 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f962e842-23e4-405b-b532-4e46af8a9eab tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.450082 Nov 02 13:26:59.182527 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1864/3389] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:26:58 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:59.194930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:26:59.210624 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4bf98b7b-45fc-4713-a90b-d85666f4c858 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1557 microversion: 2.1 time: 0.405787 Nov 02 13:26:59.211850 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1526/3390] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:26:58 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1557 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:26:59.229020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6fb4fc2-245d-4f24-9b46-978bc03a4200 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe787e7c040>, body: {"security_group_rule": {"parent_group_id": "a4d9693a-5b2f-4c86-8592-12f8c938527f", "ip_protocol": "tempest-999-1988651894", "from_port": 22, "to_port": 22}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:59.376953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-512f6e5a-755d-459a-a054-69bd559870d8 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Action: 'create', calling method: .version_select at 0x7fe786e41c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1088899584", "metadata": {"Type": "work"}}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-512f6e5a-755d-459a-a054-69bd559870d8 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Request method failure captured: Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 122 Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAi_bRavj8piV1tLzJoD6xTCUtE_mCguf8XVzFjx0_CXbIyGsT7xs-I1FvInkIvn0p4JvJRM8i7FU1I1eIPuM0iT1m4yAU7awEUTxgdiN3HR5WJAvFb6U3lsVpapTXSDzlGMxHLX1irXXtAgVxZhz9SpbZ5pGEz2A0I4-kQuqBFAQo Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:59.382675 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0521efb8200949fd859137abeebe826d Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1088899584", "metadata": {"Type": "work"}}} Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:26:59.384137 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1088899584', 'metadata': {'Type': 'work'}}}} Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:59.384979 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:26:59.386856 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:26:59.388033 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 13:26:59.388033 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.388033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-512f6e5a-755d-459a-a054-69bd559870d8 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:59.388033 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-512f6e5a-755d-459a-a054-69bd559870d8 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.201037 Nov 02 13:26:59.388033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1865/3391] 10.222.0.113 () {60 vars in 1161 bytes} [Wed Nov 2 13:26:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:26:59.390322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-267d6e0c-a69f-46de-bf5b-62a2e4f83cc2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:59.393919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-267d6e0c-a69f-46de-bf5b-62a2e4f83cc2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:26:59.400436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267d6e0c-a69f-46de-bf5b-62a2e4f83cc2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:59.400928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267d6e0c-a69f-46de-bf5b-62a2e4f83cc2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:59.401371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267d6e0c-a69f-46de-bf5b-62a2e4f83cc2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:59.402076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267d6e0c-a69f-46de-bf5b-62a2e4f83cc2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:26:59.403011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267d6e0c-a69f-46de-bf5b-62a2e4f83cc2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:26:59.403640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-267d6e0c-a69f-46de-bf5b-62a2e4f83cc2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:26:59.428241 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f6fb4fc2-245d-4f24-9b46-978bc03a4200 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] HTTP exception thrown: Invalid IP protocol tempest-999-1988651894. Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6fb4fc2-245d-4f24-9b46-978bc03a4200 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Request method failure captured: Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 157 Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAfheKaeH5FuS5aQaVJD3n4zXVCsHM9_x7eDVhWjunga2D-HIsF_DJanMEbCZ6y44wefeuYUbzXNlLGbUPIhvhSB86O3mQU5EXd7_Mbw3zYbmyllXOdQVMkwlnS7Z4Z0Uj9WQ1KX39ZtGMC59RKrlc_UIv7CAizK7dU3C8wJdNMfN0 Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:26:59.429842 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0ce5c7a5652441793591e3847455734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0ce5c7a5652441793591e3847455734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 538c80c1cde64def881af3846ab6758c Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: {"security_group_rule": {"parent_group_id": "a4d9693a-5b2f-4c86-8592-12f8c938527f", "ip_protocol": "tempest-999-1988651894", "from_port": 22, "to_port": 22}} Nov 02 13:26:59.431600 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid IP protocol tempest-999-1988651894. Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a4d9693a-5b2f-4c86-8592-12f8c938527f', 'ip_protocol': 'tempest-999-1988651894', 'from_port': 22, 'to_port': 22}}} Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1988651894. Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.432624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1988651894. Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1988651894. Nov 02 13:26:59.434204 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.435975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6fb4fc2-245d-4f24-9b46-978bc03a4200 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Returning 400 to user: Invalid IP protocol tempest-999-1988651894. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:59.435975 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6fb4fc2-245d-4f24-9b46-978bc03a4200 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.218207 Nov 02 13:26:59.435975 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1527/3392] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:26:59 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:26:59.438796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-323d1137-b5f2-41f1-8a96-afbba6450a96 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Action: 'create', calling method: .version_select at 0x7fe78fa7d160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1694328837", "metadata": {"Type": "work"}}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-323d1137-b5f2-41f1-8a96-afbba6450a96 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Request method failure captured: Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 120 Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAi_bRavj8piV1tLzJoD6xTCUtE_mCguf8XVzFjx0_CXbIyGsT7xs-I1FvInkIvn0p4JvJRM8i7FU1I1eIPuM0iT1m4yAU7awEUTxgdiN3HR5WJAvFb6U3lsVpapTXSDzlGMxHLX1irXXtAgVxZhz9SpbZ5pGEz2A0I4-kQuqBFAQo Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:26:59.450207 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0521efb8200949fd859137abeebe826d Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1694328837", "metadata": {"Type": "work"}}} Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:26:59.451675 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1694328837', 'metadata': {'Type': 'work'}}}} Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi '0' Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:59.452778 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:26:59.454336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:26:59.461075 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 13:26:59.461075 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.461075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-323d1137-b5f2-41f1-8a96-afbba6450a96 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:59.461075 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-323d1137-b5f2-41f1-8a96-afbba6450a96 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019055 Nov 02 13:26:59.461075 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1528/3393] 10.222.0.113 () {60 vars in 1161 bytes} [Wed Nov 2 13:26:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:26:59.462646 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-267d6e0c-a69f-46de-bf5b-62a2e4f83cc2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.075369 Nov 02 13:26:59.462646 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1866/3394] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:26:59 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:26:59.473864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a12635e-fdc1-48b6-877d-51fd84415c40 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Action: 'create', calling method: .version_select at 0x7fe7875783a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-24285481", "metadata": {"Type": "work"}}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:59.481223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-822fd459-f3f5-4e68-8de0-cc16d2aff969 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe787e0c790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-759829830", "description": "tempest-description-734406387"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a12635e-fdc1-48b6-877d-51fd84415c40 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Request method failure captured: Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 117 Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAi_bRavj8piV1tLzJoD6xTCUtE_mCguf8XVzFjx0_CXbIyGsT7xs-I1FvInkIvn0p4JvJRM8i7FU1I1eIPuM0iT1m4yAU7awEUTxgdiN3HR5WJAvFb6U3lsVpapTXSDzlGMxHLX1irXXtAgVxZhz9SpbZ5pGEz2A0I4-kQuqBFAQo Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:59.484743 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0521efb8200949fd859137abeebe826d Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-24285481", "metadata": {"Type": "work"}}} Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:26:59.486103 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-24285481', 'metadata': {'Type': 'work'}}}} Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi '' Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:59.487642 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:26:59.489166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:26:59.490392 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 13:26:59.490392 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.492178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a12635e-fdc1-48b6-877d-51fd84415c40 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:59.493288 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a12635e-fdc1-48b6-877d-51fd84415c40 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029597 Nov 02 13:26:59.496579 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1867/3395] 10.222.0.113 () {60 vars in 1161 bytes} [Wed Nov 2 13:26:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:26:59.507013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-452b109f-5fb9-48c3-bafe-8ba7ad3aecd4 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Calling method '.version_select at 0x7fe7876c9940>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:59.555718 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-452b109f-5fb9-48c3-bafe-8ba7ad3aecd4 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] HTTP exception thrown: Volume tempest-invalid-1761134434 could not be found. Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-452b109f-5fb9-48c3-bafe-8ba7ad3aecd4 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Request method failure captured: Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1761134434 HTTP/1.1 Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAi_bRavj8piV1tLzJoD6xTCUtE_mCguf8XVzFjx0_CXbIyGsT7xs-I1FvInkIvn0p4JvJRM8i7FU1I1eIPuM0iT1m4yAU7awEUTxgdiN3HR5WJAvFb6U3lsVpapTXSDzlGMxHLX1irXXtAgVxZhz9SpbZ5pGEz2A0I4-kQuqBFAQo Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:59.590735 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0521efb8200949fd859137abeebe826d Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: exception: Volume tempest-invalid-1761134434 could not be found. Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'tempest-invalid-1761134434'} Nov 02 13:26:59.592464 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1761134434 could not be found. (HTTP 404) (Request-ID: req-4c4be5e4-e2f0-4291-a200-bc664c69493f) Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.593612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:26:59.595037 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1761134434 could not be found. Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:59.597465 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1761134434 could not be found. Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1761134434 could not be found. Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-452b109f-5fb9-48c3-bafe-8ba7ad3aecd4 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Returning 404 to user: Volume tempest-invalid-1761134434 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-452b109f-5fb9-48c3-bafe-8ba7ad3aecd4 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1761134434" status: 404 len: 99 microversion: 2.1 time: 0.090445 Nov 02 13:26:59.598922 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1868/3396] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:26:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1761134434 => generated 99 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:26:59.606122 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d9f7946c-a072-47ee-b9a9-d51e21fdd1a1 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004737 Nov 02 13:26:59.607579 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1869/3397] 10.222.0.113 () {58 vars in 1145 bytes} [Wed Nov 2 13:26:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 02 13:26:59.616878 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0269fd2c-3133-4a2f-90bd-c4b00b37dbe1 tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004017 Nov 02 13:26:59.617994 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1870/3398] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:26:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 02 13:26:59.628118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efa87d6f-bc0e-4bcf-bebe-6746225cbebb tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Calling method '.version_select at 0x7fe787817ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:59.668816 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-efa87d6f-bc0e-4bcf-bebe-6746225cbebb tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] HTTP exception thrown: Volume 2cecb008-eba9-46da-a379-7bfda3b5d071 could not be found. Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efa87d6f-bc0e-4bcf-bebe-6746225cbebb tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Request method failure captured: Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-volumes/2cecb008-eba9-46da-a379-7bfda3b5d071 HTTP/1.1 Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAi_bRavj8piV1tLzJoD6xTCUtE_mCguf8XVzFjx0_CXbIyGsT7xs-I1FvInkIvn0p4JvJRM8i7FU1I1eIPuM0iT1m4yAU7awEUTxgdiN3HR5WJAvFb6U3lsVpapTXSDzlGMxHLX1irXXtAgVxZhz9SpbZ5pGEz2A0I4-kQuqBFAQo Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:59.671310 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0521efb8200949fd859137abeebe826d Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: exception: Volume 2cecb008-eba9-46da-a379-7bfda3b5d071 could not be found. Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '2cecb008-eba9-46da-a379-7bfda3b5d071'} Nov 02 13:26:59.673158 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2cecb008-eba9-46da-a379-7bfda3b5d071 could not be found. (HTTP 404) (Request-ID: req-7fea9157-4cbd-499a-a0b1-cb78f8eb49fa) Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.674682 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:26:59.676021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2cecb008-eba9-46da-a379-7bfda3b5d071 could not be found. Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 13:26:59.677360 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2cecb008-eba9-46da-a379-7bfda3b5d071 could not be found. Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2cecb008-eba9-46da-a379-7bfda3b5d071 could not be found. Nov 02 13:26:59.678868 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.682108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efa87d6f-bc0e-4bcf-bebe-6746225cbebb tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Returning 404 to user: Volume 2cecb008-eba9-46da-a379-7bfda3b5d071 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:59.683653 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efa87d6f-bc0e-4bcf-bebe-6746225cbebb tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/2cecb008-eba9-46da-a379-7bfda3b5d071" status: 404 len: 109 microversion: 2.1 time: 0.060019 Nov 02 13:26:59.684994 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1871/3399] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:26:59 2022] DELETE /compute/v2.1/os-volumes/2cecb008-eba9-46da-a379-7bfda3b5d071 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:59.696196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b3bb5d2-34d7-4ad2-803d-fa867ad1113b tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Calling method '.version_select at 0x7fe787578ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:26:59.733974 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4b3bb5d2-34d7-4ad2-803d-fa867ad1113b tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] HTTP exception thrown: Volume 6f3e7050-0ede-4deb-b9cc-9e8ff12af81a could not be found. Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b3bb5d2-34d7-4ad2-803d-fa867ad1113b tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Request method failure captured: Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-volumes/6f3e7050-0ede-4deb-b9cc-9e8ff12af81a HTTP/1.1 Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAi_bRavj8piV1tLzJoD6xTCUtE_mCguf8XVzFjx0_CXbIyGsT7xs-I1FvInkIvn0p4JvJRM8i7FU1I1eIPuM0iT1m4yAU7awEUTxgdiN3HR5WJAvFb6U3lsVpapTXSDzlGMxHLX1irXXtAgVxZhz9SpbZ5pGEz2A0I4-kQuqBFAQo Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:59.738198 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e1e4ed7fb45846dc9ed497b476236070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e1e4ed7fb45846dc9ed497b476236070 Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesNegativeTest-711461863 Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0521efb8200949fd859137abeebe826d Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesNegativeTest-711461863-project Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: exception: Volume 6f3e7050-0ede-4deb-b9cc-9e8ff12af81a could not be found. Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '6f3e7050-0ede-4deb-b9cc-9e8ff12af81a'} Nov 02 13:26:59.740255 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f3e7050-0ede-4deb-b9cc-9e8ff12af81a could not be found. (HTTP 404) (Request-ID: req-70e80858-950c-405d-a67d-a7ccbbf3d73c) Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.741104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:26:59.742328 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f3e7050-0ede-4deb-b9cc-9e8ff12af81a could not be found. Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 13:26:59.744021 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f3e7050-0ede-4deb-b9cc-9e8ff12af81a could not be found. Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f3e7050-0ede-4deb-b9cc-9e8ff12af81a could not be found. Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b3bb5d2-34d7-4ad2-803d-fa867ad1113b tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] Returning 404 to user: Volume 6f3e7050-0ede-4deb-b9cc-9e8ff12af81a could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b3bb5d2-34d7-4ad2-803d-fa867ad1113b tempest-VolumesNegativeTest-711461863 tempest-VolumesNegativeTest-711461863-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/6f3e7050-0ede-4deb-b9cc-9e8ff12af81a" status: 404 len: 109 microversion: 2.1 time: 0.048697 Nov 02 13:26:59.745599 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1872/3400] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:26:59 2022] GET /compute/v2.1/os-volumes/6f3e7050-0ede-4deb-b9cc-9e8ff12af81a => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:26:59.876480 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-822fd459-f3f5-4e68-8de0-cc16d2aff969 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.404603 Nov 02 13:26:59.878243 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1529/3401] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:26:59 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:26:59.892147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00899e31-14ba-4553-9fe5-77206aad4ed8 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe7876c9430>, body: {"security_group_rule": {"parent_group_id": "554951f9-6417-4f67-b445-af0dd05cef86", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:26:59.994691 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-00899e31-14ba-4553-9fe5-77206aad4ed8 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00899e31-14ba-4553-9fe5-77206aad4ed8 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Request method failure captured: Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 138 Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAfheKaeH5FuS5aQaVJD3n4zXVCsHM9_x7eDVhWjunga2D-HIsF_DJanMEbCZ6y44wefeuYUbzXNlLGbUPIhvhSB86O3mQU5EXd7_Mbw3zYbmyllXOdQVMkwlnS7Z4Z0Uj9WQ1KX39ZtGMC59RKrlc_UIv7CAizK7dU3C8wJdNMfN0 Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:26:59.997509 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0ce5c7a5652441793591e3847455734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0ce5c7a5652441793591e3847455734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 538c80c1cde64def881af3846ab6758c Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: {"security_group_rule": {"parent_group_id": "554951f9-6417-4f67-b445-af0dd05cef86", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Nov 02 13:26:59.999402 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'security_group_rule': {'parent_group_id': '554951f9-6417-4f67-b445-af0dd05cef86', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:00.000568 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 13:27:00.002890 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.007039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00899e31-14ba-4553-9fe5-77206aad4ed8 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:00.007039 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00899e31-14ba-4553-9fe5-77206aad4ed8 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.112468 Nov 02 13:27:00.007852 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1873/3402] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:26:59 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:27:00.011420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5187cba5-0df2-4b47-89c2-62c3eb3619a9 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe78fa3fd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1493197763", "description": "tempest-description-1441294901"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:00.238787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:00.239659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:00.258498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:00.259211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:00.260142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:00.263960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:00.264783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:00.268535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:00.533301 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5187cba5-0df2-4b47-89c2-62c3eb3619a9 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.526083 Nov 02 13:27:00.553559 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1530/3403] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:27:00 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:00.574937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9176c862-3f3a-4c87-ad9a-fc904d49fac7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:00.589411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9176c862-3f3a-4c87-ad9a-fc904d49fac7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:00.604383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9176c862-3f3a-4c87-ad9a-fc904d49fac7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:00.605259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9176c862-3f3a-4c87-ad9a-fc904d49fac7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:00.606748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9176c862-3f3a-4c87-ad9a-fc904d49fac7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:00.607857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9176c862-3f3a-4c87-ad9a-fc904d49fac7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:00.608541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9176c862-3f3a-4c87-ad9a-fc904d49fac7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:00.609341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9176c862-3f3a-4c87-ad9a-fc904d49fac7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:00.672096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9176c862-3f3a-4c87-ad9a-fc904d49fac7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.115959 Nov 02 13:27:00.673192 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1531/3404] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:00 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:27:00.683935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52727d18-4ee0-4cee-a874-2319ec0b0ace tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe786d61700>, body: {"security_group_rule": {"parent_group_id": "d84dfd5b-fbbc-4be8-9482-12b8838ba7e1", "ip_protocol": "tcp", "from_port": 22, "to_port": 1834506404}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:00.857691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:00.867523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1e208a34-2ac1-4b6b-8b29-4683b55dcdf1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1557 microversion: 2.1 time: 0.633385 Nov 02 13:27:00.883707 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1874/3405] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:00 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1557 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:00.907838 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-52727d18-4ee0-4cee-a874-2319ec0b0ace tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] HTTP exception thrown: Invalid port range 22:1834506404. Valid TCP ports should be between 1-65535 Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52727d18-4ee0-4cee-a874-2319ec0b0ace tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Request method failure captured: Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 146 Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAfheKaeH5FuS5aQaVJD3n4zXVCsHM9_x7eDVhWjunga2D-HIsF_DJanMEbCZ6y44wefeuYUbzXNlLGbUPIhvhSB86O3mQU5EXd7_Mbw3zYbmyllXOdQVMkwlnS7Z4Z0Uj9WQ1KX39ZtGMC59RKrlc_UIv7CAizK7dU3C8wJdNMfN0 Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:27:00.910106 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0ce5c7a5652441793591e3847455734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0ce5c7a5652441793591e3847455734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 538c80c1cde64def881af3846ab6758c Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: {"security_group_rule": {"parent_group_id": "d84dfd5b-fbbc-4be8-9482-12b8838ba7e1", "ip_protocol": "tcp", "from_port": 22, "to_port": 1834506404}} Nov 02 13:27:00.911936 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid port range 22:1834506404. Valid TCP ports should be between 1-65535 Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd84dfd5b-fbbc-4be8-9482-12b8838ba7e1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1834506404}}} Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1834506404. Valid TCP ports should be between 1-65535 Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:00.912864 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1834506404. Valid TCP ports should be between 1-65535 Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1834506404. Valid TCP ports should be between 1-65535 Nov 02 13:27:00.917803 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.920338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52727d18-4ee0-4cee-a874-2319ec0b0ace tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Returning 400 to user: Invalid port range 22:1834506404. Valid TCP ports should be between 1-65535 {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:00.920338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-52727d18-4ee0-4cee-a874-2319ec0b0ace tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.236474 Nov 02 13:27:00.920338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1532/3406] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:27:00 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:27:00.923561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e197d11-d0e5-4ecd-96b8-a9be3c297101 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Action: 'create', calling method: .version_select at 0x7fe786e27430>, body: {"security_group_rule": {"parent_group_id": "17785781-b547-4cb4-bbe8-8a9271f82f20", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:00.955410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-734235f6-67be-4104-8b61-a036f06a606a req-04ebf1cd-eb5b-416b-add6-25f970938f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "265a2907-ff73-412a-ae89-aaafbddd4781", "name": "network-vif-deleted", "tag": "b5ffdfa0-61de-4f95-b5dd-018ce78fa368"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:00.968245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-734235f6-67be-4104-8b61-a036f06a606a req-04ebf1cd-eb5b-416b-add6-25f970938f51 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:00.969225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-734235f6-67be-4104-8b61-a036f06a606a req-04ebf1cd-eb5b-416b-add6-25f970938f51 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:00.969821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-734235f6-67be-4104-8b61-a036f06a606a req-04ebf1cd-eb5b-416b-add6-25f970938f51 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:00.986057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-6e197d11-d0e5-4ecd-96b8-a9be3c297101 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17785781-b547-4cb4-bbe8-8a9271f82f20 does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:27:00.986274 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-734235f6-67be-4104-8b61-a036f06a606a req-04ebf1cd-eb5b-416b-add6-25f970938f51 service nova] Creating event network-vif-deleted:b5ffdfa0-61de-4f95-b5dd-018ce78fa368 for instance 265a2907-ff73-412a-ae89-aaafbddd4781 on n-h1-858384-19 Nov 02 13:27:00.986878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-6e197d11-d0e5-4ecd-96b8-a9be3c297101 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Neutron security group 17785781-b547-4cb4-bbe8-8a9271f82f20 not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:27:00.988279 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6e197d11-d0e5-4ecd-96b8-a9be3c297101 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] HTTP exception thrown: Security group 17785781-b547-4cb4-bbe8-8a9271f82f20 does not exist Nov 02 13:27:00.988279 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-4af71138-bf07-42d3-8db9-b10cee418031'] Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e197d11-d0e5-4ecd-96b8-a9be3c297101 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Request method failure captured: Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 138 Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAfheKaeH5FuS5aQaVJD3n4zXVCsHM9_x7eDVhWjunga2D-HIsF_DJanMEbCZ6y44wefeuYUbzXNlLGbUPIhvhSB86O3mQU5EXd7_Mbw3zYbmyllXOdQVMkwlnS7Z4Z0Uj9WQ1KX39ZtGMC59RKrlc_UIv7CAizK7dU3C8wJdNMfN0 Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:27:00.991598 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0ce5c7a5652441793591e3847455734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0ce5c7a5652441793591e3847455734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 538c80c1cde64def881af3846ab6758c Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: {"security_group_rule": {"parent_group_id": "17785781-b547-4cb4-bbe8-8a9271f82f20", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 13:27:00.992918 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group 17785781-b547-4cb4-bbe8-8a9271f82f20 does not exist Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-4af71138-bf07-42d3-8db9-b10cee418031'] Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'security_group_rule': {'parent_group_id': '17785781-b547-4cb4-bbe8-8a9271f82f20', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:27:00.993648 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17785781-b547-4cb4-bbe8-8a9271f82f20 does not exist Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4af71138-bf07-42d3-8db9-b10cee418031'] Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Nov 02 13:27:00.995864 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17785781-b547-4cb4-bbe8-8a9271f82f20 does not exist Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4af71138-bf07-42d3-8db9-b10cee418031'] Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17785781-b547-4cb4-bbe8-8a9271f82f20 does not exist Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4af71138-bf07-42d3-8db9-b10cee418031'] Nov 02 13:27:00.997915 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17785781-b547-4cb4-bbe8-8a9271f82f20 does not exist Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4af71138-bf07-42d3-8db9-b10cee418031'] Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e197d11-d0e5-4ecd-96b8-a9be3c297101 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Returning 404 to user: Security group 17785781-b547-4cb4-bbe8-8a9271f82f20 does not exist Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-4af71138-bf07-42d3-8db9-b10cee418031'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:01.000138 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e197d11-d0e5-4ecd-96b8-a9be3c297101 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.074634 Nov 02 13:27:01.004049 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1875/3407] 10.222.0.113 () {60 vars in 1200 bytes} [Wed Nov 2 13:27:00 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:27:01.011474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c9cd013-14b4-4fea-a1a0-7b04d0c56b18 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Calling method '.version_select at 0x7fe786e41c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:01.015817 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-734235f6-67be-4104-8b61-a036f06a606a req-04ebf1cd-eb5b-416b-add6-25f970938f51 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059131 Nov 02 13:27:01.020438 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1533/3408] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:27:01.084937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-8c9cd013-14b4-4fea-a1a0-7b04d0c56b18 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 3214d02d-ccbf-4812-8353-b5057b56c3bc does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:27:01.085540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-8c9cd013-14b4-4fea-a1a0-7b04d0c56b18 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Neutron security group rule 3214d02d-ccbf-4812-8353-b5057b56c3bc not found {{(pid=120928) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 02 13:27:01.086071 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-8c9cd013-14b4-4fea-a1a0-7b04d0c56b18 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] HTTP exception thrown: Security group rule 3214d02d-ccbf-4812-8353-b5057b56c3bc does not exist Nov 02 13:27:01.086071 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-e7ee2f21-8f84-42f5-b4a1-233ec2142260'] Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c9cd013-14b4-4fea-a1a0-7b04d0c56b18 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Request method failure captured: Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-security-group-rules/3214d02d-ccbf-4812-8353-b5057b56c3bc HTTP/1.1 Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAfheKaeH5FuS5aQaVJD3n4zXVCsHM9_x7eDVhWjunga2D-HIsF_DJanMEbCZ6y44wefeuYUbzXNlLGbUPIhvhSB86O3mQU5EXd7_Mbw3zYbmyllXOdQVMkwlnS7Z4Z0Uj9WQ1KX39ZtGMC59RKrlc_UIv7CAizK7dU3C8wJdNMfN0 Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:27:01.088005 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0ce5c7a5652441793591e3847455734"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0ce5c7a5652441793591e3847455734"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0ce5c7a5652441793591e3847455734"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0ce5c7a5652441793591e3847455734 Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048 Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 538c80c1cde64def881af3846ab6758c Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-877013048-project Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group rule 3214d02d-ccbf-4812-8353-b5057b56c3bc does not exist Nov 02 13:27:01.089356 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-e7ee2f21-8f84-42f5-b4a1-233ec2142260'] Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '3214d02d-ccbf-4812-8353-b5057b56c3bc'} Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:01.090548 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 3214d02d-ccbf-4812-8353-b5057b56c3bc does not exist Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7ee2f21-8f84-42f5-b4a1-233ec2142260'] Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Nov 02 13:27:01.092012 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 3214d02d-ccbf-4812-8353-b5057b56c3bc does not exist Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7ee2f21-8f84-42f5-b4a1-233ec2142260'] Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 3214d02d-ccbf-4812-8353-b5057b56c3bc does not exist Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7ee2f21-8f84-42f5-b4a1-233ec2142260'] Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.093098 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 3214d02d-ccbf-4812-8353-b5057b56c3bc does not exist Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7ee2f21-8f84-42f5-b4a1-233ec2142260'] Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c9cd013-14b4-4fea-a1a0-7b04d0c56b18 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Returning 404 to user: Security group rule 3214d02d-ccbf-4812-8353-b5057b56c3bc does not exist Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-e7ee2f21-8f84-42f5-b4a1-233ec2142260'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:01.095600 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c9cd013-14b4-4fea-a1a0-7b04d0c56b18 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-group-rules/3214d02d-ccbf-4812-8353-b5057b56c3bc" status: 404 len: 199 microversion: 2.1 time: 0.088572 Nov 02 13:27:01.097682 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1876/3409] 10.222.0.113 () {58 vars in 1292 bytes} [Wed Nov 2 13:27:00 2022] DELETE /compute/v2.1/os-security-group-rules/3214d02d-ccbf-4812-8353-b5057b56c3bc => generated 199 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:27:01.104502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65f8cbcf-0981-45cb-b9c3-6daf22fadb80 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Calling method '.version_select at 0x7fe787c50670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:01.685029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8df7dc49-5267-4c93-bbd9-af2497989521 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:01.687450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8df7dc49-5267-4c93-bbd9-af2497989521 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:01.702884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df7dc49-5267-4c93-bbd9-af2497989521 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:01.703712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df7dc49-5267-4c93-bbd9-af2497989521 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:01.707804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df7dc49-5267-4c93-bbd9-af2497989521 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:01.708847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df7dc49-5267-4c93-bbd9-af2497989521 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:01.709526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df7dc49-5267-4c93-bbd9-af2497989521 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:01.710165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df7dc49-5267-4c93-bbd9-af2497989521 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:01.787925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8df7dc49-5267-4c93-bbd9-af2497989521 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.107206 Nov 02 13:27:01.790943 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1877/3410] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:01 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 13:27:01.895043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:01.900241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:01.937214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:01.937924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:01.940221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:01.942643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:01.946549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:01.947382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:02.161655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:02.186372 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-583cf88a-0235-4482-af66-5c2bd32afa21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1350 microversion: 2.1 time: 0.297111 Nov 02 13:27:02.195150 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1878/3411] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:01 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1350 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:02.503886 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-65f8cbcf-0981-45cb-b9c3-6daf22fadb80 tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/d84dfd5b-fbbc-4be8-9482-12b8838ba7e1" status: 202 len: 0 microversion: 2.1 time: 1.404399 Nov 02 13:27:02.505666 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1534/3412] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:27:01 2022] DELETE /compute/v2.1/os-security-groups/d84dfd5b-fbbc-4be8-9482-12b8838ba7e1 => generated 0 bytes in 1407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:02.513565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-62a84338-e1ea-47cb-91a9-3b2b86b4e19f tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Calling method '.version_select at 0x7fe786e56820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:02.803141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c320e7c6-8353-4437-8e30-bf0e9215bd26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:02.807509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c320e7c6-8353-4437-8e30-bf0e9215bd26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:02.834421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c320e7c6-8353-4437-8e30-bf0e9215bd26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:02.835071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c320e7c6-8353-4437-8e30-bf0e9215bd26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:02.835451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c320e7c6-8353-4437-8e30-bf0e9215bd26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:02.836195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c320e7c6-8353-4437-8e30-bf0e9215bd26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:02.836650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c320e7c6-8353-4437-8e30-bf0e9215bd26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:02.839366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c320e7c6-8353-4437-8e30-bf0e9215bd26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:02.923606 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c320e7c6-8353-4437-8e30-bf0e9215bd26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.125296 Nov 02 13:27:02.925478 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1535/3413] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:02 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:27:03.169160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-62a84338-e1ea-47cb-91a9-3b2b86b4e19f tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/554951f9-6417-4f67-b445-af0dd05cef86" status: 202 len: 0 microversion: 2.1 time: 0.659664 Nov 02 13:27:03.170199 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1879/3414] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:27:02 2022] DELETE /compute/v2.1/os-security-groups/554951f9-6417-4f67-b445-af0dd05cef86 => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:03.181441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60158e1a-8b92-4f21-94c2-4759f4efc63d tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Calling method '.version_select at 0x7fe78fa6e160>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:03.220101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:03.220961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:03.234102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:03.234570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:03.235023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:03.237907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:03.238591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:03.239045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:03.390974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:03.413039 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7aa03aea-2f59-447c-a92e-39918461bfb3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1350 microversion: 2.1 time: 0.197670 Nov 02 13:27:03.414502 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1880/3415] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:03 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1350 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:03.852881 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60158e1a-8b92-4f21-94c2-4759f4efc63d tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/a4d9693a-5b2f-4c86-8592-12f8c938527f" status: 202 len: 0 microversion: 2.1 time: 0.676606 Nov 02 13:27:03.856322 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1536/3416] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:27:03 2022] DELETE /compute/v2.1/os-security-groups/a4d9693a-5b2f-4c86-8592-12f8c938527f => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:03.866495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-86e6a987-a068-4f4f-8e03-fc9c23c1a4be tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Calling method '.version_select at 0x7fe786e56af0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:03.942402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5da0568d-08c5-4fe7-ac65-a026f0995dfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:03.954218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5da0568d-08c5-4fe7-ac65-a026f0995dfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:03.978661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:03.982002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5da0568d-08c5-4fe7-ac65-a026f0995dfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:03.985644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5da0568d-08c5-4fe7-ac65-a026f0995dfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:03.987923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5da0568d-08c5-4fe7-ac65-a026f0995dfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:03.991563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5da0568d-08c5-4fe7-ac65-a026f0995dfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:03.993583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5da0568d-08c5-4fe7-ac65-a026f0995dfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:03.994111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5da0568d-08c5-4fe7-ac65-a026f0995dfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:04.105594 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5da0568d-08c5-4fe7-ac65-a026f0995dfe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action" status: 200 len: 8203 microversion: 2.1 time: 0.170599 Nov 02 13:27:04.107414 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1537/3417] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:03 2022] POST /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5/action => generated 8203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:04.121098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:04.124604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:04.143507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:04.145479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:04.146165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:04.150946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:04.151952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:04.154545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:04.385050 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-86e6a987-a068-4f4f-8e03-fc9c23c1a4be tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/4fec0993-a02b-4bad-be10-8bd4ce20c2e1" status: 202 len: 0 microversion: 2.1 time: 0.523637 Nov 02 13:27:04.386186 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1881/3418] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:27:03 2022] DELETE /compute/v2.1/os-security-groups/4fec0993-a02b-4bad-be10-8bd4ce20c2e1 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:04.399384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee0f0d2c-e6c2-401e-a6dc-ece463b4a62c tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] Calling method '.version_select at 0x7fe786e56dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:04.789473 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee0f0d2c-e6c2-401e-a6dc-ece463b4a62c tempest-SecurityGroupRulesNegativeTestJSON-877013048 tempest-SecurityGroupRulesNegativeTestJSON-877013048-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/6a7bb7dd-8006-4563-b92f-a95898f141b6" status: 202 len: 0 microversion: 2.1 time: 0.399009 Nov 02 13:27:04.790575 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1882/3419] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:27:04 2022] DELETE /compute/v2.1/os-security-groups/6a7bb7dd-8006-4563-b92f-a95898f141b6 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:04.799755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:04.801793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:04.821074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:04.826301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:04.827213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:04.828553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:04.829671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:04.831268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:04.934813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:04.959425 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9fa5eb59-ee79-4f74-abeb-601df75b2a0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.843143 Nov 02 13:27:04.976262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1538/3420] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:04 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:05.008373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:05.011097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:05.018547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:05.027710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:05.028219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:05.029013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:05.029653 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-376cbd95-1be7-441e-acf5-a2818e00f520 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1350 microversion: 2.1 time: 0.237249 Nov 02 13:27:05.029935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:05.030445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:05.030889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:05.039508 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1883/3421] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:04 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1350 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:05.271455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:05.287170 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e16db75c-b6aa-4358-a343-26c2f0665d18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.285733 Nov 02 13:27:05.291228 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1539/3422] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:04 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:05.322009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:05.322835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:05.338907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:05.339855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:05.340652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:05.341739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:05.342355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:05.343686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:05.793395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:05.805243 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-36e231b4-766e-4d09-b4f0-a524969f1cea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.492746 Nov 02 13:27:05.805937 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1884/3423] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:05 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:05.829907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:05.831146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:05.839265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:05.839771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:05.840219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:05.840931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:05.841390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:05.841821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:06.057683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:06.058547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:06.071719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:06.072638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:06.074641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:06.075824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:06.076522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:06.076646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:06.077146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:06.087086 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2dc6f8bf-6593-4839-bcbd-9d93f2d33805 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.261518 Nov 02 13:27:06.091131 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1540/3424] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:05 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:06.114373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:06.117865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:06.133332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:06.134850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:06.135753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:06.137915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:06.139392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:06.140708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:06.169750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:06.185975 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f7fd01d-462d-43c3-8ad5-271fb33829fb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1350 microversion: 2.1 time: 0.132200 Nov 02 13:27:06.189873 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1885/3425] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:06 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:06.209992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:06.224022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Locking {{(pid=120929) lock /opt/stack/nova/nova/compute/api.py:4846}} Nov 02 13:27:06.324032 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d5770dc-f654-43b7-8236-59ea1b19b9fe tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.213847 Nov 02 13:27:06.325360 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1541/3426] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:06 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:06.335918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:06.336927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:06.348892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:06.350080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:06.352899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:06.356429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:06.357215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:06.357824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.088121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:07.098928 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b816027-91f0-4a1c-9dac-eb66336fcf71 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.769195 Nov 02 13:27:07.101439 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1886/3427] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:06 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:07.124365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17c3114c-f30a-4f88-9ec7-682a2a445f5b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:07.137639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c3114c-f30a-4f88-9ec7-682a2a445f5b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.141566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c3114c-f30a-4f88-9ec7-682a2a445f5b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.142194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c3114c-f30a-4f88-9ec7-682a2a445f5b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.179835 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-17c3114c-f30a-4f88-9ec7-682a2a445f5b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] HTTP exception thrown: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 is locked Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17c3114c-f30a-4f88-9ec7-682a2a445f5b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Request method failure captured: Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action HTTP/1.1 Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 15 Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm6io6tF-FtuHS0PIEx8WBk2Wt554RWt5TmvXvpV-_ZV4TeWwlsjkPqRSQjlI7PmR7zwqYtUKC3M16qm-e8e_Zylrzb09VgeuR3gmq3vpnrryPrGKVgGkKZwswfheyIrDEpUdlZKsyjADDwsXbwx6CT8jxHfty333F9KEw09H8QZcjw Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:27:07.181663 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: fa31baf6e9c94e8393baad059544adb5 Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: {"os-stop": {}} Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 is locked Nov 02 13:27:07.183309 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'cfdfca83-c725-4ad1-9005-3d100bb279e7', 'body': {'os-stop': {}}} Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 is locked Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Nov 02 13:27:07.184234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 is locked Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 is locked Nov 02 13:27:07.185553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:07.187592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17c3114c-f30a-4f88-9ec7-682a2a445f5b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Returning 409 to user: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 is locked {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:07.188679 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17c3114c-f30a-4f88-9ec7-682a2a445f5b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 409 len: 107 microversion: 2.1 time: 0.069481 Nov 02 13:27:07.190578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1542/3428] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:07 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 107 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:27:07.199355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:07.200237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:07.213977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.214686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.216427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.218356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.218640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:07.219597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:07.220336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.222248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.237707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.239678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.240646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.245092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.247949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.249971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.336081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:07.341012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Unlocking {{(pid=120928) unlock /opt/stack/nova/nova/compute/api.py:4875}} Nov 02 13:27:07.345074 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-85bf5a11-5045-44a0-86bf-891b13a78462 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1350 microversion: 2.1 time: 0.136639 Nov 02 13:27:07.347773 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1543/3429] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:07 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:07.442814 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a535d8c7-d738-4dc4-b0c7-ced93984a27e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.247774 Nov 02 13:27:07.444882 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1887/3430] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:07 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:07.452588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a742b5a9-a376-4f40-b3ef-2a8991a9dba1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:07.459880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a742b5a9-a376-4f40-b3ef-2a8991a9dba1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.460593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a742b5a9-a376-4f40-b3ef-2a8991a9dba1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.461215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a742b5a9-a376-4f40-b3ef-2a8991a9dba1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.492200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a742b5a9-a376-4f40-b3ef-2a8991a9dba1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Going to try to stop instance {{(pid=120929) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:27:07.576975 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a742b5a9-a376-4f40-b3ef-2a8991a9dba1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.127247 Nov 02 13:27:07.582570 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1544/3431] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:07 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:07.587250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:07.587880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:07.599430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.600642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.601108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:07.603409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:07.605319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:07.605956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:08.005141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:08.020259 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b4591584-5bdd-4f09-8410-bff81960ca0c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.436997 Nov 02 13:27:08.025640 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1888/3432] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:07 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:08.384052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:08.385519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:08.410894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:08.411626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:08.412304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:08.416060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:08.425701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:08.427344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:08.527106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:08.530680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:08.531302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:08.533259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lazy-loading 'fault' on Instance uuid 265a2907-ff73-412a-ae89-aaafbddd4781 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:27:08.617051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:08.630063 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-82c990b5-3e01-46aa-87b3-25714d473636 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1355 microversion: 2.1 time: 0.259221 Nov 02 13:27:08.637943 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1545/3433] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:08 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1355 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:08.893495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-567cd976-3f81-423b-bbbc-3f8513e70192 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Action: 'create', calling method: .version_select at 0x7fe786e56dc0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpeViI7SQe2a4CHviX1u+Htc6zHHOmAFsCrxk8sW617Se5bvvR6kGUBGKR80jvnMOcyWZlnD045FRAZosTNz2g/89cJup72eMNlJWJVmCgH3C6eNwYyOxAWBTSEL1sk5w=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-567cd976-3f81-423b-bbbc-3f8513e70192 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Request method failure captured: Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 257 Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAs477tx9wB2zWvjNExdAVHm9g1n3n3sv5sKUCvzqSZDpbIZeVXVyWWg5LJPiDIS48wkQfa2QVKPjBxgNpd3OCNFtsZe1-dYYH4E5RU0sSZHGGc3o3c_dM-qTdW4oFGNaKR0iDbAW5cYhx4yE0AcHzwuHu05dBkxJyfzdECHjpBeYI Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:27:08.899527 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:27:08.900838 n-d-858384-19 devstack@n-api.service[120928]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpeViI7SQe2a4CHviX1u+Htc6zHHOmAFsCrxk8sW617Se5bvvR6kGUBGKR80jvnMOcyWZlnD045FRAZosTNz2g/89cJup72eMNlJWJVmCgH3C6eNwYyOxAWBTSEL1sk5w=="}} Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpeViI7SQe2a4CHviX1u+Htc6zHHOmAFsCrxk8sW617Se5bvvR6kGUBGKR80jvnMOcyWZlnD045FRAZosTNz2g/89cJup72eMNlJWJVmCgH3C6eNwYyOxAWBTSEL1sk5w=='}}} Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:08.901536 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'minLength': 1, Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:08.902587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:27:08.910194 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:27:08.913052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 13:27:08.913052 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:08.913052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-567cd976-3f81-423b-bbbc-3f8513e70192 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:08.913052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-567cd976-3f81-423b-bbbc-3f8513e70192 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.332167 Nov 02 13:27:08.913052 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1889/3434] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:27:08 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 334 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:27:08.919782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9342419-a83c-4f49-a903-7dc9b0d8f7b2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Action: 'create', calling method: .version_select at 0x7fe78fa86e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-339344899", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:08.945854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f9342419-a83c-4f49-a903-7dc9b0d8f7b2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:08.951832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f9342419-a83c-4f49-a903-7dc9b0d8f7b2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for user 0ff476fbbfa04880b772989f45759cc3 and project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:08.982287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f9342419-a83c-4f49-a903-7dc9b0d8f7b2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9342419-a83c-4f49-a903-7dc9b0d8f7b2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Request method failure captured: Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 2166 Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAs477tx9wB2zWvjNExdAVHm9g1n3n3sv5sKUCvzqSZDpbIZeVXVyWWg5LJPiDIS48wkQfa2QVKPjBxgNpd3OCNFtsZe1-dYYH4E5RU0sSZHGGc3o3c_dM-qTdW4oFGNaKR0iDbAW5cYhx4yE0AcHzwuHu05dBkxJyfzdECHjpBeYI Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-339344899", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:27:09.011638 n-d-858384-19 devstack@n-api.service[120929]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-339344899', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:09.013951 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9342419-a83c-4f49-a903-7dc9b0d8f7b2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9342419-a83c-4f49-a903-7dc9b0d8f7b2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.097893 Nov 02 13:27:09.017116 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1546/3435] 10.222.0.113 () {60 vars in 1165 bytes} [Wed Nov 2 13:27:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:27:09.041731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4afd0ff-9abb-4d31-9a2e-c73cd7f48588 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Action: 'create', calling method: .version_select at 0x7fe787511310>, body: {"keypair": {"name": "tempest-keypair-1362570688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlU/gxe1w6fXl2C63QAonp9PEaxof9uxnnq9VmAeuqJYV6jNqRvLoKifC5+c3+96zuVghcYowybVjOpwcr+5gnICUSkH0bVQgpt4yUbtBsIBnkn9QrDCTt8dKMLWZ/N/A=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:09.056177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:09.058005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:09.096536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:09.097106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:09.099599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:09.105286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:09.106299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:09.109519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:09.126687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a4afd0ff-9abb-4d31-9a2e-c73cd7f48588 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:09.161795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a4afd0ff-9abb-4d31-9a2e-c73cd7f48588 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for user 0ff476fbbfa04880b772989f45759cc3 and project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:09.277353 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4afd0ff-9abb-4d31-9a2e-c73cd7f48588 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.249483 Nov 02 13:27:09.278531 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1890/3436] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:27:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:09.293840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7270751a-4ac2-40e0-9319-cb08562c5160 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Action: 'create', calling method: .version_select at 0x7fe787763a60>, body: {"keypair": {"name": "tempest-keypair-1362570688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRKOK+xaTeLWWjbMcvWgCOOP9soANxxorpRuWQ1RcjCFFFRcsKAXjDmRwCo0DfJcO/rkQzW9lyNXLeITFEcx6RaWzShj3azrOASmQU41dxvHuJ/tduNob7Jvrb1Az00vA=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:09.336959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7270751a-4ac2-40e0-9319-cb08562c5160 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:09.345065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7270751a-4ac2-40e0-9319-cb08562c5160 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for user 0ff476fbbfa04880b772989f45759cc3 and project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:09.384821 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-7270751a-4ac2-40e0-9319-cb08562c5160 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] HTTP exception thrown: Key pair 'tempest-keypair-1362570688' already exists. Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7270751a-4ac2-40e0-9319-cb08562c5160 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Request method failure captured: Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 273 Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAs477tx9wB2zWvjNExdAVHm9g1n3n3sv5sKUCvzqSZDpbIZeVXVyWWg5LJPiDIS48wkQfa2QVKPjBxgNpd3OCNFtsZe1-dYYH4E5RU0sSZHGGc3o3c_dM-qTdW4oFGNaKR0iDbAW5cYhx4yE0AcHzwuHu05dBkxJyfzdECHjpBeYI Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: {"keypair": {"name": "tempest-keypair-1362570688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRKOK+xaTeLWWjbMcvWgCOOP9soANxxorpRuWQ1RcjCFFFRcsKAXjDmRwCo0DfJcO/rkQzW9lyNXLeITFEcx6RaWzShj3azrOASmQU41dxvHuJ/tduNob7Jvrb1Az00vA=="}} Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: exception: Key pair 'tempest-keypair-1362570688' already exists. Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1362570688', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRKOK+xaTeLWWjbMcvWgCOOP9soANxxorpRuWQ1RcjCFFFRcsKAXjDmRwCo0DfJcO/rkQzW9lyNXLeITFEcx6RaWzShj3azrOASmQU41dxvHuJ/tduNob7Jvrb1Az00vA=='}}} Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '0ff476fbbfa04880b772989f45759cc3-tempest-keypair-1362570688' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 13:27:09.399828 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi kp.save(context.session) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result.read() Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 13:27:09.404011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '0ff476fbbfa04880b772989f45759cc3-tempest-keypair-1362570688' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 13, 27, 9, 372595), 'updated_at': None, 'name': 'tempest-keypair-1362570688', 'user_id': '0ff476fbbfa04880b772989f45759cc3', 'fingerprint': '77:23:38:90:1d:57:ed:c8:ca:81:e8:a0:3c:ea:ab:dd', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRKOK+xaTeLWWjbMcvWgCOOP9soANxxorpRuWQ1RcjCFFFRcsKAXjDmRwCo0DfJcO/rkQzW9lyNXLeITFEcx6RaWzShj3azrOASmQU41dxvHuJ/tduNob7Jvrb1Az00vA==', 'type': 'ssh'}] Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6779, in import_key_pair Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi keypair.create() Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._create() Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1362570688' already exists. Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Nov 02 13:27:09.408987 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1362570688' already exists. Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1362570688' already exists. Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.415842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7270751a-4ac2-40e0-9319-cb08562c5160 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Returning 409 to user: Key pair 'tempest-keypair-1362570688' already exists. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:09.417610 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7270751a-4ac2-40e0-9319-cb08562c5160 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.129126 Nov 02 13:27:09.418363 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1891/3437] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:27:09 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:27:09.432805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:09.437470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c9b9a55-fc25-4013-8d62-acf1d3727948 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Calling method '.version_select at 0x7fe786c2cb80>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:09.443754 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-29023519-bbb6-4fcd-9a41-4dddfb9b6e65 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.392081 Nov 02 13:27:09.460452 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1547/3438] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:09 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:09.475197 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c9b9a55-fc25-4013-8d62-acf1d3727948 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362570688" status: 202 len: 0 microversion: 2.1 time: 0.050869 Nov 02 13:27:09.478044 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1892/3439] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:27:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362570688 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:09.496847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a28dd979-9fca-451b-84c1-0520cb231fd2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Action: 'create', calling method: .version_select at 0x7fe78fa3fc10>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtrbdQSoqyeGbYy02RTIsfli7bECfsKbvE0/l4VMD4kIvIGNAdwPcphfCtWKVEF0znE4PbKZyNL9pnGKId7RWSfn0CxYOXCX6LU4EVz9JM2SWsNeCDd3BeKg+w4UUwwow=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a28dd979-9fca-451b-84c1-0520cb231fd2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Request method failure captured: Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 247 Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAs477tx9wB2zWvjNExdAVHm9g1n3n3sv5sKUCvzqSZDpbIZeVXVyWWg5LJPiDIS48wkQfa2QVKPjBxgNpd3OCNFtsZe1-dYYH4E5RU0sSZHGGc3o3c_dM-qTdW4oFGNaKR0iDbAW5cYhx4yE0AcHzwuHu05dBkxJyfzdECHjpBeYI Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtrbdQSoqyeGbYy02RTIsfli7bECfsKbvE0/l4VMD4kIvIGNAdwPcphfCtWKVEF0znE4PbKZyNL9pnGKId7RWSfn0CxYOXCX6LU4EVz9JM2SWsNeCDd3BeKg+w4UUwwow=="}} Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtrbdQSoqyeGbYy02RTIsfli7bECfsKbvE0/l4VMD4kIvIGNAdwPcphfCtWKVEF0znE4PbKZyNL9pnGKId7RWSfn0CxYOXCX6LU4EVz9JM2SWsNeCDd3BeKg+w4UUwwow=='}}} Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi '' Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:27:09.507085 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:27:09.511967 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.515472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a28dd979-9fca-451b-84c1-0520cb231fd2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:09.516508 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a28dd979-9fca-451b-84c1-0520cb231fd2 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.030211 Nov 02 13:27:09.527704 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1548/3440] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:27:09 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:27:09.528537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b60f1860-ed76-4ba0-85d2-e9be6ef17eb5 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Action: 'create', calling method: .version_select at 0x7fe786bb2ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1858618892", "public_key": " "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:09.557590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b60f1860-ed76-4ba0-85d2-e9be6ef17eb5 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:09.579872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-b60f1860-ed76-4ba0-85d2-e9be6ef17eb5 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for user 0ff476fbbfa04880b772989f45759cc3 and project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:09.633827 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-b60f1860-ed76-4ba0-85d2-e9be6ef17eb5 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b60f1860-ed76-4ba0-85d2-e9be6ef17eb5 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Request method failure captured: Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 95 Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnAs477tx9wB2zWvjNExdAVHm9g1n3n3sv5sKUCvzqSZDpbIZeVXVyWWg5LJPiDIS48wkQfa2QVKPjBxgNpd3OCNFtsZe1-dYYH4E5RU0sSZHGGc3o3c_dM-qTdW4oFGNaKR0iDbAW5cYhx4yE0AcHzwuHu05dBkxJyfzdECHjpBeYI Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1858618892", "public_key": " "}} Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1858618892', 'public_key': ' '}}} Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.636581 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b60f1860-ed76-4ba0-85d2-e9be6ef17eb5 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b60f1860-ed76-4ba0-85d2-e9be6ef17eb5 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.114639 Nov 02 13:27:09.648776 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1893/3441] 10.222.0.113 () {60 vars in 1163 bytes} [Wed Nov 2 13:27:09 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:27:09.652593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b624953-766e-485b-98f7-19ec9b34e9fa tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Action: 'create', calling method: .version_select at 0x7fe786fc21f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVhIvJU+E4Bw9dJXpknAOzqG0W0i3Sl+4z0ODDbJ04mziM4IvDRlUDCqx9TehU09ePOmzVjr6p39Ehs9/7KN7B+6ZA60cSKV+bq7I0MU6mku9Jwng/PWRXnfR77UBosQ=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b624953-766e-485b-98f7-19ec9b34e9fa tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Request method failure captured: Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 507 Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAs477tx9wB2zWvjNExdAVHm9g1n3n3sv5sKUCvzqSZDpbIZeVXVyWWg5LJPiDIS48wkQfa2QVKPjBxgNpd3OCNFtsZe1-dYYH4E5RU0sSZHGGc3o3c_dM-qTdW4oFGNaKR0iDbAW5cYhx4yE0AcHzwuHu05dBkxJyfzdECHjpBeYI Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVhIvJU+E4Bw9dJXpknAOzqG0W0i3Sl+4z0ODDbJ04mziM4IvDRlUDCqx9TehU09ePOmzVjr6p39Ehs9/7KN7B+6ZA60cSKV+bq7I0MU6mku9Jwng/PWRXnfR77UBosQ=="}} Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVhIvJU+E4Bw9dJXpknAOzqG0W0i3Sl+4z0ODDbJ04mziM4IvDRlUDCqx9TehU09ePOmzVjr6p39Ehs9/7KN7B+6ZA60cSKV+bq7I0MU6mku9Jwng/PWRXnfR77UBosQ=='}}} Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 13:27:09.656745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b624953-766e-485b-98f7-19ec9b34e9fa tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b624953-766e-485b-98f7-19ec9b34e9fa tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010270 Nov 02 13:27:09.665439 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1549/3442] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:27:09 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:27:09.671210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:09.671379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:09.680720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff9ea139-f3be-467d-a7e1-41e0049f878e tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Action: 'create', calling method: .version_select at 0x7fe786df59d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1013724134", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:09.695644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:09.696511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:09.697199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:09.698231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:09.699744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:09.700543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:09.725797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ff9ea139-f3be-467d-a7e1-41e0049f878e tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:09.740396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ff9ea139-f3be-467d-a7e1-41e0049f878e tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Getting quotas for user 0ff476fbbfa04880b772989f45759cc3 and project cd82800f19294991a3b1cb195e5f7ebd. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:09.773196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:09.775770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:09.776226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:09.777773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lazy-loading 'fault' on Instance uuid 265a2907-ff73-412a-ae89-aaafbddd4781 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:27:09.779225 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-ff9ea139-f3be-467d-a7e1-41e0049f878e tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff9ea139-f3be-467d-a7e1-41e0049f878e tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Request method failure captured: Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 118 Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAs477tx9wB2zWvjNExdAVHm9g1n3n3sv5sKUCvzqSZDpbIZeVXVyWWg5LJPiDIS48wkQfa2QVKPjBxgNpd3OCNFtsZe1-dYYH4E5RU0sSZHGGc3o3c_dM-qTdW4oFGNaKR0iDbAW5cYhx4yE0AcHzwuHu05dBkxJyfzdECHjpBeYI Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1013724134", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1013724134', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Nov 02 13:27:09.780177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff9ea139-f3be-467d-a7e1-41e0049f878e tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff9ea139-f3be-467d-a7e1-41e0049f878e tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.116945 Nov 02 13:27:09.786763 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1550/3443] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:27:09 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:27:09.791235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:09.802063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5fec269b-a16c-4557-a803-e861dab48727 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Calling method '.version_select at 0x7fe78fa86040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:09.823801 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-5fec269b-a16c-4557-a803-e861dab48727 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2142832741 not found for user 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5fec269b-a16c-4557-a803-e861dab48727 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Request method failure captured: Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2142832741 HTTP/1.1 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnAs477tx9wB2zWvjNExdAVHm9g1n3n3sv5sKUCvzqSZDpbIZeVXVyWWg5LJPiDIS48wkQfa2QVKPjBxgNpd3OCNFtsZe1-dYYH4E5RU0sSZHGGc3o3c_dM-qTdW4oFGNaKR0iDbAW5cYhx4yE0AcHzwuHu05dBkxJyfzdECHjpBeYI Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd82800f19294991a3b1cb195e5f7ebd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cd82800f19294991a3b1cb195e5f7ebd Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1419712762 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1419712762-project Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: exception: Keypair tempest-keypair-non-existent-2142832741 not found for user 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'tempest-keypair-non-existent-2142832741'} Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6863, in delete_key_pair Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6884, in get_key_pair Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2142832741 not found for user 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.826912 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req, id) Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2142832741 not found for user 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2142832741 not found for user 0ff476fbbfa04880b772989f45759cc3 Nov 02 13:27:09.832726 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:09.835633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5fec269b-a16c-4557-a803-e861dab48727 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2142832741 not found for user 0ff476fbbfa04880b772989f45759cc3 {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:09.836742 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5fec269b-a16c-4557-a803-e861dab48727 tempest-KeyPairsNegativeTestJSON-1419712762 tempest-KeyPairsNegativeTestJSON-1419712762-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2142832741" status: 404 len: 145 microversion: 2.1 time: 0.040474 Nov 02 13:27:09.837465 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1551/3444] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:27:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2142832741 => generated 145 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:27:09.870600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:09.881948 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c716b6b6-c23b-4d5c-aa36-12739f3d3cd3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 200 len: 1309 microversion: 2.1 time: 0.225417 Nov 02 13:27:09.882958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1894/3445] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:09 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 1309 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:10.471859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:10.473434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:10.487857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:10.488736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:10.491727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:10.492962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:10.496600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:10.497283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:10.734383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:10.745337 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f3f118fb-a2fb-471c-850a-1edf0a5c6c12 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.280979 Nov 02 13:27:10.749139 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1552/3446] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:10 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:10.920149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:10.922253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:10.934001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:10.934968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:10.936207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:10.937480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:10.938567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:10.939372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:10.970343 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 HTTP/1.1 Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '265a2907-ff73-412a-ae89-aaafbddd4781'} Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:10.974826 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:10.979228 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:10.979228 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:10.979228 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:10.979228 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:10.979228 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:10.979228 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:10.979228 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:10.982184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:10.984406 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7a478a65-7132-4ebd-a192-b5d6bdc56abb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 404 len: 111 microversion: 2.1 time: 0.081697 Nov 02 13:27:10.987855 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1895/3447] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:10 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:27:11.186071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:11.189168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:11.202425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:11.203719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:11.204337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:11.206162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:11.206908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:11.207545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:11.232377 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781/os-volume_attachments HTTP/1.1 Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': '265a2907-ff73-412a-ae89-aaafbddd4781'} Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:27:11.235103 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:27:11.240247 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:11.243279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:11.244756 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-73d8e9f6-e223-492b-a438-ea0cb29e9855 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063984 Nov 02 13:27:11.245944 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1553/3448] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:27:11 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781/os-volume_attachments => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:27:11.485894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1967510175", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "37c549b8-fcca-4ed8-94a6-1e15dc2811d6"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:11.632848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] validate_networks() for [('37c549b8-fcca-4ed8-94a6-1e15dc2811d6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:27:11.776101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:11.777458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:11.791048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:11.791959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:11.793205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:11.794258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:11.795619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:11.796316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.062738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:12.074874 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17ebf576-d785-4c0c-a1c3-3d2d942a3e7e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.303707 Nov 02 13:27:12.075499 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1554/3449] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:11 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:12.282344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:27:12.284259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:27:12.285203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:27:12.285840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:27:12.286451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:27:12.309005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:12.311828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:12.312803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.315940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:12.317649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:12.318452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:12.349367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:12.356383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for user 4228809f65b74c90b1d34cecc1b4d30e and project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:12.376817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:27:12.380006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fec033ae-a8a2-4e35-91cc-f74b5f3965c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:27:12.410811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:12.451826 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-231cff34-b8c2-4768-95ef-9c6ada43a428 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.971068 Nov 02 13:27:12.452795 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1896/3450] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:27:11 2022] POST /compute/v2.1/servers => generated 382 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:27:12.466100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a316eeee-f26f-4d57-a30a-4cb26d854e82 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:12.467005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a316eeee-f26f-4d57-a30a-4cb26d854e82 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fec033ae-a8a2-4e35-91cc-f74b5f3965c5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:12.645324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a316eeee-f26f-4d57-a30a-4cb26d854e82 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:12.654250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a316eeee-f26f-4d57-a30a-4cb26d854e82 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5" status: 200 len: 1219 microversion: 2.1 time: 0.192708 Nov 02 13:27:12.654846 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1555/3451] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:12 2022] GET /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:12.677867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3aeab592-0941-41e8-a8ea-390754c539fc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:12.678807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3aeab592-0941-41e8-a8ea-390754c539fc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fec033ae-a8a2-4e35-91cc-f74b5f3965c5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:12.704830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3aeab592-0941-41e8-a8ea-390754c539fc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fec033ae-a8a2-4e35-91cc-f74b5f3965c5] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:27:13.106984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:13.108144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:13.123362 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.scheduler.client.report [None req-3aeab592-0941-41e8-a8ea-390754c539fc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Deleted allocations for instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 Nov 02 13:27:13.140654 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.compute.api [None req-3aeab592-0941-41e8-a8ea-390754c539fc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fec033ae-a8a2-4e35-91cc-f74b5f3965c5] Instance Mapping does not exist while attempting local delete cleanup. Nov 02 13:27:13.142463 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3aeab592-0941-41e8-a8ea-390754c539fc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5" status: 204 len: 0 microversion: 2.1 time: 0.469712 Nov 02 13:27:13.143895 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1897/3452] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:27:12 2022] DELETE /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:27:13.146801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:13.147661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:13.154265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:13.155891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:13.160100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-737af435-bd25-4dcd-b19c-f5c8d2ac61ea tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:13.161278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:13.162318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:13.167451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-737af435-bd25-4dcd-b19c-f5c8d2ac61ea tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fec033ae-a8a2-4e35-91cc-f74b5f3965c5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:13.194919 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-737af435-bd25-4dcd-b19c-f5c8d2ac61ea tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-737af435-bd25-4dcd-b19c-f5c8d2ac61ea tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5 HTTP/1.1 Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'fec033ae-a8a2-4e35-91cc-f74b5f3965c5'} Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:13.196671 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:13.204096 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:13.204096 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:13.204096 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:13.204096 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:27:13.204096 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:27:13.204096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-737af435-bd25-4dcd-b19c-f5c8d2ac61ea tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:13.204096 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-737af435-bd25-4dcd-b19c-f5c8d2ac61ea tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5" status: 404 len: 111 microversion: 2.1 time: 0.048942 Nov 02 13:27:13.210516 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1898/3453] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:13 2022] GET /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:27:13.372035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:13.381228 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b313638-dc66-4c52-bd4f-1d0b85470beb tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.283129 Nov 02 13:27:13.381812 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1556/3454] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:13 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:13.538105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1645342827", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "37c549b8-fcca-4ed8-94a6-1e15dc2811d6"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:13.616274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] validate_networks() for [('37c549b8-fcca-4ed8-94a6-1e15dc2811d6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:27:14.419123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:14.419952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:14.435603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:14.437842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:14.440753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:14.442401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:14.443617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:14.461068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:14.490105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:27:14.490536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:27:14.491067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:27:14.491521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:27:14.491939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:27:14.514932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:14.515452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:14.516114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:14.517201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:14.518800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:14.519563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:14.560929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:14.570455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for user 4228809f65b74c90b1d34cecc1b4d30e and project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:14.590917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:27:14.593733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:27:14.653002 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8da1b9db-cd5c-419c-9f55-937f2b6c6adf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.119730 Nov 02 13:27:14.653961 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1899/3455] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:27:13 2022] POST /compute/v2.1/servers => generated 382 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:27:14.667291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8923196-97af-4643-87c3-44724236c2ec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:14.668238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8923196-97af-4643-87c3-44724236c2ec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:14.801994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8923196-97af-4643-87c3-44724236c2ec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:14.810822 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8923196-97af-4643-87c3-44724236c2ec tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1219 microversion: 2.1 time: 0.148894 Nov 02 13:27:14.819425 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1900/3456] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:14 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:14.929781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:14.946800 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-079f8508-24f4-4eae-992a-ef95d75d2a6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.532329 Nov 02 13:27:14.948191 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1557/3457] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:14 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:15.839887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:15.840983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:15.853060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:15.853740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:15.854527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:15.855638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:15.856361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:15.857260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:15.975325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:15.977570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:15.986985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:15.987826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:15.988818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:15.990945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:15.992226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:15.992887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:16.057268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:16.066930 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-58749de6-45df-4e82-ad75-98058b63614f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1271 microversion: 2.1 time: 0.232944 Nov 02 13:27:16.083716 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1901/3458] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:15 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:16.486127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:16.498401 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-acedbbcc-74e1-44c9-8f1b-4a38e2c42e25 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.529779 Nov 02 13:27:16.499705 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1558/3459] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:15 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:17.091106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:17.092405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:17.118271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:17.120603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:17.123252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:17.128790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:17.129934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:17.130739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:17.371949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:17.386227 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dbbaf573-6087-4413-9422-8a84b5db4e6c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1277 microversion: 2.1 time: 0.297489 Nov 02 13:27:17.387201 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1902/3460] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:17 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1277 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:17.521862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:17.523664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:17.533994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:17.534942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:17.535672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:17.537118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:17.538073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:17.538737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:18.071985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:18.087256 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9faa1b9b-c01f-4795-a9da-7b6c798a32b0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.567990 Nov 02 13:27:18.107524 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1559/3461] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:17 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:18.418210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:18.419801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:18.435424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:18.438433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:18.439841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:18.444445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:18.446740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:18.447414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:19.049163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f12bd512-e89c-4127-975c-4e25a8daf11b req-9bfab4fb-52d6-4667-aa0e-f01a273272b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a13437-49ca-4a77-b86b-893d0b62338b", "tag": "1b4978f1-73b6-4dff-ac4d-e9e6b320a87f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:19.075774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:19.089226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f12bd512-e89c-4127-975c-4e25a8daf11b req-9bfab4fb-52d6-4667-aa0e-f01a273272b7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:19.091967 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df10c7da-ce7d-42db-9b12-ffea4ea6e9ca tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1319 microversion: 2.1 time: 0.679703 Nov 02 13:27:19.104382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f12bd512-e89c-4127-975c-4e25a8daf11b req-9bfab4fb-52d6-4667-aa0e-f01a273272b7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:19.104847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f12bd512-e89c-4127-975c-4e25a8daf11b req-9bfab4fb-52d6-4667-aa0e-f01a273272b7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:19.110616 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1903/3462] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:18 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1319 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:19.126150 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f12bd512-e89c-4127-975c-4e25a8daf11b req-9bfab4fb-52d6-4667-aa0e-f01a273272b7 service nova] Creating event network-changed:1b4978f1-73b6-4dff-ac4d-e9e6b320a87f for instance 81a13437-49ca-4a77-b86b-893d0b62338b on n-h1-858384-19 Nov 02 13:27:19.126373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:19.127178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:19.144480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:19.145368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:19.151572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:19.152109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:19.152580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:19.153013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:19.168580 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f12bd512-e89c-4127-975c-4e25a8daf11b req-9bfab4fb-52d6-4667-aa0e-f01a273272b7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124931 Nov 02 13:27:19.170583 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1560/3463] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:27:20.126467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:20.128477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:20.131626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:20.147933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:20.148344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:20.148804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:20.149517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:20.149978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:20.150422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:20.160147 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3a2d6114-588b-4b85-991c-6d6bb4e61fbf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1660 microversion: 2.1 time: 1.045582 Nov 02 13:27:20.162595 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1904/3464] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:19 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1660 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:20.206018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df567e7d-bc3e-429e-81d0-ea4961eaf6df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:20.214039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df567e7d-bc3e-429e-81d0-ea4961eaf6df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:20.215230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df567e7d-bc3e-429e-81d0-ea4961eaf6df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:20.215230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df567e7d-bc3e-429e-81d0-ea4961eaf6df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:20.282201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df567e7d-bc3e-429e-81d0-ea4961eaf6df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Going to try to start instance {{(pid=120928) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 13:27:20.371175 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df567e7d-bc3e-429e-81d0-ea4961eaf6df tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.184568 Nov 02 13:27:20.377933 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1905/3465] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:20 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:20.387686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:20.388657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:20.406035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:20.410254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:20.411003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:20.413922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:20.415377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:20.418528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:20.495822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:20.509578 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5af956fc-8225-433a-9b38-92cb6c0f698c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1319 microversion: 2.1 time: 0.391666 Nov 02 13:27:20.510938 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1561/3466] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:20 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:21.543737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:21.544417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:21.568678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:21.573635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:21.573635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:21.574577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:21.577874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:21.578372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:21.621487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:21.639561 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d28c1478-1ac8-49dd-9b0b-9652b21f8f0b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1669 microversion: 2.1 time: 1.259726 Nov 02 13:27:21.640152 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1906/3467] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:20 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1669 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:21.965915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:21.977577 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a99898f1-d40a-46b6-9bf8-ad11a30a9787 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1319 microversion: 2.1 time: 0.447995 Nov 02 13:27:21.982152 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1562/3468] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:21 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:22.675504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:22.676963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:22.694087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:22.695202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:22.695925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:22.697674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:22.698937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:22.699649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:23.007360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:23.008408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:23.017747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:23.029596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:23.030197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:23.033760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:23.034937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:23.035665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:23.036032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:23.048748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:23.307036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:23.350711 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-399577bf-264f-4e23-a2bb-a6be492a0ab1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1669 microversion: 2.1 time: 0.678134 Nov 02 13:27:23.369666 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1907/3469] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:22 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1669 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:23.566297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-236f8ca7-2468-4d86-be62-5b06f693e272 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4937711d-56fd-4686-aac9-8a56596ed24e"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:23.569399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-236f8ca7-2468-4d86-be62-5b06f693e272 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:23.583991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-236f8ca7-2468-4d86-be62-5b06f693e272 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:23.584506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-236f8ca7-2468-4d86-be62-5b06f693e272 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:23.584960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-236f8ca7-2468-4d86-be62-5b06f693e272 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:23.590540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-236f8ca7-2468-4d86-be62-5b06f693e272 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:23.591334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-236f8ca7-2468-4d86-be62-5b06f693e272 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:23.592107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-236f8ca7-2468-4d86-be62-5b06f693e272 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:23.729984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:23.740282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ecf434ec-c6be-4900-91f3-7ec9d8e68ce1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1319 microversion: 2.1 time: 0.737133 Nov 02 13:27:23.745716 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1563/3470] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:23 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:24.050660 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-236f8ca7-2468-4d86-be62-5b06f693e272 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "POST /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490217 Nov 02 13:27:24.052473 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1908/3471] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:27:23 2022] POST /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:27:24.396244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:24.397597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:24.412104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:24.413049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:24.413668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:24.415043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:24.415756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:24.418056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:24.763216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:24.769201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:24.770674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:24.790304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:24.792278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:24.794549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:24.803411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:24.804242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:24.804851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:24.840985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:24.862161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=28 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:24.863221 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc4b1b27-613a-4d74-bd7c-88335c96943e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.467457 Nov 02 13:27:24.866195 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1564/3472] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:24 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:24.893851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:24.894992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:24.920792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:24.930347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:24.933350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:24.939491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:24.942665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:24.944853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:25.545522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:25.586701 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97c70770-7311-4796-aed8-c3f38dc948e8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1319 microversion: 2.1 time: 0.824358 Nov 02 13:27:25.587787 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1909/3473] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:24 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1319 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:26.528735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:26.542659 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4e4de0ed-bb9e-40b7-94f0-3325912abd50 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 1.653416 Nov 02 13:27:26.545155 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1565/3474] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:24 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:26.572581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:26.573184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:26.585983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:26.586477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:26.586920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:26.587683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:26.588140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:26.588574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:26.639100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:26.648379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:26.668710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:26.669196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:26.681783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:26.684290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:26.684788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:26.685230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:26.778442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Unlocking {{(pid=120928) unlock /opt/stack/nova/nova/compute/api.py:4875}} Nov 02 13:27:26.882463 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cadd9e5c-981a-4c5e-ad9e-453f76f4a74e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.314043 Nov 02 13:27:26.893264 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1910/3475] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:26 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:26.904299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:26.905448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:26.912783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:26.913581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:26.914293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:26.915523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:26.916477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:26.917087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:26.982376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:27.370679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:27.388365 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-919a0dc2-a78f-4edc-bbf7-6bb22c7dc8fd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.492948 Nov 02 13:27:27.388972 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1911/3476] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:26 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:27.433674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:27.437091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:27.453872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:27.454138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:27.464758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:27.472261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:27.473361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:27.479222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:27.868397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:27.878036 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c9258f2-66a2-4b6b-9134-3f7871727ba2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.463916 Nov 02 13:27:27.884291 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1912/3477] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:27 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:27.943005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:27.964656 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-47abe6b8-3883-4bc6-8aed-6d469b115e67 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1319 microversion: 2.1 time: 1.331572 Nov 02 13:27:27.979199 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1566/3478] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:26 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1319 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:27.979199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e1f33d26-0b7b-4fd7-a511-febc4370fa23 req-2a214db0-0452-4202-9bc9-f99c7e8f67d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a13437-49ca-4a77-b86b-893d0b62338b", "name": "network-vif-plugged", "status": "completed", "tag": "1b4978f1-73b6-4dff-ac4d-e9e6b320a87f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:27.998016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e1f33d26-0b7b-4fd7-a511-febc4370fa23 req-2a214db0-0452-4202-9bc9-f99c7e8f67d5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:27.998265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e1f33d26-0b7b-4fd7-a511-febc4370fa23 req-2a214db0-0452-4202-9bc9-f99c7e8f67d5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:27.998591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e1f33d26-0b7b-4fd7-a511-febc4370fa23 req-2a214db0-0452-4202-9bc9-f99c7e8f67d5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:28.027370 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e1f33d26-0b7b-4fd7-a511-febc4370fa23 req-2a214db0-0452-4202-9bc9-f99c7e8f67d5 service nova] Creating event network-vif-plugged:1b4978f1-73b6-4dff-ac4d-e9e6b320a87f for instance 81a13437-49ca-4a77-b86b-893d0b62338b on n-h1-858384-19 Nov 02 13:27:28.045681 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e1f33d26-0b7b-4fd7-a511-febc4370fa23 req-2a214db0-0452-4202-9bc9-f99c7e8f67d5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076404 Nov 02 13:27:28.049087 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1567/3479] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:28.064757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:28.068188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:28.084439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:28.085607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:28.086224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:28.087931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:28.090730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:28.091391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:28.249073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01376594-6b9f-4f81-bc5f-c0a2fc607036 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Action: 'create', calling method: .version_select at 0x7fe787763820>, body: {"keypair": {"name": "tempest-keypair-325163301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRu7bt4JN5x1PGPegxoY0x/51In12kCeXi/FpS6yTebMx1mYO9eKqov1vo9nLAu5wIN0KAwa3MObyTFi8SduXmm2O1CwJ1HNUqq6gXWWY0ACRAwT8mh7coO9g62bGz1QA=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:28.290183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-01376594-6b9f-4f81-bc5f-c0a2fc607036 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Getting quotas for project 0d74750aac324a3ab667af124ed2691b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:28.299407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-01376594-6b9f-4f81-bc5f-c0a2fc607036 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Getting quotas for user ca29fecc3e35486ba22ef8a7b415c63c and project 0d74750aac324a3ab667af124ed2691b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:28.353090 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01376594-6b9f-4f81-bc5f-c0a2fc607036 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.467609 Nov 02 13:27:28.353701 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1913/3480] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:27:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:29.003389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:29.006034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:29.030076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:29.037272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:29.038175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:29.041462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:29.044233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:29.046102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:29.157951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:29.174763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d1d5535e-16f7-4b7e-827b-59eddff07311 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 1.121779 Nov 02 13:27:29.178486 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1568/3481] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:28 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:29.206463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bd4abb82-01bc-40c6-a469-06a28435673d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:29.207366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bd4abb82-01bc-40c6-a469-06a28435673d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:29.219140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd4abb82-01bc-40c6-a469-06a28435673d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:29.220009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd4abb82-01bc-40c6-a469-06a28435673d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:29.220834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd4abb82-01bc-40c6-a469-06a28435673d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:29.221745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd4abb82-01bc-40c6-a469-06a28435673d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:29.222383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd4abb82-01bc-40c6-a469-06a28435673d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:29.223290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd4abb82-01bc-40c6-a469-06a28435673d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:29.327249 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bd4abb82-01bc-40c6-a469-06a28435673d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.110205 Nov 02 13:27:29.332962 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1569/3482] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:29 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:27:29.340270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:29.341637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:29.352155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:29.353079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:29.353705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:29.354739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:29.355469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:29.356585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:29.456002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:29.487214 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1e1599c3-19d9-4b95-946c-069b3f019baf tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1319 microversion: 2.1 time: 0.493998 Nov 02 13:27:29.489770 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1914/3483] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:28 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:29.930284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:29.943899 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-219bf1ea-241a-4eb1-b895-dde54c90f0dd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1678 microversion: 2.1 time: 0.609324 Nov 02 13:27:29.946748 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1570/3484] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:29 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1678 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:30.518887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:30.523963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:30.543266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:30.543973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:30.546530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:30.550070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:30.550818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:30.552169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:30.842134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:30.861005 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cea3281b-d199-4a7c-8577-1cce57001a91 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1319 microversion: 2.1 time: 0.345753 Nov 02 13:27:30.864742 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1915/3485] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:30 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:30.967510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:30.968066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:30.992163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:30.992163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:30.992163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:30.992163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:30.992163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:30.993461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.555820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:31.573010 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-34cda3f3-36af-4f33-ac25-9ac6ba2c0665 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1658 microversion: 2.1 time: 0.609694 Nov 02 13:27:31.586721 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1571/3486] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:30 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1658 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:31.602561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36f1ba38-874b-42d7-a0f0-0733c3e87ed1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:31.603194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-36f1ba38-874b-42d7-a0f0-0733c3e87ed1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:31.628362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36f1ba38-874b-42d7-a0f0-0733c3e87ed1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.628885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36f1ba38-874b-42d7-a0f0-0733c3e87ed1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.635985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36f1ba38-874b-42d7-a0f0-0733c3e87ed1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.636745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36f1ba38-874b-42d7-a0f0-0733c3e87ed1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.637212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36f1ba38-874b-42d7-a0f0-0733c3e87ed1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.637642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36f1ba38-874b-42d7-a0f0-0733c3e87ed1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.825293 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-36f1ba38-874b-42d7-a0f0-0733c3e87ed1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.227195 Nov 02 13:27:31.826651 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1916/3487] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:31 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:31.835981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:31.842913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:31.859483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.860284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.864023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.865696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.866341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.867138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.895573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:31.896627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:31.911842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.916186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.918543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:31.919566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:31.921820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:31.922474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:32.235088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:32.245253 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-32d2fb02-f1f2-4826-a8de-8dc910742e94 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1505 microversion: 2.1 time: 0.356882 Nov 02 13:27:32.245851 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1917/3488] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:31 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:32.271755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b7f5d61a-cd39-47ae-bef8-73fab2cda00d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:32.272492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b7f5d61a-cd39-47ae-bef8-73fab2cda00d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:32.285615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f5d61a-cd39-47ae-bef8-73fab2cda00d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:32.288476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f5d61a-cd39-47ae-bef8-73fab2cda00d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:32.289223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f5d61a-cd39-47ae-bef8-73fab2cda00d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:32.290767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f5d61a-cd39-47ae-bef8-73fab2cda00d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:32.291673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f5d61a-cd39-47ae-bef8-73fab2cda00d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:32.294532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f5d61a-cd39-47ae-bef8-73fab2cda00d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:32.446327 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b7f5d61a-cd39-47ae-bef8-73fab2cda00d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b/action" status: 202 len: 0 microversion: 2.1 time: 0.177677 Nov 02 13:27:32.447505 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1918/3489] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:32 2022] POST /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:27:32.465031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:32.472962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:32.492652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:32.498604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:32.499425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:32.500170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:32.500811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:32.502909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:32.885985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:32.896877 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb72165d-2f8e-4b2e-bea0-fbad916920de tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1510 microversion: 2.1 time: 0.444393 Nov 02 13:27:32.898577 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1919/3490] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:32 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1510 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:33.229457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:33.246161 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03dafd5d-4c93-4700-a873-d0d6c375aa26 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1665 microversion: 2.1 time: 1.410795 Nov 02 13:27:33.246161 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1572/3491] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:31 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1665 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:33.926057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:33.926938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:33.944060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:33.948109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:33.948891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:33.950406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:33.957989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:33.960345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:34.339202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b9be1229-0d75-4a56-8f79-8179742fdd87 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: .version_select at 0x7fe786aa7670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1795426446", "description": "tempest-description-1807708832"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:34.477219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:34.493870 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0bb5daf8-8cef-4f0e-a38d-dd22f664c408 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1490 microversion: 2.1 time: 0.570792 Nov 02 13:27:34.494764 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1573/3492] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:33 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1490 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:34.520531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:34.522959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:34.551785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=90 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:34.568227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:34.570046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:34.575379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:34.577325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:34.579650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:34.585610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.098970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:35.130618 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a0510894-0466-4eed-8df2-671cb76ee886 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.634743 Nov 02 13:27:35.141333 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1574/3493] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:34 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:35.171142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:35.180678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:35.215762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.225407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.229348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.230530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.243805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.244528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.334930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:27:35.729636 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-124491ff-788c-41b0-9d75-15d9fc1fdf99 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 204 len: 0 microversion: 2.1 time: 0.585975 Nov 02 13:27:35.730524 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1575/3494] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:27:35 2022] DELETE /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:27:35.744101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:35.747080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:35.762704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.763241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.763818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:35.772147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:35.772666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:35.776226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:36.299757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:36.310521 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b9be1229-0d75-4a56-8f79-8179742fdd87 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 2.737571 Nov 02 13:27:36.311827 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1920/3495] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:27:33 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 2740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:36.316791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:36.335765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:36.356069 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-abd3cce1-9526-4d38-8231-bbc61f148b7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.624117 Nov 02 13:27:36.360273 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1576/3496] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:35 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:36.368446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:36.370035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:36.372356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e174aba-50e7-4671-bdd5-2f0dbcf66a3a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: .version_select at 0x7fe787c69160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-580373385", "description": "tempest-description-1866268737"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:36.373492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:36.374444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:36.375410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:36.376592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:36.989007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:37.006743 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5578e8a5-e485-4cdc-8b2e-7af7206af048 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1496 microversion: 2.1 time: 0.689357 Nov 02 13:27:37.007728 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1921/3497] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:36 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1496 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:37.019028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:37.020074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:37.038464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.039340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.043354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:37.044479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.045147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.045767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:37.128770 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e174aba-50e7-4671-bdd5-2f0dbcf66a3a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.766209 Nov 02 13:27:37.131890 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1577/3498] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:27:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:37.422241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-92050990", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "e2f61ca9-e2f8-4fbb-90f1-d110e2455df2"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:37.437182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:37.445479 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e64f4684-91f4-469f-bc95-d5e307c4bd76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.436481 Nov 02 13:27:37.464336 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1922/3499] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:37 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:37.471445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:37.472093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:37.489599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.490069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.490563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:37.491222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.496626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.497140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:37.504664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] validate_networks() for [('e2f61ca9-e2f8-4fbb-90f1-d110e2455df2', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:27:37.786053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:37.797216 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a782bcc9-6747-4841-b2e7-8264140b9392 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.330578 Nov 02 13:27:37.798401 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1923/3500] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:37 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:37.827431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:37.828543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:37.838170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.838992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.839630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:37.840527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:37.841154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:37.841749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.130163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:38.144861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb7f4e6b-825e-4aca-89c8-af441dc482ed tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.322537 Nov 02 13:27:38.149345 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1924/3501] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:37 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:38.156556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:38.160252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:38.176344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.177361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.178043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.179475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.180203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.180645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.311763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:38.424136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:38.446154 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-99a0799b-4f54-45a2-9f76-468ac6135ee0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1496 microversion: 2.1 time: 0.295517 Nov 02 13:27:38.449196 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1925/3502] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:38 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1496 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:38.460921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:38.461570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:38.477066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.477771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.478372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.479857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.480325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.480931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.739294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:38.750429 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9794915a-5d21-4389-b378-ca424629fff1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.300123 Nov 02 13:27:38.752664 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1926/3503] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:38 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:38.762663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-08e39bf3-01cb-4e56-9959-2941b75bd8e6 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98d5ddea-57b1-4521-be0b-5a993f2d785f"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:38.766231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-08e39bf3-01cb-4e56-9959-2941b75bd8e6 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:38.774336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08e39bf3-01cb-4e56-9959-2941b75bd8e6 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.776001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08e39bf3-01cb-4e56-9959-2941b75bd8e6 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.776565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08e39bf3-01cb-4e56-9959-2941b75bd8e6 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.780190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08e39bf3-01cb-4e56-9959-2941b75bd8e6 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:38.780914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08e39bf3-01cb-4e56-9959-2941b75bd8e6 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:38.781353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08e39bf3-01cb-4e56-9959-2941b75bd8e6 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:38.937205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:39.321934 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-08e39bf3-01cb-4e56-9959-2941b75bd8e6 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "POST /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.560061 Nov 02 13:27:39.324317 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1927/3504] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:27:38 2022] POST /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:39.474183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:39.476251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:39.495770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:39.503530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:39.505526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:39.509872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:39.512187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:39.513351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:39.775661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:27:39.776757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:27:39.777780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:27:39.778420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:27:39.779473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:27:39.803672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:39.806021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:39.808546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:39.808676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:39.809830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:39.816031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:39.819446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:39.825774 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-006cd06b-12a2-4e5e-8691-440be7d53a7b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 200 len: 1454 microversion: 2.1 time: 0.357234 Nov 02 13:27:39.831726 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1928/3505] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:39 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 1454 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:39.836959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-2f190385-2308-4f54-8249-43bda1beeee9 req-b024ffc3-3c10-40dd-a968-79348bc64a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a13437-49ca-4a77-b86b-893d0b62338b", "name": "network-vif-deleted", "tag": "1b4978f1-73b6-4dff-ac4d-e9e6b320a87f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:39.861785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:39.874321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2f190385-2308-4f54-8249-43bda1beeee9 req-b024ffc3-3c10-40dd-a968-79348bc64a05 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:39.875077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2f190385-2308-4f54-8249-43bda1beeee9 req-b024ffc3-3c10-40dd-a968-79348bc64a05 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:39.875742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2f190385-2308-4f54-8249-43bda1beeee9 req-b024ffc3-3c10-40dd-a968-79348bc64a05 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:39.893572 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-2f190385-2308-4f54-8249-43bda1beeee9 req-b024ffc3-3c10-40dd-a968-79348bc64a05 service nova] Creating event network-vif-deleted:1b4978f1-73b6-4dff-ac4d-e9e6b320a87f for instance 81a13437-49ca-4a77-b86b-893d0b62338b on n-h1-858384-19 Nov 02 13:27:39.899889 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-2f190385-2308-4f54-8249-43bda1beeee9 req-b024ffc3-3c10-40dd-a968-79348bc64a05 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066509 Nov 02 13:27:39.901152 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1929/3506] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:39.910673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Getting quotas for project 8a41acb2595c4028ba02cf9fd7ce5fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:39.949779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Getting quotas for user 209a1d83f0ce4ca6b0b27a56e5959eaf and project 8a41acb2595c4028ba02cf9fd7ce5fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:39.979530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:27:39.996787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:27:40.151803 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7363feb5-6849-4262-a4a9-6eb58d66396e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.735238 Nov 02 13:27:40.155154 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1578/3507] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:27:37 2022] POST /compute/v2.1/servers => generated 382 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:27:40.168656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d85650ee-87ce-4b9b-91b9-13fbf4ad5395 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:40.169683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d85650ee-87ce-4b9b-91b9-13fbf4ad5395 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:40.271962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d85650ee-87ce-4b9b-91b9-13fbf4ad5395 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:40.285701 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d85650ee-87ce-4b9b-91b9-13fbf4ad5395 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1218 microversion: 2.1 time: 0.121505 Nov 02 13:27:40.288104 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1930/3508] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:40 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:40.850462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:40.851522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:40.865493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:40.869069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:40.871773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:40.874525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:40.875158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:40.877363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:40.926668 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b HTTP/1.1 Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '81a13437-49ca-4a77-b86b-893d0b62338b'} Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:27:40.929939 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:40.935314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:27:40.935314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:27:40.935314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:27:40.935314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:27:40.935314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:27:40.935314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:27:40.935314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:27:40.941289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:27:40.945769 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7e012413-c14f-4269-8e06-e1ce591f001b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 404 len: 111 microversion: 2.1 time: 0.099317 Nov 02 13:27:40.949538 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1579/3509] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:40 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:27:41.162630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1707521281", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "37c549b8-fcca-4ed8-94a6-1e15dc2811d6"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:41.287504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] validate_networks() for [('37c549b8-fcca-4ed8-94a6-1e15dc2811d6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:27:41.320129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:41.322475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:41.373132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:41.374480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:41.378804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:41.380447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:41.381520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:41.382493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:41.409439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:42.230059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:42.252042 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d87678c7-4d88-42db-bca0-4851dad5f4c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1214 microversion: 2.1 time: 0.932682 Nov 02 13:27:42.254928 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1580/3510] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:41 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1214 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:42.521463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e488e4d-1b1d-49f0-bad2-e6e963c0eefe tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:42.524645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8e488e4d-1b1d-49f0-bad2-e6e963c0eefe tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:42.556114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e488e4d-1b1d-49f0-bad2-e6e963c0eefe tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:42.556779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e488e4d-1b1d-49f0-bad2-e6e963c0eefe tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:42.557344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e488e4d-1b1d-49f0-bad2-e6e963c0eefe tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:42.559539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e488e4d-1b1d-49f0-bad2-e6e963c0eefe tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:42.562260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e488e4d-1b1d-49f0-bad2-e6e963c0eefe tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:42.562839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e488e4d-1b1d-49f0-bad2-e6e963c0eefe tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:42.662832 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e488e4d-1b1d-49f0-bad2-e6e963c0eefe tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149151 Nov 02 13:27:42.665308 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1581/3511] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:27:42 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:27:42.685003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:42.687711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:42.721524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:42.724389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:42.730176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:42.732281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:42.736280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:42.738938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:42.919531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:27:42.920076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:27:42.920420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:27:42.920834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:27:42.921248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:27:42.943544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:42.944242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:42.944697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:42.947259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:42.948018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:42.950644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:43.021350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:27:43.033340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for user 4228809f65b74c90b1d34cecc1b4d30e and project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:27:43.053556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:27:43.057049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:27:43.148068 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e3d89850-b816-44db-a0e0-e3ba7a502149 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.991791 Nov 02 13:27:43.156804 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1931/3512] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:27:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:27:43.186027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-04da0314-b36c-40f8-b903-b5f1137dd2b9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:43.193585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-04da0314-b36c-40f8-b903-b5f1137dd2b9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:43.195314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lazy-loading 'services' on Instance uuid b1839e8d-7af9-46b2-a7f4-bc09f7585d3c {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:27:43.423560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04da0314-b36c-40f8-b903-b5f1137dd2b9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:43.433065 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-04da0314-b36c-40f8-b903-b5f1137dd2b9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1219 microversion: 2.1 time: 0.266460 Nov 02 13:27:43.433676 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1932/3513] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:43 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:43.453070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:43.458986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:43.481768 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-96abdd1a-8955-4648-bea7-ebbc8f50d3c7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "DELETE /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments/4937711d-56fd-4686-aac9-8a56596ed24e" status: 202 len: 0 microversion: 2.1 time: 0.805842 Nov 02 13:27:43.484986 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1582/3514] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:27:42 2022] DELETE /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments/4937711d-56fd-4686-aac9-8a56596ed24e => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:27:43.493712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:43.496707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:43.497656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:43.499658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:43.501098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:43.504797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:43.800556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:43.811533 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68803fb8-606e-40b0-a68d-12b979beb560 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1276 microversion: 2.1 time: 0.376654 Nov 02 13:27:43.815213 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1933/3515] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:43 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1276 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:44.463341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:44.464270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:44.479559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.484564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.485878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.487971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.490560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.492142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.772483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:44.788437 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8eb74941-f0e6-4b98-9d3b-0d2dd8a2b269 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1223 microversion: 2.1 time: 0.329346 Nov 02 13:27:44.791503 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1583/3516] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:44 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1223 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:44.844573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:44.845565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:44.862566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.863194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.864824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:44.866430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:44.867697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:44.868871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:45.036153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:45.045154 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87647a8a-e415-4890-81bc-6ae54a96bd06 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1276 microversion: 2.1 time: 0.208019 Nov 02 13:27:45.048954 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1934/3517] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:44 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:45.826408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:45.832392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:45.865486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:45.881243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:45.883183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:45.884363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:45.885098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:45.885723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:46.074470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:46.076495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:46.127981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:46.135551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:46.146073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:46.148476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:46.149341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:46.151862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:46.210209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:46.245428 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3e17260f-6dca-424e-b797-7c76d46905d2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1277 microversion: 2.1 time: 0.432449 Nov 02 13:27:46.247724 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1584/3518] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:45 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1277 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:46.583834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:46.604079 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc1d2d35-86dc-4b21-a241-32a242f6ad69 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1318 microversion: 2.1 time: 0.537462 Nov 02 13:27:46.610638 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1935/3519] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:46 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:47.278082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:47.278975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:47.308846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:47.309471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:47.315245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:47.316832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:47.317334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:47.317802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:47.636226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:47.636919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:47.670402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:47.683054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:47.694235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:47.704705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:47.718549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:47.719025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:48.075126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:48.097806 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7e064a7a-e86f-48ac-a172-569359d0b777 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1319 microversion: 2.1 time: 0.818237 Nov 02 13:27:48.101431 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1585/3520] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:47 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1319 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:48.454380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3ded9641-55db-4fa2-864d-d2c75eeaaa02 req-ed75923c-f08b-4989-b646-4b3c80a48067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9bd4071-e51a-429d-9e8e-d9ca8c26a37a", "tag": "55ea9702-4291-4cad-8c7f-ce2ff4027302"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:48.493294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ded9641-55db-4fa2-864d-d2c75eeaaa02 req-ed75923c-f08b-4989-b646-4b3c80a48067 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:48.495764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ded9641-55db-4fa2-864d-d2c75eeaaa02 req-ed75923c-f08b-4989-b646-4b3c80a48067 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:48.497787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ded9641-55db-4fa2-864d-d2c75eeaaa02 req-ed75923c-f08b-4989-b646-4b3c80a48067 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:48.576176 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3ded9641-55db-4fa2-864d-d2c75eeaaa02 req-ed75923c-f08b-4989-b646-4b3c80a48067 service nova] Creating event network-changed:55ea9702-4291-4cad-8c7f-ce2ff4027302 for instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a on n-h1-858384-19 Nov 02 13:27:48.590314 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3ded9641-55db-4fa2-864d-d2c75eeaaa02 req-ed75923c-f08b-4989-b646-4b3c80a48067 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148732 Nov 02 13:27:48.592012 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1586/3521] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:49.135507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:49.136222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:49.136681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:49.145730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:49.146226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:49.155461 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fcaa6101-e556-4966-a2c7-2443911c5038 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1318 microversion: 2.1 time: 1.522930 Nov 02 13:27:49.157402 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1936/3522] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:47 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1318 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:49.164122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:49.164909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:49.165389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:49.165828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:49.865279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:49.974571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:50.028126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-4a095906-5ea8-497c-aa69-b1e17336849a req-724d399c-9869-4721-babb-d7a293ef8584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a0aa59-efb1-4c34-bca2-780b90088e7f", "tag": "065e6efd-a2b8-42c7-a53e-45a0713a89cd"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:50.053629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4a095906-5ea8-497c-aa69-b1e17336849a req-724d399c-9869-4721-babb-d7a293ef8584 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:50.054443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4a095906-5ea8-497c-aa69-b1e17336849a req-724d399c-9869-4721-babb-d7a293ef8584 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:50.055068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4a095906-5ea8-497c-aa69-b1e17336849a req-724d399c-9869-4721-babb-d7a293ef8584 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:50.077404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:50.087486 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-4a095906-5ea8-497c-aa69-b1e17336849a req-724d399c-9869-4721-babb-d7a293ef8584 service nova] Creating event network-changed:065e6efd-a2b8-42c7-a53e-45a0713a89cd for instance 45a0aa59-efb1-4c34-bca2-780b90088e7f on n-h2-858384-19 Nov 02 13:27:50.090143 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d1ab5f4-a9d2-42ff-9263-77925c067bd2 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1319 microversion: 2.1 time: 0.958954 Nov 02 13:27:50.096135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1587/3523] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:49 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1319 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:50.102712 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-4a095906-5ea8-497c-aa69-b1e17336849a req-724d399c-9869-4721-babb-d7a293ef8584 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078388 Nov 02 13:27:50.103682 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1937/3524] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:50.187138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:50.188439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:50.203091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:50.205100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:50.208041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:50.209350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:50.212622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:50.214548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:50.797353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:50.853763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-037a8a1f-932e-463b-a27f-a6394599adf2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1318 microversion: 2.1 time: 0.672153 Nov 02 13:27:50.874318 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1588/3525] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:50 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:51.121767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:51.123161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:51.141754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:51.142754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:51.143401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:51.144358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:51.149487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:51.151555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:51.425644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:51.449367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ecf6d82-49a0-45d2-9787-a484a72993fa tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1319 microversion: 2.1 time: 0.332359 Nov 02 13:27:51.463138 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1938/3526] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:51 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:51.883335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:51.884665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:51.901416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:51.901957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:51.902403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:51.903150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:51.906428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:51.908322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:52.317609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:52.331658 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-990a654e-8806-449a-b513-f5b3fd41c2d6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1318 microversion: 2.1 time: 0.452542 Nov 02 13:27:52.332640 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1589/3527] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:51 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:52.478075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:52.478756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:52.488758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:52.489903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:52.490910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:52.491990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:52.492621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:52.493421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:52.874987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:52.884097 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-542fce74-cac6-429c-a7c0-02a9787049ba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1319 microversion: 2.1 time: 0.409858 Nov 02 13:27:52.892716 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1939/3528] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:52 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:53.360803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:53.361675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:53.397124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:53.402485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:53.404327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:53.413716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:53.414601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:53.416383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:53.923283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:53.924886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:53.927478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:53.930312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:53.955366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:53.955876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:53.956325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:53.957050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:53.957508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:53.957933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:55.033655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:55.044428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:55.083316 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0eecbb87-5849-428a-8af5-16a7c35fb7ce tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1319 microversion: 2.1 time: 1.164879 Nov 02 13:27:55.084286 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1940/3529] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:53 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1319 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:55.085006 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-70361576-0466-4fa2-9917-1bbf011fb4e8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1318 microversion: 2.1 time: 1.718429 Nov 02 13:27:55.085976 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1590/3530] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:53 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1318 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:56.118408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:56.120205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:56.133779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:56.134466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:56.146835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:56.148130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:56.149462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:56.150656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:56.151381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:56.153208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:56.157250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:56.158063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:56.158519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:56.159315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:56.159770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:56.160391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:56.495569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:56.505978 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5933f4c7-2a8a-4513-9dd4-7a47c0b82c10 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1319 microversion: 2.1 time: 0.396693 Nov 02 13:27:56.508711 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1941/3531] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:56 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:56.515676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0da22d83-b7ef-4ef3-853c-3609452187bf req-a8418a14-75b7-4ff2-a526-ca881be9a445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9bd4071-e51a-429d-9e8e-d9ca8c26a37a", "name": "network-vif-plugged", "status": "completed", "tag": "55ea9702-4291-4cad-8c7f-ce2ff4027302"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:56.546062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0da22d83-b7ef-4ef3-853c-3609452187bf req-a8418a14-75b7-4ff2-a526-ca881be9a445 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:56.546782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0da22d83-b7ef-4ef3-853c-3609452187bf req-a8418a14-75b7-4ff2-a526-ca881be9a445 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:56.554231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:56.558104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0da22d83-b7ef-4ef3-853c-3609452187bf req-a8418a14-75b7-4ff2-a526-ca881be9a445 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:56.565457 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57501bd9-fbd8-4f17-a93e-6dd3bbd07e58 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1318 microversion: 2.1 time: 0.437222 Nov 02 13:27:56.571182 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1591/3532] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:56 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:56.582760 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0da22d83-b7ef-4ef3-853c-3609452187bf req-a8418a14-75b7-4ff2-a526-ca881be9a445 service nova] Creating event network-vif-plugged:55ea9702-4291-4cad-8c7f-ce2ff4027302 for instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a on n-h1-858384-19 Nov 02 13:27:56.593637 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0da22d83-b7ef-4ef3-853c-3609452187bf req-a8418a14-75b7-4ff2-a526-ca881be9a445 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081609 Nov 02 13:27:56.595676 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1942/3533] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:56.805346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49d8049d-cc69-447d-9a0b-590577545cbc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:56.809888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49d8049d-cc69-447d-9a0b-590577545cbc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:56.824769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49d8049d-cc69-447d-9a0b-590577545cbc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:56.826201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49d8049d-cc69-447d-9a0b-590577545cbc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:56.826885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49d8049d-cc69-447d-9a0b-590577545cbc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:56.832879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49d8049d-cc69-447d-9a0b-590577545cbc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:56.833574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49d8049d-cc69-447d-9a0b-590577545cbc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:56.834203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49d8049d-cc69-447d-9a0b-590577545cbc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:56.899623 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49d8049d-cc69-447d-9a0b-590577545cbc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099101 Nov 02 13:27:56.911471 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1592/3534] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:27:56 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:27:57.014349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0f8cadc7-7204-41f9-b881-b3a23b446312 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:57.018266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0f8cadc7-7204-41f9-b881-b3a23b446312 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:57.029288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f8cadc7-7204-41f9-b881-b3a23b446312 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.030130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f8cadc7-7204-41f9-b881-b3a23b446312 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.030802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f8cadc7-7204-41f9-b881-b3a23b446312 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.031863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f8cadc7-7204-41f9-b881-b3a23b446312 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.032546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f8cadc7-7204-41f9-b881-b3a23b446312 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.033206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f8cadc7-7204-41f9-b881-b3a23b446312 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.068742 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0f8cadc7-7204-41f9-b881-b3a23b446312 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058743 Nov 02 13:27:57.069979 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1943/3535] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:27:57 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:27:57.200307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:57.201123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:57.210752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.221988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.222614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.223520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.224099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.224633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.271406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:27:57.455182 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-846b97b6-a1ce-4f26-9fc0-b1a5e711f6b0 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "DELETE /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 204 len: 0 microversion: 2.1 time: 0.258473 Nov 02 13:27:57.461825 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1593/3536] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:27:57 2022] DELETE /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:27:57.466787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:57.467431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:57.480761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.481244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.482124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.484308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.485968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.486615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.534090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:57.537390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:57.554758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.555649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.556307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.557244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.557811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.558346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.754587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:57.781269 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a08cdc49-c915-4fbe-81e4-8d0c31de36ef tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1319 microversion: 2.1 time: 0.252318 Nov 02 13:27:57.792366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1594/3537] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:57 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:27:57.804685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:57.807743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:57.825595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.827570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.830106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.830876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:57.831381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:57.831822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:57.847025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:27:57.883538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:57.892362 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-213f5681-ac1a-4bc9-b512-d610fbd8054e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1683 microversion: 2.1 time: 0.429276 Nov 02 13:27:57.907866 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1944/3538] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:57 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1683 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:58.097585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:58.107847 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7848e409-d7f2-42d7-982a-71c99392052a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1318 microversion: 2.1 time: 0.316447 Nov 02 13:27:58.108770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1595/3539] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:57 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:58.615522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-35680bbe-ca05-462d-91ec-0b31c28a8bd0 req-7a79ea92-e370-4308-a775-5a7ad8012a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a0aa59-efb1-4c34-bca2-780b90088e7f", "name": "network-vif-plugged", "status": "completed", "tag": "065e6efd-a2b8-42c7-a53e-45a0713a89cd"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:58.629848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-35680bbe-ca05-462d-91ec-0b31c28a8bd0 req-7a79ea92-e370-4308-a775-5a7ad8012a88 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:58.631220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-35680bbe-ca05-462d-91ec-0b31c28a8bd0 req-7a79ea92-e370-4308-a775-5a7ad8012a88 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:58.631892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-35680bbe-ca05-462d-91ec-0b31c28a8bd0 req-7a79ea92-e370-4308-a775-5a7ad8012a88 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:58.646094 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-35680bbe-ca05-462d-91ec-0b31c28a8bd0 req-7a79ea92-e370-4308-a775-5a7ad8012a88 service nova] Creating event network-vif-plugged:065e6efd-a2b8-42c7-a53e-45a0713a89cd for instance 45a0aa59-efb1-4c34-bca2-780b90088e7f on n-h2-858384-19 Nov 02 13:27:58.651709 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-35680bbe-ca05-462d-91ec-0b31c28a8bd0 req-7a79ea92-e370-4308-a775-5a7ad8012a88 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042569 Nov 02 13:27:58.659649 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1945/3540] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:27:58.813041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:58.814549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:58.830722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:58.831706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:58.833418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:58.834436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:58.835337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:58.836265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:58.929574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:58.930952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:58.948968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:58.952419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:58.953905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:58.961235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:58.962546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:58.963398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:59.143635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:59.153675 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c5b25ea6-ee0c-4a6b-bf3d-99312538551b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1319 microversion: 2.1 time: 0.346299 Nov 02 13:27:59.155849 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1596/3541] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:58 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:59.162251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:27:59.163063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:59.171833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:59.172740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:59.173289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:59.174401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:59.174872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:59.175770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:59.425356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:59.461091 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0ebd6ab-89fe-4095-a711-65df3ee80440 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1506 microversion: 2.1 time: 0.301212 Nov 02 13:27:59.462516 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1597/3542] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:59 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:59.487102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1795426446"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:27:59.487696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:27:59.495800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:59.496307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:59.496903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:59.497633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:27:59.498120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:27:59.498683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:27:59.523357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:27:59.537342 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7777a462-f684-48d1-844c-3c18094b337b tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1683 microversion: 2.1 time: 0.617034 Nov 02 13:27:59.537942 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1946/3543] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:27:58 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1683 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:27:59.720091 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.network.security_group_api [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Adding security group db070fd2-9920-4bf0-aaf4-e7e37cd536a5 to port 55ea9702-4291-4cad-8c7f-ce2ff4027302 Nov 02 13:28:00.183045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:00.183771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:00.197695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:00.198671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:00.199179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:00.201638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:00.204331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:00.208134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:00.226440 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-000b38c9-3508-4fdc-be73-0e7e1e780ce9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a/action" status: 202 len: 0 microversion: 2.1 time: 0.741362 Nov 02 13:28:00.226440 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1598/3544] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:27:59 2022] POST /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:28:00.239041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-580373385"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:00.239750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:00.255536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:00.256139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:00.256664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:00.259070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:00.259754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:00.269407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:00.480035 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.network.security_group_api [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Adding security group 98f79738-7aef-4468-908b-334b8f35fa17 to port 55ea9702-4291-4cad-8c7f-ce2ff4027302 Nov 02 13:28:00.716931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:00.735213 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3408e3f6-454a-4863-a12b-073247be1e21 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1319 microversion: 2.1 time: 0.556594 Nov 02 13:28:00.743958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1947/3545] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:00 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:00.759942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-524b3ce0-d199-4822-8220-0035c81c2083 req-0a752297-b0bf-48ff-90c4-d665b65c7452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9bd4071-e51a-429d-9e8e-d9ca8c26a37a", "tag": "55ea9702-4291-4cad-8c7f-ce2ff4027302"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:00.800495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-524b3ce0-d199-4822-8220-0035c81c2083 req-0a752297-b0bf-48ff-90c4-d665b65c7452 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:00.804446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-524b3ce0-d199-4822-8220-0035c81c2083 req-0a752297-b0bf-48ff-90c4-d665b65c7452 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:00.809620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-524b3ce0-d199-4822-8220-0035c81c2083 req-0a752297-b0bf-48ff-90c4-d665b65c7452 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:00.834809 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-524b3ce0-d199-4822-8220-0035c81c2083 req-0a752297-b0bf-48ff-90c4-d665b65c7452 service nova] Creating event network-changed:55ea9702-4291-4cad-8c7f-ce2ff4027302 for instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a on n-h1-858384-19 Nov 02 13:28:00.846195 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-524b3ce0-d199-4822-8220-0035c81c2083 req-0a752297-b0bf-48ff-90c4-d665b65c7452 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099835 Nov 02 13:28:00.847197 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1948/3546] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:00.853520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:00.854501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:00.863631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:00.864627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:00.865386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:00.866922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:00.868122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:00.868951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:00.928443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:01.662377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:01.671328 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e247ea56-2631-46c9-a1bb-ecd8606cc30d tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1683 microversion: 2.1 time: 0.822448 Nov 02 13:28:01.673912 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1949/3547] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:00 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1683 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:01.767797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:01.768666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:01.785811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:01.787033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:01.787842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:01.788946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:01.791101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:01.791973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:01.815698 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2f6eb10e-d459-4863-a839-a92f7cbe24ac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a/action" status: 202 len: 0 microversion: 2.1 time: 1.586545 Nov 02 13:28:01.817276 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1599/3548] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:28:00 2022] POST /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a/action => generated 0 bytes in 1589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:28:01.827724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-35bc3033-7249-4520-9a4a-501a3ad72bb5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:01.828724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-35bc3033-7249-4520-9a4a-501a3ad72bb5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:01.866637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35bc3033-7249-4520-9a4a-501a3ad72bb5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:01.869658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35bc3033-7249-4520-9a4a-501a3ad72bb5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:01.871436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35bc3033-7249-4520-9a4a-501a3ad72bb5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:01.872933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35bc3033-7249-4520-9a4a-501a3ad72bb5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:01.874818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35bc3033-7249-4520-9a4a-501a3ad72bb5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:01.876298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35bc3033-7249-4520-9a4a-501a3ad72bb5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.145870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:02.157125 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff732f54-380c-4cf5-8cb0-bec11e2e2278 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1505 microversion: 2.1 time: 0.393774 Nov 02 13:28:02.163949 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1950/3549] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:01 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:02.196639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:02.197544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:02.206682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:02.207492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:02.208951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.209898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:02.211064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:02.211748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.266991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lazy-loading 'flavor' on Instance uuid 45a0aa59-efb1-4c34-bca2-780b90088e7f {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:28:02.722315 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2c551fe2-b157-45d6-b13d-3bf0e9d814c7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f/action" status: 202 len: 0 microversion: 2.1 time: 0.536311 Nov 02 13:28:02.724642 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1951/3550] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:28:02 2022] POST /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:28:02.743105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ad3cf2de-33d4-4655-bbdb-de464edb035d req-76807d7c-90d5-4de6-b7d8-8bb008b3ce6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1839e8d-7af9-46b2-a7f4-bc09f7585d3c", "name": "network-vif-deleted", "tag": "58cad526-c321-4747-8c01-e8fdb18337d9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:02.764855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ad3cf2de-33d4-4655-bbdb-de464edb035d req-76807d7c-90d5-4de6-b7d8-8bb008b3ce6f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:02.767299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ad3cf2de-33d4-4655-bbdb-de464edb035d req-76807d7c-90d5-4de6-b7d8-8bb008b3ce6f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:02.768044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ad3cf2de-33d4-4655-bbdb-de464edb035d req-76807d7c-90d5-4de6-b7d8-8bb008b3ce6f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.833161 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ad3cf2de-33d4-4655-bbdb-de464edb035d req-76807d7c-90d5-4de6-b7d8-8bb008b3ce6f service nova] Creating event network-vif-deleted:58cad526-c321-4747-8c01-e8fdb18337d9 for instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c on n-h2-858384-19 Nov 02 13:28:02.839611 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ad3cf2de-33d4-4655-bbdb-de464edb035d req-76807d7c-90d5-4de6-b7d8-8bb008b3ce6f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112822 Nov 02 13:28:02.840538 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1952/3551] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:02.846506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:02.847229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:02.853598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:02.854075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:02.854689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.855743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:02.856352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:02.857295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.869633 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-35bc3033-7249-4520-9a4a-501a3ad72bb5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.047837 Nov 02 13:28:02.876762 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1600/3552] 10.222.0.113 () {58 vars in 1298 bytes} [Wed Nov 2 13:28:01 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a/os-security-groups => generated 1158 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:02.884329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:02.886207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:02.899073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:02.899794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:02.900400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.901503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:02.903804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:02.904409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.935007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:02.935603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:02.936054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:02.936510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lazy-loading 'fault' on Instance uuid b1839e8d-7af9-46b2-a7f4-bc09f7585d3c {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:28:03.006499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f635fead26c9417c9781b527efc9353e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d4814779354fb6be0cfd8213a1ef83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:03.016469 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5286c303-6513-4a68-b606-744854f343e1 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 200 len: 1335 microversion: 2.1 time: 0.174348 Nov 02 13:28:03.019956 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1953/3553] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:02 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 1335 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:03.032108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bd19c27d-0aec-4a79-97cf-5051c8d8cda2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: .version_select at 0x7fe787763160>, body: {"security_group": {"name": " tempest-securitygroup -1139864074 ", "description": "tempest-description-145056476"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:03.202616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:03.214869 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-15180c25-0b5c-481d-a38c-26b7bdb33975 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.340941 Nov 02 13:28:03.230594 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1601/3554] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:02 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:03.243797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-22058e1d-3d5a-489a-b19c-1fb92dc9fd95 req-e8b587a7-9269-40cf-acf9-4a8601201934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9bd4071-e51a-429d-9e8e-d9ca8c26a37a", "tag": "55ea9702-4291-4cad-8c7f-ce2ff4027302"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:03.255995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-22058e1d-3d5a-489a-b19c-1fb92dc9fd95 req-e8b587a7-9269-40cf-acf9-4a8601201934 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:03.256734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-22058e1d-3d5a-489a-b19c-1fb92dc9fd95 req-e8b587a7-9269-40cf-acf9-4a8601201934 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:03.257345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-22058e1d-3d5a-489a-b19c-1fb92dc9fd95 req-e8b587a7-9269-40cf-acf9-4a8601201934 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:03.272389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-22058e1d-3d5a-489a-b19c-1fb92dc9fd95 req-e8b587a7-9269-40cf-acf9-4a8601201934 service nova] Creating event network-changed:55ea9702-4291-4cad-8c7f-ce2ff4027302 for instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a on n-h1-858384-19 Nov 02 13:28:03.278339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-22058e1d-3d5a-489a-b19c-1fb92dc9fd95 req-e8b587a7-9269-40cf-acf9-4a8601201934 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046430 Nov 02 13:28:03.279198 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1602/3555] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:03.508346 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bd19c27d-0aec-4a79-97cf-5051c8d8cda2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.487130 Nov 02 13:28:03.509193 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1954/3556] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:28:03 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:03.524392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-951aa506-1851-48e4-817b-e85d9b891ca3 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe787cc03a0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:03.708969 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-951aa506-1851-48e4-817b-e85d9b891ca3 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25" status: 200 len: 223 microversion: 2.1 time: 0.187336 Nov 02 13:28:03.721740 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1603/3557] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:28:03 2022] GET /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25 => generated 223 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:03.722985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fac71da-be04-4dc1-8b6b-300cd3340b3f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786c4d700>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:04.047327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:04.049417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:04.064930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:04.067740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:04.069152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:04.070080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:04.072224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:04.072948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:04.094055 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] HTTP exception thrown: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Request method failure captured: Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c HTTP/1.1 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm9qFsZAilHBfe7m8Z2jRFEgJ9RBsY36ctxHX7W48eAbm17HDAjZ3DCc4A7FBJAjs-0fR_hnhC8CC6q9INisoeWYyI1flDwKuNfcb8Ac7Qw9SEYytlKiXikA__bv0W2OOT0w7iCtxVQ4uG0-sJ8tAhiCjNJyV5NiLk1jaN8l7NpW4W0 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 26d4814779354fb6be0cfd8213a1ef83 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1189509588 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1189509588 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 26d4814779354fb6be0cfd8213a1ef83 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1189509588 Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachSCSIVolumeTestJSON-1189509588-project Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f635fead26c9417c9781b527efc9353e Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1189509588-project Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'b1839e8d-7af9-46b2-a7f4-bc09f7585d3c'} Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:04.097767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:04.102984 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:04.102984 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:04.102984 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:04.102984 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:04.102984 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:04.102984 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:04.102984 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:04.105377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Returning 404 to user: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:04.106436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9cdbef20-2216-402e-9f7d-b1f9abb355a7 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 404 len: 111 microversion: 2.1 time: 0.064644 Nov 02 13:28:04.107558 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1604/3558] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:04 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:28:04.132241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-675ce97f-28a4-4c2d-b0d4-b7314c7653bc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '.version_select at 0x7fe78f90eaf0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:04.205570 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-675ce97f-28a4-4c2d-b0d4-b7314c7653bc tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014336364" status: 202 len: 0 microversion: 2.1 time: 0.084975 Nov 02 13:28:04.208030 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1605/3559] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:28:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014336364 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:28:04.244981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:04.245808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:04.273585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:04.274301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:04.274929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:04.280691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:04.284087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:04.284801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:04.295247 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3fac71da-be04-4dc1-8b6b-300cd3340b3f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25" status: 202 len: 0 microversion: 2.1 time: 0.576793 Nov 02 13:28:04.296802 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1955/3560] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:28:03 2022] DELETE /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:28:04.306165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12be0a68-a07c-462b-97d5-ee3ed9a90fc4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe78f953310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:04.911820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:04.920874 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c76dbafe-c006-4811-b7df-88ac8d279e57 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.681283 Nov 02 13:28:04.923260 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1606/3561] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:04 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:05.033694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-12be0a68-a07c-462b-97d5-ee3ed9a90fc4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:28:05.034440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-12be0a68-a07c-462b-97d5-ee3ed9a90fc4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group aa3eca1a-51f4-4953-9a77-62ba45818d25 not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:28:05.035154 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-12be0a68-a07c-462b-97d5-ee3ed9a90fc4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:28:05.035154 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-acf2db6c-ff9d-4b6b-a856-6e3bbe4cebfe'] Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12be0a68-a07c-462b-97d5-ee3ed9a90fc4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25 HTTP/1.1 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-acf2db6c-ff9d-4b6b-a856-6e3bbe4cebfe'] Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'aa3eca1a-51f4-4953-9a77-62ba45818d25'} Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:28:05.037872 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acf2db6c-ff9d-4b6b-a856-6e3bbe4cebfe'] Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acf2db6c-ff9d-4b6b-a856-6e3bbe4cebfe'] Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acf2db6c-ff9d-4b6b-a856-6e3bbe4cebfe'] Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-acf2db6c-ff9d-4b6b-a856-6e3bbe4cebfe'] Nov 02 13:28:05.041873 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:05.049590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12be0a68-a07c-462b-97d5-ee3ed9a90fc4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:28:05.049590 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-acf2db6c-ff9d-4b6b-a856-6e3bbe4cebfe'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:05.051811 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12be0a68-a07c-462b-97d5-ee3ed9a90fc4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25" status: 404 len: 194 microversion: 2.1 time: 0.750442 Nov 02 13:28:05.052965 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1956/3562] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:28:04 2022] GET /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25 => generated 194 bytes in 752 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:28:05.067463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-37bd2746-b844-4e94-81d9-92b31e7442a9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: .version_select at 0x7fe78f84e160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-905397877", "description": "tempest-description-210021406"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:05.673339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-37bd2746-b844-4e94-81d9-92b31e7442a9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.612882 Nov 02 13:28:05.674356 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1607/3563] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:28:05 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:28:05.700689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-271aed23-0cd7-48d3-8e0c-d742b33a2c2a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: .version_select at 0x7fe786e6fee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-708963911", "description": "tempest-description-732545054"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:05.951704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:05.953578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:05.961769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:05.973672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:05.977581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:05.979233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:05.980407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:05.985532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:05.986485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:06.076219 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-271aed23-0cd7-48d3-8e0c-d742b33a2c2a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.392611 Nov 02 13:28:06.077153 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1957/3564] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:28:05 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:28:06.404280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6479a08d-9774-4c23-85a2-9b4ba59426d6"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:06.408324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:06.427606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:06.428384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:06.429048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:06.430171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:06.431005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:06.432717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:06.546354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:06.557598 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b68d359a-463a-435c-a2ea-8111dcd9fa2a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.612706 Nov 02 13:28:06.559833 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1608/3565] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:05 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:06.571834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0e226d85-c942-41f8-ab4d-a30026eb35bd tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: .version_select at 0x7fe78f876160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-817453277", "description": "tempest-description-1443514706"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:06.659567 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] HTTP exception thrown: Volume 6479a08d-9774-4c23-85a2-9b4ba59426d6 could not be found. Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Request method failure captured: Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments/98d5ddea-57b1-4521-be0b-5a993f2d785f HTTP/1.1 Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 74 Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_H_TPfJO6akXiBbnwEeZs9z5Lr_1pJH4DuYYnw6WcBARwvXs9fMPfvKbFfj-A5XSOfXxLvTNitj-QcS8D4_cU_2HfDoORQnM1tx1HjCeXJ38pDMBXW0jOCh1LTKg947gFTAVL3Q-I7ZlBSpuAc1K2f-eDFBcLtm-kJ92n5dXcL11E Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dfc11f4ca0564eff9e3deb99f70141db Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesAdminNegativeTest-1663731763 Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dfc11f4ca0564eff9e3deb99f70141db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dfc11f4ca0564eff9e3deb99f70141db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dfc11f4ca0564eff9e3deb99f70141db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dfc11f4ca0564eff9e3deb99f70141db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesAdminNegativeTest-1663731763 Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dfc11f4ca0564eff9e3deb99f70141db Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1663731763 Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesAdminNegativeTest-1663731763-project-admin Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: d910c8ed2b7749ebbc8e23ee4526885f Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesAdminNegativeTest-1663731763-project-admin Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: {"volumeAttachment": {"volumeId": "6479a08d-9774-4c23-85a2-9b4ba59426d6"}} Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: exception: Volume 6479a08d-9774-4c23-85a2-9b4ba59426d6 could not be found. Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'server_id': 'fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05', 'id': '98d5ddea-57b1-4521-be0b-5a993f2d785f', 'body': {'volumeAttachment': {'volumeId': '6479a08d-9774-4c23-85a2-9b4ba59426d6'}}} Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6479a08d-9774-4c23-85a2-9b4ba59426d6 could not be found. (HTTP 404) (Request-ID: req-3034494e-61b0-489c-a99b-99e9fc021337) Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:28:06.661849 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6479a08d-9774-4c23-85a2-9b4ba59426d6 could not be found. Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 6479a08d-9774-4c23-85a2-9b4ba59426d6 could not be found. Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6479a08d-9774-4c23-85a2-9b4ba59426d6 could not be found. Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Returning 400 to user: Volume 6479a08d-9774-4c23-85a2-9b4ba59426d6 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8670d6ef-e51a-429a-ae0d-07998640e5a0 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] 10.222.0.113 "PUT /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments/98d5ddea-57b1-4521-be0b-5a993f2d785f" status: 400 len: 107 microversion: 2.1 time: 0.585354 Nov 02 13:28:06.666662 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1958/3566] 10.222.0.113 () {60 vars in 1438 bytes} [Wed Nov 2 13:28:06 2022] PUT /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments/98d5ddea-57b1-4521-be0b-5a993f2d785f => generated 107 bytes in 587 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:28:06.733452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-197161963", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "964f9535-6334-4273-b101-4e662c8559a6"}], "security_groups": [{"name": "tempest-securitygroup--1228768111"}], "key_name": "tempest-keypair-325163301", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6fe80c66-9bb8-4634-ae17-52eb06da01cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:06.907960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] validate_networks() for [('964f9535-6334-4273-b101-4e662c8559a6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:28:07.026343 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0e226d85-c942-41f8-ab4d-a30026eb35bd tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.463804 Nov 02 13:28:07.027400 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1609/3567] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:28:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:07.034438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:07.035735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:07.064447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:07.065346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:07.066042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:07.066981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:07.067692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:07.068458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:07.247692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lazy-loading 'services' on Instance uuid fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:28:07.342256 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c1de3d91-dceb-403c-bfeb-0566bae9ab1b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments/98d5ddea-57b1-4521-be0b-5a993f2d785f" status: 202 len: 0 microversion: 2.1 time: 0.313105 Nov 02 13:28:07.344014 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1610/3568] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:28:07 2022] DELETE /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments/98d5ddea-57b1-4521-be0b-5a993f2d785f => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:28:07.351088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-efa7b0e9-8d0c-495a-ac7e-65b6bd6e020e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe787e855e0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:07.740598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Getting quotas for project 0d74750aac324a3ab667af124ed2691b. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:28:07.748772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Getting quotas for user ca29fecc3e35486ba22ef8a7b415c63c and project 0d74750aac324a3ab667af124ed2691b. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:28:07.767159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:28:07.767785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:28:07.768497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:28:07.769111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:28:07.769737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:28:07.801010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:07.801610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:07.802298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:07.803450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:07.804112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:07.804746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:07.824544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Getting quotas for project 0d74750aac324a3ab667af124ed2691b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:28:07.831756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Getting quotas for user ca29fecc3e35486ba22ef8a7b415c63c and project 0d74750aac324a3ab667af124ed2691b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:28:07.860731 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-efa7b0e9-8d0c-495a-ac7e-65b6bd6e020e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.515097 Nov 02 13:28:07.873565 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1611/3569] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:28:07 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:07.890253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f722b4b-aeef-43b3-ae11-c2c7a8f90232 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:07.896237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6f722b4b-aeef-43b3-ae11-c2c7a8f90232 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:07.917385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f722b4b-aeef-43b3-ae11-c2c7a8f90232 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:07.917963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f722b4b-aeef-43b3-ae11-c2c7a8f90232 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:07.918554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f722b4b-aeef-43b3-ae11-c2c7a8f90232 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:07.919355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f722b4b-aeef-43b3-ae11-c2c7a8f90232 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:07.922443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f722b4b-aeef-43b3-ae11-c2c7a8f90232 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:07.922590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f722b4b-aeef-43b3-ae11-c2c7a8f90232 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:07.967987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:28:07.971975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6fe80c66-9bb8-4634-ae17-52eb06da01cf',volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:28:07.996534 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f722b4b-aeef-43b3-ae11-c2c7a8f90232 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120225 Nov 02 13:28:08.000040 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1612/3570] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:28:07 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:08.008524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:08.010343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:08.027495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:08.028442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:08.029129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:08.030078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:08.030763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:08.032046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:08.252228 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c6e140e0-c6d5-4431-8c5b-c45c3beb772d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.532152 Nov 02 13:28:08.256852 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1959/3571] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:28:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:28:08.268179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a415bed5-589a-47da-b2f3-d9248562016b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786e57af0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:08.372870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:08.389431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0eecc39e-90da-4cff-914d-b09683ed0940 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.387855 Nov 02 13:28:08.390044 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1613/3572] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:08 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:08.411146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-73f59ca6-7298-4574-a4ef-8ec1fa83c8c3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:08.418487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-73f59ca6-7298-4574-a4ef-8ec1fa83c8c3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:08.741582 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a415bed5-589a-47da-b2f3-d9248562016b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/4f4ad4ca-1ad5-4e1f-8888-9c7f54579019" status: 202 len: 0 microversion: 2.1 time: 0.483183 Nov 02 13:28:08.742755 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1960/3573] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:28:08 2022] DELETE /compute/v2.1/os-security-groups/4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:28:08.752995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9138bd46-b526-40b8-8374-929b6c118f23 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786aa73a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:08.799617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-9138bd46-b526-40b8-8374-929b6c118f23 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:28:08.800792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-9138bd46-b526-40b8-8374-929b6c118f23 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:28:08.801388 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-9138bd46-b526-40b8-8374-929b6c118f23 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:28:08.801388 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-52f6498a-193f-47de-b02f-78ada15a7e28'] Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9138bd46-b526-40b8-8374-929b6c118f23 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-security-groups/4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 HTTP/1.1 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-52f6498a-193f-47de-b02f-78ada15a7e28'] Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '4f4ad4ca-1ad5-4e1f-8888-9c7f54579019'} Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:28:08.804031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52f6498a-193f-47de-b02f-78ada15a7e28'] Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52f6498a-193f-47de-b02f-78ada15a7e28'] Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52f6498a-193f-47de-b02f-78ada15a7e28'] Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52f6498a-193f-47de-b02f-78ada15a7e28'] Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9138bd46-b526-40b8-8374-929b6c118f23 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-52f6498a-193f-47de-b02f-78ada15a7e28'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9138bd46-b526-40b8-8374-929b6c118f23 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups/4f4ad4ca-1ad5-4e1f-8888-9c7f54579019" status: 404 len: 194 microversion: 2.1 time: 0.059272 Nov 02 13:28:08.811694 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1961/3574] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:28:08 2022] GET /compute/v2.1/os-security-groups/4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:28:08.832393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d83f052-a489-4ce2-8618-549251140f57 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786c6f0d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:09.046397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-73f59ca6-7298-4574-a4ef-8ec1fa83c8c3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:09.058800 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-73f59ca6-7298-4574-a4ef-8ec1fa83c8c3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1123 microversion: 2.1 time: 0.664543 Nov 02 13:28:09.060534 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1614/3575] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:08 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1123 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:09.081420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d332e89-6b62-466f-9fcb-102ed06e4738 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:09.091583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9d332e89-6b62-466f-9fcb-102ed06e4738 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:09.105239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d332e89-6b62-466f-9fcb-102ed06e4738 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:09.105737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d332e89-6b62-466f-9fcb-102ed06e4738 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:09.106177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d332e89-6b62-466f-9fcb-102ed06e4738 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:09.106888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d332e89-6b62-466f-9fcb-102ed06e4738 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:09.107365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d332e89-6b62-466f-9fcb-102ed06e4738 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:09.107793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d332e89-6b62-466f-9fcb-102ed06e4738 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:09.178229 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d332e89-6b62-466f-9fcb-102ed06e4738 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114507 Nov 02 13:28:09.178828 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1615/3576] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:28:09 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:09.416225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:09.416960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:09.428464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:09.430807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:09.431389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:09.433321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:09.433792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:09.434224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:09.662312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d83f052-a489-4ce2-8618-549251140f57 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/7c88be4e-df90-49ba-9efa-287efbc0f43e" status: 202 len: 0 microversion: 2.1 time: 0.838770 Nov 02 13:28:09.663300 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1962/3577] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:28:08 2022] DELETE /compute/v2.1/os-security-groups/7c88be4e-df90-49ba-9efa-287efbc0f43e => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:28:09.672273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-254b17e5-e991-4a8b-8396-1aa68f0f14ca tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786c4d820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:09.734967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-254b17e5-e991-4a8b-8396-1aa68f0f14ca tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:28:09.736026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-254b17e5-e991-4a8b-8396-1aa68f0f14ca tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group 7c88be4e-df90-49ba-9efa-287efbc0f43e not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:28:09.736541 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-254b17e5-e991-4a8b-8396-1aa68f0f14ca tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:28:09.736541 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-1563f71c-0c8f-4d06-af2a-dfd9c8ff2ea5'] Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-254b17e5-e991-4a8b-8396-1aa68f0f14ca tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-security-groups/7c88be4e-df90-49ba-9efa-287efbc0f43e HTTP/1.1 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-1563f71c-0c8f-4d06-af2a-dfd9c8ff2ea5'] Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7c88be4e-df90-49ba-9efa-287efbc0f43e'} Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:28:09.739076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1563f71c-0c8f-4d06-af2a-dfd9c8ff2ea5'] Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1563f71c-0c8f-4d06-af2a-dfd9c8ff2ea5'] Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1563f71c-0c8f-4d06-af2a-dfd9c8ff2ea5'] Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1563f71c-0c8f-4d06-af2a-dfd9c8ff2ea5'] Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-254b17e5-e991-4a8b-8396-1aa68f0f14ca tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-1563f71c-0c8f-4d06-af2a-dfd9c8ff2ea5'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-254b17e5-e991-4a8b-8396-1aa68f0f14ca tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups/7c88be4e-df90-49ba-9efa-287efbc0f43e" status: 404 len: 194 microversion: 2.1 time: 0.073697 Nov 02 13:28:09.745909 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1963/3578] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:28:09 2022] GET /compute/v2.1/os-security-groups/7c88be4e-df90-49ba-9efa-287efbc0f43e => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:28:09.754514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79d2153d-4001-4966-be64-032b7fe39489 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786c6f280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:09.893864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:09.904158 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e1eebb16-40d5-4bcc-9109-80cf5b936dc1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.492424 Nov 02 13:28:09.920256 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1616/3579] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:09 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:10.082726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:10.084329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:10.095990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:10.096763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:10.097415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:10.098996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:10.099696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:10.100337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:10.174100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79d2153d-4001-4966-be64-032b7fe39489 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/03f63978-5541-4d1a-9120-0a4e2cc7897e" status: 202 len: 0 microversion: 2.1 time: 0.425245 Nov 02 13:28:10.177870 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1964/3580] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:28:09 2022] DELETE /compute/v2.1/os-security-groups/03f63978-5541-4d1a-9120-0a4e2cc7897e => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:28:10.182651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01a7d4e0-cd5b-4242-b980-00cdc076129c tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786c4d0d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:10.230291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-01a7d4e0-cd5b-4242-b980-00cdc076129c tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:28:10.230872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-01a7d4e0-cd5b-4242-b980-00cdc076129c tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group 03f63978-5541-4d1a-9120-0a4e2cc7897e not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:28:10.231423 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-01a7d4e0-cd5b-4242-b980-00cdc076129c tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:28:10.231423 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-255d0152-c9b9-47a0-aeb1-85dde1ddcb02'] Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01a7d4e0-cd5b-4242-b980-00cdc076129c tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/os-security-groups/03f63978-5541-4d1a-9120-0a4e2cc7897e HTTP/1.1 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-255d0152-c9b9-47a0-aeb1-85dde1ddcb02'] Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '03f63978-5541-4d1a-9120-0a4e2cc7897e'} Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:28:10.233776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-255d0152-c9b9-47a0-aeb1-85dde1ddcb02'] Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-255d0152-c9b9-47a0-aeb1-85dde1ddcb02'] Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-255d0152-c9b9-47a0-aeb1-85dde1ddcb02'] Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-255d0152-c9b9-47a0-aeb1-85dde1ddcb02'] Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01a7d4e0-cd5b-4242-b980-00cdc076129c tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-255d0152-c9b9-47a0-aeb1-85dde1ddcb02'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01a7d4e0-cd5b-4242-b980-00cdc076129c tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups/03f63978-5541-4d1a-9120-0a4e2cc7897e" status: 404 len: 194 microversion: 2.1 time: 0.057191 Nov 02 13:28:10.240349 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1965/3581] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:28:10 2022] GET /compute/v2.1/os-security-groups/03f63978-5541-4d1a-9120-0a4e2cc7897e => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:28:10.251355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a2405cb-d236-4ba7-979c-f64d848dd6cf tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:10.254078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a2405cb-d236-4ba7-979c-f64d848dd6cf tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:10.262094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:10.270335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a2405cb-d236-4ba7-979c-f64d848dd6cf tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:10.270995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a2405cb-d236-4ba7-979c-f64d848dd6cf tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:10.271531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a2405cb-d236-4ba7-979c-f64d848dd6cf tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:10.272279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a2405cb-d236-4ba7-979c-f64d848dd6cf tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:10.273063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a2405cb-d236-4ba7-979c-f64d848dd6cf tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:10.273733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a2405cb-d236-4ba7-979c-f64d848dd6cf tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:10.288691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:10.303378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6224608-e970-4396-9ee5-f4e49b16d504 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1221 microversion: 2.1 time: 0.224842 Nov 02 13:28:10.305597 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1617/3582] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:10 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1221 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:10.317161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-98540518-dd3f-4044-b14d-7b6dbda46fc5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe787d10f70>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:10.338468 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a2405cb-d236-4ba7-979c-f64d848dd6cf tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097665 Nov 02 13:28:10.339688 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1966/3583] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:28:10 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:10.792843 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-98540518-dd3f-4044-b14d-7b6dbda46fc5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.486060 Nov 02 13:28:10.804137 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1618/3584] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:28:10 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:10.811816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ab50905a-93ab-4806-acca-4fe09fe7295e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: .version_select at 0x7fe78789cc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1083141549", "description": "tempest-description-665416478"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:10.933625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:10.934421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:10.947569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:10.950360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:10.951514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:10.954290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:10.955982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:10.959369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:11.696321 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ab50905a-93ab-4806-acca-4fe09fe7295e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.889342 Nov 02 13:28:11.707903 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1967/3585] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:28:10 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:11.715180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:11.716090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:11.741692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:11.742574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:11.743653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:11.744849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:11.745474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:11.746065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:11.874498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:11.891834 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8b07366f-376c-49a2-a123-e9267efcdc79 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.962729 Nov 02 13:28:11.907139 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1619/3586] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:10 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:11.907139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce5476e1-b960-4210-b4af-fe98134da3b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:11.910356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ce5476e1-b960-4210-b4af-fe98134da3b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:11.925938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce5476e1-b960-4210-b4af-fe98134da3b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:11.929079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce5476e1-b960-4210-b4af-fe98134da3b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:11.929532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce5476e1-b960-4210-b4af-fe98134da3b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:11.931700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce5476e1-b960-4210-b4af-fe98134da3b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:11.932193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce5476e1-b960-4210-b4af-fe98134da3b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:11.932669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce5476e1-b960-4210-b4af-fe98134da3b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:11.977026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:12.005306 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce5476e1-b960-4210-b4af-fe98134da3b1 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099153 Nov 02 13:28:12.006406 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1620/3587] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:28:11 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:12.012504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94c8f2b0-c3ec-4dd7-8bfe-ea5790a47064 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: .version_select at 0x7fe78f888b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1769299038", "description": "tempest-description-987519221"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:12.361364 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94c8f2b0-c3ec-4dd7-8bfe-ea5790a47064 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.353634 Nov 02 13:28:12.375314 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1621/3588] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:28:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:12.410930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:12.419102 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-32dd3c95-ba96-4b28-a55c-62dc7ca5853c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1307 microversion: 2.1 time: 0.709657 Nov 02 13:28:12.446452 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1968/3589] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:11 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1307 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:12.599976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-405084222", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "e2f61ca9-e2f8-4fbb-90f1-d110e2455df2"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:12.838068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] validate_networks() for [('e2f61ca9-e2f8-4fbb-90f1-d110e2455df2', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:28:12.923505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:12.924358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:12.937556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:12.945746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:12.946441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:12.947390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:12.948026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:12.948464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:13.377415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:13.388560 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7dee4ad2-6908-4c18-a0da-c12fd8b627f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.472425 Nov 02 13:28:13.389852 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1969/3590] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:12 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:13.397161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5395129c-10ad-41f7-b48f-19ab7e0ebf74 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:13.400041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5395129c-10ad-41f7-b48f-19ab7e0ebf74 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:13.427184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5395129c-10ad-41f7-b48f-19ab7e0ebf74 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:13.430908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5395129c-10ad-41f7-b48f-19ab7e0ebf74 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:13.431485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5395129c-10ad-41f7-b48f-19ab7e0ebf74 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:13.432256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5395129c-10ad-41f7-b48f-19ab7e0ebf74 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:13.432708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5395129c-10ad-41f7-b48f-19ab7e0ebf74 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:13.435330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5395129c-10ad-41f7-b48f-19ab7e0ebf74 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:13.486081 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5395129c-10ad-41f7-b48f-19ab7e0ebf74 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092900 Nov 02 13:28:13.491333 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1970/3591] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:28:13 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:13.496783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-56a045f7-e1fd-4c2a-b051-f6241838040d req-0e4f2408-8347-4ac4-902a-cdd66f98ace2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b89c0d2-e784-4971-be86-f981bb800744", "tag": "e2ea0671-cd52-449c-b2f7-37963312ecae"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:13.508788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-56a045f7-e1fd-4c2a-b051-f6241838040d req-0e4f2408-8347-4ac4-902a-cdd66f98ace2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:13.509522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-56a045f7-e1fd-4c2a-b051-f6241838040d req-0e4f2408-8347-4ac4-902a-cdd66f98ace2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:13.510120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-56a045f7-e1fd-4c2a-b051-f6241838040d req-0e4f2408-8347-4ac4-902a-cdd66f98ace2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:13.522980 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-56a045f7-e1fd-4c2a-b051-f6241838040d req-0e4f2408-8347-4ac4-902a-cdd66f98ace2 service nova] Creating event network-changed:e2ea0671-cd52-449c-b2f7-37963312ecae for instance 5b89c0d2-e784-4971-be86-f981bb800744 on n-h1-858384-19 Nov 02 13:28:13.528479 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-56a045f7-e1fd-4c2a-b051-f6241838040d req-0e4f2408-8347-4ac4-902a-cdd66f98ace2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035918 Nov 02 13:28:13.529473 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1971/3592] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:13.536009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:13.538194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:13.544936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:13.545754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:13.546517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:13.547941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:13.549316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:13.550209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:13.743399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:13.758905 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f9e0ce50-dce1-4a48-932b-0ba6311e6694 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1307 microversion: 2.1 time: 0.227230 Nov 02 13:28:13.769411 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1972/3593] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:13 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:14.104121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:28:14.104591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:28:14.105001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:28:14.105493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:28:14.105804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:28:14.118836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:14.119865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:14.120487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:14.121490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:14.122666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:14.123349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:14.151073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Getting quotas for project 8a41acb2595c4028ba02cf9fd7ce5fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:28:14.158029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Getting quotas for user 209a1d83f0ce4ca6b0b27a56e5959eaf and project 8a41acb2595c4028ba02cf9fd7ce5fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:28:14.177094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:28:14.178732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:28:14.235686 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2aab7580-712b-4e17-bb73-add4de753793 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.650959 Nov 02 13:28:14.236781 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1622/3594] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:28:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:28:14.249338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4db3ff72-af9e-4c95-b676-b20f70a444d8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:14.251042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4db3ff72-af9e-4c95-b676-b20f70a444d8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:14.420450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:14.422939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:14.432378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:14.435010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:14.435598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:14.439723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:14.440534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:14.441249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:14.725467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4db3ff72-af9e-4c95-b676-b20f70a444d8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:14.732631 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4db3ff72-af9e-4c95-b676-b20f70a444d8 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1219 microversion: 2.1 time: 0.489160 Nov 02 13:28:14.748393 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1973/3595] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:14 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1219 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:14.748393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1552b20-75a4-481b-8c58-6263a57edc77 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:14.748393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1552b20-75a4-481b-8c58-6263a57edc77 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:14.764265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1552b20-75a4-481b-8c58-6263a57edc77 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:14.764759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1552b20-75a4-481b-8c58-6263a57edc77 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:14.765831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1552b20-75a4-481b-8c58-6263a57edc77 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:14.766564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1552b20-75a4-481b-8c58-6263a57edc77 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:14.767022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1552b20-75a4-481b-8c58-6263a57edc77 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:14.767490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1552b20-75a4-481b-8c58-6263a57edc77 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:14.837596 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1552b20-75a4-481b-8c58-6263a57edc77 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099097 Nov 02 13:28:14.838205 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1974/3596] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:28:14 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:14.842732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:14.843664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:14.854730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:14.855297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:14.855683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:14.856391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:14.856874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:14.866054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:15.000496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:15.010192 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1f53f0fc-a824-4c50-b541-adbe23a9430a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.594591 Nov 02 13:28:15.016466 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1623/3597] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:14 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:15.035566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:15.036078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:15.054546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:15.055786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:15.056239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:15.057062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:15.057513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:15.058911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:15.092887 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] HTTP exception thrown: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Request method failure captured: Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c HTTP/1.1 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm9qFsZAilHBfe7m8Z2jRFEgJ9RBsY36ctxHX7W48eAbm17HDAjZ3DCc4A7FBJAjs-0fR_hnhC8CC6q9INisoeWYyI1flDwKuNfcb8Ac7Qw9SEYytlKiXikA__bv0W2OOT0w7iCtxVQ4uG0-sJ8tAhiCjNJyV5NiLk1jaN8l7NpW4W0 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 26d4814779354fb6be0cfd8213a1ef83 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1189509588 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1189509588 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 26d4814779354fb6be0cfd8213a1ef83 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1189509588 Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachSCSIVolumeTestJSON-1189509588-project Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f635fead26c9417c9781b527efc9353e Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1189509588-project Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'b1839e8d-7af9-46b2-a7f4-bc09f7585d3c'} Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:28:15.096312 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.100873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.104185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Returning 404 to user: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:15.105799 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4bb38c8d-d6f8-4d2b-8d65-66e751ecbb9e tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "DELETE /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 404 len: 111 microversion: 2.1 time: 0.088231 Nov 02 13:28:15.106926 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1624/3598] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:28:15 2022] DELETE /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:28:15.117282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:15.118248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] [instance: b1839e8d-7af9-46b2-a7f4-bc09f7585d3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:15.126669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:15.127575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:15.128278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:15.129296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:15.129981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:15.130681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:15.150022 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] HTTP exception thrown: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Request method failure captured: Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c HTTP/1.1 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm9qFsZAilHBfe7m8Z2jRFEgJ9RBsY36ctxHX7W48eAbm17HDAjZ3DCc4A7FBJAjs-0fR_hnhC8CC6q9INisoeWYyI1flDwKuNfcb8Ac7Qw9SEYytlKiXikA__bv0W2OOT0w7iCtxVQ4uG0-sJ8tAhiCjNJyV5NiLk1jaN8l7NpW4W0 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 26d4814779354fb6be0cfd8213a1ef83 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1189509588 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/26d4814779354fb6be0cfd8213a1ef83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1189509588 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 26d4814779354fb6be0cfd8213a1ef83 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1189509588 Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachSCSIVolumeTestJSON-1189509588-project Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f635fead26c9417c9781b527efc9353e Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1189509588-project Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'b1839e8d-7af9-46b2-a7f4-bc09f7585d3c'} Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:15.157400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.161610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:15.161610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:15.161610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:15.161610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:15.161610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:15.161610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. Nov 02 13:28:15.161610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:15.166161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] Returning 404 to user: Instance b1839e8d-7af9-46b2-a7f4-bc09f7585d3c could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:15.167535 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c92cec94-08a5-4fd5-ab4d-3d9bf79c4ff6 tempest-AttachSCSIVolumeTestJSON-1189509588 tempest-AttachSCSIVolumeTestJSON-1189509588-project] 10.222.0.113 "GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c" status: 404 len: 111 microversion: 2.1 time: 0.055498 Nov 02 13:28:15.168882 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1625/3599] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:15 2022] GET /compute/v2.1/servers/b1839e8d-7af9-46b2-a7f4-bc09f7585d3c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:28:15.386753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:15.408351 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a730874e-2f0b-4994-997e-683db6c8e4a0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1307 microversion: 2.1 time: 0.568188 Nov 02 13:28:15.413451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1975/3600] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:14 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1307 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:15.761403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:15.762011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:15.775804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:15.776300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:15.776754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:15.777456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:15.778088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:15.778679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:15.852515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc537b7c-e0f7-42b8-a682-22497d103402 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:15.856623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc537b7c-e0f7-42b8-a682-22497d103402 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:15.866367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc537b7c-e0f7-42b8-a682-22497d103402 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:15.867178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc537b7c-e0f7-42b8-a682-22497d103402 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:15.867799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc537b7c-e0f7-42b8-a682-22497d103402 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:15.868677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc537b7c-e0f7-42b8-a682-22497d103402 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:15.869791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc537b7c-e0f7-42b8-a682-22497d103402 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:15.870387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc537b7c-e0f7-42b8-a682-22497d103402 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:15.941478 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc537b7c-e0f7-42b8-a682-22497d103402 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093557 Nov 02 13:28:15.942085 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1976/3601] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:28:15 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:28:15.997366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:16.027346 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-df73e5f8-c182-4f5e-9356-76663939d934 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1271 microversion: 2.1 time: 0.269219 Nov 02 13:28:16.028354 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1626/3602] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:15 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:16.045820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:16.048654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:16.060398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:16.062658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:16.067323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:16.069286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:16.070622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:16.071636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:16.394628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-321723019", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "8d1f5df2-f82c-47a1-9ba6-7643b938dfa7"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:16.438795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:16.443574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:16.458766 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d9a5d19-43b6-49f4-bf77-27a5348aa00e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.417876 Nov 02 13:28:16.459394 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1977/3603] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:16 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:16.485821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:16.486808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:16.518286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:16.518601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] validate_networks() for [('8d1f5df2-f82c-47a1-9ba6-7643b938dfa7', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:28:16.518780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:16.521061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:16.521957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:16.533517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:16.535974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:17.086995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:17.098254 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc9c8869-7dd5-4426-afc8-a489b06faf30 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1307 microversion: 2.1 time: 0.631814 Nov 02 13:28:17.099484 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1978/3604] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:16 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1307 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:17.104429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:17.105237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:17.112113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:17.112842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:17.113465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:17.114410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:17.114870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:17.115340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:17.228227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:17.238834 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e95c2860-1b79-412f-9094-473d5a7c12bb tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1277 microversion: 2.1 time: 0.138064 Nov 02 13:28:17.243780 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1979/3605] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:17 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:17.436568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:28:17.437899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:28:17.438603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:28:17.439258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:28:17.439882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:28:17.449798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:17.450682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:17.451373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:17.452389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:17.453625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:17.454684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:17.479962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Getting quotas for project 09d9c87a17af442bab426aaef8e4ce27. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:28:17.485782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Getting quotas for user 5e151fa8ebc04ad286fc9ee20fc122f7 and project 09d9c87a17af442bab426aaef8e4ce27. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:28:17.488850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:17.490290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:17.501718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:28:17.504772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:28:17.505022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:17.506074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:17.506871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:17.507757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:17.508324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:17.509313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:17.563795 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-89f14255-6347-4b7f-9907-42f07f1808f2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.173384 Nov 02 13:28:17.565149 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1627/3606] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:28:16 2022] POST /compute/v2.1/servers => generated 382 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:28:17.577253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6acde089-ad53-4ee3-b1c7-cc1ac3756f0d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:17.578952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6acde089-ad53-4ee3-b1c7-cc1ac3756f0d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:17.662193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6acde089-ad53-4ee3-b1c7-cc1ac3756f0d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:17.675176 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6acde089-ad53-4ee3-b1c7-cc1ac3756f0d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1221 microversion: 2.1 time: 0.103082 Nov 02 13:28:17.676500 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1628/3607] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:17 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:17.815844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:18.123359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:18.124031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:18.144584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:18.147720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:18.148959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:18.152820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:18.157555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:18.158218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:18.426550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:18.440801 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d11f466-78eb-4887-8300-cc4d2b191de8 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.955724 Nov 02 13:28:18.459627 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1980/3608] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:17 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:18.470922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:18.474577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:18.496347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:18.498410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:18.499549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:18.502498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:18.505825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:18.507746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:18.721167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:18.724932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:18.733123 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b64e9564-c3e7-449a-b67d-822dfd673313 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1307 microversion: 2.1 time: 0.615035 Nov 02 13:28:18.736217 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-235f1da8-7337-4a84-aea8-d081b3646f90 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1277 microversion: 2.1 time: 0.273865 Nov 02 13:28:18.737574 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1629/3609] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:18 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1307 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:18.747372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:18.747767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:18.754721 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1981/3610] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:18 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:18.766618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:18.767264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:18.767970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:18.768913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:18.776007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:18.776933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:18.886268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:18.899349 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f370357f-b2f6-4afc-9e49-aac42a6ffdd7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1217 microversion: 2.1 time: 0.160378 Nov 02 13:28:18.899944 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1630/3611] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:18 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:19.466152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:19.470184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:19.476708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:19.477147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:19.477593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:19.488251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:19.489079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:19.492820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:19.763363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:19.764487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:19.786750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:19.787288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:19.787927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:19.788664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:19.789119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:19.789546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:20.165784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:20.183492 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-526a76f8-19ae-4606-bd04-721a094200b1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.721290 Nov 02 13:28:20.186477 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1982/3612] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:19 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:20.203685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:20.204787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:20.223208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:20.224257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:20.224982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:20.226314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:20.227553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:20.229789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:20.659400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:20.681655 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-698ed808-d164-46dc-8211-65be046af205 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1307 microversion: 2.1 time: 0.922233 Nov 02 13:28:20.683591 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1631/3613] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:19 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1307 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:20.689928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:20.690836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:20.698527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:20.699360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:20.700155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:20.701919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:20.702806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:20.703895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:21.114095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:21.125606 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f0d8255d-0c2f-48f3-9465-a61003ba678a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1319 microversion: 2.1 time: 0.936587 Nov 02 13:28:21.127748 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1983/3614] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:20 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1319 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:21.213564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:21.214935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:21.225609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:21.226156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:21.226889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:21.235691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:21.236723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:21.237464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:21.248113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:21.261562 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8be28e88-2655-4048-93d4-e1a195bf520a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1279 microversion: 2.1 time: 0.573466 Nov 02 13:28:21.262476 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1632/3615] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:20 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1279 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:21.643138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:21.652504 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f16a8b2a-79ff-4147-bbfa-fdcfa7029cc7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.443546 Nov 02 13:28:21.655224 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1984/3616] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:21 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:21.707627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:21.708267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:21.722971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:21.723507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:21.723956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:21.724876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:21.725330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:21.725768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:22.121607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:22.131196 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-878964f9-5c84-4bd6-8b70-789eafef710c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.428371 Nov 02 13:28:22.147630 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1633/3617] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:21 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:22.162524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:22.164891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:22.177050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f778a0be-fc99-4f55-8b27-f77a9dca10ce req-b9e390af-423a-480e-9c41-154ccdb28aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08d77f3-d6ea-4224-b55c-06e9ea319fa8", "tag": "75ce267c-0d4b-4098-9e53-0cdb0322a5d2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:22.204128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f778a0be-fc99-4f55-8b27-f77a9dca10ce req-b9e390af-423a-480e-9c41-154ccdb28aa1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:22.204751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f778a0be-fc99-4f55-8b27-f77a9dca10ce req-b9e390af-423a-480e-9c41-154ccdb28aa1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:22.205191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f778a0be-fc99-4f55-8b27-f77a9dca10ce req-b9e390af-423a-480e-9c41-154ccdb28aa1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:22.216358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:22.218223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:22.220809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:22.222167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:22.223537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:22.224156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:22.229562 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f778a0be-fc99-4f55-8b27-f77a9dca10ce req-b9e390af-423a-480e-9c41-154ccdb28aa1 service nova] Creating event network-changed:75ce267c-0d4b-4098-9e53-0cdb0322a5d2 for instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 on n-h2-858384-19 Nov 02 13:28:22.237017 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f778a0be-fc99-4f55-8b27-f77a9dca10ce req-b9e390af-423a-480e-9c41-154ccdb28aa1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063854 Nov 02 13:28:22.241136 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1634/3618] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:22.291523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:22.292226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:22.304098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:22.305212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:22.307234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:22.307234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:22.310116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:22.310752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:22.762156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:22.778959 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d06cd26c-1fed-495b-8427-a665972a7aa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1321 microversion: 2.1 time: 0.491622 Nov 02 13:28:22.779935 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1635/3619] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:22 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:22.802491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:22.805181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:22.816996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:22.819682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:22.820420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:22.821324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:22.822900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:22.824074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:22.842597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:22.865575 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-08ac1189-26d5-4d97-a21b-e227d716411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1319 microversion: 2.1 time: 0.716668 Nov 02 13:28:22.870156 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1985/3620] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:22 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1319 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:23.162015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:23.162775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:23.169357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:23.169888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:23.170329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:23.172312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:23.172994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:23.173435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:23.247717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:23.257478 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2893975b-d707-478b-aa20-c8b05f842f2d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.475561 Nov 02 13:28:23.258403 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1636/3621] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:22 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:23.809090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:23.810807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:23.829454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:23.830351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:23.831088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:23.832048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:23.832772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:23.833403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:24.054937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:24.063491 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc2e411a-f7b7-448a-a21b-29a27a275527 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.909046 Nov 02 13:28:24.064090 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1986/3622] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:23 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:24.075682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:24.076472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:24.092022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:24.093896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:24.094691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:24.097286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:24.097881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:24.098344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:24.112967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:24.123174 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3ff9183f-66bf-4d64-9ab9-e11e3edf936b tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1321 microversion: 2.1 time: 0.319890 Nov 02 13:28:24.135956 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1637/3623] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:23 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:24.146347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-8bbcd9c6-7ed3-41fb-ac8a-4386146aac0b req-7ca78f41-c388-4e28-b6f8-c8dbb98c36f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09177089-3ca7-4468-950f-8d5856489ee7", "tag": "5569d12a-373a-4895-b3b1-7623c7ed6564"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:24.158086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8bbcd9c6-7ed3-41fb-ac8a-4386146aac0b req-7ca78f41-c388-4e28-b6f8-c8dbb98c36f7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:24.158864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8bbcd9c6-7ed3-41fb-ac8a-4386146aac0b req-7ca78f41-c388-4e28-b6f8-c8dbb98c36f7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:24.159550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8bbcd9c6-7ed3-41fb-ac8a-4386146aac0b req-7ca78f41-c388-4e28-b6f8-c8dbb98c36f7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:24.172436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-8bbcd9c6-7ed3-41fb-ac8a-4386146aac0b req-7ca78f41-c388-4e28-b6f8-c8dbb98c36f7 service nova] Creating event network-changed:5569d12a-373a-4895-b3b1-7623c7ed6564 for instance 09177089-3ca7-4468-950f-8d5856489ee7 on n-h1-858384-19 Nov 02 13:28:24.179023 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-8bbcd9c6-7ed3-41fb-ac8a-4386146aac0b req-7ca78f41-c388-4e28-b6f8-c8dbb98c36f7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041391 Nov 02 13:28:24.185603 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1638/3624] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:24.288595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:24.289956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:24.298195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:24.299562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:24.308231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:24.318619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:24.319470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:24.320087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:24.420328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:24.430427 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6348be4-726f-4f00-8171-10b2440e1767 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1319 microversion: 2.1 time: 0.360448 Nov 02 13:28:24.431460 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1987/3625] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:24 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:24.689009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:24.700618 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3c38f2f-ff65-492d-9e2d-0d7e397e5fbe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.417583 Nov 02 13:28:24.701646 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1639/3626] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:24 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:25.092975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:25.094262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:25.098776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:25.104629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:25.105417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:25.106078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:25.107256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:25.107827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:25.109109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:25.150614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:25.151294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:25.158990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:25.160530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:25.161394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:25.162888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:25.163766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:25.164549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:25.347125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:25.360126 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c63e110-eaf9-4e18-88e5-ba73bee2efea tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.273327 Nov 02 13:28:25.375148 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1988/3627] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:25 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:25.444139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:25.454997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:25.455649 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4018f6d0-0466-497a-8f74-2b6b8333b870 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1321 microversion: 2.1 time: 0.308370 Nov 02 13:28:25.464186 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1640/3628] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:25 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:25.466508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:25.476240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:25.477178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:25.477724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:25.479414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:25.479781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:25.480288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:25.711327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:25.724196 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0d5f4230-649a-4a1b-bd02-8822e670325f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1319 microversion: 2.1 time: 0.274005 Nov 02 13:28:25.725215 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1989/3629] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:25 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:25.727291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:25.728318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:25.743196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:25.744315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:25.745189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:25.745845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:25.746364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:25.746792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:26.085820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:26.104358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c0c63a03-b6f5-4d99-a1c1-e50fca9713ac tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.381181 Nov 02 13:28:26.104959 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1641/3630] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:25 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:26.385593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:26.386213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:26.393724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:26.394221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:26.394666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:26.395597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:26.396222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:26.396850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:26.481289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:26.482878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:26.491103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:26.491984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:26.492856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:26.494321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:26.494994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:26.496015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:26.711302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:26.728109 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c4e7ca47-a541-4b0a-b65f-cd19275a4cfc tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.346366 Nov 02 13:28:26.747067 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1990/3631] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:26 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:26.758764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:26.761352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:26.773030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:26.774762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:26.775548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:26.777425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:26.778179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:26.778893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:27.073146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:27.084550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6cc8d8e-d957-4987-b549-2dcba9a6db7d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1321 microversion: 2.1 time: 0.608335 Nov 02 13:28:27.090923 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1642/3632] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:26 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:27.131741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:27.132758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:27.139229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:27.140237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:27.140883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:27.141814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:27.142444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:27.143706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:27.179302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:27.184364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:27.192596 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-865bb5bb-80fa-435f-93e6-a81a11483800 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1319 microversion: 2.1 time: 0.443769 Nov 02 13:28:27.196368 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1991/3633] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:26 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1319 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:27.464048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:27.510589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:27.538768 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2009cbe0-c0bf-45ab-92d5-0e143e9e773f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.411200 Nov 02 13:28:27.539761 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1643/3634] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:27 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:27.761395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:27.762633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:27.788970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:27.793387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:27.809515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:27.812991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:27.814137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:27.815987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:28.122319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:28.123024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:28.126167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=16 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:28.137343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:28.140410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:28.140884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:28.144390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:28.144983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:28.145735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:28.225403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:28.235382 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a5971f23-2e7d-445e-bed2-4112b23b357e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.478398 Nov 02 13:28:28.240590 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1992/3635] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:27 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:28.258044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:28.261018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:28.277348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:28.278192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:28.278879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:28.279874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:28.281190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:28.282261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:28.408893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:28.420464 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fef2e72e-7aa0-43fd-bb55-d96882338b2e tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1321 microversion: 2.1 time: 0.302350 Nov 02 13:28:28.421800 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1644/3636] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:28 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:28.528346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:28.541090 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10b8da76-2d41-4e79-9ac1-4fa8da2b8cac tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1319 microversion: 2.1 time: 0.291854 Nov 02 13:28:28.542613 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1993/3637] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:28 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:28.566470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:28.567745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:28.578845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:28.579394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:28.579838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:28.580550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:28.581189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:28.581615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:28.953645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-206ef8a6-d2ce-43e4-b9eb-004fd3962709 req-b716d202-5630-47c2-8506-deea46265851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08d77f3-d6ea-4224-b55c-06e9ea319fa8", "name": "network-vif-plugged", "status": "completed", "tag": "75ce267c-0d4b-4098-9e53-0cdb0322a5d2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:28.987790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-206ef8a6-d2ce-43e4-b9eb-004fd3962709 req-b716d202-5630-47c2-8506-deea46265851 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:28.988699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-206ef8a6-d2ce-43e4-b9eb-004fd3962709 req-b716d202-5630-47c2-8506-deea46265851 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:28.989451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-206ef8a6-d2ce-43e4-b9eb-004fd3962709 req-b716d202-5630-47c2-8506-deea46265851 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:29.034944 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-206ef8a6-d2ce-43e4-b9eb-004fd3962709 req-b716d202-5630-47c2-8506-deea46265851 service nova] Creating event network-vif-plugged:75ce267c-0d4b-4098-9e53-0cdb0322a5d2 for instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 on n-h2-858384-19 Nov 02 13:28:29.056825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-206ef8a6-d2ce-43e4-b9eb-004fd3962709 req-b716d202-5630-47c2-8506-deea46265851 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107514 Nov 02 13:28:29.062516 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1994/3638] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:28:29.205092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:29.216171 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-77b6438d-5d9d-46e7-820d-9fdc62fd001f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.654594 Nov 02 13:28:29.217182 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1645/3639] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:28 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:29.269378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:29.270386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:29.279069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:29.279718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:29.281182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:29.282926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:29.283863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:29.284562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:29.291559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:29.450332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:29.451412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:29.456894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:29.466999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:29.470000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:29.470000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:29.470000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:29.470000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:29.472429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:29.596412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:29.605222 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90e467d7-adad-433c-8b3b-b2375b6ba1ba tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.340874 Nov 02 13:28:29.606178 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1995/3640] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:29 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:29.612280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:29.613148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:29.619804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:29.620496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:29.621137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:29.622018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:29.622650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:29.623081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:30.007576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:30.016883 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5dcf37df-7af5-4f6d-b876-9bf757207872 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1319 microversion: 2.1 time: 0.409422 Nov 02 13:28:30.017481 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1996/3641] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:29 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:30.253059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:30.253891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:30.260497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:30.261276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:30.261965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:30.262863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:30.263664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:30.264280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:30.384021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:30.397305 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-01e1e04d-ace8-49f8-9033-3833082950b2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1321 microversion: 2.1 time: 0.955883 Nov 02 13:28:30.398538 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1646/3642] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:29 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1321 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:30.609947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:30.629171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:30.629781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:30.636775 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f5a5f813-4a8a-4d65-b81c-88257d18bd29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.398390 Nov 02 13:28:30.637393 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1997/3643] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:30 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:30.640275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:30.640767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:30.641201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:30.641909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:30.642357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:30.642779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:31.001611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:31.009593 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d20ec8a8-71cd-4ca1-a04f-c03a67664b19 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.384254 Nov 02 13:28:31.010742 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1647/3644] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:30 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:31.041124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:31.041825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:31.053679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:31.056943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:31.059407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:31.060348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:31.063155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:31.063811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:31.078627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d55d98f4-bc26-4e9c-8640-27faa0f6d413 req-6cf175e0-0d35-42f3-a65d-fded41017b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09177089-3ca7-4468-950f-8d5856489ee7", "name": "network-vif-plugged", "status": "completed", "tag": "5569d12a-373a-4895-b3b1-7623c7ed6564"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:31.103772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d55d98f4-bc26-4e9c-8640-27faa0f6d413 req-6cf175e0-0d35-42f3-a65d-fded41017b08 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:31.104901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d55d98f4-bc26-4e9c-8640-27faa0f6d413 req-6cf175e0-0d35-42f3-a65d-fded41017b08 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:31.107095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d55d98f4-bc26-4e9c-8640-27faa0f6d413 req-6cf175e0-0d35-42f3-a65d-fded41017b08 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:31.137189 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d55d98f4-bc26-4e9c-8640-27faa0f6d413 req-6cf175e0-0d35-42f3-a65d-fded41017b08 service nova] Creating event network-vif-plugged:5569d12a-373a-4895-b3b1-7623c7ed6564 for instance 09177089-3ca7-4468-950f-8d5856489ee7 on n-h1-858384-19 Nov 02 13:28:31.143621 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d55d98f4-bc26-4e9c-8640-27faa0f6d413 req-6cf175e0-0d35-42f3-a65d-fded41017b08 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070263 Nov 02 13:28:31.144864 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1648/3645] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:28:31.310919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:31.320568 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-106c7e1c-815a-4042-a112-526dec76977a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1508 microversion: 2.1 time: 0.283059 Nov 02 13:28:31.322227 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1998/3646] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:31 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:31.352278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1083141549"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:31.353456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:31.361656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:31.362389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:31.363235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:31.364135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:31.365035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:31.365627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:31.423903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:31.425300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:31.432708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:31.439726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:31.440977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:31.446125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:31.446616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:31.447267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:31.684507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:31.699691 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3e2d6f27-a8db-46f2-bb28-8b80e6362979 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1321 microversion: 2.1 time: 0.281548 Nov 02 13:28:31.716233 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 1999/3647] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:31 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:31.724924 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.network.security_group_api [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Adding security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 to port 75ce267c-0d4b-4098-9e53-0cdb0322a5d2 Nov 02 13:28:31.726561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:31.727807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:31.738674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:31.739215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:31.739671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:31.740396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:31.740885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:31.741325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:32.143046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:32.153847 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-360d7a43-997d-4254-b17e-188794d5309e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.436208 Nov 02 13:28:32.154544 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2000/3648] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:31 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:32.173807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f79bb3e-60c6-41af-8b0a-96896876d649 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:32.178719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9f79bb3e-60c6-41af-8b0a-96896876d649 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:32.186233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f79bb3e-60c6-41af-8b0a-96896876d649 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:32.186233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f79bb3e-60c6-41af-8b0a-96896876d649 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:32.186775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f79bb3e-60c6-41af-8b0a-96896876d649 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:32.187720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f79bb3e-60c6-41af-8b0a-96896876d649 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:32.188839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f79bb3e-60c6-41af-8b0a-96896876d649 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:32.188839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f79bb3e-60c6-41af-8b0a-96896876d649 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:32.277305 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f79bb3e-60c6-41af-8b0a-96896876d649 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.121066 Nov 02 13:28:32.278046 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2001/3649] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:28:32 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:28:32.293924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:32.295078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:32.303238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:32.303752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:32.304205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:32.304953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:32.305629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:32.306239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:32.828705 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7aec8f2b-356b-448b-9e7e-0c6d0c9a2705 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8/action" status: 202 len: 0 microversion: 2.1 time: 1.481657 Nov 02 13:28:32.832385 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1649/3650] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:28:31 2022] POST /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8/action => generated 0 bytes in 1488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:28:32.838070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:32.842025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:32.850353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:32.851169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:32.851974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:32.852877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:32.853621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:32.854657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:33.038981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:33.054467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-303114bb-4ca1-406f-80bb-974c85af13f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.774822 Nov 02 13:28:33.055558 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2002/3651] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:32 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:33.074287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:33.075936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:33.087896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:33.088400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:33.088852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:33.089578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:33.090245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:33.090886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:33.458285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:33.476093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e61415f5-d85f-43a7-8bad-f362e19a11c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1675 microversion: 2.1 time: 0.642489 Nov 02 13:28:33.476710 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1650/3652] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:32 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1675 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:33.508594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7fc3c449-942d-4250-81ea-d438a333520e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe7879bd4c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:33.742235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:33.750984 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ba7f111c-35eb-4743-a76e-fb98b30e341a tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1321 microversion: 2.1 time: 0.693516 Nov 02 13:28:33.754802 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2003/3653] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:33 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1321 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:33.769617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-dd48c9b8-893e-487c-8416-9b4d636a77a5 req-fc310531-308b-4f17-b6ce-a476dc6bbff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08d77f3-d6ea-4224-b55c-06e9ea319fa8", "tag": "75ce267c-0d4b-4098-9e53-0cdb0322a5d2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:33.779766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dd48c9b8-893e-487c-8416-9b4d636a77a5 req-fc310531-308b-4f17-b6ce-a476dc6bbff6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:33.781863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dd48c9b8-893e-487c-8416-9b4d636a77a5 req-fc310531-308b-4f17-b6ce-a476dc6bbff6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:33.782892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dd48c9b8-893e-487c-8416-9b4d636a77a5 req-fc310531-308b-4f17-b6ce-a476dc6bbff6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:33.802450 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-dd48c9b8-893e-487c-8416-9b4d636a77a5 req-fc310531-308b-4f17-b6ce-a476dc6bbff6 service nova] Creating event network-changed:75ce267c-0d4b-4098-9e53-0cdb0322a5d2 for instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 on n-h2-858384-19 Nov 02 13:28:33.807784 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-dd48c9b8-893e-487c-8416-9b4d636a77a5 req-fc310531-308b-4f17-b6ce-a476dc6bbff6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042658 Nov 02 13:28:33.808716 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2004/3654] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:33.815508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:33.816320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:33.823359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:33.823737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:33.824019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:33.824927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:33.825654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:33.826895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:33.849028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG neutronclient.v2_0.client [None req-7fc3c449-942d-4250-81ea-d438a333520e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 in use.", "detail": ""}} {{(pid=120929) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:28:33.849834 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7fc3c449-942d-4250-81ea-d438a333520e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security Group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 in use. Nov 02 13:28:33.849834 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-4c01708d-68a4-47a9-8a58-a55baec4bad2'] Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7fc3c449-942d-4250-81ea-d438a333520e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-security-groups/521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 HTTP/1.1 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: exception: Security Group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 in use. Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-4c01708d-68a4-47a9-8a58-a55baec4bad2'] Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '521a2ca2-9d52-44e9-ad7a-0bf20cdcb883'} Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:28:33.857825 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 in use. Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c01708d-68a4-47a9-8a58-a55baec4bad2'] Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 in use. Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c01708d-68a4-47a9-8a58-a55baec4bad2'] Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 in use. Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c01708d-68a4-47a9-8a58-a55baec4bad2'] Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 in use. Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c01708d-68a4-47a9-8a58-a55baec4bad2'] Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7fc3c449-942d-4250-81ea-d438a333520e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 400 to user: Security Group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 in use. Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-4c01708d-68a4-47a9-8a58-a55baec4bad2'] {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7fc3c449-942d-4250-81ea-d438a333520e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/521a2ca2-9d52-44e9-ad7a-0bf20cdcb883" status: 400 len: 185 microversion: 2.1 time: 0.379245 Nov 02 13:28:33.863473 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1651/3655] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:28:33 2022] DELETE /compute/v2.1/os-security-groups/521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 => generated 185 bytes in 384 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:28:33.880808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a5c315b7-4760-4601-a2e2-1ab6add71a01 req-c44b52cb-e942-42be-b30e-7f47c9eeb0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b89c0d2-e784-4971-be86-f981bb800744", "name": "network-vif-plugged", "status": "completed", "tag": "e2ea0671-cd52-449c-b2f7-37963312ecae"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:33.898646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a5c315b7-4760-4601-a2e2-1ab6add71a01 req-c44b52cb-e942-42be-b30e-7f47c9eeb0bf service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:33.899588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a5c315b7-4760-4601-a2e2-1ab6add71a01 req-c44b52cb-e942-42be-b30e-7f47c9eeb0bf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:33.900128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a5c315b7-4760-4601-a2e2-1ab6add71a01 req-c44b52cb-e942-42be-b30e-7f47c9eeb0bf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:33.913281 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a5c315b7-4760-4601-a2e2-1ab6add71a01 req-c44b52cb-e942-42be-b30e-7f47c9eeb0bf service nova] Creating event network-vif-plugged:e2ea0671-cd52-449c-b2f7-37963312ecae for instance 5b89c0d2-e784-4971-be86-f981bb800744 on n-h1-858384-19 Nov 02 13:28:33.922442 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a5c315b7-4760-4601-a2e2-1ab6add71a01 req-c44b52cb-e942-42be-b30e-7f47c9eeb0bf service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058713 Nov 02 13:28:33.923101 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1652/3656] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:33.928516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-25fe0530-66eb-40ce-b4f7-8664e6d02ef4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:33.930994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-25fe0530-66eb-40ce-b4f7-8664e6d02ef4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:33.938483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25fe0530-66eb-40ce-b4f7-8664e6d02ef4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:33.938965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25fe0530-66eb-40ce-b4f7-8664e6d02ef4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:33.939774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25fe0530-66eb-40ce-b4f7-8664e6d02ef4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:33.940666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25fe0530-66eb-40ce-b4f7-8664e6d02ef4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:33.942311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25fe0530-66eb-40ce-b4f7-8664e6d02ef4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:33.942923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25fe0530-66eb-40ce-b4f7-8664e6d02ef4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:34.082447 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-25fe0530-66eb-40ce-b4f7-8664e6d02ef4 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8/action" status: 202 len: 0 microversion: 2.1 time: 0.156691 Nov 02 13:28:34.087462 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1653/3657] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:28:33 2022] POST /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:28:34.097994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:34.099457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:34.108882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:34.110342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:34.111002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:34.111970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:34.112620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:34.113267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:34.189336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:34.209557 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4dfbfaee-e2b9-4f41-a3cb-9e939fa71121 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1511 microversion: 2.1 time: 0.399625 Nov 02 13:28:34.210473 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2005/3658] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:33 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:34.227620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:34.228511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:34.246490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:34.247006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:34.247685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:34.248398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:34.249115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:34.249510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:34.375165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:34.387257 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8be47627-b650-4236-980f-f15d1abe031c tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.297705 Nov 02 13:28:34.387899 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1654/3659] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:34 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:34.506197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:34.506829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:34.532119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:34.533326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:34.533949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:34.535391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:34.538768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:34.541876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:34.618256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:34.634626 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8b2cf707-bd8e-4aeb-9c36-dc4362a4e8ab tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1579 microversion: 2.1 time: 0.423043 Nov 02 13:28:34.635761 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2006/3660] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:34 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1579 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:34.777969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:34.779300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:34.797927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:34.798739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:34.799212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:34.799941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:34.800402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:34.801173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:35.148788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:35.173055 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3367e5ca-b7f0-4278-906c-bacf1a99d04f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1511 microversion: 2.1 time: 0.399090 Nov 02 13:28:35.176201 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2007/3661] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:34 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:35.237961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:35.238572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:35.248234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:35.265461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:35.266052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:35.266389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:35.267103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:35.271036 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-263cf8c7-3a91-49b7-beff-f1aee0ffeace tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1680 microversion: 2.1 time: 0.770526 Nov 02 13:28:35.275899 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1655/3662] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:34 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1680 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:35.282364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:35.283216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:35.414104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:35.414758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:35.425777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:35.426502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:35.428030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:35.429522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:35.433047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:35.433708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:35.678966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:35.690279 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1a0d015e-fe1e-42e7-9e63-6fbe0c50bedd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1532 microversion: 2.1 time: 0.456843 Nov 02 13:28:35.693813 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2008/3663] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:35 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1532 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:35.714386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:35.715011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:35.752032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:35.753095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:35.767243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:35.768320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:35.768797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:35.769282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:35.982309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:36.003091 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b767b96-1941-4627-929f-c64b5ba6a922 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1295 microversion: 2.1 time: 0.586622 Nov 02 13:28:36.007809 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1656/3664] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:35 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1295 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:36.156974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:36.166722 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-03679370-6d58-4d0d-9a01-8a80788bb492 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1579 microversion: 2.1 time: 0.468966 Nov 02 13:28:36.174441 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2009/3665] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:35 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1579 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:36.304496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:36.305279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:36.316423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:36.318174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:36.318625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:36.321896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:36.322376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:36.323969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:36.656569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:36.666005 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-abf5a710-5cf6-4b27-8266-08503e5a0a6a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.366022 Nov 02 13:28:36.683442 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1657/3666] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:36 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:36.726374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:36.727061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:36.743182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:36.743612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:36.744327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:36.745044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:36.749284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:36.752368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:37.006797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:37.019558 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0020374b-fa72-4f11-9b1c-5837e1f1bf1f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1532 microversion: 2.1 time: 0.300897 Nov 02 13:28:37.021250 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2010/3667] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:36 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1532 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:37.047697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:37.048475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:37.084940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:37.085684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:37.086122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:37.091428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:37.092110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:37.092826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:37.093072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-69e77f87-b8ad-40f9-9b36-6874e3aae769 req-70d558b4-84c4-44f5-9280-8a0acc56be99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a0aa59-efb1-4c34-bca2-780b90088e7f", "name": "network-vif-plugged", "status": "completed", "tag": "065e6efd-a2b8-42c7-a53e-45a0713a89cd"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:37.109848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-69e77f87-b8ad-40f9-9b36-6874e3aae769 req-70d558b4-84c4-44f5-9280-8a0acc56be99 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:37.110642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-69e77f87-b8ad-40f9-9b36-6874e3aae769 req-70d558b4-84c4-44f5-9280-8a0acc56be99 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:37.112006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-69e77f87-b8ad-40f9-9b36-6874e3aae769 req-70d558b4-84c4-44f5-9280-8a0acc56be99 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:37.154173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-69e77f87-b8ad-40f9-9b36-6874e3aae769 req-70d558b4-84c4-44f5-9280-8a0acc56be99 service nova] Creating event network-vif-plugged:065e6efd-a2b8-42c7-a53e-45a0713a89cd for instance 45a0aa59-efb1-4c34-bca2-780b90088e7f on n-h2-858384-19 Nov 02 13:28:37.174643 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-69e77f87-b8ad-40f9-9b36-6874e3aae769 req-70d558b4-84c4-44f5-9280-8a0acc56be99 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083937 Nov 02 13:28:37.177430 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2011/3668] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:28:37.215768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:37.228417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:37.272868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:37.276735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:37.290087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:37.293744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:37.294562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:37.297176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:37.371967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:37.598475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:37.619466 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-544dafd6-e91d-4b6b-b68a-7f058fd788e0 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1486 microversion: 2.1 time: 0.578062 Nov 02 13:28:37.621901 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1658/3669] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:37 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1486 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:37.674371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d0cef3c-9862-4a49-b411-1aa225c7b765 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:37.676933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d0cef3c-9862-4a49-b411-1aa225c7b765 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:37.703593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0cef3c-9862-4a49-b411-1aa225c7b765 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:37.708258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0cef3c-9862-4a49-b411-1aa225c7b765 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:37.709195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0cef3c-9862-4a49-b411-1aa225c7b765 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:37.710828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0cef3c-9862-4a49-b411-1aa225c7b765 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:37.714023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0cef3c-9862-4a49-b411-1aa225c7b765 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:37.718613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0cef3c-9862-4a49-b411-1aa225c7b765 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:37.737312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:37.748410 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7be006f-b895-477a-b228-aaaa3d7b2a5b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1584 microversion: 2.1 time: 0.550335 Nov 02 13:28:37.753579 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2012/3670] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:37 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1584 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:37.911951 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d0cef3c-9862-4a49-b411-1aa225c7b765 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.261974 Nov 02 13:28:37.912582 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1659/3671] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:28:37 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744/os-interface => generated 285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:38.008075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "600c166a-1cf7-413b-a86b-e955c08766c0"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:38.013031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:38.021836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:38.022555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:38.023212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:38.024196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:38.024808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:38.025397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:38.054068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:38.054976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:38.067222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:38.067517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:38.067799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:38.068511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:38.068964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:38.069434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:38.147363 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] HTTP exception thrown: Volume 0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4 could not be found. Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Request method failure captured: Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7/os-volume_attachments/0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4 HTTP/1.1 Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 74 Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_H_TPfJO6akXiBbnwEeZs9z5Lr_1pJH4DuYYnw6WcBARwvXs9fMPfvKbFfj-A5XSOfXxLvTNitj-QcS8D4_cU_2HfDoORQnM1tx1HjCeXJ38pDMBXW0jOCh1LTKg947gFTAVL3Q-I7ZlBSpuAc1K2f-eDFBcLtm-kJ92n5dXcL11E Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dfc11f4ca0564eff9e3deb99f70141db Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesAdminNegativeTest-1663731763 Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dfc11f4ca0564eff9e3deb99f70141db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dfc11f4ca0564eff9e3deb99f70141db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dfc11f4ca0564eff9e3deb99f70141db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dfc11f4ca0564eff9e3deb99f70141db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesAdminNegativeTest-1663731763 Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dfc11f4ca0564eff9e3deb99f70141db Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1663731763 Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesAdminNegativeTest-1663731763-project-admin Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: d910c8ed2b7749ebbc8e23ee4526885f Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesAdminNegativeTest-1663731763-project-admin Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: {"volumeAttachment": {"volumeId": "600c166a-1cf7-413b-a86b-e955c08766c0"}} Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: exception: Volume 0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4 could not be found. Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'server_id': '09177089-3ca7-4468-950f-8d5856489ee7', 'id': '0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4', 'body': {'volumeAttachment': {'volumeId': '600c166a-1cf7-413b-a86b-e955c08766c0'}}} Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4 could not be found. (HTTP 404) (Request-ID: req-5976902e-c87a-4c12-ab4f-c65587c5620c) Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:28:38.149566 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4 could not be found. Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4 could not be found. Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4 could not be found. Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] Returning 404 to user: Volume 0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:38.154439 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77b0f3a5-cd28-47b2-902b-3a4a57d7d808 tempest-VolumesAdminNegativeTest-1663731763 tempest-VolumesAdminNegativeTest-1663731763-project-admin] 10.222.0.113 "PUT /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7/os-volume_attachments/0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4" status: 404 len: 109 microversion: 2.1 time: 0.147881 Nov 02 13:28:38.166680 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2013/3672] 10.222.0.113 () {60 vars in 1438 bytes} [Wed Nov 2 13:28:38 2022] PUT /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7/os-volume_attachments/0a18ef95-55d7-4a7e-96e4-6aaaafc9cab4 => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:28:38.734039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:38.749204 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a7d67a8a-7d1b-4962-9c74-605eb3c4fff7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1532 microversion: 2.1 time: 0.705537 Nov 02 13:28:38.768631 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1660/3673] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:38 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1532 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:38.798263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:38.799055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:38.814760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:38.815787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:38.816465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:38.819240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:38.819971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:38.820703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:39.086409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:39.097945 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7324e5e4-9d75-47ff-8b93-e388443a15c5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1577 microversion: 2.1 time: 0.316040 Nov 02 13:28:39.110600 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2014/3674] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:38 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1577 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:39.126698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1769299038"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:39.127485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:39.136593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:39.137466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:39.138134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:39.139356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:39.140363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:39.141126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:39.519651 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.network.security_group_api [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Adding security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 to port 75ce267c-0d4b-4098-9e53-0cdb0322a5d2 Nov 02 13:28:39.789557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:39.790368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:39.800910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:39.802163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:39.802801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:39.804168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:39.804872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:39.805473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:40.098343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:40.110111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d5707dba-ae42-4077-8035-bb1b5c743a0e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1532 microversion: 2.1 time: 0.325828 Nov 02 13:28:40.119662 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2015/3675] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:39 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1532 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:40.543541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-196583e6-667c-4df4-954e-cc3bd3c0a374 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786aa7040>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:40.659443 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-196583e6-667c-4df4-954e-cc3bd3c0a374 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/256f3859-264b-4ac8-9b5c-e830e0ada64c" status: 200 len: 665 microversion: 2.1 time: 0.121398 Nov 02 13:28:40.662465 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2016/3676] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:28:40 2022] GET /compute/v2.1/images/256f3859-264b-4ac8-9b5c-e830e0ada64c => generated 665 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:40.683787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2d2aaaa-2ad8-4522-80d0-0f51d580b0c9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787547ee0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:40.760949 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2d2aaaa-2ad8-4522-80d0-0f51d580b0c9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/256f3859-264b-4ac8-9b5c-e830e0ada64c" status: 200 len: 665 microversion: 2.1 time: 0.084877 Nov 02 13:28:40.761728 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2017/3677] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:28:40 2022] GET /compute/v2.1/images/256f3859-264b-4ac8-9b5c-e830e0ada64c => generated 665 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:41.145781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:41.146653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:41.162076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:41.164016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:41.164708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:41.165330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:41.166237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:41.166866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:41.167530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:41.456466 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f20fab58-e5eb-4de8-a350-e36e6601dab2 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8/action" status: 202 len: 0 microversion: 2.1 time: 2.334002 Nov 02 13:28:41.457619 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1661/3678] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:28:39 2022] POST /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8/action => generated 0 bytes in 2336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:28:41.462854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:41.463732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:41.486211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:41.486978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:41.491072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:41.492037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:41.492666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:41.493261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:41.496849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:41.886170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:41.922600 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b38deba6-9229-4717-9650-2a4e1746f4dd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.781743 Nov 02 13:28:41.932311 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2018/3679] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:41 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:41.976367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:41.991277 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff10fce5-448f-47ff-823d-2bd1a9401bd3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1486 microversion: 2.1 time: 0.531790 Nov 02 13:28:41.991906 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1662/3680] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:41 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1486 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:42.004919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d7770d8-bebe-4095-ac86-e6d8ce197fed tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe787061670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:42.011042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c5ac8c68-aee1-474c-a46c-0adfeb2ca6c4 req-7c11108f-9875-4d0f-989a-ef884aeeeae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b89c0d2-e784-4971-be86-f981bb800744", "tag": "e2ea0671-cd52-449c-b2f7-37963312ecae"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:42.064944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c5ac8c68-aee1-474c-a46c-0adfeb2ca6c4 req-7c11108f-9875-4d0f-989a-ef884aeeeae1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:42.065441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c5ac8c68-aee1-474c-a46c-0adfeb2ca6c4 req-7c11108f-9875-4d0f-989a-ef884aeeeae1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:42.065884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c5ac8c68-aee1-474c-a46c-0adfeb2ca6c4 req-7c11108f-9875-4d0f-989a-ef884aeeeae1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:42.112364 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c5ac8c68-aee1-474c-a46c-0adfeb2ca6c4 req-7c11108f-9875-4d0f-989a-ef884aeeeae1 service nova] Creating event network-changed:e2ea0671-cd52-449c-b2f7-37963312ecae for instance 5b89c0d2-e784-4971-be86-f981bb800744 on n-h1-858384-19 Nov 02 13:28:42.133528 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c5ac8c68-aee1-474c-a46c-0adfeb2ca6c4 req-7c11108f-9875-4d0f-989a-ef884aeeeae1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187180 Nov 02 13:28:42.135764 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2019/3681] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:42.694099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG neutronclient.v2_0.client [None req-7d7770d8-bebe-4095-ac86-e6d8ce197fed tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 in use.", "detail": ""}} {{(pid=120929) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:28:42.695677 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7d7770d8-bebe-4095-ac86-e6d8ce197fed tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security Group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 in use. Nov 02 13:28:42.695677 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-b824f4d4-84dc-494e-bb5c-c79d6a1a3900'] Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d7770d8-bebe-4095-ac86-e6d8ce197fed tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-security-groups/7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 HTTP/1.1 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: exception: Security Group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 in use. Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-b824f4d4-84dc-494e-bb5c-c79d6a1a3900'] Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7cf3ca59-d7ec-41b2-b522-5ced432e0cc0'} Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:28:42.698659 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 in use. Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b824f4d4-84dc-494e-bb5c-c79d6a1a3900'] Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 in use. Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b824f4d4-84dc-494e-bb5c-c79d6a1a3900'] Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 in use. Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b824f4d4-84dc-494e-bb5c-c79d6a1a3900'] Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 in use. Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b824f4d4-84dc-494e-bb5c-c79d6a1a3900'] Nov 02 13:28:42.703507 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:42.707693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d7770d8-bebe-4095-ac86-e6d8ce197fed tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 400 to user: Security Group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 in use. Nov 02 13:28:42.707693 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-b824f4d4-84dc-494e-bb5c-c79d6a1a3900'] {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:42.709186 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d7770d8-bebe-4095-ac86-e6d8ce197fed tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/7cf3ca59-d7ec-41b2-b522-5ced432e0cc0" status: 400 len: 185 microversion: 2.1 time: 0.714291 Nov 02 13:28:42.710753 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1663/3682] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:28:41 2022] DELETE /compute/v2.1/os-security-groups/7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 => generated 185 bytes in 717 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:28:42.721617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:42.722359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:42.743329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:42.744766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d2f5cf7-f62e-4255-9dc2-03bb27ca346b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787037670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:42.749729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:42.752191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:42.755871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:42.758134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:42.767790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:42.852858 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d2f5cf7-f62e-4255-9dc2-03bb27ca346b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/315a6e27-2380-4c16-b947-2664de434890" status: 200 len: 665 microversion: 2.1 time: 0.112548 Nov 02 13:28:42.854239 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1664/3683] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:28:42 2022] GET /compute/v2.1/images/315a6e27-2380-4c16-b947-2664de434890 => generated 665 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:42.872538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2158c24-a5f1-4bc8-8372-b326392902a1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78fa6e820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:42.896565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:28:42.973096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e2158c24-a5f1-4bc8-8372-b326392902a1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/315a6e27-2380-4c16-b947-2664de434890" status: 200 len: 665 microversion: 2.1 time: 0.104688 Nov 02 13:28:42.974564 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1665/3684] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:28:42 2022] GET /compute/v2.1/images/315a6e27-2380-4c16-b947-2664de434890 => generated 665 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:42.992374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:42.999317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:43.026212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:43.026813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:43.027347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:43.028147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:43.028683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:43.029185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:43.107429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:28:43.194402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5cc78e8b-1366-4ef8-b694-866402e337b6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 204 len: 0 microversion: 2.1 time: 0.479192 Nov 02 13:28:43.197929 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2020/3685] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:28:42 2022] DELETE /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:28:43.204199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:43.204916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:43.223546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:43.224058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:43.225262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:43.226168 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c78f2d19-e6d3-4ad8-b4e2-96551bceafd2 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "DELETE /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 204 len: 0 microversion: 2.1 time: 0.249433 Nov 02 13:28:43.226299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:43.226698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:43.226897 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1666/3686] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:28:42 2022] DELETE /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:28:43.229988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:43.236164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:43.237244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:43.245970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:43.246738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:43.247498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:43.249541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:43.250273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:43.251125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:43.527388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:43.542293 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-92dec644-b2a2-4c01-88de-621c59d1ad0f tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.345682 Nov 02 13:28:43.543234 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2021/3687] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:43 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:43.560395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:43.561047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:43.568373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:43.576209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:43.577115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:43.578061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:43.578580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:43.579020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:44.041912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:44.054722 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-09bc88fb-f9c2-4fb6-8e76-458b2f97e45f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1652 microversion: 2.1 time: 0.826127 Nov 02 13:28:44.073098 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1667/3688] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:43 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1652 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:44.103515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:44.128978 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31b250cb-cc0c-4b6b-bc01-6fe3f22116ab tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1517 microversion: 2.1 time: 0.584578 Nov 02 13:28:44.133014 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2022/3689] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:43 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1517 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:44.161667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ed2531f7-194b-4e90-9b6f-e4d85e181499 req-b266edb9-6138-4fd7-9b88-e5c378fa586b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08d77f3-d6ea-4224-b55c-06e9ea319fa8", "tag": "75ce267c-0d4b-4098-9e53-0cdb0322a5d2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:44.179308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ed2531f7-194b-4e90-9b6f-e4d85e181499 req-b266edb9-6138-4fd7-9b88-e5c378fa586b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:44.183027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ed2531f7-194b-4e90-9b6f-e4d85e181499 req-b266edb9-6138-4fd7-9b88-e5c378fa586b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:44.184617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ed2531f7-194b-4e90-9b6f-e4d85e181499 req-b266edb9-6138-4fd7-9b88-e5c378fa586b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:44.208972 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ed2531f7-194b-4e90-9b6f-e4d85e181499 req-b266edb9-6138-4fd7-9b88-e5c378fa586b service nova] Creating event network-changed:75ce267c-0d4b-4098-9e53-0cdb0322a5d2 for instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 on n-h2-858384-19 Nov 02 13:28:44.224715 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ed2531f7-194b-4e90-9b6f-e4d85e181499 req-b266edb9-6138-4fd7-9b88-e5c378fa586b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066132 Nov 02 13:28:44.225973 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1668/3690] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:44.575490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:44.576119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:44.610514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:44.612279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:44.612897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:44.614384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:44.616122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:44.617132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:45.086357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:45.087798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:45.103268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:45.103771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:45.105483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:45.106844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:45.107358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:45.110736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:46.060680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:46.082892 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c698db00-ed27-402a-8132-095d62af03f5 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1652 microversion: 2.1 time: 1.001829 Nov 02 13:28:46.086450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:46.089758 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1669/3691] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:45 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1652 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:46.098545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6940f0c7-360f-4ab5-8369-5f73e629eb66 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786fd3670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:46.106592 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15d35951-8c42-4e60-a59e-9c0dced62d1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 1.531962 Nov 02 13:28:46.108123 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2023/3692] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:44 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:46.129353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:46.130650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:46.143812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:46.144464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:46.147624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:46.148517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:46.151190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:46.152879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:46.244162 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6940f0c7-360f-4ab5-8369-5f73e629eb66 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/27e64314-193f-466d-8aba-e94cd2a3b528" status: 200 len: 665 microversion: 2.1 time: 0.152475 Nov 02 13:28:46.246453 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1670/3693] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:28:46 2022] GET /compute/v2.1/images/27e64314-193f-466d-8aba-e94cd2a3b528 => generated 665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:46.266000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6fbaadee-3374-403e-a2ac-00e2f65de3dd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f90edc0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:46.361273 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6fbaadee-3374-403e-a2ac-00e2f65de3dd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/27e64314-193f-466d-8aba-e94cd2a3b528" status: 200 len: 665 microversion: 2.1 time: 0.103639 Nov 02 13:28:46.362965 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1671/3694] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:28:46 2022] GET /compute/v2.1/images/27e64314-193f-466d-8aba-e94cd2a3b528 => generated 665 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:46.677611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2011057759", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:46.841756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] validate_networks() for None {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:28:47.260250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:28:47.261208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:28:47.261574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:28:47.262187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:28:47.262609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:28:47.268136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:47.291529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:47.292588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:47.293204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:47.294586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:47.296083 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-67dd5424-cc69-493f-82b3-0fa8ec7a3295 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 200 len: 1517 microversion: 2.1 time: 1.185886 Nov 02 13:28:47.296868 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2024/3695] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:46 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 1517 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:47.296997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:47.297615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:47.324273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b1d09285-172e-4866-a2b6-000a731b965f req-5d5c4e79-5879-4925-8df6-06b5a3746cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09177089-3ca7-4468-950f-8d5856489ee7", "name": "network-vif-deleted", "tag": "5569d12a-373a-4895-b3b1-7623c7ed6564"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:47.331482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Getting quotas for project 7668fc27c2c847e086b43b0cbccfa7ce. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:28:47.345998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Getting quotas for user bbef957564b8465e973d3e6fe2e74816 and project 7668fc27c2c847e086b43b0cbccfa7ce. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:28:47.352095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b1d09285-172e-4866-a2b6-000a731b965f req-5d5c4e79-5879-4925-8df6-06b5a3746cd6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:47.353242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b1d09285-172e-4866-a2b6-000a731b965f req-5d5c4e79-5879-4925-8df6-06b5a3746cd6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:47.354160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b1d09285-172e-4866-a2b6-000a731b965f req-5d5c4e79-5879-4925-8df6-06b5a3746cd6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:47.380820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:28:47.386255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:28:47.401374 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b1d09285-172e-4866-a2b6-000a731b965f req-5d5c4e79-5879-4925-8df6-06b5a3746cd6 service nova] Creating event network-vif-deleted:5569d12a-373a-4895-b3b1-7623c7ed6564 for instance 09177089-3ca7-4468-950f-8d5856489ee7 on n-h1-858384-19 Nov 02 13:28:47.412514 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b1d09285-172e-4866-a2b6-000a731b965f req-5d5c4e79-5879-4925-8df6-06b5a3746cd6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097423 Nov 02 13:28:47.418454 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2025/3696] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:47.432193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:47.434088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:47.449133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:47.450459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:47.453882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:47.456491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:47.458454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:47.459081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:47.505749 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0beb8ca3-0967-47a2-9b98-03d1d4e95b74 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.836658 Nov 02 13:28:47.510146 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1672/3697] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:28:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:28:47.522571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:47.525017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:47.562054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:47.562762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:47.563884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:47.567012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:47.569649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:47.572103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:48.522782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:48.539029 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-48782f22-6415-4e17-ae59-e869fcc0417a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1652 microversion: 2.1 time: 1.119501 Nov 02 13:28:48.541691 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2026/3698] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:47 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1652 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:48.555464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-431200814", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:48.686758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:28:48.786041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:48.807005 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc19f362-9823-41f9-a782-4e97a79a7412 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 1.293854 Nov 02 13:28:48.808106 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1673/3699] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:47 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:48.823322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:48.824309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: 09177089-3ca7-4468-950f-8d5856489ee7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:48.839866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:48.843793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:48.844828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:48.847299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:48.847948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:48.850821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:48.891046 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] HTTP exception thrown: Instance 09177089-3ca7-4468-950f-8d5856489ee7 could not be found. Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Request method failure captured: Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 HTTP/1.1 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm-rgmWJWSaZZwRCXNGUgSAQbQoJ1CWfGwNAJXyjLqCw0P3ZiAl2g2TCX9hnYUJzq_mBbswiG1nOZujEJdvFxgt6b78twvPYMruv1LV_lCE_PAu8tJzVNUOsBgOiaJr998d3GzPnzL6bB3QAze7PNalT8QvTB6u9quqZxzfIukWviY8 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 09d9c87a17af442bab426aaef8e4ce27 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesAdminNegativeTest-1364265846 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/09d9c87a17af442bab426aaef8e4ce27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/09d9c87a17af442bab426aaef8e4ce27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_09d9c87a17af442bab426aaef8e4ce27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/09d9c87a17af442bab426aaef8e4ce27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesAdminNegativeTest-1364265846 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 09d9c87a17af442bab426aaef8e4ce27 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1364265846 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesAdminNegativeTest-1364265846-project Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5e151fa8ebc04ad286fc9ee20fc122f7 Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesAdminNegativeTest-1364265846-project Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 09177089-3ca7-4468-950f-8d5856489ee7 could not be found. Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '09177089-3ca7-4468-950f-8d5856489ee7'} Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09177089-3ca7-4468-950f-8d5856489ee7 could not be found. Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09177089-3ca7-4468-950f-8d5856489ee7 could not be found. Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:48.893632 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:48.898019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:48.898019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:48.898019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:48.898019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:48.898019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:48.898019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09177089-3ca7-4468-950f-8d5856489ee7 could not be found. Nov 02 13:28:48.898019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:28:48.898019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Returning 404 to user: Instance 09177089-3ca7-4468-950f-8d5856489ee7 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:48.898019 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e16cb75d-f0f1-49a3-801b-0a6bd8d7399c tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7" status: 404 len: 111 microversion: 2.1 time: 0.085226 Nov 02 13:28:48.907958 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1674/3700] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:48 2022] GET /compute/v2.1/servers/09177089-3ca7-4468-950f-8d5856489ee7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:28:49.243336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:28:49.244319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:28:49.245152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:28:49.246108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:28:49.246692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:28:49.277790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:49.278740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:49.289651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:49.291483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:49.292631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:49.295278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:49.345915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Getting quotas for project 7668fc27c2c847e086b43b0cbccfa7ce. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:28:49.362390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Getting quotas for user bbef957564b8465e973d3e6fe2e74816 and project 7668fc27c2c847e086b43b0cbccfa7ce. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:28:49.428059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:28:49.438195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:28:49.573195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:49.574133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:49.621040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:49.627768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:49.630898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:49.634760 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5552942f-ecc2-4e67-b2c1-8023d740113b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.090271 Nov 02 13:28:49.636099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:49.639648 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2027/3701] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:28:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:28:49.649008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:49.649488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:49.652087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-53b3e5ec-f5ba-4d94-ba59-617c1b25b155 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:49.657473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-53b3e5ec-f5ba-4d94-ba59-617c1b25b155 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:49.864977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-53b3e5ec-f5ba-4d94-ba59-617c1b25b155 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:49.884628 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-53b3e5ec-f5ba-4d94-ba59-617c1b25b155 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1221 microversion: 2.1 time: 0.237254 Nov 02 13:28:49.900055 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2028/3702] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:49 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1221 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:49.917306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:49.918244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:49.937118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:49.937917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:49.939915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:49.943346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:49.944093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:49.944720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:50.244474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:50.255440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f8b96990-5c79-445d-a2ac-3bdb5b23475d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.353887 Nov 02 13:28:50.257054 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2029/3703] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:49 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:50.270181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-385e719d-a9a4-4ab1-8c5d-d5a63fad1bdd req-f60d2286-0c36-4a63-a965-382f0c083a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08d77f3-d6ea-4224-b55c-06e9ea319fa8", "name": "network-vif-deleted", "tag": "75ce267c-0d4b-4098-9e53-0cdb0322a5d2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:50.290201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-385e719d-a9a4-4ab1-8c5d-d5a63fad1bdd req-f60d2286-0c36-4a63-a965-382f0c083a1e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:50.290703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-385e719d-a9a4-4ab1-8c5d-d5a63fad1bdd req-f60d2286-0c36-4a63-a965-382f0c083a1e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:50.294150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-385e719d-a9a4-4ab1-8c5d-d5a63fad1bdd req-f60d2286-0c36-4a63-a965-382f0c083a1e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:50.321916 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-385e719d-a9a4-4ab1-8c5d-d5a63fad1bdd req-f60d2286-0c36-4a63-a965-382f0c083a1e service nova] Creating event network-vif-deleted:75ce267c-0d4b-4098-9e53-0cdb0322a5d2 for instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 on n-h2-858384-19 Nov 02 13:28:50.334937 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-385e719d-a9a4-4ab1-8c5d-d5a63fad1bdd req-f60d2286-0c36-4a63-a965-382f0c083a1e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075292 Nov 02 13:28:50.337012 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2030/3704] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:50.454723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:50.472191 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5690bf40-323d-4525-aaa1-bad4c662cbec tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 200 len: 1472 microversion: 2.1 time: 0.904207 Nov 02 13:28:50.474947 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1675/3705] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:49 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 1472 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:50.916941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9804bed4-047e-4a54-b947-5cdb40407969 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:50.917664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9804bed4-047e-4a54-b947-5cdb40407969 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:51.038258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9804bed4-047e-4a54-b947-5cdb40407969 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:51.050176 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9804bed4-047e-4a54-b947-5cdb40407969 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1221 microversion: 2.1 time: 0.139765 Nov 02 13:28:51.065104 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2031/3706] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:50 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:51.288102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:51.288808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:51.313017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:51.313896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:51.316600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:51.317593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:51.318249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:51.319959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:51.504834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:51.506386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:51.542620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:51.544069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:51.545531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:51.546847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:51.556756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:51.557939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:51.581662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 HTTP/1.1 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f08d77f3-d6ea-4224-b55c-06e9ea319fa8'} Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:28:51.584733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:51.589888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:28:51.589888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:28:51.589888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:28:51.589888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:28:51.589888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:28:51.589888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:28:51.589888 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:28:51.591543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:28:51.594448 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7356f7db-d3a4-4b06-8a6a-f4bb9c1320e6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 404 len: 111 microversion: 2.1 time: 0.093789 Nov 02 13:28:51.598711 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2032/3707] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:51 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:28:51.604786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89d1a33c-558d-4059-87fe-0ff5d79f2c46 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe787a98550>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:52.078155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:52.100037 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9240f36e-6c30-46f0-948a-c224677adb52 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.817779 Nov 02 13:28:52.103017 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1676/3708] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:51 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:52.108988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:52.110252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:52.146842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:52.147720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:52.149415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:52.152653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:52.153871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:52.157385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:52.398535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:52.412539 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05e9d5a8-134b-4509-a354-f632c175edf9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1273 microversion: 2.1 time: 0.306917 Nov 02 13:28:52.415084 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1677/3709] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:52 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:52.679545 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89d1a33c-558d-4059-87fe-0ff5d79f2c46 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/521a2ca2-9d52-44e9-ad7a-0bf20cdcb883" status: 202 len: 0 microversion: 2.1 time: 1.078934 Nov 02 13:28:52.681065 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2033/3710] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:28:51 2022] DELETE /compute/v2.1/os-security-groups/521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:28:52.690292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b6255fd-4caa-4727-aaf8-717c29e6964d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe78f92ae50>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:53.126719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:53.127376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:53.145672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:53.150024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:53.150849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:53.152036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:53.153124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:53.156002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:53.972293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:54.002434 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f84e4ef8-e1f5-43c3-8eb6-fe7878c53226 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.880289 Nov 02 13:28:54.016497 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2034/3711] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:53 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:54.030675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:54.031993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:54.049489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:54.051496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:54.051957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:54.053768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:54.054244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:54.054758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:54.413624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:54.418761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:54.441957 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-078dd195-ae13-452b-98db-2a993bb89334 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1279 microversion: 2.1 time: 0.417842 Nov 02 13:28:54.443547 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2035/3712] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:54 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1279 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:54.922443 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b6255fd-4caa-4727-aaf8-717c29e6964d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/7cf3ca59-d7ec-41b2-b522-5ced432e0cc0" status: 202 len: 0 microversion: 2.1 time: 2.236385 Nov 02 13:28:54.923076 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1678/3713] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:28:52 2022] DELETE /compute/v2.1/os-security-groups/7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 => generated 0 bytes in 2238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:28:54.938932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0bc2b2ea-5c7c-46de-b56e-a974b2d755b0 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'create', calling method: .version_select at 0x7fe787867a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-515186192", "description": "tempest-description-244977655"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:55.031881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:55.032499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:55.045637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:55.050612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:55.051526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:55.052833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:55.055202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:55.057986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:55.926311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:55.949767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8b6b5125-9422-4c05-922c-124f0c06fe0a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.923551 Nov 02 13:28:55.979304 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1679/3714] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:55 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:55.989810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:55.990722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:55.999685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:56.000532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:56.001318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:56.002832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:56.003711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:56.004392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:56.882129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:56.895251 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b345ab64-2c06-416f-9e9e-d7d988dc73fd tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.914445 Nov 02 13:28:56.901032 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1680/3715] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:55 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:56.988550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:56.990849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:57.031430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:57.033258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:57.036066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:57.039359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:57.041663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:57.044868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:57.050849 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0bc2b2ea-5c7c-46de-b56e-a974b2d755b0 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.116344 Nov 02 13:28:57.052239 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2036/3716] 10.222.0.113 () {60 vars in 1185 bytes} [Wed Nov 2 13:28:54 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:57.067881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f15dae3-245d-403f-8c7e-b5454532e142 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Action: 'update', calling method: .version_select at 0x7fe786aa7dc0>, body: {"security_group": {"name": "tempest-sg-hth-1720292822", "description": "tempest-description-hth-2075680497"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:28:57.308224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:57.362355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:57.612659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f15dae3-245d-403f-8c7e-b5454532e142 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "PUT /compute/v2.1/os-security-groups/a1bec2e7-6d25-4266-a65c-6e5755afe0c3" status: 200 len: 218 microversion: 2.1 time: 0.548856 Nov 02 13:28:57.626039 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2037/3717] 10.222.0.113 () {60 vars in 1295 bytes} [Wed Nov 2 13:28:57 2022] PUT /compute/v2.1/os-security-groups/a1bec2e7-6d25-4266-a65c-6e5755afe0c3 => generated 218 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:57.631077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:57.631799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:57.657042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:57.658113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:57.658632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:57.659407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:57.661346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:57.662113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:57.722051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:57.727811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:28:57.753490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af074f7b-e1b0-4a91-b406-58cc6c093b31 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.771041 Nov 02 13:28:57.759327 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1681/3718] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:56 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:28:57.785422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-96e826c1-34c2-4bf2-a321-3cf86a1ce8ed tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786d785e0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:57.976084 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ccb69112-c4ce-47a3-8732-ef53e23582c8 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 204 len: 0 microversion: 2.1 time: 0.348576 Nov 02 13:28:57.978986 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2038/3719] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:28:57 2022] DELETE /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:28:57.987028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:58.003587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:58.032608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:58.033511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:58.034222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:58.035775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:58.036861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:58.037680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:58.437516 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-96e826c1-34c2-4bf2-a321-3cf86a1ce8ed tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/os-security-groups/a1bec2e7-6d25-4266-a65c-6e5755afe0c3" status: 200 len: 218 microversion: 2.1 time: 0.675950 Nov 02 13:28:58.438616 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1682/3720] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:28:57 2022] GET /compute/v2.1/os-security-groups/a1bec2e7-6d25-4266-a65c-6e5755afe0c3 => generated 218 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:28:58.444966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:58.445591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:58.454962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:58.474594 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-36e0f347-8c22-4155-a385-f5c0c4d1eb49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.496285 Nov 02 13:28:58.475765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:58.476812 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2039/3721] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:57 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:58.482106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:58.483171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:58.483942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:58.484411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:58.484841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:58.486277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c2beefd-fb86-4709-9be3-fee375513665 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786c2c280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:59.318738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:59.320103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:59.325504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-579176c9-fe87-4e18-af56-5a8753d47d68 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1686 microversion: 2.1 time: 0.885320 Nov 02 13:28:59.331138 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1683/3722] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:58 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1686 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:59.336236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:59.336909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:59.358814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:59.359699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:59.360289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:59.362264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:59.363325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:59.363936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:59.792315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:28:59.801330 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d7165533-a340-472d-94ff-4a35c6a18afe tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.468998 Nov 02 13:28:59.825166 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1684/3723] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:59 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:28:59.836312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:28:59.836934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:28:59.859675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:28:59.861279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:59.861780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:59.862275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:59.863371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:28:59.864895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:28:59.865355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:28:59.865860 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c2beefd-fb86-4709-9be3-fee375513665 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/a1bec2e7-6d25-4266-a65c-6e5755afe0c3" status: 202 len: 0 microversion: 2.1 time: 1.387429 Nov 02 13:28:59.867254 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2040/3724] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:28:58 2022] DELETE /compute/v2.1/os-security-groups/a1bec2e7-6d25-4266-a65c-6e5755afe0c3 => generated 0 bytes in 1390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:29:00.219732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-54fbaceb-4074-4485-8421-359e8c6a8352 req-9f1aaed5-2aaa-4ee2-b6f7-77db619b155c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f903fade-568a-4ab8-921c-4d0af0956d73", "tag": "2c8ab030-6991-42fe-ad13-68219a6b114c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:00.292345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:00.297024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-54fbaceb-4074-4485-8421-359e8c6a8352 req-9f1aaed5-2aaa-4ee2-b6f7-77db619b155c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:00.300431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-54fbaceb-4074-4485-8421-359e8c6a8352 req-9f1aaed5-2aaa-4ee2-b6f7-77db619b155c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:00.301221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-54fbaceb-4074-4485-8421-359e8c6a8352 req-9f1aaed5-2aaa-4ee2-b6f7-77db619b155c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:00.313404 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-13831dc7-1b3a-47fa-b597-68614ccec722 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.487194 Nov 02 13:29:00.316641 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1685/3725] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:28:59 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:00.328748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:00.329584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:00.347394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:00.349886 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-54fbaceb-4074-4485-8421-359e8c6a8352 req-9f1aaed5-2aaa-4ee2-b6f7-77db619b155c service nova] Creating event network-changed:2c8ab030-6991-42fe-ad13-68219a6b114c for instance f903fade-568a-4ab8-921c-4d0af0956d73 on n-h2-858384-19 Nov 02 13:29:00.353336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:00.353918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:00.355708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:00.361650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:00.362291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:00.365482 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-54fbaceb-4074-4485-8421-359e8c6a8352 req-9f1aaed5-2aaa-4ee2-b6f7-77db619b155c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.496154 Nov 02 13:29:00.368310 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2041/3726] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:00.384578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:00.390878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:00.412458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:00.419075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:00.419492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 HTTP/1.1 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f08d77f3-d6ea-4224-b55c-06e9ea319fa8'} Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:29:00.421635 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.426513 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.427942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:00.428794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:00.429537 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a46c90a9-e91d-4ebb-81b4-20ca8993599a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 404 len: 111 microversion: 2.1 time: 0.111070 Nov 02 13:29:00.434385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:00.435511 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1686/3727] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:29:00 2022] DELETE /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:00.437049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:00.438620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:00.439472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:00.448309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:00.449956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: f08d77f3-d6ea-4224-b55c-06e9ea319fa8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:00.469682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:00.471703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:00.476708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:00.477850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:00.478521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:00.479783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:00.556687 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 HTTP/1.1 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f08d77f3-d6ea-4224-b55c-06e9ea319fa8'} Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.558612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.564040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.564040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:00.564040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:00.564040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:00.564040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:00.564040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. Nov 02 13:29:00.564040 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.564040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Instance f08d77f3-d6ea-4224-b55c-06e9ea319fa8 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:00.564040 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-30245ffe-979b-4a88-a2fc-150c542fbef1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8" status: 404 len: 111 microversion: 2.1 time: 0.119635 Nov 02 13:29:00.566422 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1687/3728] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:00 2022] GET /compute/v2.1/servers/f08d77f3-d6ea-4224-b55c-06e9ea319fa8 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:00.578587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-009b40e3-e05e-4e3b-bd07-a802c911738e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe78703e310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:00.756636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG neutronclient.v2_0.client [None req-009b40e3-e05e-4e3b-bd07-a802c911738e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 does not exist", "detail": ""}} {{(pid=120929) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:29:00.757237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.security_group_api [None req-009b40e3-e05e-4e3b-bd07-a802c911738e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 not found {{(pid=120929) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:29:00.757777 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-009b40e3-e05e-4e3b-bd07-a802c911738e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 does not exist Nov 02 13:29:00.757777 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-803fcd8b-89ad-4ffa-85cc-acb69ced0c79'] Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-009b40e3-e05e-4e3b-bd07-a802c911738e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-security-groups/7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 HTTP/1.1 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: exception: Security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 does not exist Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-803fcd8b-89ad-4ffa-85cc-acb69ced0c79'] Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7cf3ca59-d7ec-41b2-b522-5ced432e0cc0'} Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:29:00.760893 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 does not exist Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-803fcd8b-89ad-4ffa-85cc-acb69ced0c79'] Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 does not exist Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-803fcd8b-89ad-4ffa-85cc-acb69ced0c79'] Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 does not exist Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-803fcd8b-89ad-4ffa-85cc-acb69ced0c79'] Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 does not exist Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-803fcd8b-89ad-4ffa-85cc-acb69ced0c79'] Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-009b40e3-e05e-4e3b-bd07-a802c911738e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group 7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 does not exist Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-803fcd8b-89ad-4ffa-85cc-acb69ced0c79'] {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-009b40e3-e05e-4e3b-bd07-a802c911738e tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/7cf3ca59-d7ec-41b2-b522-5ced432e0cc0" status: 404 len: 194 microversion: 2.1 time: 0.194825 Nov 02 13:29:00.765364 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1688/3729] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:29:00 2022] DELETE /compute/v2.1/os-security-groups/7cf3ca59-d7ec-41b2-b522-5ced432e0cc0 => generated 194 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:00.772659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6272dac3-9920-4e58-b0e2-077c8eb1848a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe787060790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:00.898312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG neutronclient.v2_0.client [None req-6272dac3-9920-4e58-b0e2-077c8eb1848a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 does not exist", "detail": ""}} {{(pid=120929) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:29:00.899712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.security_group_api [None req-6272dac3-9920-4e58-b0e2-077c8eb1848a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 not found {{(pid=120929) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:29:00.900499 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-6272dac3-9920-4e58-b0e2-077c8eb1848a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 does not exist Nov 02 13:29:00.900499 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-71f1044a-fd4e-46d9-a6c3-28e21cee6aae'] Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6272dac3-9920-4e58-b0e2-077c8eb1848a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-security-groups/521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 HTTP/1.1 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: exception: Security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 does not exist Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-71f1044a-fd4e-46d9-a6c3-28e21cee6aae'] Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '521a2ca2-9d52-44e9-ad7a-0bf20cdcb883'} Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:29:00.902942 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 does not exist Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71f1044a-fd4e-46d9-a6c3-28e21cee6aae'] Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 does not exist Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71f1044a-fd4e-46d9-a6c3-28e21cee6aae'] Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 does not exist Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71f1044a-fd4e-46d9-a6c3-28e21cee6aae'] Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 does not exist Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71f1044a-fd4e-46d9-a6c3-28e21cee6aae'] Nov 02 13:29:00.908921 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:00.913258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6272dac3-9920-4e58-b0e2-077c8eb1848a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group 521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 does not exist Nov 02 13:29:00.913258 n-d-858384-19 devstack@n-api.service[120929]: Neutron server returns request_ids: ['req-71f1044a-fd4e-46d9-a6c3-28e21cee6aae'] {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:00.914450 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6272dac3-9920-4e58-b0e2-077c8eb1848a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/521a2ca2-9d52-44e9-ad7a-0bf20cdcb883" status: 404 len: 194 microversion: 2.1 time: 0.145880 Nov 02 13:29:00.915807 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1689/3730] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:29:00 2022] DELETE /compute/v2.1/os-security-groups/521a2ca2-9d52-44e9-ad7a-0bf20cdcb883 => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:29:00.925816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:00.933796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:00.940927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:00.943356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:00.950698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:00.952582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:00.953426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:00.954173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:00.954862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:00.974905 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c98cb9d0-c0ff-49c2-a773-4a1c7b9e0fa7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1686 microversion: 2.1 time: 0.593336 Nov 02 13:29:00.999525 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2042/3731] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:00 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1686 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:01.020063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-690cf6ab-aadb-4333-9b26-8d419f6570b1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe787a46ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:01.046775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:01.133814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-690cf6ab-aadb-4333-9b26-8d419f6570b1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:29:01.134702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-690cf6ab-aadb-4333-9b26-8d419f6570b1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group 03f63978-5541-4d1a-9120-0a4e2cc7897e not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:29:01.135678 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-690cf6ab-aadb-4333-9b26-8d419f6570b1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:29:01.135678 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-f5351386-e0a8-445d-b515-3351782203f3'] Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-690cf6ab-aadb-4333-9b26-8d419f6570b1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-security-groups/03f63978-5541-4d1a-9120-0a4e2cc7897e HTTP/1.1 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-f5351386-e0a8-445d-b515-3351782203f3'] Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '03f63978-5541-4d1a-9120-0a4e2cc7897e'} Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:29:01.139014 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5351386-e0a8-445d-b515-3351782203f3'] Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5351386-e0a8-445d-b515-3351782203f3'] Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5351386-e0a8-445d-b515-3351782203f3'] Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5351386-e0a8-445d-b515-3351782203f3'] Nov 02 13:29:01.145882 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.151446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-690cf6ab-aadb-4333-9b26-8d419f6570b1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group 03f63978-5541-4d1a-9120-0a4e2cc7897e does not exist Nov 02 13:29:01.151446 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-f5351386-e0a8-445d-b515-3351782203f3'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:01.153213 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-690cf6ab-aadb-4333-9b26-8d419f6570b1 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/03f63978-5541-4d1a-9120-0a4e2cc7897e" status: 404 len: 194 microversion: 2.1 time: 0.151815 Nov 02 13:29:01.158159 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2043/3732] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:29:00 2022] DELETE /compute/v2.1/os-security-groups/03f63978-5541-4d1a-9120-0a4e2cc7897e => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:01.166065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a0da45b-9da1-4fd3-8993-19aee41ec45a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe786c4d310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:01.205025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-4a0da45b-9da1-4fd3-8993-19aee41ec45a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:29:01.205947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-4a0da45b-9da1-4fd3-8993-19aee41ec45a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group 7c88be4e-df90-49ba-9efa-287efbc0f43e not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:29:01.206777 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4a0da45b-9da1-4fd3-8993-19aee41ec45a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:29:01.206777 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-95b50d31-60bb-4e75-92ad-c91f903e30c6'] Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a0da45b-9da1-4fd3-8993-19aee41ec45a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-security-groups/7c88be4e-df90-49ba-9efa-287efbc0f43e HTTP/1.1 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-95b50d31-60bb-4e75-92ad-c91f903e30c6'] Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7c88be4e-df90-49ba-9efa-287efbc0f43e'} Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:29:01.210203 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b50d31-60bb-4e75-92ad-c91f903e30c6'] Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b50d31-60bb-4e75-92ad-c91f903e30c6'] Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b50d31-60bb-4e75-92ad-c91f903e30c6'] Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b50d31-60bb-4e75-92ad-c91f903e30c6'] Nov 02 13:29:01.215680 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.222113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a0da45b-9da1-4fd3-8993-19aee41ec45a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group 7c88be4e-df90-49ba-9efa-287efbc0f43e does not exist Nov 02 13:29:01.222113 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-95b50d31-60bb-4e75-92ad-c91f903e30c6'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:01.223392 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a0da45b-9da1-4fd3-8993-19aee41ec45a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/7c88be4e-df90-49ba-9efa-287efbc0f43e" status: 404 len: 194 microversion: 2.1 time: 0.063907 Nov 02 13:29:01.233124 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2044/3733] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:29:01 2022] DELETE /compute/v2.1/os-security-groups/7c88be4e-df90-49ba-9efa-287efbc0f43e => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:01.238734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8eb9f516-3ff1-4e5d-83ef-f652e3c0d701 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe787578700>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:01.280463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-8eb9f516-3ff1-4e5d-83ef-f652e3c0d701 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:29:01.281579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-8eb9f516-3ff1-4e5d-83ef-f652e3c0d701 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:29:01.282296 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-8eb9f516-3ff1-4e5d-83ef-f652e3c0d701 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:29:01.282296 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-ac9b71e3-530b-48cd-98bb-b42c9c2f5143'] Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8eb9f516-3ff1-4e5d-83ef-f652e3c0d701 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-security-groups/4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 HTTP/1.1 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-ac9b71e3-530b-48cd-98bb-b42c9c2f5143'] Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '4f4ad4ca-1ad5-4e1f-8888-9c7f54579019'} Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:29:01.285038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac9b71e3-530b-48cd-98bb-b42c9c2f5143'] Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac9b71e3-530b-48cd-98bb-b42c9c2f5143'] Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac9b71e3-530b-48cd-98bb-b42c9c2f5143'] Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac9b71e3-530b-48cd-98bb-b42c9c2f5143'] Nov 02 13:29:01.290065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.295697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8eb9f516-3ff1-4e5d-83ef-f652e3c0d701 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group 4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 does not exist Nov 02 13:29:01.295697 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-ac9b71e3-530b-48cd-98bb-b42c9c2f5143'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:01.297033 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8eb9f516-3ff1-4e5d-83ef-f652e3c0d701 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/4f4ad4ca-1ad5-4e1f-8888-9c7f54579019" status: 404 len: 194 microversion: 2.1 time: 0.062444 Nov 02 13:29:01.301232 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2045/3734] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:29:01 2022] DELETE /compute/v2.1/os-security-groups/4f4ad4ca-1ad5-4e1f-8888-9c7f54579019 => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:01.318424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96931d13-bed4-4989-b054-4d1005a4b32f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe78772c4c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:01.379351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG neutronclient.v2_0.client [None req-96931d13-bed4-4989-b054-4d1005a4b32f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist", "detail": ""}} {{(pid=120928) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 13:29:01.379874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.security_group_api [None req-96931d13-bed4-4989-b054-4d1005a4b32f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Neutron security group aa3eca1a-51f4-4953-9a77-62ba45818d25 not found {{(pid=120928) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 13:29:01.380402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-96931d13-bed4-4989-b054-4d1005a4b32f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:29:01.380402 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-6270733f-e913-4413-817b-2bdd7e2b6005'] Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96931d13-bed4-4989-b054-4d1005a4b32f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25 HTTP/1.1 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: exception: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-6270733f-e913-4413-817b-2bdd7e2b6005'] Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'aa3eca1a-51f4-4953-9a77-62ba45818d25'} Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 13:29:01.383502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6270733f-e913-4413-817b-2bdd7e2b6005'] Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6270733f-e913-4413-817b-2bdd7e2b6005'] Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6270733f-e913-4413-817b-2bdd7e2b6005'] Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6270733f-e913-4413-817b-2bdd7e2b6005'] Nov 02 13:29:01.387812 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:01.392176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96931d13-bed4-4989-b054-4d1005a4b32f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Security group aa3eca1a-51f4-4953-9a77-62ba45818d25 does not exist Nov 02 13:29:01.392176 n-d-858384-19 devstack@n-api.service[120928]: Neutron server returns request_ids: ['req-6270733f-e913-4413-817b-2bdd7e2b6005'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:01.393426 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-96931d13-bed4-4989-b054-4d1005a4b32f tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25" status: 404 len: 194 microversion: 2.1 time: 0.085826 Nov 02 13:29:01.397430 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2046/3735] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:29:01 2022] DELETE /compute/v2.1/os-security-groups/aa3eca1a-51f4-4953-9a77-62ba45818d25 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:01.419330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:01.421688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:01.428623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:01.429494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:01.430311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:01.431279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:01.432261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:01.433064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:01.646471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:01.686039 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f0881137-b7e0-439f-94a8-0c50e1482663 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.766283 Nov 02 13:29:01.689646 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1690/3736] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:00 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:01.711406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:01.717323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:01.740339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:01.747346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:01.749499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:01.750739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:01.753078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:01.753934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:01.755136 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b6c8c4c-2d39-4d77-838b-a8b158eb2ed9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.356348 Nov 02 13:29:01.755886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:01.758291 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2047/3737] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:01 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:01.839308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:29:02.024523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:02.028476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:02.040004 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c71fbf98-ba67-47d6-880c-1f4c690ac40b tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 204 len: 0 microversion: 2.1 time: 0.348564 Nov 02 13:29:02.041907 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1691/3738] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:29:01 2022] DELETE /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:29:02.057721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:02.058672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:02.059519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:02.060663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:02.062087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:02.063067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:02.064031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:02.064768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:02.082355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:02.083044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:02.085494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:02.086619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:02.088800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:02.098990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:02.418385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:02.431606 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f55c2c7-2e09-4db3-8dba-69c0627d8a4d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1686 microversion: 2.1 time: 0.417197 Nov 02 13:29:02.433820 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2048/3739] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:02 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1686 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:02.521855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-931846a0-7521-49a9-b67c-8ee05f65de00 req-52f166d6-a27f-49ba-990e-c30cdf356e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c41302-b126-4b93-957b-bb4f86c2e292", "tag": "4f740d47-b052-4b9e-a6aa-c5fc11434e11"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:02.548620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-931846a0-7521-49a9-b67c-8ee05f65de00 req-52f166d6-a27f-49ba-990e-c30cdf356e07 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:02.550092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-931846a0-7521-49a9-b67c-8ee05f65de00 req-52f166d6-a27f-49ba-990e-c30cdf356e07 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:02.551742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-931846a0-7521-49a9-b67c-8ee05f65de00 req-52f166d6-a27f-49ba-990e-c30cdf356e07 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:02.587201 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-931846a0-7521-49a9-b67c-8ee05f65de00 req-52f166d6-a27f-49ba-990e-c30cdf356e07 service nova] Creating event network-changed:4f740d47-b052-4b9e-a6aa-c5fc11434e11 for instance 31c41302-b126-4b93-957b-bb4f86c2e292 on n-h2-858384-19 Nov 02 13:29:02.603509 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-931846a0-7521-49a9-b67c-8ee05f65de00 req-52f166d6-a27f-49ba-990e-c30cdf356e07 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085491 Nov 02 13:29:02.607712 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2049/3740] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:29:02.721603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:02.722904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:02.735055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:02.739818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:02.740812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:02.743437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:02.744843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:02.747057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:02.911949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:02.921338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-518da0b1-f96d-4108-b678-3bcd6d8e3e7a tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1649 microversion: 2.1 time: 0.874020 Nov 02 13:29:02.926274 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1692/3741] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:02 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1649 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:02.933375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:02.937821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:02.954605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:02.955307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:02.957776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:02.959860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:02.961415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:02.962495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:03.079295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:03.091298 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5f1892b9-068d-4c32-a0c5-a0dd16345d29 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.371451 Nov 02 13:29:03.094516 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2050/3742] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:02 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:03.421901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:03.434005 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b895f509-6df0-4862-b37e-ef490890be59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.506328 Nov 02 13:29:03.439366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1693/3743] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:02 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:03.464252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:03.465317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:03.490009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:03.491463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:03.493279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:03.495369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:03.497013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:03.499473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:03.950458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:03.953156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:03.968457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:03.969119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:03.969678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:03.973119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:03.974970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:03.980329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:04.629052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:04.644537 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-413738e1-a59f-48e0-8224-55743eccff2f tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1686 microversion: 2.1 time: 1.186368 Nov 02 13:29:04.648109 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2051/3744] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:03 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1686 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:04.662478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:04.664189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:04.679030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:04.679854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:04.680613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:04.681649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:04.682301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:04.683231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:05.088489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:05.101951 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8b1b641a-1f31-40ec-b140-c78d3eb10ae6 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1649 microversion: 2.1 time: 1.155889 Nov 02 13:29:05.105720 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1694/3745] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:03 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1649 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:05.118434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:05.127925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:05.135004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:05.135809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:05.136530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:05.137447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:05.138081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:05.138782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:05.423408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:05.435046 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-354008fb-48a7-4962-b333-e04af18fe495 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.785527 Nov 02 13:29:05.436537 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2052/3746] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:04 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:05.685984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b61187f2-e94f-4809-83bb-95cb7b63d171 req-c1f31d2d-fd67-4406-a662-8f846600196a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05", "name": "network-vif-deleted", "tag": "fe56ff1e-7166-4c49-b12f-1ded03e755d5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:05.710008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:05.725691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b61187f2-e94f-4809-83bb-95cb7b63d171 req-c1f31d2d-fd67-4406-a662-8f846600196a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:05.728263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b61187f2-e94f-4809-83bb-95cb7b63d171 req-c1f31d2d-fd67-4406-a662-8f846600196a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:05.736597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b61187f2-e94f-4809-83bb-95cb7b63d171 req-c1f31d2d-fd67-4406-a662-8f846600196a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:05.746142 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3833e0d6-d0b9-4cb7-aa8d-e088478c7ddc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.638927 Nov 02 13:29:05.755483 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1695/3747] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:05 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:05.775352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:05.776286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:05.777012 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b61187f2-e94f-4809-83bb-95cb7b63d171 req-c1f31d2d-fd67-4406-a662-8f846600196a service nova] Creating event network-vif-deleted:fe56ff1e-7166-4c49-b12f-1ded03e755d5 for instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 on n-h1-858384-19 Nov 02 13:29:05.797104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:05.797466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:05.803003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:05.803912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:05.807234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:05.807972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:05.818724 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b61187f2-e94f-4809-83bb-95cb7b63d171 req-c1f31d2d-fd67-4406-a662-8f846600196a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232533 Nov 02 13:29:05.823088 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2053/3748] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:05.964932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:05.967600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:05.968372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:05.971678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lazy-loading 'fault' on Instance uuid fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:29:06.137824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:06.139024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:06.166159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:06.166659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:06.174747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:06.178171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:06.178962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:06.183185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:06.269194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e151fa8ebc04ad286fc9ee20fc122f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d9c87a17af442bab426aaef8e4ce27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:06.286921 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-80a2f972-a084-4383-b213-12ff5e2bc3dc tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 200 len: 1335 microversion: 2.1 time: 0.530155 Nov 02 13:29:06.287565 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1696/3749] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:05 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 1335 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:06.464567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:06.465297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:06.489489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:06.491627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:06.493547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:06.495733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:06.499879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:06.502094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:06.553158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:06.565934 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a3d8a5e-66c6-41be-976d-1642ea3cd5af tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1470 microversion: 2.1 time: 0.433481 Nov 02 13:29:06.574939 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2054/3750] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:06 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1470 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:06.771630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:06.772533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:06.791035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:06.797663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:06.798248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:06.799286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:06.799905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:06.800471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:07.298606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:07.317554 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22da9818-0492-46d8-a5cd-988e7132dccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.860013 Nov 02 13:29:07.336088 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1697/3751] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:06 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:07.347627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:07.353207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] [instance: fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:07.367764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:07.392644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:07.424688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:07.434068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:07.447829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:07.452436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:07.572800 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] HTTP exception thrown: Instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 could not be found. Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Request method failure captured: Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 HTTP/1.1 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm-rgmWJWSaZZwRCXNGUgSAQbQoJ1CWfGwNAJXyjLqCw0P3ZiAl2g2TCX9hnYUJzq_mBbswiG1nOZujEJdvFxgt6b78twvPYMruv1LV_lCE_PAu8tJzVNUOsBgOiaJr998d3GzPnzL6bB3QAze7PNalT8QvTB6u9quqZxzfIukWviY8 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 09d9c87a17af442bab426aaef8e4ce27 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesAdminNegativeTest-1364265846 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/09d9c87a17af442bab426aaef8e4ce27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/09d9c87a17af442bab426aaef8e4ce27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_09d9c87a17af442bab426aaef8e4ce27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/09d9c87a17af442bab426aaef8e4ce27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesAdminNegativeTest-1364265846 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 09d9c87a17af442bab426aaef8e4ce27 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1364265846 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesAdminNegativeTest-1364265846-project Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5e151fa8ebc04ad286fc9ee20fc122f7 Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesAdminNegativeTest-1364265846-project Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 could not be found. Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05'} Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 could not be found. Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 could not be found. Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:07.589073 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 could not be found. Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Returning 404 to user: Instance fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d68a2e4-93d3-41e2-b4d0-896a83c6da9d tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05" status: 404 len: 111 microversion: 2.1 time: 0.255289 Nov 02 13:29:07.597947 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1698/3752] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:07 2022] GET /compute/v2.1/servers/fe393c70-f8e0-4fc0-83d3-b16a7e7ccd05 => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:07.616288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:07.620922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:07.632325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:07.633252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:07.633899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:07.635050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:07.643038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:07.645307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:07.793442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '209a1d83f0ce4ca6b0b27a56e5959eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a41acb2595c4028ba02cf9fd7ce5fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:07.804005 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4706fde8-191f-4a9d-8191-1b5acee9339d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 200 len: 1303 microversion: 2.1 time: 0.206655 Nov 02 13:29:07.807211 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1699/3753] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:07 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 1303 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:07.832965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f061bd7-38dc-4cb1-b864-99c1a852d3e7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] Calling method '.version_select at 0x7fe787061820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:07.856266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:07.881601 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-344e3ed1-5356-4e8b-a6cb-ea76bc36657e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 1.114052 Nov 02 13:29:07.894450 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2055/3754] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:06 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:07.924110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-433c841e-3ab9-4b6b-aafa-514661505645 req-92a1056b-9f14-487c-b58d-ba504228f5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9bd4071-e51a-429d-9e8e-d9ca8c26a37a", "name": "network-vif-deleted", "tag": "55ea9702-4291-4cad-8c7f-ce2ff4027302"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:07.954933 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f061bd7-38dc-4cb1-b864-99c1a852d3e7 tempest-VolumesAdminNegativeTest-1364265846 tempest-VolumesAdminNegativeTest-1364265846-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205426712" status: 202 len: 0 microversion: 2.1 time: 0.145076 Nov 02 13:29:07.982432 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1700/3755] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205426712 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:29:07.986223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-433c841e-3ab9-4b6b-aafa-514661505645 req-92a1056b-9f14-487c-b58d-ba504228f5d0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:07.991811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-433c841e-3ab9-4b6b-aafa-514661505645 req-92a1056b-9f14-487c-b58d-ba504228f5d0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:07.992889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-433c841e-3ab9-4b6b-aafa-514661505645 req-92a1056b-9f14-487c-b58d-ba504228f5d0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:08.042046 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-433c841e-3ab9-4b6b-aafa-514661505645 req-92a1056b-9f14-487c-b58d-ba504228f5d0 service nova] Creating event network-vif-deleted:55ea9702-4291-4cad-8c7f-ce2ff4027302 for instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a on n-h1-858384-19 Nov 02 13:29:08.069372 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-433c841e-3ab9-4b6b-aafa-514661505645 req-92a1056b-9f14-487c-b58d-ba504228f5d0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155787 Nov 02 13:29:08.077918 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2056/3756] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:08.352326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:08.354313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:08.374931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:08.377824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:08.380417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:08.385206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:08.386494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:08.388833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:08.834095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:08.835056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] [instance: e9bd4071-e51a-429d-9e8e-d9ca8c26a37a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:08.845971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:08.852856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:08.853323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:08.854162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:08.854629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:08.855062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:08.886846 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] HTTP exception thrown: Instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a could not be found. Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Request method failure captured: Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a HTTP/1.1 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnBFwucxHCStJwSXbKD32sq4XnMBo69z7zQPuNc1uxJ6MEUEdVM4rJRR_7fANGpWXnCCpUQxWGGzE5fn6DrxaQJxmNUcGkKKAFB52uOCRaf8QsFgmD6fM9KvP75CFCQ583B1UaP799ypVw8lZ8oXJf2uV7_02WPoQ1rjJTgXOnWwpH4 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8a41acb2595c4028ba02cf9fd7ce5fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8a41acb2595c4028ba02cf9fd7ce5fe4 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658526288 Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 209a1d83f0ce4ca6b0b27a56e5959eaf Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-SecurityGroupsTestJSON-1658526288-project Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a could not be found. Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e9bd4071-e51a-429d-9e8e-d9ca8c26a37a'} Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a could not be found. Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a could not be found. Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:08.895898 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:08.901499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:08.901499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:08.901499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:08.901499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:08.901499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:08.901499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a could not be found. Nov 02 13:29:08.901499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:08.901499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Returning 404 to user: Instance e9bd4071-e51a-429d-9e8e-d9ca8c26a37a could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:08.901499 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc3536b8-353f-44bc-b1d5-85263d2e9938 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a" status: 404 len: 111 microversion: 2.1 time: 0.068818 Nov 02 13:29:08.902891 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2057/3757] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:08 2022] GET /compute/v2.1/servers/e9bd4071-e51a-429d-9e8e-d9ca8c26a37a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:08.916003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1614557-3849-4a46-bb94-21a05e94ffb9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe787c159d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:08.941174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:08.968103 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-497ce99d-e7e3-489d-9c22-03da5c16b4f0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.623567 Nov 02 13:29:08.969194 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1701/3758] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:08 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:08.981095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:08.981904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:09.001004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:09.001355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:09.002174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:09.002773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:09.003286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:09.004017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:09.315636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:09.335202 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cea871bf-674a-4515-90db-4561f620a67e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.359216 Nov 02 13:29:09.358826 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1702/3759] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:08 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:09.786418 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1614557-3849-4a46-bb94-21a05e94ffb9 tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/98f79738-7aef-4468-908b-334b8f35fa17" status: 202 len: 0 microversion: 2.1 time: 0.883295 Nov 02 13:29:09.787538 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2058/3760] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:29:08 2022] DELETE /compute/v2.1/os-security-groups/98f79738-7aef-4468-908b-334b8f35fa17 => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:29:09.796640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f357b69-fb92-457b-bd39-36435762411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] Calling method '.version_select at 0x7fe78f981a60>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:09.995900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:09.996659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:10.030616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:10.032823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:10.034038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:10.036678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:10.038218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:10.040705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:10.275617 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f357b69-fb92-457b-bd39-36435762411d tempest-SecurityGroupsTestJSON-1658526288 tempest-SecurityGroupsTestJSON-1658526288-project] 10.222.0.113 "DELETE /compute/v2.1/os-security-groups/db070fd2-9920-4bf0-aaf4-e7e37cd536a5" status: 202 len: 0 microversion: 2.1 time: 0.483519 Nov 02 13:29:10.276943 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1703/3761] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:29:09 2022] DELETE /compute/v2.1/os-security-groups/db070fd2-9920-4bf0-aaf4-e7e37cd536a5 => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:29:10.364392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:10.366751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:10.392780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:10.399658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:10.400502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:10.403031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:10.405066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:10.407655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:10.626359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:10.639066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19c8ee15-0c9e-460a-bcf1-9e14f81d2d9b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.646816 Nov 02 13:29:10.639879 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2059/3762] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:09 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:11.015225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:11.040373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dab89f91-4cbb-4477-a8cc-f4ad2abde1e1 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.683283 Nov 02 13:29:11.059383 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1704/3763] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:10 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:11.426386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-053d3ff8-be48-4264-9717-0e5c133ad735 req-b20165bc-1031-41a5-b038-132c39e12ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f903fade-568a-4ab8-921c-4d0af0956d73", "name": "network-vif-plugged", "status": "completed", "tag": "2c8ab030-6991-42fe-ad13-68219a6b114c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:11.441153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:11.444994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-053d3ff8-be48-4264-9717-0e5c133ad735 req-b20165bc-1031-41a5-b038-132c39e12ca5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:11.445923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-053d3ff8-be48-4264-9717-0e5c133ad735 req-b20165bc-1031-41a5-b038-132c39e12ca5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:11.447611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-053d3ff8-be48-4264-9717-0e5c133ad735 req-b20165bc-1031-41a5-b038-132c39e12ca5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:11.487044 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-053d3ff8-be48-4264-9717-0e5c133ad735 req-b20165bc-1031-41a5-b038-132c39e12ca5 service nova] Creating event network-vif-plugged:2c8ab030-6991-42fe-ad13-68219a6b114c for instance f903fade-568a-4ab8-921c-4d0af0956d73 on n-h2-858384-19 Nov 02 13:29:11.493946 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-053d3ff8-be48-4264-9717-0e5c133ad735 req-b20165bc-1031-41a5-b038-132c39e12ca5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072355 Nov 02 13:29:11.495024 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2060/3764] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:11.663304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:11.664619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:11.687774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:11.688683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:11.689381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:11.691437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:11.692135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:11.692797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:12.082010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:12.083243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:12.092904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:12.093478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:12.094202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:12.095085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:12.095735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:12.096259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:12.423757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:12.432470 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e34d5755-c9d3-497b-a4fe-94433a0f1bad tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.361427 Nov 02 13:29:12.439834 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2061/3765] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:12 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:12.518138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:12.531310 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0973eb5a-5311-4a1a-b453-ea92e3fe584c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1527 microversion: 2.1 time: 0.871931 Nov 02 13:29:12.541777 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1705/3766] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:11 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1527 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:13.457536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:13.464077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:13.485996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:13.489243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:13.490251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:13.500763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:13.503358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:13.505387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:13.560381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:13.562205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:13.574726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:13.576375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:13.577327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:13.578551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:13.580214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:13.580949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:14.040495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:14.053535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:14.078032 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a12b639a-76e7-4aa0-999c-f3497e1be4d5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.625155 Nov 02 13:29:14.084580 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2062/3767] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:13 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:14.094072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:14.099381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:14.126726 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ada05a5-e781-412e-a8cb-023d18c514c5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1509 microversion: 2.1 time: 0.573768 Nov 02 13:29:14.130241 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1706/3768] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:13 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:15.110938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:15.112438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:15.121525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:15.122326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:15.123552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:15.124476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:15.125103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:15.125700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:15.156224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:15.156841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:15.173342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:15.173843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:15.174280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:15.175232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:15.175851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:15.182012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:15.362637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:15.376734 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8f0b11fd-6fef-4147-a744-ab83121d8c63 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.270856 Nov 02 13:29:15.378232 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2063/3769] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:15 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:15.954678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1e7ea07d-d8eb-4e8d-8db6-1b82b3179d9c req-5a5b9227-51a6-40f6-92b1-b3ca753f0b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c41302-b126-4b93-957b-bb4f86c2e292", "name": "network-vif-plugged", "status": "completed", "tag": "4f740d47-b052-4b9e-a6aa-c5fc11434e11"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:15.970319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1e7ea07d-d8eb-4e8d-8db6-1b82b3179d9c req-5a5b9227-51a6-40f6-92b1-b3ca753f0b16 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:15.984007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1e7ea07d-d8eb-4e8d-8db6-1b82b3179d9c req-5a5b9227-51a6-40f6-92b1-b3ca753f0b16 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:15.985065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1e7ea07d-d8eb-4e8d-8db6-1b82b3179d9c req-5a5b9227-51a6-40f6-92b1-b3ca753f0b16 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:15.998081 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1e7ea07d-d8eb-4e8d-8db6-1b82b3179d9c req-5a5b9227-51a6-40f6-92b1-b3ca753f0b16 service nova] Creating event network-vif-plugged:4f740d47-b052-4b9e-a6aa-c5fc11434e11 for instance 31c41302-b126-4b93-957b-bb4f86c2e292 on n-h2-858384-19 Nov 02 13:29:16.003787 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1e7ea07d-d8eb-4e8d-8db6-1b82b3179d9c req-5a5b9227-51a6-40f6-92b1-b3ca753f0b16 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150640 Nov 02 13:29:16.004973 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2064/3770] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:29:16.293399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:16.309322 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-26e4a668-4781-44bb-8ae4-78dead45aa03 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1509 microversion: 2.1 time: 1.157378 Nov 02 13:29:16.311444 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1707/3771] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:15 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1509 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:16.401161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:16.402458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:16.412487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:16.413242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:16.413915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:16.415472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:16.415472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:16.416075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:16.771478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:16.782136 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eeca70ce-4061-478a-aa1d-7b126381d4dc tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.385578 Nov 02 13:29:16.782996 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2065/3772] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:16 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:17.334697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:17.335869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:17.350910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:17.351392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:17.352012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:17.352611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:17.353068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:17.353497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:17.808001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:17.808905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:17.827926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:17.828659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:17.830200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:17.831375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:17.832283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:17.833676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:17.898145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:17.942602 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d52b2922-3873-4b07-8692-f5aac1b00794 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 200 len: 1512 microversion: 2.1 time: 0.609618 Nov 02 13:29:17.966601 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1708/3773] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:17 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 1512 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:17.997404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:18.004667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:18.041541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:18.043590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:18.049227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:18.052852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:18.055129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:18.056169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:18.184142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:29:18.203854 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.api [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Working on deleting snapshot 49a60147-08e0-41ef-bb17-4bd231980a9e from shelved instance... Nov 02 13:29:18.580595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:18.594123 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16e69472-a357-4911-b583-cded125c950c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1321 microversion: 2.1 time: 0.790038 Nov 02 13:29:18.613246 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2066/3774] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:17 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1321 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:18.631596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3e11ff6e-462a-40d4-8a91-0db62c08bab3 req-8629a448-1a4b-4afa-ae20-6d1f56c248bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a0aa59-efb1-4c34-bca2-780b90088e7f", "name": "network-vif-unplugged", "status": "completed", "tag": "065e6efd-a2b8-42c7-a53e-45a0713a89cd"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:18.657624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3e11ff6e-462a-40d4-8a91-0db62c08bab3 req-8629a448-1a4b-4afa-ae20-6d1f56c248bf service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:18.658216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3e11ff6e-462a-40d4-8a91-0db62c08bab3 req-8629a448-1a4b-4afa-ae20-6d1f56c248bf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:18.658663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3e11ff6e-462a-40d4-8a91-0db62c08bab3 req-8629a448-1a4b-4afa-ae20-6d1f56c248bf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:18.677302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.compute.server_external_events [req-3e11ff6e-462a-40d4-8a91-0db62c08bab3 req-8629a448-1a4b-4afa-ae20-6d1f56c248bf service nova] Unable to find a host for instance 45a0aa59-efb1-4c34-bca2-780b90088e7f. Dropping event network-vif-unplugged {{(pid=120928) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 13:29:18.678215 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3e11ff6e-462a-40d4-8a91-0db62c08bab3 req-8629a448-1a4b-4afa-ae20-6d1f56c248bf service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.063560 Nov 02 13:29:18.678862 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2067/3775] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 13:29:19.066157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:19.077989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:19.079150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Doing local delete in cell 9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) {{(pid=120929) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 13:29:19.079716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Searching by: {'deleted': False, 'project_id': '0d74750aac324a3ab667af124ed2691b'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:29:19.080140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:19.080757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:19.081310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:19.081956 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.api [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 13:29:19.087602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] deallocate_for_instance() {{(pid=120929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 13:29:19.093692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:19.094168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:19.094648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:19.107814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:19.108978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:19.109452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:19.156602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:29:19.191973 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f60c8a6-aa1d-4ea3-b9db-4f7df13e6770 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.129892 Nov 02 13:29:19.202281 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2068/3776] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:29:19 2022] GET /compute/v2.1/servers => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:19.207423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:19.212933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:19.214045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Searching by: {'deleted': False, 'project_id': '0d74750aac324a3ab667af124ed2691b'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:29:19.220476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:19.221215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:19.221853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:19.222975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:19.223721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:19.224399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:19.257935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:29:19.303787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:19.311852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:19.312448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:19.312958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:19.662355 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4466c0e1-6f6e-4b15-8c92-7a4f050a2f61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/detail" status: 200 len: 1608 microversion: 2.1 time: 0.458811 Nov 02 13:29:19.662979 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2069/3777] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:29:19 2022] GET /compute/v2.1/servers/detail => generated 1608 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:19.691578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:19.692675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:19.699429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:19.701509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:19.702142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:19.703034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:19.703703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:19.704295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:20.089493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:20.106251 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-034c9864-c0e5-4456-8d59-9aafb85d15f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1471 microversion: 2.1 time: 0.425729 Nov 02 13:29:20.107771 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2070/3778] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:19 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1471 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:20.113609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2720acc6-9aa4-4a10-afd2-501fe49b1c71 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:20.122729 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2720acc6-9aa4-4a10-afd2-501fe49b1c71 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.013255 Nov 02 13:29:20.123836 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2071/3779] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:29:20 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:20.150158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:20.151209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:20.166295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:20.168770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:20.171646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:20.172630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:20.175749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:20.176754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:20.584779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:20.605594 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d625cce0-e713-4194-b5e8-ec7da3183448 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73" status: 200 len: 1472 microversion: 2.1 time: 0.458029 Nov 02 13:29:20.607753 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2072/3780] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:20 2022] GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:20.620769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:20.622689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:20.639481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:20.642957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:20.644742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:20.649890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:20.650377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:20.650827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:20.693632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:29:20.733950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Updating instance_info_cache with network_info: [] {{(pid=120929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:29:20.897265 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41ac22ab-523b-48ec-bd20-9ebba4cc437f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "DELETE /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 204 len: 0 microversion: 2.1 time: 0.285986 Nov 02 13:29:20.899453 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2073/3781] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:29:20 2022] DELETE /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:29:20.913353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83ddea05-5de4-4483-b367-0ea46011a87b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1440763193"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:20.935564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83ddea05-5de4-4483-b367-0ea46011a87b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:20.947452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83ddea05-5de4-4483-b367-0ea46011a87b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:20.948755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83ddea05-5de4-4483-b367-0ea46011a87b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:20.949488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83ddea05-5de4-4483-b367-0ea46011a87b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:20.950477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83ddea05-5de4-4483-b367-0ea46011a87b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:20.951486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83ddea05-5de4-4483-b367-0ea46011a87b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:20.952179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83ddea05-5de4-4483-b367-0ea46011a87b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:21.221904 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-be850e62-2265-4014-97e2-c8d58cb6168e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 204 len: 0 microversion: 2.1 time: 3.244444 Nov 02 13:29:21.226892 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1709/3782] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:29:17 2022] DELETE /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 0 bytes in 3248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:29:21.235084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-92c85795-39df-4b69-84d4-84d17c1e2638 req-284ec5ae-aec6-4355-8765-6a7c9d1e6ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a0aa59-efb1-4c34-bca2-780b90088e7f", "name": "network-vif-deleted", "tag": "065e6efd-a2b8-42c7-a53e-45a0713a89cd"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:21.249476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-92c85795-39df-4b69-84d4-84d17c1e2638 req-284ec5ae-aec6-4355-8765-6a7c9d1e6ba1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:21.250287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-92c85795-39df-4b69-84d4-84d17c1e2638 req-284ec5ae-aec6-4355-8765-6a7c9d1e6ba1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:21.251502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-92c85795-39df-4b69-84d4-84d17c1e2638 req-284ec5ae-aec6-4355-8765-6a7c9d1e6ba1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:21.268259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.compute.server_external_events [req-92c85795-39df-4b69-84d4-84d17c1e2638 req-284ec5ae-aec6-4355-8765-6a7c9d1e6ba1 service nova] Unable to find a host for instance 45a0aa59-efb1-4c34-bca2-780b90088e7f. Dropping event network-vif-deleted {{(pid=120929) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 13:29:21.269849 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-92c85795-39df-4b69-84d4-84d17c1e2638 req-284ec5ae-aec6-4355-8765-6a7c9d1e6ba1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.041621 Nov 02 13:29:21.270631 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1710/3783] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 13:29:21.276496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:21.277901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:21.287348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:21.288278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:21.288927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:21.290599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:21.291290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:21.291881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:21.398969 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83ddea05-5de4-4483-b367-0ea46011a87b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "POST /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73/action" status: 202 len: 0 microversion: 2.1 time: 0.497030 Nov 02 13:29:21.400971 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2074/3784] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:29:20 2022] POST /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:29:21.407820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:21.408980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:21.416613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:21.417775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:21.418552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:21.420598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:21.421719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:21.422388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:21.442631 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f HTTP/1.1 Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '45a0aa59-efb1-4c34-bca2-780b90088e7f'} Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:21.445585 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:21.450878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:21.450878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:21.450878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:21.450878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:21.450878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:21.450878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:29:21.450878 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:21.452708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:21.454320 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ad90c4f9-7916-477b-a411-e2d59835f8f1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 404 len: 111 microversion: 2.1 time: 0.051693 Nov 02 13:29:21.455450 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2075/3785] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:21 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:21.460885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09050b99-0eff-485c-aaed-f3eda407191c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786e6f550>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:21.548242 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09050b99-0eff-485c-aaed-f3eda407191c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.091425 Nov 02 13:29:21.552792 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2076/3786] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:21 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:21.627643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-165780464", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "37c549b8-fcca-4ed8-94a6-1e15dc2811d6"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:21.709549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] validate_networks() for [('37c549b8-fcca-4ed8-94a6-1e15dc2811d6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:29:21.815260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:21.825515 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f335ddf9-4c01-4327-838a-eba5d9fe384e tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1611 microversion: 2.1 time: 0.553347 Nov 02 13:29:21.844304 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1711/3787] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:21 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1611 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:22.572171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ae6a1f6e-ef99-4e88-b731-0b4dc8fd765a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78697baf0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:22.654679 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ae6a1f6e-ef99-4e88-b731-0b4dc8fd765a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.089741 Nov 02 13:29:22.655614 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1712/3788] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:22 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:22.866056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:22.866808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:22.892142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:22.893052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:22.893776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:22.894630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:22.895232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:22.902457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:23.015948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:29:23.016532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:29:23.017068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:29:23.017600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:29:23.018116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:29:23.034634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:23.038742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:23.040093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:23.041030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:23.043320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:23.044503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:23.094672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:29:23.108569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for user 4228809f65b74c90b1d34cecc1b4d30e and project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:29:23.143377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:29:23.145864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:29:23.269526 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5f1323fa-471f-4a3a-997d-72deba2a3bdd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.646164 Nov 02 13:29:23.275237 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2077/3789] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:29:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:29:23.307727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-78341fe1-1e91-42f7-b01b-97f0f25f2c41 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:23.308679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-78341fe1-1e91-42f7-b01b-97f0f25f2c41 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:23.509927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:23.521977 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-820f1b75-5d72-4fd7-8779-911a75331bab tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1611 microversion: 2.1 time: 0.659176 Nov 02 13:29:23.523248 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1713/3790] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:22 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1611 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:23.566499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-78341fe1-1e91-42f7-b01b-97f0f25f2c41 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:23.581503 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-78341fe1-1e91-42f7-b01b-97f0f25f2c41 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1218 microversion: 2.1 time: 0.299616 Nov 02 13:29:23.600740 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2078/3791] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:23 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1218 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:23.670803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-68c28adc-1278-499c-8b41-4e6ba7314376 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78703e040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:23.749014 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-68c28adc-1278-499c-8b41-4e6ba7314376 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.082772 Nov 02 13:29:23.749702 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1714/3792] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:23 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:24.559050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:24.568270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:24.583822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:24.584320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:24.584760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:24.585473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:24.585927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:24.586357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:24.610838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:24.611474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:24.626629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:24.627524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:24.628135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:24.634868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:24.635609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:24.636955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:24.797963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:24.806137 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c557990-4dd4-40cc-9fe3-3308eb59d72d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1214 microversion: 2.1 time: 0.203295 Nov 02 13:29:24.816343 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1715/3793] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:24 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:24.821338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2204455e-4d27-4168-b220-034fac1d95f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786d344c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:24.881953 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2204455e-4d27-4168-b220-034fac1d95f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.064371 Nov 02 13:29:24.883205 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1716/3794] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:24 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:24.964643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:24.989344 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c6a9f27-de97-40bd-858b-846fcb12143b tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1543 microversion: 2.1 time: 0.442555 Nov 02 13:29:24.993136 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2079/3795] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:24 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1543 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:25.843059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:25.846268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:25.853912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:25.854647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:25.855314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:25.856023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:25.856881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:25.857315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:25.898233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7c9cfef-0bb9-4272-90dc-7726ea03b6db tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f97e550>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:26.012409 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a7c9cfef-0bb9-4272-90dc-7726ea03b6db tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.117895 Nov 02 13:29:26.014427 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2080/3796] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:25 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:26.019640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:26.020272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:26.029851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:26.030365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:26.030816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:26.038725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:26.039393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:26.039884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:26.198811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:26.226444 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb5861bf-915d-4a3d-9015-fc1f8c2b6c3d tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1543 microversion: 2.1 time: 0.201582 Nov 02 13:29:26.226444 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2081/3797] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:26 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1543 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:26.439596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d56688f8-893e-4197-989e-062421645da2 req-21c91096-9834-44c5-ae33-f3a23ac62d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b89c0d2-e784-4971-be86-f981bb800744", "name": "network-vif-deleted", "tag": "e2ea0671-cd52-449c-b2f7-37963312ecae"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:26.453528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:26.464275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d56688f8-893e-4197-989e-062421645da2 req-21c91096-9834-44c5-ae33-f3a23ac62d63 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:26.464718 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0cf9022a-3121-46fd-aa6d-63de7584b427 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1276 microversion: 2.1 time: 0.627059 Nov 02 13:29:26.467798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d56688f8-893e-4197-989e-062421645da2 req-21c91096-9834-44c5-ae33-f3a23ac62d63 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:26.470306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d56688f8-893e-4197-989e-062421645da2 req-21c91096-9834-44c5-ae33-f3a23ac62d63 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:26.491960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:26.499615 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1717/3798] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:25 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1276 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:26.505429 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d56688f8-893e-4197-989e-062421645da2 req-21c91096-9834-44c5-ae33-f3a23ac62d63 service nova] Creating event network-vif-deleted:e2ea0671-cd52-449c-b2f7-37963312ecae for instance 5b89c0d2-e784-4971-be86-f981bb800744 on n-h1-858384-19 Nov 02 13:29:26.515750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d56688f8-893e-4197-989e-062421645da2 req-21c91096-9834-44c5-ae33-f3a23ac62d63 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080308 Nov 02 13:29:26.516795 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2082/3799] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:27.029833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5129e94d-3e69-42d9-afb5-4133bdb5cf0a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f93d040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:27.107601 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5129e94d-3e69-42d9-afb5-4133bdb5cf0a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.081148 Nov 02 13:29:27.108293 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1718/3800] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:27 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:27.243548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:27.244915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:27.260308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:27.261071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:27.261233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:27.261963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:27.262956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:27.263703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:27.385830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:27.400262 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-944ad41b-cfd5-4500-a34b-12b6de6f5655 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1254 microversion: 2.1 time: 0.161937 Nov 02 13:29:27.402761 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2083/3801] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:27 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1254 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:27.493489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:27.495015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:27.510425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:27.512068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:27.512783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:27.514686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:27.515371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:27.515996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:27.775842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:27.795659 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e2277b38-06cc-4f69-86ed-c3a3f7f788f4 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1276 microversion: 2.1 time: 0.303768 Nov 02 13:29:27.797370 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1719/3802] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:27 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1276 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:28.133383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dee22d39-1929-4ef7-85c8-e3a6defa9e05 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787867af0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:28.235392 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dee22d39-1929-4ef7-85c8-e3a6defa9e05 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.110723 Nov 02 13:29:28.239501 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2084/3803] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:28 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:28.427587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:28.428197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:28.451720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:28.452309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:28.459282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:28.461327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:28.465366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:28.468232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:28.734420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:28.752202 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-364b058e-8680-4d37-a9d8-8ae6f09ae590 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1254 microversion: 2.1 time: 0.329586 Nov 02 13:29:28.752802 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1720/3804] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:28 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1254 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:28.829935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:28.829935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:28.854250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:28.858774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:28.859422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:28.860194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:28.862591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:28.867376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:29.255656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-107bc22c-e875-4502-b453-ccc0532b5032 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78fa86790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:29.352037 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-107bc22c-e875-4502-b453-ccc0532b5032 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.100305 Nov 02 13:29:29.352748 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1721/3805] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:29 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:29.458335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:29.480062 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee9b43fa-7e20-46fb-8483-5984712b99f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.658262 Nov 02 13:29:29.487269 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2085/3806] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:28 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:29.782569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:29.784984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:29.798105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:29.799016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:29.801264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:29.802306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:29.804118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:29.805174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:29.986223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:29.989056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:30.000720 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e16afbdd-d97d-49ce-84c5-7c476f4cb1ee tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1254 microversion: 2.1 time: 0.224865 Nov 02 13:29:30.007092 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1722/3807] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:29 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1254 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:30.370015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f129a44-a7d4-45b2-ae69-a19effb0625f tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7878b7f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:30.391660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c4404195-1131-4d4a-91a3-d692d35f2d2c req-61a8df91-8914-492e-b967-b31fc70614dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f903fade-568a-4ab8-921c-4d0af0956d73", "name": "network-vif-plugged", "status": "completed", "tag": "2c8ab030-6991-42fe-ad13-68219a6b114c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:30.404853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:30.438511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c4404195-1131-4d4a-91a3-d692d35f2d2c req-61a8df91-8914-492e-b967-b31fc70614dd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:30.440458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c4404195-1131-4d4a-91a3-d692d35f2d2c req-61a8df91-8914-492e-b967-b31fc70614dd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:30.441720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c4404195-1131-4d4a-91a3-d692d35f2d2c req-61a8df91-8914-492e-b967-b31fc70614dd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:30.511359 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c4404195-1131-4d4a-91a3-d692d35f2d2c req-61a8df91-8914-492e-b967-b31fc70614dd service nova] Creating event network-vif-plugged:2c8ab030-6991-42fe-ad13-68219a6b114c for instance f903fade-568a-4ab8-921c-4d0af0956d73 on n-h2-858384-19 Nov 02 13:29:30.523878 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f129a44-a7d4-45b2-ae69-a19effb0625f tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.158983 Nov 02 13:29:30.540288 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c4404195-1131-4d4a-91a3-d692d35f2d2c req-61a8df91-8914-492e-b967-b31fc70614dd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153482 Nov 02 13:29:30.545724 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2086/3808] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:30 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:30.554281 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1723/3809] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:30.562111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:30.563183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:30.576991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:30.577960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:30.578669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:30.579969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:30.580673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:30.581364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:31.032246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:31.033032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:31.050157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:31.059011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:31.063152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:31.064653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:31.069431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:31.079346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:31.187629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:31.206396 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c25e40a-1017-4c91-a563-9a678c45ebda tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.659031 Nov 02 13:29:31.207010 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2087/3810] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:30 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:31.542377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-876efb92-e55c-4366-90a2-1fa386bcad79 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78766edc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:31.574218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:31.591571 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5f74c2f4-ed22-42cc-a5ca-8dcbed55b2f7 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1254 microversion: 2.1 time: 0.558818 Nov 02 13:29:31.594526 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1724/3811] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:31 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1254 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:31.627321 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-876efb92-e55c-4366-90a2-1fa386bcad79 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.089582 Nov 02 13:29:31.627934 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2088/3812] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:31 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:32.233919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:32.234793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:32.243249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:32.254335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:32.254905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:32.257418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:32.263924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:32.264739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:32.618196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:32.619832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:32.656281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:32.656994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:32.659723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:32.660685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:32.661315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:32.662419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:32.823929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:32.833723 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aad9422f-f6bb-4613-b901-872f46dcceb1 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1254 microversion: 2.1 time: 0.220258 Nov 02 13:29:32.837433 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2089/3813] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:32 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1254 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:32.851220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1fab9804-66d9-4d20-812a-2043e8e4579a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787b18670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:32.945512 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1fab9804-66d9-4d20-812a-2043e8e4579a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.104838 Nov 02 13:29:32.946181 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2090/3814] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:32 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:33.012827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:33.023547 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b5f8190c-106b-401f-935c-d63796554d9c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.794357 Nov 02 13:29:33.031837 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1725/3815] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:32 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:33.186520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:33.192783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-54b105b3-ee6f-4347-b287-e85264deffab req-e58a63b6-e879-46c9-94f6-8cc1b35213a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc799996-097f-4616-9175-cfdf0034603a", "tag": "8ac99842-4078-41b2-b11f-6d5a0c860509"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:33.237720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-54b105b3-ee6f-4347-b287-e85264deffab req-e58a63b6-e879-46c9-94f6-8cc1b35213a3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:33.243375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-54b105b3-ee6f-4347-b287-e85264deffab req-e58a63b6-e879-46c9-94f6-8cc1b35213a3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:33.244176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-54b105b3-ee6f-4347-b287-e85264deffab req-e58a63b6-e879-46c9-94f6-8cc1b35213a3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:33.283570 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-54b105b3-ee6f-4347-b287-e85264deffab req-e58a63b6-e879-46c9-94f6-8cc1b35213a3 service nova] Creating event network-changed:8ac99842-4078-41b2-b11f-6d5a0c860509 for instance fc799996-097f-4616-9175-cfdf0034603a on n-h1-858384-19 Nov 02 13:29:33.296486 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-54b105b3-ee6f-4347-b287-e85264deffab req-e58a63b6-e879-46c9-94f6-8cc1b35213a3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109866 Nov 02 13:29:33.302765 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2091/3816] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:33.861019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:33.861746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:33.884860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:33.885847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:33.886354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:33.887222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:33.888632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:33.889126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:33.974355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29acf741-01d6-4078-bf5d-cfccc435a438 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78772c820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:33.987832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:34.027357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:34.042047 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dea9c0b0-42da-480f-89b6-05a6243aeb4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1254 microversion: 2.1 time: 0.185584 Nov 02 13:29:34.043682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1726/3817] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:33 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1254 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:34.066554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:34.067703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:34.087737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:34.088370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:34.097105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:34.104057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:34.104703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:34.105873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:34.152302 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29acf741-01d6-4078-bf5d-cfccc435a438 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.184651 Nov 02 13:29:34.153488 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2092/3818] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:33 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:34.636568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f3fe800-0199-4288-a254-780e022503da tempest-FlavorsV2NegativeTest-1414889207 tempest-FlavorsV2NegativeTest-1414889207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:34.665900 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f3fe800-0199-4288-a254-780e022503da tempest-FlavorsV2NegativeTest-1414889207 tempest-FlavorsV2NegativeTest-1414889207-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.274919 Nov 02 13:29:34.683139 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2093/3819] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:29:34 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:34.921362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:34.931023 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-19a6ac05-db5c-4666-871b-b61c010c28ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.869219 Nov 02 13:29:34.931654 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1727/3820] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:34 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:35.080068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:35.082618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:35.111207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:35.112654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:35.114647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:35.118087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:35.121076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:35.123155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:35.174265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9c65fc39-bdf4-4ce0-8cf8-38a62c4b4161 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786914af0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:35.375278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:35.406194 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b7e35e8c-48ce-4558-836a-5e9ec6ddb5a3 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1254 microversion: 2.1 time: 0.335091 Nov 02 13:29:35.408299 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2094/3821] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:35 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1254 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:35.753837 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9c65fc39-bdf4-4ce0-8cf8-38a62c4b4161 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.587479 Nov 02 13:29:35.754867 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1728/3822] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:35 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:35.815412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-773c95a6-8394-4d99-9aa1-5e7d16f9b9ac tempest-FlavorsV2NegativeTest-1414889207 tempest-FlavorsV2NegativeTest-1414889207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2041473297", "imageRef": "fb28221c-5787-45bf-8f70-cb420f84eb2c", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:35.914964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-773c95a6-8394-4d99-9aa1-5e7d16f9b9ac tempest-FlavorsV2NegativeTest-1414889207 tempest-FlavorsV2NegativeTest-1414889207-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:29:35.957610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:35.958929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:35.976991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:35.980729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:35.981628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:35.982750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:35.983471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:35.984121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:36.414047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:36.424813 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e8289e7c-15ca-44f5-a5cb-b0036b5f7244 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.474639 Nov 02 13:29:36.447462 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1729/3823] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:35 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:36.455097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:36.461380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:36.480427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:36.482828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:36.483524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:36.486031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:36.487666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:36.488312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:36.650930 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-773c95a6-8394-4d99-9aa1-5e7d16f9b9ac tempest-FlavorsV2NegativeTest-1414889207 tempest-FlavorsV2NegativeTest-1414889207-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-773c95a6-8394-4d99-9aa1-5e7d16f9b9ac tempest-FlavorsV2NegativeTest-1414889207 tempest-FlavorsV2NegativeTest-1414889207-project] Request method failure captured: Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 143 Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnC-k_z6tXLREFK60C07KkGWYHLD9yuwZ8QXppGzE5Ehgv9S5oTjvGk7W9PRidtzjl4s1ouurlOv3d_ZKFkMx3B9nBVO53AuxGdjKqqJeRhbuYcBsU8rKFj8nK9Sq1OPJHNYUDw6I9gCNe53WWHZt-5EijIk8G4M2J7ma-syYDFKWvA Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 6b99ab5d3def4dfdae52b4ed7675c87e Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FlavorsV2NegativeTest-1414889207 Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6b99ab5d3def4dfdae52b4ed7675c87e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6b99ab5d3def4dfdae52b4ed7675c87e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_6b99ab5d3def4dfdae52b4ed7675c87e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/6b99ab5d3def4dfdae52b4ed7675c87e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FlavorsV2NegativeTest-1414889207 Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 6b99ab5d3def4dfdae52b4ed7675c87e Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1414889207 Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FlavorsV2NegativeTest-1414889207-project Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: a2ad0f0465834d778f26b6cfa403dba1 Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FlavorsV2NegativeTest-1414889207-project Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2041473297", "imageRef": "fb28221c-5787-45bf-8f70-cb420f84eb2c", "flavorRef": "452"}} Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: exception: Flavor's memory is too small for requested image. Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2041473297', 'imageRef': 'fb28221c-5787-45bf-8f70-cb420f84eb2c', 'flavorRef': '452'}}} Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:29:36.654077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Nov 02 13:29:36.659545 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:36.674006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-773c95a6-8394-4d99-9aa1-5e7d16f9b9ac tempest-FlavorsV2NegativeTest-1414889207 tempest-FlavorsV2NegativeTest-1414889207-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:36.676067 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-773c95a6-8394-4d99-9aa1-5e7d16f9b9ac tempest-FlavorsV2NegativeTest-1414889207 tempest-FlavorsV2NegativeTest-1414889207-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.865041 Nov 02 13:29:36.678020 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2095/3824] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:29:35 2022] POST /compute/v2.1/servers => generated 93 bytes in 869 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:29:36.708363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:36.734598 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dd67b1d8-4eee-4d52-b4dc-7e74ef9c7783 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1254 microversion: 2.1 time: 0.285525 Nov 02 13:29:36.753257 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1730/3825] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:36 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1254 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:36.771797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-981510f8-6e7e-4b7d-bbbb-6b3ca2f2dce9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7878b1700>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:37.459914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:37.460858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:37.482279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:37.482788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:37.486390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:37.505584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:37.506379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:37.509134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:37.589762 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-981510f8-6e7e-4b7d-bbbb-6b3ca2f2dce9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.821429 Nov 02 13:29:37.604648 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2096/3826] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:36 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:37.759940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:37.760607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:37.780566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:37.781669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:37.784474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:37.787874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:37.790198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:37.794721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:37.886607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:37.888112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:37.890772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:37.891558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lazy-loading 'fault' on Instance uuid 5b89c0d2-e784-4971-be86-f981bb800744 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:29:38.226008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:38.247535 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8d8a81cc-4f00-4dbb-ae36-cd5d16b47a3e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.786764 Nov 02 13:29:38.248816 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1731/3827] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:37 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:38.606941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-85f4df34-80e4-4fee-809e-deca853279e2 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787dac9d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:38.686504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-85f4df34-80e4-4fee-809e-deca853279e2 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.084156 Nov 02 13:29:38.690402 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1732/3828] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:38 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:38.865973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca29fecc3e35486ba22ef8a7b415c63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d74750aac324a3ab667af124ed2691b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:38.882783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f4cba9da-9708-4532-80a0-ff0b8343cd4f tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 200 len: 1213 microversion: 2.1 time: 1.128093 Nov 02 13:29:38.898437 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2097/3829] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:37 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 1213 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:39.275143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:39.275856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:39.289011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:39.302206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:39.302763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:39.303824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:39.306462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:39.307729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:39.706587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a12b8a2f-0b84-49ba-8268-d8ab722534f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78c05caf0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:39.786119 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a12b8a2f-0b84-49ba-8268-d8ab722534f5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.083580 Nov 02 13:29:39.786723 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2098/3830] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:39 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:39.876096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:39.886668 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83b1c549-1cc1-442f-89ce-964ccea6193d tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.615633 Nov 02 13:29:39.915145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:39.915781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] [instance: 5b89c0d2-e784-4971-be86-f981bb800744] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:39.921828 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1733/3831] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:39 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:39.935519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:39.936310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:39.938800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:39.939883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:39.943368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:39.944021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:39.979435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] HTTP exception thrown: Instance 5b89c0d2-e784-4971-be86-f981bb800744 could not be found. Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Request method failure captured: Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 HTTP/1.1 Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnA__GiYZ_F8IBkRJ1E3BNg6Sq0eb4eVFeDgIP869ryWSsMFbZRTjcle-7iPf-xrZMwkFmQfNwEmwUyrt5CIJWa9xw4XSu3u4T3-Hzg3dau_qOg4Ky7EEQC63B2mK8SLE1VFr2DBIKsaZihACN_JnNNfqowQEL5Pgdk75jFLNeqpAyw Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 0d74750aac324a3ab667af124ed2691b Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestBootFromVolume-1122407619 Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0d74750aac324a3ab667af124ed2691b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0d74750aac324a3ab667af124ed2691b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_0d74750aac324a3ab667af124ed2691b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/0d74750aac324a3ab667af124ed2691b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestBootFromVolume-1122407619 Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 0d74750aac324a3ab667af124ed2691b Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1122407619 Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestBootFromVolume-1122407619-project Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: ca29fecc3e35486ba22ef8a7b415c63c Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestBootFromVolume-1122407619-project Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 5b89c0d2-e784-4971-be86-f981bb800744 could not be found. Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '5b89c0d2-e784-4971-be86-f981bb800744'} Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b89c0d2-e784-4971-be86-f981bb800744 could not be found. Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b89c0d2-e784-4971-be86-f981bb800744 could not be found. Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:39.981921 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:29:39.986708 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:39.986708 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:29:39.986708 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:29:39.986708 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:29:39.986708 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:29:39.986708 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:29:39.986708 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b89c0d2-e784-4971-be86-f981bb800744 could not be found. Nov 02 13:29:39.986708 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:29:39.992903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Returning 404 to user: Instance 5b89c0d2-e784-4971-be86-f981bb800744 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:29:39.994439 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2594807-84e0-4344-b5eb-5303c3ed9c61 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744" status: 404 len: 111 microversion: 2.1 time: 0.085466 Nov 02 13:29:40.005017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-67f24631-8314-4eb8-8c12-0911ba3189b8 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] Calling method '.version_select at 0x7fe78f863670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:40.010242 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2099/3832] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:39 2022] GET /compute/v2.1/servers/5b89c0d2-e784-4971-be86-f981bb800744 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:29:40.033508 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-67f24631-8314-4eb8-8c12-0911ba3189b8 tempest-ServersTestBootFromVolume-1122407619 tempest-ServersTestBootFromVolume-1122407619-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-325163301" status: 202 len: 0 microversion: 2.1 time: 0.033140 Nov 02 13:29:40.038239 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1734/3833] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:29:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-325163301 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:29:40.804702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1f5beff6-87b5-4796-b47b-927fab21edb3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787b16670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:40.915579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:40.916249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:40.958412 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1f5beff6-87b5-4796-b47b-927fab21edb3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.157156 Nov 02 13:29:40.959482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:40.960077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:40.960528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:40.963553 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2100/3834] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:40 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:40.963793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:40.964455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:40.964904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:41.974719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd1cb661-fd49-4f18-9d55-4b89f63474f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f960f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:42.087191 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd1cb661-fd49-4f18-9d55-4b89f63474f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.116406 Nov 02 13:29:42.088536 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2101/3835] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:41 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:42.178444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:42.188205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8663477a-4966-4a5c-bc93-9e192dcb49ae tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 1.277161 Nov 02 13:29:42.188816 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1735/3836] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:40 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:42.507857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:42.516593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:42.518905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:42.537577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:42.542556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:42.545055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:42.547912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:42.554421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:42.555890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:43.104041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6d743b45-35a4-4e8b-8bef-337beb7f13a5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786906310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:43.237662 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6d743b45-35a4-4e8b-8bef-337beb7f13a5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.137398 Nov 02 13:29:43.240508 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1736/3837] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:43 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:43.251253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:43.252167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:43.274066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:43.274761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:43.275427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:43.276309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:43.283373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:43.284097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:44.016035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:44.041600 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f2b4b5c5-c12c-4dc1-9323-0358b258c359 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.799982 Nov 02 13:29:44.042197 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1737/3838] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:43 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:44.260779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-196c4ee9-71f0-488f-9f9f-14ea6a1ae317 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786935790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:44.431375 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-196c4ee9-71f0-488f-9f9f-14ea6a1ae317 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.172923 Nov 02 13:29:44.434321 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1738/3839] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:44 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:44.478484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:44.494085 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5413be3b-7b55-4477-87bf-fd8cc2abbec7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 1.993330 Nov 02 13:29:44.500967 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2102/3840] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:42 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:44.520894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f601f657-4ef0-4382-93fd-f3addb09e014 req-0722718b-3dc1-49b9-abc5-001c27c6ca6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc799996-097f-4616-9175-cfdf0034603a", "name": "network-vif-plugged", "status": "completed", "tag": "8ac99842-4078-41b2-b11f-6d5a0c860509"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:44.539945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:44.540584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:44.600690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f601f657-4ef0-4382-93fd-f3addb09e014 req-0722718b-3dc1-49b9-abc5-001c27c6ca6c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:44.603330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f601f657-4ef0-4382-93fd-f3addb09e014 req-0722718b-3dc1-49b9-abc5-001c27c6ca6c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:44.607751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f601f657-4ef0-4382-93fd-f3addb09e014 req-0722718b-3dc1-49b9-abc5-001c27c6ca6c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:44.610678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:44.614964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:44.617610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:44.623250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:44.623762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:44.624219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:44.643307 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f601f657-4ef0-4382-93fd-f3addb09e014 req-0722718b-3dc1-49b9-abc5-001c27c6ca6c service nova] Creating event network-vif-plugged:8ac99842-4078-41b2-b11f-6d5a0c860509 for instance fc799996-097f-4616-9175-cfdf0034603a on n-h1-858384-19 Nov 02 13:29:44.656978 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f601f657-4ef0-4382-93fd-f3addb09e014 req-0722718b-3dc1-49b9-abc5-001c27c6ca6c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149961 Nov 02 13:29:44.671054 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1739/3841] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:29:45.069557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:45.070475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:45.078830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:45.087761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:45.088387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:45.089496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:45.091079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:45.093595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:45.914556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:45.928969 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bb29d87b-4b43-4d4f-ab10-1ef7bf6012e3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.863113 Nov 02 13:29:45.930059 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1740/3842] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:45 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:45.947384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cb307015-948d-447d-b051-c946b42b8734 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786906ee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:46.057259 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cb307015-948d-447d-b051-c946b42b8734 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.124210 Nov 02 13:29:46.058339 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1741/3843] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:45 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:46.554775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:46.580373 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-011e9e3d-4f4d-4305-8680-28651fc16fc3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 2.058861 Nov 02 13:29:46.585014 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2103/3844] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:44 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:46.613586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:46.614093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:46.638861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:46.642926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:46.643480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:46.648222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:46.652163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:46.659448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:46.957964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:46.959045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:46.974162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:46.977021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:46.977799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:46.978837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:46.979614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:46.980295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:47.752490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:47.768248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cddd0b62-6fd0-4978-a43d-4294732bdc3c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1318 microversion: 2.1 time: 0.812736 Nov 02 13:29:47.770567 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2104/3845] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:46 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:47.798164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b029203e-9824-4ca7-9e69-97bf9ad5dcb4 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f98ed30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:47.926882 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b029203e-9824-4ca7-9e69-97bf9ad5dcb4 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.153239 Nov 02 13:29:47.939468 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2105/3846] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:47 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:48.076083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:48.091919 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0867bfa7-1ce2-4a6a-9d6e-3dd51117e5b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 1.484091 Nov 02 13:29:48.104575 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1742/3847] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:46 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:48.132922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:48.135983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:48.163158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:48.169496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:48.170085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:48.173536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:48.176702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:48.179909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:48.792906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:48.794957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:48.816385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:48.817943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:48.819848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:48.820983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:48.823203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:48.825845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:48.864186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:48.883045 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ccdc314c-d2ae-4911-8cd4-e774ddd903a6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.754837 Nov 02 13:29:48.883717 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2106/3848] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:48 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:48.952827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d409d00b-d8a1-4545-9d3c-e6fd5e0886b9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f93f8b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:49.088118 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d409d00b-d8a1-4545-9d3c-e6fd5e0886b9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.142056 Nov 02 13:29:49.098263 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2107/3849] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:48 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:49.296858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1710531115", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0f49ae81-cfe3-4633-a929-56b3685d4723"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:49.298978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:49.310556 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2dbfc797-0389-4006-8417-fb0fd6640a1a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1505 microversion: 2.1 time: 0.522459 Nov 02 13:29:49.322025 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1743/3850] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:48 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:49.352548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-09e37e39-bbc2-41b7-9f2f-f0e35f5c0ce5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:29:49.375407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09e37e39-bbc2-41b7-9f2f-f0e35f5c0ce5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:49.376331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09e37e39-bbc2-41b7-9f2f-f0e35f5c0ce5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:49.377492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09e37e39-bbc2-41b7-9f2f-f0e35f5c0ce5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:49.409807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] validate_networks() for [('0f49ae81-cfe3-4633-a929-56b3685d4723', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:29:49.434945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-09e37e39-bbc2-41b7-9f2f-f0e35f5c0ce5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Going to try to stop instance {{(pid=120929) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:29:49.690490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-09e37e39-bbc2-41b7-9f2f-f0e35f5c0ce5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a/action" status: 202 len: 0 microversion: 2.1 time: 0.341291 Nov 02 13:29:49.692667 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1744/3851] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:29:49 2022] POST /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:29:49.711307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:49.715631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:49.739909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:49.743022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:49.744460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:49.745784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:49.747999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:49.758275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:50.239622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:50.242072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:50.258178 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-09032bc1-649c-44fe-9075-e5f47c6fc742 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.559455 Nov 02 13:29:50.260886 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1745/3852] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:49 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:50.281191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8b5368b8-4c1d-4f38-9197-6c3e1f19e2fb tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786935040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:50.374926 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8b5368b8-4c1d-4f38-9197-6c3e1f19e2fb tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.112010 Nov 02 13:29:50.375597 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1746/3853] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:50 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:51.288177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:51.289074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:51.312327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:51.313285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:51.318436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:51.319841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:51.320492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:51.321094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:51.831220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:51.841940 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-50594235-e4f9-460c-838f-f383774f1273 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.558429 Nov 02 13:29:51.847667 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1747/3854] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:51 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:51.862331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eaba0220-5289-4d34-847b-ccf6fc07c103 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f863670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:51.955802 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eaba0220-5289-4d34-847b-ccf6fc07c103 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.105997 Nov 02 13:29:51.956756 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1748/3855] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:51 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:52.579071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:29:52.581006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:29:52.582066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:29:52.582205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:29:52.582678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:29:52.607572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:52.608082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:52.608685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:52.609278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:52.610373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:52.611164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:52.655872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:29:52.674600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for user fa31baf6e9c94e8393baad059544adb5 and project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:29:52.703785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:29:52.707546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:29:52.822218 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1cb452af-ff0c-4379-ace9-cade4812d040 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.531112 Nov 02 13:29:52.823811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2108/3856] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:29:49 2022] POST /compute/v2.1/servers => generated 382 bytes in 3533 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:29:52.846340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-455eda5b-c4e2-49dd-b450-8fa08697f078 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:52.847611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-455eda5b-c4e2-49dd-b450-8fa08697f078 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:52.890866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:52.894051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:52.911440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:52.912425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:52.913049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:52.916557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:52.917288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:52.918404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:53.132719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-455eda5b-c4e2-49dd-b450-8fa08697f078 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:53.154567 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-455eda5b-c4e2-49dd-b450-8fa08697f078 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1219 microversion: 2.1 time: 0.316955 Nov 02 13:29:53.154789 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1749/3857] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:52 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1219 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:53.180443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd44ffee-35b6-4c92-850a-b3e9a96b31cb tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868c6940>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:53.287505 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd44ffee-35b6-4c92-850a-b3e9a96b31cb tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.128980 Nov 02 13:29:53.297135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1750/3858] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:53 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:53.759755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:53.774760 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-50dafcf4-7fab-4e60-a0e8-58b32e83d680 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.903811 Nov 02 13:29:53.775905 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2109/3859] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:52 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:54.191407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:54.192910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:54.211713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:54.215997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:54.216615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:54.217883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:54.219740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:54.220435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:54.304484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c9f0038b-bb8d-40ae-b02c-74215d03a089 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f9888b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:54.410655 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c9f0038b-bb8d-40ae-b02c-74215d03a089 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.110481 Nov 02 13:29:54.411272 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2110/3860] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:54 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:54.560946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:54.575550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6eb5b3a8-a83f-40b7-a5b9-2e62ac89070d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1215 microversion: 2.1 time: 0.401924 Nov 02 13:29:54.592600 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1751/3861] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:54 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1215 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:54.801346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:54.801970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:54.821546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:54.822041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:54.822489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:54.823237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:54.823690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:54.832389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:55.427174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4e9da148-9808-415a-81ae-089280b5fd02 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78c540670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:55.590508 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4e9da148-9808-415a-81ae-089280b5fd02 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.166710 Nov 02 13:29:55.591102 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1752/3862] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:55 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:55.608297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:55.620082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:55.631068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:55.640786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:55.641511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:55.642439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:55.643100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:55.643747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:55.784063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:55.792500 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c33bd93d-1b9b-4411-b66b-e5fb0f2f633c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1289 microversion: 2.1 time: 0.188893 Nov 02 13:29:55.793855 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1753/3863] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:55 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1289 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:56.612552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dd05764e-ad4c-43bc-be9a-f1e3873beefe tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7869548b0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:56.642779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:56.661705 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e32118fb-29f3-44a9-8055-4af171df9e1c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 1.857015 Nov 02 13:29:56.668533 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2111/3864] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:54 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:56.708788 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dd05764e-ad4c-43bc-be9a-f1e3873beefe tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.103854 Nov 02 13:29:56.710196 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1754/3865] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:56 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:56.818916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:56.819875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:56.833877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:56.839151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:56.842782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:56.847397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:56.850876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:56.853098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:57.107679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:57.131840 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ea3a8e4b-ea77-4569-93dc-51d3f4096662 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1277 microversion: 2.1 time: 0.315626 Nov 02 13:29:57.134903 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2112/3866] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:56 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1277 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:57.695714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:57.696390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:57.717873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:57.719220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:57.720477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:57.722053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:57.724204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:57.724739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:57.726452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06aefe2b-2e67-4d75-8411-2e431fad22e4 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f955af0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:57.804723 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06aefe2b-2e67-4d75-8411-2e431fad22e4 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1458 microversion: 2.1 time: 0.082426 Nov 02 13:29:57.807401 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2113/3867] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:57 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1458 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:29:58.150006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:58.166152 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-30a86467-9526-476c-9abc-49c206f12f13 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.472445 Nov 02 13:29:58.171018 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1755/3868] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:57 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:58.239224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:58.239224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:58.255543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:58.256046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:58.256502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:58.257237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:58.257704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:58.258147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:58.261753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=87 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:29:58.519389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:29:58.536451 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0747366-dc15-4d2c-8063-86810c0b7fd0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1277 microversion: 2.1 time: 0.302029 Nov 02 13:29:58.537718 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2114/3869] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:58 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1277 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:58.823282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-193b2377-b642-4596-84e9-ae07543358a8 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f93dd30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:58.911423 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-193b2377-b642-4596-84e9-ae07543358a8 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1467 microversion: 2.1 time: 0.091953 Nov 02 13:29:58.914241 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1756/3870] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:58 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1467 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:58.928589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ad1fb8c-99f8-40a6-b084-f107a6aae47b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787657670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:58.988476 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ad1fb8c-99f8-40a6-b084-f107a6aae47b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 200 len: 1467 microversion: 2.1 time: 0.063291 Nov 02 13:29:58.989690 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2115/3871] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:29:58 2022] GET /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 1467 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:29:59.004641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:59.005741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:59.014476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:59.015328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:59.016727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:59.017729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:59.018434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:59.019185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:59.193776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:29:59.194814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:29:59.223419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:59.224732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:59.225512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:29:59.226614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:29:59.227401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:29:59.229294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:00.095654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:00.112665 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b64139ea-9076-415e-b0df-f82838de7c9c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73" status: 200 len: 1485 microversion: 2.1 time: 1.111920 Nov 02 13:30:00.137136 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1757/3872] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:58 2022] GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 => generated 1485 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:00.155358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:00.159503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:00.204954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:00.206001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:00.207937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:00.210525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:00.214408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:00.217776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:00.289206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:00.307787 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8364837-c1a5-47c3-a6d9-886ecabe2a88 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 1.111359 Nov 02 13:30:00.308925 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2116/3873] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:29:59 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:01.161827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:01.162454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:01.177888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:01.178501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:01.178821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:01.191168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:01.191713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:01.192171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:01.500312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:01.508896 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c547871d-efb4-4d1a-9cfc-9612ec738801 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1319 microversion: 2.1 time: 1.369658 Nov 02 13:30:01.528653 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1758/3874] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:00 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1319 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:01.529418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:01.534509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:01.556599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:01.558616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:01.571463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:01.575478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:01.576771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:01.577904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:01.578612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:01.579318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:01.581201 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35099b29-9169-4163-9cee-0797334634ee tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73" status: 200 len: 1472 microversion: 2.1 time: 0.422614 Nov 02 13:30:01.583805 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2117/3875] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:01 2022] GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 => generated 1472 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:01.615014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e1b1634-4a6a-4f7e-93b3-0f7dd6998419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-19815202"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:01.622303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2e1b1634-4a6a-4f7e-93b3-0f7dd6998419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:01.637785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e1b1634-4a6a-4f7e-93b3-0f7dd6998419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:01.638641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e1b1634-4a6a-4f7e-93b3-0f7dd6998419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:01.639295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e1b1634-4a6a-4f7e-93b3-0f7dd6998419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:01.640203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e1b1634-4a6a-4f7e-93b3-0f7dd6998419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:01.640843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e1b1634-4a6a-4f7e-93b3-0f7dd6998419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:01.641445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e1b1634-4a6a-4f7e-93b3-0f7dd6998419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:02.035600 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e1b1634-4a6a-4f7e-93b3-0f7dd6998419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "POST /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292/action" status: 202 len: 0 microversion: 2.1 time: 0.422629 Nov 02 13:30:02.045085 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2118/3876] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:30:01 2022] POST /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:30:02.054072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d01cfa82-34c5-41a4-abcc-f60331d4257c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f93f4c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:02.133915 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d01cfa82-34c5-41a4-abcc-f60331d4257c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.087177 Nov 02 13:30:02.134529 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2119/3877] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:02 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:02.537596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:02.547357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:02.562245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:02.567883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:02.568602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:02.569565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:02.570812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:02.573436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:02.640877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:02.695059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:02.869310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:02.893371 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2a0a6666-70d8-4fe7-8c18-b0fad194b77b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 1.362646 Nov 02 13:30:02.894553 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1759/3878] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:01 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:03.154910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5123c1ae-3123-4f2b-855c-7a8abaf42991 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868c6160>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:03.176088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:03.233554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:03.238954 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5123c1ae-3123-4f2b-855c-7a8abaf42991 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.091872 Nov 02 13:30:03.248625 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1760/3879] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:03 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:03.254864 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-991ccc4e-3449-40f4-816f-5fc697dded64 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1319 microversion: 2.1 time: 0.718848 Nov 02 13:30:03.269733 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2120/3880] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:02 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:03.275190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a5c9e38f-362d-4cf1-a4d8-4f0a7c69a962 req-ab9d8574-d120-479d-884f-c8119a46f460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6ed66e0-3944-4d50-91e7-f1e513a1445c", "tag": "2764793c-ec29-4458-aec8-62c6e775e8f7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:03.291791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a5c9e38f-362d-4cf1-a4d8-4f0a7c69a962 req-ab9d8574-d120-479d-884f-c8119a46f460 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:03.292545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a5c9e38f-362d-4cf1-a4d8-4f0a7c69a962 req-ab9d8574-d120-479d-884f-c8119a46f460 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:03.293169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a5c9e38f-362d-4cf1-a4d8-4f0a7c69a962 req-ab9d8574-d120-479d-884f-c8119a46f460 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:03.304004 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a5c9e38f-362d-4cf1-a4d8-4f0a7c69a962 req-ab9d8574-d120-479d-884f-c8119a46f460 service nova] Creating event network-changed:2764793c-ec29-4458-aec8-62c6e775e8f7 for instance a6ed66e0-3944-4d50-91e7-f1e513a1445c on n-h2-858384-19 Nov 02 13:30:03.313203 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a5c9e38f-362d-4cf1-a4d8-4f0a7c69a962 req-ab9d8574-d120-479d-884f-c8119a46f460 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042160 Nov 02 13:30:03.314670 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1761/3881] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:03.759951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-dbabdc3e-1431-4d15-bf44-7fbf02aa6036 req-63b00c81-4ba1-4a85-9b36-152affa79cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f903fade-568a-4ab8-921c-4d0af0956d73", "name": "network-vif-unplugged", "status": "completed", "tag": "2c8ab030-6991-42fe-ad13-68219a6b114c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:03.798044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dbabdc3e-1431-4d15-bf44-7fbf02aa6036 req-63b00c81-4ba1-4a85-9b36-152affa79cbe service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:03.798548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dbabdc3e-1431-4d15-bf44-7fbf02aa6036 req-63b00c81-4ba1-4a85-9b36-152affa79cbe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:03.799257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dbabdc3e-1431-4d15-bf44-7fbf02aa6036 req-63b00c81-4ba1-4a85-9b36-152affa79cbe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:03.828410 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-dbabdc3e-1431-4d15-bf44-7fbf02aa6036 req-63b00c81-4ba1-4a85-9b36-152affa79cbe service nova] Creating event network-vif-unplugged:2c8ab030-6991-42fe-ad13-68219a6b114c for instance f903fade-568a-4ab8-921c-4d0af0956d73 on n-h2-858384-19 Nov 02 13:30:03.846060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-dbabdc3e-1431-4d15-bf44-7fbf02aa6036 req-63b00c81-4ba1-4a85-9b36-152affa79cbe service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091497 Nov 02 13:30:03.847451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2121/3882] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:03.922947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:03.923686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:03.944441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:03.944924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:03.945690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:03.946449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:03.946905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:03.947391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:04.256072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e3b6b6f-582e-4cd8-ab61-2744e1fb22b3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f93fca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:04.407710 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e3b6b6f-582e-4cd8-ab61-2744e1fb22b3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.155918 Nov 02 13:30:04.408312 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2122/3883] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:04 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:04.421877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:04.422640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:04.429492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:04.431161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:04.431161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:04.431161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:04.431699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:04.432224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:04.493242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:04.504208 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b1b5547-8eec-42e7-a3db-df661e78a8a1 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.590784 Nov 02 13:30:04.505982 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1762/3884] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:03 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:05.027586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:05.040188 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4cf6219d-a2a3-4a95-8f28-14373d7a9997 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1319 microversion: 2.1 time: 0.623322 Nov 02 13:30:05.041110 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2123/3885] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:04 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1319 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:05.427829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3d94d76-d1f4-4bc9-9aa0-c218d88f68de tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868fa310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:05.514428 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f3d94d76-d1f4-4bc9-9aa0-c218d88f68de tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.093995 Nov 02 13:30:05.515205 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1763/3886] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:05 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:05.532156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:05.535716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:05.557630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.558627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.559691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.562152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:05.562847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:05.563553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:05.880299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:05.890189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0f77d55a-26c7-48fe-9249-6263cf5552c9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.361857 Nov 02 13:30:05.891455 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2124/3887] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:05 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:06.072651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:06.074251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:06.084378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:06.085250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:06.085915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:06.086886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:06.087609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:06.088294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:06.536232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35cfe61b-98d9-4ff3-9cf3-53c3ac238998 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f98e550>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:06.623851 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35cfe61b-98d9-4ff3-9cf3-53c3ac238998 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.094134 Nov 02 13:30:06.628463 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2125/3888] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:06 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:06.830192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:06.862349 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cbfd2ad2-9649-43b9-8683-14c6a59ff277 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1319 microversion: 2.1 time: 0.793710 Nov 02 13:30:06.875413 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1764/3889] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:06 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1319 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:06.918911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:06.927515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:06.978434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:06.979266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:06.981037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:06.987455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:06.988360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:06.990281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:07.643824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5d9bbe6-56dc-41b3-9bdc-f50edc84cb54 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786898ee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:07.733932 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5d9bbe6-56dc-41b3-9bdc-f50edc84cb54 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.098119 Nov 02 13:30:07.734539 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1765/3890] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:07 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:07.889459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:07.890903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:07.910595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:07.911414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:07.925681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:07.932213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:07.934062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:07.935083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:08.312383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:08.325730 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-046351c4-df29-4dc3-ad4f-79bb147fd49e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 1.413738 Nov 02 13:30:08.328205 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2126/3891] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:06 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:08.547643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:08.563360 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2c960ce6-8b40-45c6-8080-6b3a4cfa9085 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1319 microversion: 2.1 time: 0.679656 Nov 02 13:30:08.575848 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1766/3892] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:07 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1319 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:08.751411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e36c702b-9725-4a6d-a9ab-ee2efbdbc419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f960f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:08.841386 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e36c702b-9725-4a6d-a9ab-ee2efbdbc419 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.094555 Nov 02 13:30:08.842005 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2127/3893] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:08 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:09.354087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:09.355725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:09.372099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:09.372963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:09.373742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:09.376304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:09.377008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:09.378673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:09.590886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:09.592115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:09.631300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:09.632357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:09.633075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:09.634366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:09.635251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:09.640443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:09.917161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:09.928847 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05bf3dfd-617e-4947-ac42-3eca581ecdfd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.578814 Nov 02 13:30:09.930271 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1767/3894] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:09 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:09.951951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ea66523e-87d5-481b-8bd1-7a51870e9d69 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78697b820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:10.133036 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ea66523e-87d5-481b-8bd1-7a51870e9d69 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.201241 Nov 02 13:30:10.134905 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1768/3895] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:09 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:10.422759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-892c6eb4-0cf3-4f45-96db-9bb846217b2b req-41bb62b9-5690-4ad9-92a3-c796e1349d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c41302-b126-4b93-957b-bb4f86c2e292", "name": "network-vif-plugged", "status": "completed", "tag": "4f740d47-b052-4b9e-a6aa-c5fc11434e11"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:10.450636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-892c6eb4-0cf3-4f45-96db-9bb846217b2b req-41bb62b9-5690-4ad9-92a3-c796e1349d67 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:10.453791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-892c6eb4-0cf3-4f45-96db-9bb846217b2b req-41bb62b9-5690-4ad9-92a3-c796e1349d67 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:10.454424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-892c6eb4-0cf3-4f45-96db-9bb846217b2b req-41bb62b9-5690-4ad9-92a3-c796e1349d67 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:10.499730 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-892c6eb4-0cf3-4f45-96db-9bb846217b2b req-41bb62b9-5690-4ad9-92a3-c796e1349d67 service nova] Creating event network-vif-plugged:4f740d47-b052-4b9e-a6aa-c5fc11434e11 for instance 31c41302-b126-4b93-957b-bb4f86c2e292 on n-h2-858384-19 Nov 02 13:30:10.548291 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-892c6eb4-0cf3-4f45-96db-9bb846217b2b req-41bb62b9-5690-4ad9-92a3-c796e1349d67 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110063 Nov 02 13:30:10.549468 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1769/3896] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:10.821660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1888005351", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "16a488c5-bc10-4fc2-8635-3fe544404977"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:10.940504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] validate_networks() for [('16a488c5-bc10-4fc2-8635-3fe544404977', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:30:11.643938 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:30:11.643938 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 13:30:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c (ip 10.222.0.113) !!! Nov 02 13:30:11.705407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:11.735353 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a3baf30-a66e-4c1d-b8a3-4b3e9cb4d5a5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1319 microversion: 2.1 time: 2.141850 Nov 02 13:30:11.736820 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2128/3897] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:09 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1319 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:11.779265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:11.781765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:11.816443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:11.818638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:11.820685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:11.822402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:11.823037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:11.827746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:12.455872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:12.472959 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6a99939b-e80d-4f8a-a8bf-bc26f6040ef9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.711833 Nov 02 13:30:12.474150 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2129/3898] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:11 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:12.482901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b22aee02-ccc0-4107-9c97-9cd3c9d79669 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786e6faf0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:12.566117 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b22aee02-ccc0-4107-9c97-9cd3c9d79669 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.090660 Nov 02 13:30:12.576243 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2130/3899] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:12 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:12.764874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:12.766429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:12.782178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:12.785273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:12.785734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:12.786361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:12.795405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:12.796075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:12.796683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:13.185580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:30:13.187990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:30:13.191444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:30:13.193430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:30:13.195612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:30:13.252473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:13.257488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:13.259552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:13.262161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:13.262315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:13.268032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:13.270426 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7a20a4e4-1775-476f-9fba-4919362c37c1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1319 microversion: 2.1 time: 0.511058 Nov 02 13:30:13.271639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:13.287256 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2131/3900] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:12 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:13.312552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Getting quotas for project b8254a8a3abe4829941573211dc1aa74. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:30:13.319382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Getting quotas for user 318964014c11438c9316b35382a49ed9 and project b8254a8a3abe4829941573211dc1aa74. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:30:13.337882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:30:13.341788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:30:13.410293 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-872fa079-db1a-4e9d-97eb-bd37ecede1c7 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.856229 Nov 02 13:30:13.417260 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1770/3901] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:30:10 2022] POST /compute/v2.1/servers => generated 382 bytes in 2858 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:30:13.422609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9584c8c-ba1d-4fea-a2d2-4ee4be622509 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:13.425426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f9584c8c-ba1d-4fea-a2d2-4ee4be622509 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:13.505945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:13.508735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:13.565150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:13.569034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:13.572155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:13.573152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:13.573972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:13.574673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:13.699290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9584c8c-ba1d-4fea-a2d2-4ee4be622509 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:13.708396 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f9584c8c-ba1d-4fea-a2d2-4ee4be622509 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1228 microversion: 2.1 time: 0.289734 Nov 02 13:30:13.714688 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2132/3902] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:13 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1228 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:13.728249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d501e26-fbb8-4e21-bb0f-d5f634239e5c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7879e7ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:13.826323 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d501e26-fbb8-4e21-bb0f-d5f634239e5c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.110064 Nov 02 13:30:13.827415 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2133/3903] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:13 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:13.968252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:13.983951 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bbbcefe3-856a-4778-91d3-544f9383f31a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.488150 Nov 02 13:30:13.984746 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1771/3904] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:13 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:14.296633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:14.303337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:14.330560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:14.332079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:14.333542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:14.338207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:14.343105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:14.344883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:14.347932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-2d68cb28-3d10-49ac-8e19-3db5433f72b4 req-a37150f7-9f40-476e-b12c-d55245167d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6ed66e0-3944-4d50-91e7-f1e513a1445c", "name": "network-vif-plugged", "status": "completed", "tag": "2764793c-ec29-4458-aec8-62c6e775e8f7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:14.400561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2d68cb28-3d10-49ac-8e19-3db5433f72b4 req-a37150f7-9f40-476e-b12c-d55245167d4c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:14.404675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2d68cb28-3d10-49ac-8e19-3db5433f72b4 req-a37150f7-9f40-476e-b12c-d55245167d4c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:14.405144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2d68cb28-3d10-49ac-8e19-3db5433f72b4 req-a37150f7-9f40-476e-b12c-d55245167d4c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:14.442282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-2d68cb28-3d10-49ac-8e19-3db5433f72b4 req-a37150f7-9f40-476e-b12c-d55245167d4c service nova] Creating event network-vif-plugged:2764793c-ec29-4458-aec8-62c6e775e8f7 for instance a6ed66e0-3944-4d50-91e7-f1e513a1445c on n-h2-858384-19 Nov 02 13:30:14.461908 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-2d68cb28-3d10-49ac-8e19-3db5433f72b4 req-a37150f7-9f40-476e-b12c-d55245167d4c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114595 Nov 02 13:30:14.480704 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1772/3905] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:14.745178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:14.747476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:14.778628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:14.780159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:14.784558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:14.792596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:14.800911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:14.802495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:15.127970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:15.143307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dda0b11c-4df1-4b46-808c-6a33be900e18 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1319 microversion: 2.1 time: 0.851439 Nov 02 13:30:15.144491 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2134/3906] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:14 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1319 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:15.149582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c59d645-8cf0-4a66-b515-506580792ccb tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787893ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:15.158122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:15.170518 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-87f777d0-2da2-48c9-ad0c-d5a52a2582db tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1232 microversion: 2.1 time: 0.433444 Nov 02 13:30:15.171837 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1773/3907] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:14 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1232 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:15.205382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:15.206356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:15.227446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:15.228301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:15.230192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:15.243808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:15.247725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:15.248914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:15.279865 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c59d645-8cf0-4a66-b515-506580792ccb tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.133865 Nov 02 13:30:15.283544 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2135/3908] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:15 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:16.058022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:16.066433 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83263b88-26ad-4c4b-ae89-4968d4208e07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1515 microversion: 2.1 time: 0.890211 Nov 02 13:30:16.067029 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1774/3909] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:15 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1515 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:16.166683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:16.171842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:16.196333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:16.197240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:16.198036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:16.198940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:16.199587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:16.200987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:16.201647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:16.203032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:16.206709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:16.207234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:16.207672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:16.211556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:16.213288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:16.221142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:16.430681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:16.439668 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-15a27d50-20c1-494a-9f32-aeb968dce4f9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1288 microversion: 2.1 time: 0.247496 Nov 02 13:30:16.447562 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1775/3910] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:16 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1288 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:16.463808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed413cde-ef34-466c-bd95-d50cf8ecf580 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868fac10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:16.730620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:16.766118 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c224240-00bf-4a6a-82d9-033571fec270 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1319 microversion: 2.1 time: 0.599826 Nov 02 13:30:16.786821 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2136/3911] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:16 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:17.094556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:17.095574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:17.113929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:17.114782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:17.115484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:17.116442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:17.120275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:17.121883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:18.116319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:18.170111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-351986e2-4d44-4f48-8aba-53e0568c1cd9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1492 microversion: 2.1 time: 1.078226 Nov 02 13:30:18.173187 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2137/3912] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:17 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1492 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:18.215857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:18.219676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:18.271201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:18.286297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:18.288360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:18.299166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:18.304766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:18.310453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:18.888290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:18.934690 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfd34e8c-407b-4e5c-99e1-6e38acad3eee tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1286 microversion: 2.1 time: 0.736078 Nov 02 13:30:18.935906 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2138/3913] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:18 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1286 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:18.953496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:18.956832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:18.972651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:18.974256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:18.974961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:18.976993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:18.981322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:18.982358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:19.006513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:19.642228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:19.658594 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8000504f-3591-456e-b48b-c2c98f9b7be1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1506 microversion: 2.1 time: 0.714246 Nov 02 13:30:19.660996 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2139/3914] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:18 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1506 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:19.671280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:19.671820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:19.717598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:19.720159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:19.720988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:19.724118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:19.727417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:19.728095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:19.799575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:30:20.143302 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-235fd9bb-61b5-49cc-b897-c37a4e1361f7 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 204 len: 0 microversion: 2.1 time: 0.472197 Nov 02 13:30:20.154482 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2140/3915] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:30:19 2022] DELETE /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:30:20.202892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:20.204257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:20.231987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:20.240892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:20.245964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:20.247429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:20.251035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:20.254200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:20.793680 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.network.security_group_api [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Removing security group 0eadd40b-4b7f-4973-90c8-d7fb506dee76 from port 2764793c-ec29-4458-aec8-62c6e775e8f7 Nov 02 13:30:22.921154 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-945af82d-cc86-43dd-acdf-71419af64a41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c/action" status: 202 len: 0 microversion: 2.1 time: 2.758070 Nov 02 13:30:22.921894 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2141/3916] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:30:20 2022] POST /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c/action => generated 0 bytes in 2767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:30:22.926689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:22.927591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:22.948932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:22.952259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:22.952947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:22.953893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:22.954369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:22.954804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:23.301622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:23.332957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:23.705714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:23.770873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:23.797744 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff3ee311-b02f-43b5-97fd-e35108a43fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1328 microversion: 2.1 time: 0.874748 Nov 02 13:30:23.798406 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2142/3917] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:22 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1328 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:23.831930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:23.836549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:23.867445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:23.867941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:23.868658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:23.869492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:23.870496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:23.870939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:24.160529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:24.179303 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b510018d-16c3-40e9-a043-d1b6f864d431 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 200 len: 1290 microversion: 2.1 time: 0.371791 Nov 02 13:30:24.184738 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2143/3918] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:23 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 1290 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:24.202680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:24.209964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:24.236501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:24.238371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:24.239705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:24.259952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:24.261468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:24.269942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:24.660884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:24.680646 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9dfd487b-6d01-441b-bd39-5c17701b319f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1464 microversion: 2.1 time: 0.494646 Nov 02 13:30:24.702837 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2144/3919] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:24 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1464 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:24.723437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d6c36af1-a8cc-4c51-aadf-59199fe51df8 req-89c92294-528f-4655-bb3e-98c185f9e468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6ed66e0-3944-4d50-91e7-f1e513a1445c", "tag": "2764793c-ec29-4458-aec8-62c6e775e8f7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:24.757928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d6c36af1-a8cc-4c51-aadf-59199fe51df8 req-89c92294-528f-4655-bb3e-98c185f9e468 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:24.758419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d6c36af1-a8cc-4c51-aadf-59199fe51df8 req-89c92294-528f-4655-bb3e-98c185f9e468 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:24.759006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d6c36af1-a8cc-4c51-aadf-59199fe51df8 req-89c92294-528f-4655-bb3e-98c185f9e468 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:24.803807 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d6c36af1-a8cc-4c51-aadf-59199fe51df8 req-89c92294-528f-4655-bb3e-98c185f9e468 service nova] Creating event network-changed:2764793c-ec29-4458-aec8-62c6e775e8f7 for instance a6ed66e0-3944-4d50-91e7-f1e513a1445c on n-h2-858384-19 Nov 02 13:30:24.819337 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d6c36af1-a8cc-4c51-aadf-59199fe51df8 req-89c92294-528f-4655-bb3e-98c185f9e468 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114197 Nov 02 13:30:24.820209 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2145/3920] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:24.879396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d8bcd3dd-904f-4175-801b-55d854203a37 req-cb1ea9fe-1abc-4bab-b622-33b35abdbc05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc799996-097f-4616-9175-cfdf0034603a", "name": "network-vif-deleted", "tag": "8ac99842-4078-41b2-b11f-6d5a0c860509"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:24.923628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d8bcd3dd-904f-4175-801b-55d854203a37 req-cb1ea9fe-1abc-4bab-b622-33b35abdbc05 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:24.924167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d8bcd3dd-904f-4175-801b-55d854203a37 req-cb1ea9fe-1abc-4bab-b622-33b35abdbc05 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:24.924623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d8bcd3dd-904f-4175-801b-55d854203a37 req-cb1ea9fe-1abc-4bab-b622-33b35abdbc05 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:24.988340 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d8bcd3dd-904f-4175-801b-55d854203a37 req-cb1ea9fe-1abc-4bab-b622-33b35abdbc05 service nova] Creating event network-vif-deleted:8ac99842-4078-41b2-b11f-6d5a0c860509 for instance fc799996-097f-4616-9175-cfdf0034603a on n-h1-858384-19 Nov 02 13:30:25.006461 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d8bcd3dd-904f-4175-801b-55d854203a37 req-cb1ea9fe-1abc-4bab-b622-33b35abdbc05 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184606 Nov 02 13:30:25.008343 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2146/3921] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:25.028654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:25.029976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:25.040324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:25.041414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:25.043749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:25.046352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:25.053887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:25.054915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:25.790946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:25.809275 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b7c8b1fc-fc5b-492c-bcd3-959aa05d466c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.798209 Nov 02 13:30:25.815620 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2147/3922] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:25 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:25.852114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:25.853279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:25.865238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:25.866305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:25.866994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:25.868157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:25.869081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:25.870843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:26.201402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:26.438769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=99 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:27.252261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:27.266756 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d58f655a-9370-47c9-a55f-d578c58399b6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1328 microversion: 2.1 time: 1.449166 Nov 02 13:30:27.280345 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2148/3923] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:25 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1328 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:27.296926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:27.299072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:27.332772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.335859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.336575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.340359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.341760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.343315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.382348 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a HTTP/1.1 Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'fc799996-097f-4616-9175-cfdf0034603a'} Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:30:27.386099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.391070 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:30:27.391070 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:30:27.391070 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:30:27.391070 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:30:27.391070 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:30:27.391070 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:30:27.391070 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:30:27.394706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:30:27.402116 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed045a69-b351-4558-9657-cf2eda2fa9ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 404 len: 111 microversion: 2.1 time: 0.118352 Nov 02 13:30:27.404009 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2149/3924] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:27 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:30:27.421003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:27.422919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:27.431968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.433447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.434124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:27.435900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:27.436675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:27.437614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:28.372892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:28.398937 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-13d20563-cbed-45f8-b9b4-06999eef86fc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.984351 Nov 02 13:30:28.403093 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2150/3925] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:27 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:28.422383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ecb28688-67f3-45c8-bec4-cc508a674e5f req-d31172d0-368c-480a-a063-0efb156e3ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47463cd7-babe-480b-b99c-6a8fdbb3e278", "tag": "0371c62f-95e5-471c-9c06-cd18325aba3f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:28.474814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ecb28688-67f3-45c8-bec4-cc508a674e5f req-d31172d0-368c-480a-a063-0efb156e3ef5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:28.477366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ecb28688-67f3-45c8-bec4-cc508a674e5f req-d31172d0-368c-480a-a063-0efb156e3ef5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:28.478207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ecb28688-67f3-45c8-bec4-cc508a674e5f req-d31172d0-368c-480a-a063-0efb156e3ef5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:28.495823 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ecb28688-67f3-45c8-bec4-cc508a674e5f req-d31172d0-368c-480a-a063-0efb156e3ef5 service nova] Creating event network-changed:0371c62f-95e5-471c-9c06-cd18325aba3f for instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 on n-h1-858384-19 Nov 02 13:30:28.502577 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ecb28688-67f3-45c8-bec4-cc508a674e5f req-d31172d0-368c-480a-a063-0efb156e3ef5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089901 Nov 02 13:30:28.504025 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2151/3926] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:28.511305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-732180603", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "37c549b8-fcca-4ed8-94a6-1e15dc2811d6"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:33.017845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] validate_networks() for [('37c549b8-fcca-4ed8-94a6-1e15dc2811d6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:30:33.024380 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed413cde-ef34-466c-bd95-d50cf8ecf580 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 16.573304 Nov 02 13:30:33.041070 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1776/3927] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:16 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 16589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:33.059735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:33.060797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:33.092738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:33.095490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:33.095956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:33.096715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:33.097186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:33.097617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:33.531368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:33.549210 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a74573c7-0ba1-4180-bdcc-3984e759b380 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1328 microversion: 2.1 time: 0.510637 Nov 02 13:30:33.550514 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1777/3928] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:33 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1328 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:33.591189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:33.592754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:33.630482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:33.632922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:33.633405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:33.634183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:33.634668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:33.635764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:34.095025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:34.113548 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20129027-1d31-4e5e-b9f0-4bf5803f7f8c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.544400 Nov 02 13:30:34.114153 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1778/3929] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:33 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:34.377728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-919219314", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "5f8f21c1-476d-44ae-b48b-8d173e6474d6"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:34.556900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] validate_networks() for [('5f8f21c1-476d-44ae-b48b-8d173e6474d6', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:30:34.597585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:30:34.598840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:30:34.599823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:30:34.605540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:30:34.606279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:30:34.634660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:34.637520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:34.638316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:34.639513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:34.640730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:34.642775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:34.678117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:30:34.691480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Getting quotas for user 4228809f65b74c90b1d34cecc1b4d30e and project 5fddc748dcdb4ceeb421a758b753b756. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:30:34.730450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:30:34.734311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:30:34.877545 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e2e66f9c-6400-4250-9c63-475f0b1c060a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 6.362951 Nov 02 13:30:34.882084 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2152/3930] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:30:28 2022] POST /compute/v2.1/servers => generated 382 bytes in 6377 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:30:34.920050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b05dd242-ac1f-46a6-97c5-21a18dae7dea req-97c9b381-9e95-443b-b84c-58c7d920a908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47463cd7-babe-480b-b99c-6a8fdbb3e278", "name": "network-vif-plugged", "status": "completed", "tag": "0371c62f-95e5-471c-9c06-cd18325aba3f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:34.971416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b05dd242-ac1f-46a6-97c5-21a18dae7dea req-97c9b381-9e95-443b-b84c-58c7d920a908 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:34.974327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b05dd242-ac1f-46a6-97c5-21a18dae7dea req-97c9b381-9e95-443b-b84c-58c7d920a908 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:34.979261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b05dd242-ac1f-46a6-97c5-21a18dae7dea req-97c9b381-9e95-443b-b84c-58c7d920a908 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.027506 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b05dd242-ac1f-46a6-97c5-21a18dae7dea req-97c9b381-9e95-443b-b84c-58c7d920a908 service nova] Creating event network-vif-plugged:0371c62f-95e5-471c-9c06-cd18325aba3f for instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 on n-h1-858384-19 Nov 02 13:30:35.057389 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b05dd242-ac1f-46a6-97c5-21a18dae7dea req-97c9b381-9e95-443b-b84c-58c7d920a908 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167386 Nov 02 13:30:35.063858 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2153/3931] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:35.117960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e26db6f-c496-479a-86f3-2b7fdf2afb5d tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f94e5e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:35.268200 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e26db6f-c496-479a-86f3-2b7fdf2afb5d tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.202760 Nov 02 13:30:35.275313 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2154/3932] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:35 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:35.301284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:35.301919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:35.322231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.330618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.337205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.338689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.363988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.364693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.722104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:35.742575 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ebe31536-9d0c-43c2-ae3c-9568f13db8b9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.461977 Nov 02 13:30:35.757613 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2155/3933] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:35 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:35.863497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:35.870165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:35.902986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.903462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.903923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:35.904671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:35.911025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:35.913832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:36.284039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:36.298062 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a09e6235-e9b2-4f7d-a2aa-ea90ece570d8 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1328 microversion: 2.1 time: 0.505267 Nov 02 13:30:36.305629 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2156/3934] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:35 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1328 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:36.311141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bd0cab4f-b406-4d5e-998c-45ee06f9826c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:36.312013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bd0cab4f-b406-4d5e-998c-45ee06f9826c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:36.558340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bd0cab4f-b406-4d5e-998c-45ee06f9826c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:36.576503 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bd0cab4f-b406-4d5e-998c-45ee06f9826c tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1218 microversion: 2.1 time: 0.269124 Nov 02 13:30:36.581104 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2157/3935] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:36 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1218 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:36.591847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b575264-44e4-4adc-a8c9-3bd5400be0f0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786a2ba60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:36.698115 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b575264-44e4-4adc-a8c9-3bd5400be0f0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.115869 Nov 02 13:30:36.708901 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2158/3936] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:36 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:36.874745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1314303857", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0f49ae81-cfe3-4633-a929-56b3685d4723"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:37.120849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] validate_networks() for [('0f49ae81-cfe3-4633-a929-56b3685d4723', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:30:37.814678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:30:37.815898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:30:37.816872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:30:37.817947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:30:37.818524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:30:37.840608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:37.842874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:37.843722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:37.844821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:37.845561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:37.846163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:37.890015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Getting quotas for project c1ce242632104a26aa3b74e365e15582. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:30:37.906335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Getting quotas for user 1dca8c7d88154a5ca8e3afbe216b4ee2 and project c1ce242632104a26aa3b74e365e15582. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:30:37.969014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:30:37.976146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:30:38.140887 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d82c38f5-a98e-4adc-8688-ef6b38e7d022 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.21 time: 4.025620 Nov 02 13:30:38.146567 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1779/3937] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:30:34 2022] POST /compute/v2.1/servers => generated 382 bytes in 4032 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:30:38.168753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:38.169206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:38.223937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:38.225845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:38.227231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:38.236422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:38.241014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:38.241644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.112324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:30:39.113427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:30:39.114091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:30:39.116028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:30:39.116492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:30:39.136167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:39.161417 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3d56641b-e1ea-4071-b200-2813ed0c5d27 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1524 microversion: 2.1 time: 1.013283 Nov 02 13:30:39.168172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.174975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.180168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.181510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.188117 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1780/3938] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:38 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1524 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:39.191528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.193739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.216622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.217454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.233582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.234576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.235265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.236231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:39.236889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:39.237482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:39.365968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:30:39.397810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Getting quotas for user fa31baf6e9c94e8393baad059544adb5 and project 0e478af6eaa94c1f99ffbff44af089e3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:30:39.426410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:39.445666 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-72013755-d837-4265-adb1-5142ec70dc97 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1276 microversion: 2.1 time: 0.255543 Nov 02 13:30:39.446585 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1781/3939] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:39 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:39.456346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-412a33ba-4119-4bde-acd9-8f37591b0fec tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786906ee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.460732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:30:39.489930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:30:39.606394 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-412a33ba-4119-4bde-acd9-8f37591b0fec tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.156580 Nov 02 13:30:39.610057 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1782/3940] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:39 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:39.623448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9337d05-76ab-4e27-b114-28676e6ba83c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.624599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9337d05-76ab-4e27-b114-28676e6ba83c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:39.737076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d593eeb4-3f22-4251-b504-8fe53b265a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.024834 Nov 02 13:30:39.751924 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2159/3941] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:30:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 3036 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:30:39.764184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a01bdb07-d9b5-4e43-953e-0932d08accf1 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Action: 'create', calling method: .version_select at 0x7fe786a06700>, body: {"pool": null} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:39.869765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9337d05-76ab-4e27-b114-28676e6ba83c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:39.905924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9337d05-76ab-4e27-b114-28676e6ba83c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:39.909585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9337d05-76ab-4e27-b114-28676e6ba83c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:39.913052 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9337d05-76ab-4e27-b114-28676e6ba83c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1262 microversion: 2.21 time: 0.301657 Nov 02 13:30:39.931547 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1783/3942] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:39 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1262 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:39.937315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd218b46-ad7f-43ec-8580-f38e67f76fe3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:39.939375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fd218b46-ad7f-43ec-8580-f38e67f76fe3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:40.978069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd218b46-ad7f-43ec-8580-f38e67f76fe3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:41.016537 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd218b46-ad7f-43ec-8580-f38e67f76fe3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1219 microversion: 2.1 time: 1.088530 Nov 02 13:30:41.027886 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1784/3943] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:39 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1219 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:41.042208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:41.043014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:41.061849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:41.062396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:41.066793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:41.073763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:41.074359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:41.074864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:42.115867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:42.128143 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-48da93ca-99af-4ac8-95fa-8b1fb0e54ff3 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 1.099097 Nov 02 13:30:42.132173 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1785/3944] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:41 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:42.141309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe36b036-399b-42bb-9b01-afe01abbec8f tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7869350d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:42.244506 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe36b036-399b-42bb-9b01-afe01abbec8f tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.110345 Nov 02 13:30:42.249851 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1786/3945] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:42 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:42.255307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:42.268180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:42.285822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:42.287401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:42.291981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:42.293772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:42.295688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:42.301604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:42.652934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:42.668838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:42.670328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:42.683851 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-981d699b-ca39-46e3-beee-4955594e2592 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1332 microversion: 2.21 time: 0.432595 Nov 02 13:30:42.684478 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1787/3946] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:42 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1332 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:42.689138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:42.689754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:42.732162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:42.732677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:42.733126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:42.733855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:42.734308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:42.744830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:42.986498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:43.000595 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f605758c-1c16-40f3-bfe7-d3d92a9caa76 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1271 microversion: 2.1 time: 0.311800 Nov 02 13:30:43.003605 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1788/3947] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:42 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1271 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:43.156459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:43.157189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:43.176324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:43.179454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:43.182027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:43.183224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:43.183867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:43.184998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:43.907526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:43.922615 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7bf1c7e1-80e4-4fe5-a21b-4019ce626159 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.772102 Nov 02 13:30:43.926954 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1789/3948] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:43 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:43.934476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ebc73349-bbc8-4eea-ba9d-9218242170c8 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7869359d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:44.053288 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ebc73349-bbc8-4eea-ba9d-9218242170c8 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.124849 Nov 02 13:30:44.053973 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1790/3949] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:43 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:44.069598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:44.071091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:44.104316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:44.106735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:44.111293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:44.114479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:44.120267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:44.121214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:45.229940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:45.258262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:45.279984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:45.281546 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-26f27ef8-29dc-480c-b054-f9caa6d87c6a tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 1.221783 Nov 02 13:30:45.308999 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1791/3950] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:44 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:45.318224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:45.323379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:45.334081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:45.339717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:45.340941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:45.343943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:45.344599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:45.345222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:45.486987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:45.498287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d19b108-b4b7-43d3-ac25-cf05bc4a4167 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1277 microversion: 2.1 time: 0.187214 Nov 02 13:30:45.509271 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1792/3951] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:45 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:45.538732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:45.543940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:45.566484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:45.567005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:45.568578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:45.569335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:45.578898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:45.579492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:46.154338 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a01bdb07-d9b5-4e43-953e-0932d08accf1 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.403242 Nov 02 13:30:46.155799 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2160/3952] 10.222.0.113 () {60 vars in 1175 bytes} [Wed Nov 2 13:30:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:46.161110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a0bcc6ed-9f21-49a3-81f9-1ec14f865620 req-be7e94f0-ebc7-4542-8d49-38b84d2e69ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d3764e-855d-43f3-b1d7-b834fabcb80e", "tag": "10b3a375-2a8f-4c2d-9d8d-636dd981ef5d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:46.173263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:46.192279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a0bcc6ed-9f21-49a3-81f9-1ec14f865620 req-be7e94f0-ebc7-4542-8d49-38b84d2e69ed service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:46.192897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a0bcc6ed-9f21-49a3-81f9-1ec14f865620 req-be7e94f0-ebc7-4542-8d49-38b84d2e69ed service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:46.193369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a0bcc6ed-9f21-49a3-81f9-1ec14f865620 req-be7e94f0-ebc7-4542-8d49-38b84d2e69ed service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:46.231559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:46.244219 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d3e099e-4afb-4679-b3c3-75b76f0337ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.732335 Nov 02 13:30:46.250413 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1793/3953] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:45 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:46.263792 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a0bcc6ed-9f21-49a3-81f9-1ec14f865620 req-be7e94f0-ebc7-4542-8d49-38b84d2e69ed service nova] Creating event network-changed:10b3a375-2a8f-4c2d-9d8d-636dd981ef5d for instance 32d3764e-855d-43f3-b1d7-b834fabcb80e on n-h1-858384-19 Nov 02 13:30:46.272520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51da187d-45c0-495a-ba1f-789f59d14829 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78703e670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:46.288982 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a0bcc6ed-9f21-49a3-81f9-1ec14f865620 req-be7e94f0-ebc7-4542-8d49-38b84d2e69ed service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131502 Nov 02 13:30:46.299628 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2161/3954] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:46.324291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:46.325754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:46.351873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:46.352394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:46.352851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:46.354595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:46.355098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:46.357693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:46.391093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51da187d-45c0-495a-ba1f-789f59d14829 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1456 microversion: 2.1 time: 0.125392 Nov 02 13:30:46.399078 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1794/3955] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:46 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1456 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:46.437030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1696487685", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "16a488c5-bc10-4fc2-8635-3fe544404977"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:46.502112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] validate_networks() for [('16a488c5-bc10-4fc2-8635-3fe544404977', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:30:47.092422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:47.131064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:47.136035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:47.138621 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc7e2023-5784-4ca7-8b8d-6e41fd7b1aad tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.828222 Nov 02 13:30:47.141412 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2162/3956] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:46 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:30:47.156186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:30:47.157747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:30:47.159135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:30:47.159889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:30:47.160714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:30:47.165339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:47.168030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:47.186593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:47.187093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:47.187959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:47.190063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:47.191067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:47.191355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:47.192076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:47.192730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:47.194278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:47.194936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:47.197718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:47.200122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:47.311292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Getting quotas for project b8254a8a3abe4829941573211dc1aa74. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:30:47.321619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Getting quotas for user 318964014c11438c9316b35382a49ed9 and project b8254a8a3abe4829941573211dc1aa74. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:30:47.345810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:30:47.348123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:30:47.421061 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d731554b-8b2b-4b15-acde-af3bead8c7a9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.988177 Nov 02 13:30:47.424978 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1795/3957] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:30:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:30:47.441266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:47.443983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:47.476500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:47.477115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:47.489527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:47.490693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:47.491227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:47.492184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:47.778542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:47.782067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:47.802193 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dcf7c7f9-8baa-42e7-b3c7-6770b1c8837f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.659258 Nov 02 13:30:47.805066 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2163/3958] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:47 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:47.829490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff632ae1-d8fc-4ef2-b9e0-621ffca962c3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7876054c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:47.918385 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff632ae1-d8fc-4ef2-b9e0-621ffca962c3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1465 microversion: 2.1 time: 0.111928 Nov 02 13:30:47.923426 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2164/3959] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:47 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1465 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:47.937022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13427afa-3424-4304-be0d-16c356b667d6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:47.938002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-13427afa-3424-4304-be0d-16c356b667d6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:48.204588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:48.226578 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ebe18be1-4347-41af-a15d-ced45590a80e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.799160 Nov 02 13:30:48.244329 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1796/3960] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:47 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:48.253001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-13427afa-3424-4304-be0d-16c356b667d6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:48.264204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6c8542f4-7500-482f-8637-2acb6f000699 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868d3430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:48.267145 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-13427afa-3424-4304-be0d-16c356b667d6 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1228 microversion: 2.1 time: 0.341661 Nov 02 13:30:48.280965 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2165/3961] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:47 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1228 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:48.297544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:48.298309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:48.304719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.305218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.305654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.307140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.307850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.308024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.332566 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6c8542f4-7500-482f-8637-2acb6f000699 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 200 len: 1465 microversion: 2.1 time: 0.086499 Nov 02 13:30:48.343578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1797/3962] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:48 2022] GET /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 1465 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:48.349132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:48.350118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:48.358860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.359679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.360183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.361204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.361659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.362135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.586753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:48.596967 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9b2604d-7b9d-4f41-b9e0-e0940bda1d4e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1471 microversion: 2.1 time: 0.252651 Nov 02 13:30:48.597713 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1798/3963] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:48 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1471 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:48.624222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8d2f1ae3-309a-4ecb-8766-f93423d0129a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1634721691"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:48.627010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8d2f1ae3-309a-4ecb-8766-f93423d0129a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:48.633384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d2f1ae3-309a-4ecb-8766-f93423d0129a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.633965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d2f1ae3-309a-4ecb-8766-f93423d0129a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.635046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d2f1ae3-309a-4ecb-8766-f93423d0129a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.636059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d2f1ae3-309a-4ecb-8766-f93423d0129a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.636562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d2f1ae3-309a-4ecb-8766-f93423d0129a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.636982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d2f1ae3-309a-4ecb-8766-f93423d0129a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.789459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:48.809259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:48.817385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:48.820007 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44c1f68c-6ee1-48f3-8438-0ef77eca5b12 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.537866 Nov 02 13:30:48.828157 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2166/3964] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:48 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:48.836368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:48.851656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:48.861883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.862817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.863515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.864732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.865426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.866296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.943736 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8d2f1ae3-309a-4ecb-8766-f93423d0129a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "POST /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73/action" status: 202 len: 0 microversion: 2.1 time: 0.323847 Nov 02 13:30:48.944611 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1799/3965] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:30:48 2022] POST /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:30:48.959462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a67e5baa-187f-49e2-842f-2c18fe91442f req-1b2b8796-7271-4d18-a0b4-35c652972cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0108c040-a1b8-4a2a-9188-9ca98794e998", "tag": "76518416-f6fe-4130-a69b-71d907a6cff9"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:48.975261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a67e5baa-187f-49e2-842f-2c18fe91442f req-1b2b8796-7271-4d18-a0b4-35c652972cb2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:48.976354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a67e5baa-187f-49e2-842f-2c18fe91442f req-1b2b8796-7271-4d18-a0b4-35c652972cb2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:48.977093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a67e5baa-187f-49e2-842f-2c18fe91442f req-1b2b8796-7271-4d18-a0b4-35c652972cb2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:48.999906 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a67e5baa-187f-49e2-842f-2c18fe91442f req-1b2b8796-7271-4d18-a0b4-35c652972cb2 service nova] Creating event network-changed:76518416-f6fe-4130-a69b-71d907a6cff9 for instance 0108c040-a1b8-4a2a-9188-9ca98794e998 on n-h2-858384-19 Nov 02 13:30:49.008797 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a67e5baa-187f-49e2-842f-2c18fe91442f req-1b2b8796-7271-4d18-a0b4-35c652972cb2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062622 Nov 02 13:30:49.012316 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1800/3966] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:49.021267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5d21e4f3-a621-4563-bb5a-d4586af2db49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868ea940>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:49.094019 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5d21e4f3-a621-4563-bb5a-d4586af2db49 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.080102 Nov 02 13:30:49.102312 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1801/3967] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:49 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:49.246246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:49.258039 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2f3bb35-777f-4d11-8635-cdd802e348b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.427659 Nov 02 13:30:49.261970 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2167/3968] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:48 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:49.283490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:49.284707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:49.299062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:49.299831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:49.300090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:49.300832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:49.301025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:49.301932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:49.302783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:49.303356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:49.303577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:49.309831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:49.328026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:49.328905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:49.330038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:49.331019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:49.331867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:49.332463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:49.481572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:49.496201 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a6287e8-f821-4370-8563-47d3dcfed120 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1232 microversion: 2.1 time: 0.201342 Nov 02 13:30:49.497159 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2168/3969] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:49 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1232 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:49.810492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:49.825708 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d7a4900-38bc-4397-8100-51aa395fc7e5 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.540787 Nov 02 13:30:49.826476 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1802/3970] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:49 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:49.862642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:49.863705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:49.877209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:49.878407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:49.879500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:49.881619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:49.882692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:49.883751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:50.111077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c2240f94-8d23-46b3-8496-f34174767620 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868fa8b0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:50.211075 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c2240f94-8d23-46b3-8496-f34174767620 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.103879 Nov 02 13:30:50.220155 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1803/3971] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:50 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:50.289407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:50.290126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:50.299206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:50.300000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:50.301548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:50.302763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:50.303575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:50.304429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:50.352032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:50.375568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:50.378385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:50.381104 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-49e8f6ba-9ed7-43c1-be00-8dbf33b6d911 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.525720 Nov 02 13:30:50.382095 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2169/3972] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:49 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:50.548382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:50.549131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:50.566563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:50.568504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:50.569079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:50.570127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:50.571572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:50.573072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:50.773212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:50.793518 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f2da6fa8-a060-4826-9c02-da3b5574c8a2 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1288 microversion: 2.1 time: 0.245458 Nov 02 13:30:50.796685 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2170/3973] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:50 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1288 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:51.140640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:51.142986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:51.150729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.152972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.154031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.155028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.155692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.156335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.195712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:51.216304 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d313f95e-f344-4744-bcc9-d0ae0f2ab41e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.933613 Nov 02 13:30:51.216909 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1804/3974] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:50 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:51.221985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f490e0d7-2058-48e6-babd-bad2c1ec822c req-3fc37a6f-f1dd-40eb-90da-bff11bba09e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e57c4d-4569-49a6-a42a-493bb7904624", "tag": "1b493f0a-2ada-4730-97e9-2afd52152e70"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:51.236712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f490e0d7-2058-48e6-babd-bad2c1ec822c req-3fc37a6f-f1dd-40eb-90da-bff11bba09e9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.237202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f490e0d7-2058-48e6-babd-bad2c1ec822c req-3fc37a6f-f1dd-40eb-90da-bff11bba09e9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.237645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f490e0d7-2058-48e6-babd-bad2c1ec822c req-3fc37a6f-f1dd-40eb-90da-bff11bba09e9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.270270 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f490e0d7-2058-48e6-babd-bad2c1ec822c req-3fc37a6f-f1dd-40eb-90da-bff11bba09e9 service nova] Creating event network-changed:1b493f0a-2ada-4730-97e9-2afd52152e70 for instance 36e57c4d-4569-49a6-a42a-493bb7904624 on n-h2-858384-19 Nov 02 13:30:51.277127 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f490e0d7-2058-48e6-babd-bad2c1ec822c req-3fc37a6f-f1dd-40eb-90da-bff11bba09e9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058771 Nov 02 13:30:51.278109 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1805/3975] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:51.285335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6e59b748-38a6-41e3-b12a-d0d5e8563b38 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786d34c10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:51.342201 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6e59b748-38a6-41e3-b12a-d0d5e8563b38 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.062534 Nov 02 13:30:51.343006 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1806/3976] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:51 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:51.417713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:51.418524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:51.430006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.430829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.432675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.433904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.434558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.435315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.675247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:51.685727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:51.687271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:51.690497 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-47447873-a823-4933-95db-9cd6d4613300 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.276177 Nov 02 13:30:51.690497 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1807/3977] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:51 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:51.714679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6e85b5ce-985f-44b2-9d96-6961a486af6e req-7ee16110-8c38-408f-99d4-702b391dc04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c41302-b126-4b93-957b-bb4f86c2e292", "name": "network-vif-unplugged", "status": "completed", "tag": "4f740d47-b052-4b9e-a6aa-c5fc11434e11"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:51.725974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6e85b5ce-985f-44b2-9d96-6961a486af6e req-7ee16110-8c38-408f-99d4-702b391dc04d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.726450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6e85b5ce-985f-44b2-9d96-6961a486af6e req-7ee16110-8c38-408f-99d4-702b391dc04d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.727156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6e85b5ce-985f-44b2-9d96-6961a486af6e req-7ee16110-8c38-408f-99d4-702b391dc04d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.749356 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6e85b5ce-985f-44b2-9d96-6961a486af6e req-7ee16110-8c38-408f-99d4-702b391dc04d service nova] Creating event network-vif-unplugged:4f740d47-b052-4b9e-a6aa-c5fc11434e11 for instance 31c41302-b126-4b93-957b-bb4f86c2e292 on n-h2-858384-19 Nov 02 13:30:51.756537 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6e85b5ce-985f-44b2-9d96-6961a486af6e req-7ee16110-8c38-408f-99d4-702b391dc04d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065663 Nov 02 13:30:51.757337 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1808/3978] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:51.822969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:51.823822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:51.827241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:51.834970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.835492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.835926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.836629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:51.836886 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-298ed095-cf1d-4346-aade-9a7976013026 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.977070 Nov 02 13:30:51.837073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:51.839425 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2171/3979] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:50 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:51.841819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:51.950259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:51.961604 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-81d0f5c7-df00-4e80-8751-3561719a6fad tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1286 microversion: 2.1 time: 0.144566 Nov 02 13:30:51.972022 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1809/3980] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:51 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:52.243885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:52.244810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:52.262209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:52.263770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:52.267337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:52.285965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:52.288030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:52.292374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:52.360575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-12a06645-c57c-4dd8-8362-1f0604482f84 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868d3e50>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:52.461865 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-12a06645-c57c-4dd8-8362-1f0604482f84 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.106610 Nov 02 13:30:52.463146 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1810/3981] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:52 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:52.669116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:52.678183 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e0e20fde-dc53-4988-b89c-353a28ca948a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.439856 Nov 02 13:30:52.682538 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2172/3982] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:52 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:52.715101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:52.716126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:52.726819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:52.729023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:52.730817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:52.732214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:52.732974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:52.733666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:52.862576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:52.864165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:52.881461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:52.884064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:52.884697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:52.889560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:52.891937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:52.892552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:53.245125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:53.254486 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d8cce6e-e33c-4487-9862-5a4248f52068 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.396413 Nov 02 13:30:53.272404 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2173/3983] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:52 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:53.279772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:53.282047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:53.294849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:53.296424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:53.297125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:53.298053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:53.299372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:53.300140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:53.409663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:53.427137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:53.428633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:53.437818 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8bea13d1-8ebe-42f2-86eb-103dfa7e5d6e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.727519 Nov 02 13:30:53.451144 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1811/3984] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:52 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:53.478540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6f18789-0a45-41d0-8f6b-c0bedaa022a6 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7869225e0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:53.552717 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6f18789-0a45-41d0-8f6b-c0bedaa022a6 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.078616 Nov 02 13:30:53.553373 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1812/3985] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:53 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:53.707288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:53.708639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:53.720911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:53.726087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:53.727232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:53.729117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:53.733697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:53.734355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:53.742452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:53.753508 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83f51cc2-444d-488e-b688-e18f0ba1282e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.478788 Nov 02 13:30:53.776523 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2174/3986] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:53 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:54.106735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:54.117915 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba568fac-9e5f-49aa-a280-226e16bc54cf tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.412248 Nov 02 13:30:54.119848 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1813/3987] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:53 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:54.281733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:54.283455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:54.295071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:54.295327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:54.298479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:54.299395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:54.302228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:54.302715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:54.349949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b908f29b-ad26-4d29-94fc-15eb46498e02 req-c1c677ae-3d49-4f55-958f-962846dc06cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f596fd2-1baa-4da3-a6fb-cd1a070fe257", "tag": "3549cdb8-a8f2-40ce-99d6-0f91c1b1f979"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:54.372938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b908f29b-ad26-4d29-94fc-15eb46498e02 req-c1c677ae-3d49-4f55-958f-962846dc06cd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:54.374891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b908f29b-ad26-4d29-94fc-15eb46498e02 req-c1c677ae-3d49-4f55-958f-962846dc06cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:54.375368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b908f29b-ad26-4d29-94fc-15eb46498e02 req-c1c677ae-3d49-4f55-958f-962846dc06cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:54.396071 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b908f29b-ad26-4d29-94fc-15eb46498e02 req-c1c677ae-3d49-4f55-958f-962846dc06cd service nova] Creating event network-changed:3549cdb8-a8f2-40ce-99d6-0f91c1b1f979 for instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 on n-h1-858384-19 Nov 02 13:30:54.401872 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b908f29b-ad26-4d29-94fc-15eb46498e02 req-c1c677ae-3d49-4f55-958f-962846dc06cd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056423 Nov 02 13:30:54.403210 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1814/3988] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:54.469746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:54.471612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:54.489600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:54.493345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:54.494649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:54.497482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:54.498190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:54.502189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:54.771598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:54.785183 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b911165b-71ef-4b83-843f-dc2df7fc64ff tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.507875 Nov 02 13:30:54.792148 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2175/3989] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:54 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:54.808217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c705e89b-13c4-4539-a0d6-537c849d9b59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7879e7a60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:54.876340 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c705e89b-13c4-4539-a0d6-537c849d9b59 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.082675 Nov 02 13:30:54.877409 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2176/3990] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:54 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:54.882875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:54.883755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:54.891096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:54.891951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:54.892849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:54.894108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:54.894679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:54.895399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:55.045364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:55.056857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:55.059481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:55.060591 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-715b7fd9-1f54-433e-9a3e-a08066e27bb2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.599233 Nov 02 13:30:55.061445 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1815/3991] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:54 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:55.066297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ab94f11b-b264-4a5c-afc6-aafcb871ddaa req-ef2e3ca7-4ce4-4f90-ac07-c786d5b69931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d3764e-855d-43f3-b1d7-b834fabcb80e", "name": "network-vif-plugged", "status": "completed", "tag": "10b3a375-2a8f-4c2d-9d8d-636dd981ef5d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:30:55.076901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ab94f11b-b264-4a5c-afc6-aafcb871ddaa req-ef2e3ca7-4ce4-4f90-ac07-c786d5b69931 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:55.077387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ab94f11b-b264-4a5c-afc6-aafcb871ddaa req-ef2e3ca7-4ce4-4f90-ac07-c786d5b69931 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:55.077840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ab94f11b-b264-4a5c-afc6-aafcb871ddaa req-ef2e3ca7-4ce4-4f90-ac07-c786d5b69931 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:55.090199 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ab94f11b-b264-4a5c-afc6-aafcb871ddaa req-ef2e3ca7-4ce4-4f90-ac07-c786d5b69931 service nova] Creating event network-vif-plugged:10b3a375-2a8f-4c2d-9d8d-636dd981ef5d for instance 32d3764e-855d-43f3-b1d7-b834fabcb80e on n-h1-858384-19 Nov 02 13:30:55.095642 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ab94f11b-b264-4a5c-afc6-aafcb871ddaa req-ef2e3ca7-4ce4-4f90-ac07-c786d5b69931 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032739 Nov 02 13:30:55.096544 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1816/3992] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:30:55.151964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:55.152675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:55.159639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:55.160125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:55.160564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:55.161270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:55.161723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:55.162356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:55.367299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:55.377760 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-545b62eb-76fb-4380-8d7f-b4216167990d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.498974 Nov 02 13:30:55.379041 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2177/3993] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:54 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:55.441212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:55.451373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-07137e81-7600-490b-9eff-baaaeaebd952 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.305298 Nov 02 13:30:55.451971 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1817/3994] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:55 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:55.812429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:55.813068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:55.826695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:55.826975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:55.827639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:55.828685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:55.829344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:55.829781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:55.906638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-518f761d-424e-4e4a-ae31-72d1fd13aeca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786914040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:55.999079 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-518f761d-424e-4e4a-ae31-72d1fd13aeca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.109075 Nov 02 13:30:56.000255 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1818/3995] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:55 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:56.052650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:56.063237 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2bb21225-08e2-417d-98be-91ab7352050b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.254601 Nov 02 13:30:56.079430 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2178/3996] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:55 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:56.091683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:56.092302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:56.099603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:56.100217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:56.100913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:56.101842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:56.102542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:56.104184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:56.389234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:56.398408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:56.400504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:56.401834 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cc316b5d-ebca-4ac5-a7dd-afe11957ac2d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.315929 Nov 02 13:30:56.402939 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1819/3997] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:56 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:56.411532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:56.412799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:56.421105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:56.421592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:56.422244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:56.423087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:56.423757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:56.424276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:56.478672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:56.479323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:56.485267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:56.487458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:56.488188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:56.488623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:56.489363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:56.489802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:56.490412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:56.669749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:56.682011 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-55a2c3d8-7f01-4cc0-8cb6-abe6f1abc7ae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.283185 Nov 02 13:30:56.683242 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2179/3998] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:56 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:56.728761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:56.740994 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b405013-a3b2-4d0a-8c56-e56c74c39442 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.265232 Nov 02 13:30:56.741575 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1820/3999] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:56 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:30:57.016011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6f823092-1780-4ed0-a44b-90ef5dc864e3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786ebef70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:57.077041 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6f823092-1780-4ed0-a44b-90ef5dc864e3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.064010 Nov 02 13:30:57.079500 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2180/4000] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:57 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:57.097155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:57.098521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:57.111418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.112035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.112784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.114558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.115266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.116022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.290307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:57.336243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=16 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:57.389638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:57.404877 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0ed61c84-2fcb-4bf7-a6bf-53aa84b109e6 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.311526 Nov 02 13:30:57.406218 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1821/4001] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:57 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:57.433100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:57.434517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:57.442434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.443273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.444121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.445161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.446063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.447359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.705143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:57.706047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:57.713524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.714268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.714913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.715871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.716543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.717210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.815083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:57.835292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:57.841333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:57.843070 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90db6a26-b582-4099-8c5f-1f3371cd7e0c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.417969 Nov 02 13:30:57.856589 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2181/4002] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:57 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:57.868793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:57.870214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:57.897222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.898185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.899726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.903672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:57.904621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:57.905676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:57.966108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:57.978525 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5c178e18-c48e-49fa-8ee7-c80928f9de3e tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.277016 Nov 02 13:30:57.979474 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1822/4003] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:57 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:58.097690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-21b4e64f-e8a6-4ee8-87e6-c2456ef8a8c9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868c6550>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:58.203716 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-21b4e64f-e8a6-4ee8-87e6-c2456ef8a8c9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.109527 Nov 02 13:30:58.215358 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1823/4004] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:58 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:58.262312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=16 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:30:58.317684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:58.328981 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cca4ad4a-ae58-40be-9c87-ba3a310b7202 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.471061 Nov 02 13:30:58.331754 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2182/4005] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:57 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:58.431952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:58.432969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:58.440992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:58.441929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:58.442572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:58.443588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:58.444428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:58.445053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:58.750687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:58.764857 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f51f6a0d-ab1d-4dc7-b536-b8abffbde9fd tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1318 microversion: 2.1 time: 0.338791 Nov 02 13:30:58.766038 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1824/4006] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:58 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:58.880808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:58.882056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:58.893942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:58.894953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:58.895425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:58.896142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:58.900460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:58.901526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.005665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:59.006436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:59.025791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.026695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.027777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.028832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.029694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.030623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.317357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:59.343347 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5bfe4ecf-d0b5-4cc2-9f06-da2b1c8fcedf tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.342201 Nov 02 13:30:59.373251 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1825/4007] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:58 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:59.393078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-474b1723-363e-4b5f-9487-05880df1c3e3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868d3d30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:59.467055 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-474b1723-363e-4b5f-9487-05880df1c3e3 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.092139 Nov 02 13:30:59.468774 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1826/4008] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:30:59 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:59.474787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:59.475830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:59.486559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.487570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.488172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.492356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.494907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.495592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.876067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:59.885535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:59.889976 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3612f277-a739-4a2f-93f3-2ce6548b54c2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.419879 Nov 02 13:30:59.894986 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1827/4009] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:59 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:30:59.901742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:59.903307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:30:59.904233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:30:59.905986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:30:59.913440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.914635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.916222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.918165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:30:59.918823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:30:59.919494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:30:59.925551 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05695d96-ae0a-437c-a96f-38315e4069d8 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 1.030607 Nov 02 13:30:59.944709 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2183/4010] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:30:58 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:30:59.955584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:00.142909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-dfed6c71-ab29-49e7-b445-251082abc6d1 req-30134fad-f13a-4fe0-9982-1a793fbb11c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0108c040-a1b8-4a2a-9188-9ca98794e998", "name": "network-vif-plugged", "status": "completed", "tag": "76518416-f6fe-4130-a69b-71d907a6cff9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:00.168963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dfed6c71-ab29-49e7-b445-251082abc6d1 req-30134fad-f13a-4fe0-9982-1a793fbb11c8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.169457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dfed6c71-ab29-49e7-b445-251082abc6d1 req-30134fad-f13a-4fe0-9982-1a793fbb11c8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.175952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dfed6c71-ab29-49e7-b445-251082abc6d1 req-30134fad-f13a-4fe0-9982-1a793fbb11c8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:00.228721 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-dfed6c71-ab29-49e7-b445-251082abc6d1 req-30134fad-f13a-4fe0-9982-1a793fbb11c8 service nova] Creating event network-vif-plugged:76518416-f6fe-4130-a69b-71d907a6cff9 for instance 0108c040-a1b8-4a2a-9188-9ca98794e998 on n-h2-858384-19 Nov 02 13:31:00.240490 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-dfed6c71-ab29-49e7-b445-251082abc6d1 req-30134fad-f13a-4fe0-9982-1a793fbb11c8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102072 Nov 02 13:31:00.241423 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2184/4011] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:31:00.379993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:00.380720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:00.393886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.400294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.401233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:00.402028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.408659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.412335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:00.488335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:00.489046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:00.501407 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bdb7bdeb-2d79-408c-84a7-6571e95c400b tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1504 microversion: 2.1 time: 0.603651 Nov 02 13:31:00.508723 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1828/4012] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:30:59 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1504 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:00.548361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d97c76e1-99fd-4d6e-92bb-c95b62458476 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868fa820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:00.642813 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d97c76e1-99fd-4d6e-92bb-c95b62458476 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.129707 Nov 02 13:31:00.645515 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1829/4013] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:00 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:00.664310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:00.667024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:00.684025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.684819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.688230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:00.689297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:00.692052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:00.693235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:00.777723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lazy-loading 'flavor' on Instance uuid 32d3764e-855d-43f3-b1d7-b834fabcb80e {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:31:00.973098 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7c691357-ae3d-46e0-ac6b-cf2e570c0812 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "POST /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e/action" status: 202 len: 0 microversion: 2.1 time: 0.323961 Nov 02 13:31:00.979105 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1830/4014] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:31:00 2022] POST /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:31:01.004607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:01.006660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:01.008357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:01.026582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:01.028735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:01.029798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:01.031932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:01.034023 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2216445a-71f1-48bd-b985-67a7b658a52a tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.660127 Nov 02 13:31:01.034642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:01.035389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:01.039076 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2185/4015] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:00 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:01.046096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:01.047000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:01.058725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:01.059478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:01.061359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:01.062617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:01.063332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:01.063945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:01.469052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:01.482311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:01.489534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:01.490982 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7213b0d3-4a1e-4875-8f65-f151d13b571e tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.448867 Nov 02 13:31:01.495826 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2186/4016] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:01 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:01.503025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:01.507609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:01.521128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:01.522634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:01.523964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:01.525407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:01.534475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:01.535193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:01.561391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:01.582912 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-35d40d81-f322-4326-928d-bf38bbc0180b tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.595803 Nov 02 13:31:01.585014 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1831/4017] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:00 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:01.660978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75775a81-07de-4bbf-9988-eb0e06ad64cb tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786d34d30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:01.751921 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75775a81-07de-4bbf-9988-eb0e06ad64cb tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.089385 Nov 02 13:31:01.755708 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1832/4018] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:01 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:31:01.974365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:01.986384 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-18807c6c-4bf0-43bf-974b-bf1ee5cfa534 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1512 microversion: 2.1 time: 0.489173 Nov 02 13:31:01.987363 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2187/4019] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:01 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1512 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:02.063063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:02.063849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:02.073264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.073778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.074123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.075050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.075606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.076102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.341562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-cf5b8b19-f3e0-497e-9f44-d185431937d9 req-3b30eb80-bc72-4501-9912-dceee6e3297f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f903fade-568a-4ab8-921c-4d0af0956d73", "name": "network-vif-plugged", "status": "completed", "tag": "2c8ab030-6991-42fe-ad13-68219a6b114c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:02.372252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cf5b8b19-f3e0-497e-9f44-d185431937d9 req-3b30eb80-bc72-4501-9912-dceee6e3297f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.373251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cf5b8b19-f3e0-497e-9f44-d185431937d9 req-3b30eb80-bc72-4501-9912-dceee6e3297f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.375139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cf5b8b19-f3e0-497e-9f44-d185431937d9 req-3b30eb80-bc72-4501-9912-dceee6e3297f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.406222 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-cf5b8b19-f3e0-497e-9f44-d185431937d9 req-3b30eb80-bc72-4501-9912-dceee6e3297f service nova] Creating event network-vif-plugged:2c8ab030-6991-42fe-ad13-68219a6b114c for instance f903fade-568a-4ab8-921c-4d0af0956d73 on n-h2-858384-19 Nov 02 13:31:02.423248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-cf5b8b19-f3e0-497e-9f44-d185431937d9 req-3b30eb80-bc72-4501-9912-dceee6e3297f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094864 Nov 02 13:31:02.424255 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2188/4020] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:31:02.522793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:02.524215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:02.539420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.540324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.541260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.542199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.542834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.543565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.626955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:02.637245 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e5aae9a9-9c2b-4ef4-9043-be569eccef53 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.578058 Nov 02 13:31:02.638478 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1833/4021] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:02 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:02.643659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:02.644511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:02.652395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.653192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.654357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.654937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:02.655821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:02.656490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:02.916367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:02.933539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:02.939738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:02.943050 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf477605-9102-43da-a9a0-33eb19b4bea5 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1362 microversion: 2.21 time: 0.425719 Nov 02 13:31:02.945872 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2189/4022] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:02 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:02.956856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5880f3d4-60a2-4d67-8b99-b11ba110da5e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786a98280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:03.065335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:03.093205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e35a1246-0fd4-4dfa-ad5d-57b4f56fc0f9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.452176 Nov 02 13:31:03.093432 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5880f3d4-60a2-4d67-8b99-b11ba110da5e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.144776 Nov 02 13:31:03.095222 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2190/4023] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:02 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:03.107596 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1834/4024] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:02 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:03.111484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:03.121207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:03.129186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.129721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.130175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.133402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.136591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.137429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.459400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57f20ede-111d-4705-817f-80f3bd36972a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Action: 'create', calling method: .version_select at 0x7fe78684b280>, body: {"keypair": {"name": "tempest-keypair-461846968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzK4kvgzZzdmGifFMwzour8Hqz2wMJck/uO6c0IhgFltAEhqw+/thxxwHJLjFvcmGzACdct2XrBbc/Zrov/DS36wIS+nwwh9qVWF4pE0npetT9c96khS664fR13JOp5ug=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:03.494267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-57f20ede-111d-4705-817f-80f3bd36972a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Getting quotas for project 71c9ac6a19e84cfb8ba6d86da5292fbe. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:31:03.504264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:03.509136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-57f20ede-111d-4705-817f-80f3bd36972a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Getting quotas for user 533414d2d1ae4de09cce393f8f6c8b8e and project 71c9ac6a19e84cfb8ba6d86da5292fbe. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:31:03.521485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29bbfb7d-15ab-4778-8588-1467fa422aba tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1495 microversion: 2.1 time: 0.420213 Nov 02 13:31:03.553878 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2191/4025] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:03 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1495 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:03.574557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:03.575073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:03.582099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.584667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.585340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.586709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.588748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.589518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.598956 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57f20ede-111d-4705-817f-80f3bd36972a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.143539 Nov 02 13:31:03.599967 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1835/4026] 10.222.0.113 () {62 vars in 1205 bytes} [Wed Nov 2 13:31:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 02 13:31:03.629475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:31:03.668786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:03.669413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:03.686976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.687616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.698060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.699080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.699763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.702513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.800565 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6a0f3b2a-c455-4628-8f25-7b69ff9e6089 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 204 len: 0 microversion: 2.1 time: 0.232672 Nov 02 13:31:03.801587 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2192/4027] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:31:03 2022] DELETE /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:31:03.814894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:03.816398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:03.830222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.832719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.833826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.835341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:03.838052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:03.838915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:03.958498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:03.968938 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7993d42-ff67-4168-86fe-1708f34ba5b0 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.307786 Nov 02 13:31:03.990902 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1836/4028] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:03 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:31:03.990902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:03.990902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:04.003038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.003675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.004116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.005021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.005631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.005908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.107712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:04.116755 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c4471f63-60ce-4388-9e99-5c0036f92966 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1501 microversion: 2.1 time: 0.307294 Nov 02 13:31:04.135141 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2193/4029] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:03 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1501 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:04.140650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87006af3-bd17-4121-9887-f0a99e9fbde0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786a06670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:04.225772 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87006af3-bd17-4121-9887-f0a99e9fbde0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.101951 Nov 02 13:31:04.229089 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2194/4030] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:04 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:04.236303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:04.236927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:04.255091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.255635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.256082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.256816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.257283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.257719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.337985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:04.351467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:04.358455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:04.360963 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-78dda8df-05da-4677-aeb1-b8148290d52c tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1554 microversion: 2.21 time: 0.384850 Nov 02 13:31:04.365991 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1837/4031] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:03 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1554 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:04.397540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:04.398481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:04.413048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.415724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.418625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.420716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.423378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.427676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.504840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:31:04.627328 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c9ce5d1d-5496-4882-a4f0-abdd36fcf39d tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 204 len: 0 microversion: 2.21 time: 0.236759 Nov 02 13:31:04.628550 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1838/4032] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:31:04 2022] DELETE /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 13:31:04.635095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5f6eaa81-e06e-471c-8636-b477b9875874 req-2bcb9629-93d3-4585-a777-a24fd7fcc321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f596fd2-1baa-4da3-a6fb-cd1a070fe257", "name": "network-vif-plugged", "status": "completed", "tag": "3549cdb8-a8f2-40ce-99d6-0f91c1b1f979"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:04.640626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:04.646398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5f6eaa81-e06e-471c-8636-b477b9875874 req-2bcb9629-93d3-4585-a777-a24fd7fcc321 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.647137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5f6eaa81-e06e-471c-8636-b477b9875874 req-2bcb9629-93d3-4585-a777-a24fd7fcc321 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.647769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5f6eaa81-e06e-471c-8636-b477b9875874 req-2bcb9629-93d3-4585-a777-a24fd7fcc321 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.656253 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cf991014-bbb3-4e0d-932e-1e00658783f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.424734 Nov 02 13:31:04.671151 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2195/4033] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:04 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:04.671151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:04.671151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:04.675649 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5f6eaa81-e06e-471c-8636-b477b9875874 req-2bcb9629-93d3-4585-a777-a24fd7fcc321 service nova] Creating event network-vif-plugged:3549cdb8-a8f2-40ce-99d6-0f91c1b1f979 for instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 on n-h1-858384-19 Nov 02 13:31:04.685914 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5f6eaa81-e06e-471c-8636-b477b9875874 req-2bcb9629-93d3-4585-a777-a24fd7fcc321 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055406 Nov 02 13:31:04.687818 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1839/4034] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:04.691874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.693868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.694636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:04.696733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:04.697650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:04.698329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.000553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:05.001305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:05.021192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.021698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.022130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.028223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.035854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.037019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.084899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:05.098650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:05.107830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:05.111634 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6f302831-002c-4ee6-b68e-8b1bce45a9f9 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1560 microversion: 2.21 time: 0.451475 Nov 02 13:31:05.113967 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2196/4035] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:04 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1560 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:05.145842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:05.148025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:05.160403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.161295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.161974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.162956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.163686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.164415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.496579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:05.505870 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-571ce42c-07e9-4a35-91d2-f3d6e087bc7d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.510894 Nov 02 13:31:05.506468 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1840/4036] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:04 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:05.526190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-06a9381d-25d4-426b-b43e-20c24e08f389 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786874ca0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:05.582883 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-06a9381d-25d4-426b-b43e-20c24e08f389 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.070914 Nov 02 13:31:05.583753 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1841/4037] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:05 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:05.636144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:05.651261 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ff3cc65-5292-4b7b-b7ef-267b4de92e20 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1501 microversion: 2.1 time: 0.508605 Nov 02 13:31:05.652617 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2197/4038] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:05 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1501 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:31:05.686436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:05.687152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:05.709848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.710372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.712782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.716382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:05.716889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:05.717724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:05.996483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:06.012638 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-daa050d5-5fb3-4816-aa13-064a34ca5f54 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.334573 Nov 02 13:31:06.027150 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1842/4039] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:05 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:06.146601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:06.147360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:06.162803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:06.163376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:06.163827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:06.164556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:06.165056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:06.166196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:06.532196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:06.533242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:06.545800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:06.550588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:06.551417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:06.552659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:06.556182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:06.557423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:06.572052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:06.584221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:06.585901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:06.613758 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-49382337-c0aa-4784-8069-cafa74b25ced tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1560 microversion: 2.21 time: 0.445477 Nov 02 13:31:06.617333 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2198/4040] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:06 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1560 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:06.635820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e9ed1ef8-efe7-4d79-9a4f-5ded3cd1db52 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f89a430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:06.762294 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e9ed1ef8-efe7-4d79-9a4f-5ded3cd1db52 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.141848 Nov 02 13:31:06.765887 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2199/4041] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:06 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:06.780823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:06.781944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:06.793047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:06.793561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:06.794695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:06.795573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:06.796630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:06.797087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:06.952296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:06.963229 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3feff0b3-172d-4ccd-a79f-e79c84d5a24d tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1328 microversion: 2.1 time: 0.435154 Nov 02 13:31:06.968686 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1843/4042] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:06 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1328 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:31:06.982055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-be09bc86-b218-40a1-875d-0c8bd11c5b23 req-7752b256-a389-496a-a8c6-51c13c89b576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e57c4d-4569-49a6-a42a-493bb7904624", "name": "network-vif-plugged", "status": "completed", "tag": "1b493f0a-2ada-4730-97e9-2afd52152e70"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:07.011656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-be09bc86-b218-40a1-875d-0c8bd11c5b23 req-7752b256-a389-496a-a8c6-51c13c89b576 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.013228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-be09bc86-b218-40a1-875d-0c8bd11c5b23 req-7752b256-a389-496a-a8c6-51c13c89b576 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.017453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-be09bc86-b218-40a1-875d-0c8bd11c5b23 req-7752b256-a389-496a-a8c6-51c13c89b576 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.039503 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-be09bc86-b218-40a1-875d-0c8bd11c5b23 req-7752b256-a389-496a-a8c6-51c13c89b576 service nova] Creating event network-vif-plugged:1b493f0a-2ada-4730-97e9-2afd52152e70 for instance 36e57c4d-4569-49a6-a42a-493bb7904624 on n-h2-858384-19 Nov 02 13:31:07.054146 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-be09bc86-b218-40a1-875d-0c8bd11c5b23 req-7752b256-a389-496a-a8c6-51c13c89b576 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079632 Nov 02 13:31:07.057433 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1844/4043] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:07.092979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1552481153", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1dafac15-446a-4fa4-b8d4-1b4ca13b93f5"}, {"port": "a59140df-02b2-48d4-9f91-b051ae369f57", "tag": "port-1"}, {"port": "7a0e3e23-49a6-431b-bfe5-ae6397b899d3", "tag": "port-2"}, {"uuid": "5cf8d99c-3541-4e83-a73c-7dd67f665840", "tag": "net-1"}, {"uuid": "5cf8d99c-3541-4e83-a73c-7dd67f665840"}, {"uuid": "afbcddd0-ecbd-4f6e-8841-82aed71682eb", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "afbcddd0-ecbd-4f6e-8841-82aed71682eb", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "016cc66d-18e8-4a47-a440-86b2b8198243", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d59be48b-e208-4652-a1ef-3dbc133af48a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0c9e9414-8b6d-458e-a775-8f6e7a59debd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--146392565"}], "key_name": "tempest-keypair-461846968", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:07.301169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:07.314451 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d57cd471-0836-46c1-8186-fefa1f47e2e0 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1501 microversion: 2.1 time: 0.547235 Nov 02 13:31:07.315214 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2200/4044] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:06 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1501 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:07.321425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:07.327613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:07.341560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.343973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.344716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.349068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.349846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.350517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.416596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] validate_networks() for [('1dafac15-446a-4fa4-b8d4-1b4ca13b93f5', None, None, None, None, None), (None, None, 'a59140df-02b2-48d4-9f91-b051ae369f57', None, None, None), (None, None, '7a0e3e23-49a6-431b-bfe5-ae6397b899d3', None, None, None), ('5cf8d99c-3541-4e83-a73c-7dd67f665840', None, None, None, None, None), ('5cf8d99c-3541-4e83-a73c-7dd67f665840', None, None, None, None, None), ('afbcddd0-ecbd-4f6e-8841-82aed71682eb', '10.2.2.100', None, None, None, None), ('afbcddd0-ecbd-4f6e-8841-82aed71682eb', '10.2.2.200', None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:31:07.849828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:07.860068 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c510fe95-c635-4535-a552-6e772d77fb7f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1319 microversion: 2.1 time: 0.543534 Nov 02 13:31:07.870524 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2201/4045] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:07 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:07.885999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:07.886619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:07.893499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.894047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.898104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:07.898873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:07.899910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:07.900365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:08.404872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:08.419033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:08.420760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dca8c7d88154a5ca8e3afbe216b4ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1ce242632104a26aa3b74e365e15582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:08.421983 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d0a1f1b2-82f4-4e26-98df-949e9455bbcd tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 200 len: 1560 microversion: 2.21 time: 0.550058 Nov 02 13:31:08.435169 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2202/4046] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:07 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 1560 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:08.466384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f07422e2-3044-4e71-a874-f8cb19e4479b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786a16040>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:08.604458 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f07422e2-3044-4e71-a874-f8cb19e4479b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.156204 Nov 02 13:31:08.606271 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2203/4047] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:08 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:08.617682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:08.630886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:08.645264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:08.653059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:08.654902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:08.657345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:08.658001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:08.659642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:09.370657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:09.373325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:09.387499 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d84fce79-3e19-4caa-9643-7f29f74bd684 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 200 len: 1523 microversion: 2.1 time: 0.779645 Nov 02 13:31:09.388921 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2204/4048] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:08 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 1523 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:09.420892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:09.422633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:09.434895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:09.435783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:09.436397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:09.437286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:09.437910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:09.438685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:09.551734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:09.553357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:09.553990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:09.554702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lazy-loading 'fault' on Instance uuid 32d3764e-855d-43f3-b1d7-b834fabcb80e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:31:09.738276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4228809f65b74c90b1d34cecc1b4d30e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fddc748dcdb4ceeb421a758b753b756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:09.749580 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-42f80f5f-7ee5-4292-ae61-e2221123d81e tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 200 len: 1308 microversion: 2.1 time: 0.335894 Nov 02 13:31:09.750745 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2205/4049] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:09 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:09.763222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-73b9d5b4-c7b3-4c3e-ac75-5d5bb987cdb2 req-3bc05e56-8410-4ee9-be73-befe2619df00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0108c040-a1b8-4a2a-9188-9ca98794e998", "name": "network-vif-deleted", "tag": "76518416-f6fe-4130-a69b-71d907a6cff9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:09.795454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-73b9d5b4-c7b3-4c3e-ac75-5d5bb987cdb2 req-3bc05e56-8410-4ee9-be73-befe2619df00 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:09.795936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-73b9d5b4-c7b3-4c3e-ac75-5d5bb987cdb2 req-3bc05e56-8410-4ee9-be73-befe2619df00 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:09.796373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-73b9d5b4-c7b3-4c3e-ac75-5d5bb987cdb2 req-3bc05e56-8410-4ee9-be73-befe2619df00 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:09.809475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-73b9d5b4-c7b3-4c3e-ac75-5d5bb987cdb2 req-3bc05e56-8410-4ee9-be73-befe2619df00 service nova] Creating event network-vif-deleted:76518416-f6fe-4130-a69b-71d907a6cff9 for instance 0108c040-a1b8-4a2a-9188-9ca98794e998 on n-h2-858384-19 Nov 02 13:31:09.827803 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-73b9d5b4-c7b3-4c3e-ac75-5d5bb987cdb2 req-3bc05e56-8410-4ee9-be73-befe2619df00 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075580 Nov 02 13:31:09.828679 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2206/4050] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:09.837988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:09.849793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:09.859050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:09.859842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:09.860568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:09.861528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:09.862212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:09.862865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:10.258530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:10.269500 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eaa2e6ef-e676-4a2a-a0af-4ef5b0d2f12e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1506 microversion: 2.1 time: 0.434054 Nov 02 13:31:10.270441 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2207/4051] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:09 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:10.279985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.107"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:10.282767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:10.289491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:10.290779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:10.291430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:10.292364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:10.293065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:10.294008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:10.395869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "refresh_cache-47463cd7-babe-480b-b99c-6a8fdbb3e278" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:31:10.396551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquired lock "refresh_cache-47463cd7-babe-480b-b99c-6a8fdbb3e278" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:31:12.029574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Building network info cache for instance {{(pid=120928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:31:12.765613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:31:12.768164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:31:12.768664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:31:12.769595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:31:12.772821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:31:12.799914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:12.800365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:12.800812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:12.809687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:12.810189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:12.815015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:12.878439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Getting quotas for project 71c9ac6a19e84cfb8ba6d86da5292fbe. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:31:12.894191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Getting quotas for user 533414d2d1ae4de09cce393f8f6c8b8e and project 71c9ac6a19e84cfb8ba6d86da5292fbe. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:31:13.259427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Updating instance_info_cache with network_info: [{"id": "0371c62f-95e5-471c-9c06-cd18325aba3f", "address": "fa:16:3e:93:18:68", "network": {"id": "16a488c5-bc10-4fc2-8635-3fe544404977", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-191585170-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b8254a8a3abe4829941573211dc1aa74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0371c62f-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:31:13.275871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:31:13.279244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='016cc66d-18e8-4a47-a440-86b2b8198243',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d59be48b-e208-4652-a1ef-3dbc133af48a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c9e9414-8b6d-458e-a775-8f6e7a59debd',volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:31:13.293647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Releasing lock "refresh_cache-47463cd7-babe-480b-b99c-6a8fdbb3e278" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:31:13.294541 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5e704973-4600-4e03-94a2-3d1b6955dd14 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "POST /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278/action" status: 202 len: 0 microversion: 2.1 time: 3.019023 Nov 02 13:31:13.295179 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2208/4052] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:31:10 2022] POST /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278/action => generated 0 bytes in 3021 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:31:13.318832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:13.319822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:13.336250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:13.338469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:13.339573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:13.341124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:13.342172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:13.345557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:13.385900 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] HTTP exception thrown: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Request method failure captured: Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 HTTP/1.1 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnD30nR6q9frxID-Sqmv8ux27a9A8v1RtZp-nUAUrxd1X3otfrApq_AhvS8y1FF1jqQRbOsKJF1ZKy9EdGsN2Sbu_Ml8IoJyEq6EdU-dxS6ums80uXiMrG5d1bHnB5D5aoLaiAHrmu2KkSLuouxKc6eQWSpZtmB0g144H_ugR8oSnTw Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: c1ce242632104a26aa3b74e365e15582 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1362495657 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c1ce242632104a26aa3b74e365e15582"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c1ce242632104a26aa3b74e365e15582"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c1ce242632104a26aa3b74e365e15582"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c1ce242632104a26aa3b74e365e15582"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-InstanceActionsV221TestJSON-1362495657 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: c1ce242632104a26aa3b74e365e15582 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1362495657 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-InstanceActionsV221TestJSON-1362495657-project Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 1dca8c7d88154a5ca8e3afbe216b4ee2 Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-InstanceActionsV221TestJSON-1362495657-project Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0108c040-a1b8-4a2a-9188-9ca98794e998'} Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:13.389562 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.401354 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:13.401354 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.401354 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:13.401354 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:13.401354 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:13.401354 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:13.401354 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:13.401354 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:13.401354 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.403977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Returning 404 to user: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:13.405674 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6809ec0a-d131-4476-87a5-dfc5a08384d2 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 404 len: 111 microversion: 2.21 time: 0.101166 Nov 02 13:31:13.411824 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2209/4053] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:13 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:31:13.432105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-65dd14f8-fdfd-4d89-8c40-d3bb5ed5d2a6 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786bbbca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:13.663252 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-65dd14f8-fdfd-4d89-8c40-d3bb5ed5d2a6 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.248504 Nov 02 13:31:13.675787 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2210/4054] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:13 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:13.687733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a52b1ecd-468f-4d9c-8bd4-e0b45960bfad tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:13.690556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a52b1ecd-468f-4d9c-8bd4-e0b45960bfad tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:13.702751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a52b1ecd-468f-4d9c-8bd4-e0b45960bfad tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:13.708603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a52b1ecd-468f-4d9c-8bd4-e0b45960bfad tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:13.710844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a52b1ecd-468f-4d9c-8bd4-e0b45960bfad tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:13.712834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a52b1ecd-468f-4d9c-8bd4-e0b45960bfad tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:13.713554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a52b1ecd-468f-4d9c-8bd4-e0b45960bfad tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:13.714347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a52b1ecd-468f-4d9c-8bd4-e0b45960bfad tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:13.835859 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a52b1ecd-468f-4d9c-8bd4-e0b45960bfad tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624/action" status: 202 len: 0 microversion: 2.1 time: 0.157817 Nov 02 13:31:13.841055 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2211/4055] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:31:13 2022] POST /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:31:13.845323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:13.846704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:13.858279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:13.859100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:13.859821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:13.861408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:13.862362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:13.863269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:13.920198 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e HTTP/1.1 Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '32d3764e-855d-43f3-b1d7-b834fabcb80e'} Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:13.921935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.926848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:13.926848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:13.926848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:13.926848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:13.926848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:13.926848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:13.926848 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:13.950094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:13.951475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a442583-c381-4cc4-85d1-4786cb6da1d9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 404 len: 111 microversion: 2.1 time: 0.111913 Nov 02 13:31:13.958783 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2212/4056] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:13 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:13.976501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-fe99ce31-1aca-4dfd-9b42-0cddb4a1a3c3 req-cac284b4-a2ae-48cd-b0ac-feeb6d917cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d3764e-855d-43f3-b1d7-b834fabcb80e", "name": "network-vif-deleted", "tag": "10b3a375-2a8f-4c2d-9d8d-636dd981ef5d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:14.004679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fe99ce31-1aca-4dfd-9b42-0cddb4a1a3c3 req-cac284b4-a2ae-48cd-b0ac-feeb6d917cab service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:14.005571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fe99ce31-1aca-4dfd-9b42-0cddb4a1a3c3 req-cac284b4-a2ae-48cd-b0ac-feeb6d917cab service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:14.006592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-fe99ce31-1aca-4dfd-9b42-0cddb4a1a3c3 req-cac284b4-a2ae-48cd-b0ac-feeb6d917cab service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:14.073931 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-fe99ce31-1aca-4dfd-9b42-0cddb4a1a3c3 req-cac284b4-a2ae-48cd-b0ac-feeb6d917cab service nova] Creating event network-vif-deleted:10b3a375-2a8f-4c2d-9d8d-636dd981ef5d for instance 32d3764e-855d-43f3-b1d7-b834fabcb80e on n-h1-858384-19 Nov 02 13:31:14.094399 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-fe99ce31-1aca-4dfd-9b42-0cddb4a1a3c3 req-cac284b4-a2ae-48cd-b0ac-feeb6d917cab service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133206 Nov 02 13:31:14.097821 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2213/4057] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:14.111041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.107"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:14.117460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:14.124837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:14.133189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:14.135450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:14.136238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:14.137338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:14.144284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:14.148867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:14.175230 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e3ea849-1263-4d1e-bf4e-c14e4063b690 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.32 time: 7.116070 Nov 02 13:31:14.184068 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1845/4058] 10.222.0.113 () {62 vars in 1194 bytes} [Wed Nov 2 13:31:07 2022] POST /compute/v2.1/servers => generated 407 bytes in 7126 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:31:14.196473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cc360400-1a6f-406c-82e1-4863dffb4262 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '.version_select at 0x7fe786935700>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:14.197061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cc360400-1a6f-406c-82e1-4863dffb4262 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:14.223481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc360400-1a6f-406c-82e1-4863dffb4262 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:14.226954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc360400-1a6f-406c-82e1-4863dffb4262 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:14.227906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc360400-1a6f-406c-82e1-4863dffb4262 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:14.229434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc360400-1a6f-406c-82e1-4863dffb4262 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:14.231300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc360400-1a6f-406c-82e1-4863dffb4262 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:14.234428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc360400-1a6f-406c-82e1-4863dffb4262 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:14.253972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "refresh_cache-0f596fd2-1baa-4da3-a6fb-cd1a070fe257" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:31:14.254380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquired lock "refresh_cache-0f596fd2-1baa-4da3-a6fb-cd1a070fe257" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:31:14.458934 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cc360400-1a6f-406c-82e1-4863dffb4262 tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.272840 Nov 02 13:31:14.460137 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1846/4059] 10.222.0.113 () {60 vars in 1342 bytes} [Wed Nov 2 13:31:14 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998/os-instance-actions => generated 611 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:31:14.471034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:14.474014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:14.486368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:14.491966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:14.496166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:14.497312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:14.497980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:14.500320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:15.418124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:15.424515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:15.433770 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0328692-c1e2-4b61-9f64-477747821c41 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1491 microversion: 2.1 time: 0.971137 Nov 02 13:31:15.435474 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1847/4060] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:14 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1491 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:15.441237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:15.442208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:15.450973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:15.452244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:15.453686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:15.455346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:15.457089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:15.458385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:15.489547 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e HTTP/1.1 Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '32d3764e-855d-43f3-b1d7-b834fabcb80e'} Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:15.492338 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:15.498400 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.502729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:15.504391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4aade9d3-52ea-487c-ac0b-f8ab51d95e28 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 404 len: 111 microversion: 2.1 time: 0.067458 Nov 02 13:31:15.506038 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1848/4061] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:31:15 2022] DELETE /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:15.514240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4706248d-8a5b-409b-b37d-f7da18809472 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:15.514969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4706248d-8a5b-409b-b37d-f7da18809472 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:15.626647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4706248d-8a5b-409b-b37d-f7da18809472 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:15.637890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4706248d-8a5b-409b-b37d-f7da18809472 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:15.639998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4706248d-8a5b-409b-b37d-f7da18809472 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:15.641531 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4706248d-8a5b-409b-b37d-f7da18809472 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1289 microversion: 2.32 time: 0.133289 Nov 02 13:31:15.642873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1849/4062] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:15 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1289 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:15.672950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:15.674483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:15.697447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:15.699000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:15.701295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:15.702434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:15.704167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:15.708766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:15.740231 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] HTTP exception thrown: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Request method failure captured: Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 HTTP/1.1 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnD30nR6q9frxID-Sqmv8ux27a9A8v1RtZp-nUAUrxd1X3otfrApq_AhvS8y1FF1jqQRbOsKJF1ZKy9EdGsN2Sbu_Ml8IoJyEq6EdU-dxS6ums80uXiMrG5d1bHnB5D5aoLaiAHrmu2KkSLuouxKc6eQWSpZtmB0g144H_ugR8oSnTw Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c1ce242632104a26aa3b74e365e15582 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1362495657 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c1ce242632104a26aa3b74e365e15582"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c1ce242632104a26aa3b74e365e15582"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c1ce242632104a26aa3b74e365e15582"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c1ce242632104a26aa3b74e365e15582"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-InstanceActionsV221TestJSON-1362495657 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c1ce242632104a26aa3b74e365e15582 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1362495657 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-InstanceActionsV221TestJSON-1362495657-project Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1dca8c7d88154a5ca8e3afbe216b4ee2 Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-InstanceActionsV221TestJSON-1362495657-project Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '0108c040-a1b8-4a2a-9188-9ca98794e998'} Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:15.742823 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:15.748655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:15.762352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Returning 404 to user: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:15.765599 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-359c45c2-b1cd-4dd5-bdc2-deb2fc4773ed tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 404 len: 111 microversion: 2.21 time: 0.121483 Nov 02 13:31:15.774773 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1850/4063] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:31:15 2022] DELETE /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:31:15.797716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53d25333-770e-4a6e-8dcc-2f0aaefe443c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78689d550>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:15.879847 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-53d25333-770e-4a6e-8dcc-2f0aaefe443c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.102446 Nov 02 13:31:15.880775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1851/4064] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:15 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:15.897992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:15.904916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:15.925376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:15.927777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:15.928226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:15.933949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:15.934438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:15.934881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:15.981653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lazy-loading 'flavor' on Instance uuid 36e57c4d-4569-49a6-a42a-493bb7904624 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:31:16.533093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a223bed0-e2e0-48bf-92fc-e7aeb877a836 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624/action" status: 202 len: 0 microversion: 2.1 time: 0.645410 Nov 02 13:31:16.536478 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1852/4065] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:31:15 2022] POST /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:31:16.581486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:16.589596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 32d3764e-855d-43f3-b1d7-b834fabcb80e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:16.629848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:16.631670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:16.633616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:16.636128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:16.636916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:16.637454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:16.659399 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e HTTP/1.1 Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '32d3764e-855d-43f3-b1d7-b834fabcb80e'} Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:16.664236 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 32d3764e-855d-43f3-b1d7-b834fabcb80e could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9f14feb-96a6-4e76-a352-b68d074a6b9a tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e" status: 404 len: 111 microversion: 2.1 time: 0.130024 Nov 02 13:31:16.671590 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1853/4066] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:16 2022] GET /compute/v2.1/servers/32d3764e-855d-43f3-b1d7-b834fabcb80e => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:16.685471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:16.686412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] [instance: 0108c040-a1b8-4a2a-9188-9ca98794e998] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:16.696797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:16.697492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:16.698045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:16.698842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:16.699826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:16.700384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:16.722307 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] HTTP exception thrown: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Request method failure captured: Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 HTTP/1.1 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnD30nR6q9frxID-Sqmv8ux27a9A8v1RtZp-nUAUrxd1X3otfrApq_AhvS8y1FF1jqQRbOsKJF1ZKy9EdGsN2Sbu_Ml8IoJyEq6EdU-dxS6ums80uXiMrG5d1bHnB5D5aoLaiAHrmu2KkSLuouxKc6eQWSpZtmB0g144H_ugR8oSnTw Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: c1ce242632104a26aa3b74e365e15582 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1362495657 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c1ce242632104a26aa3b74e365e15582"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/c1ce242632104a26aa3b74e365e15582"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_c1ce242632104a26aa3b74e365e15582"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/c1ce242632104a26aa3b74e365e15582"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-InstanceActionsV221TestJSON-1362495657 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: c1ce242632104a26aa3b74e365e15582 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1362495657 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-InstanceActionsV221TestJSON-1362495657-project Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1dca8c7d88154a5ca8e3afbe216b4ee2 Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-InstanceActionsV221TestJSON-1362495657-project Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '0108c040-a1b8-4a2a-9188-9ca98794e998'} Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:16.725082 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.733110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:16.733110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.733110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:16.733110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:16.733110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:16.733110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:16.733110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:16.733110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. Nov 02 13:31:16.733110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:16.735858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] Returning 404 to user: Instance 0108c040-a1b8-4a2a-9188-9ca98794e998 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:16.740422 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f50eeede-adc8-4c24-bfe7-f152964e0e9b tempest-InstanceActionsV221TestJSON-1362495657 tempest-InstanceActionsV221TestJSON-1362495657-project] 10.222.0.113 "GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998" status: 404 len: 111 microversion: 2.21 time: 0.065387 Nov 02 13:31:16.743224 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1854/4067] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:16 2022] GET /compute/v2.1/servers/0108c040-a1b8-4a2a-9188-9ca98794e998 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:31:16.752803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-eaea2988-8488-4f7f-a9a5-1aa224f624d8 req-eba1417a-ce97-44ae-88ff-6d47a86c4dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47463cd7-babe-480b-b99c-6a8fdbb3e278", "tag": "0371c62f-95e5-471c-9c06-cd18325aba3f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:16.772741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eaea2988-8488-4f7f-a9a5-1aa224f624d8 req-eba1417a-ce97-44ae-88ff-6d47a86c4dac service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:16.773795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eaea2988-8488-4f7f-a9a5-1aa224f624d8 req-eba1417a-ce97-44ae-88ff-6d47a86c4dac service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:16.783528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eaea2988-8488-4f7f-a9a5-1aa224f624d8 req-eba1417a-ce97-44ae-88ff-6d47a86c4dac service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:16.804913 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-eaea2988-8488-4f7f-a9a5-1aa224f624d8 req-eba1417a-ce97-44ae-88ff-6d47a86c4dac service nova] Creating event network-changed:0371c62f-95e5-471c-9c06-cd18325aba3f for instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 on n-h1-858384-19 Nov 02 13:31:16.821473 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-eaea2988-8488-4f7f-a9a5-1aa224f624d8 req-eba1417a-ce97-44ae-88ff-6d47a86c4dac service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071585 Nov 02 13:31:16.822831 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1855/4068] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:16.833370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:16.835194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:16.865578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:16.868911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:16.869650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:16.872517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:16.873231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:16.873871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:17.662631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:17.673222 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-083bd5e3-291d-4fc1-94dc-2b05970d8af3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1497 microversion: 2.1 time: 0.848499 Nov 02 13:31:17.677081 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1856/4069] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:16 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1497 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:17.693007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:17.693984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:17.725851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:17.726776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:17.728226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:17.729364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:17.733095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:17.733841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.136169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:18.197594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:18.203339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:18.208059 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f77c0ab-49e6-4507-9fc0-057df8b552d0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1579 microversion: 2.32 time: 0.526922 Nov 02 13:31:18.210280 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1857/4070] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:17 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1579 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:18.221861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:18.222361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:18.243748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.248473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.249168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.255609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.256886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.257568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.305821 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a HTTP/1.1 Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fc799996-097f-4616-9175-cfdf0034603a'} Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:18.307567 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.312724 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.322482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:18.327087 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c4c93457-ec0e-4036-8dae-297d341af394 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 404 len: 111 microversion: 2.1 time: 0.115771 Nov 02 13:31:18.331662 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1858/4071] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:31:18 2022] DELETE /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:18.343607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bb1bfb68-33ea-4d7c-a654-2a3e27f2a21a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787e85ee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:18.439967 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bb1bfb68-33ea-4d7c-a654-2a3e27f2a21a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.106874 Nov 02 13:31:18.440864 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1859/4072] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:18 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:18.460762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:18.465686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fc799996-097f-4616-9175-cfdf0034603a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:18.505736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:18.507688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.508944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.509402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.514547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.522175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.523897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.559705 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a HTTP/1.1 Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fc799996-097f-4616-9175-cfdf0034603a'} Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:18.561435 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.566378 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.566378 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:18.566378 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:18.566378 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:18.566378 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:18.566378 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. Nov 02 13:31:18.566378 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.566378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance fc799996-097f-4616-9175-cfdf0034603a could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:18.566378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec4cf1da-646b-4707-8087-5406b9da9670 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a" status: 404 len: 111 microversion: 2.1 time: 0.120607 Nov 02 13:31:18.567789 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1860/4073] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:18 2022] GET /compute/v2.1/servers/fc799996-097f-4616-9175-cfdf0034603a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:18.576962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:18.583719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:18.607520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.608040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.608491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.609361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.609692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.610133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.663103 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f HTTP/1.1 Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '45a0aa59-efb1-4c34-bca2-780b90088e7f'} Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:18.675683 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.681447 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.686314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:18.687450 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-46980a2d-5783-40c8-85ce-43a2d408bd95 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 404 len: 111 microversion: 2.1 time: 0.114976 Nov 02 13:31:18.692146 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1861/4074] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:31:18 2022] DELETE /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:18.724315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:18.732081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 45a0aa59-efb1-4c34-bca2-780b90088e7f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:18.750675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.751208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.751657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.752375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.752835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.754435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.796597 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f HTTP/1.1 Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '45a0aa59-efb1-4c34-bca2-780b90088e7f'} Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:18.799802 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.805386 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:18.805386 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:18.805386 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:18.805386 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:18.805386 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:18.805386 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. Nov 02 13:31:18.805386 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:18.807458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 45a0aa59-efb1-4c34-bca2-780b90088e7f could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:18.808513 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bba0b5ae-a27c-409f-bacb-a368e953bccc tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f" status: 404 len: 111 microversion: 2.1 time: 0.110329 Nov 02 13:31:18.809267 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1862/4075] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:18 2022] GET /compute/v2.1/servers/45a0aa59-efb1-4c34-bca2-780b90088e7f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:18.818552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:18.819462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:18.827895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.829909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.830737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:18.833513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:18.834200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:18.834810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:19.444343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:19.458746 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0418fe28-5094-4319-a1e2-58110a809037 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1518 microversion: 2.1 time: 0.644905 Nov 02 13:31:19.461209 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1863/4076] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:18 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1518 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:19.477589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:19.478647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:19.495142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:19.500194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:19.500893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:19.503995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:19.506686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:19.508928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:19.547062 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b HTTP/1.1 Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '81a13437-49ca-4a77-b86b-893d0b62338b'} Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:19.548697 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:19.553331 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ddfe6cf3-c1b1-445d-8436-b8da2e888e14 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 404 len: 111 microversion: 2.1 time: 0.086871 Nov 02 13:31:19.562929 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1864/4077] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:31:19 2022] DELETE /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:19.578671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:19.581414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:19.603674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:19.605776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:19.606411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:19.613145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:19.613953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:19.614580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:19.871792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:19.897215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:19.905771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:19.909370 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d902c3b-e407-44bb-b814-37b6a365c5c6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1597 microversion: 2.32 time: 0.343917 Nov 02 13:31:19.911534 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1865/4078] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:19 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1597 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:19.923915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9e09e96-3a27-482b-9823-9b06337b5329 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868fa9d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:20.033034 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9e09e96-3a27-482b-9823-9b06337b5329 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.116731 Nov 02 13:31:20.041654 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1866/4079] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:19 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:20.054707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:20.061952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 81a13437-49ca-4a77-b86b-893d0b62338b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:20.085398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:20.087779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:20.088355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:20.090784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:20.097724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:20.101184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:20.176458 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b HTTP/1.1 Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '81a13437-49ca-4a77-b86b-893d0b62338b'} Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:20.179770 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 81a13437-49ca-4a77-b86b-893d0b62338b could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-072a2fb3-f9ed-4bb3-9ac2-b279d5373def tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b" status: 404 len: 111 microversion: 2.1 time: 0.140983 Nov 02 13:31:20.188433 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1867/4080] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:20 2022] GET /compute/v2.1/servers/81a13437-49ca-4a77-b86b-893d0b62338b => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:20.200051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5143d77-8d30-4b98-9b4b-3d545322dfbb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:20.202552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c5143d77-8d30-4b98-9b4b-3d545322dfbb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fec033ae-a8a2-4e35-91cc-f74b5f3965c5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:20.221752 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c5143d77-8d30-4b98-9b4b-3d545322dfbb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5143d77-8d30-4b98-9b4b-3d545322dfbb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5 HTTP/1.1 Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fec033ae-a8a2-4e35-91cc-f74b5f3965c5'} Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.224533 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5143d77-8d30-4b98-9b4b-3d545322dfbb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c5143d77-8d30-4b98-9b4b-3d545322dfbb tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5" status: 404 len: 111 microversion: 2.1 time: 0.034577 Nov 02 13:31:20.230322 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1868/4081] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:31:20 2022] DELETE /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:20.255941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f24df912-db3a-451d-90fa-e92d11691852 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:20.261425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f24df912-db3a-451d-90fa-e92d11691852 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: fec033ae-a8a2-4e35-91cc-f74b5f3965c5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:20.299226 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f24df912-db3a-451d-90fa-e92d11691852 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f24df912-db3a-451d-90fa-e92d11691852 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5 HTTP/1.1 Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fec033ae-a8a2-4e35-91cc-f74b5f3965c5'} Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:20.317230 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:20.322910 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:20.322910 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:20.322910 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:20.322910 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. Nov 02 13:31:20.322910 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:20.322910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f24df912-db3a-451d-90fa-e92d11691852 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance fec033ae-a8a2-4e35-91cc-f74b5f3965c5 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:20.327106 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f24df912-db3a-451d-90fa-e92d11691852 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5" status: 404 len: 111 microversion: 2.1 time: 0.094994 Nov 02 13:31:20.328365 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1869/4082] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:20 2022] GET /compute/v2.1/servers/fec033ae-a8a2-4e35-91cc-f74b5f3965c5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:20.488096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:20.488654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:20.502579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:20.503242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:20.503694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:20.514799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:20.519062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:20.522328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:21.121136 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.network.neutron [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] re-assign floating IP 172.25.1.107 from instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 Nov 02 13:31:21.207016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Building network info cache for instance {{(pid=120928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:31:22.295104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:22.324272 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51d0e36c-5ed8-4e31-865c-8f302bedb395 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1518 microversion: 2.1 time: 1.840126 Nov 02 13:31:22.327817 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1870/4083] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:20 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1518 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:22.345479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-113fc031-ba94-42a9-b972-67be7c930e7f req-36a7e429-d3d2-4de9-980b-e9844b8b168b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47463cd7-babe-480b-b99c-6a8fdbb3e278", "tag": "0371c62f-95e5-471c-9c06-cd18325aba3f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:22.372693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-113fc031-ba94-42a9-b972-67be7c930e7f req-36a7e429-d3d2-4de9-980b-e9844b8b168b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:22.373542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-113fc031-ba94-42a9-b972-67be7c930e7f req-36a7e429-d3d2-4de9-980b-e9844b8b168b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:22.374191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-113fc031-ba94-42a9-b972-67be7c930e7f req-36a7e429-d3d2-4de9-980b-e9844b8b168b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:22.409150 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-113fc031-ba94-42a9-b972-67be7c930e7f req-36a7e429-d3d2-4de9-980b-e9844b8b168b service nova] Creating event network-changed:0371c62f-95e5-471c-9c06-cd18325aba3f for instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 on n-h1-858384-19 Nov 02 13:31:22.415572 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-113fc031-ba94-42a9-b972-67be7c930e7f req-36a7e429-d3d2-4de9-980b-e9844b8b168b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083208 Nov 02 13:31:22.417191 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1871/4084] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:22.422670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:22.423714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:22.441059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:22.444146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:22.446313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:22.454022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:22.456175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:22.456860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:22.838959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:22.872977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:22.890538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:22.894508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:22.895916 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c0fd7f10-f72d-40e4-b031-187df175ae28 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1597 microversion: 2.32 time: 0.477424 Nov 02 13:31:22.900849 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1872/4085] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:22 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1597 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:22.907771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-205eb514-8c86-4c6b-8abd-f34770170cbf tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78682d820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:23.198854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Updating instance_info_cache with network_info: [{"id": "0371c62f-95e5-471c-9c06-cd18325aba3f", "address": "fa:16:3e:93:18:68", "network": {"id": "16a488c5-bc10-4fc2-8635-3fe544404977", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-191585170-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b8254a8a3abe4829941573211dc1aa74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0371c62f-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:31:23.211865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Building network info cache for instance {{(pid=120928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:31:23.376815 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-205eb514-8c86-4c6b-8abd-f34770170cbf tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1458 microversion: 2.1 time: 0.474403 Nov 02 13:31:23.378324 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1873/4086] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:22 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1458 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:23.390374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-8c693b94-6219-42dd-8b76-d17101757e9f req-a3f66d9d-372a-4c3e-b891-113ef8fdfbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e57c4d-4569-49a6-a42a-493bb7904624", "name": "network-vif-plugged", "status": "completed", "tag": "1b493f0a-2ada-4730-97e9-2afd52152e70"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:23.420398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8c693b94-6219-42dd-8b76-d17101757e9f req-a3f66d9d-372a-4c3e-b891-113ef8fdfbe6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:23.421462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8c693b94-6219-42dd-8b76-d17101757e9f req-a3f66d9d-372a-4c3e-b891-113ef8fdfbe6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:23.424532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8c693b94-6219-42dd-8b76-d17101757e9f req-a3f66d9d-372a-4c3e-b891-113ef8fdfbe6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:23.453420 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-8c693b94-6219-42dd-8b76-d17101757e9f req-a3f66d9d-372a-4c3e-b891-113ef8fdfbe6 service nova] Creating event network-vif-plugged:1b493f0a-2ada-4730-97e9-2afd52152e70 for instance 36e57c4d-4569-49a6-a42a-493bb7904624 on n-h2-858384-19 Nov 02 13:31:23.468760 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-8c693b94-6219-42dd-8b76-d17101757e9f req-a3f66d9d-372a-4c3e-b891-113ef8fdfbe6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089033 Nov 02 13:31:23.471476 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1874/4087] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:23.484559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:23.486412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:23.499562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:23.501720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:23.502494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:23.503616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:23.505299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:23.506038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:24.205745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:25.208004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:25.229706 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4975fce3-3735-49fa-aec7-4bfb8760c9b1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 1.752394 Nov 02 13:31:25.249039 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1875/4088] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:23 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:25.254345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:25.254968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:25.312873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.313376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.319430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.323722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:25.324468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:25.325112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:25.620121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Updating instance_info_cache with network_info: [{"id": "3549cdb8-a8f2-40ce-99d6-0f91c1b1f979", "address": "fa:16:3e:68:ce:8e", "network": {"id": "16a488c5-bc10-4fc2-8635-3fe544404977", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-191585170-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b8254a8a3abe4829941573211dc1aa74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3549cdb8-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:31:25.632011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:25.662771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Releasing lock "refresh_cache-0f596fd2-1baa-4da3-a6fb-cd1a070fe257" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:31:25.663849 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-37023313-c2ed-445f-882f-bb2fb0ede005 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "POST /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257/action" status: 202 len: 0 microversion: 2.1 time: 11.564469 Nov 02 13:31:25.665713 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2214/4089] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:31:14 2022] POST /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257/action => generated 0 bytes in 11567 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:31:25.680621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-abecfcf7-3b9e-41ea-bb05-b54766d9784d tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787ac9820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:26.206905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:26.234921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:26.239758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:26.244790 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51781378-20dc-4df2-bfa4-0094a2f6986a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1664 microversion: 2.32 time: 0.994240 Nov 02 13:31:26.247173 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1876/4090] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:25 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1664 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:26.277689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-03e98187-4f1b-41e5-bb24-2b03a4e5ca33 req-d7fcb982-0e2a-4447-a350-48440f75f7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f596fd2-1baa-4da3-a6fb-cd1a070fe257", "tag": "3549cdb8-a8f2-40ce-99d6-0f91c1b1f979"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:26.330597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-03e98187-4f1b-41e5-bb24-2b03a4e5ca33 req-d7fcb982-0e2a-4447-a350-48440f75f7f2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:26.331044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-03e98187-4f1b-41e5-bb24-2b03a4e5ca33 req-d7fcb982-0e2a-4447-a350-48440f75f7f2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:26.332776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-03e98187-4f1b-41e5-bb24-2b03a4e5ca33 req-d7fcb982-0e2a-4447-a350-48440f75f7f2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:26.369813 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-03e98187-4f1b-41e5-bb24-2b03a4e5ca33 req-d7fcb982-0e2a-4447-a350-48440f75f7f2 service nova] Creating event network-changed:3549cdb8-a8f2-40ce-99d6-0f91c1b1f979 for instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 on n-h1-858384-19 Nov 02 13:31:26.388954 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-03e98187-4f1b-41e5-bb24-2b03a4e5ca33 req-d7fcb982-0e2a-4447-a350-48440f75f7f2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134038 Nov 02 13:31:26.394186 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1877/4091] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:26.421292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.107"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:27.326582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:27.335232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:27.338388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:27.341025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:27.342461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:27.347316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:27.350318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:28.636735 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] HTTP exception thrown: Floating IP 172.25.1.107 is not associated with instance 47463cd7-babe-480b-b99c-6a8fdbb3e278. Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Request method failure captured: Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278/action HTTP/1.1 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 49 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnDilobPrkpBLGVZ1Q27FI60ClzpQg3dO-O2aELtfLQKNOQTzeEOu50biUC_JZ0HSk0Zdl_XB7yjpOQ0E-B4htAcI8eo2uH2CNEZzGLbuceq27cUsVmuAxRtBVlAHvrrEjMW0SqnWcbOQ24eiRg2Hkiqdj09Dp5uRTMfitJ6Wmd_ojw Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b8254a8a3abe4829941573211dc1aa74 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b8254a8a3abe4829941573211dc1aa74 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-FloatingIPsAssociationTestJSON-1995900720-project Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 318964014c11438c9316b35382a49ed9 Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1995900720-project Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: {"removeFloatingIp": {"address": "172.25.1.107"}} Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: exception: Floating IP 172.25.1.107 is not associated with instance 47463cd7-babe-480b-b99c-6a8fdbb3e278. Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '47463cd7-babe-480b-b99c-6a8fdbb3e278', 'body': {'removeFloatingIp': {'address': '172.25.1.107'}}} Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.107 is not associated with instance 47463cd7-babe-480b-b99c-6a8fdbb3e278. Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.107 is not associated with instance 47463cd7-babe-480b-b99c-6a8fdbb3e278. Nov 02 13:31:28.638340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:28.645739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Returning 409 to user: Floating IP 172.25.1.107 is not associated with instance 47463cd7-babe-480b-b99c-6a8fdbb3e278. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:28.645739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b7fbd1b-6fa4-4897-9697-3c27e5fc426b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "POST /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278/action" status: 409 len: 146 microversion: 2.1 time: 2.241530 Nov 02 13:31:28.645739 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1878/4092] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:31:26 2022] POST /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278/action => generated 146 bytes in 2245 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:31:28.646366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:28.646993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:28.676096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:28.676595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:28.677039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:28.677762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:28.686165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:28.686719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:28.717589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:29.633937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:29.680270 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e8b2fe14-a1f0-4e17-bb4f-5230eec1e9a4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 1.034958 Nov 02 13:31:29.683914 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1879/4093] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:28 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:29.744448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:29.745599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:29.793325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:29.799370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:29.800724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:29.819255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:29.820440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:29.822844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:30.715391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:30.734036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:30.744526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:30.749896 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bda61034-f54b-41f4-982e-4a4e3d791c27 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1710 microversion: 2.32 time: 1.035736 Nov 02 13:31:30.753054 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1880/4094] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:29 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1710 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:30.782110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.107"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:30.829685 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-abecfcf7-3b9e-41ea-bb05-b54766d9784d tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1467 microversion: 2.1 time: 5.162768 Nov 02 13:31:30.833413 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2215/4095] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:25 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1467 bytes in 5167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:30.844331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:30.845366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:30.871723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:30.874046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:30.874742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:30.880890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:30.882197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:30.884824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:31.404100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:31.434385 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e04a60e-6c71-436b-8f2c-a468a6800fbc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 0.593961 Nov 02 13:31:31.448370 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2216/4096] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:30 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:31.470833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce60477f-7cf4-4049-8658-f4bf8f050cd0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f908d30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:31.603736 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce60477f-7cf4-4049-8658-f4bf8f050cd0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 200 len: 1467 microversion: 2.1 time: 0.153891 Nov 02 13:31:31.611174 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2217/4097] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:31 2022] GET /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 1467 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:31.619728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:31.622713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:31.629679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:31.630573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:31.631415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:31.632506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:31.634510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:31.635247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:31.841596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:31.851328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:31.851860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:31.852296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:31.853018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:31.853469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:31.853895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:32.414855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:32.425716 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20e978bf-2510-4ee2-84fa-26059c75e407 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73" status: 200 len: 1472 microversion: 2.1 time: 0.810976 Nov 02 13:31:32.452275 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2218/4098] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:31 2022] GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 => generated 1472 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:32.457883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:32.462594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:32.483301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:32.484285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:32.485006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:32.486151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:32.486878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:32.490472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:33.049052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:33.116027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:33.121801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:33.123074 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0cdb8575-c79c-4ec6-b2fe-f4f7e996ec77 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1756 microversion: 2.32 time: 0.669355 Nov 02 13:31:33.132335 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2219/4099] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:32 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1756 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:33.157574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-226823a5-2409-4d09-bf8a-dde9dec44b13 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78630ee50>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:33.260932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "refresh_cache-0f596fd2-1baa-4da3-a6fb-cd1a070fe257" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:31:33.261886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquired lock "refresh_cache-0f596fd2-1baa-4da3-a6fb-cd1a070fe257" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:31:33.552354 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-226823a5-2409-4d09-bf8a-dde9dec44b13 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images?changes-since=2022-11-02T13%3A28%3A43Z" status: 200 len: 2390 microversion: 2.1 time: 0.417755 Nov 02 13:31:33.557294 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2220/4100] 10.222.0.113 () {58 vars in 1204 bytes} [Wed Nov 2 13:31:33 2022] GET /compute/v2.1/images?changes-since=2022-11-02T13%3A28%3A43Z => generated 2390 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:33.567145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:33.567773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:33.604099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:33.608632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:33.609138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:33.609923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:33.610408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:33.610850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:35.104474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:35.137084 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e9c7a18-5b4d-4b49-97fb-f8b71389d360 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 1.572393 Nov 02 13:31:35.138832 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2221/4101] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:33 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:35.168473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-725b277e-31dc-43b6-9141-61df505c427e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786e41040>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:35.366649 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-725b277e-31dc-43b6-9141-61df505c427e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1722788196" status: 200 len: 488 microversion: 2.1 time: 0.217013 Nov 02 13:31:35.377562 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2222/4102] 10.222.0.113 () {58 vars in 1236 bytes} [Wed Nov 2 13:31:35 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1722788196 => generated 488 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:35.382633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:35.397896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:35.453354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:35.453863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:35.454464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:35.455665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:35.456138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:35.456575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:36.104726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:36.137069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:36.143480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:36.155325 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84315a87-3db4-4eee-814a-0ab59e2139ab tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1802 microversion: 2.32 time: 0.776445 Nov 02 13:31:36.167267 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2223/4103] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:35 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1802 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:36.225178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ba1397c8-095d-44ee-8988-9b26cb710a62 req-0e2bab33-67db-4a5a-9b48-61ceccd80701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f903fade-568a-4ab8-921c-4d0af0956d73", "name": "network-vif-unplugged", "status": "completed", "tag": "2c8ab030-6991-42fe-ad13-68219a6b114c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:36.298108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Building network info cache for instance {{(pid=120929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:31:36.315913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ba1397c8-095d-44ee-8988-9b26cb710a62 req-0e2bab33-67db-4a5a-9b48-61ceccd80701 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:36.319678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ba1397c8-095d-44ee-8988-9b26cb710a62 req-0e2bab33-67db-4a5a-9b48-61ceccd80701 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:36.325087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ba1397c8-095d-44ee-8988-9b26cb710a62 req-0e2bab33-67db-4a5a-9b48-61ceccd80701 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:36.425077 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ba1397c8-095d-44ee-8988-9b26cb710a62 req-0e2bab33-67db-4a5a-9b48-61ceccd80701 service nova] Creating event network-vif-unplugged:2c8ab030-6991-42fe-ad13-68219a6b114c for instance f903fade-568a-4ab8-921c-4d0af0956d73 on n-h2-858384-19 Nov 02 13:31:36.475552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ba1397c8-095d-44ee-8988-9b26cb710a62 req-0e2bab33-67db-4a5a-9b48-61ceccd80701 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.284588 Nov 02 13:31:36.482154 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2224/4104] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:36.546567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b15de94-319b-4a29-8f18-768c4037be3e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786314b80>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:36.854685 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b15de94-319b-4a29-8f18-768c4037be3e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images?server=f903fade-568a-4ab8-921c-4d0af0956d73" status: 200 len: 964 microversion: 2.1 time: 0.363603 Nov 02 13:31:36.855751 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2225/4105] 10.222.0.113 () {58 vars in 1214 bytes} [Wed Nov 2 13:31:36 2022] GET /compute/v2.1/images?server=f903fade-568a-4ab8-921c-4d0af0956d73 => generated 964 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:36.881292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:36.883250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:36.923574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:36.932834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:36.933561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:36.937316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:36.941391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:36.948988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:37.046664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 HTTP/1.1 Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '265a2907-ff73-412a-ae89-aaafbddd4781'} Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:37.062243 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:37.068190 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:37.076213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:37.077426 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68ea81e8-f0ed-41b4-8cbf-75dcf896e3f9 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 404 len: 111 microversion: 2.1 time: 0.216517 Nov 02 13:31:37.084484 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2226/4106] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:31:36 2022] DELETE /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:37.134138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:37.139215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:37.185755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:37.189816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:37.198600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:37.199972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:37.210945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:37.212908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:37.333749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:38.372687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:38.381365 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1a6031e-8405-4518-883e-effd936b826c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 1.295582 Nov 02 13:31:38.381964 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2227/4107] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:37 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:38.402005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-aa7b4267-6921-4358-9c80-0351862d55cd req-ec57bdd2-f88b-45cb-b641-692b00c2efe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f596fd2-1baa-4da3-a6fb-cd1a070fe257", "tag": "3549cdb8-a8f2-40ce-99d6-0f91c1b1f979"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:38.447167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-aa7b4267-6921-4358-9c80-0351862d55cd req-ec57bdd2-f88b-45cb-b641-692b00c2efe1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:38.447671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-aa7b4267-6921-4358-9c80-0351862d55cd req-ec57bdd2-f88b-45cb-b641-692b00c2efe1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:38.448112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-aa7b4267-6921-4358-9c80-0351862d55cd req-ec57bdd2-f88b-45cb-b641-692b00c2efe1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:38.491991 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-aa7b4267-6921-4358-9c80-0351862d55cd req-ec57bdd2-f88b-45cb-b641-692b00c2efe1 service nova] Creating event network-changed:3549cdb8-a8f2-40ce-99d6-0f91c1b1f979 for instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 on n-h1-858384-19 Nov 02 13:31:38.517377 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-aa7b4267-6921-4358-9c80-0351862d55cd req-ec57bdd2-f88b-45cb-b641-692b00c2efe1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134063 Nov 02 13:31:38.537961 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2228/4108] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:38.592961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1eca0d39-d5d5-4fba-b9d9-d7ca519ce9e9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7863234c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:38.745271 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1eca0d39-d5d5-4fba-b9d9-d7ca519ce9e9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.113%2Fcompute%2Fv2.1%2Fservers%2F31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 486 microversion: 2.1 time: 0.204154 Nov 02 13:31:38.753868 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2229/4109] 10.222.0.113 () {58 vars in 1324 bytes} [Wed Nov 2 13:31:38 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.113%2Fcompute%2Fv2.1%2Fservers%2F31c41302-b126-4b93-957b-bb4f86c2e292 => generated 486 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:38.766108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:38.788773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 265a2907-ff73-412a-ae89-aaafbddd4781] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:38.798816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:38.799607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:38.800277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:38.801256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:38.801953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:38.802637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:38.819380 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 HTTP/1.1 Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '265a2907-ff73-412a-ae89-aaafbddd4781'} Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:38.821965 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:38.826663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:38.826663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:38.826663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:38.826663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:38.826663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:38.826663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. Nov 02 13:31:38.826663 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:38.830498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 265a2907-ff73-412a-ae89-aaafbddd4781 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:38.832138 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a7245fad-ceb3-43e7-88cd-c58396581b07 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781" status: 404 len: 111 microversion: 2.1 time: 0.076559 Nov 02 13:31:38.834578 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2230/4110] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:38 2022] GET /compute/v2.1/servers/265a2907-ff73-412a-ae89-aaafbddd4781 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:38.843071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:38.848161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:38.856542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:38.868003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:38.868963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:38.870186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:38.871236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:38.871920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:39.306830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Updating instance_info_cache with network_info: [{"id": "3549cdb8-a8f2-40ce-99d6-0f91c1b1f979", "address": "fa:16:3e:68:ce:8e", "network": {"id": "16a488c5-bc10-4fc2-8635-3fe544404977", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-191585170-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b8254a8a3abe4829941573211dc1aa74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3549cdb8-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:31:39.337014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Releasing lock "refresh_cache-0f596fd2-1baa-4da3-a6fb-cd1a070fe257" {{(pid=120929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:31:39.339371 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-144f9e02-106f-49b1-8af4-7edfade43c1c tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "POST /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257/action" status: 202 len: 0 microversion: 2.1 time: 8.583626 Nov 02 13:31:39.340811 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1881/4111] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:31:30 2022] POST /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257/action => generated 0 bytes in 8586 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:31:39.348968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fb86a9ea-de15-4a70-8727-9017e43fa22f tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78682d9d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:39.439350 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fb86a9ea-de15-4a70-8727-9017e43fa22f tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.113%2Fcompute%2Fservers%2F31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 486 microversion: 2.1 time: 0.096192 Nov 02 13:31:39.440598 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1882/4112] 10.222.0.113 () {58 vars in 1310 bytes} [Wed Nov 2 13:31:39 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.113%2Fcompute%2Fservers%2F31c41302-b126-4b93-957b-bb4f86c2e292 => generated 486 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:39.456422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:39.457481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:39.477718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:39.479974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:39.481465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:39.484787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:39.485659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:39.487144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:39.541165 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 HTTP/1.1 Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7de59311-9e6e-4ca3-9c85-58f04c65a5e1'} Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:39.553148 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:39.558105 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f3034580-4862-48a5-8955-3010991e41ee tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 404 len: 111 microversion: 2.1 time: 0.113239 Nov 02 13:31:39.571291 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1883/4113] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:31:39 2022] DELETE /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:39.579512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:39.580022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:39.625134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:39.625707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:39.626168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:39.626926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:39.627424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:39.627857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:39.759175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:31:40.049589 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f22ad598-3dca-48fb-874d-d08b813010a3 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 204 len: 0 microversion: 2.1 time: 0.476324 Nov 02 13:31:40.056265 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1884/4114] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:31:39 2022] DELETE /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:31:40.064300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:40.065487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:40.083929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:40.084493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:40.084954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:40.089528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:40.090078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:40.090672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:40.205056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:40.216403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:40.217929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:40.229908 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88d4bf78-af52-4f1f-a5cd-94a7ed885243 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1802 microversion: 2.32 time: 1.393860 Nov 02 13:31:40.232740 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2231/4115] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:38 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1802 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:40.255178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-40356e54-2d93-4238-9aea-7fdf284b36b0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786c78310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:40.564099 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-40356e54-2d93-4238-9aea-7fdf284b36b0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3302 microversion: 2.1 time: 0.329928 Nov 02 13:31:40.589382 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2232/4116] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:31:40 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3302 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:40.597856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:40.598912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] [instance: 7de59311-9e6e-4ca3-9c85-58f04c65a5e1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:40.631657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:40.632178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:40.632898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:40.633854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:40.634333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:40.637107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:40.690693 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] HTTP exception thrown: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Request method failure captured: Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 HTTP/1.1 Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm_ee53ZidEo3X6Fa3n-lw5baayp08GHQFzr6KS8uownYUY_lc1r1JawwnxZOw0orDm_QXi9mSUngk7rkkk8Xw46CbmkmltG-YMz3Kw2jNjCMQaqf2b_eizijGDzs7_rnqnjtVCepyfuGzlYJdJmvmb0phf1kalCWDYf2ndEy4wEjCM Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5fddc748dcdb4ceeb421a758b753b756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 5fddc748dcdb4ceeb421a758b753b756 Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-904803922 Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4228809f65b74c90b1d34cecc1b4d30e Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-904803922-project Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7de59311-9e6e-4ca3-9c85-58f04c65a5e1'} Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:31:40.697752 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:40.703208 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:31:40.703208 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:31:40.703208 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:31:40.703208 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:31:40.703208 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:31:40.703208 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. Nov 02 13:31:40.703208 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:31:40.711154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] Returning 404 to user: Instance 7de59311-9e6e-4ca3-9c85-58f04c65a5e1 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:31:40.712367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-49413c7c-52e2-4384-b8ae-b5d8a9b1d038 tempest-DeleteServersTestJSON-904803922 tempest-DeleteServersTestJSON-904803922-project] 10.222.0.113 "GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1" status: 404 len: 111 microversion: 2.1 time: 0.118499 Nov 02 13:31:40.712956 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2233/4117] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:40 2022] GET /compute/v2.1/servers/7de59311-9e6e-4ca3-9c85-58f04c65a5e1 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:31:40.732399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.107"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:40.742338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:40.778069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:40.778582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:40.779036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:40.779795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:40.780256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:40.780693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:40.828365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:40.839090 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ec8e90b-304c-49cd-a14b-6c7e7c415170 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 0.786856 Nov 02 13:31:40.849808 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1885/4118] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:40 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:40.857345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60b7b48d-cd12-4033-979c-52b71d804a81 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786d6d160>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:40.868681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "refresh_cache-47463cd7-babe-480b-b99c-6a8fdbb3e278" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:31:40.869226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquired lock "refresh_cache-47463cd7-babe-480b-b99c-6a8fdbb3e278" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:31:40.978701 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60b7b48d-cd12-4033-979c-52b71d804a81 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1438 microversion: 2.1 time: 0.127387 Nov 02 13:31:40.995462 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1886/4119] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:31:40 2022] GET /compute/v2.1/images?type=snapshot => generated 1438 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:41.011043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72f79b81-bde8-447f-943a-ac979e8fa988 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787060550>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:41.172494 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-72f79b81-bde8-447f-943a-ac979e8fa988 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images?limit=1" status: 200 len: 626 microversion: 2.1 time: 0.166892 Nov 02 13:31:41.174068 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1887/4120] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:31:41 2022] GET /compute/v2.1/images?limit=1 => generated 626 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:41.196033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fa44ef43-98fd-4618-926c-4a6762639681 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786d6d040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:41.372720 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fa44ef43-98fd-4618-926c-4a6762639681 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/detail?changes-since=2022-11-02T13%3A28%3A39Z" status: 200 len: 6352 microversion: 2.1 time: 0.181554 Nov 02 13:31:41.399298 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1888/4121] 10.222.0.113 () {58 vars in 1225 bytes} [Wed Nov 2 13:31:41 2022] GET /compute/v2.1/images/detail?changes-since=2022-11-02T13%3A28%3A39Z => generated 6352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:41.425993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:41.436266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:41.469356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:41.469968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:41.470490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:41.471333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:41.474301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:41.474860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:42.176104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:42.192217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:42.193772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:42.195177 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4aaf383f-17e6-4bc6-8947-e09c26b2b513 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1848 microversion: 2.32 time: 0.775609 Nov 02 13:31:42.203129 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1889/4122] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:41 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1848 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:42.207946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad7b42b8-a20e-41f2-94b1-3976167ba875 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78686fe50>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:42.291061 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad7b42b8-a20e-41f2-94b1-3976167ba875 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1722788196" status: 200 len: 668 microversion: 2.1 time: 0.086602 Nov 02 13:31:42.292266 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1890/4123] 10.222.0.113 () {58 vars in 1257 bytes} [Wed Nov 2 13:31:42 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1722788196 => generated 668 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:42.298694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:42.305033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:42.327859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:42.328669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:42.329296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:42.330222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:42.330853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:42.331486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:43.247871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:43.264835 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-394cfa0d-4855-4bcb-aaae-b1fddca9eec5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 0.971306 Nov 02 13:31:43.265726 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1891/4124] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:42 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:43.271947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-23c90230-faa4-4e8b-b1b5-74abb66446c0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787e85430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:43.371897 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-23c90230-faa4-4e8b-b1b5-74abb66446c0 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.113%2Fcompute%2Fv2.1%2Fservers%2F31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1468 microversion: 2.1 time: 0.102713 Nov 02 13:31:43.372523 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1892/4125] 10.222.0.113 () {58 vars in 1345 bytes} [Wed Nov 2 13:31:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.113%2Fcompute%2Fv2.1%2Fservers%2F31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1468 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:43.396819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:43.405478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:43.418782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:43.423849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:43.424925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:43.425863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:43.426551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:43.427203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:44.661091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:44.695441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:44.698353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:44.700140 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-92ce0281-87c4-4782-b8bb-6a1bdeb34542 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1848 microversion: 2.32 time: 1.315953 Nov 02 13:31:44.701988 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1893/4126] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:43 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1848 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:44.708528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f096d8f-f4d8-4faa-91d4-e21fa98939ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78682daf0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:44.793777 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f096d8f-f4d8-4faa-91d4-e21fa98939ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.113%2Fcompute%2Fservers%2F31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1468 microversion: 2.1 time: 0.090420 Nov 02 13:31:44.794733 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1894/4127] 10.222.0.113 () {58 vars in 1331 bytes} [Wed Nov 2 13:31:44 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.113%2Fcompute%2Fservers%2F31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1468 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:44.818566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:44.823800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:44.851709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:44.853563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:44.854064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:44.858736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:44.859778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:44.860240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:45.786481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:45.806087 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-84008405-06a5-4246-95a4-70475cc7cabc tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 0.999086 Nov 02 13:31:45.806844 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1895/4128] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:44 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:45.812011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-02e27744-4dca-4871-86a4-629da6f5ae7d req-b98397b3-840f-4c72-be9a-28efb6d4fd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f596fd2-1baa-4da3-a6fb-cd1a070fe257", "name": "network-vif-deleted", "tag": "3549cdb8-a8f2-40ce-99d6-0f91c1b1f979"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:45.838801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-02e27744-4dca-4871-86a4-629da6f5ae7d req-b98397b3-840f-4c72-be9a-28efb6d4fd6a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:45.840013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-02e27744-4dca-4871-86a4-629da6f5ae7d req-b98397b3-840f-4c72-be9a-28efb6d4fd6a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:45.843954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-02e27744-4dca-4871-86a4-629da6f5ae7d req-b98397b3-840f-4c72-be9a-28efb6d4fd6a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:45.868051 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-02e27744-4dca-4871-86a4-629da6f5ae7d req-b98397b3-840f-4c72-be9a-28efb6d4fd6a service nova] Creating event network-vif-deleted:3549cdb8-a8f2-40ce-99d6-0f91c1b1f979 for instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 on n-h1-858384-19 Nov 02 13:31:45.882908 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-02e27744-4dca-4871-86a4-629da6f5ae7d req-b98397b3-840f-4c72-be9a-28efb6d4fd6a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071130 Nov 02 13:31:45.883779 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1896/4129] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:45.899678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a83a3342-413b-4540-aa94-2264f89ab79b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786d6d5e0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:46.148689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Building network info cache for instance {{(pid=120928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:31:46.197687 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a83a3342-413b-4540-aa94-2264f89ab79b tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7130 microversion: 2.1 time: 0.306945 Nov 02 13:31:46.201764 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1897/4130] 10.222.0.113 () {58 vars in 1175 bytes} [Wed Nov 2 13:31:45 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7130 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:46.220039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:46.220924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:46.249792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:46.250289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:46.250734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:46.251477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:46.251933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:46.252362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:48.486915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Updating instance_info_cache with network_info: [{"id": "0371c62f-95e5-471c-9c06-cd18325aba3f", "address": "fa:16:3e:93:18:68", "network": {"id": "16a488c5-bc10-4fc2-8635-3fe544404977", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-191585170-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b8254a8a3abe4829941573211dc1aa74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0371c62f-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:31:48.509255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:48.511144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Releasing lock "refresh_cache-47463cd7-babe-480b-b99c-6a8fdbb3e278" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:31:48.512093 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-832e76a6-6f30-4197-ae66-f44d1125b4cb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "POST /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278/action" status: 202 len: 0 microversion: 2.1 time: 7.792187 Nov 02 13:31:48.515396 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2234/4131] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:31:40 2022] POST /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278/action => generated 0 bytes in 7796 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:31:48.546463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f6086606-7b87-4392-87e3-da29739e2d07 req-cfcbf4b1-27f4-49c0-9a8e-a3d0fcb8c03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47463cd7-babe-480b-b99c-6a8fdbb3e278", "tag": "0371c62f-95e5-471c-9c06-cd18325aba3f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:48.552957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:48.566806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:48.579955 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9500584a-373b-49b8-a430-384d930af78b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1848 microversion: 2.32 time: 2.377002 Nov 02 13:31:48.580562 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1898/4132] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:46 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1848 bytes in 2378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:48.589524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f6086606-7b87-4392-87e3-da29739e2d07 req-cfcbf4b1-27f4-49c0-9a8e-a3d0fcb8c03c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:48.590933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f6086606-7b87-4392-87e3-da29739e2d07 req-cfcbf4b1-27f4-49c0-9a8e-a3d0fcb8c03c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:48.594958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f6086606-7b87-4392-87e3-da29739e2d07 req-cfcbf4b1-27f4-49c0-9a8e-a3d0fcb8c03c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:48.626666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd1eabe8-c87d-4a43-b12b-8232eee4ab80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f83c3a0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:48.634300 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f6086606-7b87-4392-87e3-da29739e2d07 req-cfcbf4b1-27f4-49c0-9a8e-a3d0fcb8c03c service nova] Creating event network-changed:0371c62f-95e5-471c-9c06-cd18325aba3f for instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 on n-h1-858384-19 Nov 02 13:31:48.657060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f6086606-7b87-4392-87e3-da29739e2d07 req-cfcbf4b1-27f4-49c0-9a8e-a3d0fcb8c03c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138589 Nov 02 13:31:48.659975 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2235/4133] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:48.679421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:48.680604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:48.704003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:48.704586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:48.705261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:48.706324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:48.708229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:48.708690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:48.861640 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd1eabe8-c87d-4a43-b12b-8232eee4ab80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4384 microversion: 2.1 time: 0.254624 Nov 02 13:31:48.878158 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1899/4134] 10.222.0.113 () {58 vars in 1175 bytes} [Wed Nov 2 13:31:48 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4384 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:48.888717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c87a5b61-188d-4995-b297-7baa250809b4 req-9ff76f63-5e2f-44df-acf4-edafdef4bc8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "tag": "2ff943a8-9281-45f9-9a6c-37130580d8a5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:48.909483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:48.926754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c87a5b61-188d-4995-b297-7baa250809b4 req-9ff76f63-5e2f-44df-acf4-edafdef4bc8a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:48.928621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c87a5b61-188d-4995-b297-7baa250809b4 req-9ff76f63-5e2f-44df-acf4-edafdef4bc8a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:48.931251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c87a5b61-188d-4995-b297-7baa250809b4 req-9ff76f63-5e2f-44df-acf4-edafdef4bc8a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:48.960733 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c87a5b61-188d-4995-b297-7baa250809b4 req-9ff76f63-5e2f-44df-acf4-edafdef4bc8a service nova] Creating event network-changed:2ff943a8-9281-45f9-9a6c-37130580d8a5 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:31:48.975477 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c87a5b61-188d-4995-b297-7baa250809b4 req-9ff76f63-5e2f-44df-acf4-edafdef4bc8a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095476 Nov 02 13:31:48.979083 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1900/4135] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:48.987398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-656fdb94-90ae-49b4-96da-4477b647ad50 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '.version_select at 0x7fe7868c6700>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:50.493678 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-656fdb94-90ae-49b4-96da-4477b647ad50 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/os-floating-ips/021e27e5-4d9f-480c-950c-33d8f401361a" status: 200 len: 185 microversion: 2.1 time: 1.510539 Nov 02 13:31:50.495027 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1901/4136] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 13:31:48 2022] GET /compute/v2.1/os-floating-ips/021e27e5-4d9f-480c-950c-33d8f401361a => generated 185 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:50.500079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74d8d0b8-b8df-440c-b489-93e530b5acb5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78703eb80>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:50.604290 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74d8d0b8-b8df-440c-b489-93e530b5acb5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/c691e80e-3ff7-4224-8e34-80d276ecc1b1" status: 200 len: 787 microversion: 2.1 time: 0.107951 Nov 02 13:31:50.607222 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1902/4137] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:31:50 2022] GET /compute/v2.1/images/c691e80e-3ff7-4224-8e34-80d276ecc1b1 => generated 787 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:50.622272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:50.623519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:50.635698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:50.642731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:50.643550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:50.645114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:50.648238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:50.648715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:51.004361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:51.023346 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-40e4f473-dd3f-478c-a39d-fa5dc79a2a63 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 2.361336 Nov 02 13:31:51.027634 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2236/4138] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:48 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:51.033427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Action: 'action', calling method: .version_select at 0x7fe78dc553a0>, body: {"removeFloatingIp": {"address": "172.25.1.107"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:51.643480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:51.659982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:51.676005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:51.680001 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7188f428-89e6-4df3-ab86-cb2351dbe8b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1869 microversion: 2.32 time: 1.070655 Nov 02 13:31:51.684698 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1903/4139] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:50 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1869 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:51.691091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-009b8820-e7dd-4837-907f-f4b46dcfff4a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786906550>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:51.784524 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-009b8820-e7dd-4837-907f-f4b46dcfff4a tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1615 microversion: 2.1 time: 0.096757 Nov 02 13:31:51.785597 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1904/4140] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:31:51 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:51.816050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-387e0187-57c6-45fc-a155-906198140219 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe7868a2790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:51.990793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:52.001060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:52.002346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:52.004282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:52.009041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:52.010563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:52.015791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:53.625854 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-387e0187-57c6-45fc-a155-906198140219 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "DELETE /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b" status: 204 len: 0 microversion: 2.1 time: 1.825570 Nov 02 13:31:53.629418 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1905/4141] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:51 2022] DELETE /compute/v2.1/images/5d436c4e-684e-4098-8ad4-bfc6a922821b => generated 0 bytes in 1828 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:31:53.633101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-75d459db-6f40-454e-8da2-79dad555531a req-16631695-66ed-4877-9f41-a8c82431cddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "tag": "a59140df-02b2-48d4-9f91-b051ae369f57"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:53.660569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-75d459db-6f40-454e-8da2-79dad555531a req-16631695-66ed-4877-9f41-a8c82431cddc service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:53.662175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-75d459db-6f40-454e-8da2-79dad555531a req-16631695-66ed-4877-9f41-a8c82431cddc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:53.665090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-75d459db-6f40-454e-8da2-79dad555531a req-16631695-66ed-4877-9f41-a8c82431cddc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:53.699099 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-75d459db-6f40-454e-8da2-79dad555531a req-16631695-66ed-4877-9f41-a8c82431cddc service nova] Creating event network-changed:a59140df-02b2-48d4-9f91-b051ae369f57 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:31:53.715868 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-75d459db-6f40-454e-8da2-79dad555531a req-16631695-66ed-4877-9f41-a8c82431cddc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084715 Nov 02 13:31:53.719668 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1906/4142] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:53.737410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:53.738413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:53.774242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:53.778103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:53.778834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:53.779874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:53.780514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:53.784024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:54.236016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "refresh_cache-47463cd7-babe-480b-b99c-6a8fdbb3e278" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 13:31:54.236016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquired lock "refresh_cache-47463cd7-babe-480b-b99c-6a8fdbb3e278" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 13:31:55.437388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:55.461067 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ec73657-8cd4-4b5c-aac3-0c59df02a4b7 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 1.726349 Nov 02 13:31:55.461801 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1907/4143] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:53 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:55.485313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:55.492388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:55.504238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:55.507551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:55.508330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:55.516236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:55.517123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:55.517740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:56.307197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:56.317120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:56.318567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:56.326305 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-19234f19-c212-412b-855f-73185c271fce tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1890 microversion: 2.32 time: 0.849171 Nov 02 13:31:56.328273 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1908/4144] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:55 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1890 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:31:56.343782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ad30c9a-10e0-45ac-966e-4e87c6fb7e55 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe786906670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:57.742189 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ad30c9a-10e0-45ac-966e-4e87c6fb7e55 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "DELETE /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b" status: 204 len: 0 microversion: 2.1 time: 1.410142 Nov 02 13:31:57.746231 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1909/4145] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:56 2022] DELETE /compute/v2.1/images/a848f05f-d70b-4d76-b59b-53c1c37f351b => generated 0 bytes in 1414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:31:57.751340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:57.752233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:57.770828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:57.772195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:57.773434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:57.774595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:57.775281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:57.775889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:57.786605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:31:58.251246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Building network info cache for instance {{(pid=120928) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 02 13:31:59.036841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:31:59.056223 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ecd81f09-6b03-4ba5-9b62-0dc5d5c7e21d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1510 microversion: 2.1 time: 1.308766 Nov 02 13:31:59.057133 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1910/4146] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:31:57 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1510 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:31:59.077577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5bc015a9-86ed-4343-9e26-4ea0330401fa req-c790de1d-ebbf-4f68-9a50-0a6dc05c063e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "tag": "7a0e3e23-49a6-431b-bfe5-ae6397b899d3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:31:59.103714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5bc015a9-86ed-4343-9e26-4ea0330401fa req-c790de1d-ebbf-4f68-9a50-0a6dc05c063e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:59.104266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5bc015a9-86ed-4343-9e26-4ea0330401fa req-c790de1d-ebbf-4f68-9a50-0a6dc05c063e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:59.104932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5bc015a9-86ed-4343-9e26-4ea0330401fa req-c790de1d-ebbf-4f68-9a50-0a6dc05c063e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:59.123822 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5bc015a9-86ed-4343-9e26-4ea0330401fa req-c790de1d-ebbf-4f68-9a50-0a6dc05c063e service nova] Creating event network-changed:7a0e3e23-49a6-431b-bfe5-ae6397b899d3 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:31:59.153711 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5bc015a9-86ed-4343-9e26-4ea0330401fa req-c790de1d-ebbf-4f68-9a50-0a6dc05c063e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079286 Nov 02 13:31:59.155305 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1911/4147] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:31:59.169078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:31:59.170103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:31:59.218575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:59.219513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:59.220248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:31:59.221193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:31:59.222037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:31:59.223991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:00.195060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:00.212363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:00.218211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:00.223860 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ea431e8-e237-4c7f-a371-6fd964722bbd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 1.059938 Nov 02 13:32:00.224530 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1912/4148] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:31:59 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:00.245564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e9a846bc-2a53-4cd3-9c9e-1fd907dd3da5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78682dc10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:01.055494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Updating instance_info_cache with network_info: [{"id": "0371c62f-95e5-471c-9c06-cd18325aba3f", "address": "fa:16:3e:93:18:68", "network": {"id": "16a488c5-bc10-4fc2-8635-3fe544404977", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-191585170-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b8254a8a3abe4829941573211dc1aa74", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0371c62f-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120928) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:32:01.088719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Releasing lock "refresh_cache-47463cd7-babe-480b-b99c-6a8fdbb3e278" {{(pid=120928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 13:32:01.089675 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1bbe9e86-6f90-4a8c-b916-8e2652905823 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "POST /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278/action" status: 202 len: 0 microversion: 2.1 time: 10.060483 Nov 02 13:32:01.091141 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2237/4149] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:31:51 2022] POST /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278/action => generated 0 bytes in 10062 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 02 13:32:01.102915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-2b9534c4-7210-4ebf-a9fd-3fee825eb0a0 req-d341beed-6f85-4823-bc6b-dd71ac5ecd22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47463cd7-babe-480b-b99c-6a8fdbb3e278", "tag": "0371c62f-95e5-471c-9c06-cd18325aba3f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:01.134203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=33 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:01.139296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2b9534c4-7210-4ebf-a9fd-3fee825eb0a0 req-d341beed-6f85-4823-bc6b-dd71ac5ecd22 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:01.141340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2b9534c4-7210-4ebf-a9fd-3fee825eb0a0 req-d341beed-6f85-4823-bc6b-dd71ac5ecd22 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:01.141841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2b9534c4-7210-4ebf-a9fd-3fee825eb0a0 req-d341beed-6f85-4823-bc6b-dd71ac5ecd22 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:01.176990 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-2b9534c4-7210-4ebf-a9fd-3fee825eb0a0 req-d341beed-6f85-4823-bc6b-dd71ac5ecd22 service nova] Creating event network-changed:0371c62f-95e5-471c-9c06-cd18325aba3f for instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 on n-h1-858384-19 Nov 02 13:32:01.193310 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-2b9534c4-7210-4ebf-a9fd-3fee825eb0a0 req-d341beed-6f85-4823-bc6b-dd71ac5ecd22 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099258 Nov 02 13:32:01.196638 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2238/4150] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:01.210781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:01.211910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:01.229904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:01.230887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:01.233332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:01.235944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:01.236590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:01.243904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:01.976884 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e9a846bc-2a53-4cd3-9c9e-1fd907dd3da5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "DELETE /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a" status: 204 len: 0 microversion: 2.1 time: 1.750481 Nov 02 13:32:01.977383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:01.977698 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1913/4151] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:00 2022] DELETE /compute/v2.1/images/58ca0a11-605b-4924-87a3-768fcb333a9a => generated 0 bytes in 1753 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:01.983421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-64a10589-1ea6-4585-a712-97a8a429364a req-07ee00a3-fcaf-42aa-b885-6f51f79e608a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e57c4d-4569-49a6-a42a-493bb7904624", "name": "network-vif-unplugged", "status": "completed", "tag": "1b493f0a-2ada-4730-97e9-2afd52152e70"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:01.988549 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-81ce085f-0299-4ac8-9e5c-6825c4728d6e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 200 len: 1513 microversion: 2.1 time: 0.790585 Nov 02 13:32:01.989800 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2239/4152] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:01 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 1513 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:02.014334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-64a10589-1ea6-4585-a712-97a8a429364a req-07ee00a3-fcaf-42aa-b885-6f51f79e608a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.014933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-64a10589-1ea6-4585-a712-97a8a429364a req-07ee00a3-fcaf-42aa-b885-6f51f79e608a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.018640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-64a10589-1ea6-4585-a712-97a8a429364a req-07ee00a3-fcaf-42aa-b885-6f51f79e608a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.026301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:02.027862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:02.041986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.042835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.044487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.046142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.046936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.047961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.048418 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-64a10589-1ea6-4585-a712-97a8a429364a req-07ee00a3-fcaf-42aa-b885-6f51f79e608a service nova] Creating event network-vif-unplugged:1b493f0a-2ada-4730-97e9-2afd52152e70 for instance 36e57c4d-4569-49a6-a42a-493bb7904624 on n-h2-858384-19 Nov 02 13:32:02.059782 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-64a10589-1ea6-4585-a712-97a8a429364a req-07ee00a3-fcaf-42aa-b885-6f51f79e608a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080744 Nov 02 13:32:02.063404 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1914/4153] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:02.075422 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] HTTP exception thrown: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Request method failure captured: Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 HTTP/1.1 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnDilobPrkpBLGVZ1Q27FI60ClzpQg3dO-O2aELtfLQKNOQTzeEOu50biUC_JZ0HSk0Zdl_XB7yjpOQ0E-B4htAcI8eo2uH2CNEZzGLbuceq27cUsVmuAxRtBVlAHvrrEjMW0SqnWcbOQ24eiRg2Hkiqdj09Dp5uRTMfitJ6Wmd_ojw Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b8254a8a3abe4829941573211dc1aa74 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b8254a8a3abe4829941573211dc1aa74 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FloatingIPsAssociationTestJSON-1995900720-project Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 318964014c11438c9316b35382a49ed9 Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1995900720-project Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0f596fd2-1baa-4da3-a6fb-cd1a070fe257'} Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:02.078085 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Returning 404 to user: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-64e06798-7cf5-4774-9443-22a5dc60d096 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 404 len: 111 microversion: 2.1 time: 0.090679 Nov 02 13:32:02.084108 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2240/4154] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:01 2022] DELETE /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:02.091650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:02.092688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:02.101216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6ba31f2f-c332-44f9-a286-6477d528e149 req-6d66dfbb-d4f0-4c99-b3ed-12fa6b926cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "tag": "bae0f565-113c-46c6-8652-ba244ff3de95"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:02.104402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.105174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.106806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.108289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.115076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.116489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.123693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6ba31f2f-c332-44f9-a286-6477d528e149 req-6d66dfbb-d4f0-4c99-b3ed-12fa6b926cc2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.125138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6ba31f2f-c332-44f9-a286-6477d528e149 req-6d66dfbb-d4f0-4c99-b3ed-12fa6b926cc2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.125138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6ba31f2f-c332-44f9-a286-6477d528e149 req-6d66dfbb-d4f0-4c99-b3ed-12fa6b926cc2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.144763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6ba31f2f-c332-44f9-a286-6477d528e149 req-6d66dfbb-d4f0-4c99-b3ed-12fa6b926cc2 service nova] Creating event network-changed:bae0f565-113c-46c6-8652-ba244ff3de95 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:32:02.151266 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6ba31f2f-c332-44f9-a286-6477d528e149 req-6d66dfbb-d4f0-4c99-b3ed-12fa6b926cc2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085763 Nov 02 13:32:02.152967 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1915/4155] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:02.158462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:02.159048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:02.206163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.209035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.210266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.213500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.219810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.220920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.270016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:02.419172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a9e5f9c-4546-4baf-a0da-e737b798841c tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "DELETE /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 204 len: 0 microversion: 2.1 time: 0.264498 Nov 02 13:32:02.423274 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1916/4156] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:02 2022] DELETE /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:02.437119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:02.438020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:02.447746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.449011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.449912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.450743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.452217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.452818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.706772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:02.721687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:02.723212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:02.724563 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-527178aa-4100-406d-8c49-82feda4f736c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.638098 Nov 02 13:32:02.730558 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2241/4157] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:02 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:02.741731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:02.744041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 0f596fd2-1baa-4da3-a6fb-cd1a070fe257] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:02.760151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.761179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.761863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.766938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.767700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.768760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.784410 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] HTTP exception thrown: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Request method failure captured: Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 HTTP/1.1 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnDilobPrkpBLGVZ1Q27FI60ClzpQg3dO-O2aELtfLQKNOQTzeEOu50biUC_JZ0HSk0Zdl_XB7yjpOQ0E-B4htAcI8eo2uH2CNEZzGLbuceq27cUsVmuAxRtBVlAHvrrEjMW0SqnWcbOQ24eiRg2Hkiqdj09Dp5uRTMfitJ6Wmd_ojw Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b8254a8a3abe4829941573211dc1aa74 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b8254a8a3abe4829941573211dc1aa74 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FloatingIPsAssociationTestJSON-1995900720-project Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 318964014c11438c9316b35382a49ed9 Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1995900720-project Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0f596fd2-1baa-4da3-a6fb-cd1a070fe257'} Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.786572 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Returning 404 to user: Instance 0f596fd2-1baa-4da3-a6fb-cd1a070fe257 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1ee730c8-970d-420f-ad80-a02fe20a0060 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257" status: 404 len: 111 microversion: 2.1 time: 0.056267 Nov 02 13:32:02.791183 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2242/4158] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:02 2022] GET /compute/v2.1/servers/0f596fd2-1baa-4da3-a6fb-cd1a070fe257 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:02.793940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:02.794799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:02.801546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.802160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.802694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:02.803618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:02.804209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:02.804704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:03.019443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:03.028323 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f51cad3-bf38-4450-89cd-55343bd27397 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1477 microversion: 2.1 time: 0.238646 Nov 02 13:32:03.044159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:03.045313 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2243/4159] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:02 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:03.055824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-70e70fdc-0a8d-4138-b739-9355c94dbfae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '.version_select at 0x7fe786314280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:03.057851 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2fd9a0b5-4b07-468d-8efd-85444ab8979e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.633207 Nov 02 13:32:03.058603 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1917/4160] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:02 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:03.091684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:03.092221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:03.098587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:03.099355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:03.100030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:03.101583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:03.102404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:03.103340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:03.449522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:03.461164 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a979895-d4fc-4d10-9bcf-b5ce097c5541 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.373661 Nov 02 13:32:03.462383 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1918/4161] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:03 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:03.487289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:03.488323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:03.502068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:03.503576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:03.504244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:03.505505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:03.506210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:03.507751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:03.714292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:03.723588 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4fa73cba-b6d8-42a7-a38b-1f2f6a890e1a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.240482 Nov 02 13:32:03.735140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1919/4162] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:03 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:03.748782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:03.750458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:03.760885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:03.761530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:03.762200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:03.763169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:03.763795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:03.764425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.021478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:04.034244 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-98a0cc43-8374-45fe-a939-36a76766319d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.289574 Nov 02 13:32:04.049418 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1920/4163] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:03 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:04.049418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:04.049418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:04.080847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.083609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.084094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.084994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.090029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.090549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.381288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:04.394649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:04.397989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:04.403018 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c0f7648-b422-45b6-8b9b-24f0feb75634 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.365088 Nov 02 13:32:04.416117 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1921/4164] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:04 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:04.429245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:04.434150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:04.441611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.442093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.442527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.443300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.443764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.444902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.673962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:04.684414 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec93addc-8975-4acf-af34-a13344fc9843 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1477 microversion: 2.1 time: 0.259885 Nov 02 13:32:04.688497 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1922/4165] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:04 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1477 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:04.711010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4bfe635-2617-4e36-a738-109fd53b5a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:04.728791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4bfe635-2617-4e36-a738-109fd53b5a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.729306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4bfe635-2617-4e36-a738-109fd53b5a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.729744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4bfe635-2617-4e36-a738-109fd53b5a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.782744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4bfe635-2617-4e36-a738-109fd53b5a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Going to try to stop instance {{(pid=120929) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:32:04.876045 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4bfe635-2617-4e36-a738-109fd53b5a58 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.170254 Nov 02 13:32:04.877065 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1923/4166] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:32:04 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:04.886430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a9d5360c-0a7f-4caf-a78e-c782def58bb9 req-f2a79f47-0659-408c-abe2-beb5df4fdfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "tag": "f973e9e0-60ad-4e52-aef0-171fdb0226e1"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:04.901446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a9d5360c-0a7f-4caf-a78e-c782def58bb9 req-f2a79f47-0659-408c-abe2-beb5df4fdfa8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.903643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a9d5360c-0a7f-4caf-a78e-c782def58bb9 req-f2a79f47-0659-408c-abe2-beb5df4fdfa8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.904894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a9d5360c-0a7f-4caf-a78e-c782def58bb9 req-f2a79f47-0659-408c-abe2-beb5df4fdfa8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.920087 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a9d5360c-0a7f-4caf-a78e-c782def58bb9 req-f2a79f47-0659-408c-abe2-beb5df4fdfa8 service nova] Creating event network-changed:f973e9e0-60ad-4e52-aef0-171fdb0226e1 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:32:04.929909 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a9d5360c-0a7f-4caf-a78e-c782def58bb9 req-f2a79f47-0659-408c-abe2-beb5df4fdfa8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050029 Nov 02 13:32:04.931761 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1924/4167] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:04.941912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:04.942861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:04.952098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.953051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.953768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:04.954714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:04.955452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:04.956102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:05.295392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:05.312469 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b4760fa8-3f05-47bc-b504-36c51de8965c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.376637 Nov 02 13:32:05.313992 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1925/4168] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:04 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:05.443199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:05.445572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:05.463743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:05.467151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:05.467627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:05.468385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:05.468871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:05.469313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:05.841132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:05.867884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:05.870093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:05.871345 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e15acd31-0592-41a1-a269-ad78fd1c84f5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.433491 Nov 02 13:32:05.872247 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1926/4169] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:05 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:05.888396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:05.889419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:05.896550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:05.898551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:05.899091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:05.900230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:05.900794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:05.901302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:06.150480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:06.156884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:06.159245 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a085d961-e661-4df5-90f0-0a897b997820 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 200 len: 1477 microversion: 2.1 time: 0.285431 Nov 02 13:32:06.159788 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1927/4170] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:05 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:06.341335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:06.342858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:06.356690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:06.357191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:06.357643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:06.358375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:06.358837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:06.359390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:06.488769 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-70e70fdc-0a8d-4138-b739-9355c94dbfae tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "DELETE /compute/v2.1/os-floating-ips/021e27e5-4d9f-480c-950c-33d8f401361a" status: 202 len: 0 microversion: 2.1 time: 3.438802 Nov 02 13:32:06.502904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2244/4171] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:32:03 2022] DELETE /compute/v2.1/os-floating-ips/021e27e5-4d9f-480c-950c-33d8f401361a => generated 0 bytes in 3450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:06.765703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-348968087", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "68b31622-5a44-47b7-8077-cda1837dadfb"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:06.804688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:06.824415 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-391f19ba-bc42-4301-9d9f-81b85215d61d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.487515 Nov 02 13:32:06.825558 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1928/4172] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:06 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:06.854465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:06.855360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:06.867017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:06.867758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:06.868188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:06.869045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:06.869523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:06.870167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:06.914111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] validate_networks() for [('68b31622-5a44-47b7-8077-cda1837dadfb', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:32:06.936801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:07.097319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62366e2b-6107-465e-a376-068498cd6c3b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "DELETE /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 204 len: 0 microversion: 2.1 time: 0.252710 Nov 02 13:32:07.098491 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1929/4173] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:06 2022] DELETE /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:07.111397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:07.114520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:07.132996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:07.133506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:07.133954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:07.134677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:07.140651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:07.141370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:08.217046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:32:08.217567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:32:08.217933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:32:08.218612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:32:08.219224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:32:08.235074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:08.237983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:08.248760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:08.249623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:08.250100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:08.250540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:08.284283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=66,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:08.344759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Getting quotas for project e50122d42b3e420ebf65f2a8d16b2da8. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:08.362293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Getting quotas for user b6eba5b1172f4e2791e039d18904ed58 and project e50122d42b3e420ebf65f2a8d16b2da8. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:08.408487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Going to run 3 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:32:08.418394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:32:08.491767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: bd91b461-05bb-403c-b07f-181066f71ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=75714141-548d-4be5-bcdd-fc9ee050212c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:32:08.563886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=bd91b461-05bb-403c-b07f-181066f71ffe,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:32:08.732601 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce88ea9a-9091-49c9-b85e-30b5c3e497b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.234321 Nov 02 13:32:08.735922 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2245/4174] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:32:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:32:08.747566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:08.751945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:08.766174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:08.771211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:08.772752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:08.773736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:08.777822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:08.778498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.194678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:09.217431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:09.219530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:09.223336 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-96d368d3-24e4-49d2-93bd-4ffbb658534f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 2.121811 Nov 02 13:32:09.228440 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1930/4175] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:07 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:09.276520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:09.277399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: 31c41302-b126-4b93-957b-bb4f86c2e292] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:09.298227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.298872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.300527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.301302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.303250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.303759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.328928 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] HTTP exception thrown: Instance 31c41302-b126-4b93-957b-bb4f86c2e292 could not be found. Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Request method failure captured: Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 HTTP/1.1 Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnCFTYgp9DOqCF2_eU0hCgm6-vm9E18Hh3ahaU-UY2lLO56MzoSp5JIDRuCJxhQfjG8CTJYP-63anr4woFZ1gjX_1MQHGrLXKBDAFalmGVdlEYryZ5FeCucgjHrEekpzwPOBmfMY38JK1uCkyRa_AiuFZGfrpUc3UDzk7ZS-_-W2ZWU Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 7668fc27c2c847e086b43b0cbccfa7ce Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ListImageFiltersTestJSON-468829061 Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7668fc27c2c847e086b43b0cbccfa7ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7668fc27c2c847e086b43b0cbccfa7ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_7668fc27c2c847e086b43b0cbccfa7ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/7668fc27c2c847e086b43b0cbccfa7ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ListImageFiltersTestJSON-468829061 Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 7668fc27c2c847e086b43b0cbccfa7ce Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-468829061 Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ListImageFiltersTestJSON-468829061-project Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: bbef957564b8465e973d3e6fe2e74816 Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ListImageFiltersTestJSON-468829061-project Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 31c41302-b126-4b93-957b-bb4f86c2e292 could not be found. Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '31c41302-b126-4b93-957b-bb4f86c2e292'} Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c41302-b126-4b93-957b-bb4f86c2e292 could not be found. Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c41302-b126-4b93-957b-bb4f86c2e292 could not be found. Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:09.331169 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:09.338521 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:09.338521 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:09.338521 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:09.338521 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:09.338521 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:09.338521 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c41302-b126-4b93-957b-bb4f86c2e292 could not be found. Nov 02 13:32:09.338521 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:09.340880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Returning 404 to user: Instance 31c41302-b126-4b93-957b-bb4f86c2e292 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:09.342635 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e8cd21d-0bd2-416f-b0de-033f46da4af7 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292" status: 404 len: 111 microversion: 2.1 time: 0.113335 Nov 02 13:32:09.343610 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1931/4176] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:09 2022] GET /compute/v2.1/servers/31c41302-b126-4b93-957b-bb4f86c2e292 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:09.352905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-14cc5d7f-c4c3-49f5-9695-aed3dc2817f1 req-cc8e54af-3b17-4a3c-a643-a8a4fd1ecbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c41302-b126-4b93-957b-bb4f86c2e292", "name": "network-vif-deleted", "tag": "4f740d47-b052-4b9e-a6aa-c5fc11434e11"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:09.387352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-14cc5d7f-c4c3-49f5-9695-aed3dc2817f1 req-cc8e54af-3b17-4a3c-a643-a8a4fd1ecbb4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.388340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-14cc5d7f-c4c3-49f5-9695-aed3dc2817f1 req-cc8e54af-3b17-4a3c-a643-a8a4fd1ecbb4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.389031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-14cc5d7f-c4c3-49f5-9695-aed3dc2817f1 req-cc8e54af-3b17-4a3c-a643-a8a4fd1ecbb4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.434048 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-14cc5d7f-c4c3-49f5-9695-aed3dc2817f1 req-cc8e54af-3b17-4a3c-a643-a8a4fd1ecbb4 service nova] Creating event network-vif-deleted:4f740d47-b052-4b9e-a6aa-c5fc11434e11 for instance 31c41302-b126-4b93-957b-bb4f86c2e292 on n-h2-858384-19 Nov 02 13:32:09.457981 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-14cc5d7f-c4c3-49f5-9695-aed3dc2817f1 req-cc8e54af-3b17-4a3c-a643-a8a4fd1ecbb4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102105 Nov 02 13:32:09.461252 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1932/4177] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:09.478460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:09.480727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:09.514878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.518950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.519363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.520189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.520734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.521238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.555148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:09.570933 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82546711-e607-48ea-b8fd-46e2a5415946 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1530 microversion: 2.1 time: 0.833559 Nov 02 13:32:09.577005 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2246/4178] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:08 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1530 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:09.605755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:09.617849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:09.619208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Searching by: {'deleted': False, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:32:09.663170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.664243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.664990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.666004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.666669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.667318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.703957 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34fecb76-997f-49ff-9d2d-7dcdfcfdb50b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 1021 microversion: 2.1 time: 0.125113 Nov 02 13:32:09.705906 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2247/4179] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:32:09 2022] GET /compute/v2.1/servers => generated 1021 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:09.713285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:09.714817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:09.725661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.726477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.727560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.729496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:09.730376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:09.730989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:09.799829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:09.961215 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8863237a-d312-445a-bf62-de770c609e80 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73" status: 204 len: 0 microversion: 2.1 time: 0.253207 Nov 02 13:32:09.961439 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2248/4180] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:09 2022] DELETE /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:09.969826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af9255d2-6ce8-4017-b5fe-9e5496b0f988 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:09.976261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af9255d2-6ce8-4017-b5fe-9e5496b0f988 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:10.189264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af9255d2-6ce8-4017-b5fe-9e5496b0f988 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:10.237911 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af9255d2-6ce8-4017-b5fe-9e5496b0f988 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1226 microversion: 2.1 time: 0.242569 Nov 02 13:32:10.238540 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2249/4181] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:09 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1226 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:10.252198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:10.253076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:10.265241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:10.273418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:10.274241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:10.274867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:10.275909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:10.276550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:10.277643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:10.281171 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-767d7e09-39d7-4934-8e32-94dddfdfa348 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.818460 Nov 02 13:32:10.287084 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1933/4182] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:09 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:10.297660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:10.298286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:10.327494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:10.328002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:10.328544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:10.329152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:10.329613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:10.330047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:10.821276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:10.863557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:10.871250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:10.876397 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c990a82-92dd-44e9-8a45-94f43d1f7b3c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.586418 Nov 02 13:32:10.878442 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1934/4183] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:10 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:10.888631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:10.889517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:10.905751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:10.906806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:10.908285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:10.909094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:10.909563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:10.913193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:11.039590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:11.062986 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fdbb1050-fc80-4551-955a-c644b6d64c89 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73" status: 200 len: 1478 microversion: 2.1 time: 0.821080 Nov 02 13:32:11.090217 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2250/4184] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:10 2022] GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 => generated 1478 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:11.265189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:11.265945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:11.275398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:11.275888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:11.276330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:11.277045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:11.277496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:11.290839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:11.583513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:11.601161 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b440f486-6b59-4305-b35a-dc669d7d2054 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1230 microversion: 2.1 time: 0.339733 Nov 02 13:32:11.604025 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2251/4185] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:11 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1230 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:11.610560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:11.611433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:11.629807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:11.632213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:11.636637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:11.640278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:11.642789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:11.643559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:11.871287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:11.882908 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f26cb25e-6f87-4140-8983-2ac3f3b3867b tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1530 microversion: 2.1 time: 1.002305 Nov 02 13:32:11.892353 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1935/4186] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:10 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1530 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:11.917000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7367a362-f4b9-4923-be29-26ee16ce4e13 req-f243f574-66eb-4e0b-8bcd-e8eb671141cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "tag": "8e6ea7b1-cf33-429d-8374-e26f5239f9f6"}, {"name": "network-changed", "server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "tag": "2e49e2c7-c69b-46c6-87ac-2018188af28c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:11.976389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7367a362-f4b9-4923-be29-26ee16ce4e13 req-f243f574-66eb-4e0b-8bcd-e8eb671141cd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:11.976891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7367a362-f4b9-4923-be29-26ee16ce4e13 req-f243f574-66eb-4e0b-8bcd-e8eb671141cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:11.984084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7367a362-f4b9-4923-be29-26ee16ce4e13 req-f243f574-66eb-4e0b-8bcd-e8eb671141cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:12.055785 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7367a362-f4b9-4923-be29-26ee16ce4e13 req-f243f574-66eb-4e0b-8bcd-e8eb671141cd service nova] Creating event network-changed:8e6ea7b1-cf33-429d-8374-e26f5239f9f6 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:32:12.056109 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7367a362-f4b9-4923-be29-26ee16ce4e13 req-f243f574-66eb-4e0b-8bcd-e8eb671141cd service nova] Creating event network-changed:2e49e2c7-c69b-46c6-87ac-2018188af28c for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:32:12.086425 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7367a362-f4b9-4923-be29-26ee16ce4e13 req-f243f574-66eb-4e0b-8bcd-e8eb671141cd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.190524 Nov 02 13:32:12.089416 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1936/4187] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:12.114333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-93ab8975-deb5-41be-8374-5d8821356370 req-5613f7fb-2f15-4d1a-835a-b2f5276e162e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47463cd7-babe-480b-b99c-6a8fdbb3e278", "name": "network-vif-deleted", "tag": "0371c62f-95e5-471c-9c06-cd18325aba3f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:12.158913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93ab8975-deb5-41be-8374-5d8821356370 req-5613f7fb-2f15-4d1a-835a-b2f5276e162e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:12.159427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93ab8975-deb5-41be-8374-5d8821356370 req-5613f7fb-2f15-4d1a-835a-b2f5276e162e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:12.164059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93ab8975-deb5-41be-8374-5d8821356370 req-5613f7fb-2f15-4d1a-835a-b2f5276e162e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:12.199206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-93ab8975-deb5-41be-8374-5d8821356370 req-5613f7fb-2f15-4d1a-835a-b2f5276e162e service nova] Creating event network-vif-deleted:0371c62f-95e5-471c-9c06-cd18325aba3f for instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 on n-h1-858384-19 Nov 02 13:32:12.212598 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-93ab8975-deb5-41be-8374-5d8821356370 req-5613f7fb-2f15-4d1a-835a-b2f5276e162e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121608 Nov 02 13:32:12.213366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1937/4188] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:12.231041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:12.232273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:12.248269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:12.249079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:12.249762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:12.250747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:12.251834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:12.256921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:12.626613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:12.640668 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7b5907b-1520-4de4-88ce-ec97f4e42d2e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 1.033325 Nov 02 13:32:12.641947 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2252/4189] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:11 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:12.659654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:12.660293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:12.679134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:12.689107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:12.689656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:12.692429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:12.693436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:12.695722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:12.777546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:12.794775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:12.799032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:12.804237 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-26740cbb-fe36-4bae-a252-a098b5ea814b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.589366 Nov 02 13:32:12.823139 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1938/4190] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:12 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:12.841244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:12.846791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:12.858371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:12.859241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:12.859876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:12.862363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:12.863720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:12.869833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.087984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:13.102072 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d5624f9e-a6f0-4220-a4df-975789b1c6f9 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73" status: 200 len: 1478 microversion: 2.1 time: 0.457219 Nov 02 13:32:13.102593 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2253/4191] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:12 2022] GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 => generated 1478 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:13.111805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:13.128224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-08286da8-c06d-43c8-98fe-0e06bec6a0f6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1278 microversion: 2.1 time: 0.302626 Nov 02 13:32:13.130890 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1939/4192] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:12 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1278 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:13.138643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:13.143854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:13.157714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.158572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.159299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.160252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.160965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.161664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.224641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.225976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.226734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.227479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lazy-loading 'fault' on Instance uuid 47463cd7-babe-480b-b99c-6a8fdbb3e278 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:32:13.335973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318964014c11438c9316b35382a49ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8254a8a3abe4829941573211dc1aa74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:13.344294 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cebd16d8-5464-41a8-8a36-6da6af73a7e9 tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 200 len: 1318 microversion: 2.1 time: 0.214253 Nov 02 13:32:13.351965 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2254/4193] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:13 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:13.671136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:13.671823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:13.688241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.691752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.693412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.696459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.696958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.697414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.855697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:13.855697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:13.937509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.947961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.949284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:13.951308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:13.955802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:13.956517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:14.455925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:14.482131 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6aa55ad3-df96-486e-a7bb-f705f958c6b6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1683 microversion: 2.1 time: 0.812487 Nov 02 13:32:14.486939 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1940/4194] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:13 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1683 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:14.496629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:14.497664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:14.509703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:14.510455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:14.512919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:14.513720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:14.514243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:14.514688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.496092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:15.514977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:15.522852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:15.524233 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-54547b6c-7539-4d10-b1c2-4b4904f34d4c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 1.691322 Nov 02 13:32:15.531311 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2255/4195] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:13 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:15.542866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:15.552062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:15.572370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.572871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.576190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.578624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.582830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.588199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.725596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:15.737142 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-66d2bc57-924d-4156-b266-e7b5a361926a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1284 microversion: 2.1 time: 0.204460 Nov 02 13:32:15.737613 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2256/4196] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:15 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:15.750520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:15.754229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] [instance: 47463cd7-babe-480b-b99c-6a8fdbb3e278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:15.769137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.771138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.772143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.774745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.776671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.777321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.814929 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] HTTP exception thrown: Instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 could not be found. Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Request method failure captured: Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 HTTP/1.1 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnDilobPrkpBLGVZ1Q27FI60ClzpQg3dO-O2aELtfLQKNOQTzeEOu50biUC_JZ0HSk0Zdl_XB7yjpOQ0E-B4htAcI8eo2uH2CNEZzGLbuceq27cUsVmuAxRtBVlAHvrrEjMW0SqnWcbOQ24eiRg2Hkiqdj09Dp5uRTMfitJ6Wmd_ojw Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b8254a8a3abe4829941573211dc1aa74 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b8254a8a3abe4829941573211dc1aa74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b8254a8a3abe4829941573211dc1aa74 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1995900720 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-FloatingIPsAssociationTestJSON-1995900720-project Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 318964014c11438c9316b35382a49ed9 Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1995900720-project Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 could not be found. Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '47463cd7-babe-480b-b99c-6a8fdbb3e278'} Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 could not be found. Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 could not be found. Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:15.820087 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:15.825293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:15.825293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:15.825293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:15.825293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:15.825293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:15.825293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:15.825293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 could not be found. Nov 02 13:32:15.825293 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:15.828075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] Returning 404 to user: Instance 47463cd7-babe-480b-b99c-6a8fdbb3e278 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:15.830995 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e51824bb-f338-498b-ad80-f3a0d5fef9fb tempest-FloatingIPsAssociationTestJSON-1995900720 tempest-FloatingIPsAssociationTestJSON-1995900720-project] 10.222.0.113 "GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278" status: 404 len: 111 microversion: 2.1 time: 0.088676 Nov 02 13:32:15.833341 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2257/4197] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:15 2022] GET /compute/v2.1/servers/47463cd7-babe-480b-b99c-6a8fdbb3e278 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:15.850880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:15.853729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:15.869761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.870564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.871251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:15.872169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:15.874271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:15.875068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:16.034947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbef957564b8465e973d3e6fe2e74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7668fc27c2c847e086b43b0cbccfa7ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:16.054941 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c9cca56b-81cb-439f-998f-53d1e87242ca tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73" status: 200 len: 1478 microversion: 2.1 time: 1.566437 Nov 02 13:32:16.055589 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1941/4198] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:14 2022] GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 => generated 1478 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:16.554919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:16.555756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:16.575993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:16.576507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:16.576952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:16.577678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:16.578141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:16.578571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:17.374336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:17.399982 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-727e58d8-5a55-470c-87a2-bc6db889aca4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1660 microversion: 2.1 time: 1.561349 Nov 02 13:32:17.413736 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2258/4199] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:15 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1660 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:17.441951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f9cce3de-8840-4d0f-8a29-3a8ace75fa8d req-ec631067-912e-482a-a3f5-f4a7daef8560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f903fade-568a-4ab8-921c-4d0af0956d73", "name": "network-vif-deleted", "tag": "2c8ab030-6991-42fe-ad13-68219a6b114c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:17.473263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:17.496903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:17.501625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f9cce3de-8840-4d0f-8a29-3a8ace75fa8d req-ec631067-912e-482a-a3f5-f4a7daef8560 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:17.502128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f9cce3de-8840-4d0f-8a29-3a8ace75fa8d req-ec631067-912e-482a-a3f5-f4a7daef8560 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:17.505232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f9cce3de-8840-4d0f-8a29-3a8ace75fa8d req-ec631067-912e-482a-a3f5-f4a7daef8560 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:17.508491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:17.509793 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bfb321a0-2959-401e-bb1b-0ab0695988e5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.959585 Nov 02 13:32:17.510392 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1942/4200] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:16 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:17.544198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:17.544769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:17.562321 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f9cce3de-8840-4d0f-8a29-3a8ace75fa8d req-ec631067-912e-482a-a3f5-f4a7daef8560 service nova] Creating event network-vif-deleted:2c8ab030-6991-42fe-ad13-68219a6b114c for instance f903fade-568a-4ab8-921c-4d0af0956d73 on n-h2-858384-19 Nov 02 13:32:17.590178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:17.591844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:17.594741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:17.596639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:17.600231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:17.601054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:17.605877 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f9cce3de-8840-4d0f-8a29-3a8ace75fa8d req-ec631067-912e-482a-a3f5-f4a7daef8560 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189356 Nov 02 13:32:17.618814 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2259/4201] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:17.635990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:17.642452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] [instance: f903fade-568a-4ab8-921c-4d0af0956d73] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:17.657260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:17.666647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:17.668549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:17.669966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:17.673341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:17.674246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:17.730111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] HTTP exception thrown: Instance f903fade-568a-4ab8-921c-4d0af0956d73 could not be found. Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Request method failure captured: Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 HTTP/1.1 Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnCFTYgp9DOqCF2_eU0hCgm6-vm9E18Hh3ahaU-UY2lLO56MzoSp5JIDRuCJxhQfjG8CTJYP-63anr4woFZ1gjX_1MQHGrLXKBDAFalmGVdlEYryZ5FeCucgjHrEekpzwPOBmfMY38JK1uCkyRa_AiuFZGfrpUc3UDzk7ZS-_-W2ZWU Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 7668fc27c2c847e086b43b0cbccfa7ce Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ListImageFiltersTestJSON-468829061 Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7668fc27c2c847e086b43b0cbccfa7ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7668fc27c2c847e086b43b0cbccfa7ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_7668fc27c2c847e086b43b0cbccfa7ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/7668fc27c2c847e086b43b0cbccfa7ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ListImageFiltersTestJSON-468829061 Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 7668fc27c2c847e086b43b0cbccfa7ce Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-468829061 Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ListImageFiltersTestJSON-468829061-project Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: bbef957564b8465e973d3e6fe2e74816 Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ListImageFiltersTestJSON-468829061-project Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f903fade-568a-4ab8-921c-4d0af0956d73 could not be found. Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f903fade-568a-4ab8-921c-4d0af0956d73'} Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f903fade-568a-4ab8-921c-4d0af0956d73 could not be found. Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f903fade-568a-4ab8-921c-4d0af0956d73 could not be found. Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:17.734703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:17.740410 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:17.740410 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:17.740410 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:17.740410 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:17.740410 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:17.740410 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f903fade-568a-4ab8-921c-4d0af0956d73 could not be found. Nov 02 13:32:17.740410 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:17.753231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Returning 404 to user: Instance f903fade-568a-4ab8-921c-4d0af0956d73 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:17.754538 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39836c78-0f53-4626-be80-101fdb1eb3c5 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73" status: 404 len: 111 microversion: 2.1 time: 0.134203 Nov 02 13:32:17.755443 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2260/4202] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:17 2022] GET /compute/v2.1/servers/f903fade-568a-4ab8-921c-4d0af0956d73 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:17.761828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3052690a-f445-4d4a-9465-b92a3478ae88 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:17.783760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3052690a-f445-4d4a-9465-b92a3478ae88 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:17.784410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3052690a-f445-4d4a-9465-b92a3478ae88 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:17.784857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3052690a-f445-4d4a-9465-b92a3478ae88 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:17.839002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3052690a-f445-4d4a-9465-b92a3478ae88 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Going to try to start instance {{(pid=120928) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 13:32:17.960601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:17.968969 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ca288614-fca9-4222-816e-5dbae95cd89f tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1284 microversion: 2.1 time: 0.457309 Nov 02 13:32:17.969566 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1943/4203] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:17 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1284 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:17.995556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-436b4c0a-29e8-48f0-b26b-116f32117e8e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78703e310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:18.070227 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3052690a-f445-4d4a-9465-b92a3478ae88 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.297821 Nov 02 13:32:18.075513 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2261/4204] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:32:17 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:18.109243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:18.112184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:18.134255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:18.135081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:18.136573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:18.139425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:18.154374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:18.158217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:19.087882 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-436b4c0a-29e8-48f0-b26b-116f32117e8e tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "DELETE /compute/v2.1/images/27e64314-193f-466d-8aba-e94cd2a3b528" status: 204 len: 0 microversion: 2.1 time: 1.116623 Nov 02 13:32:19.088496 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1944/4205] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:17 2022] DELETE /compute/v2.1/images/27e64314-193f-466d-8aba-e94cd2a3b528 => generated 0 bytes in 1118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:19.094627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:19.096643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:19.104905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:19.118681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:19.120726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:19.121377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:19.125066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:19.125768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:19.126517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:19.409332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:19.429048 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ca74bf8-6887-4eae-9fa9-f78f76a862ea tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1669 microversion: 2.1 time: 1.343764 Nov 02 13:32:19.435561 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2262/4206] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:18 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1669 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:19.443044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:19.444369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:19.467547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:19.468367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:19.469771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:19.470685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:19.476797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:19.477674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:19.541954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:19.689147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:20.204985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:20.277714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:20.295657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:20.297787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:20.299589 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57537263-304a-4f0f-9bbc-610cc7da8d4d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 1.209629 Nov 02 13:32:20.301296 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1945/4207] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:19 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:20.310234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c80fece-cd6a-4c6f-b5de-bddc1a663390 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe78f8cc670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:21.012521 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c80fece-cd6a-4c6f-b5de-bddc1a663390 tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "DELETE /compute/v2.1/images/315a6e27-2380-4c16-b947-2664de434890" status: 204 len: 0 microversion: 2.1 time: 0.709504 Nov 02 13:32:21.013330 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1946/4208] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:20 2022] DELETE /compute/v2.1/images/315a6e27-2380-4c16-b947-2664de434890 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:21.021907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:21.023661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:21.033753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:21.035320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:21.036447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:21.038079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:21.039345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:21.039872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:21.069075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:21.092078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:21.107721 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a995cf84-9dc3-4e4b-8958-ff46486b3a1e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1326 microversion: 2.1 time: 1.663941 Nov 02 13:32:21.122316 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2263/4209] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:19 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1326 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:21.136407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd95c03d-8142-4d31-9e75-d8dec30a7aec tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] Calling method '.version_select at 0x7fe787bf6040>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:21.399524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:21.412649 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6a912636-8960-40f7-9c1e-c1ce1e2cc703 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1669 microversion: 2.1 time: 0.397447 Nov 02 13:32:21.416307 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1947/4210] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:21 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1669 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:21.427527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:21.430338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:21.447010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:21.449205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:21.450925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:21.456620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:21.457392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:21.458106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:21.499310 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd95c03d-8142-4d31-9e75-d8dec30a7aec tempest-ListImageFiltersTestJSON-468829061 tempest-ListImageFiltersTestJSON-468829061-project] 10.222.0.113 "DELETE /compute/v2.1/images/256f3859-264b-4ac8-9b5c-e830e0ada64c" status: 204 len: 0 microversion: 2.1 time: 0.375507 Nov 02 13:32:21.502984 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2264/4211] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:21 2022] DELETE /compute/v2.1/images/256f3859-264b-4ac8-9b5c-e830e0ada64c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:22.149834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:22.151543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:22.151911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:22.163014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:22.171011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:22.171877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:22.172836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:22.174274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:22.176918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:22.177046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:22.179324 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9adf241e-216f-4ae6-bd78-d7801e235e87 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.761667 Nov 02 13:32:22.179927 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1948/4212] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:21 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:22.188835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:22.442363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:22.443009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:22.461285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:22.461798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:22.462600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:22.463534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:22.464147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:22.464835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:22.736286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:22.745883 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-04cb4193-33a5-4967-94de-9e03a47adf8d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1326 microversion: 2.1 time: 0.616664 Nov 02 13:32:22.762336 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2265/4213] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:22 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1326 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:23.198332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:23.206578 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f66bafb5-b685-4c1b-9810-d7799c30682c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1669 microversion: 2.1 time: 0.769390 Nov 02 13:32:23.223455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:23.223455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:23.232455 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1949/4214] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:22 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1669 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:23.237667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:23.239982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:23.242927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:23.245024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:23.250649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:23.251160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:23.771980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:23.773195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:23.791298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:23.791835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:23.793797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:23.795568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:23.799638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:23.800265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:24.116432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:24.135342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:24.137051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:24.138395 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3bfbb586-e370-4f45-939e-26647a588ca4 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.933145 Nov 02 13:32:24.148571 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2266/4215] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:23 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:32:24.240108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:24.240725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:24.251953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:24.252448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:24.253089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:24.253962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:24.254585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:24.255021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:24.497630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:24.543721 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3ac18a07-1133-4c4f-8dee-cebf0a8d7dd2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1326 microversion: 2.1 time: 0.757728 Nov 02 13:32:24.551615 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1950/4216] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:23 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1326 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:24.858941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-743b28da-a51c-4659-aa6f-89844fb697c1 tempest-ListImageFiltersNegativeTestJSON-667569196 tempest-ListImageFiltersNegativeTestJSON-667569196-project] Calling method '.version_select at 0x7fe78703edc0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:24.897359 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-743b28da-a51c-4659-aa6f-89844fb697c1 tempest-ListImageFiltersNegativeTestJSON-667569196 tempest-ListImageFiltersNegativeTestJSON-667569196-project] HTTP exception thrown: Image not found. Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-743b28da-a51c-4659-aa6f-89844fb697c1 tempest-ListImageFiltersNegativeTestJSON-667569196 tempest-ListImageFiltersNegativeTestJSON-667569196-project] Request method failure captured: Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/images/df886e06-b6fe-4eef-9220-2b58576e198f HTTP/1.1 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnFo8sgT4dnJvoUnAiQkY1LhKwjM0h71bdDoPlVM5IgK9M5tPhtlJxUlKdo9-RSYcqCXrw00IhXH1Ss4MIjjr8lLOt2gR3ZpbwLsmPWsDWUKXXdRZUlxsl5_k41M-cLrBYid3f67XT6JkP6SlH_2Yo4mnf_sjDr8MBegUBxHGx0EL2U Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 7f337985dc0e44229156825329254bb6 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-667569196 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7f337985dc0e44229156825329254bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7f337985dc0e44229156825329254bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_7f337985dc0e44229156825329254bb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/7f337985dc0e44229156825329254bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-667569196 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 7f337985dc0e44229156825329254bb6 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-667569196 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ListImageFiltersNegativeTestJSON-667569196-project Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: ada14f1f8aad49be8d83e7328c6fff48 Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-667569196-project Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: exception: Image not found. Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'df886e06-b6fe-4eef-9220-2b58576e198f'} Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID df886e06-b6fe-4eef-9220-2b58576e198f Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:32:24.899733 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df886e06-b6fe-4eef-9220-2b58576e198f could not be found. Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:32:24.902839 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:24.907934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-743b28da-a51c-4659-aa6f-89844fb697c1 tempest-ListImageFiltersNegativeTestJSON-667569196 tempest-ListImageFiltersNegativeTestJSON-667569196-project] Returning 404 to user: Image not found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:24.909208 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-743b28da-a51c-4659-aa6f-89844fb697c1 tempest-ListImageFiltersNegativeTestJSON-667569196 tempest-ListImageFiltersNegativeTestJSON-667569196-project] 10.222.0.113 "GET /compute/v2.1/images/df886e06-b6fe-4eef-9220-2b58576e198f" status: 404 len: 62 microversion: 2.1 time: 0.305467 Nov 02 13:32:24.917275 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1951/4217] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:32:24 2022] GET /compute/v2.1/images/df886e06-b6fe-4eef-9220-2b58576e198f => generated 62 bytes in 314 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:32:25.017834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1887399781", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "763e202f-cb6a-4b76-b525-70533c52550f"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:25.057950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:25.069179 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-762e7238-b903-4e45-9850-12fc07401ad3 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.833846 Nov 02 13:32:25.069791 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2267/4218] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:24 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:25.113739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-24e0d52f-6107-4d50-b9e6-d251eb7384db req-b30c72a5-5518-49f5-abe7-1379565a7edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd91b461-05bb-403c-b07f-181066f71ffe", "tag": "aff65f7b-505b-4417-b336-bf64beea6e66"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:25.157850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-24e0d52f-6107-4d50-b9e6-d251eb7384db req-b30c72a5-5518-49f5-abe7-1379565a7edd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:25.158223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] validate_networks() for [('763e202f-cb6a-4b76-b525-70533c52550f', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:32:25.158342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-24e0d52f-6107-4d50-b9e6-d251eb7384db req-b30c72a5-5518-49f5-abe7-1379565a7edd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:25.158751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-24e0d52f-6107-4d50-b9e6-d251eb7384db req-b30c72a5-5518-49f5-abe7-1379565a7edd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:25.205534 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-24e0d52f-6107-4d50-b9e6-d251eb7384db req-b30c72a5-5518-49f5-abe7-1379565a7edd service nova] Creating event network-changed:aff65f7b-505b-4417-b336-bf64beea6e66 for instance bd91b461-05bb-403c-b07f-181066f71ffe on n-h1-858384-19 Nov 02 13:32:25.225975 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-24e0d52f-6107-4d50-b9e6-d251eb7384db req-b30c72a5-5518-49f5-abe7-1379565a7edd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125952 Nov 02 13:32:25.226982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2268/4219] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:25.232464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:25.233171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:25.268914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:25.269530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:25.269981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:25.274742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:25.275255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:25.275707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.033596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:27.045725 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bca2b2d5-8ea3-44ee-b32e-16c354457d53 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 1.815347 Nov 02 13:32:27.045725 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2269/4220] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:25 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:27.057612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:27.060835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:27.077326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:27.078010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:27.078633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.079581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:27.080847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:27.082199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.644291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:32:27.645298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:32:27.645963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:32:27.647131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:32:27.647863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:32:27.663007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:27.674195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:27.675032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.676034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:27.676673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:27.677264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.709721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Getting quotas for project e131e64eb64346ba991ca2f0c4dfbf94. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:27.718136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Getting quotas for user 9072a15377bd497fb117ce4aad116a18 and project e131e64eb64346ba991ca2f0c4dfbf94. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:27.730149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:27.746043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:27.749434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:27.749582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:32:27.751811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:32:27.755307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ec4bb91-bd76-4403-90e1-fa3742f8e5f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.706594 Nov 02 13:32:27.758571 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2270/4221] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:27 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:27.766092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:27.775071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:27.785733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:27.789045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:27.789760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.792465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:27.794612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:27.795358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.849124 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7ec7c82-344b-496e-acdc-b8c250ffbf8b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.930445 Nov 02 13:32:27.856356 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1952/4222] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:32:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 2938 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:32:27.861021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-fc3e1907-1b4e-4e3f-bd4e-3fed80990e94 req-cd4d0261-d993-4b10-9067-cb3418983729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a016a9-b97a-466e-a423-4125c875c4ee", "tag": "152d6e71-3362-4c9a-8250-9c6dc67e9c6e"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:27.910775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fc3e1907-1b4e-4e3f-bd4e-3fed80990e94 req-cd4d0261-d993-4b10-9067-cb3418983729 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:27.911297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fc3e1907-1b4e-4e3f-bd4e-3fed80990e94 req-cd4d0261-d993-4b10-9067-cb3418983729 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:27.911838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fc3e1907-1b4e-4e3f-bd4e-3fed80990e94 req-cd4d0261-d993-4b10-9067-cb3418983729 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:27.941513 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-fc3e1907-1b4e-4e3f-bd4e-3fed80990e94 req-cd4d0261-d993-4b10-9067-cb3418983729 service nova] Creating event network-changed:152d6e71-3362-4c9a-8250-9c6dc67e9c6e for instance 95a016a9-b97a-466e-a423-4125c875c4ee on n-h2-858384-19 Nov 02 13:32:27.948186 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-fc3e1907-1b4e-4e3f-bd4e-3fed80990e94 req-cd4d0261-d993-4b10-9067-cb3418983729 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091180 Nov 02 13:32:27.948795 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1953/4223] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:27.956934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:27.973328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:28.001381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:28.001870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:28.022836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:28.024760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:28.028883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:28.029591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:28.308206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:28.317723 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bab0c96d-316c-477f-a870-2623e7d3cab0 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.367563 Nov 02 13:32:28.318828 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1954/4224] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:27 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:28.348285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-536b4a19-e251-4cc1-ab66-f0e23862c490 req-4d5c89e3-8ad8-48f7-9864-4f7937a17989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75714141-548d-4be5-bcdd-fc9ee050212c", "tag": "b44d899f-02b2-4b2c-ba4c-f20d54df181e"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:28.362071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-536b4a19-e251-4cc1-ab66-f0e23862c490 req-4d5c89e3-8ad8-48f7-9864-4f7937a17989 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:28.362822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-536b4a19-e251-4cc1-ab66-f0e23862c490 req-4d5c89e3-8ad8-48f7-9864-4f7937a17989 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:28.363519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-536b4a19-e251-4cc1-ab66-f0e23862c490 req-4d5c89e3-8ad8-48f7-9864-4f7937a17989 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:28.380472 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-536b4a19-e251-4cc1-ab66-f0e23862c490 req-4d5c89e3-8ad8-48f7-9864-4f7937a17989 service nova] Creating event network-changed:b44d899f-02b2-4b2c-ba4c-f20d54df181e for instance 75714141-548d-4be5-bcdd-fc9ee050212c on n-h2-858384-19 Nov 02 13:32:28.386966 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-536b4a19-e251-4cc1-ab66-f0e23862c490 req-4d5c89e3-8ad8-48f7-9864-4f7937a17989 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066621 Nov 02 13:32:28.388347 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1955/4225] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:28.397490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-98202066-9661-4688-9677-5d67f91f051a tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:28.398472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-98202066-9661-4688-9677-5d67f91f051a tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:28.503869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-98202066-9661-4688-9677-5d67f91f051a tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:28.512374 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-98202066-9661-4688-9677-5d67f91f051a tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1221 microversion: 2.1 time: 0.122669 Nov 02 13:32:28.514544 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1956/4226] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:28 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:28.521593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:28.545505 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a5a7ad62-09cf-4ca3-bb49-277a0e24050b tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1326 microversion: 2.1 time: 0.783195 Nov 02 13:32:28.549281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:28.564040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:28.565045 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2271/4227] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:27 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1326 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:28.565135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:28.565135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:28.565135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:28.565135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:28.565135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:28.565135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:28.793003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:28.793641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:28.810198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:28.810731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:28.811587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:28.819142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:28.820017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:28.820135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:29.202080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:29.219041 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4cc23889-4290-4ac8-93fe-0b37d8279028 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.703362 Nov 02 13:32:29.223378 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1957/4228] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:28 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:29.251660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:29.252382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:29.266045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:29.266551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:29.267025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:29.278878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:29.282387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:29.283676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:29.968478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:29.978772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:29.989278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:29.994068 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb401ea0-0fd8-4061-9832-8c276a0dcebb tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 1.205778 Nov 02 13:32:29.997475 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2272/4229] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:28 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:30.011788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:30.012628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:30.033042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.033917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.037890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.040285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.040964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.042785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.241638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:30.254861 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-956b6fa6-1265-4f5f-8e0a-0b58ab3682a1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 1.005887 Nov 02 13:32:30.258047 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1958/4230] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:29 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:30.273333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:30.279704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:30.291463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.293499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.294610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.298736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.299418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.300143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.399282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:30.409249 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-065a4dd9-b9e2-4275-a6a6-ccda8c73d497 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1273 microversion: 2.1 time: 0.410485 Nov 02 13:32:30.410393 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2273/4231] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:29 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:30.417417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:30.418185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:30.424949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:30.427450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.428470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.429201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.430831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.431558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.432141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.525972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lazy-loading 'flavor' on Instance uuid cfdfca83-c725-4ad1-9005-3d100bb279e7 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:32:30.747850 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-174507ee-4c01-44af-8f8e-2836e7720c5f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.335889 Nov 02 13:32:30.748666 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2274/4232] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:32:30 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:30.767260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:30.773974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:30.782617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.783521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.784173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:30.788672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:30.789482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:30.790229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:31.340177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:31.343537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:31.353266 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b67b9092-fda8-43f6-ab72-200ce364124d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1681 microversion: 2.1 time: 0.600140 Nov 02 13:32:31.354721 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2275/4233] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:30 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1681 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:31.376141 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-82b9a43d-9265-44ad-89cf-0d71476860e9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1326 microversion: 2.1 time: 1.115441 Nov 02 13:32:31.376952 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1959/4234] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:30 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1326 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:31.382959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:31.383634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:31.394935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:31.397375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:31.397375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:31.397375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:31.397854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:31.413190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:31.612620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35f263ee-448d-4b7c-bd7c-86324a539644 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Action: 'create', calling method: .version_select at 0x7fe786e6f430>, body: {"keypair": {"name": "tempest-keypair-467471296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQBLfctYxlPml9YXUPxiEkOtnyxjkjmSk+XpwY6q/BE51gUvRLnNlTzQNBCWjoATBfesjAQJlche7BBWtPydZHVJ0iw0fHOHmnwfkLL7aGLSQfkgoLwDspM8RcPxr6ABQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:31.705635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-35f263ee-448d-4b7c-bd7c-86324a539644 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:31.717282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-35f263ee-448d-4b7c-bd7c-86324a539644 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for user edeca282c9c94c2abe3c8678a5f1b7df and project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:31.781111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35f263ee-448d-4b7c-bd7c-86324a539644 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.424813 Nov 02 13:32:31.783906 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2276/4235] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:32:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:31.795963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:31.796594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:31.813530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:31.814030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:31.814715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:31.816171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:31.816890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:31.817477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:32.025731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:32.047260 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bd14aa7b-fa3d-40ed-8d7b-32e1a9727700 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1279 microversion: 2.1 time: 0.255171 Nov 02 13:32:32.047954 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2277/4236] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:31 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:32.075898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5bc59910-5ca6-4152-9dc0-50249e97cdbe tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Calling method '.version_select at 0x7fe786e6f430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:32.119427 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5bc59910-5ca6-4152-9dc0-50249e97cdbe tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "GET /compute/v2.1/os-keypairs/tempest-keypair-467471296" status: 200 len: 497 microversion: 2.1 time: 0.048949 Nov 02 13:32:32.126673 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2278/4237] 10.222.0.113 () {58 vars in 1220 bytes} [Wed Nov 2 13:32:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-467471296 => generated 497 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:32.152498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15b93c45-6f0f-4e49-a9ba-87a9e6cca92e tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Calling method '.version_select at 0x7fe7862c5c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:32.233577 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15b93c45-6f0f-4e49-a9ba-87a9e6cca92e tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467471296" status: 202 len: 0 microversion: 2.1 time: 0.095543 Nov 02 13:32:32.234474 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2279/4238] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:32:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467471296 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:32:32.252917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44296573-03ad-414c-909b-b696b3e21316 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Action: 'create', calling method: .version_select at 0x7fe786e84160>, body: {"keypair": {"name": "tempest-keypair-1894838614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnuFh1t2niN+rY+p4ohBz6MYFs12C6GBxezW5cAJzwQXiYgpbv5iToIxacouf0EdAlYEHbl+vtN28rpbIJ+Xbzxsyj8vOfl9IJasIa/RLwXKmKTYvC5JW8VYprrmVSiHQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:32.293658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-44296573-03ad-414c-909b-b696b3e21316 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:32.302088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-44296573-03ad-414c-909b-b696b3e21316 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for user edeca282c9c94c2abe3c8678a5f1b7df and project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:32.335476 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44296573-03ad-414c-909b-b696b3e21316 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086306 Nov 02 13:32:32.336797 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2280/4239] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:32:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:32:32.348753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9903a548-c25c-420a-b4d8-c9a85bd1a512 req-193ebfb7-be54-45e0-9e1d-f4e4dcd52fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd91b461-05bb-403c-b07f-181066f71ffe", "name": "network-vif-plugged", "status": "completed", "tag": "aff65f7b-505b-4417-b336-bf64beea6e66"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:32.363380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9903a548-c25c-420a-b4d8-c9a85bd1a512 req-193ebfb7-be54-45e0-9e1d-f4e4dcd52fbf service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:32.364197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9903a548-c25c-420a-b4d8-c9a85bd1a512 req-193ebfb7-be54-45e0-9e1d-f4e4dcd52fbf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:32.366329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9903a548-c25c-420a-b4d8-c9a85bd1a512 req-193ebfb7-be54-45e0-9e1d-f4e4dcd52fbf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:32.384348 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9903a548-c25c-420a-b4d8-c9a85bd1a512 req-193ebfb7-be54-45e0-9e1d-f4e4dcd52fbf service nova] Creating event network-vif-plugged:aff65f7b-505b-4417-b336-bf64beea6e66 for instance bd91b461-05bb-403c-b07f-181066f71ffe on n-h1-858384-19 Nov 02 13:32:32.391967 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9903a548-c25c-420a-b4d8-c9a85bd1a512 req-193ebfb7-be54-45e0-9e1d-f4e4dcd52fbf service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053410 Nov 02 13:32:32.393894 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2281/4240] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:32.401251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c5fe56dc-98d1-499e-ac98-2fb13a7a8339 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Calling method '.version_select at 0x7fe786323430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:32.429082 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c5fe56dc-98d1-499e-ac98-2fb13a7a8339 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894838614" status: 202 len: 0 microversion: 2.1 time: 0.033445 Nov 02 13:32:32.430403 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2282/4241] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:32:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894838614 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:32.438673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:32.440544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:32.450907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:32.451712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:32.452345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:32.453257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:32.453930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:32.454720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:32.673264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:32.688943 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39d27b91-f10c-4e7b-accc-a7d64a34af30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1681 microversion: 2.1 time: 0.255852 Nov 02 13:32:32.692009 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2283/4242] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:32 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:32.701558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:32.702193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:32.720202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:32.721087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:32.721562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:32.726957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:32.727837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:32.728297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:33.690646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:33.709447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:33.716386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:33.719024 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94691206-955f-49c2-99cb-15bad73c92f9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 2.341325 Nov 02 13:32:33.727887 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1960/4243] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:31 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 2351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:33.741054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f80ece6d-c1de-4402-8867-a0de98ca11ac tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Action: 'create', calling method: .version_select at 0x7fe7869061f0>, body: {"keypair": {"name": "tempest-keypair-977837002", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:33.760165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:33.786602 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a46f80f-599c-43c5-9f5c-ff1b374514bb tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1326 microversion: 2.1 time: 1.089614 Nov 02 13:32:33.798266 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2284/4244] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:32 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1326 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:33.800261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f80ece6d-c1de-4402-8867-a0de98ca11ac tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:33.807086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:33.819386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:33.829793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f80ece6d-c1de-4402-8867-a0de98ca11ac tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for user edeca282c9c94c2abe3c8678a5f1b7df and project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:33.850977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:33.855362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:33.856115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:33.857033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:33.859961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:33.862829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:33.901228 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f80ece6d-c1de-4402-8867-a0de98ca11ac tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.164777 Nov 02 13:32:33.902345 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1961/4245] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:32:33 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:33.907558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:33.915824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:33.944911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:33.950591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:33.952895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:33.953880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:33.956725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:33.956933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:33.958078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:34.751767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:34.767392 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b6d33c8-bd35-4412-8463-352901ba1396 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1664 microversion: 2.1 time: 0.863724 Nov 02 13:32:34.768201 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1962/4246] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:33 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1664 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:34.789430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3fa4857c-3b5f-4895-8814-1789f99b2fd7 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Calling method '.version_select at 0x7fe787021430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:34.826355 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3fa4857c-3b5f-4895-8814-1789f99b2fd7 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-977837002" status: 202 len: 0 microversion: 2.1 time: 0.056927 Nov 02 13:32:34.827513 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1963/4247] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-977837002 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:34.836873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:34.845153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:34.859016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:34.871913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:34.872738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:34.873782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:34.873890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:34.874980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:34.875667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:34.882019 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-602d4c79-dca4-4d99-88e5-9c7208c54026 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 1.081846 Nov 02 13:32:34.895952 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2285/4248] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:33 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:34.898817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-123c0ddf-e233-4e96-8622-8fa7cca61e86 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:34.901296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-123c0ddf-e233-4e96-8622-8fa7cca61e86 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:34.917259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-123c0ddf-e233-4e96-8622-8fa7cca61e86 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:34.917749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-123c0ddf-e233-4e96-8622-8fa7cca61e86 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:34.918191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-123c0ddf-e233-4e96-8622-8fa7cca61e86 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:34.919024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-123c0ddf-e233-4e96-8622-8fa7cca61e86 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:34.919514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-123c0ddf-e233-4e96-8622-8fa7cca61e86 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:34.919945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-123c0ddf-e233-4e96-8622-8fa7cca61e86 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.034262 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-123c0ddf-e233-4e96-8622-8fa7cca61e86 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action" status: 202 len: 0 microversion: 2.1 time: 0.146781 Nov 02 13:32:35.034899 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2286/4249] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:32:34 2022] POST /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:35.055007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:35.056159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:35.076104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.076607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.077106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.077851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.078340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.078898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.572889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:35.603669 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf3744b9-6b4e-40af-adb3-3f06a53a98dd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1326 microversion: 2.1 time: 0.567088 Nov 02 13:32:35.604268 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2287/4250] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:35 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1326 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:35.621773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-37ccacd7-4d95-48d6-9c53-921a199f4f06 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Action: 'create', calling method: .version_select at 0x7fe786e56790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-876755401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9iHx7wvh1tBwRbQY5lmksICUM8dzGu03jFJQQj5Cwya34+gA5nbqXTI+YYdTWNGIXbA8xNzRCgrbBZdcEIFkD+7fh0/k6iTFvWt54tiFq3xtrAD4EOYtw7nlLljowj4Q=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:35.684119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-37ccacd7-4d95-48d6-9c53-921a199f4f06 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:35.691481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-37ccacd7-4d95-48d6-9c53-921a199f4f06 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for user edeca282c9c94c2abe3c8678a5f1b7df and project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:35.736314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:35.747862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:35.751448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:35.756827 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4acdd08c-2d59-4ed1-942a-88c9175d9257 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.927383 Nov 02 13:32:35.776814 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1964/4251] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:34 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:35.778098 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-37ccacd7-4d95-48d6-9c53-921a199f4f06 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.170114 Nov 02 13:32:35.778874 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2288/4252] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:32:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:35.783716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-92444a9c-e116-44df-975b-53c254b0bb4d req-663a5922-52ac-448a-8826-4401a463e85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75714141-548d-4be5-bcdd-fc9ee050212c", "name": "network-vif-plugged", "status": "completed", "tag": "b44d899f-02b2-4b2c-ba4c-f20d54df181e"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:35.792659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:35.793276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:35.815760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.816267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.816705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.817288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-92444a9c-e116-44df-975b-53c254b0bb4d req-663a5922-52ac-448a-8826-4401a463e85e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.817418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:35.818395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.818820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.819274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-92444a9c-e116-44df-975b-53c254b0bb4d req-663a5922-52ac-448a-8826-4401a463e85e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:35.819945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-92444a9c-e116-44df-975b-53c254b0bb4d req-663a5922-52ac-448a-8826-4401a463e85e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:35.837993 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-92444a9c-e116-44df-975b-53c254b0bb4d req-663a5922-52ac-448a-8826-4401a463e85e service nova] Creating event network-vif-plugged:b44d899f-02b2-4b2c-ba4c-f20d54df181e for instance 75714141-548d-4be5-bcdd-fc9ee050212c on n-h2-858384-19 Nov 02 13:32:35.848096 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-92444a9c-e116-44df-975b-53c254b0bb4d req-663a5922-52ac-448a-8826-4401a463e85e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067902 Nov 02 13:32:35.855263 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2289/4253] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:35.872073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dd00dcf2-c0b8-423e-9d8b-5e8da27f1b2c tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Action: 'create', calling method: .version_select at 0x7fe7862f7f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1736176085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCA+XILxs1OAfAQfXVKYwFxPeUOt4U331XMOeu7elGzWlxLuQSEQUlXCGfMavT8dONXRGkBb8ZT9Fd3CdgfpSP+f0uzH6vPee1C3Xy0Nt1nIXwyoJC+6Lx+RUhJAX/xpNw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:35.930764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-dd00dcf2-c0b8-423e-9d8b-5e8da27f1b2c tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:35.947237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-dd00dcf2-c0b8-423e-9d8b-5e8da27f1b2c tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for user edeca282c9c94c2abe3c8678a5f1b7df and project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:36.014890 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dd00dcf2-c0b8-423e-9d8b-5e8da27f1b2c tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.158044 Nov 02 13:32:36.019081 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2290/4254] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:32:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:36.033000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:36.034372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:36.055900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:36.057721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:36.061352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:36.062359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:36.064663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:36.065368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:36.431861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:36.447926 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38e2e7c0-7733-4f47-a9d7-720480b3a367 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1670 microversion: 2.1 time: 0.669604 Nov 02 13:32:36.454556 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1965/4255] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:35 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1670 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:36.480414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d74c5e4-ddb1-4b12-bf3a-c1dd01a74236 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Action: 'create', calling method: .version_select at 0x7fe78f84e0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-953745522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPlTX4wKJzAfy+tFsMx456qImlMY2vk8gkD9uaanZafTxauUtZdTdDNeYgR4hyrL+hoZs7UFTKe+gBhCRw76CIMnjG2DDRlg8AQtPVYz3g5M4EIBGqz7KW0FVzbu6slGg=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:36.535610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9d74c5e4-ddb1-4b12-bf3a-c1dd01a74236 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:36.548292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9d74c5e4-ddb1-4b12-bf3a-c1dd01a74236 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Getting quotas for user edeca282c9c94c2abe3c8678a5f1b7df and project f557410492fc445bb12b537ea95d2688. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:36.615394 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d74c5e4-ddb1-4b12-bf3a-c1dd01a74236 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.150567 Nov 02 13:32:36.616778 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1966/4256] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:32:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:36.631828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8322f5f6-eb75-47e9-9d48-2ee239373665 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Calling method '.version_select at 0x7fe78fa71c10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:36.642941 n-d-858384-19 devstack@n-api.service[120929]: WARNING oslo_db.sqlalchemy.utils [None req-8322f5f6-eb75-47e9-9d48-2ee239373665 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:32:36.664863 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8322f5f6-eb75-47e9-9d48-2ee239373665 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.041425 Nov 02 13:32:36.674428 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1967/4257] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:32:36 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:36.687288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:36.687950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:36.705372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:36.705891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:36.709503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:36.710740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:36.711260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:36.711708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:36.782157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:36.796726 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a042ae29-204f-4d9a-95ec-78dbe1fbf91f tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 0.774886 Nov 02 13:32:36.797628 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2291/4258] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:36 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:36.811274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0edf331d-5400-42b1-929a-1aabb9e15b0b tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Calling method '.version_select at 0x7fe7862f7d30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:36.854404 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0edf331d-5400-42b1-929a-1aabb9e15b0b tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-953745522" status: 202 len: 0 microversion: 2.1 time: 0.053757 Nov 02 13:32:36.859082 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2292/4259] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:32:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-953745522 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:36.875210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:36.879089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:36.903381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:36.905234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:36.908043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:36.908973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:36.910635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:36.912848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:37.231785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:37.273526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:37.278246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:37.280148 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2760a2a5-abc4-4bd4-8516-a508f47f9372 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.417776 Nov 02 13:32:37.283691 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2293/4260] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:36 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:37.293155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97384932-9530-403a-b5d0-7c8e1844af12 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Calling method '.version_select at 0x7fe7862f1dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:37.298136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:37.312031 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-675eb5f5-534b-4598-9975-7e8edd027aa9 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1326 microversion: 2.1 time: 0.641701 Nov 02 13:32:37.316282 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1968/4261] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:36 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1326 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:37.348031 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97384932-9530-403a-b5d0-7c8e1844af12 tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1736176085" status: 202 len: 0 microversion: 2.1 time: 0.063029 Nov 02 13:32:37.349390 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2294/4262] 10.222.0.113 () {58 vars in 1283 bytes} [Wed Nov 2 13:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1736176085 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:37.357909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d11ea9d-0739-4172-8f87-42ee846c4baf tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] Calling method '.version_select at 0x7fe78f8df4c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:37.382982 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d11ea9d-0739-4172-8f87-42ee846c4baf tempest-KeyPairsV2TestJSON-1990019231 tempest-KeyPairsV2TestJSON-1990019231-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-876755401" status: 202 len: 0 microversion: 2.1 time: 0.028774 Nov 02 13:32:37.384254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1969/4263] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-876755401 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:32:37.478315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:37.478928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:37.498306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:37.498802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:37.499297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:37.510968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:37.511520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:37.512425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:37.754683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:37.766311 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f7430be7-cda5-4835-b009-249d0c094394 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1670 microversion: 2.1 time: 0.292818 Nov 02 13:32:37.767439 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2295/4264] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:37 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1670 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:37.821868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:37.831028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:37.831873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:37.849894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:37.850732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:37.851360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:37.854263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:37.856373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:37.856984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.074479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-dbaeb898-d77b-4c43-b528-8a754f33eb8b req-1002a74a-36f4-4ee8-b124-9fc53780522e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60eb1c44-792a-42b2-9ac8-2b6278e38cbd", "tag": "14a9ab8c-8537-4d8a-bb52-726abf524a19"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:38.087890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dbaeb898-d77b-4c43-b528-8a754f33eb8b req-1002a74a-36f4-4ee8-b124-9fc53780522e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.088730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dbaeb898-d77b-4c43-b528-8a754f33eb8b req-1002a74a-36f4-4ee8-b124-9fc53780522e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.089379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-dbaeb898-d77b-4c43-b528-8a754f33eb8b req-1002a74a-36f4-4ee8-b124-9fc53780522e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.106002 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-dbaeb898-d77b-4c43-b528-8a754f33eb8b req-1002a74a-36f4-4ee8-b124-9fc53780522e service nova] Creating event network-changed:14a9ab8c-8537-4d8a-bb52-726abf524a19 for instance 60eb1c44-792a-42b2-9ac8-2b6278e38cbd on n-h1-858384-19 Nov 02 13:32:38.112199 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-dbaeb898-d77b-4c43-b528-8a754f33eb8b req-1002a74a-36f4-4ee8-b124-9fc53780522e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043697 Nov 02 13:32:38.113723 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2296/4265] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:32:38.250448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c9828336-3c34-41dd-8318-b2a446bab25d req-325dc089-6e57-498c-a402-294f0da32220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a016a9-b97a-466e-a423-4125c875c4ee", "name": "network-vif-plugged", "status": "completed", "tag": "152d6e71-3362-4c9a-8250-9c6dc67e9c6e"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:38.326550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c9828336-3c34-41dd-8318-b2a446bab25d req-325dc089-6e57-498c-a402-294f0da32220 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.327428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c9828336-3c34-41dd-8318-b2a446bab25d req-325dc089-6e57-498c-a402-294f0da32220 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.331429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c9828336-3c34-41dd-8318-b2a446bab25d req-325dc089-6e57-498c-a402-294f0da32220 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.369992 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c9828336-3c34-41dd-8318-b2a446bab25d req-325dc089-6e57-498c-a402-294f0da32220 service nova] Creating event network-vif-plugged:152d6e71-3362-4c9a-8250-9c6dc67e9c6e for instance 95a016a9-b97a-466e-a423-4125c875c4ee on n-h2-858384-19 Nov 02 13:32:38.382634 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c9828336-3c34-41dd-8318-b2a446bab25d req-325dc089-6e57-498c-a402-294f0da32220 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148771 Nov 02 13:32:38.383957 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2297/4266] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:38.393752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:38.399456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:38.416680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.417184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.417793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.424038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.424549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.425099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.812032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:38.837360 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ea272fe9-05a1-4ca5-bfe9-5081807f3caf tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 1.019229 Nov 02 13:32:38.861343 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1970/4267] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:37 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:38.875196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:38.876146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:38.886661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.887497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.906864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:38.907974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:38.908911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:38.909547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:39.429725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:39.447931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:39.453430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:39.456896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-63d02ad2-d61b-4299-b357-5e893c7a316f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 1.070632 Nov 02 13:32:39.459681 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2298/4268] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:38 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:39.475929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:39.477604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:39.494226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:39.495570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:39.496248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:39.498147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:39.500860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:39.501527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:39.914684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:39.924397 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-86f7411f-c7a2-4205-a53a-510db628577d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.460028 Nov 02 13:32:39.925182 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2299/4269] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:39 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:39.930481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:39.931314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:39.934619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:39.938847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:39.939532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:39.940122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:39.941032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:39.941635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:39.943644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:39.964449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:39.983003 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-557b47f0-08f3-47dd-a023-06c39240e2fe tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1326 microversion: 2.1 time: 1.115253 Nov 02 13:32:39.987407 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1971/4270] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:38 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1326 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:40.000333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:40.009835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:40.032509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:40.041992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:40.042856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:40.044796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:40.046285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:40.048091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:40.355700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:40.370432 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b397c92-e244-49b4-8f40-046301398993 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 0.443357 Nov 02 13:32:40.372934 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2300/4271] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:39 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:40.485630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:40.487080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:40.503792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:40.505977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:40.506605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:40.508843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:40.511034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:40.511671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:40.669165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:40.682212 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16144263-16cc-4554-8f1d-7bf5296419d5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1673 microversion: 2.1 time: 0.693442 Nov 02 13:32:40.683315 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1972/4272] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:39 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1673 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:40.708119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:40.708621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:40.720186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:40.720692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:40.721139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:40.721860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:40.722320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:40.722751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:40.779299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:40.789046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:40.808473 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.api [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Working on deleting snapshot db080d8c-f6b4-4137-84d0-f1badb0f4227 from shelved instance... Nov 02 13:32:41.134638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:41.152917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:41.159128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:41.163772 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2a714397-d9d7-403a-808c-52a8494b9618 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.682453 Nov 02 13:32:41.167073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2301/4273] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:40 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:41.173605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:41.174390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:41.182465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:41.183554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:41.184303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:41.185203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:41.186593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:41.187264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:41.492943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:41.503076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ce6a0d7-1463-4529-a03f-ec76198615ee tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1518 microversion: 2.1 time: 0.334445 Nov 02 13:32:41.505648 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2302/4274] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:41 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1518 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:41.526638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:41.528631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:41.543613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:41.546408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:41.548889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:41.549867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:41.551323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:41.552494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:41.947806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:41.963954 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b38f276f-e4c8-4f7a-9263-2ee2fcaf4561 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 0.456981 Nov 02 13:32:41.972211 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2303/4275] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:41 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:42.467573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5948d945-270f-4fa3-bd9b-0d937ebe3205 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Calling method '.version_select at 0x7fe7862880d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:42.482983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5948d945-270f-4fa3-bd9b-0d937ebe3205 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.483871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5948d945-270f-4fa3-bd9b-0d937ebe3205 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.489069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5948d945-270f-4fa3-bd9b-0d937ebe3205 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.489945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5948d945-270f-4fa3-bd9b-0d937ebe3205 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.490402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5948d945-270f-4fa3-bd9b-0d937ebe3205 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.490837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5948d945-270f-4fa3-bd9b-0d937ebe3205 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.506771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Doing local delete in cell 9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) {{(pid=120929) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 13:32:42.507559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.514459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.516092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.516569 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.api [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 13:32:42.525101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] deallocate_for_instance() {{(pid=120929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 13:32:42.534925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5948d945-270f-4fa3-bd9b-0d937ebe3205 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] 10.222.0.113 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.560967 Nov 02 13:32:42.535893 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2304/4276] 10.222.0.113 () {58 vars in 1127 bytes} [Wed Nov 2 13:32:41 2022] GET /compute/v2.1/limits => generated 511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:42.546632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:42.549779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: bd91b461-05bb-403c-b07f-181066f71ffe] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:42.573026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.574551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.575102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.576000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.576524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.577221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.815706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:42.830800 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1d7c92b0-a6da-46f2-a898-603335c43b5d tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe" status: 200 len: 1518 microversion: 2.1 time: 0.292530 Nov 02 13:32:42.837893 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2305/4277] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:42 2022] GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:42.852588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:42.855890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:42.870400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.874137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.876623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:42.878893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:42.879547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:42.881707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:43.186220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:43.197208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:43.205123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:43.206496 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de2d033f-6b8b-4399-94e2-ebaacfa6b100 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.367391 Nov 02 13:32:43.207101 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2306/4278] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:42 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:43.213235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6744dd1-1285-40ee-be05-cc1e015a53f2 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1354751673", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:43.345755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-f6744dd1-1285-40ee-be05-cc1e015a53f2 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:32:43.862941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-f6744dd1-1285-40ee-be05-cc1e015a53f2 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Getting quotas for project d52b3a73f08547bbb8581d6ada22ebd4. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:43.901714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-f6744dd1-1285-40ee-be05-cc1e015a53f2 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Getting quotas for user 7b481d586dc2493888703f2a4380d340 and project d52b3a73f08547bbb8581d6ada22ebd4. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:43.952981 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-f6744dd1-1285-40ee-be05-cc1e015a53f2 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6744dd1-1285-40ee-be05-cc1e015a53f2 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Request method failure captured: Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 1752 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnF521VbPP0rJCxS5B4hdfPMLebpRjb1P1Gta0H2RzKGDxSBzWLAIqzZAt3__jV_yx6E62o7uZ0x7rQu0wd14GiWCi1vMHNLoigJybVVYp99DZFGSm9HBoWaiu4cWVUgah_wZBqTWdaatRhnWG-BnzxuE5XAPczMVJSIkSmidmZBFOc Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d52b3a73f08547bbb8581d6ada22ebd4 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1677911775 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d52b3a73f08547bbb8581d6ada22ebd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d52b3a73f08547bbb8581d6ada22ebd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d52b3a73f08547bbb8581d6ada22ebd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d52b3a73f08547bbb8581d6ada22ebd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1677911775 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d52b3a73f08547bbb8581d6ada22ebd4 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1677911775 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 7b481d586dc2493888703f2a4380d340 Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1354751673", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:43.956468 n-d-858384-19 devstack@n-api.service[120928]: exception: Maximum number of metadata items exceeds 128 Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1354751673', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:43.969731 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6744dd1-1285-40ee-be05-cc1e015a53f2 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f6744dd1-1285-40ee-be05-cc1e015a53f2 tempest-AbsoluteLimitsNegativeTestJSON-1677911775 tempest-AbsoluteLimitsNegativeTestJSON-1677911775-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.756392 Nov 02 13:32:43.985502 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2307/4279] 10.222.0.113 () {60 vars in 1153 bytes} [Wed Nov 2 13:32:43 2022] POST /compute/v2.1/servers => generated 87 bytes in 764 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:32:43.992969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:43.996688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:44.009426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.012572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.015556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.025794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Updating instance_info_cache with network_info: [] {{(pid=120929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 13:32:44.029724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.031192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.033633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.285915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:44.404165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:44.406635 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee9cdc97-0288-4955-83e1-543cfce47213 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "DELETE /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 204 len: 0 microversion: 2.1 time: 3.702111 Nov 02 13:32:44.408194 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1973/4280] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:40 2022] DELETE /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 0 bytes in 3704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:32:44.412399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:44.416113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:44.417297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:44.424541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.425304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.425903 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45881237-c669-4819-bca1-d235e5b11d09 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c" status: 200 len: 1519 microversion: 2.1 time: 0.447174 Nov 02 13:32:44.427388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.428065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.428572 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2308/4281] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:43 2022] GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c => generated 1519 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:44.429090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.429741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.435475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-33b3cd09-b4a3-4e1c-a049-3c96b0e51d19 req-cb98d7ce-d0ca-4e9a-af21-a8c18fdd7650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e57c4d-4569-49a6-a42a-493bb7904624", "name": "network-vif-deleted", "tag": "1b493f0a-2ada-4730-97e9-2afd52152e70"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:44.468312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-33b3cd09-b4a3-4e1c-a049-3c96b0e51d19 req-cb98d7ce-d0ca-4e9a-af21-a8c18fdd7650 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.468843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-33b3cd09-b4a3-4e1c-a049-3c96b0e51d19 req-cb98d7ce-d0ca-4e9a-af21-a8c18fdd7650 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.472876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-33b3cd09-b4a3-4e1c-a049-3c96b0e51d19 req-cb98d7ce-d0ca-4e9a-af21-a8c18fdd7650 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.514353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.compute.server_external_events [req-33b3cd09-b4a3-4e1c-a049-3c96b0e51d19 req-cb98d7ce-d0ca-4e9a-af21-a8c18fdd7650 service nova] Unable to find a host for instance 36e57c4d-4569-49a6-a42a-493bb7904624. Dropping event network-vif-deleted {{(pid=120928) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 13:32:44.532603 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-33b3cd09-b4a3-4e1c-a049-3c96b0e51d19 req-cb98d7ce-d0ca-4e9a-af21-a8c18fdd7650 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.085737 Nov 02 13:32:44.535410 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2309/4282] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 106 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 13:32:44.555379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:44.555379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:44.559805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.560305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.560751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.561828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.562051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.562341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.816605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:44.832708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:44.835099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:44.836405 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ad72185d-bf98-48a9-b607-c2b7b61652d8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.300086 Nov 02 13:32:44.837006 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2310/4283] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:44 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:44.840613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:44.852249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:44.854127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 36e57c4d-4569-49a6-a42a-493bb7904624] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:44.854378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a56f7813-4829-4cb0-93d4-cbfd9293d5af tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 0.441668 Nov 02 13:32:44.861884 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1974/4284] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:44 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:44.876724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:44.877564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:44.882718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.883394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.883698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.884436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.884866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.885301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.894719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.895835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.897986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.898998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.900391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.904868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.923163 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] HTTP exception thrown: Instance 36e57c4d-4569-49a6-a42a-493bb7904624 could not be found. Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Request method failure captured: Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 HTTP/1.1 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm6io6tF-FtuHS0PIEx8WBk2Wt554RWt5TmvXvpV-_ZV4TeWwlsjkPqRSQjlI7PmR7zwqYtUKC3M16qm-e8e_Zylrzb09VgeuR3gmq3vpnrryPrGKVgGkKZwswfheyIrDEpUdlZKsyjADDwsXbwx6CT8jxHfty333F9KEw09H8QZcjw Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: fa31baf6e9c94e8393baad059544adb5 Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 36e57c4d-4569-49a6-a42a-493bb7904624 could not be found. Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '36e57c4d-4569-49a6-a42a-493bb7904624'} Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e57c4d-4569-49a6-a42a-493bb7904624 could not be found. Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e57c4d-4569-49a6-a42a-493bb7904624 could not be found. Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:44.924710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e57c4d-4569-49a6-a42a-493bb7904624 could not be found. Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Returning 404 to user: Instance 36e57c4d-4569-49a6-a42a-493bb7904624 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1515143d-6e65-48cc-98fd-89741223673a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624" status: 404 len: 111 microversion: 2.1 time: 0.088177 Nov 02 13:32:44.929590 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2311/4285] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:44 2022] GET /compute/v2.1/servers/36e57c4d-4569-49a6-a42a-493bb7904624 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:44.934988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:44.935512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:44.949234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:44.957244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.957741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.958214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:44.959016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:44.959516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:44.960129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.029332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:45.126775 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5860b470-7c12-43ef-b525-7fead473f628 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "DELETE /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c" status: 204 len: 0 microversion: 2.1 time: 0.262946 Nov 02 13:32:45.127391 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1975/4286] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:44 2022] DELETE /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:45.136131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:45.136826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:45.155986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.156766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.158296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.159218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.160302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.163552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.196059 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d7c4e382-0523-4831-8824-011fd9ae0470 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 204 len: 0 microversion: 2.1 time: 0.264540 Nov 02 13:32:45.196962 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2312/4287] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:44 2022] DELETE /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:45.205856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:45.206572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:45.218928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.219444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.219887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.220603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.226765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.227408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.451241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:45.464353 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-889deb3f-1485-47c7-8512-bde591afbc83 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1470 microversion: 2.1 time: 0.262655 Nov 02 13:32:45.468910 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2313/4288] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:45 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:45.863915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:45.865338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:45.879819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.881189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.881644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.884655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.885927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.888374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.919306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:45.935758 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7195da0d-0333-4e9f-8ab7-1940d3dda202 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c" status: 200 len: 1525 microversion: 2.1 time: 0.802223 Nov 02 13:32:45.938645 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1976/4289] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:45 2022] GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c => generated 1525 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:45.952304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:45.954521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:45.976539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.978352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.980612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:45.984360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:45.985664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:45.987060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:46.306848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:46.326256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:46.331706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:46.333593 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-65ae1db6-454d-4774-89c1-e061cd24424e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.473323 Nov 02 13:32:46.334432 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2314/4290] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:45 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:32:46.338386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:46.349035 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0ba187bf-4caa-485c-a94a-542e3f427036 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 0.408110 Nov 02 13:32:46.352008 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1977/4291] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:45 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:46.493849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:46.493849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:46.501868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:46.502367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:46.502814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:46.503576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:46.510050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:46.510815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:46.651513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:46.660992 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0771f583-30dd-4515-8a5b-437567769e0f tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1470 microversion: 2.1 time: 0.173022 Nov 02 13:32:46.663045 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2315/4292] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:46 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:46.964780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:46.966019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:46.969151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=16 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:46.979840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:46.981660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:46.982660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:46.984765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:46.988587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:46.989248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:47.228537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:47.239937 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5062053f-7de2-4a15-95a4-65ccf7e853a8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c" status: 200 len: 1525 microversion: 2.1 time: 0.278990 Nov 02 13:32:47.250140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1978/4293] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:46 2022] GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c => generated 1525 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:47.363971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:47.364738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:47.377154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:47.386365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:47.387227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:47.388519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:47.390646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:47.391074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:47.391906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:47.394430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:47.409934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:47.410422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:47.410877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:47.417350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:47.417860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:47.418312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:47.798584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:47.815563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:47.821057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:47.825594 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06714bb6-1e75-4842-8b31-ca9a57cf021f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.466749 Nov 02 13:32:47.843728 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2316/4294] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:47 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:47.843728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:47.843728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:47.858552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:47.859588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:47.860300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:47.861280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:47.861969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:47.862671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:47.931633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:47.946455 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8ee01c2c-1232-4c8a-9e23-5163f80a1514 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 0.561872 Nov 02 13:32:47.947072 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1979/4295] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:47 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:48.105487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:48.115675 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05919fb8-e334-4728-9ed1-328a9d7c1a5c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1470 microversion: 2.1 time: 0.284532 Nov 02 13:32:48.116588 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2317/4296] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:47 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:48.137166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-839578e8-85e6-4232-b774-a5b8683cedee req-58b3647b-68b5-43d2-9f7c-5ce9f4ec391d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60eb1c44-792a-42b2-9ac8-2b6278e38cbd", "name": "network-vif-plugged", "status": "completed", "tag": "14a9ab8c-8537-4d8a-bb52-726abf524a19"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:48.182671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-839578e8-85e6-4232-b774-a5b8683cedee req-58b3647b-68b5-43d2-9f7c-5ce9f4ec391d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:48.188112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-839578e8-85e6-4232-b774-a5b8683cedee req-58b3647b-68b5-43d2-9f7c-5ce9f4ec391d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:48.192373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-839578e8-85e6-4232-b774-a5b8683cedee req-58b3647b-68b5-43d2-9f7c-5ce9f4ec391d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:48.234488 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-839578e8-85e6-4232-b774-a5b8683cedee req-58b3647b-68b5-43d2-9f7c-5ce9f4ec391d service nova] Creating event network-vif-plugged:14a9ab8c-8537-4d8a-bb52-726abf524a19 for instance 60eb1c44-792a-42b2-9ac8-2b6278e38cbd on n-h1-858384-19 Nov 02 13:32:48.261520 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-839578e8-85e6-4232-b774-a5b8683cedee req-58b3647b-68b5-43d2-9f7c-5ce9f4ec391d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122066 Nov 02 13:32:48.264685 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1980/4297] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:48.278048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:48.278695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:48.292356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:48.294871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:48.295785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:48.298683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:48.300056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:48.302663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:48.782891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:48.795149 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6a6838d7-86cd-4407-b01a-e7bcd4de97b7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c" status: 200 len: 1525 microversion: 2.1 time: 0.532860 Nov 02 13:32:48.795760 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2318/4298] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:48 2022] GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c => generated 1525 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:48.859865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:48.861378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:48.875085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:48.876683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:48.880760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:48.881778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:48.883176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:48.883926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:48.972312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:48.973199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:48.984944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:48.985608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:48.986270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:48.988591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:48.989454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:48.991883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:49.417608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:49.431043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10e601d2-d631-4b24-8802-5feb14ed898c tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 0.463550 Nov 02 13:32:49.447136 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2319/4299] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:48 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:49.456179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:49.459140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:49.474143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:49.477221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:49.477675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:49.478409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:49.481268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:49.481871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:49.587997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:49.610366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:49.618034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:49.621217 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-70fab4d3-fa7e-4655-8d08-a6f7ba19e8af tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.767709 Nov 02 13:32:49.659563 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1981/4300] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:48 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:49.778951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:49.795794 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-65fbf6ba-305a-487c-8275-97f76a81a07a tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1470 microversion: 2.1 time: 0.355816 Nov 02 13:32:49.796435 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2320/4301] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:49 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1470 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:49.823224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:49.824128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:49.840582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:49.841327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:49.841949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:49.842825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:49.846003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:49.846769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:49.892288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:50.148121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7af8e775-f108-4d7a-a408-795e114c4b56 req-78116665-ec5c-47f3-9115-fec997944ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75714141-548d-4be5-bcdd-fc9ee050212c", "name": "network-vif-deleted", "tag": "b44d899f-02b2-4b2c-ba4c-f20d54df181e"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:50.203660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7af8e775-f108-4d7a-a408-795e114c4b56 req-78116665-ec5c-47f3-9115-fec997944ebe service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:50.204420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7af8e775-f108-4d7a-a408-795e114c4b56 req-78116665-ec5c-47f3-9115-fec997944ebe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:50.208471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7af8e775-f108-4d7a-a408-795e114c4b56 req-78116665-ec5c-47f3-9115-fec997944ebe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:50.295501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:50.311243 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7af8e775-f108-4d7a-a408-795e114c4b56 req-78116665-ec5c-47f3-9115-fec997944ebe service nova] Creating event network-vif-deleted:b44d899f-02b2-4b2c-ba4c-f20d54df181e for instance 75714141-548d-4be5-bcdd-fc9ee050212c on n-h2-858384-19 Nov 02 13:32:50.319795 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5d2aa343-a014-4b0e-8dd9-7b1a7249dff6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c" status: 200 len: 1483 microversion: 2.1 time: 0.501315 Nov 02 13:32:50.325789 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1982/4302] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:49 2022] GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c => generated 1483 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:50.331896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7af8e775-f108-4d7a-a408-795e114c4b56 req-78116665-ec5c-47f3-9115-fec997944ebe service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190389 Nov 02 13:32:50.335587 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2321/4303] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:50.461961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:50.464084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:50.481531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:50.482431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:50.483159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:50.484219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:50.484904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:50.485546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:50.662707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:50.663800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:50.671666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:50.672507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:50.673161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:50.674262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:50.674925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:50.675591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.185020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:51.225657 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1c57a79-0842-4c7c-a4b1-02c13785f286 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1321 microversion: 2.1 time: 0.763884 Nov 02 13:32:51.227454 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1983/4304] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:50 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1321 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:32:51.240181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:51.243508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:51.308699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.314031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.314600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.315409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.320242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.323130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.435127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:51.450723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.451265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.451797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:51.451920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.452331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lazy-loading 'fault' on Instance uuid a6ed66e0-3944-4d50-91e7-f1e513a1445c {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:32:51.469925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:51.475923 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d7c14f62-3f07-4d08-8ef2-f3370df794d1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.818362 Nov 02 13:32:51.479779 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2322/4305] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:50 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:51.494885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-43b75d23-0e7e-493e-8cf8-96d5a870398e req-90cb7f7d-0645-4ff8-b2e7-f1e6bdccafb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6ed66e0-3944-4d50-91e7-f1e513a1445c", "name": "network-vif-deleted", "tag": "2764793c-ec29-4458-aec8-62c6e775e8f7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:51.524268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-43b75d23-0e7e-493e-8cf8-96d5a870398e req-90cb7f7d-0645-4ff8-b2e7-f1e6bdccafb6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.524978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-43b75d23-0e7e-493e-8cf8-96d5a870398e req-90cb7f7d-0645-4ff8-b2e7-f1e6bdccafb6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.525590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-43b75d23-0e7e-493e-8cf8-96d5a870398e req-90cb7f7d-0645-4ff8-b2e7-f1e6bdccafb6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.576930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:51.584957 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-43b75d23-0e7e-493e-8cf8-96d5a870398e req-90cb7f7d-0645-4ff8-b2e7-f1e6bdccafb6 service nova] Creating event network-vif-deleted:2764793c-ec29-4458-aec8-62c6e775e8f7 for instance a6ed66e0-3944-4d50-91e7-f1e513a1445c on n-h2-858384-19 Nov 02 13:32:51.594610 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40b75aa6-732f-447b-8f06-6243024b241c tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 200 len: 1309 microversion: 2.1 time: 0.358766 Nov 02 13:32:51.596140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1984/4306] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:51 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:51.603526 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-43b75d23-0e7e-493e-8cf8-96d5a870398e req-90cb7f7d-0645-4ff8-b2e7-f1e6bdccafb6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111570 Nov 02 13:32:51.604379 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2323/4307] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:51.621956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:51.622671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:51.646858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.647948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.648692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.650848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.652695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.657561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.681443 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] HTTP exception thrown: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Request method failure captured: Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c HTTP/1.1 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnFWlWgF89ius07vXkUG15cCo_KT350CKLjl8r-WMkxCkaNwUgHxwdgtXQOZpMQA7H97QEg0bXdof0ex-WhHsAFnXjxnWnL893VHBNXJdILjLDH2TlU1XTp8be8Ld6bU2i0USJXBzdum56IlDzB8ncsjbWS6me7difw5EhrlunVXb-M Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: b6eba5b1172f4e2791e039d18904ed58 Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '75714141-548d-4be5-bcdd-fc9ee050212c'} Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.683139 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:51.687199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.687199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:51.687199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:51.687199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:51.687199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:51.687199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:51.687199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:51.687199 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.693032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Returning 404 to user: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:51.699966 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6207e0ca-8a59-4ead-96b6-9bbb0957af25 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c" status: 404 len: 111 microversion: 2.1 time: 0.089379 Nov 02 13:32:51.708981 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2324/4308] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:51 2022] GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:51.713998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:51.727659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:51.730329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:32:51.746612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.747103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.747575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.748301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:51.752927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:51.753528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:51.848949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1684533489", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "47bb2f77-f27b-4713-bfef-5f74b66d9d9d"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:51.937022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] validate_networks() for [('47bb2f77-f27b-4713-bfef-5f74b66d9d9d', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:32:51.952266 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2333d9f8-0f1f-4796-8263-02431b0bcffd tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.219986 Nov 02 13:32:51.955890 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2325/4309] 10.222.0.113 () {58 vars in 1235 bytes} [Wed Nov 2 13:32:51 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:32:51.970614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-398472d0-b8a2-42ce-9c31-a68326c710c6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-398472d0-b8a2-42ce-9c31-a68326c710c6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Request method failure captured: Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnFWlWgF89ius07vXkUG15cCo_KT350CKLjl8r-WMkxCkaNwUgHxwdgtXQOZpMQA7H97QEg0bXdof0ex-WhHsAFnXjxnWnL893VHBNXJdILjLDH2TlU1XTp8be8Ld6bU2i0USJXBzdum56IlDzB8ncsjbWS6me7difw5EhrlunVXb-M Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: b6eba5b1172f4e2791e039d18904ed58 Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: action_args: {} Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi '2011/01/01' Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 13:32:51.979989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 02 13:32:51.986057 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:51.988425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-398472d0-b8a2-42ce-9c31-a68326c710c6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:51.989806 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-398472d0-b8a2-42ce-9c31-a68326c710c6 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.025043 Nov 02 13:32:51.993706 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2326/4310] 10.222.0.113 () {58 vars in 1187 bytes} [Wed Nov 2 13:32:51 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:32:52.018854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:52.052391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:52.053852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Searching by: {'deleted': False, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:32:52.062445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.063347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.064189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.065160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.066272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.068003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.129713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:32:52.180530 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc10503a-b6cb-4fdd-8418-c4298e0c7e3e tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 685 microversion: 2.1 time: 0.179354 Nov 02 13:32:52.181960 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2327/4311] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:32:51 2022] GET /compute/v2.1/servers => generated 685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:32:52.202589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:52.249359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:52.250844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.compute.servers [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Removing options 'limit' from query {{(pid=120928) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 02 13:32:52.260018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Searching by: {'deleted': False, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:32:52.287780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.290948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.291613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.294991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.295669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.296222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.357145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:52.374207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:32:52.499675 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09254aca-410f-44c9-a79d-52c5c0743132 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers?limit=102" status: 200 len: 685 microversion: 2.1 time: 0.309000 Nov 02 13:32:52.511191 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2328/4312] 10.222.0.113 () {58 vars in 1149 bytes} [Wed Nov 2 13:32:52 2022] GET /compute/v2.1/servers?limit=102 => generated 685 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:52.517980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:52.518756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:52.532189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.532800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.533309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.537909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.538521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.539039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.745292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:32:52.747316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:32:52.748139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:32:52.749169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:32:52.749784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:32:52.768533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.771006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.774069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.775200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:52.777074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:52.777677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:52.814473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:32:52.878672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for user be8bee2d23fa481193b5a23cf2348a73 and project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:32:52.950883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:32:52.967050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:32:53.086590 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7370656d-6d25-43b9-9c11-af3d2ca800ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.489059 Nov 02 13:32:53.088941 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1985/4313] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:32:51 2022] POST /compute/v2.1/servers => generated 382 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:32:53.123687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:53.126406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:53.143734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.144404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.146662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:53.149496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.150889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.153870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:53.293736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:53.308664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ba3827e9-cf99-46f2-9915-40d10f5d45e7 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1509 microversion: 2.1 time: 0.804505 Nov 02 13:32:53.311550 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2329/4314] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:52 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1509 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:53.343676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d062d49-aa4c-4dd1-9647-5ec3a516c335 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d062d49-aa4c-4dd1-9647-5ec3a516c335 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Request method failure captured: Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnFWlWgF89ius07vXkUG15cCo_KT350CKLjl8r-WMkxCkaNwUgHxwdgtXQOZpMQA7H97QEg0bXdof0ex-WhHsAFnXjxnWnL893VHBNXJdILjLDH2TlU1XTp8be8Ld6bU2i0USJXBzdum56IlDzB8ncsjbWS6me7difw5EhrlunVXb-M Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: b6eba5b1172f4e2791e039d18904ed58 Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: action_args: {} Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi '-1' Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 13:32:53.359159 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 02 13:32:53.364751 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.369173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d062d49-aa4c-4dd1-9647-5ec3a516c335 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:53.372059 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d062d49-aa4c-4dd1-9647-5ec3a516c335 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.059224 Nov 02 13:32:53.373149 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2330/4315] 10.222.0.113 () {58 vars in 1147 bytes} [Wed Nov 2 13:32:53 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:32:53.387217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:53.389489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: a6ed66e0-3944-4d50-91e7-f1e513a1445c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:53.420378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.423511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.424008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:53.424825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.425300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.425734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:53.482740 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] HTTP exception thrown: Instance a6ed66e0-3944-4d50-91e7-f1e513a1445c could not be found. Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Request method failure captured: Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c HTTP/1.1 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm6io6tF-FtuHS0PIEx8WBk2Wt554RWt5TmvXvpV-_ZV4TeWwlsjkPqRSQjlI7PmR7zwqYtUKC3M16qm-e8e_Zylrzb09VgeuR3gmq3vpnrryPrGKVgGkKZwswfheyIrDEpUdlZKsyjADDwsXbwx6CT8jxHfty333F9KEw09H8QZcjw Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: fa31baf6e9c94e8393baad059544adb5 Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance a6ed66e0-3944-4d50-91e7-f1e513a1445c could not be found. Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a6ed66e0-3944-4d50-91e7-f1e513a1445c'} Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ed66e0-3944-4d50-91e7-f1e513a1445c could not be found. Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ed66e0-3944-4d50-91e7-f1e513a1445c could not be found. Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:53.493133 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.497703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:53.497703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:53.497703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:53.497703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:53.497703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:53.497703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ed66e0-3944-4d50-91e7-f1e513a1445c could not be found. Nov 02 13:32:53.497703 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.508285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Returning 404 to user: Instance a6ed66e0-3944-4d50-91e7-f1e513a1445c could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:53.518615 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc178d47-1f85-4e15-8bdd-fbdb538c10e5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c" status: 404 len: 111 microversion: 2.1 time: 0.135205 Nov 02 13:32:53.524143 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2331/4316] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:53 2022] GET /compute/v2.1/servers/a6ed66e0-3944-4d50-91e7-f1e513a1445c => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:53.565098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4cc5d77b-d813-43cb-9672-bfd3e301e6d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:53.565998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4cc5d77b-d813-43cb-9672-bfd3e301e6d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:53.721975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:53.740908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:53.742826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:53.745833 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b4440d89-c237-486d-96b1-143c2281dabd tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.648299 Nov 02 13:32:53.746438 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1986/4317] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:53 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:53.764948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-48e88486-b842-40bf-b3fa-5ec58646574e tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:53.765462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-48e88486-b842-40bf-b3fa-5ec58646574e tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:53.773505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e88486-b842-40bf-b3fa-5ec58646574e tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.778827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e88486-b842-40bf-b3fa-5ec58646574e tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.779104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e88486-b842-40bf-b3fa-5ec58646574e tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:53.779907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e88486-b842-40bf-b3fa-5ec58646574e tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:53.780378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e88486-b842-40bf-b3fa-5ec58646574e tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:53.780870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e88486-b842-40bf-b3fa-5ec58646574e tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:53.878873 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-48e88486-b842-40bf-b3fa-5ec58646574e tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd/ips" status: 200 len: 108 microversion: 2.1 time: 0.131281 Nov 02 13:32:53.881262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1987/4318] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:32:53 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd/ips => generated 108 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:53.899068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c97b3f45-0d61-4155-84da-f8c3777d58b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c97b3f45-0d61-4155-84da-f8c3777d58b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Request method failure captured: Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnFWlWgF89ius07vXkUG15cCo_KT350CKLjl8r-WMkxCkaNwUgHxwdgtXQOZpMQA7H97QEg0bXdof0ex-WhHsAFnXjxnWnL893VHBNXJdILjLDH2TlU1XTp8be8Ld6bU2i0USJXBzdum56IlDzB8ncsjbWS6me7difw5EhrlunVXb-M Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: b6eba5b1172f4e2791e039d18904ed58 Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: action_args: {} Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'testing' Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 02 13:32:53.915788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 02 13:32:53.923658 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:32:53.930803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c97b3f45-0d61-4155-84da-f8c3777d58b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:53.931990 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c97b3f45-0d61-4155-84da-f8c3777d58b0 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.047825 Nov 02 13:32:53.940239 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1988/4319] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:32:53 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:32:53.941117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=22 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:53.962748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:53.967720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:54.002401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.007895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.010061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.015208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.016637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.023369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.113033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:54.410160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cc5d77b-d813-43cb-9672-bfd3e301e6d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:54.411502 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3235b71d-93cc-48e7-b8da-36afde8dc2d2 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 204 len: 0 microversion: 2.1 time: 0.465879 Nov 02 13:32:54.412705 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1989/4320] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:53 2022] DELETE /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:54.420431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ac8d4914-9016-4ba8-9139-6f0172dfb250 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:54.421936 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4cc5d77b-d813-43cb-9672-bfd3e301e6d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1212 microversion: 2.1 time: 0.895346 Nov 02 13:32:54.423449 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2332/4321] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:53 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1212 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:54.427267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ac8d4914-9016-4ba8-9139-6f0172dfb250 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:54.445134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a9063748-3e31-4d82-9239-20c773f17e8a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:54.446091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8d4914-9016-4ba8-9139-6f0172dfb250 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.446606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8d4914-9016-4ba8-9139-6f0172dfb250 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.449913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8d4914-9016-4ba8-9139-6f0172dfb250 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.450835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8d4914-9016-4ba8-9139-6f0172dfb250 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.453759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8d4914-9016-4ba8-9139-6f0172dfb250 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.454239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac8d4914-9016-4ba8-9139-6f0172dfb250 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.465791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a9063748-3e31-4d82-9239-20c773f17e8a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:54.466691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a9063748-3e31-4d82-9239-20c773f17e8a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:32:54.489065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.compute.servers [None req-a9063748-3e31-4d82-9239-20c773f17e8a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Flavor 'non_existing_flavor' could not be found {{(pid=120928) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Nov 02 13:32:54.498748 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a9063748-3e31-4d82-9239-20c773f17e8a tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.061402 Nov 02 13:32:54.498748 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2333/4322] 10.222.0.113 () {58 vars in 1183 bytes} [Wed Nov 2 13:32:54 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:32:54.510687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:54.523038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:54.540558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.541053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.541494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.542216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.542674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.545066 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ac8d4914-9016-4ba8-9139-6f0172dfb250 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd/ips" status: 200 len: 108 microversion: 2.1 time: 0.124976 Nov 02 13:32:54.547341 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1990/4323] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:32:54 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd/ips => generated 108 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:54.551021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.573563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:54.593486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:54.601160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:32:54.621604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.625088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.626926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.631037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.632897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.636019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.868185 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b738ee6e-df59-46f3-a73b-043eb21a38a4 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.318709 Nov 02 13:32:54.872770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1991/4324] 10.222.0.113 () {58 vars in 1179 bytes} [Wed Nov 2 13:32:54 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:32:54.876599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05d3893a-b8b3-4caa-a6a2-c6adf7479fdc tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:54.877591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05d3893a-b8b3-4caa-a6a2-c6adf7479fdc tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:54.894671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d3893a-b8b3-4caa-a6a2-c6adf7479fdc tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.895608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d3893a-b8b3-4caa-a6a2-c6adf7479fdc tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.897065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d3893a-b8b3-4caa-a6a2-c6adf7479fdc tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.900495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d3893a-b8b3-4caa-a6a2-c6adf7479fdc tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:54.904083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d3893a-b8b3-4caa-a6a2-c6adf7479fdc tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:54.906466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d3893a-b8b3-4caa-a6a2-c6adf7479fdc tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:54.995210 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05d3893a-b8b3-4caa-a6a2-c6adf7479fdc tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd/ips/tempest-ServerAddressesTestJSON-688903656-network" status: 200 len: 93 microversion: 2.1 time: 0.124029 Nov 02 13:32:54.995815 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1992/4325] 10.222.0.113 () {58 vars in 1403 bytes} [Wed Nov 2 13:32:54 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd/ips/tempest-ServerAddressesTestJSON-688903656-network => generated 93 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:32:55.004932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:55.009444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:55.031995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:55.032920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:55.035428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:55.037872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:55.038527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:55.040164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:55.209024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:55.230329 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bab42ad7-9abd-4421-b278-f70245271225 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1512 microversion: 2.1 time: 0.727519 Nov 02 13:32:55.232112 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2334/4326] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:54 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1512 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:55.255401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:55.269654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:55.270621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:32:55.286297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:55.294229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:55.294965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:55.295987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:55.296757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:55.297357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:55.575661 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7edf26b2-9018-4999-8e97-b60380fb71f7 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.330410 Nov 02 13:32:55.587486 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2335/4327] 10.222.0.113 () {58 vars in 1189 bytes} [Wed Nov 2 13:32:55 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:32:55.599358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:55.604037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:55.620482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:55.621221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:55.623392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:55.624673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:55.630381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:55.631325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:55.718148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:32:56.084862 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3f0db9ec-537c-4853-98fe-add6702cc650 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "DELETE /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 204 len: 0 microversion: 2.1 time: 0.495535 Nov 02 13:32:56.085609 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2336/4328] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:55 2022] DELETE /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:32:56.093315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:56.094048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:56.109125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:56.109533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:56.116065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:56.117930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:56.118721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:56.119193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:56.367880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:56.377834 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf4004e5-3b00-4dfd-b417-5823aefddc7c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1272 microversion: 2.1 time: 0.290790 Nov 02 13:32:56.382588 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2337/4329] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:56 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1272 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:56.396100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:56.407128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:56.423534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Searching by: {'deleted': False, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:32:56.434125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:56.434865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:56.435531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:56.436495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:56.444021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:56.444754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:56.526111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:32:56.590137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:56.611636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:56.613812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:56.617352 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d33b774b-d5c8-4d3e-a15d-e073dbfef33d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 1.620299 Nov 02 13:32:56.621696 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1993/4330] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:54 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:56.633714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:56.636788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:56.658140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:56.660510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:56.662543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:56.663163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:56.664499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:56.667986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:56.669591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:56.672572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:32:56.728252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:56.728998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:56.730590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:57.166971 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-017a69ec-9229-4f2a-8c5f-a4f7af5d15e2 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/detail" status: 200 len: 3029 microversion: 2.1 time: 0.782994 Nov 02 13:32:57.168292 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2338/4331] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:32:56 2022] GET /compute/v2.1/servers/detail => generated 3029 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:57.173250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:57.174159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:57.195652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:57.196740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:57.197410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:57.198436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:57.199135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:57.199800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:57.488022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:57.499780 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4bd4b388-5956-43b2-95d4-ae6b3f45c3d9 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1515 microversion: 2.1 time: 0.876768 Nov 02 13:32:57.503770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1994/4332] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:56 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1515 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:57.514658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-844c9a8a-12a1-46ff-8905-1d72fc592231 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:57.531880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-844c9a8a-12a1-46ff-8905-1d72fc592231 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:57.533121 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-844c9a8a-12a1-46ff-8905-1d72fc592231 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.027613 Nov 02 13:32:57.533739 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1995/4333] 10.222.0.113 () {58 vars in 1183 bytes} [Wed Nov 2 13:32:57 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:32:57.555422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:57.556325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:57.569737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:57.574524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:57.576119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:57.579070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:57.579768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:57.580449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:57.771691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:57.781463 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a93dbe3-b551-40ae-a7a4-c9d948642fbe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1270 microversion: 2.1 time: 0.233071 Nov 02 13:32:57.790287 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1996/4334] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:57 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:57.845697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:57.880774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:57.883470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Searching by: {'deleted': False, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:32:57.901758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:57.908216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:57.912420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:57.916825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:57.920524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:57.922636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:58.005832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:32:58.097390 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4aba9ec4-0097-49dd-9509-c04b9a6047dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 685 microversion: 2.1 time: 0.283622 Nov 02 13:32:58.105780 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1997/4335] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:32:57 2022] GET /compute/v2.1/servers => generated 685 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:58.111493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:58.112129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:58.128575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:58.129775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:58.130379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:58.131486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:58.131921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:58.132423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:58.358320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:58.380540 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d84164a3-407a-4d5d-958c-25122395abca tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 200 len: 1512 microversion: 2.1 time: 1.210704 Nov 02 13:32:58.381635 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2339/4336] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:57 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 1512 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:32:58.394794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b388b87e-afa6-4339-b8c6-1032c49dd1b0 req-4fe8b182-1db5-42c2-8e78-f8b8ac20470e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5", "name": "network-vif-deleted", "tag": "25f11a79-0efc-47bc-a160-afb66b8dfa92"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:32:58.487808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b388b87e-afa6-4339-b8c6-1032c49dd1b0 req-4fe8b182-1db5-42c2-8e78-f8b8ac20470e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:58.488310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b388b87e-afa6-4339-b8c6-1032c49dd1b0 req-4fe8b182-1db5-42c2-8e78-f8b8ac20470e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:58.499755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b388b87e-afa6-4339-b8c6-1032c49dd1b0 req-4fe8b182-1db5-42c2-8e78-f8b8ac20470e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:58.541943 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b388b87e-afa6-4339-b8c6-1032c49dd1b0 req-4fe8b182-1db5-42c2-8e78-f8b8ac20470e service nova] Creating event network-vif-deleted:25f11a79-0efc-47bc-a160-afb66b8dfa92 for instance 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 on n-h2-858384-19 Nov 02 13:32:58.570956 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b388b87e-afa6-4339-b8c6-1032c49dd1b0 req-4fe8b182-1db5-42c2-8e78-f8b8ac20470e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187978 Nov 02 13:32:58.571890 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2340/4337] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:32:58.578081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:58.579012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:58.612261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:58.615097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:58.644118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:58.646738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:58.647512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:58.661383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:58.683900 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] HTTP exception thrown: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Request method failure captured: Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c HTTP/1.1 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnFWlWgF89ius07vXkUG15cCo_KT350CKLjl8r-WMkxCkaNwUgHxwdgtXQOZpMQA7H97QEg0bXdof0ex-WhHsAFnXjxnWnL893VHBNXJdILjLDH2TlU1XTp8be8Ld6bU2i0USJXBzdum56IlDzB8ncsjbWS6me7difw5EhrlunVXb-M Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: b6eba5b1172f4e2791e039d18904ed58 Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '75714141-548d-4be5-bcdd-fc9ee050212c'} Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:32:58.694235 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Returning 404 to user: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:32:58.697697 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c04cfd1f-ef59-4d10-92cb-c207bedea50c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "DELETE /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c" status: 404 len: 111 microversion: 2.1 time: 0.123240 Nov 02 13:32:58.701918 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2341/4338] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:58 2022] DELETE /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:32:58.707830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:58.709135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:58.738393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:58.747610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:58.748511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:58.749506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:58.752460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:58.752460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:59.720149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:59.763649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:59.771579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:32:59.778177 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4cb5999b-a7da-4319-a32d-2d414de86fb0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 1.678366 Nov 02 13:32:59.791155 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1998/4339] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:32:58 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:32:59.800844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:32:59.805235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: bd91b461-05bb-403c-b07f-181066f71ffe] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:32:59.817851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:59.818444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:59.818896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:59.848449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:32:59.849078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:32:59.856798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:32:59.931859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: bd91b461-05bb-403c-b07f-181066f71ffe] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:00.030194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:00.050039 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f4a9a0f9-f154-473d-973c-f0dbbc80987b tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1515 microversion: 2.1 time: 1.346339 Nov 02 13:33:00.059971 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2342/4340] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:32:58 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1515 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:00.074366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:00.076262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:00.085985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:00.105266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.108286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.109680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.118526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.119906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.120489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.253216 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-720ff6c5-f2bc-42fc-b99a-c1325809c9e8 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "DELETE /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe" status: 204 len: 0 microversion: 2.1 time: 0.464387 Nov 02 13:33:00.255681 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 1999/4341] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:32:59 2022] DELETE /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:33:00.267647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:00.270652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:00.299194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.301122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.303511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.307336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.308256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.309872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.368413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] HTTP exception thrown: Instance 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 could not be found. Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Request method failure captured: Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 HTTP/1.1 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm6io6tF-FtuHS0PIEx8WBk2Wt554RWt5TmvXvpV-_ZV4TeWwlsjkPqRSQjlI7PmR7zwqYtUKC3M16qm-e8e_Zylrzb09VgeuR3gmq3vpnrryPrGKVgGkKZwswfheyIrDEpUdlZKsyjADDwsXbwx6CT8jxHfty333F9KEw09H8QZcjw Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: fa31baf6e9c94e8393baad059544adb5 Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 could not be found. Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5'} Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 could not be found. Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 could not be found. Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:00.374775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:00.379787 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:00.379787 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:00.379787 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:00.379787 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:00.379787 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:00.379787 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 could not be found. Nov 02 13:33:00.379787 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:00.380665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Returning 404 to user: Instance 7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:00.385064 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3e7c2c29-34a3-4475-8cc6-660ea14808f4 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5" status: 404 len: 111 microversion: 2.1 time: 0.123548 Nov 02 13:33:00.388768 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2000/4342] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:00 2022] GET /compute/v2.1/servers/7b03cdca-ebd5-4fa4-80ff-cdfeea29c8a5 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:33:00.413706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:00.414321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:00.452220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.452776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.453233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.453890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.454314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.454860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.582115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:00.833591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:00.846466 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c91a8da-a683-4b96-8480-47908bf25db0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1312 microversion: 2.1 time: 0.785139 Nov 02 13:33:00.854731 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d474764e-b0ab-45f9-91db-9ee53129e2f3 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "DELETE /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 204 len: 0 microversion: 2.1 time: 0.466914 Nov 02 13:33:00.859328 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2001/4343] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:33:00 2022] DELETE /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:33:00.876151 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2343/4344] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:00 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1312 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:00.878912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:00.882320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:00.892276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:00.893145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:00.901025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.901528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.903218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.904575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.905537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.906457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.927984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.930658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.932008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.935485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:00.936226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:00.937603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:00.961379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:01.151790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=5,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:01.167229 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-085e1c54-eaaf-4597-8e86-ef3808677798 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 204 len: 0 microversion: 2.1 time: 0.305414 Nov 02 13:33:01.168973 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2002/4345] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:33:00 2022] DELETE /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:33:01.175874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:01.177845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 75714141-548d-4be5-bcdd-fc9ee050212c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:01.192044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.193441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.193596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.194580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.196186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.196637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.258938 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] HTTP exception thrown: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Request method failure captured: Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c HTTP/1.1 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnFWlWgF89ius07vXkUG15cCo_KT350CKLjl8r-WMkxCkaNwUgHxwdgtXQOZpMQA7H97QEg0bXdof0ex-WhHsAFnXjxnWnL893VHBNXJdILjLDH2TlU1XTp8be8Ld6bU2i0USJXBzdum56IlDzB8ncsjbWS6me7difw5EhrlunVXb-M Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: b6eba5b1172f4e2791e039d18904ed58 Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '75714141-548d-4be5-bcdd-fc9ee050212c'} Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:01.263098 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:01.266625 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:01.266625 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:01.266625 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:01.266625 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:01.266625 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:01.266625 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:01.266625 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. Nov 02 13:33:01.266625 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:01.266625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Returning 404 to user: Instance 75714141-548d-4be5-bcdd-fc9ee050212c could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:01.268036 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99b36a2d-1bb1-422d-a9db-775774bc59dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c" status: 404 len: 111 microversion: 2.1 time: 0.097037 Nov 02 13:33:01.269783 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2003/4346] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:01 2022] GET /compute/v2.1/servers/75714141-548d-4be5-bcdd-fc9ee050212c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:33:01.300820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-85ccc471-f59b-47d2-bf06-ad3490d2d12a req-024c4e58-343a-4222-9abc-5150309788ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60eb1c44-792a-42b2-9ac8-2b6278e38cbd", "name": "network-vif-deleted", "tag": "14a9ab8c-8537-4d8a-bb52-726abf524a19"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:01.331884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-85ccc471-f59b-47d2-bf06-ad3490d2d12a req-024c4e58-343a-4222-9abc-5150309788ae service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.333446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-85ccc471-f59b-47d2-bf06-ad3490d2d12a req-024c4e58-343a-4222-9abc-5150309788ae service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.334370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-85ccc471-f59b-47d2-bf06-ad3490d2d12a req-024c4e58-343a-4222-9abc-5150309788ae service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.371863 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-85ccc471-f59b-47d2-bf06-ad3490d2d12a req-024c4e58-343a-4222-9abc-5150309788ae service nova] Creating event network-vif-deleted:14a9ab8c-8537-4d8a-bb52-726abf524a19 for instance 60eb1c44-792a-42b2-9ac8-2b6278e38cbd on n-h1-858384-19 Nov 02 13:33:01.390420 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-85ccc471-f59b-47d2-bf06-ad3490d2d12a req-024c4e58-343a-4222-9abc-5150309788ae service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112533 Nov 02 13:33:01.393255 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2004/4347] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:01.428778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:01.430799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:01.440160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.446196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.447047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.447917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.448655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.449336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.621669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9072a15377bd497fb117ce4aad116a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e131e64eb64346ba991ca2f0c4dfbf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:01.635344 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fae4e150-4f72-4bf8-aeb9-7d90481506ba tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 200 len: 1306 microversion: 2.1 time: 0.238466 Nov 02 13:33:01.636114 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2005/4348] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:01 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 1306 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:01.645837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:01.646681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:01.671857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.671857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.671857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.680676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.683408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.686785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.793949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:01.809233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:01.811447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:01.813547 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c3cf1a5-9a4e-405b-bcd3-9cb2c4a7dd5e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.936021 Nov 02 13:33:01.814737 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2344/4349] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:00 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:01.821524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:01.823025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: bd91b461-05bb-403c-b07f-181066f71ffe] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:01.834837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.835950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.837475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:01.838463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:01.839295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:01.840607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:02.278430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:02.292936 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-89ab0f7a-7404-4c07-a00f-85e5a15246ef tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1500 microversion: 2.1 time: 0.655936 Nov 02 13:33:02.311983 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2006/4350] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:01 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1500 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:02.321303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:02.322999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:02.337349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:02.342027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:02.342740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:02.345958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:02.350125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:02.350845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:02.531578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:02.541531 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0a1db2e0-8d39-4129-9725-15f8ce3cd033 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe" status: 200 len: 1524 microversion: 2.1 time: 0.725181 Nov 02 13:33:02.570539 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2345/4351] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:01 2022] GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe => generated 1524 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:02.659652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:02.661128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] [instance: 60eb1c44-792a-42b2-9ac8-2b6278e38cbd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:02.671451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:02.671959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:02.674998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:02.683555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:02.684223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:02.684747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:02.718213 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] HTTP exception thrown: Instance 60eb1c44-792a-42b2-9ac8-2b6278e38cbd could not be found. Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Request method failure captured: Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd HTTP/1.1 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnForu3EEqxyJ_3AresL1CQ7CDvpR9z5VAqk4EkFQuDgoMMDMgiroE31p4OEX4V6aizrfF61ENW0sdu5RQaNwqfY5AEZircOQamqWQEvaTtdTzVv2au_ViJQrE7uoBwpiz3Yq3Gu1eKMO7YcDW_zl3H7dFeq7hW1V242j32nNd523jU Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e131e64eb64346ba991ca2f0c4dfbf94 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerAddressesTestJSON-1991997510 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e131e64eb64346ba991ca2f0c4dfbf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e131e64eb64346ba991ca2f0c4dfbf94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e131e64eb64346ba991ca2f0c4dfbf94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e131e64eb64346ba991ca2f0c4dfbf94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerAddressesTestJSON-1991997510 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e131e64eb64346ba991ca2f0c4dfbf94 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1991997510 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerAddressesTestJSON-1991997510-project Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 9072a15377bd497fb117ce4aad116a18 Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerAddressesTestJSON-1991997510-project Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 60eb1c44-792a-42b2-9ac8-2b6278e38cbd could not be found. Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '60eb1c44-792a-42b2-9ac8-2b6278e38cbd'} Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60eb1c44-792a-42b2-9ac8-2b6278e38cbd could not be found. Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60eb1c44-792a-42b2-9ac8-2b6278e38cbd could not be found. Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:02.725963 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:02.730426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:02.730426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:02.730426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:02.730426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:02.730426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:02.730426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60eb1c44-792a-42b2-9ac8-2b6278e38cbd could not be found. Nov 02 13:33:02.730426 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:02.732200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] Returning 404 to user: Instance 60eb1c44-792a-42b2-9ac8-2b6278e38cbd could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:02.733303 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-039480f7-7a8e-4be3-befd-c2a9724ec428 tempest-ServerAddressesTestJSON-1991997510 tempest-ServerAddressesTestJSON-1991997510-project] 10.222.0.113 "GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd" status: 404 len: 111 microversion: 2.1 time: 0.079394 Nov 02 13:33:02.737791 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2346/4352] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:02 2022] GET /compute/v2.1/servers/60eb1c44-792a-42b2-9ac8-2b6278e38cbd => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:33:02.841507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:02.842927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:02.855697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:02.869609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:02.875034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:02.876085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:02.876772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:02.880251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:02.920973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:03.266566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:03.283258 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c8eedd67-26f8-4dc4-b413-72938706b63a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1312 microversion: 2.1 time: 0.969984 Nov 02 13:33:03.302423 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2007/4353] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:02 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1312 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:03.325800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:03.326661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:03.337869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:03.341280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:03.341960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:03.343356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:03.348190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:03.349791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:03.923762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:03.932172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ab521cd-e782-40fe-bfdf-3f8cdd521f46 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1500 microversion: 2.1 time: 0.610562 Nov 02 13:33:03.932626 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2008/4354] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:03 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1500 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:03.937218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:03.937833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: bd91b461-05bb-403c-b07f-181066f71ffe] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:03.964381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:03.965234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:03.965881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:03.966808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:03.967698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:03.968329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:04.238020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:04.247142 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-846b7e1e-391b-47db-8800-bf8a88b50053 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe" status: 200 len: 1482 microversion: 2.1 time: 0.313464 Nov 02 13:33:04.259366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2009/4355] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:03 2022] GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe => generated 1482 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:04.314012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:04.315428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:04.326700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:04.327252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:04.327676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:04.343617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:04.352060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:04.352827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:04.641172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:04.686350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:04.702514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:04.705595 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee29d199-73a7-4fef-98f0-488c0d2b7412 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 1.866692 Nov 02 13:33:04.721342 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2347/4356] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:02 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:04.740390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b14734f2-869e-4cba-ae9a-90c4a0a6a24d req-ea21bf50-e20e-43e2-a4f8-1c4ce1a53d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd91b461-05bb-403c-b07f-181066f71ffe", "name": "network-vif-deleted", "tag": "aff65f7b-505b-4417-b336-bf64beea6e66"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:04.795639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b14734f2-869e-4cba-ae9a-90c4a0a6a24d req-ea21bf50-e20e-43e2-a4f8-1c4ce1a53d18 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:04.797491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b14734f2-869e-4cba-ae9a-90c4a0a6a24d req-ea21bf50-e20e-43e2-a4f8-1c4ce1a53d18 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:04.805042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b14734f2-869e-4cba-ae9a-90c4a0a6a24d req-ea21bf50-e20e-43e2-a4f8-1c4ce1a53d18 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:04.846334 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b14734f2-869e-4cba-ae9a-90c4a0a6a24d req-ea21bf50-e20e-43e2-a4f8-1c4ce1a53d18 service nova] Creating event network-vif-deleted:aff65f7b-505b-4417-b336-bf64beea6e66 for instance bd91b461-05bb-403c-b07f-181066f71ffe on n-h1-858384-19 Nov 02 13:33:04.873175 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b14734f2-869e-4cba-ae9a-90c4a0a6a24d req-ea21bf50-e20e-43e2-a4f8-1c4ce1a53d18 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142324 Nov 02 13:33:04.875155 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2348/4357] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:04.888829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e5b2fc6a-66e9-4cd1-861e-9287cc7b52fb req-dd3e6a64-afa9-4b9c-b955-33bc48e54c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59cb0435-5222-4140-af24-8cea35c0daa6", "tag": "52fe1de7-a4e2-46a0-8735-175040987808"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:04.933709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e5b2fc6a-66e9-4cd1-861e-9287cc7b52fb req-dd3e6a64-afa9-4b9c-b955-33bc48e54c0b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:04.934509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e5b2fc6a-66e9-4cd1-861e-9287cc7b52fb req-dd3e6a64-afa9-4b9c-b955-33bc48e54c0b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:04.935698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e5b2fc6a-66e9-4cd1-861e-9287cc7b52fb req-dd3e6a64-afa9-4b9c-b955-33bc48e54c0b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:04.986862 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e5b2fc6a-66e9-4cd1-861e-9287cc7b52fb req-dd3e6a64-afa9-4b9c-b955-33bc48e54c0b service nova] Creating event network-changed:52fe1de7-a4e2-46a0-8735-175040987808 for instance 59cb0435-5222-4140-af24-8cea35c0daa6 on n-h2-858384-19 Nov 02 13:33:05.007160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e5b2fc6a-66e9-4cd1-861e-9287cc7b52fb req-dd3e6a64-afa9-4b9c-b955-33bc48e54c0b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128933 Nov 02 13:33:05.015844 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2349/4358] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:05.024047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:05.043759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:05.052114 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5da215b-86c4-407a-8712-d63e01ec0f06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1312 microversion: 2.1 time: 0.742018 Nov 02 13:33:05.053776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:05.055434 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2010/4359] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:04 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1312 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:05.069475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.073577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.074262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:05.075245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.077839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.078468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:05.093218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:05.276978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:05.278299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: bd91b461-05bb-403c-b07f-181066f71ffe] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:05.292867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.293369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.293803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:05.294530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.294995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.304100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:05.404831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.408580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.409253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:05.410903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lazy-loading 'fault' on Instance uuid bd91b461-05bb-403c-b07f-181066f71ffe {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:33:05.494551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:05.507514 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29225e09-c3b0-475a-8564-acfb493521f6 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 200 len: 1291 microversion: 2.1 time: 0.489653 Nov 02 13:33:05.512214 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2350/4360] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:05 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 1291 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:05.531984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f29360c5-df21-4b9c-bed7-d14a82e0c844 req-e63c3c99-452d-4399-a748-4ef4c8228990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-plugged", "status": "completed", "tag": "7a0e3e23-49a6-431b-bfe5-ae6397b899d3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:05.580728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f29360c5-df21-4b9c-bed7-d14a82e0c844 req-e63c3c99-452d-4399-a748-4ef4c8228990 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.581415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f29360c5-df21-4b9c-bed7-d14a82e0c844 req-e63c3c99-452d-4399-a748-4ef4c8228990 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.581864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f29360c5-df21-4b9c-bed7-d14a82e0c844 req-e63c3c99-452d-4399-a748-4ef4c8228990 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:05.609826 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f29360c5-df21-4b9c-bed7-d14a82e0c844 req-e63c3c99-452d-4399-a748-4ef4c8228990 service nova] Creating event network-vif-plugged:7a0e3e23-49a6-431b-bfe5-ae6397b899d3 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:33:05.625844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:05.634631 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f3fdb7a-461e-4730-9fb0-bd3933d94c97 tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe" status: 200 len: 1316 microversion: 2.1 time: 0.362015 Nov 02 13:33:05.637809 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2011/4361] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:05 2022] GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:05.638066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f29360c5-df21-4b9c-bed7-d14a82e0c844 req-e63c3c99-452d-4399-a748-4ef4c8228990 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123992 Nov 02 13:33:05.639264 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2351/4362] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:05.739848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:05.740671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:05.752316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.752724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.753425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:05.757143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:05.758643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:05.760307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.079815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.081152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:06.105314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.108495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.112531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.113540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.118205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.119949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.456817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:06.558107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:06.580985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:06.603383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:06.604777 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3c920c0d-a46a-4c73-87bb-4cfe2259ffb5 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.870271 Nov 02 13:33:06.605391 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2012/4363] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:05 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:33:06.623978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.647987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:06.656474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: f9788658-3399-4fa6-b84d-f611bcf47d64] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:06.671715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.672209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.672649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.673988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.674450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.674885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.719224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] HTTP exception thrown: Instance f9788658-3399-4fa6-b84d-f611bcf47d64 could not be found. Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Request method failure captured: Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 HTTP/1.1 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYm6io6tF-FtuHS0PIEx8WBk2Wt554RWt5TmvXvpV-_ZV4TeWwlsjkPqRSQjlI7PmR7zwqYtUKC3M16qm-e8e_Zylrzb09VgeuR3gmq3vpnrryPrGKVgGkKZwswfheyIrDEpUdlZKsyjADDwsXbwx6CT8jxHfty333F9KEw09H8QZcjw Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: fa31baf6e9c94e8393baad059544adb5 Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f9788658-3399-4fa6-b84d-f611bcf47d64 could not be found. Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f9788658-3399-4fa6-b84d-f611bcf47d64'} Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9788658-3399-4fa6-b84d-f611bcf47d64 could not be found. Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9788658-3399-4fa6-b84d-f611bcf47d64 could not be found. Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:06.721767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.726022 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.726022 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:06.726022 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:06.726022 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:06.726022 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:06.726022 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9788658-3399-4fa6-b84d-f611bcf47d64 could not be found. Nov 02 13:33:06.726022 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.730594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Returning 404 to user: Instance f9788658-3399-4fa6-b84d-f611bcf47d64 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:06.732380 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3b1a92c6-70bc-456b-924e-1bb486dbc7cd tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64" status: 404 len: 111 microversion: 2.1 time: 0.119282 Nov 02 13:33:06.734138 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2013/4364] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/servers/f9788658-3399-4fa6-b84d-f611bcf47d64 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:33:06.747839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.748801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: bd91b461-05bb-403c-b07f-181066f71ffe] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:06.759501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.760275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.760878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.762046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.762659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.764164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.788080 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] HTTP exception thrown: Instance bd91b461-05bb-403c-b07f-181066f71ffe could not be found. Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Request method failure captured: Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe HTTP/1.1 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnFWlWgF89ius07vXkUG15cCo_KT350CKLjl8r-WMkxCkaNwUgHxwdgtXQOZpMQA7H97QEg0bXdof0ex-WhHsAFnXjxnWnL893VHBNXJdILjLDH2TlU1XTp8be8Ld6bU2i0USJXBzdum56IlDzB8ncsjbWS6me7difw5EhrlunVXb-M Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: b6eba5b1172f4e2791e039d18904ed58 Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance bd91b461-05bb-403c-b07f-181066f71ffe could not be found. Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'bd91b461-05bb-403c-b07f-181066f71ffe'} Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd91b461-05bb-403c-b07f-181066f71ffe could not be found. Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd91b461-05bb-403c-b07f-181066f71ffe could not be found. Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.790062 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:06.794359 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.794359 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:06.794359 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:06.794359 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:06.794359 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:06.794359 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:06.794359 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd91b461-05bb-403c-b07f-181066f71ffe could not be found. Nov 02 13:33:06.794359 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:06.799714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:06.801905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Returning 404 to user: Instance bd91b461-05bb-403c-b07f-181066f71ffe could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:06.806512 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e1721ecb-bbe2-4131-bc32-432b46ba636c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe" status: 404 len: 111 microversion: 2.1 time: 0.066328 Nov 02 13:33:06.809192 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2014/4365] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/servers/bd91b461-05bb-403c-b07f-181066f71ffe => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:33:06.813764 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4dc4e519-a594-4f50-9aa0-412c537bbb36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1312 microversion: 2.1 time: 0.739846 Nov 02 13:33:06.821464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.822589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:06.831643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.833250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.833931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.834627 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2352/4366] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1312 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:06.835093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.835776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.836399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.857037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:06.857658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:06.874316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:06.876174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.876738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.877100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.877884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.886756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.887303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.898323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:06.942021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:06.942768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:06.943397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:06.944027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lazy-loading 'fault' on Instance uuid 95a016a9-b97a-466e-a423-4125c875c4ee {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:33:07.027135 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e5fe0d9d-97c0-4905-ba2e-72b073316860 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "DELETE /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 204 len: 0 microversion: 2.1 time: 0.216374 Nov 02 13:33:07.042619 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2015/4367] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:33:06 2022] DELETE /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:33:07.057613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d313d64e-ba8c-4321-bd43-1cb75b94f133 req-52324638-7bb5-46c8-8405-86bb0afffab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9788658-3399-4fa6-b84d-f611bcf47d64", "name": "network-vif-deleted", "tag": "f11ebcd1-70a5-407a-b4f5-0fd48037f949"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:07.071905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d313d64e-ba8c-4321-bd43-1cb75b94f133 req-52324638-7bb5-46c8-8405-86bb0afffab7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:07.072486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d313d64e-ba8c-4321-bd43-1cb75b94f133 req-52324638-7bb5-46c8-8405-86bb0afffab7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:07.073089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d313d64e-ba8c-4321-bd43-1cb75b94f133 req-52324638-7bb5-46c8-8405-86bb0afffab7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:07.091334 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d313d64e-ba8c-4321-bd43-1cb75b94f133 req-52324638-7bb5-46c8-8405-86bb0afffab7 service nova] Creating event network-vif-deleted:f11ebcd1-70a5-407a-b4f5-0fd48037f949 for instance f9788658-3399-4fa6-b84d-f611bcf47d64 on n-h2-858384-19 Nov 02 13:33:07.107476 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d313d64e-ba8c-4321-bd43-1cb75b94f133 req-52324638-7bb5-46c8-8405-86bb0afffab7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053039 Nov 02 13:33:07.109796 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2016/4368] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:07.128068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:07.130764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:07.157562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:07.158475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:07.159800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:07.168292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:07.169787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:07.185682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:07.221822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6eba5b1172f4e2791e039d18904ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50122d42b3e420ebf65f2a8d16b2da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:07.245838 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-25fb3045-cd67-45c4-9f4c-200d0eaf36dc tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 200 len: 1316 microversion: 2.1 time: 0.407511 Nov 02 13:33:07.290882 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2353/4369] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:06 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:07.344389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d949a3eb-2457-42c0-8fc5-f601b9266c09 req-51dd0139-cff2-44e9-babd-21a4184024b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a016a9-b97a-466e-a423-4125c875c4ee", "name": "network-vif-deleted", "tag": "152d6e71-3362-4c9a-8250-9c6dc67e9c6e"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:07.378299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d949a3eb-2457-42c0-8fc5-f601b9266c09 req-51dd0139-cff2-44e9-babd-21a4184024b8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:07.378792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d949a3eb-2457-42c0-8fc5-f601b9266c09 req-51dd0139-cff2-44e9-babd-21a4184024b8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:07.380523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d949a3eb-2457-42c0-8fc5-f601b9266c09 req-51dd0139-cff2-44e9-babd-21a4184024b8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:07.399410 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d949a3eb-2457-42c0-8fc5-f601b9266c09 req-51dd0139-cff2-44e9-babd-21a4184024b8 service nova] Creating event network-vif-deleted:152d6e71-3362-4c9a-8250-9c6dc67e9c6e for instance 95a016a9-b97a-466e-a423-4125c875c4ee on n-h2-858384-19 Nov 02 13:33:07.405739 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d949a3eb-2457-42c0-8fc5-f601b9266c09 req-51dd0139-cff2-44e9-babd-21a4184024b8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113202 Nov 02 13:33:07.411719 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2354/4370] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:07.747393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-990009355", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a51594b5-f7a2-4ac2-8ce7-dad5e878026e"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:07.816896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] validate_networks() for [('a51594b5-f7a2-4ac2-8ce7-dad5e878026e', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:33:07.971979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:08.100749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:08.109381 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9285b49-4a73-436f-8ce7-dd4a3ea124db tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1679 microversion: 2.1 time: 0.995971 Nov 02 13:33:08.117996 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2017/4371] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:07 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1679 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:08.143484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.145093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:08.152937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.153704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.154449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.155427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.156064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.156669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.328032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:33:08.328482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:33:08.328934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:33:08.329343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:33:08.329763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:33:08.349498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.349995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.350443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.351866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.352579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.353116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.403005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Getting quotas for project 5cee3ec1369f453c9fcbc8cb46b8b7f3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:33:08.412750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Getting quotas for user e973866c9b404719b4223679d7795f4d and project 5cee3ec1369f453c9fcbc8cb46b8b7f3. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:33:08.441022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Going to run 2 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:33:08.441022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 9ceca675-5b17-4d42-8176-230e7ae7f8c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:33:08.583936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:08.602554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:08.624254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:08.625503 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-be8cc374-7ec4-4448-b4fc-bcd5d2002504 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.506398 Nov 02 13:33:08.627815 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2018/4372] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:08.635829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=9ceca675-5b17-4d42-8176-230e7ae7f8c6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:33:08.647151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.669117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:08.690895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.695978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.696975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.699640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.701239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.704246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.825552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e613dc2-35b7-4517-afab-431e89532e38 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.239068 Nov 02 13:33:08.841501 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2355/4373] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:33:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:33:08.849151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-208feb8c-5296-43e1-8f4a-e0ed06b7864a req-83064482-c7d9-4c72-8739-8377051cd382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-plugged", "status": "completed", "tag": "a59140df-02b2-48d4-9f91-b051ae369f57"}, {"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-plugged", "status": "completed", "tag": "2ff943a8-9281-45f9-9a6c-37130580d8a5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:08.884972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-208feb8c-5296-43e1-8f4a-e0ed06b7864a req-83064482-c7d9-4c72-8739-8377051cd382 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.885355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-208feb8c-5296-43e1-8f4a-e0ed06b7864a req-83064482-c7d9-4c72-8739-8377051cd382 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.885810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-208feb8c-5296-43e1-8f4a-e0ed06b7864a req-83064482-c7d9-4c72-8739-8377051cd382 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.941115 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-208feb8c-5296-43e1-8f4a-e0ed06b7864a req-83064482-c7d9-4c72-8739-8377051cd382 service nova] Creating event network-vif-plugged:a59140df-02b2-48d4-9f91-b051ae369f57 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:33:08.941115 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-208feb8c-5296-43e1-8f4a-e0ed06b7864a req-83064482-c7d9-4c72-8739-8377051cd382 service nova] Creating event network-vif-plugged:2ff943a8-9281-45f9-9a6c-37130580d8a5 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:33:08.945067 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-208feb8c-5296-43e1-8f4a-e0ed06b7864a req-83064482-c7d9-4c72-8739-8377051cd382 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102079 Nov 02 13:33:08.945692 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2356/4374] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:08.950854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:08.964826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] [instance: 95a016a9-b97a-466e-a423-4125c875c4ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:08.972176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.974464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.975095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:08.978329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:08.979689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:08.982275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:09.025420 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] HTTP exception thrown: Instance 95a016a9-b97a-466e-a423-4125c875c4ee could not be found. Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Request method failure captured: Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee HTTP/1.1 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnFWlWgF89ius07vXkUG15cCo_KT350CKLjl8r-WMkxCkaNwUgHxwdgtXQOZpMQA7H97QEg0bXdof0ex-WhHsAFnXjxnWnL893VHBNXJdILjLDH2TlU1XTp8be8Ld6bU2i0USJXBzdum56IlDzB8ncsjbWS6me7difw5EhrlunVXb-M Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e50122d42b3e420ebf65f2a8d16b2da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e50122d42b3e420ebf65f2a8d16b2da8 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2120406712 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: b6eba5b1172f4e2791e039d18904ed58 Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ListServersNegativeTestJSON-2120406712-project Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 95a016a9-b97a-466e-a423-4125c875c4ee could not be found. Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '95a016a9-b97a-466e-a423-4125c875c4ee'} Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a016a9-b97a-466e-a423-4125c875c4ee could not be found. Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a016a9-b97a-466e-a423-4125c875c4ee could not be found. Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:09.029515 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:09.033791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:09.033791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:09.033791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:09.033791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:09.033791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:09.033791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:09.033791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a016a9-b97a-466e-a423-4125c875c4ee could not be found. Nov 02 13:33:09.033791 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:09.036127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] Returning 404 to user: Instance 95a016a9-b97a-466e-a423-4125c875c4ee could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:09.040334 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a5641f3-807d-4e8c-828a-a6b7b2eaa62c tempest-ListServersNegativeTestJSON-2120406712 tempest-ListServersNegativeTestJSON-2120406712-project] 10.222.0.113 "GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee" status: 404 len: 111 microversion: 2.1 time: 0.093449 Nov 02 13:33:09.045343 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2357/4375] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1/servers/95a016a9-b97a-466e-a423-4125c875c4ee => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:33:09.068171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:09.080003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:09.091398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Searching by: {'deleted': False, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:33:09.132461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:09.135765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:09.136400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:09.137681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:09.143881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:09.144674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:09.158629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:09.167063 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-23ee5ea2-35f0-405d-8f4b-00c569387ea7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1312 microversion: 2.1 time: 0.536541 Nov 02 13:33:09.169945 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2019/4376] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:08 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1312 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:09.180622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:09.183001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:09.186415 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-99320875-6967-42c8-83c7-c4a6d9700c2e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 679 microversion: 2.1 time: 0.139674 Nov 02 13:33:09.194680 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2358/4377] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:33:09 2022] GET /compute/v2.1/servers => generated 679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:09.199983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:09.201650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:09.202397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:09.205027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:09.206438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:09.208251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:09.208827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c56d73f-3acd-4ae1-ac11-11a5dcb1eb46 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:09.209697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c56d73f-3acd-4ae1-ac11-11a5dcb1eb46 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:09.471152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:09.497178 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0fd50d88-9055-4421-8781-9cb508b0b10d tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1679 microversion: 2.1 time: 0.321977 Nov 02 13:33:09.500338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2020/4378] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:09 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1679 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:09.663144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:09.663768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:09.676895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:09.678485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:09.678951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:09.682544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:09.684472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:09.684948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:09.754027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8c56d73f-3acd-4ae1-ac11-11a5dcb1eb46 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:09.764355 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c56d73f-3acd-4ae1-ac11-11a5dcb1eb46 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1223 microversion: 2.1 time: 0.566207 Nov 02 13:33:09.769238 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2359/4379] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:09 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1223 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:10.131995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:10.146037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:10.154772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:10.156129 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8392ccd7-cb97-4ef8-8e8b-544382a18e1b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.498554 Nov 02 13:33:10.167379 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2021/4380] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:09 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:33:10.196150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:10.196771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:10.205086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:10.205677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:10.212150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:10.213075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:10.213696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:10.215963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:10.529409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:10.530533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:10.543589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:10.551175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:10.552222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:10.553613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:10.555344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:10.557426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.046004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:11.063146 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5dc0435a-acb1-4ef7-b65a-0dc7b57958b5 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1679 microversion: 2.1 time: 0.535015 Nov 02 13:33:11.064502 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2022/4381] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:10 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1679 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:11.080632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:11.080632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:11.094160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:11.106053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:11.106876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.110413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:11.111181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:11.113219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.343798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:11.365698 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7311353-71c8-4582-99b9-c1848b88bfd6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1219 microversion: 2.1 time: 0.298915 Nov 02 13:33:11.368790 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2023/4382] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:11 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1219 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:11.385315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-cd493df1-ff40-483b-9e07-2a71a522de9f req-d7cde698-f8c5-4df0-a345-e3f723fcd8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-plugged", "status": "completed", "tag": "f973e9e0-60ad-4e52-aef0-171fdb0226e1"}, {"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-plugged", "status": "completed", "tag": "8e6ea7b1-cf33-429d-8374-e26f5239f9f6"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:11.402614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cd493df1-ff40-483b-9e07-2a71a522de9f req-d7cde698-f8c5-4df0-a345-e3f723fcd8b3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:11.403385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cd493df1-ff40-483b-9e07-2a71a522de9f req-d7cde698-f8c5-4df0-a345-e3f723fcd8b3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:11.403979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cd493df1-ff40-483b-9e07-2a71a522de9f req-d7cde698-f8c5-4df0-a345-e3f723fcd8b3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.422030 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-cd493df1-ff40-483b-9e07-2a71a522de9f req-d7cde698-f8c5-4df0-a345-e3f723fcd8b3 service nova] Creating event network-vif-plugged:f973e9e0-60ad-4e52-aef0-171fdb0226e1 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:33:11.423846 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-cd493df1-ff40-483b-9e07-2a71a522de9f req-d7cde698-f8c5-4df0-a345-e3f723fcd8b3 service nova] Creating event network-vif-plugged:8e6ea7b1-cf33-429d-8374-e26f5239f9f6 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:33:11.436244 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-cd493df1-ff40-483b-9e07-2a71a522de9f req-d7cde698-f8c5-4df0-a345-e3f723fcd8b3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064106 Nov 02 13:33:11.438951 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2024/4383] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:11.449918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:11.452015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:11.468900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:11.469405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:11.469847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.471265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:11.471745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:11.478019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:11.946584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:11.966547 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fcc09d90-0ca7-41dd-80af-fe5202f3d39a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1312 microversion: 2.1 time: 1.774338 Nov 02 13:33:11.988614 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2360/4384] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:10 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1312 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:12.097427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:12.102045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:12.141526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.143877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.145829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.147224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.151359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.151749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.297895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:12.321278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:12.325595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:12.328645 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6bdc91d-a424-4605-a712-72f8b4a342f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.888293 Nov 02 13:33:12.353683 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2025/4385] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:11 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:12.395432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:12.396273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:12.408302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.408984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.409672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.411272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:12.411923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:12.412618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:12.887810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:12.897259 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-55aef221-393b-4e35-8ba9-bc3f32b79709 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1281 microversion: 2.1 time: 0.508056 Nov 02 13:33:12.913258 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2026/4386] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:12 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1281 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:12.995410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:12.996149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:13.002992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:13.003629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:13.004356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:13.005620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:13.006096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:13.006617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:13.088316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:13.102184 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da77e981-affb-40a7-8e1f-e14a5b3c56e9 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1679 microversion: 2.1 time: 1.010253 Nov 02 13:33:13.116532 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2361/4387] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:12 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1679 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:13.368606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:13.369195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:13.380600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:13.387735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:13.388402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:13.389298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:13.389930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:13.391148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:13.761733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:13.776100 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eb528b18-88e3-4840-b961-54c109503ab1 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1312 microversion: 2.1 time: 0.785191 Nov 02 13:33:13.788388 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2027/4388] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:12 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1312 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:13.802612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3ea8602c-fb20-41e4-9a1a-a356c2b2f1a8 req-f1a285b8-d2f8-44fb-9496-e19ce5260854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-plugged", "status": "completed", "tag": "bae0f565-113c-46c6-8652-ba244ff3de95"}, {"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-plugged", "status": "completed", "tag": "2e49e2c7-c69b-46c6-87ac-2018188af28c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:13.875953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ea8602c-fb20-41e4-9a1a-a356c2b2f1a8 req-f1a285b8-d2f8-44fb-9496-e19ce5260854 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:13.883049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ea8602c-fb20-41e4-9a1a-a356c2b2f1a8 req-f1a285b8-d2f8-44fb-9496-e19ce5260854 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:13.884834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ea8602c-fb20-41e4-9a1a-a356c2b2f1a8 req-f1a285b8-d2f8-44fb-9496-e19ce5260854 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:13.926252 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3ea8602c-fb20-41e4-9a1a-a356c2b2f1a8 req-f1a285b8-d2f8-44fb-9496-e19ce5260854 service nova] Creating event network-vif-plugged:bae0f565-113c-46c6-8652-ba244ff3de95 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:33:13.931998 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3ea8602c-fb20-41e4-9a1a-a356c2b2f1a8 req-f1a285b8-d2f8-44fb-9496-e19ce5260854 service nova] Creating event network-vif-plugged:2e49e2c7-c69b-46c6-87ac-2018188af28c for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:33:13.949100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:13.957829 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3ea8602c-fb20-41e4-9a1a-a356c2b2f1a8 req-f1a285b8-d2f8-44fb-9496-e19ce5260854 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.156771 Nov 02 13:33:13.965699 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2028/4389] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:13.968496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:13.970440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:13.975372 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a77a48c7-c156-4958-807a-1371d9bdc01d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.610824 Nov 02 13:33:13.982145 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2362/4390] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:13 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:33:14.000453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:14.005365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:14.023852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:14.027570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:14.028214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:14.031826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:14.032503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:14.033139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:14.141436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:14.143049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:14.158992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:14.165333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:14.165938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:14.170311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:14.170988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:14.171566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:14.726734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:14.748037 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c363ff7e-220e-4044-8b98-7f1088c00c07 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1679 microversion: 2.1 time: 0.610367 Nov 02 13:33:14.751449 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2363/4391] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:14 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1679 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:14.817174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:14.819369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:14.834763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:14.836942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:14.838885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:14.842560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:14.843788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:14.863866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.113418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:15.128195 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc3ebba6-0fb9-4067-9be8-23ced3ed2106 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 1.160645 Nov 02 13:33:15.129433 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2029/4392] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:13 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:15.134356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:15.139855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:15.165026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.167715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.168534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.169502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.170195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.170832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.924679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:15.942973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:15.944571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:15.946136 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66d104dc-f407-4511-862b-7c8ddefb7e0e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.815297 Nov 02 13:33:15.946337 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2030/4393] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:15 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:15.969317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:15.970067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:15.985101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.986030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:15.988003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:15.989274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:15.998732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:16.000173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:16.727934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:16.757877 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ef482318-2c40-443a-80d2-fdb6cffe6bd1 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1612 microversion: 2.1 time: 0.801540 Nov 02 13:33:16.759027 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2031/4394] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:15 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1612 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:16.793571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:16.800513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:16.819643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:16.821941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:16.822609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:16.823509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:16.824104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:16.824673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:16.853792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:16.865296 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ec98d0b5-abc1-423b-b63b-ef14b82bb813 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1312 microversion: 2.1 time: 2.054016 Nov 02 13:33:16.869761 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2364/4395] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:14 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1312 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:16.888474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-eb4d8044-7930-4ed7-b525-3c8e9346a411 req-7e7c676e-4c4f-4491-8615-2f21d63a5080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cb0435-5222-4140-af24-8cea35c0daa6", "name": "network-vif-plugged", "status": "completed", "tag": "52fe1de7-a4e2-46a0-8735-175040987808"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:16.917052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-eb4d8044-7930-4ed7-b525-3c8e9346a411 req-7e7c676e-4c4f-4491-8615-2f21d63a5080 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:16.924773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-eb4d8044-7930-4ed7-b525-3c8e9346a411 req-7e7c676e-4c4f-4491-8615-2f21d63a5080 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:16.925808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-eb4d8044-7930-4ed7-b525-3c8e9346a411 req-7e7c676e-4c4f-4491-8615-2f21d63a5080 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:16.969592 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-eb4d8044-7930-4ed7-b525-3c8e9346a411 req-7e7c676e-4c4f-4491-8615-2f21d63a5080 service nova] Creating event network-vif-plugged:52fe1de7-a4e2-46a0-8735-175040987808 for instance 59cb0435-5222-4140-af24-8cea35c0daa6 on n-h2-858384-19 Nov 02 13:33:16.997506 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-eb4d8044-7930-4ed7-b525-3c8e9346a411 req-7e7c676e-4c4f-4491-8615-2f21d63a5080 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126167 Nov 02 13:33:17.004940 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2365/4396] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:17.018304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:17.023409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:17.044382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:17.044901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:17.045458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:17.047220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:17.048554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:17.049423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:17.763033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:17.765799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:17.777108 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b5502b7-375e-4f11-9716-dbbc9ac1e621 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 0.992607 Nov 02 13:33:17.777828 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2032/4397] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:16 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:17.808530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:17.809466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:17.833758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:17.835265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:17.835926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:17.836855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:17.847443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:17.848383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:17.879882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:17.904794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:17.911969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:17.916914 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-49c88876-b294-4a2d-93bc-e826d26b814e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1878 microversion: 2.32 time: 0.910172 Nov 02 13:33:17.917530 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2366/4398] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:17 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1878 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:17.951888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:17.953614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:17.977518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:17.978299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:17.979310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:17.998039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:17.998871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:17.999558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.145789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa31baf6e9c94e8393baad059544adb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e478af6eaa94c1f99ffbff44af089e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:18.175070 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0dc7db4c-fa51-4876-a715-11aef578b9c8 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 200 len: 1612 microversion: 2.1 time: 0.370396 Nov 02 13:33:18.180377 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2033/4399] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:17 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 1612 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:18.192299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-08547333-0189-4040-9e34-4be7c1e90150 req-bdeb34d8-fabc-4c3a-bf61-a4713a089fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfdfca83-c725-4ad1-9005-3d100bb279e7", "name": "network-vif-deleted", "tag": "a2b33e3d-c43d-4a44-93d2-7cd135963adb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:18.226329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-08547333-0189-4040-9e34-4be7c1e90150 req-bdeb34d8-fabc-4c3a-bf61-a4713a089fed service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.229518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-08547333-0189-4040-9e34-4be7c1e90150 req-bdeb34d8-fabc-4c3a-bf61-a4713a089fed service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.231101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-08547333-0189-4040-9e34-4be7c1e90150 req-bdeb34d8-fabc-4c3a-bf61-a4713a089fed service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.288169 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-08547333-0189-4040-9e34-4be7c1e90150 req-bdeb34d8-fabc-4c3a-bf61-a4713a089fed service nova] Creating event network-vif-deleted:a2b33e3d-c43d-4a44-93d2-7cd135963adb for instance cfdfca83-c725-4ad1-9005-3d100bb279e7 on n-h2-858384-19 Nov 02 13:33:18.301587 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-08547333-0189-4040-9e34-4be7c1e90150 req-bdeb34d8-fabc-4c3a-bf61-a4713a089fed service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118473 Nov 02 13:33:18.306166 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2034/4400] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:18.607545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:18.636280 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77a27a1e-83c7-4eb5-b072-c8d8eb42e2dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1312 microversion: 2.1 time: 0.712307 Nov 02 13:33:18.638946 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2367/4401] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:17 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1312 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:18.697376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1e23792f-d90c-495e-92cf-d9f8ba04d883 req-014a2965-78ce-4e30-acb9-b0443e5eec7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5b08d5-bad6-4f3f-8fd4-258b7930b314", "tag": "12a27dd6-f7f7-421d-a75d-a6823f16fe1f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:18.747557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1e23792f-d90c-495e-92cf-d9f8ba04d883 req-014a2965-78ce-4e30-acb9-b0443e5eec7d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.753234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1e23792f-d90c-495e-92cf-d9f8ba04d883 req-014a2965-78ce-4e30-acb9-b0443e5eec7d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.757289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1e23792f-d90c-495e-92cf-d9f8ba04d883 req-014a2965-78ce-4e30-acb9-b0443e5eec7d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.800820 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1e23792f-d90c-495e-92cf-d9f8ba04d883 req-014a2965-78ce-4e30-acb9-b0443e5eec7d service nova] Creating event network-changed:12a27dd6-f7f7-421d-a75d-a6823f16fe1f for instance 0b5b08d5-bad6-4f3f-8fd4-258b7930b314 on n-h2-858384-19 Nov 02 13:33:18.808396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:18.809955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:18.822709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.827670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.828678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.830808 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1e23792f-d90c-495e-92cf-d9f8ba04d883 req-014a2965-78ce-4e30-acb9-b0443e5eec7d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141862 Nov 02 13:33:18.831046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.831683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.832416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.834283 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2035/4402] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:18.945807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:18.946838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:18.968353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.969177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.970948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:18.974716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:18.977184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:18.977839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:19.151954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:19.640912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:19.664096 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-96779230-8c7f-4173-8517-fad4361a428d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 0.852766 Nov 02 13:33:19.664579 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2368/4403] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:18 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:19.681963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:19.693795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] [instance: cfdfca83-c725-4ad1-9005-3d100bb279e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:19.713851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:19.715362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:19.720529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:19.724049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:19.725019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:19.726671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:19.764809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:19.767247 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] HTTP exception thrown: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 could not be found. Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Request method failure captured: Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 HTTP/1.1 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYm6io6tF-FtuHS0PIEx8WBk2Wt554RWt5TmvXvpV-_ZV4TeWwlsjkPqRSQjlI7PmR7zwqYtUKC3M16qm-e8e_Zylrzb09VgeuR3gmq3vpnrryPrGKVgGkKZwswfheyIrDEpUdlZKsyjADDwsXbwx6CT8jxHfty333F9KEw09H8QZcjw Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/0e478af6eaa94c1f99ffbff44af089e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 0e478af6eaa94c1f99ffbff44af089e3 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1851313237 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: fa31baf6e9c94e8393baad059544adb5 Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1851313237-project Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 could not be found. Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'cfdfca83-c725-4ad1-9005-3d100bb279e7'} Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 could not be found. Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 could not be found. Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:19.770168 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.773956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:19.773956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:19.773956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:19.773956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:19.773956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:19.773956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 could not be found. Nov 02 13:33:19.773956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:33:19.778017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Returning 404 to user: Instance cfdfca83-c725-4ad1-9005-3d100bb279e7 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:19.779315 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff36fb87-1750-4173-8e3f-cee58687367e tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7" status: 404 len: 111 microversion: 2.1 time: 0.113363 Nov 02 13:33:19.780178 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2369/4404] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:19 2022] GET /compute/v2.1/servers/cfdfca83-c725-4ad1-9005-3d100bb279e7 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:33:19.785705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:19.786773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:19.794173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:19.795050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:19.795787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:19.796805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:19.797835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:19.798489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:20.002836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:20.017542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:20.027157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:20.028778 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7e9c0286-569f-4762-b921-7b5c6e5621e8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2832 microversion: 2.32 time: 1.088864 Nov 02 13:33:20.029579 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2036/4405] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:18 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2832 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:20.061147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b380e41-59ea-4ef7-8511-c1ef6e6def30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] Calling method '.version_select at 0x7fe78fa6e160>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:20.116335 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b380e41-59ea-4ef7-8511-c1ef6e6def30 tempest-ServerActionsTestJSON-1851313237 tempest-ServerActionsTestJSON-1851313237-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601789023" status: 202 len: 0 microversion: 2.1 time: 0.071367 Nov 02 13:33:20.120989 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2037/4406] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601789023 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:33:20.126443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0691e785-e7db-4f0d-9b96-486be098f0f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:20.129753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0691e785-e7db-4f0d-9b96-486be098f0f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:20.142489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0691e785-e7db-4f0d-9b96-486be098f0f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:20.148903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0691e785-e7db-4f0d-9b96-486be098f0f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:20.149531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0691e785-e7db-4f0d-9b96-486be098f0f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:20.150307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0691e785-e7db-4f0d-9b96-486be098f0f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:20.150777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0691e785-e7db-4f0d-9b96-486be098f0f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:20.152799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0691e785-e7db-4f0d-9b96-486be098f0f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:20.380346 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0691e785-e7db-4f0d-9b96-486be098f0f3 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.257872 Nov 02 13:33:20.381539 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2038/4407] 10.222.0.113 () {60 vars in 1321 bytes} [Wed Nov 2 13:33:20 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f/os-interface => generated 1833 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:20.457409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:20.467995 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e206d963-fbca-4334-b4c2-47138594d31f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1493 microversion: 2.1 time: 0.686545 Nov 02 13:33:20.480083 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2370/4408] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:19 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1493 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:20.497016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e748f515-6db1-463b-86a5-b1d8854d7a51 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:20.497777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e748f515-6db1-463b-86a5-b1d8854d7a51 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:20.505835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e748f515-6db1-463b-86a5-b1d8854d7a51 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:20.506699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e748f515-6db1-463b-86a5-b1d8854d7a51 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:20.507349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e748f515-6db1-463b-86a5-b1d8854d7a51 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:20.508223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e748f515-6db1-463b-86a5-b1d8854d7a51 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:20.508914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e748f515-6db1-463b-86a5-b1d8854d7a51 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:20.514684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e748f515-6db1-463b-86a5-b1d8854d7a51 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:20.631104 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e748f515-6db1-463b-86a5-b1d8854d7a51 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6/action" status: 202 len: 0 microversion: 2.1 time: 0.139980 Nov 02 13:33:20.638186 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2039/4409] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:33:20 2022] POST /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:33:20.641131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:20.641809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:20.653153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:20.655780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:20.656572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:20.662276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:20.662974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:20.663730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:20.687882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:20.688364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:20.716550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:20.717047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:20.717503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:20.723197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:20.726931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:20.727416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:21.330283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:21.351756 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9a51f01-1deb-4562-ae4d-d46ecf07e18f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 0.656484 Nov 02 13:33:21.353080 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2040/4410] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:20 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:21.358132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c11739c0-80c2-44d9-9d2f-6ad1abb4152d req-c7cd087f-51e2-46c4-abb9-0591ba85a3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ceca675-5b17-4d42-8176-230e7ae7f8c6", "tag": "83ee8877-74d9-4313-a190-dc042b2c586d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:21.393209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c11739c0-80c2-44d9-9d2f-6ad1abb4152d req-c7cd087f-51e2-46c4-abb9-0591ba85a3f6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:21.394692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c11739c0-80c2-44d9-9d2f-6ad1abb4152d req-c7cd087f-51e2-46c4-abb9-0591ba85a3f6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:21.396270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c11739c0-80c2-44d9-9d2f-6ad1abb4152d req-c7cd087f-51e2-46c4-abb9-0591ba85a3f6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:21.428032 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c11739c0-80c2-44d9-9d2f-6ad1abb4152d req-c7cd087f-51e2-46c4-abb9-0591ba85a3f6 service nova] Creating event network-changed:83ee8877-74d9-4313-a190-dc042b2c586d for instance 9ceca675-5b17-4d42-8176-230e7ae7f8c6 on n-h1-858384-19 Nov 02 13:33:21.437624 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c11739c0-80c2-44d9-9d2f-6ad1abb4152d req-c7cd087f-51e2-46c4-abb9-0591ba85a3f6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083092 Nov 02 13:33:21.438456 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2041/4411] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:21.741019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:21.760081 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ea42a157-f893-4aa6-a81d-963e7bbb467f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1498 microversion: 2.1 time: 1.123128 Nov 02 13:33:21.764214 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2371/4412] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:20 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1498 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:22.384194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:22.384917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:22.400568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:22.401232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:22.402746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:22.410520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:22.415192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:22.416212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:22.790737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:22.791756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:22.806198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:22.806767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:22.807106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:22.807854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:22.813049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:22.815061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:23.579321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:23.594306 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a2d8107e-c425-4fe0-a3ad-89fd4f58d1f1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 1.218883 Nov 02 13:33:23.619446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:23.619713 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2042/4413] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:22 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:23.619813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:23.620466 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cbb0b5ae-cf71-4f02-9bc0-b77f437069d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 200 len: 1478 microversion: 2.1 time: 0.839661 Nov 02 13:33:23.630351 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2372/4414] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:22 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 1478 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:23.650350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-668acce5-0696-4557-ad3b-334979146a7b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-540087198"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:23.652895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-668acce5-0696-4557-ad3b-334979146a7b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:23.660425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-668acce5-0696-4557-ad3b-334979146a7b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:23.661216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-668acce5-0696-4557-ad3b-334979146a7b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:23.661858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-668acce5-0696-4557-ad3b-334979146a7b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:23.662848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-668acce5-0696-4557-ad3b-334979146a7b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:23.663667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-668acce5-0696-4557-ad3b-334979146a7b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:23.664333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-668acce5-0696-4557-ad3b-334979146a7b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:24.148566 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-668acce5-0696-4557-ad3b-334979146a7b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6/action" status: 202 len: 0 microversion: 2.1 time: 0.503953 Nov 02 13:33:24.152591 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2043/4415] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:33:23 2022] POST /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:33:24.161947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea6c130f-8af3-4923-9212-43e54a001cbb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786102820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:24.247483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ea6c130f-8af3-4923-9212-43e54a001cbb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.086469 Nov 02 13:33:24.258864 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2373/4416] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:24 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:24.635936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:24.636806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:24.654810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:24.658430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:24.659415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:24.660736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:24.661526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:24.662164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:25.265059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01b58bd7-dd94-481a-a439-4b0891d9cc1f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78612bd30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:25.327781 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01b58bd7-dd94-481a-a439-4b0891d9cc1f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.067420 Nov 02 13:33:25.328383 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2374/4417] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:25 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:25.436903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:25.451636 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17e7f606-d1b9-47e2-81d6-78ff8d3bca18 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 0.826397 Nov 02 13:33:25.456400 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2044/4418] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:24 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:25.656962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3fc50a69-e9df-4647-9b96-39304c90715a req-b19d5571-5359-4b5b-b932-37cdda89d929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "tag": "2ff943a8-9281-45f9-9a6c-37130580d8a5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:25.686768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3fc50a69-e9df-4647-9b96-39304c90715a req-b19d5571-5359-4b5b-b932-37cdda89d929 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:25.688710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3fc50a69-e9df-4647-9b96-39304c90715a req-b19d5571-5359-4b5b-b932-37cdda89d929 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:25.690170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3fc50a69-e9df-4647-9b96-39304c90715a req-b19d5571-5359-4b5b-b932-37cdda89d929 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:25.735945 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3fc50a69-e9df-4647-9b96-39304c90715a req-b19d5571-5359-4b5b-b932-37cdda89d929 service nova] Creating event network-changed:2ff943a8-9281-45f9-9a6c-37130580d8a5 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:33:25.749017 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3fc50a69-e9df-4647-9b96-39304c90715a req-b19d5571-5359-4b5b-b932-37cdda89d929 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096143 Nov 02 13:33:25.752867 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2375/4419] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:26.344238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-30425338-00c6-4364-8fb7-922614667a87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787e85430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:26.422389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-30425338-00c6-4364-8fb7-922614667a87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.082263 Nov 02 13:33:26.423442 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2045/4420] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:26 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:26.480939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:26.482099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:26.497768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:26.498537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:26.499336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:26.500676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:26.504067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:26.504803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:27.102554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:27.131348 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c66b2c53-8db1-4363-bcd9-3fbc295968d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 0.656587 Nov 02 13:33:27.167299 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2376/4421] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:26 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:27.441759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7cf716a8-adf5-4627-aea4-0ebf46b44b18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78fa869d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:27.510463 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7cf716a8-adf5-4627-aea4-0ebf46b44b18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.074652 Nov 02 13:33:27.517320 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2046/4422] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:27 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:28.162994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:28.165644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:28.172858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:28.193393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:28.224774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:28.230878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:28.236198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:28.256547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:28.257345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:28.536035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-34701416-6fbc-4ba0-86fc-0c0a54447c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78fa920d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:28.610262 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-34701416-6fbc-4ba0-86fc-0c0a54447c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.079908 Nov 02 13:33:28.611705 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2047/4423] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:28 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:28.956940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:28.969718 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-50c00607-f1f5-470d-9aac-0e0b1a930f88 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 0.810916 Nov 02 13:33:28.974672 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2377/4424] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:28 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:29.357562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1c2f1548-d10e-4f88-a5c6-96f0a1a0ce5a req-fe6591b7-2420-475e-9178-ba0ded7371aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5b08d5-bad6-4f3f-8fd4-258b7930b314", "name": "network-vif-plugged", "status": "completed", "tag": "12a27dd6-f7f7-421d-a75d-a6823f16fe1f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:29.378812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1c2f1548-d10e-4f88-a5c6-96f0a1a0ce5a req-fe6591b7-2420-475e-9178-ba0ded7371aa service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:29.379365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1c2f1548-d10e-4f88-a5c6-96f0a1a0ce5a req-fe6591b7-2420-475e-9178-ba0ded7371aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:29.379936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1c2f1548-d10e-4f88-a5c6-96f0a1a0ce5a req-fe6591b7-2420-475e-9178-ba0ded7371aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:29.418180 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1c2f1548-d10e-4f88-a5c6-96f0a1a0ce5a req-fe6591b7-2420-475e-9178-ba0ded7371aa service nova] Creating event network-vif-plugged:12a27dd6-f7f7-421d-a75d-a6823f16fe1f for instance 0b5b08d5-bad6-4f3f-8fd4-258b7930b314 on n-h2-858384-19 Nov 02 13:33:29.432173 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1c2f1548-d10e-4f88-a5c6-96f0a1a0ce5a req-fe6591b7-2420-475e-9178-ba0ded7371aa service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080118 Nov 02 13:33:29.438091 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2048/4425] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:29.627683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e446f9db-feec-41e3-82d6-66e4ff0734f6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7861b8280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:29.705143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e446f9db-feec-41e3-82d6-66e4ff0734f6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.081416 Nov 02 13:33:29.705740 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2378/4426] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:29 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:30.002046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:30.002749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:30.025125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:30.035612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:30.039169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:30.043300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:30.048336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:30.049668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:30.609167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:30.628341 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63a1d7a8-213e-45e4-822d-c32dad1ac679 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 0.631688 Nov 02 13:33:30.633220 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2049/4427] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:29 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:30.722542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-789d1263-d3bc-4025-b0df-627d1b299cc3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78614e5e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:30.836216 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-789d1263-d3bc-4025-b0df-627d1b299cc3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.116865 Nov 02 13:33:30.837009 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2379/4428] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:30 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:31.661482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:31.663152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:31.670054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:31.672286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:31.672987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:31.673701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:31.675438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:31.676460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:31.677112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:31.859932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b673d58-b6b5-420d-a81a-8b99a64dab58 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7862b0700>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:31.964644 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b673d58-b6b5-420d-a81a-8b99a64dab58 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.114426 Nov 02 13:33:31.967741 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2380/4429] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:31 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:32.582713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:32.594490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1fbf3050-d635-4c2f-9aaa-22855c77bca0 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1323 microversion: 2.1 time: 0.938172 Nov 02 13:33:32.595307 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2050/4430] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:31 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1323 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:32.982107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b14947b7-898e-4f42-a814-ab8aa1528a8b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78611b550>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:33.602035 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b14947b7-898e-4f42-a814-ab8aa1528a8b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.624069 Nov 02 13:33:33.603466 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2381/4431] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:32 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:33.629100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:33.629740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:33.648611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:33.649084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:33.649535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:33.650258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:33.650725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:33.651181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:34.004121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:34.023908 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-87b0a381-f758-40d6-9979-ff9173dbd209 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 200 len: 1511 microversion: 2.1 time: 0.400587 Nov 02 13:33:34.027071 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2051/4432] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:33 2022] GET /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:34.056181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:34.056903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 9ceca675-5b17-4d42-8176-230e7ae7f8c6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:34.073306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:34.074484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:34.075226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:34.076220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:34.076853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:34.077456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:34.619068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7f3cd66-c6d8-427d-8d6d-ba349d983d06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787cc0d30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:34.721638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:34.740532 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-809a56bc-80d4-4a40-9cca-8b91cc59331a tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6" status: 200 len: 1323 microversion: 2.1 time: 0.689899 Nov 02 13:33:34.744202 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2382/4433] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:34 2022] GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6 => generated 1323 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:35.143389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-bd0edfb3-d85b-4fb9-b808-c6d0be86161d req-69bd749a-586c-4fb5-b6d8-d0cc0aad2bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cb0435-5222-4140-af24-8cea35c0daa6", "name": "network-vif-plugged", "status": "completed", "tag": "52fe1de7-a4e2-46a0-8735-175040987808"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:35.174737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bd0edfb3-d85b-4fb9-b808-c6d0be86161d req-69bd749a-586c-4fb5-b6d8-d0cc0aad2bde service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:35.175508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bd0edfb3-d85b-4fb9-b808-c6d0be86161d req-69bd749a-586c-4fb5-b6d8-d0cc0aad2bde service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:35.176053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bd0edfb3-d85b-4fb9-b808-c6d0be86161d req-69bd749a-586c-4fb5-b6d8-d0cc0aad2bde service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:35.233570 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-bd0edfb3-d85b-4fb9-b808-c6d0be86161d req-69bd749a-586c-4fb5-b6d8-d0cc0aad2bde service nova] Creating event network-vif-plugged:52fe1de7-a4e2-46a0-8735-175040987808 for instance 59cb0435-5222-4140-af24-8cea35c0daa6 on n-h2-858384-19 Nov 02 13:33:35.270866 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-bd0edfb3-d85b-4fb9-b808-c6d0be86161d req-69bd749a-586c-4fb5-b6d8-d0cc0aad2bde service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131456 Nov 02 13:33:35.281969 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2383/4434] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:35.505550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7f3cd66-c6d8-427d-8d6d-ba349d983d06 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.889276 Nov 02 13:33:35.517519 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2052/4435] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:34 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:35.772937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:35.775342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 9ceca675-5b17-4d42-8176-230e7ae7f8c6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:35.783536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:35.786221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:35.787485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:35.788475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:35.789157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:35.790009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:36.531361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f2d6734-ac9a-49db-8516-f746e839f4b8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787664dc0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:36.653244 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f2d6734-ac9a-49db-8516-f746e839f4b8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.132611 Nov 02 13:33:36.664126 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2053/4436] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:36 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:36.815089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:36.840166 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0fb42ac4-ef8c-49c1-b373-5e73dda45a99 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6" status: 200 len: 1323 microversion: 2.1 time: 1.074204 Nov 02 13:33:36.840823 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2384/4437] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:35 2022] GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6 => generated 1323 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:37.017762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-477983013", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": "none"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:37.203608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:33:37.204780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:33:37.209376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:33:37.227360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:33:37.232093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:33:37.273959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:37.275934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:37.276724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:37.288985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:37.294678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:37.297583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:37.356941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Getting quotas for project 10c6a863567b4226adc190de935a4c99. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:33:37.374941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Getting quotas for user d05dc52126c045b6897fb332d10a2512 and project 10c6a863567b4226adc190de935a4c99. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:33:37.417917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:33:37.427380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:33:37.615999 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ffd855d4-bbee-406d-a100-874859dd5aed tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.47 time: 0.946039 Nov 02 13:33:37.617902 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2054/4438] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:33:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:33:37.636409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-27ac5354-0656-40a7-b455-75c14ee4069c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:37.637354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-27ac5354-0656-40a7-b455-75c14ee4069c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:37.689668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-26a46112-ef68-4554-a66e-f282d742e70f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787d7a700>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:37.811155 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-26a46112-ef68-4554-a66e-f282d742e70f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.143096 Nov 02 13:33:37.811983 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2055/4439] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:37 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:37.826639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-421c3dd0-c1e1-467f-8e23-e1cb3b89e4d9 req-74a66500-39fa-45db-bd77-e0c1d894da1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceca675-5b17-4d42-8176-230e7ae7f8c6", "name": "network-vif-plugged", "status": "completed", "tag": "83ee8877-74d9-4313-a190-dc042b2c586d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:37.852688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-421c3dd0-c1e1-467f-8e23-e1cb3b89e4d9 req-74a66500-39fa-45db-bd77-e0c1d894da1b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:37.854827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-421c3dd0-c1e1-467f-8e23-e1cb3b89e4d9 req-74a66500-39fa-45db-bd77-e0c1d894da1b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:37.862934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-421c3dd0-c1e1-467f-8e23-e1cb3b89e4d9 req-74a66500-39fa-45db-bd77-e0c1d894da1b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:37.901301 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-421c3dd0-c1e1-467f-8e23-e1cb3b89e4d9 req-74a66500-39fa-45db-bd77-e0c1d894da1b service nova] Creating event network-vif-plugged:83ee8877-74d9-4313-a190-dc042b2c586d for instance 9ceca675-5b17-4d42-8176-230e7ae7f8c6 on n-h1-858384-19 Nov 02 13:33:37.919033 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-421c3dd0-c1e1-467f-8e23-e1cb3b89e4d9 req-74a66500-39fa-45db-bd77-e0c1d894da1b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103977 Nov 02 13:33:37.921389 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2056/4440] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:37.945063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:37.948038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 9ceca675-5b17-4d42-8176-230e7ae7f8c6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:37.968129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:37.969481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:37.972237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:37.978964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:37.980358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:37.981637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:38.128512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27ac5354-0656-40a7-b455-75c14ee4069c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:38.138351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27ac5354-0656-40a7-b455-75c14ee4069c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:38.139872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27ac5354-0656-40a7-b455-75c14ee4069c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:38.141009 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-27ac5354-0656-40a7-b455-75c14ee4069c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1283 microversion: 2.47 time: 0.515259 Nov 02 13:33:38.156257 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2385/4441] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:37 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1283 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:38.733969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:38.750058 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc3fb341-e898-418b-a453-72fdd3cddb76 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6" status: 200 len: 1323 microversion: 2.1 time: 0.820524 Nov 02 13:33:38.751317 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2057/4442] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:37 2022] GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6 => generated 1323 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:38.841624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49420304-f8c3-452d-b2d4-601535588b77 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78611b8b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:39.173573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:39.174244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:39.184016 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-49420304-f8c3-452d-b2d4-601535588b77 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.350599 Nov 02 13:33:39.191630 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2386/4443] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:38 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:39.223699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:39.265642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:39.266104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:39.266865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:39.286038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:39.286555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:39.359959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:39.779430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:39.780185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 9ceca675-5b17-4d42-8176-230e7ae7f8c6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:39.791743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:39.800072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:39.809285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:39.810563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:39.813778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:39.819102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:39.829619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:39.840754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:39.852366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:39.855066 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49192a13-434a-4d7b-8c8e-dbf377620c2c tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1287 microversion: 2.47 time: 0.687435 Nov 02 13:33:39.858696 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2058/4444] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:39 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1287 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:33:40.210060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cefac43b-c1c9-403d-8d44-5da1db40ee88 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78686f670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:40.364864 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cefac43b-c1c9-403d-8d44-5da1db40ee88 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.160493 Nov 02 13:33:40.369438 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2059/4445] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:40 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:40.694497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:40.739230 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dfd76e62-f53e-4a2d-9b35-5af8ef53d88b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6" status: 200 len: 1323 microversion: 2.1 time: 0.964118 Nov 02 13:33:40.740147 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2387/4446] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:39 2022] GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6 => generated 1323 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:40.890897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:40.891563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:40.924172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:40.926455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:40.927092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:40.928093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:40.928771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:40.929385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:41.181976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:41.193740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:41.195936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:41.197675 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7aee6b47-6ef0-4fbd-918b-c3ceb92a4046 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1335 microversion: 2.47 time: 0.312097 Nov 02 13:33:41.198789 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2060/4447] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:40 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1335 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:41.385440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89d4909b-a503-43f9-bcea-9c5a8775a297 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78611b670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:41.491004 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89d4909b-a503-43f9-bcea-9c5a8775a297 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.109721 Nov 02 13:33:41.494622 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2388/4448] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:41 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:41.776739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:41.782454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 9ceca675-5b17-4d42-8176-230e7ae7f8c6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:41.821486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:41.838763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:41.840018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:41.846061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:41.853334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:41.860150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:42.249207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:42.250102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:42.273767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:42.280225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:42.287249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:42.288409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:42.298808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:42.301025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:42.510153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:42.537065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:42.541588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:42.558695 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0701cc77-8ff8-4310-a7b2-37314b00fe10 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1341 microversion: 2.47 time: 0.302894 Nov 02 13:33:42.561941 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2389/4449] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:42 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1341 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:33:42.574781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-94433a55-9a2c-40fb-b392-31acbb07e337 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786130430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:42.677172 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-94433a55-9a2c-40fb-b392-31acbb07e337 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.110967 Nov 02 13:33:42.677773 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2390/4450] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:42 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:42.772902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:42.793389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9d4dde4-ce0a-4ffe-b3f1-1f3727d0be92 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6" status: 200 len: 1511 microversion: 2.1 time: 1.028229 Nov 02 13:33:42.809180 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2061/4451] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:41 2022] GET /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6 => generated 1511 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:42.822812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:42.823707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 9ceca675-5b17-4d42-8176-230e7ae7f8c6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:42.833568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:42.839250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:42.842386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:42.843482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:42.847320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:42.854413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:42.964616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 9ceca675-5b17-4d42-8176-230e7ae7f8c6] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:43.171311 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a3580bf0-fa63-41b5-b14c-e25ef8cc98f9 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6" status: 204 len: 0 microversion: 2.1 time: 0.352134 Nov 02 13:33:43.172499 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2391/4452] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:33:42 2022] DELETE /compute/v2.1/servers/9ceca675-5b17-4d42-8176-230e7ae7f8c6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:33:43.185222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:43.185796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:43.206683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:43.210988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:43.212938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:43.213952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:43.215704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:43.216423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:43.326559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 0b5b08d5-bad6-4f3f-8fd4-258b7930b314] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:43.594937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:43.595710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:43.609623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:43.611857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:43.614778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:43.615805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:43.618094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:43.618784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:43.619770 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e258e41f-5a25-41d0-a0b0-ba5c99ce912c tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314" status: 204 len: 0 microversion: 2.1 time: 0.439779 Nov 02 13:33:43.620962 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2062/4453] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:33:43 2022] DELETE /compute/v2.1/servers/0b5b08d5-bad6-4f3f-8fd4-258b7930b314 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:33:43.696783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aea239e0-acc2-4c9f-b327-32f84bac225c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f9da0d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:43.792291 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aea239e0-acc2-4c9f-b327-32f84bac225c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.101978 Nov 02 13:33:43.793630 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2063/4454] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:43 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:43.886068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:43.905096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:43.912308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:43.923434 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ebbb080-a36c-427e-9bda-8126a8da93b3 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1341 microversion: 2.47 time: 0.324040 Nov 02 13:33:43.923434 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2392/4455] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:43 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1341 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:43.944713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1703620437", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a51594b5-f7a2-4ac2-8ce7-dad5e878026e"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:44.064515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] validate_networks() for [('a51594b5-f7a2-4ac2-8ce7-dad5e878026e', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:33:44.668714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1322272205", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:44.791088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] validate_networks() for [('991b7f8e-606b-4172-a178-2571596c958a', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:33:45.153210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:33:45.153840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:33:45.155289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:33:45.156083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:33:45.157200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:33:45.180651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:45.183882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:45.185573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:45.186611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:45.192688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:45.194165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:45.222868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Getting quotas for project 5cee3ec1369f453c9fcbc8cb46b8b7f3. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:33:45.230701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Getting quotas for user e973866c9b404719b4223679d7795f4d and project 5cee3ec1369f453c9fcbc8cb46b8b7f3. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:33:45.285867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Going to run 2 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:33:45.292941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:33:45.433228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=92c46dd0-0333-41de-a41f-d089c257f1f3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:33:45.677611 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee8936cb-1b9f-4c65-ab31-2c42909389f7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.732341 Nov 02 13:33:45.678624 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2064/4456] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:33:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 1740 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 13:33:45.709069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d5c13ae-2752-41d4-a032-e1f75471d773 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786d6d9d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:45.845745 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d5c13ae-2752-41d4-a032-e1f75471d773 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.156158 Nov 02 13:33:45.860656 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2065/4457] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:45 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:45.870630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:45.873359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:45.893553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:45.903905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:45.904532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:45.906447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:45.911575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:45.912271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:46.291773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:46.307392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:46.317117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:46.322801 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5c72bb63-170e-4716-86af-021597462d80 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1341 microversion: 2.47 time: 0.459511 Nov 02 13:33:46.326083 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2066/4458] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:45 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1341 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:46.338899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:46.363961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:46.366926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Searching by: {'deleted': False, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:33:46.422388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:46.423528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:46.426117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:46.427230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:46.428749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:46.429759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:46.513295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:33:46.710979 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3325f462-d631-41e2-a8d3-4dcea44624d1 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 1343 microversion: 2.1 time: 0.333567 Nov 02 13:33:46.725812 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2067/4459] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:33:46 2022] GET /compute/v2.1/servers => generated 1343 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:46.731268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5d351fe2-1545-4256-aa53-53fce4f4d177 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:46.748014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5d351fe2-1545-4256-aa53-53fce4f4d177 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:47.364006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5d351fe2-1545-4256-aa53-53fce4f4d177 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:47.382342 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5d351fe2-1545-4256-aa53-53fce4f4d177 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1222 microversion: 2.1 time: 0.654326 Nov 02 13:33:47.387381 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2068/4460] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:46 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1222 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:47.422258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f24db90b-6aa1-4d77-b4ab-9661b0696188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78fa864c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:47.591279 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f24db90b-6aa1-4d77-b4ab-9661b0696188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.193452 Nov 02 13:33:47.596964 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2069/4461] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:47 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:47.623735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:47.624740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:47.656743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:47.660944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:47.662957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:47.665911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:47.668225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:47.671235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.113751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:48.130304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:48.131900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:48.137347 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-db1d17e2-95b1-47e6-98be-ee463e5f1b11 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1362 microversion: 2.47 time: 0.538993 Nov 02 13:33:48.138188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:48.149448 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2070/4462] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:47 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1362 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:48.154410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-fcb9d5d3-33c8-46ec-b785-212ee44cab64 req-a2af917f-422b-4f31-9354-5c8fb55787d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5b08d5-bad6-4f3f-8fd4-258b7930b314", "name": "network-vif-deleted", "tag": "12a27dd6-f7f7-421d-a75d-a6823f16fe1f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:48.214507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fcb9d5d3-33c8-46ec-b785-212ee44cab64 req-a2af917f-422b-4f31-9354-5c8fb55787d9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:48.215004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fcb9d5d3-33c8-46ec-b785-212ee44cab64 req-a2af917f-422b-4f31-9354-5c8fb55787d9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:48.226642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fcb9d5d3-33c8-46ec-b785-212ee44cab64 req-a2af917f-422b-4f31-9354-5c8fb55787d9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.277509 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-fcb9d5d3-33c8-46ec-b785-212ee44cab64 req-a2af917f-422b-4f31-9354-5c8fb55787d9 service nova] Creating event network-vif-deleted:12a27dd6-f7f7-421d-a75d-a6823f16fe1f for instance 0b5b08d5-bad6-4f3f-8fd4-258b7930b314 on n-h2-858384-19 Nov 02 13:33:48.295349 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-fcb9d5d3-33c8-46ec-b785-212ee44cab64 req-a2af917f-422b-4f31-9354-5c8fb55787d9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144498 Nov 02 13:33:48.295973 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2071/4463] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:33:48.316993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ac0f0d3a-7f50-46bf-982e-3dc327e42c2d tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-995141950"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:48.338198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ac0f0d3a-7f50-46bf-982e-3dc327e42c2d tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:48.365197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac0f0d3a-7f50-46bf-982e-3dc327e42c2d tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:48.366376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac0f0d3a-7f50-46bf-982e-3dc327e42c2d tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:48.367304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac0f0d3a-7f50-46bf-982e-3dc327e42c2d tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.368195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac0f0d3a-7f50-46bf-982e-3dc327e42c2d tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:48.375495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac0f0d3a-7f50-46bf-982e-3dc327e42c2d tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:48.379464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac0f0d3a-7f50-46bf-982e-3dc327e42c2d tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.707862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:33:48.710191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:33:48.712450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:33:48.716667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:33:48.717944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:33:48.771798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:48.778266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:48.781215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.790887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:48.800066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:48.803527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:48.964265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Getting quotas for project b65cdb24e2274372bd18044e6aa375bd. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:33:48.986286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Getting quotas for user 075abc4f18b9481c90eef85eca4e8a81 and project b65cdb24e2274372bd18044e6aa375bd. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:33:49.029601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:33:49.037555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:33:49.099537 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ac0f0d3a-7f50-46bf-982e-3dc327e42c2d tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "POST /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459/action" status: 202 len: 52 microversion: 2.47 time: 0.790672 Nov 02 13:33:49.104164 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2072/4464] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:33:48 2022] POST /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459/action => generated 52 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:33:49.139841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:49.141891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:49.177029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.177945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.180039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.181208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.182447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.192096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.257021 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-328bda21-16f2-42fc-acd0-5da568d49f39 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.868555 Nov 02 13:33:49.264332 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2393/4465] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:33:44 2022] POST /compute/v2.1/servers => generated 382 bytes in 4877 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:33:49.287363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-14ad8eb8-842d-4117-8976-336ccb1f2f8c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786288e50>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:49.438367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-14ad8eb8-842d-4117-8976-336ccb1f2f8c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.171160 Nov 02 13:33:49.441106 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2394/4466] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:49 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:49.447249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:49.458884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:49.491889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.501061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.501725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.503467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:49.504059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:49.513534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:49.623756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:33:49.633409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:49.658172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd73226e-6d7f-4063-b5d5-ca0a69a79e3b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1218 microversion: 2.1 time: 0.550912 Nov 02 13:33:49.664277 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2073/4467] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:49 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1218 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:49.691248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-abbbc0a3-e647-480c-986e-78970b6d6c9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:49.691983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-abbbc0a3-e647-480c-986e-78970b6d6c9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:50.005485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d489182-0f68-4c1e-8ba9-f6f9f0dbebb8 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 204 len: 0 microversion: 2.47 time: 0.562018 Nov 02 13:33:50.007530 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2395/4468] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:33:49 2022] DELETE /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:33:50.031632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:50.038111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:50.058156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:50.061037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:50.064247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:50.065672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:50.067911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:50.070795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:50.133801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-abbbc0a3-e647-480c-986e-78970b6d6c9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:50.144536 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-abbbc0a3-e647-480c-986e-78970b6d6c9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1228 microversion: 2.1 time: 0.471065 Nov 02 13:33:50.149906 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2074/4469] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:49 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1228 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:50.375368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1a975a3d-cb5c-482e-b470-7e3d44f806ad req-e3ef25b5-5573-4358-81aa-954765d509c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceca675-5b17-4d42-8176-230e7ae7f8c6", "name": "network-vif-deleted", "tag": "83ee8877-74d9-4313-a190-dc042b2c586d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:33:50.428715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1a975a3d-cb5c-482e-b470-7e3d44f806ad req-e3ef25b5-5573-4358-81aa-954765d509c4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:50.429438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1a975a3d-cb5c-482e-b470-7e3d44f806ad req-e3ef25b5-5573-4358-81aa-954765d509c4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:50.429869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1a975a3d-cb5c-482e-b470-7e3d44f806ad req-e3ef25b5-5573-4358-81aa-954765d509c4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:50.525321 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1a975a3d-cb5c-482e-b470-7e3d44f806ad req-e3ef25b5-5573-4358-81aa-954765d509c4 service nova] Creating event network-vif-deleted:83ee8877-74d9-4313-a190-dc042b2c586d for instance 9ceca675-5b17-4d42-8176-230e7ae7f8c6 on n-h1-858384-19 Nov 02 13:33:50.588978 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1a975a3d-cb5c-482e-b470-7e3d44f806ad req-e3ef25b5-5573-4358-81aa-954765d509c4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219013 Nov 02 13:33:50.596894 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2075/4470] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:33:50.602424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3061019b-e234-4c90-b7a6-890bbe730b2d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f9813a0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:50.812560 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3061019b-e234-4c90-b7a6-890bbe730b2d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.214271 Nov 02 13:33:50.813906 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2076/4471] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:50 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:50.840270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:50.847884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:50.851663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:50.859920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:50.870615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:50.873318 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-934887f4-f685-4a84-8d7d-df15c6995e1f tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1368 microversion: 2.47 time: 0.858768 Nov 02 13:33:50.876422 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2396/4472] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:50 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1368 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:50.899223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:50.899768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:50.900237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:50.901028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:50.901463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:50.914481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:51.174845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a74bfe05-625d-42e2-810a-41639ac17559 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:51.177664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a74bfe05-625d-42e2-810a-41639ac17559 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:51.787276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:51.803677 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e73e982b-3af3-4366-9d91-4cd2f600226d tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1274 microversion: 2.1 time: 0.985394 Nov 02 13:33:51.804285 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2077/4473] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:50 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1274 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:51.839280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65d165fa-efb7-43f5-9645-4a55476e7b11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7869069d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:52.276098 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-65d165fa-efb7-43f5-9645-4a55476e7b11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.447841 Nov 02 13:33:52.278429 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2078/4474] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:51 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:52.325414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:52.340573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:52.372999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:52.378636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:52.380810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:52.384826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:52.390608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:52.398817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:52.958172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a74bfe05-625d-42e2-810a-41639ac17559 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:52.990613 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a74bfe05-625d-42e2-810a-41639ac17559 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1228 microversion: 2.1 time: 1.816572 Nov 02 13:33:52.996955 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2397/4475] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:51 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1228 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:53.021369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:53.023944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:53.051079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:53.056174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:53.059341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:53.061484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:53.078633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:53.083024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:54.025166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:54.047752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:54.058572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:54.060285 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a15c7ab-9c06-484b-a5f2-a9cc63948603 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1368 microversion: 2.47 time: 1.764688 Nov 02 13:33:54.063844 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2079/4476] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:52 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1368 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:54.083804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-025d5b21-0b72-4c5a-b200-ac03fc4a665d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f9819d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:54.205738 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-025d5b21-0b72-4c5a-b200-ac03fc4a665d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.139963 Nov 02 13:33:54.208599 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2080/4477] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:54 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:54.218935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:54.219867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:54.237180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:54.240227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:54.240972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:54.242196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:54.244486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:54.245380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:54.403224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:54.405712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:54.413016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:54.419909 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-881d2f24-3631-4dd8-9b54-1f5095328095 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1280 microversion: 2.1 time: 1.419929 Nov 02 13:33:54.427731 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2398/4478] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:52 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1280 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:54.429379 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4fe78c68-b8c0-4a82-a51c-fdad0dfe03b6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1286 microversion: 2.1 time: 0.216245 Nov 02 13:33:54.430544 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2081/4479] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:54 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1286 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:55.097022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:55.098529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:55.149303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.150836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.151939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.153308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.155579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.157392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.222939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b703ab98-1a58-4676-8188-37413d8799f8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787d61c10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:55.369605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.370015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.370456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.378172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lazy-loading 'fault' on Instance uuid e9208779-45ad-49b8-9273-e8cfe2dad459 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:33:55.381504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b703ab98-1a58-4676-8188-37413d8799f8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.163480 Nov 02 13:33:55.382387 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2082/4480] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:55 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:55.457799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:55.458697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:55.477240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.486207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.487250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.490663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.495804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.499961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.773042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:55.776007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:55.805559 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-77e39698-9187-441e-b29e-c2d3c86cbb22 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1280 microversion: 2.1 time: 0.352916 Nov 02 13:33:55.810506 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2083/4481] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:55 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1280 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:55.827443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:55.827443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:55.874475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.876022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.879869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:55.881917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:55.887878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:55.888638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:56.448442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:56.915997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:56.932695 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b479cc60-1027-47fc-95fe-9e49b1a2a083 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1286 microversion: 2.1 time: 1.116092 Nov 02 13:33:56.949631 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2084/4482] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:55 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1286 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:56.961089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af0c8bc0-7589-4a6f-886a-c6d422927839 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f8b1b80>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:57.054550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af0c8bc0-7589-4a6f-886a-c6d422927839 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.102429 Nov 02 13:33:57.056680 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2085/4483] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:56 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:57.078507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:57.079466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:57.107598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:57.108228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:57.108695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:57.117139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:57.122707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:57.123274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:57.128544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:57.133041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:57.143727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd05dc52126c045b6897fb332d10a2512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6a863567b4226adc190de935a4c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:57.145005 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb708b7d-3b92-4381-b204-585a83b1e9b0 tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 200 len: 1373 microversion: 2.47 time: 2.054384 Nov 02 13:33:57.145601 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2399/4484] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:55 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 1373 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:33:57.957650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:57.958586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:57.977501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:57.980922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:57.981589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:57.987211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:57.990263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:57.998693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:58.016065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:58.025205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cfeab3cb-a9e1-41b5-8e41-60dfabe83554 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 0.967288 Nov 02 13:33:58.043737 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2086/4485] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:57 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:58.072692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f04195cf-134a-46f6-bf7e-cfb41cd97565 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f92a0d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:58.182158 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f04195cf-134a-46f6-bf7e-cfb41cd97565 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.113653 Nov 02 13:33:58.185130 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2087/4486] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:58 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:58.195542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:58.198923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] [instance: e9208779-45ad-49b8-9273-e8cfe2dad459] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:58.216550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:58.217014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:58.218040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:58.222067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:58.222610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:58.223079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:58.294021 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] HTTP exception thrown: Instance e9208779-45ad-49b8-9273-e8cfe2dad459 could not be found. Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Request method failure captured: Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 HTTP/1.1 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnGw5npS0nCEoVahGItGI8ixA4843NxGTkPArXYtg_-WPcMO68tdMBYjuKx9Qr6Y3q3NwSivkcSD63-5zoEs6S_Ug6mvkS3RAbpMCATnOInUvdmmZhfw5vpfjsYAOK8joTL7MLOstwwezO6w_HD5XNzz9ORipci5CrrDC9fo_f828hk Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 10c6a863567b4226adc190de935a4c99 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersAaction247Test-1868268107 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/10c6a863567b4226adc190de935a4c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/10c6a863567b4226adc190de935a4c99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_10c6a863567b4226adc190de935a4c99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/10c6a863567b4226adc190de935a4c99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersAaction247Test-1868268107 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 10c6a863567b4226adc190de935a4c99 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersAaction247Test-1868268107 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersAaction247Test-1868268107-project Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: d05dc52126c045b6897fb332d10a2512 Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersAaction247Test-1868268107-project Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance e9208779-45ad-49b8-9273-e8cfe2dad459 could not be found. Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e9208779-45ad-49b8-9273-e8cfe2dad459'} Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9208779-45ad-49b8-9273-e8cfe2dad459 could not be found. Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9208779-45ad-49b8-9273-e8cfe2dad459 could not be found. Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:58.302171 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:33:58.306174 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:58.306174 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:33:58.306174 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:33:58.306174 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:33:58.306174 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:33:58.306174 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:33:58.306174 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9208779-45ad-49b8-9273-e8cfe2dad459 could not be found. Nov 02 13:33:58.306174 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:33:58.310727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] Returning 404 to user: Instance e9208779-45ad-49b8-9273-e8cfe2dad459 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:33:58.314627 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe0e2e3d-708b-446c-9108-726581881c8e tempest-ServersAaction247Test-1868268107 tempest-ServersAaction247Test-1868268107-project] 10.222.0.113 "GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459" status: 404 len: 111 microversion: 2.47 time: 0.126743 Nov 02 13:33:58.320508 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2088/4487] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:33:58 2022] GET /compute/v2.1/servers/e9208779-45ad-49b8-9273-e8cfe2dad459 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:33:58.897908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:33:59.051823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:59.052592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:33:59.089108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:59.093092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:59.097031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:59.098919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:33:59.103938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:33:59.105041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:33:59.215515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:59.230057 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1ff1f46-cc0d-4cb1-90e2-7e09654ffeb3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 1.277790 Nov 02 13:33:59.230660 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2400/4488] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:57 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:33:59.254043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c28fa2d-be03-4193-93f8-5cee15a2c3cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786102e50>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:33:59.375397 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c28fa2d-be03-4193-93f8-5cee15a2c3cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.134455 Nov 02 13:33:59.376397 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2401/4489] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:33:59 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:33:59.784965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:33:59.798501 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b85e94de-0af5-4daf-903c-52725319fd94 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 0.750475 Nov 02 13:33:59.800638 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2089/4490] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:33:59 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:00.244053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec3b4094-f730-403d-b6b3-15fe7689f226 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Action: 'create', calling method: .version_select at 0x7fe7861303a0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:00.259381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:00.260011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:00.262505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=16 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:00.274008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:00.282587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:00.283039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:00.292608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:00.298097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:00.298573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:00.306648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:00.358464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-ec3b4094-f730-403d-b6b3-15fe7689f226 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Getting quotas for project 61f73e16e670450fbca903dd9a551c29. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:00.384833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-ec3b4094-f730-403d-b6b3-15fe7689f226 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Getting quotas for user 01107e649ca8424fb7d7cf77c19e9bd3 and project 61f73e16e670450fbca903dd9a551c29. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:00.564017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-ec3b4094-f730-403d-b6b3-15fe7689f226 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Getting quotas for project 61f73e16e670450fbca903dd9a551c29. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:00.587946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-ec3b4094-f730-403d-b6b3-15fe7689f226 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Getting quotas for user 01107e649ca8424fb7d7cf77c19e9bd3 and project 61f73e16e670450fbca903dd9a551c29. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:00.647452 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ec3b4094-f730-403d-b6b3-15fe7689f226 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] 10.222.0.113 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.681348 Nov 02 13:34:00.656188 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2402/4491] 10.222.0.113 () {62 vars in 1219 bytes} [Wed Nov 2 13:33:59 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:34:00.669477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bc73bffe-3c3b-4fda-a006-d690d9ccd698 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7861efa60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:00.766680 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bc73bffe-3c3b-4fda-a006-d690d9ccd698 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.109005 Nov 02 13:34:00.768668 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2403/4492] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:34:00 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:00.781303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-85c9f743-affb-470a-8510-5181832b38f3 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:00.824683 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-85c9f743-affb-470a-8510-5181832b38f3 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.054056 Nov 02 13:34:00.825553 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2404/4493] 10.222.0.113 () {60 vars in 1198 bytes} [Wed Nov 2 13:34:00 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:34:00.832009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:00.833738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:00.842044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:00.842831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:00.843814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:00.845652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:00.847442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:00.850704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:01.846383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:01.859048 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-638de52d-ea45-4ec9-af0e-aee8810bcd8e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 1.600971 Nov 02 13:34:01.862351 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2090/4494] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:00 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:01.874562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e01bc6f-cc21-46aa-a4b7-b9121e0a3149 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:01.897547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:01.906998 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e01bc6f-cc21-46aa-a4b7-b9121e0a3149 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups/71318ce0-2c1b-45fd-9ab8-fa32bb11403b" status: 200 len: 235 microversion: 2.64 time: 0.043159 Nov 02 13:34:01.908637 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2091/4495] 10.222.0.113 () {60 vars in 1309 bytes} [Wed Nov 2 13:34:01 2022] GET /compute/v2.1/os-server-groups/71318ce0-2c1b-45fd-9ab8-fa32bb11403b => generated 235 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:34:01.919388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-41a2316b-8cf3-46f7-bd31-a287d9ae140c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787d109d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:02.037974 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-41a2316b-8cf3-46f7-bd31-a287d9ae140c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.128036 Nov 02 13:34:02.038623 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2092/4496] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:34:01 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:02.058407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3fcd6503-4460-4e54-bf66-98906b3b1a3e tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:02.123685 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3fcd6503-4460-4e54-bf66-98906b3b1a3e tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/71318ce0-2c1b-45fd-9ab8-fa32bb11403b" status: 204 len: 0 microversion: 2.64 time: 0.079027 Nov 02 13:34:02.129191 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2093/4497] 10.222.0.113 () {60 vars in 1312 bytes} [Wed Nov 2 13:34:02 2022] DELETE /compute/v2.1/os-server-groups/71318ce0-2c1b-45fd-9ab8-fa32bb11403b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:34:02.141440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0473ac2e-d1bf-4618-b347-6f2397848828 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:02.160196 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-0473ac2e-d1bf-4618-b347-6f2397848828 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] HTTP exception thrown: Instance group 71318ce0-2c1b-45fd-9ab8-fa32bb11403b could not be found. Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0473ac2e-d1bf-4618-b347-6f2397848828 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Request method failure captured: Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-server-groups/71318ce0-2c1b-45fd-9ab8-fa32bb11403b HTTP/1.1 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnHH9p5-cNAEOajke2IfK2jVR0VfLKlR8-0BZkCmUS1_k6FvQc1RsFWIL4PI_CF3dH3XpebCFrq6J6MpPyAq-sc4p89UOL1fGAVGlv6rr3qkE5LIxJNqkYgZF3Uib-2Dfogkv0BCgyBYQdEVPI-AU4afG_ahqRlabQHdGYE-3ZT0pIc Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.64 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 61f73e16e670450fbca903dd9a551c29 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerGroup264TestJSON-162531659 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/61f73e16e670450fbca903dd9a551c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/61f73e16e670450fbca903dd9a551c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_61f73e16e670450fbca903dd9a551c29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/61f73e16e670450fbca903dd9a551c29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerGroup264TestJSON-162531659 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 61f73e16e670450fbca903dd9a551c29 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerGroup264TestJSON-162531659 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerGroup264TestJSON-162531659-project Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 01107e649ca8424fb7d7cf77c19e9bd3 Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerGroup264TestJSON-162531659-project Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance group 71318ce0-2c1b-45fd-9ab8-fa32bb11403b could not be found. Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '71318ce0-2c1b-45fd-9ab8-fa32bb11403b'} Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 71318ce0-2c1b-45fd-9ab8-fa32bb11403b could not be found. Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 71318ce0-2c1b-45fd-9ab8-fa32bb11403b could not be found. Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:02.172027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:02.176636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:02.176636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:02.176636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:34:02.176636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:34:02.176636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 71318ce0-2c1b-45fd-9ab8-fa32bb11403b could not be found. Nov 02 13:34:02.176636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:02.178932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0473ac2e-d1bf-4618-b347-6f2397848828 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] Returning 404 to user: Instance group 71318ce0-2c1b-45fd-9ab8-fa32bb11403b could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:02.180095 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0473ac2e-d1bf-4618-b347-6f2397848828 tempest-ServerGroup264TestJSON-162531659 tempest-ServerGroup264TestJSON-162531659-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/71318ce0-2c1b-45fd-9ab8-fa32bb11403b" status: 404 len: 117 microversion: 2.64 time: 0.049531 Nov 02 13:34:02.185752 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2094/4498] 10.222.0.113 () {60 vars in 1312 bytes} [Wed Nov 2 13:34:02 2022] DELETE /compute/v2.1/os-server-groups/71318ce0-2c1b-45fd-9ab8-fa32bb11403b => generated 117 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:34:02.578521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-42e8d021-ac41-4155-8b2f-011ee04f6361 req-402b106a-2fdf-4e4b-a7c1-f3c6257928c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c46dd0-0333-41de-a41f-d089c257f1f3", "tag": "922690eb-3547-4f2b-9260-8570ae8d2cf5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:02.615710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42e8d021-ac41-4155-8b2f-011ee04f6361 req-402b106a-2fdf-4e4b-a7c1-f3c6257928c6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:02.616932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42e8d021-ac41-4155-8b2f-011ee04f6361 req-402b106a-2fdf-4e4b-a7c1-f3c6257928c6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:02.619665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42e8d021-ac41-4155-8b2f-011ee04f6361 req-402b106a-2fdf-4e4b-a7c1-f3c6257928c6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:02.655653 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-42e8d021-ac41-4155-8b2f-011ee04f6361 req-402b106a-2fdf-4e4b-a7c1-f3c6257928c6 service nova] Creating event network-changed:922690eb-3547-4f2b-9260-8570ae8d2cf5 for instance 92c46dd0-0333-41de-a41f-d089c257f1f3 on n-h2-858384-19 Nov 02 13:34:02.675571 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-42e8d021-ac41-4155-8b2f-011ee04f6361 req-402b106a-2fdf-4e4b-a7c1-f3c6257928c6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107518 Nov 02 13:34:02.681998 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2095/4499] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 13:34:02.761406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:02.800189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b71e3021-d1b7-4fbb-b210-14e18939ef96 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 1.969373 Nov 02 13:34:02.800866 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2405/4500] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:00 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:02.893499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:02.894151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:02.913565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:02.913994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:02.914548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:02.915198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:02.923463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:02.925153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:02.969696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-42fe6192-ce73-4d8a-9aa4-85bb58c4c506 req-f2105a30-dc40-41f9-aa8c-ecd21552f52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04cf1cc5-0a81-4a08-8b68-0a8d1936cc94", "tag": "dfaf6502-9a77-44ab-b2bf-a8ad89a10bb1"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:03.001166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42fe6192-ce73-4d8a-9aa4-85bb58c4c506 req-f2105a30-dc40-41f9-aa8c-ecd21552f52a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:03.004029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42fe6192-ce73-4d8a-9aa4-85bb58c4c506 req-f2105a30-dc40-41f9-aa8c-ecd21552f52a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:03.004860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42fe6192-ce73-4d8a-9aa4-85bb58c4c506 req-f2105a30-dc40-41f9-aa8c-ecd21552f52a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:03.074350 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-42fe6192-ce73-4d8a-9aa4-85bb58c4c506 req-f2105a30-dc40-41f9-aa8c-ecd21552f52a service nova] Creating event network-changed:dfaf6502-9a77-44ab-b2bf-a8ad89a10bb1 for instance 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 on n-h2-858384-19 Nov 02 13:34:03.119992 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-42fe6192-ce73-4d8a-9aa4-85bb58c4c506 req-f2105a30-dc40-41f9-aa8c-ecd21552f52a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.375488 Nov 02 13:34:03.124487 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2096/4501] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:34:03.140624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e23b4d88-ab57-495f-9c90-87907d7f3ec8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78767c790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:03.288157 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e23b4d88-ab57-495f-9c90-87907d7f3ec8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.162253 Nov 02 13:34:03.288770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2097/4502] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:34:03 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:03.772486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:03.804463 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-caa90001-b66e-4ebb-a962-4bc90bfd1f9c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 0.913547 Nov 02 13:34:03.805451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2406/4503] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:02 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:03.829601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:03.832062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:03.878144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:03.878743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:03.887995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:03.891620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:03.895456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:03.895966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:04.307299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6914496-bab4-44ab-938b-ea419e660f76 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78614e820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:04.459263 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c6914496-bab4-44ab-938b-ea419e660f76 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1416 microversion: 2.1 time: 0.157065 Nov 02 13:34:04.459499 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2407/4504] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:34:04 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1416 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:04.809688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-2e145b9d-7ea7-4123-902b-f5b44e4b6b37 req-754af83a-9b07-491b-bd65-3d51f7c18e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7aca59d-2072-4dab-8cb3-332b43c8f0a1", "tag": "78bb2231-276f-45ee-aaea-b4a4ac2d6eaf"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:04.849260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2e145b9d-7ea7-4123-902b-f5b44e4b6b37 req-754af83a-9b07-491b-bd65-3d51f7c18e46 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:04.850347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2e145b9d-7ea7-4123-902b-f5b44e4b6b37 req-754af83a-9b07-491b-bd65-3d51f7c18e46 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:04.851651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2e145b9d-7ea7-4123-902b-f5b44e4b6b37 req-754af83a-9b07-491b-bd65-3d51f7c18e46 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:04.890557 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-2e145b9d-7ea7-4123-902b-f5b44e4b6b37 req-754af83a-9b07-491b-bd65-3d51f7c18e46 service nova] Creating event network-changed:78bb2231-276f-45ee-aaea-b4a4ac2d6eaf for instance b7aca59d-2072-4dab-8cb3-332b43c8f0a1 on n-h2-858384-19 Nov 02 13:34:04.914717 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-2e145b9d-7ea7-4123-902b-f5b44e4b6b37 req-754af83a-9b07-491b-bd65-3d51f7c18e46 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108831 Nov 02 13:34:04.923684 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2408/4505] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:04.950446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:04.954755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:04.976195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:04.981136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:04.983843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:04.991066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:04.992688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:04.994066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:05.051709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:05.063467 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7b657687-fba1-434a-bf41-97ca63010ffe tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 1.242533 Nov 02 13:34:05.070796 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2098/4506] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:03 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:05.479990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fdeaffd7-74d8-40da-9835-8fb60258777d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78686f4c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:06.261084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:06.277706 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e01772a-d9ed-4468-b2f0-94966ce967fe tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 1.350126 Nov 02 13:34:06.280502 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2409/4507] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:04 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:06.296727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:06.302907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:06.309911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:06.310951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:06.311662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:06.312766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:06.313754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:06.314809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:07.433482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:07.459315 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91558fa4-8562-4a4b-969d-86e1fb81b9ee tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 1.174265 Nov 02 13:34:07.460262 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2410/4508] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:06 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:07.465825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:07.475616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:07.489045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:07.489993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:07.491823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:07.493397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:07.494710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:07.496968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:08.455264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:08.495292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17b55e2e-4741-4137-9135-3036639cb467 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 1.012627 Nov 02 13:34:08.495987 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2411/4509] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:07 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:08.537613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:08.551198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:08.584510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:08.587887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:08.588942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:08.590010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:08.592734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:08.593615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:09.802151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:09.839921 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a850dd27-d7f1-4cf5-ad94-cdb9d60336d6 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 1.333695 Nov 02 13:34:09.844411 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2412/4510] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:08 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:09.862923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:09.887082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:09.920093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:09.922596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:09.923401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:09.925939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:09.930777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:09.931799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:10.388480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:10.397658 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-92297f39-7fb8-4f0d-bce0-2c0391c6caa3 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 0.552017 Nov 02 13:34:10.402486 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2413/4511] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:09 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:10.866416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:10.868136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:10.870186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=16 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:10.883292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:10.883655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:10.884090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:10.884794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:10.885244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:10.885959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:11.626934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:11.635482 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f64db48-acc2-4934-9b5c-fe115864b830 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 0.772933 Nov 02 13:34:11.638016 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2414/4512] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:10 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:11.651949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:11.653690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:11.677734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:11.678817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:11.679534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:11.680495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:11.681179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:11.683676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:11.974172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fdeaffd7-74d8-40da-9835-8fb60258777d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1425 microversion: 2.1 time: 6.504125 Nov 02 13:34:11.987274 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2099/4513] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:34:05 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1425 bytes in 6518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:12.011269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-25fa575e-7646-43b6-bcbc-d91daa627da3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f981820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:12.091836 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-25fa575e-7646-43b6-bcbc-d91daa627da3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 200 len: 1425 microversion: 2.1 time: 0.103074 Nov 02 13:34:12.092434 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2100/4514] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:34:11 2022] GET /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 1425 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:12.108051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7fef570f-797f-4790-b9ab-7410353475f4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78fa92550>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:13.462785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:13.484299 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-02eff613-c8ac-4032-9bc8-146f136fe157 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 1.841542 Nov 02 13:34:13.486971 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2415/4515] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:11 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:13.500684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:13.501766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:13.524326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:13.525233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:13.528244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:13.529968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:13.530732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:13.531402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:13.762730 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7fef570f-797f-4790-b9ab-7410353475f4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 204 len: 0 microversion: 2.1 time: 1.659330 Nov 02 13:34:13.763948 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2101/4516] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:12 2022] DELETE /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 0 bytes in 1661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:34:13.777116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-93975036-d991-4814-98f7-e0fa6fac030f req-fdc7785b-e866-4929-8098-57899f6638b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf1cc5-0a81-4a08-8b68-0a8d1936cc94", "name": "network-vif-plugged", "status": "completed", "tag": "dfaf6502-9a77-44ab-b2bf-a8ad89a10bb1"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:13.824669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93975036-d991-4814-98f7-e0fa6fac030f req-fdc7785b-e866-4929-8098-57899f6638b2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:13.826022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93975036-d991-4814-98f7-e0fa6fac030f req-fdc7785b-e866-4929-8098-57899f6638b2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:13.827913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93975036-d991-4814-98f7-e0fa6fac030f req-fdc7785b-e866-4929-8098-57899f6638b2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:13.843426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-93975036-d991-4814-98f7-e0fa6fac030f req-fdc7785b-e866-4929-8098-57899f6638b2 service nova] Creating event network-vif-plugged:dfaf6502-9a77-44ab-b2bf-a8ad89a10bb1 for instance 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 on n-h2-858384-19 Nov 02 13:34:13.850419 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-93975036-d991-4814-98f7-e0fa6fac030f req-fdc7785b-e866-4929-8098-57899f6638b2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085197 Nov 02 13:34:13.851726 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2102/4517] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:13.860077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:13.863420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:13.871278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:13.872299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:13.890774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:13.892303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:13.896168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:13.896908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:13.950348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:34:14.139657 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c9ee36fe-783a-4052-ac02-fa0478b8f1cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 204 len: 0 microversion: 2.1 time: 0.285933 Nov 02 13:34:14.141217 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2103/4518] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:34:13 2022] DELETE /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:34:14.262554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:14.278171 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8fa399ec-c4b1-4dff-9736-8e6676228b91 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 0.788929 Nov 02 13:34:14.278804 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2416/4519] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:13 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:14.415155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-44083484", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "47bb2f77-f27b-4713-bfef-5f74b66d9d9d"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:14.536529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:14.539268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:14.569834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:14.570488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:14.570989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:14.576226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] validate_networks() for [('47bb2f77-f27b-4713-bfef-5f74b66d9d9d', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:34:14.579351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:14.580720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:14.581264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:14.932235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:14.945700 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-354da022-b045-454c-a1a9-3c8a8b0e71c6 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 0.430788 Nov 02 13:34:14.946360 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2417/4520] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:14 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:15.309170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:15.310166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:15.321359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:15.322248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:15.322990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:15.324247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:15.324869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:15.325462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:15.630248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:15.645442 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1fd979d9-4a29-41c1-aa84-56b914e73578 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 0.340801 Nov 02 13:34:15.669548 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2418/4521] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:15 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:15.975222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:15.975937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:15.987352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:15.992609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:15.993198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:15.994074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:15.995562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:16.001640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:16.353953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:16.365460 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3e57f50-8f9f-4688-86fe-a582584bb13e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 0.394376 Nov 02 13:34:16.370126 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2419/4522] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:15 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:16.685748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:16.686747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:16.698464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:16.701538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:16.706904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:16.714651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:16.715169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:16.715636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:17.193479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:17.199465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:17.210231 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b45ae607-beb9-4d2e-9c70-3c98ec3c030f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1322 microversion: 2.1 time: 0.528153 Nov 02 13:34:17.212330 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2420/4523] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:16 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:17.218464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:17.219432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:17.235450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:17.238219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:17.238889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:17.240531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:17.241167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:17.242398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:17.434260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:34:17.435666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:34:17.437134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:34:17.437787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:34:17.438364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:34:17.452915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:17.453658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:17.456144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:17.458083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:17.460399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:17.461136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:17.511973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:17.521392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for user be8bee2d23fa481193b5a23cf2348a73 and project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:17.597698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:34:17.604730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:34:17.696159 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ae78308-ac8c-43d8-9160-284fcf03b18e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.286380 Nov 02 13:34:17.697680 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2104/4524] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:14 2022] POST /compute/v2.1/servers => generated 382 bytes in 3289 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:34:18.246546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f6a8d5c9-be17-4bd1-b290-7debaebb3ef1 req-71652e60-5957-4336-8e22-9cfda9d98317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cb0435-5222-4140-af24-8cea35c0daa6", "name": "network-vif-unplugged", "status": "completed", "tag": "52fe1de7-a4e2-46a0-8735-175040987808"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:18.268823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f6a8d5c9-be17-4bd1-b290-7debaebb3ef1 req-71652e60-5957-4336-8e22-9cfda9d98317 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:18.271603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f6a8d5c9-be17-4bd1-b290-7debaebb3ef1 req-71652e60-5957-4336-8e22-9cfda9d98317 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:18.272600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f6a8d5c9-be17-4bd1-b290-7debaebb3ef1 req-71652e60-5957-4336-8e22-9cfda9d98317 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:18.302070 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f6a8d5c9-be17-4bd1-b290-7debaebb3ef1 req-71652e60-5957-4336-8e22-9cfda9d98317 service nova] Creating event network-vif-unplugged:52fe1de7-a4e2-46a0-8735-175040987808 for instance 59cb0435-5222-4140-af24-8cea35c0daa6 on n-h2-858384-19 Nov 02 13:34:18.317357 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f6a8d5c9-be17-4bd1-b290-7debaebb3ef1 req-71652e60-5957-4336-8e22-9cfda9d98317 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.617968 Nov 02 13:34:18.318293 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2105/4525] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:18.331474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:18.351376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:18.364114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:18.371764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:18.373261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:18.373261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:18.373641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:18.377045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:18.402001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:18.422296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:18.426851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:18.430347 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6273da8b-0dd9-4eff-b9fc-08b60d4badf1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2950 microversion: 2.32 time: 1.216274 Nov 02 13:34:18.433504 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2421/4526] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:34:17 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2950 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:34:18.448668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-42f73695-8b08-4604-b152-ccc0f7b0196e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:18.451655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-42f73695-8b08-4604-b152-ccc0f7b0196e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:18.690389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-42f73695-8b08-4604-b152-ccc0f7b0196e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:18.698770 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-42f73695-8b08-4604-b152-ccc0f7b0196e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1210 microversion: 2.1 time: 0.260743 Nov 02 13:34:18.719710 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2422/4527] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:18 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1210 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:18.730042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:18.732064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:18.747839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:18.749504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:18.753059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:18.757349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:18.758907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:18.760248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.200505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:19.211436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba921a0f-f52d-4ff2-97a6-af6ea3258f9a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 0.890663 Nov 02 13:34:19.214036 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2106/4528] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:18 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:19.222809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-27a913e1-b69f-4021-9558-453159dadcf8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:19.227764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-27a913e1-b69f-4021-9558-453159dadcf8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:19.239417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27a913e1-b69f-4021-9558-453159dadcf8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:19.240849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27a913e1-b69f-4021-9558-453159dadcf8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:19.241795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27a913e1-b69f-4021-9558-453159dadcf8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.242783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27a913e1-b69f-4021-9558-453159dadcf8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:19.243506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27a913e1-b69f-4021-9558-453159dadcf8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:19.244893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27a913e1-b69f-4021-9558-453159dadcf8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.395266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:19.408594 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6923295-fa0e-426b-8ea2-38fe57470649 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 200 len: 1511 microversion: 2.1 time: 0.682395 Nov 02 13:34:19.410288 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2423/4529] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:18 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 1511 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:19.435541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:19.436453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:19.448709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:19.449511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:19.451386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.452321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:19.456300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:19.457269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.826009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:19.841625 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f5299c0b-8570-4426-9356-91fdfafe3da7 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 200 len: 1322 microversion: 2.1 time: 0.410356 Nov 02 13:34:19.842505 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2424/4530] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:19 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:19.854677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9154afa9-3beb-425e-bb0a-89ad546bfded req-aefefb59-9532-46d1-a0c0-e167330cbb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59cb0435-5222-4140-af24-8cea35c0daa6", "name": "network-vif-deleted", "tag": "52fe1de7-a4e2-46a0-8735-175040987808"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:19.865694 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-27a913e1-b69f-4021-9558-453159dadcf8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.650239 Nov 02 13:34:19.867278 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2107/4531] 10.222.0.113 () {60 vars in 1321 bytes} [Wed Nov 2 13:34:19 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f/os-interface => generated 1833 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:34:19.872166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:19.874525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:19.895840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9154afa9-3beb-425e-bb0a-89ad546bfded req-aefefb59-9532-46d1-a0c0-e167330cbb17 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:19.896329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9154afa9-3beb-425e-bb0a-89ad546bfded req-aefefb59-9532-46d1-a0c0-e167330cbb17 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:19.896761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9154afa9-3beb-425e-bb0a-89ad546bfded req-aefefb59-9532-46d1-a0c0-e167330cbb17 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.899092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:19.899783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:19.902255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.908476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:19.909410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:19.910273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:19.972887 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9154afa9-3beb-425e-bb0a-89ad546bfded req-aefefb59-9532-46d1-a0c0-e167330cbb17 service nova] Creating event network-vif-deleted:52fe1de7-a4e2-46a0-8735-175040987808 for instance 59cb0435-5222-4140-af24-8cea35c0daa6 on n-h2-858384-19 Nov 02 13:34:19.999417 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9154afa9-3beb-425e-bb0a-89ad546bfded req-aefefb59-9532-46d1-a0c0-e167330cbb17 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155239 Nov 02 13:34:20.001529 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2425/4532] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:20.168853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:20.179702 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3edfdb4-2067-4266-a35d-f1e6ab012114 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1262 microversion: 2.1 time: 0.311211 Nov 02 13:34:20.181238 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2108/4533] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:19 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1262 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:20.244762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:20.245843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:20.258055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:20.258740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:20.259322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:20.260141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:20.263697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:20.264264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:20.342998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-2a639ebf-6bb3-4e0b-8903-4fca645ee409 req-1c274365-6bdb-4b90-9e16-19957c84145f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7aca59d-2072-4dab-8cb3-332b43c8f0a1", "name": "network-vif-plugged", "status": "completed", "tag": "78bb2231-276f-45ee-aaea-b4a4ac2d6eaf"}, {"server_uuid": "92c46dd0-0333-41de-a41f-d089c257f1f3", "name": "network-vif-plugged", "status": "completed", "tag": "922690eb-3547-4f2b-9260-8570ae8d2cf5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:20.376848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2a639ebf-6bb3-4e0b-8903-4fca645ee409 req-1c274365-6bdb-4b90-9e16-19957c84145f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:20.380419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2a639ebf-6bb3-4e0b-8903-4fca645ee409 req-1c274365-6bdb-4b90-9e16-19957c84145f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:20.382061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2a639ebf-6bb3-4e0b-8903-4fca645ee409 req-1c274365-6bdb-4b90-9e16-19957c84145f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:20.410859 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-2a639ebf-6bb3-4e0b-8903-4fca645ee409 req-1c274365-6bdb-4b90-9e16-19957c84145f service nova] Creating event network-vif-plugged:78bb2231-276f-45ee-aaea-b4a4ac2d6eaf for instance b7aca59d-2072-4dab-8cb3-332b43c8f0a1 on n-h2-858384-19 Nov 02 13:34:20.419178 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-2a639ebf-6bb3-4e0b-8903-4fca645ee409 req-1c274365-6bdb-4b90-9e16-19957c84145f service nova] Creating event network-vif-plugged:922690eb-3547-4f2b-9260-8570ae8d2cf5 for instance 92c46dd0-0333-41de-a41f-d089c257f1f3 on n-h2-858384-19 Nov 02 13:34:20.431854 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-2a639ebf-6bb3-4e0b-8903-4fca645ee409 req-1c274365-6bdb-4b90-9e16-19957c84145f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099824 Nov 02 13:34:20.433240 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2109/4534] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:20.833089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:20.846583 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8a66d35-91c0-4ec3-95da-f01c1ea668e7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 0.609410 Nov 02 13:34:20.847229 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2426/4535] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:20 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:20.883452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:20.885770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:20.904393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:20.907978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:20.909314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:20.912628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:20.918885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:20.920958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:21.209909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:21.210543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:21.220535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:21.220535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:21.221056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:21.222384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:21.223563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:21.224375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:21.411378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:21.426467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fac457eb-de8c-46fe-95ca-5ddd535a63dd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1268 microversion: 2.1 time: 0.222982 Nov 02 13:34:21.428810 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2427/4536] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:21 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1268 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:21.632917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:21.661327 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-afd4d048-b71c-430c-ba3d-58c45ce2106b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 200 len: 1322 microversion: 2.1 time: 0.790080 Nov 02 13:34:21.662835 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2110/4537] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:20 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 1322 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:21.876559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:21.877337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:21.893454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:21.893953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:21.898682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:21.900080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:21.902666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:21.906493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:22.255845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:22.268593 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb9248be-1d67-435c-8856-fbde774d296e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 0.396386 Nov 02 13:34:22.269999 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2428/4538] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:21 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:22.461826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:22.462663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:22.497980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:22.500130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:22.500609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:22.504047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:22.504542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:22.504979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:22.697059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:22.698502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:22.729898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:22.730323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:22.730759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:22.740345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:22.743293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:22.743293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:22.754670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:22.791946 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63a8a265-82fe-456b-bc67-b6b9ea282011 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1268 microversion: 2.1 time: 0.345191 Nov 02 13:34:22.792555 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2111/4539] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:22 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1268 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:23.304110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:23.305307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:23.316653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:23.318667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:23.320743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:23.322724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:23.323318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:23.324792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:23.456641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:23.472983 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b8234cc-572a-4c21-9ce4-a65b548644c3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 200 len: 1322 microversion: 2.1 time: 0.784116 Nov 02 13:34:23.480245 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2429/4540] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:22 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 1322 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:23.821761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:23.822391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:23.842115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:23.842820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:23.844098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:23.847705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:23.848194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:23.855551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:24.159256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:24.172084 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20aac3dc-507f-49a8-afb2-e78e48d93889 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1310 microversion: 2.1 time: 0.356597 Nov 02 13:34:24.175912 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2430/4541] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:23 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1310 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:24.435745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:24.457767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-79f1d1e9-9e05-4c0a-9603-0d9285852fd2 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1328 microversion: 2.1 time: 1.166456 Nov 02 13:34:24.462281 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2112/4542] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:23 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1328 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:24.516472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:24.517747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:24.529372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:24.530219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:24.530932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:24.531914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:24.533411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:24.534072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:24.973726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:24.994588 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01f5b529-265d-4d76-9858-7c140590f148 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 200 len: 1510 microversion: 2.1 time: 0.484673 Nov 02 13:34:25.003579 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2431/4543] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:24 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 1510 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:25.025034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:25.026077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:25.032948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.033684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.034305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.035430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.036041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.036898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.070164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:34:25.077353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:25.199175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:25.200038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:25.212922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.214543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.217559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.220775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.225373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.227440 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dfad942a-5c36-4fc0-becf-9c4f83b21a6f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "DELETE /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 204 len: 0 microversion: 2.1 time: 0.188758 Nov 02 13:34:25.227583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.232507 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2113/4544] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:34:25 2022] DELETE /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:34:25.251565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:25.255975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:25.299271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.300176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.301330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.302456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.303775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.304370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.346350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:34:25.514725 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-933fe562-3a11-4f83-8f11-8c47e43c32e3 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "DELETE /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 204 len: 0 microversion: 2.1 time: 0.278883 Nov 02 13:34:25.515698 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2114/4545] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:34:25 2022] DELETE /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:34:25.560008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:25.561128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:25.593896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.599333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.602474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.603673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.604745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.605214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.755936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:25.769304 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae8e3dd4-aeaf-4ad5-9a27-cc1b49ee6358 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1310 microversion: 2.1 time: 0.574889 Nov 02 13:34:25.772912 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2432/4546] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:25 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1310 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:25.779581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:25.780931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:25.790205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.790883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.791522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.792536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:25.793322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:25.793953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:25.920658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:25.942336 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f30549cd-06f9-4169-a624-f9f401d0df75 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1523 microversion: 2.1 time: 0.424099 Nov 02 13:34:25.944084 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2115/4547] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:25 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:26.182644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e191abd6-ef27-4a8a-96f3-a5406b1c1f2e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-786316075", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e191abd6-ef27-4a8a-96f3-a5406b1c1f2e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Request method failure captured: Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 242 Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnG4Hzxr41b3jBb_17CYQXSMR9PrVirn2nbifsAaBc_pI_Rk4-ZZG4IpCMHUfbQa6Pjo3mSJIn1wJIkSlr92q3Y1OXcfQS7zZfNuwDSxPGRY-1GqZkqxFDCcVpqtOVO3OYnQ6WL0ctKmmqnEhJd8moGtfh2f6Ffr3UP5Cg2Cxt2U7hY Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 075abc4f18b9481c90eef85eca4e8a81 Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-786316075", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-786316075', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '991b7f8e-606b-4172-a178-2571596c958a'}]}}} Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'': 'data1'} Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:26.191070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e191abd6-ef27-4a8a-96f3-a5406b1c1f2e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e191abd6-ef27-4a8a-96f3-a5406b1c1f2e tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.015610 Nov 02 13:34:26.195487 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2116/4548] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:26 2022] POST /compute/v2.1/servers => generated 175 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:34:26.217819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db5d40d8-deba-4e2a-a0e2-ed9f2b72b086 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:26.218392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-db5d40d8-deba-4e2a-a0e2-ed9f2b72b086 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: 2735932b-9f44-4ca4-96e7-ac54779802ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:26.240342 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-db5d40d8-deba-4e2a-a0e2-ed9f2b72b086 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] HTTP exception thrown: Instance 2735932b-9f44-4ca4-96e7-ac54779802ef could not be found. Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db5d40d8-deba-4e2a-a0e2-ed9f2b72b086 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Request method failure captured: Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/2735932b-9f44-4ca4-96e7-ac54779802ef/metadata HTTP/1.1 Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnG4Hzxr41b3jBb_17CYQXSMR9PrVirn2nbifsAaBc_pI_Rk4-ZZG4IpCMHUfbQa6Pjo3mSJIn1wJIkSlr92q3Y1OXcfQS7zZfNuwDSxPGRY-1GqZkqxFDCcVpqtOVO3OYnQ6WL0ctKmmqnEhJd8moGtfh2f6Ffr3UP5Cg2Cxt2U7hY Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 075abc4f18b9481c90eef85eca4e8a81 Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 2735932b-9f44-4ca4-96e7-ac54779802ef could not be found. Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': '2735932b-9f44-4ca4-96e7-ac54779802ef'} Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2735932b-9f44-4ca4-96e7-ac54779802ef could not be found. Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2735932b-9f44-4ca4-96e7-ac54779802ef could not be found. Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.251485 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.255869 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:34:26.255869 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:34:26.255869 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2735932b-9f44-4ca4-96e7-ac54779802ef could not be found. Nov 02 13:34:26.255869 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.261808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db5d40d8-deba-4e2a-a0e2-ed9f2b72b086 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Returning 404 to user: Instance 2735932b-9f44-4ca4-96e7-ac54779802ef could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:26.277612 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-db5d40d8-deba-4e2a-a0e2-ed9f2b72b086 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/2735932b-9f44-4ca4-96e7-ac54779802ef/metadata" status: 404 len: 111 microversion: 2.1 time: 0.060649 Nov 02 13:34:26.278444 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2117/4549] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:34:26 2022] GET /compute/v2.1/servers/2735932b-9f44-4ca4-96e7-ac54779802ef/metadata => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:34:26.491227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:26.509708 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c2e0c93-e86a-4049-b33c-8a5e8c76c62b tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 200 len: 1516 microversion: 2.1 time: 0.735362 Nov 02 13:34:26.520434 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2433/4550] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:25 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 1516 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:26.531159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6564fee-a945-4deb-a6b0-9c951e35d87b tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1003786325", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6564fee-a945-4deb-a6b0-9c951e35d87b tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Request method failure captured: Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 499 Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnG4Hzxr41b3jBb_17CYQXSMR9PrVirn2nbifsAaBc_pI_Rk4-ZZG4IpCMHUfbQa6Pjo3mSJIn1wJIkSlr92q3Y1OXcfQS7zZfNuwDSxPGRY-1GqZkqxFDCcVpqtOVO3OYnQ6WL0ctKmmqnEhJd8moGtfh2f6Ffr3UP5Cg2Cxt2U7hY Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 075abc4f18b9481c90eef85eca4e8a81 Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1003786325", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1003786325', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '991b7f8e-606b-4172-a178-2571596c958a'}]}}} Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:34:26.543661 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6564fee-a945-4deb-a6b0-9c951e35d87b tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:26.546587 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c6564fee-a945-4deb-a6b0-9c951e35d87b tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.023389 Nov 02 13:34:26.555709 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2434/4551] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:26 2022] POST /compute/v2.1/servers => generated 687 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:34:26.634465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19a22055-33cc-48e1-a2a5-6a867217632f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2120432379", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19a22055-33cc-48e1-a2a5-6a867217632f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Request method failure captured: Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 500 Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnG4Hzxr41b3jBb_17CYQXSMR9PrVirn2nbifsAaBc_pI_Rk4-ZZG4IpCMHUfbQa6Pjo3mSJIn1wJIkSlr92q3Y1OXcfQS7zZfNuwDSxPGRY-1GqZkqxFDCcVpqtOVO3OYnQ6WL0ctKmmqnEhJd8moGtfh2f6Ffr3UP5Cg2Cxt2U7hY Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 075abc4f18b9481c90eef85eca4e8a81 Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2120432379", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2120432379', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '991b7f8e-606b-4172-a178-2571596c958a'}]}}} Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:34:26.641301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.644936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19a22055-33cc-48e1-a2a5-6a867217632f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:26.647391 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19a22055-33cc-48e1-a2a5-6a867217632f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.013520 Nov 02 13:34:26.660724 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2435/4552] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:26 2022] POST /compute/v2.1/servers => generated 689 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:34:26.744842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d21243c9-1563-4826-a141-36c1ebea1f1c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2017308744", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:26.753552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c4dd3ea9-e703-450c-9d45-5a1935a565b2 req-cbae8b01-720a-47d9-ae99-a2c71824ae40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd242457-066d-4e86-abf9-57bf36514bcd", "tag": "639d7e7f-258a-4287-b436-3767a87f3bc6"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d21243c9-1563-4826-a141-36c1ebea1f1c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Request method failure captured: Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 754 Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnG4Hzxr41b3jBb_17CYQXSMR9PrVirn2nbifsAaBc_pI_Rk4-ZZG4IpCMHUfbQa6Pjo3mSJIn1wJIkSlr92q3Y1OXcfQS7zZfNuwDSxPGRY-1GqZkqxFDCcVpqtOVO3OYnQ6WL0ctKmmqnEhJd8moGtfh2f6Ffr3UP5Cg2Cxt2U7hY Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 075abc4f18b9481c90eef85eca4e8a81 Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2017308744", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2017308744', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '991b7f8e-606b-4172-a178-2571596c958a'}]}}} Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:34:26.754446 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:34:26.757653 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:34:26.760325 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.760325 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.762074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d21243c9-1563-4826-a141-36c1ebea1f1c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:26.764580 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d21243c9-1563-4826-a141-36c1ebea1f1c tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024634 Nov 02 13:34:26.766376 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2436/4553] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:26 2022] POST /compute/v2.1/servers => generated 1197 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 13:34:26.787701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c4dd3ea9-e703-450c-9d45-5a1935a565b2 req-cbae8b01-720a-47d9-ae99-a2c71824ae40 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:26.788367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c4dd3ea9-e703-450c-9d45-5a1935a565b2 req-cbae8b01-720a-47d9-ae99-a2c71824ae40 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:26.789054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c4dd3ea9-e703-450c-9d45-5a1935a565b2 req-cbae8b01-720a-47d9-ae99-a2c71824ae40 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:26.798599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:26.799736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:26.817217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:26.818689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:26.819600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:26.820526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:26.823771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:26.824456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:26.842587 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c4dd3ea9-e703-450c-9d45-5a1935a565b2 req-cbae8b01-720a-47d9-ae99-a2c71824ae40 service nova] Creating event network-changed:639d7e7f-258a-4287-b436-3767a87f3bc6 for instance dd242457-066d-4e86-abf9-57bf36514bcd on n-h1-858384-19 Nov 02 13:34:26.865220 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c4dd3ea9-e703-450c-9d45-5a1935a565b2 req-cbae8b01-720a-47d9-ae99-a2c71824ae40 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.497587 Nov 02 13:34:26.867866 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2118/4554] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:34:26.886185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fc99cfb6-0715-4a69-855c-445379c5421a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-519243965", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fc99cfb6-0715-4a69-855c-445379c5421a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Request method failure captured: Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 1265 Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnG4Hzxr41b3jBb_17CYQXSMR9PrVirn2nbifsAaBc_pI_Rk4-ZZG4IpCMHUfbQa6Pjo3mSJIn1wJIkSlr92q3Y1OXcfQS7zZfNuwDSxPGRY-1GqZkqxFDCcVpqtOVO3OYnQ6WL0ctKmmqnEhJd8moGtfh2f6Ffr3UP5Cg2Cxt2U7hY Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 075abc4f18b9481c90eef85eca4e8a81 Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-519243965", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "991b7f8e-606b-4172-a178-2571596c958a"}]}} Nov 02 13:34:26.901881 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-519243965', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '991b7f8e-606b-4172-a178-2571596c958a'}]}}} Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.904808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:34:26.905946 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:34:26.909885 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 02 13:34:26.909885 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.909885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fc99cfb6-0715-4a69-855c-445379c5421a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:26.911310 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fc99cfb6-0715-4a69-855c-445379c5421a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.042297 Nov 02 13:34:26.916680 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2119/4555] 10.222.0.113 () {60 vars in 1153 bytes} [Wed Nov 2 13:34:26 2022] POST /compute/v2.1/servers => generated 2221 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 02 13:34:26.928714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f4ec6fe-72ef-47bb-9835-9721ca05dd3a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:26.932094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1f4ec6fe-72ef-47bb-9835-9721ca05dd3a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: 02401cf9-cc50-4469-ae4c-11da422a21c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:26.950270 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-1f4ec6fe-72ef-47bb-9835-9721ca05dd3a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] HTTP exception thrown: Instance 02401cf9-cc50-4469-ae4c-11da422a21c2 could not be found. Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f4ec6fe-72ef-47bb-9835-9721ca05dd3a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Request method failure captured: Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/02401cf9-cc50-4469-ae4c-11da422a21c2/metadata/test2 HTTP/1.1 Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnG4Hzxr41b3jBb_17CYQXSMR9PrVirn2nbifsAaBc_pI_Rk4-ZZG4IpCMHUfbQa6Pjo3mSJIn1wJIkSlr92q3Y1OXcfQS7zZfNuwDSxPGRY-1GqZkqxFDCcVpqtOVO3OYnQ6WL0ctKmmqnEhJd8moGtfh2f6Ffr3UP5Cg2Cxt2U7hY Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 075abc4f18b9481c90eef85eca4e8a81 Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 02401cf9-cc50-4469-ae4c-11da422a21c2 could not be found. Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': '02401cf9-cc50-4469-ae4c-11da422a21c2', 'id': 'test2'} Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02401cf9-cc50-4469-ae4c-11da422a21c2 could not be found. Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02401cf9-cc50-4469-ae4c-11da422a21c2 could not be found. Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:26.953750 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:26.961436 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:34:26.961436 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:34:26.961436 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02401cf9-cc50-4469-ae4c-11da422a21c2 could not be found. Nov 02 13:34:26.961436 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:26.961436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f4ec6fe-72ef-47bb-9835-9721ca05dd3a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Returning 404 to user: Instance 02401cf9-cc50-4469-ae4c-11da422a21c2 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:26.961436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1f4ec6fe-72ef-47bb-9835-9721ca05dd3a tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/02401cf9-cc50-4469-ae4c-11da422a21c2/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.039083 Nov 02 13:34:26.964112 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2120/4556] 10.222.0.113 () {58 vars in 1286 bytes} [Wed Nov 2 13:34:26 2022] GET /compute/v2.1/servers/02401cf9-cc50-4469-ae4c-11da422a21c2/metadata/test2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:34:27.001163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:27.001679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:27.034249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:27.035214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:27.035826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:27.042355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:27.043076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:27.043707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:27.130577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:34:27.386021 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8a280d87-d594-4fb3-a8d4-d894682d858f tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "DELETE /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 204 len: 0 microversion: 2.1 time: 0.390061 Nov 02 13:34:27.397445 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2121/4557] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:34:26 2022] DELETE /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:34:27.488053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:27.541826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1182498537", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:27.598233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:27.671000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] validate_networks() for [('dbdb2ec4-00fc-4cf0-b85a-b4db9563a6b5', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:34:27.936692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:27.954279 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47ea7bbe-f5e2-4bdc-8601-80b2eb4b2a78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1310 microversion: 2.1 time: 1.160268 Nov 02 13:34:27.955012 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2437/4558] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:26 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1310 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:27.977094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:27.977701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:28.008548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:28.009060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:28.009507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:28.010358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:28.010818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:28.011279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:28.584433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:28.602965 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8fa7d1e1-aac1-491d-9e84-bb63f5c34b57 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1529 microversion: 2.1 time: 0.646565 Nov 02 13:34:28.637687 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2438/4559] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:27 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1529 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:28.653657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:28.654583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:28.666456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:28.671900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:28.672705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:28.676162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:28.676906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:28.677542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:28.699621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:34:28.700653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:34:28.701274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:34:28.701833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:34:28.702400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:34:28.715369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:28.716077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:28.716699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:28.717698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:28.718303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:28.719187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:28.730189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:28.744481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Getting quotas for project 9758bd03bdc949d495c293221823196c. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:28.762130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Getting quotas for user 9485351c342740638c6a30b05cd0b162 and project 9758bd03bdc949d495c293221823196c. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:28.769118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:28.786846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:34:28.793367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:34:28.883326 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f541e848-c1f2-4330-847e-0541377d88f7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.480203 Nov 02 13:34:28.895670 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2122/4560] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:27 2022] POST /compute/v2.1/servers => generated 385 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:34:28.902419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-34d9fc25-c330-4da1-aec0-cf0ece8cc4e1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:28.904018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-34d9fc25-c330-4da1-aec0-cf0ece8cc4e1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:28.945454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:28.954278 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06d5f049-f011-4554-affd-4b983b51d0ec tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 200 len: 1516 microversion: 2.1 time: 0.313420 Nov 02 13:34:28.955197 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2439/4561] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:28 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 1516 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:28.981599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:28.983442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:28.990675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:28.991663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:28.992289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:28.993285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:28.994194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:28.994789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:29.040417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-34d9fc25-c330-4da1-aec0-cf0ece8cc4e1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:29.048816 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-34d9fc25-c330-4da1-aec0-cf0ece8cc4e1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1226 microversion: 2.1 time: 0.151762 Nov 02 13:34:29.049436 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2123/4562] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:28 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:29.230141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1616359533", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:29.295204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:29.307572 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17ecc8ad-e90b-4c20-8fea-92a7f1198cdb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1310 microversion: 2.1 time: 0.327823 Nov 02 13:34:29.308648 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2440/4563] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:28 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1310 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:29.346779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] validate_networks() for [('dbdb2ec4-00fc-4cf0-b85a-b4db9563a6b5', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:34:29.635548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:29.636419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:29.650468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:29.656218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:29.657973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:29.661005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:29.661824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:29.663596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:30.422098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:30.436591 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f56ff4e-48ad-4e7d-9fdd-1f3341f57e21 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1529 microversion: 2.1 time: 0.805026 Nov 02 13:34:30.443986 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2441/4564] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:29 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1529 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:30.471800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:30.474725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:30.494288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:30.505098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:30.506971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:30.510998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:30.512512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:30.513457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:30.514860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:30.534511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:31.222801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:31.240164 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc10229c-0965-46cd-967e-a91c49010fdb tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 200 len: 1516 microversion: 2.1 time: 0.794562 Nov 02 13:34:31.243413 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2442/4565] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:30 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 1516 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:31.249275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:31.249980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:31.305274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:31.308109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:31.308779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:31.309748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:31.316461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:31.317931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:32.180950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:32.194188 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c562ab64-9ea0-4df3-9e2b-ded581389647 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1310 microversion: 2.1 time: 0.949178 Nov 02 13:34:32.196892 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2443/4566] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:31 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1310 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:32.217885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:32.237458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:32.249151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:32.251460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:32.252351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:32.254539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:32.257228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:32.258515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:32.589573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:32.634854 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d21cac77-1beb-48e7-a6e1-eeb0812802ba tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1487 microversion: 2.1 time: 0.436154 Nov 02 13:34:32.642956 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2444/4567] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:32 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1487 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:32.663429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:32.671936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:32.707249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:32.713220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:32.721108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:32.722375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:32.723021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:32.726642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:33.322753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:34:33.323343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:34:33.323601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:34:33.324015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:34:33.324439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:34:33.339936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:33.340772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:33.341409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:33.342328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:33.342947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:33.343599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:33.382535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Getting quotas for project 9758bd03bdc949d495c293221823196c. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:33.392537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Getting quotas for user 9485351c342740638c6a30b05cd0b162 and project 9758bd03bdc949d495c293221823196c. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:33.419375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:34:33.421833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:34:33.543189 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b657bbbd-3688-409d-bfe6-59ffa6292a64 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.317879 Nov 02 13:34:33.543879 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2124/4568] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:29 2022] POST /compute/v2.1/servers => generated 385 bytes in 4320 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:34:33.559682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-06e6beb4-bbf5-4f90-96bc-d3638cc1fe75 req-fa3fba63-8a06-4ae7-b358-52c0169771b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf1cc5-0a81-4a08-8b68-0a8d1936cc94", "name": "network-vif-deleted", "tag": "dfaf6502-9a77-44ab-b2bf-a8ad89a10bb1"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:33.594225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-06e6beb4-bbf5-4f90-96bc-d3638cc1fe75 req-fa3fba63-8a06-4ae7-b358-52c0169771b9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:33.596263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-06e6beb4-bbf5-4f90-96bc-d3638cc1fe75 req-fa3fba63-8a06-4ae7-b358-52c0169771b9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:33.596981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-06e6beb4-bbf5-4f90-96bc-d3638cc1fe75 req-fa3fba63-8a06-4ae7-b358-52c0169771b9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:33.652706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:33.662803 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-06e6beb4-bbf5-4f90-96bc-d3638cc1fe75 req-fa3fba63-8a06-4ae7-b358-52c0169771b9 service nova] Creating event network-vif-deleted:dfaf6502-9a77-44ab-b2bf-a8ad89a10bb1 for instance 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 on n-h2-858384-19 Nov 02 13:34:33.665503 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c50a80b0-fc2c-419f-9ead-700c91fd843f tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 200 len: 1516 microversion: 2.1 time: 1.016665 Nov 02 13:34:33.667477 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2445/4569] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:32 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 1516 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:33.669627 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-06e6beb4-bbf5-4f90-96bc-d3638cc1fe75 req-fa3fba63-8a06-4ae7-b358-52c0169771b9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124135 Nov 02 13:34:33.670631 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2125/4570] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:33.696475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:33.697315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:33.702043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a61d010d-0216-4f4d-824b-d97f0ce22da4 req-46952e44-0df5-474e-9aa6-c698264d2f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7aca59d-2072-4dab-8cb3-332b43c8f0a1", "name": "network-vif-deleted", "tag": "78bb2231-276f-45ee-aaea-b4a4ac2d6eaf"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:33.714804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:33.716768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:33.717633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:33.724834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:33.725636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:33.726844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:33.745364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a61d010d-0216-4f4d-824b-d97f0ce22da4 req-46952e44-0df5-474e-9aa6-c698264d2f28 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:33.747527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a61d010d-0216-4f4d-824b-d97f0ce22da4 req-46952e44-0df5-474e-9aa6-c698264d2f28 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:33.748780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a61d010d-0216-4f4d-824b-d97f0ce22da4 req-46952e44-0df5-474e-9aa6-c698264d2f28 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:33.781374 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a61d010d-0216-4f4d-824b-d97f0ce22da4 req-46952e44-0df5-474e-9aa6-c698264d2f28 service nova] Creating event network-vif-deleted:78bb2231-276f-45ee-aaea-b4a4ac2d6eaf for instance b7aca59d-2072-4dab-8cb3-332b43c8f0a1 on n-h2-858384-19 Nov 02 13:34:33.798707 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a61d010d-0216-4f4d-824b-d97f0ce22da4 req-46952e44-0df5-474e-9aa6-c698264d2f28 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098313 Nov 02 13:34:33.800937 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2126/4571] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:33.817997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8dccb1a4-ebb8-4a59-80d4-5fe8f7c4ad31 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:33.819526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8dccb1a4-ebb8-4a59-80d4-5fe8f7c4ad31 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:34.154851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8dccb1a4-ebb8-4a59-80d4-5fe8f7c4ad31 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:34.164379 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8dccb1a4-ebb8-4a59-80d4-5fe8f7c4ad31 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1226 microversion: 2.1 time: 0.360021 Nov 02 13:34:34.168191 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2127/4572] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:33 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1226 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:34.202123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:34.203051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:34.229475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:34.229983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:34.230603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:34.231186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:34.231655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:34.232100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:34.354751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:34.389020 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7af0db4f-c1f5-4566-95da-66ee67d2e8bb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1310 microversion: 2.1 time: 0.715989 Nov 02 13:34:34.397601 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2446/4573] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:33 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1310 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:34.406453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:34.413572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:34.416589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:34.418792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lazy-loading 'fault' on Instance uuid b7aca59d-2072-4dab-8cb3-332b43c8f0a1 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:34:34.698206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:34.700101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:34.714844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:34.718178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:34.718828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:34.732640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:34.742999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '075abc4f18b9481c90eef85eca4e8a81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b65cdb24e2274372bd18044e6aa375bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:34.760348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:34.761800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:34.771800 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4dd6ce5c-bb67-47bb-b4a0-709b106b0ea0 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 200 len: 1318 microversion: 2.1 time: 0.592609 Nov 02 13:34:34.794208 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2128/4574] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:34 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:35.196577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:35.197288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:35.216971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.219937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.221544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.225960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.228766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.232539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.451576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e973866c9b404719b4223679d7795f4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cee3ec1369f453c9fcbc8cb46b8b7f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:35.465680 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6efd4c00-1654-410a-97e0-99a7c00831da tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 200 len: 1307 microversion: 2.1 time: 0.774569 Nov 02 13:34:35.465919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:35.471459 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2447/4575] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:34 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 1307 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:35.487583 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a2fef7ce-2e18-41e0-a2af-da81317a6f90 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1230 microversion: 2.1 time: 0.283242 Nov 02 13:34:35.487816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:35.487816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:35.492893 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2129/4576] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:35 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1230 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:35.504673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.505303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.506096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.507193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.512362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.512836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.529377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-33e937fa-28ed-4ef4-846c-cdf13ac96544 req-c43fce65-3c99-47be-b188-19a6ba03a38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd242457-066d-4e86-abf9-57bf36514bcd", "name": "network-vif-plugged", "status": "completed", "tag": "639d7e7f-258a-4287-b436-3767a87f3bc6"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:35.559960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-33e937fa-28ed-4ef4-846c-cdf13ac96544 req-c43fce65-3c99-47be-b188-19a6ba03a38a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.560725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-33e937fa-28ed-4ef4-846c-cdf13ac96544 req-c43fce65-3c99-47be-b188-19a6ba03a38a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.567289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-33e937fa-28ed-4ef4-846c-cdf13ac96544 req-c43fce65-3c99-47be-b188-19a6ba03a38a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.607754 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-33e937fa-28ed-4ef4-846c-cdf13ac96544 req-c43fce65-3c99-47be-b188-19a6ba03a38a service nova] Creating event network-vif-plugged:639d7e7f-258a-4287-b436-3767a87f3bc6 for instance dd242457-066d-4e86-abf9-57bf36514bcd on n-h1-858384-19 Nov 02 13:34:35.625124 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-33e937fa-28ed-4ef4-846c-cdf13ac96544 req-c43fce65-3c99-47be-b188-19a6ba03a38a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096618 Nov 02 13:34:35.626818 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2130/4577] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:34:35.784381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:35.796564 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-28655d79-e284-44be-9440-c219afbf5380 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1310 microversion: 2.1 time: 0.323991 Nov 02 13:34:35.797436 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2448/4578] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:35 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1310 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:35.820776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:35.821880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] [instance: b7aca59d-2072-4dab-8cb3-332b43c8f0a1] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:35.830576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d11a209f-1fa3-4e75-a723-28b5b5f81e32 req-0f5650a8-78a4-4c18-9489-8e2098e2d955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c46dd0-0333-41de-a41f-d089c257f1f3", "name": "network-vif-deleted", "tag": "922690eb-3547-4f2b-9260-8570ae8d2cf5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:35.833210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.834287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.834929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.835933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.836536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.837232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.857995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d11a209f-1fa3-4e75-a723-28b5b5f81e32 req-0f5650a8-78a4-4c18-9489-8e2098e2d955 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:35.858662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d11a209f-1fa3-4e75-a723-28b5b5f81e32 req-0f5650a8-78a4-4c18-9489-8e2098e2d955 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:35.858981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d11a209f-1fa3-4e75-a723-28b5b5f81e32 req-0f5650a8-78a4-4c18-9489-8e2098e2d955 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:35.864968 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] HTTP exception thrown: Instance b7aca59d-2072-4dab-8cb3-332b43c8f0a1 could not be found. Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Request method failure captured: Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 HTTP/1.1 Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnG4Hzxr41b3jBb_17CYQXSMR9PrVirn2nbifsAaBc_pI_Rk4-ZZG4IpCMHUfbQa6Pjo3mSJIn1wJIkSlr92q3Y1OXcfQS7zZfNuwDSxPGRY-1GqZkqxFDCcVpqtOVO3OYnQ6WL0ctKmmqnEhJd8moGtfh2f6Ffr3UP5Cg2Cxt2U7hY Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b65cdb24e2274372bd18044e6aa375bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b65cdb24e2274372bd18044e6aa375bd Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-100742036 Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 075abc4f18b9481c90eef85eca4e8a81 Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-100742036-project Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance b7aca59d-2072-4dab-8cb3-332b43c8f0a1 could not be found. Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'b7aca59d-2072-4dab-8cb3-332b43c8f0a1'} Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7aca59d-2072-4dab-8cb3-332b43c8f0a1 could not be found. Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7aca59d-2072-4dab-8cb3-332b43c8f0a1 could not be found. Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:35.867705 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:35.874234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:35.874234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:35.874234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:35.874234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:35.874234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:34:35.874234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:34:35.874234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7aca59d-2072-4dab-8cb3-332b43c8f0a1 could not be found. Nov 02 13:34:35.874234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:35.874234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] Returning 404 to user: Instance b7aca59d-2072-4dab-8cb3-332b43c8f0a1 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:35.877073 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf8c348f-2d2c-4827-94ad-656ce07515b7 tempest-ServerMetadataNegativeTestJSON-100742036 tempest-ServerMetadataNegativeTestJSON-100742036-project] 10.222.0.113 "GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1" status: 404 len: 111 microversion: 2.1 time: 0.080590 Nov 02 13:34:35.881880 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2131/4579] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:35 2022] GET /compute/v2.1/servers/b7aca59d-2072-4dab-8cb3-332b43c8f0a1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:34:35.908972 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d11a209f-1fa3-4e75-a723-28b5b5f81e32 req-0f5650a8-78a4-4c18-9489-8e2098e2d955 service nova] Creating event network-vif-deleted:922690eb-3547-4f2b-9260-8570ae8d2cf5 for instance 92c46dd0-0333-41de-a41f-d089c257f1f3 on n-h2-858384-19 Nov 02 13:34:35.930971 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d11a209f-1fa3-4e75-a723-28b5b5f81e32 req-0f5650a8-78a4-4c18-9489-8e2098e2d955 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104999 Nov 02 13:34:35.931685 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2449/4580] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:36.494313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:36.494931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 92c46dd0-0333-41de-a41f-d089c257f1f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:36.517255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.517659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:36.517781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.518195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:36.518582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:36.521147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.521644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.522150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:36.538008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.538718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.539378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:36.541144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.545270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.545821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:36.593461 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] HTTP exception thrown: Instance 92c46dd0-0333-41de-a41f-d089c257f1f3 could not be found. Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Request method failure captured: Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 HTTP/1.1 Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnGTpWWd1UDIrQZK11JuIgm9A2fR8iLpRKJ9hDIrOAc5UQhZZZ2r0Y5WDDPZX74HUhzzx_eyLRa4H2SlDJzPnXlFT0_BpTA0Y3YAnNf5pRsi1TrqLybeAm9k1LZK2nRM8N0AjEDJotcxzKrzUeeljtC94nHdHM2GgKKmcKrcsVmadzs Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5cee3ec1369f453c9fcbc8cb46b8b7f3 Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-MultipleCreateTestJSON-1721241600 Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5cee3ec1369f453c9fcbc8cb46b8b7f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5cee3ec1369f453c9fcbc8cb46b8b7f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5cee3ec1369f453c9fcbc8cb46b8b7f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5cee3ec1369f453c9fcbc8cb46b8b7f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-MultipleCreateTestJSON-1721241600 Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5cee3ec1369f453c9fcbc8cb46b8b7f3 Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1721241600 Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-MultipleCreateTestJSON-1721241600-project Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e973866c9b404719b4223679d7795f4d Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-MultipleCreateTestJSON-1721241600-project Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 92c46dd0-0333-41de-a41f-d089c257f1f3 could not be found. Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '92c46dd0-0333-41de-a41f-d089c257f1f3'} Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c46dd0-0333-41de-a41f-d089c257f1f3 could not be found. Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c46dd0-0333-41de-a41f-d089c257f1f3 could not be found. Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:36.595277 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.599077 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:36.599077 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:36.599077 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:36.599077 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:34:36.599077 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:34:36.599077 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c46dd0-0333-41de-a41f-d089c257f1f3 could not be found. Nov 02 13:34:36.599077 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.603914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Returning 404 to user: Instance 92c46dd0-0333-41de-a41f-d089c257f1f3 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:36.605115 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51600fec-b88a-461c-a1f3-2e6fac79ee95 tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3" status: 404 len: 111 microversion: 2.1 time: 0.115121 Nov 02 13:34:36.606216 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2132/4581] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:36 2022] GET /compute/v2.1/servers/92c46dd0-0333-41de-a41f-d089c257f1f3 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:34:36.624242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:36.627808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] [instance: 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:36.642060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.642932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.643610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:36.644568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.645241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.645887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:36.670668 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] HTTP exception thrown: Instance 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 could not be found. Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Request method failure captured: Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 HTTP/1.1 Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnGTpWWd1UDIrQZK11JuIgm9A2fR8iLpRKJ9hDIrOAc5UQhZZZ2r0Y5WDDPZX74HUhzzx_eyLRa4H2SlDJzPnXlFT0_BpTA0Y3YAnNf5pRsi1TrqLybeAm9k1LZK2nRM8N0AjEDJotcxzKrzUeeljtC94nHdHM2GgKKmcKrcsVmadzs Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5cee3ec1369f453c9fcbc8cb46b8b7f3 Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-MultipleCreateTestJSON-1721241600 Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5cee3ec1369f453c9fcbc8cb46b8b7f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5cee3ec1369f453c9fcbc8cb46b8b7f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5cee3ec1369f453c9fcbc8cb46b8b7f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5cee3ec1369f453c9fcbc8cb46b8b7f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-MultipleCreateTestJSON-1721241600 Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5cee3ec1369f453c9fcbc8cb46b8b7f3 Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1721241600 Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-MultipleCreateTestJSON-1721241600-project Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e973866c9b404719b4223679d7795f4d Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-MultipleCreateTestJSON-1721241600-project Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 could not be found. Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '04cf1cc5-0a81-4a08-8b68-0a8d1936cc94'} Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 could not be found. Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 could not be found. Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:36.673290 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.677177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:36.677177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:36.677177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:36.677177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:34:36.677177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:34:36.677177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 could not be found. Nov 02 13:34:36.677177 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:36.686801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] Returning 404 to user: Instance 04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:36.688661 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7c4703a3-18bd-44d6-a684-8352ce41422e tempest-MultipleCreateTestJSON-1721241600 tempest-MultipleCreateTestJSON-1721241600-project] 10.222.0.113 "GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94" status: 404 len: 111 microversion: 2.1 time: 0.077286 Nov 02 13:34:36.696644 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2133/4582] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:36 2022] GET /compute/v2.1/servers/04cf1cc5-0a81-4a08-8b68-0a8d1936cc94 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:34:36.825941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:36.826568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:36.840028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.840534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.840983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:36.841713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:36.847959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:36.848474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:37.224221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:37.243519 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0f4ef630-d160-469d-9a84-9c50581762ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1286 microversion: 2.1 time: 0.730855 Nov 02 13:34:37.255684 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2450/4583] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:36 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1286 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:37.336340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:37.346251 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8dee9d7d-62b9-4c17-9e90-2b8e2718de54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1310 microversion: 2.1 time: 0.525568 Nov 02 13:34:37.350602 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2134/4584] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:36 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1310 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:38.269028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:38.270348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:38.284511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:38.285361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:38.286054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:38.287003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:38.287821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:38.288448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:38.382436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:38.383249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:38.393797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:38.394247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:38.394642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:38.396043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:38.396733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:38.397316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:38.614451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:38.637508 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88200994-0126-4143-805a-a33218780ce2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1284 microversion: 2.1 time: 0.372431 Nov 02 13:34:38.648753 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2451/4585] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:38 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1284 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:38.924516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:38.937163 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f551dd9e-191f-4067-82d7-c8a50a190f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1490 microversion: 2.1 time: 0.561099 Nov 02 13:34:38.940085 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2135/4586] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:38 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1490 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:38.966161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-182a10c4-fe8b-4770-90ad-695e6411aea8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:38.978724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-182a10c4-fe8b-4770-90ad-695e6411aea8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:38.979638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-182a10c4-fe8b-4770-90ad-695e6411aea8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:38.980786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-182a10c4-fe8b-4770-90ad-695e6411aea8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:39.012460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-182a10c4-fe8b-4770-90ad-695e6411aea8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Going to try to stop instance {{(pid=120928) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:34:39.089157 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-182a10c4-fe8b-4770-90ad-695e6411aea8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd/action" status: 202 len: 0 microversion: 2.1 time: 0.127425 Nov 02 13:34:39.091154 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2452/4587] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:34:38 2022] POST /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:34:39.114690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0ec32520-60e1-446b-bb9f-bbe234589b52 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'create', calling method: .version_select at 0x7fe787cc0ca0>, body: {"keypair": {"name": "tempest-keypair-41107667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBB92lAo37ME9BdL7TKnxm0LQo+OLzIdReqgMpJ339kIvNJB+XtvR0VjVfiBQTNJE2/RJa/Tyu9TnB9rsZJoMCnOqcfz8cl3yT6RBcIo+awV3CynctEYbbsWEqy/07n/AA=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:39.127081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:39.128926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:39.143440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0ec32520-60e1-446b-bb9f-bbe234589b52 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Getting quotas for project caaf4dc4c8fb46e6b6497a9f289825bf. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:39.149897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:39.150400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:39.150855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:39.153804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:39.154484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0ec32520-60e1-446b-bb9f-bbe234589b52 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Getting quotas for user 0d4a470b46934c96845dd659f4752b3b and project caaf4dc4c8fb46e6b6497a9f289825bf. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:39.156474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:39.158697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:39.186558 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0ec32520-60e1-446b-bb9f-bbe234589b52 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.214889 Nov 02 13:34:39.195344 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2136/4588] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:34:38 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:39.670602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:39.671320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:39.687781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:39.693293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:39.695148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:39.695148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:39.695148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:39.695523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:39.992978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:40.027534 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-26168a28-74fc-4ad6-9caa-61da0c2cdcb2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.918309 Nov 02 13:34:40.030254 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2453/4589] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:39 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:40.104121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:40.127611 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c3e8dd1-a5f3-44c4-a02f-502480ba7eaa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1284 microversion: 2.1 time: 0.459593 Nov 02 13:34:40.130878 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2137/4590] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:39 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1284 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:41.054557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:41.055407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:41.077841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:41.079018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:41.084292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:41.087351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:41.095278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:41.099823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:41.158225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:41.170481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:41.207304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:41.211925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:41.212889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:41.213871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:41.215015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:41.218350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:41.239899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:41.829616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:41.845179 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f592ddc-2444-4245-b5fb-998014ea09cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.791081 Nov 02 13:34:41.866839 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2454/4591] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:41 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:41.872773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-04ac5d6a-b57f-4152-b765-fa35269245dd req-7e581e98-8564-43f2-b6f3-acc3dae434ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e23861-9b9f-4579-ba97-d9e3851ce40e", "tag": "a44cd156-66cc-4374-92ca-e88bd40334eb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:41.886592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-04ac5d6a-b57f-4152-b765-fa35269245dd req-7e581e98-8564-43f2-b6f3-acc3dae434ae service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:41.887511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-04ac5d6a-b57f-4152-b765-fa35269245dd req-7e581e98-8564-43f2-b6f3-acc3dae434ae service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:41.888275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-04ac5d6a-b57f-4152-b765-fa35269245dd req-7e581e98-8564-43f2-b6f3-acc3dae434ae service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:41.919320 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-04ac5d6a-b57f-4152-b765-fa35269245dd req-7e581e98-8564-43f2-b6f3-acc3dae434ae service nova] Creating event network-changed:a44cd156-66cc-4374-92ca-e88bd40334eb for instance 30e23861-9b9f-4579-ba97-d9e3851ce40e on n-h1-858384-19 Nov 02 13:34:41.930274 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-04ac5d6a-b57f-4152-b765-fa35269245dd req-7e581e98-8564-43f2-b6f3-acc3dae434ae service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057064 Nov 02 13:34:41.931571 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2455/4592] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:42.689710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:42.707046 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c327e4d8-2bbd-42c6-96fe-806a1fa7d4b3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 1.553340 Nov 02 13:34:42.766891 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2138/4593] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:41 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:42.876860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:42.877584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:42.894353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:42.897076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:42.898488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:42.900880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:42.901760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:42.903594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:43.587184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:43.602074 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4cde4fc0-1da9-4356-a94f-18732c986036 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.730655 Nov 02 13:34:43.606024 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2456/4594] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:42 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:43.746478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:43.747367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:43.756984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:43.816388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:43.816947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:43.817413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:43.818176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:43.818642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:43.822372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:44.639332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:44.641589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:44.659526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:44.661003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:44.662560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:44.664941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:44.666687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:44.669089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:44.736600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:44.752728 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b992174c-31ab-4af9-b75e-ef143100ea1f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 1.020049 Nov 02 13:34:44.767365 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2139/4595] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:43 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:45.228522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:45.251984 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-07aa34f0-3284-402f-8dd9-490162bd66cb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.617191 Nov 02 13:34:45.256546 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2457/4596] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:44 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:45.784386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:45.785568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:45.799451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:45.805542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:45.806226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:45.808163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:45.808843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:45.809503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:46.287647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:46.288544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:46.316838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:46.318963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:46.319465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:46.320456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:46.320757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:46.322049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:46.462319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:46.472001 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75fb2917-30d6-4723-a843-586bc3132f02 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 0.693779 Nov 02 13:34:46.479165 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2140/4597] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:45 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:47.148801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:47.159948 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b8dc0ad7-6184-449b-81bf-715fa9951e87 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.877669 Nov 02 13:34:47.163901 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2458/4598] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:46 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:47.210879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-362137443", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a9d0f9f-afcf-4d5e-a109-679a014b3254"}], "security_groups": [{"name": "tempest-securitygroup--1498888345"}], "key_name": "tempest-keypair-41107667", "user_data": "}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:47.442175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] validate_networks() for [('9a9d0f9f-afcf-4d5e-a109-679a014b3254', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:34:47.503946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:47.505529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:47.524809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:47.525608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:47.526375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:47.527346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:47.528035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:47.528689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:47.541487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:47.982282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:47.990658 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20e2cb05-505c-4e00-88de-7c527aad2a57 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 0.491625 Nov 02 13:34:47.997112 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2459/4599] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:47 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:48.029094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0a37ad45-e336-4de5-8398-8a0d5d7d2a7d req-71c032d1-6807-4046-9e92-3e9128b0b9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ed7862-b20d-457d-84d7-7259ba577d12", "tag": "cc79c635-dc0b-4a6c-a9ef-7d9430045f8d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:48.054914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0a37ad45-e336-4de5-8398-8a0d5d7d2a7d req-71c032d1-6807-4046-9e92-3e9128b0b9d2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:48.058668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0a37ad45-e336-4de5-8398-8a0d5d7d2a7d req-71c032d1-6807-4046-9e92-3e9128b0b9d2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:48.060071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0a37ad45-e336-4de5-8398-8a0d5d7d2a7d req-71c032d1-6807-4046-9e92-3e9128b0b9d2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:48.105713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0a37ad45-e336-4de5-8398-8a0d5d7d2a7d req-71c032d1-6807-4046-9e92-3e9128b0b9d2 service nova] Creating event network-changed:cc79c635-dc0b-4a6c-a9ef-7d9430045f8d for instance 66ed7862-b20d-457d-84d7-7259ba577d12 on n-h2-858384-19 Nov 02 13:34:48.117783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0a37ad45-e336-4de5-8398-8a0d5d7d2a7d req-71c032d1-6807-4046-9e92-3e9128b0b9d2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104110 Nov 02 13:34:48.118931 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2460/4600] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:48.197049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:48.202099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:48.229797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:48.231002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:48.232057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:48.239841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:48.246116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:48.247249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:48.799795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:48.819252 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f0b1f327-a07f-4c61-902b-5d1553a2151f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.631666 Nov 02 13:34:48.821048 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2461/4601] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:48 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:49.026512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:49.027152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:49.038168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:49.048102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:49.048880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:49.050176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:49.050819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:49.051474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:49.171139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=20 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:49.325356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:49.333979 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71512000-9121-45c6-83ce-19890dff7985 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 0.312655 Nov 02 13:34:49.335801 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2462/4602] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:49 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:49.846471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:49.847818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:49.857753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:49.863892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:49.864609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:49.865550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:49.867454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:49.869178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:50.397286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:50.415921 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0d925331-be41-46f0-b85b-af793fb1f464 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.573740 Nov 02 13:34:50.417123 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2463/4603] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:49 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:50.422312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-554e8061-5146-4858-8c33-79f682bdbb63 req-1c4558e8-1fd3-4b52-82bb-eaae2bb8e18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e23861-9b9f-4579-ba97-d9e3851ce40e", "name": "network-vif-plugged", "status": "completed", "tag": "a44cd156-66cc-4374-92ca-e88bd40334eb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:50.436918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-554e8061-5146-4858-8c33-79f682bdbb63 req-1c4558e8-1fd3-4b52-82bb-eaae2bb8e18e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:50.438256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-554e8061-5146-4858-8c33-79f682bdbb63 req-1c4558e8-1fd3-4b52-82bb-eaae2bb8e18e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:50.447681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-554e8061-5146-4858-8c33-79f682bdbb63 req-1c4558e8-1fd3-4b52-82bb-eaae2bb8e18e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:50.459762 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-554e8061-5146-4858-8c33-79f682bdbb63 req-1c4558e8-1fd3-4b52-82bb-eaae2bb8e18e service nova] Creating event network-vif-plugged:a44cd156-66cc-4374-92ca-e88bd40334eb for instance 30e23861-9b9f-4579-ba97-d9e3851ce40e on n-h1-858384-19 Nov 02 13:34:50.477086 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-554e8061-5146-4858-8c33-79f682bdbb63 req-1c4558e8-1fd3-4b52-82bb-eaae2bb8e18e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058633 Nov 02 13:34:50.477990 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2464/4604] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:50.484213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:50.485728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:50.496280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:50.507976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:50.511893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:50.512842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:50.513487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:50.515446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:50.599829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:34:50.602877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:34:50.603956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:34:50.605655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:34:50.608171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:34:50.652673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:50.653757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:50.654519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:50.669892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:50.672587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:50.675019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:50.727518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Getting quotas for project caaf4dc4c8fb46e6b6497a9f289825bf. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:34:50.751522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Getting quotas for user 0d4a470b46934c96845dd659f4752b3b and project caaf4dc4c8fb46e6b6497a9f289825bf. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:34:50.778845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:34:50.783033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:34:50.902717 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6fad4f2c-3b9a-49ec-a4b4-892ef6c1b569 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.700086 Nov 02 13:34:50.905297 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2141/4605] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:47 2022] POST /compute/v2.1/servers => generated 404 bytes in 3704 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:34:50.931686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d48b606a-3ac9-49dd-8430-4a1f72e1d73b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:50.934625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d48b606a-3ac9-49dd-8430-4a1f72e1d73b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:50.957504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:50.974407 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-58d5d5d1-8704-4272-a153-61c582c54d7c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 0.495027 Nov 02 13:34:50.982923 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2465/4606] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:50 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:51.108194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d48b606a-3ac9-49dd-8430-4a1f72e1d73b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:51.117887 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d48b606a-3ac9-49dd-8430-4a1f72e1d73b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1239 microversion: 2.1 time: 0.204120 Nov 02 13:34:51.143538 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2142/4607] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:50 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1239 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:51.443660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:51.444277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:51.460936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:51.461584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:51.461877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:51.462596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:51.463378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:51.463985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:51.722325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:51.729976 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af8c416a-f3d5-43b7-8e21-68470beb349c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.290267 Nov 02 13:34:51.730747 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2466/4608] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:51 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:52.002072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:52.003574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:52.019346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:52.021272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:52.023329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:52.024390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:52.025438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:52.026083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:52.149161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:52.151426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:52.161768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:52.162649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:52.163481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:52.164406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:52.165751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:52.166623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:52.340499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:52.358084 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-47a661c3-150f-4fff-9000-fe05b46e93b9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 0.360854 Nov 02 13:34:52.359099 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2143/4609] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:51 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:52.403862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:52.428815 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9af2555e-7be9-4e93-b476-b3eed364865a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1243 microversion: 2.1 time: 0.287665 Nov 02 13:34:52.449658 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2467/4610] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:52 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1243 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:52.758537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:52.759221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:52.775185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:52.775705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:52.776163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:52.776887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:52.789166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:52.789640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.390161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:53.392213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:53.419731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.423526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.424089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.424981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.429524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.431137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.726704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:53.755333 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a0d06e57-294c-4a04-9eb1-3205ea01ebee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 1.003816 Nov 02 13:34:53.761739 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2144/4611] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:52 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:53.786026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:53.786673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:53.821895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:34:53.825457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.825966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.826531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:53.847345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:53.847891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:53.848351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:54.149343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:54.161323 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b8da41f-8178-417f-929a-91700a6c5c05 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 0.776968 Nov 02 13:34:54.166430 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2468/4612] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:53 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:54.210955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:54.227603 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c393e0e-6c7e-4cdc-9c15-f8ae5c0433a1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1291 microversion: 2.1 time: 0.462268 Nov 02 13:34:54.254440 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2145/4613] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:53 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1291 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:54.786570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:54.787316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:54.806641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:54.811135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:54.822052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:54.834350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:54.835023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:54.835607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:55.186468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:55.187705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:55.222100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:55.222100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:55.231195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:55.232328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:55.232734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:55.233412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:55.380887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:55.397579 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-466c99f3-461a-4d61-83fd-1b42c45e0cc4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.616216 Nov 02 13:34:55.402761 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2469/4614] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:54 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:55.414490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:55.416600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:55.443715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:55.445032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:55.449097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:55.451468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:55.454022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:55.460353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:55.815545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:55.837220 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a59a47fc-4733-4220-8e42-2c2e0cfbc082 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1297 microversion: 2.1 time: 0.433067 Nov 02 13:34:55.855576 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2470/4615] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:55 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1297 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:55.870575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:55.881802 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-31b43288-39b6-412b-815f-9bf443b43170 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 0.699507 Nov 02 13:34:55.895998 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2146/4616] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:55 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:56.138797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-caf1e1e8-ab24-4383-aa16-a72981ae0308 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1431229166", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:56.149217 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-caf1e1e8-ab24-4383-aa16-a72981ae0308 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] HTTP exception thrown: min_count must be <= max_count Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-caf1e1e8-ab24-4383-aa16-a72981ae0308 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Request method failure captured: Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 184 Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnH_JO7hjk3ayDp3J2lRJyqRf6OZniQMK-zp9aHMajQzhSlvzofBn8WzePN-I78tB2jb24uA6CfcW3tzPXlhhPG5PwUa_Tnq1GcNdoOpM27GKy7Ji1zR7i84yoHrUujZZgChYl-KLDJqLJANFtmfMhtMGe81K7Gjmtl4wyqnITt-b6E Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 63267015f5054726a83e3caed23e641a Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1431229166", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 3, "max_count": 2}} Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: exception: min_count must be <= max_count Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1431229166', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Nov 02 13:34:56.157411 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.161708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-caf1e1e8-ab24-4383-aa16-a72981ae0308 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Returning 400 to user: min_count must be <= max_count {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:56.162667 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-caf1e1e8-ab24-4383-aa16-a72981ae0308 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.300621 Nov 02 13:34:56.163918 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2471/4617] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:55 2022] POST /compute/v2.1/servers => generated 74 bytes in 308 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:34:56.268865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab42c9aa-16c2-472c-ac36-6879d14ebdb1 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-332956977", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "max_count": 0}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab42c9aa-16c2-472c-ac36-6879d14ebdb1 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Request method failure captured: Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 167 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnH_JO7hjk3ayDp3J2lRJyqRf6OZniQMK-zp9aHMajQzhSlvzofBn8WzePN-I78tB2jb24uA6CfcW3tzPXlhhPG5PwUa_Tnq1GcNdoOpM27GKy7Ji1zR7i84yoHrUujZZgChYl-KLDJqLJANFtmfMhtMGe81K7Gjmtl4wyqnITt-b6E Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 63267015f5054726a83e3caed23e641a Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-332956977", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "max_count": 0}} Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-332956977', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'max_count': 0}}} Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 0 Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:34:56.275092 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 13:34:56.279808 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.287088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab42c9aa-16c2-472c-ac36-6879d14ebdb1 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:56.289580 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ab42c9aa-16c2-472c-ac36-6879d14ebdb1 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025809 Nov 02 13:34:56.301408 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2147/4618] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:56 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:34:56.365778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89e2257e-8678-45b4-b550-8575d64788da tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1927612863", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "max_count": 2.5}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89e2257e-8678-45b4-b550-8575d64788da tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Request method failure captured: Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 170 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnH_JO7hjk3ayDp3J2lRJyqRf6OZniQMK-zp9aHMajQzhSlvzofBn8WzePN-I78tB2jb24uA6CfcW3tzPXlhhPG5PwUa_Tnq1GcNdoOpM27GKy7Ji1zR7i84yoHrUujZZgChYl-KLDJqLJANFtmfMhtMGe81K7Gjmtl4wyqnITt-b6E Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 63267015f5054726a83e3caed23e641a Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1927612863", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "max_count": 2.5}} Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1927612863', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'max_count': 2.5}}} Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:34:56.371669 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 13:34:56.377475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.382391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89e2257e-8678-45b4-b550-8575d64788da tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:56.383770 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89e2257e-8678-45b4-b550-8575d64788da tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023592 Nov 02 13:34:56.394483 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2472/4619] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:56 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:34:56.429734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:56.430716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:56.442866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:56.448428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:56.449349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:56.450323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:56.455956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:56.456721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:56.511668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f035532-a473-4227-b00f-73c87e1c59c2 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-142074418", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 0}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f035532-a473-4227-b00f-73c87e1c59c2 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Request method failure captured: Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 167 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnH_JO7hjk3ayDp3J2lRJyqRf6OZniQMK-zp9aHMajQzhSlvzofBn8WzePN-I78tB2jb24uA6CfcW3tzPXlhhPG5PwUa_Tnq1GcNdoOpM27GKy7Ji1zR7i84yoHrUujZZgChYl-KLDJqLJANFtmfMhtMGe81K7Gjmtl4wyqnITt-b6E Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 63267015f5054726a83e3caed23e641a Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-142074418", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 0}} Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-142074418', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'min_count': 0}}} Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 0 Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:34:56.516739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 13:34:56.521211 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.533539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f035532-a473-4227-b00f-73c87e1c59c2 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:56.535315 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f035532-a473-4227-b00f-73c87e1c59c2 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027446 Nov 02 13:34:56.536458 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2473/4620] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:56 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:34:56.604302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1547763-ff2f-4e82-9060-d2fc83d42318 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-993063268", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 2.5}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1547763-ff2f-4e82-9060-d2fc83d42318 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Request method failure captured: Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 169 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnH_JO7hjk3ayDp3J2lRJyqRf6OZniQMK-zp9aHMajQzhSlvzofBn8WzePN-I78tB2jb24uA6CfcW3tzPXlhhPG5PwUa_Tnq1GcNdoOpM27GKy7Ji1zR7i84yoHrUujZZgChYl-KLDJqLJANFtmfMhtMGe81K7Gjmtl4wyqnITt-b6E Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9588807cadf743ef9ae317299ff01cb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9588807cadf743ef9ae317299ff01cb2 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111616472 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 63267015f5054726a83e3caed23e641a Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111616472-project Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-993063268", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "min_count": 2.5}} Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-993063268', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'min_count': 2.5}}} Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:34:56.608373 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1547763-ff2f-4e82-9060-d2fc83d42318 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1547763-ff2f-4e82-9060-d2fc83d42318 tempest-MultipleCreateNegativeTestJSON-111616472 tempest-MultipleCreateNegativeTestJSON-111616472-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011008 Nov 02 13:34:56.613186 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2474/4621] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:34:56 2022] POST /compute/v2.1/servers => generated 139 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:34:56.853788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:56.869275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:56.869891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:56.876452 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af33827f-ef22-4e9b-8fa2-4f17a8d3ccae tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.452282 Nov 02 13:34:56.882827 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2148/4622] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:56 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:56.885241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:56.897679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:56.898467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:56.900225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:56.904400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:56.905119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:56.913220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:56.914129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:56.926380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:56.927700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:56.928837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:56.929760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:56.935532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:56.937207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:57.224838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:57.234115 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-99e02f59-5820-42e9-b8c0-9d9a007c782b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1297 microversion: 2.1 time: 0.369874 Nov 02 13:34:57.236147 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2475/4623] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:56 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1297 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:57.480890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:57.490867 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-233541d5-046f-4eb6-b2d7-2780d0e37bce tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 0.585550 Nov 02 13:34:57.498933 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2149/4624] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:56 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:57.715594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-74890fe3-a1d8-4632-85e3-bba0499aedb1 req-ec65a440-79a5-4b91-8a36-50cdd13ff32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ed7862-b20d-457d-84d7-7259ba577d12", "name": "network-vif-plugged", "status": "completed", "tag": "cc79c635-dc0b-4a6c-a9ef-7d9430045f8d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:34:57.743954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-74890fe3-a1d8-4632-85e3-bba0499aedb1 req-ec65a440-79a5-4b91-8a36-50cdd13ff32b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:57.745011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-74890fe3-a1d8-4632-85e3-bba0499aedb1 req-ec65a440-79a5-4b91-8a36-50cdd13ff32b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:57.746478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-74890fe3-a1d8-4632-85e3-bba0499aedb1 req-ec65a440-79a5-4b91-8a36-50cdd13ff32b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:57.793861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-74890fe3-a1d8-4632-85e3-bba0499aedb1 req-ec65a440-79a5-4b91-8a36-50cdd13ff32b service nova] Creating event network-vif-plugged:cc79c635-dc0b-4a6c-a9ef-7d9430045f8d for instance 66ed7862-b20d-457d-84d7-7259ba577d12 on n-h2-858384-19 Nov 02 13:34:57.811344 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-74890fe3-a1d8-4632-85e3-bba0499aedb1 req-ec65a440-79a5-4b91-8a36-50cdd13ff32b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099304 Nov 02 13:34:57.814117 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2476/4625] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:34:57.911275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:57.912402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:57.922465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:57.925647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:57.926118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:57.926856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:57.927359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:57.927794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:58.261585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:58.262906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:58.287185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:58.292596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:58.293125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:58.293888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:58.294467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:58.295063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:58.544284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:58.557045 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-35e7d3ea-5a46-4330-aef2-90e94a50da08 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.650987 Nov 02 13:34:58.571139 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2150/4626] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:57 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:58.571139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:58.571139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:58.582083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:58.582632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:58.583370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:58.583849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:58.584302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:58.584726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:58.846042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:58.872664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eabffe77-8dda-43ed-b371-ba13f9d22767 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 0.616444 Nov 02 13:34:58.873357 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2477/4627] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:58 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:34:59.591610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:59.592280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:59.621210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:59.621374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:59.623627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:59.627877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:59.631055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:59.633090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:59.847732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:34:59.870251 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-166f7b12-0f10-45a1-a768-47ea1fbc723c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1326 microversion: 2.1 time: 1.309957 Nov 02 13:34:59.882848 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2151/4628] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:58 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1326 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:34:59.900285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:34:59.902709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:34:59.911889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:59.912923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:59.913970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:34:59.914843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:34:59.915737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:34:59.919897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:00.165148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:00.177052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3814dbb4-ae8a-4d33-be67-aaa836e77188 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.595366 Nov 02 13:35:00.186099 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2478/4629] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:59 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:00.488381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:00.506288 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-86958fb1-e63b-46ce-8d31-410054e24214 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 0.610662 Nov 02 13:35:00.506896 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2152/4630] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:34:59 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:00.912985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:00.914164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:00.918007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=66 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:00.944461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:00.946895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:00.948027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:00.951296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:00.953913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:00.956742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:01.208829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:01.210089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:01.212239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:01.213167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:01.223063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:01.225521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:01.226273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:01.227918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:01.228946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:01.230270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:01.533004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:01.566256 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bc83a120-76f0-4f10-9b8c-38cc97aaf6e2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1521 microversion: 2.1 time: 0.659335 Nov 02 13:35:01.566858 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2479/4631] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:00 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1521 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:01.577373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:01.586687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:01.614149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:01.617447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:01.617940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:01.619563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:01.620232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:01.621003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:01.745247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:01.764590 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c69b5ce7-030e-403e-b04d-5c60809af3ee tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.559942 Nov 02 13:35:01.772115 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2153/4632] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:01 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:01.784559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:01.790784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:01.804080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:01.804770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:01.805587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:01.806492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:01.807234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:01.808339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:01.848751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lazy-loading 'flavor' on Instance uuid 66ed7862-b20d-457d-84d7-7259ba577d12 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:35:01.857995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:01.867822 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1d78bbe-94b7-4c46-9ef1-e6e0b6048ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 0.295234 Nov 02 13:35:01.868422 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2480/4633] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:01 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:02.000069 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-50b40d16-7b09-4598-bda8-308621392995 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12/action" status: 200 len: 32 microversion: 2.1 time: 0.223896 Nov 02 13:35:02.002425 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2154/4634] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:35:01 2022] POST /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:35:02.029300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:02.030551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:02.065673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:02.070341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:02.071360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:02.074290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:02.076376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:02.080692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:02.107256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:02.160026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc05a3c1-6ffb-4dfb-894b-50490a66f850 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: .version_select at 0x7fe7862f13a0>, body: {"keypair": {"name": "tempest-keypair-1658238931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMhE0oTW/xRBPTbq+XcyaRZ4DODxAmzwn74vFI+UZuvzhqxOY81eciR6SOsBfsAmMGsu0yfAtE/xJ1L4EOpSEnHM8HK+X42V72x9TKNmPDnCF0egW3EjvOujvXZyOtohw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:02.193429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-dc05a3c1-6ffb-4dfb-894b-50490a66f850 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:35:02.205672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-dc05a3c1-6ffb-4dfb-894b-50490a66f850 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for user 284102156ef9461e93e4af60f9496aa2 and project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:35:02.272153 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc05a3c1-6ffb-4dfb-894b-50490a66f850 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.402672 Nov 02 13:35:02.279533 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2481/4635] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:35:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:02.575683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1c178f7e-98fe-4a9a-ad65-babc6d4934d9 req-76c6a8a1-3d77-4746-99b1-cfa6e35413a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21f8474-c128-4b53-bff0-430576924452", "tag": "40df3459-8d21-4266-8914-4f5dec968db6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:02.606187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1c178f7e-98fe-4a9a-ad65-babc6d4934d9 req-76c6a8a1-3d77-4746-99b1-cfa6e35413a3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:02.606678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1c178f7e-98fe-4a9a-ad65-babc6d4934d9 req-76c6a8a1-3d77-4746-99b1-cfa6e35413a3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:02.607142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1c178f7e-98fe-4a9a-ad65-babc6d4934d9 req-76c6a8a1-3d77-4746-99b1-cfa6e35413a3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:02.646408 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1c178f7e-98fe-4a9a-ad65-babc6d4934d9 req-76c6a8a1-3d77-4746-99b1-cfa6e35413a3 service nova] Creating event network-changed:40df3459-8d21-4266-8914-4f5dec968db6 for instance e21f8474-c128-4b53-bff0-430576924452 on n-h2-858384-19 Nov 02 13:35:02.662884 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1c178f7e-98fe-4a9a-ad65-babc6d4934d9 req-76c6a8a1-3d77-4746-99b1-cfa6e35413a3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091821 Nov 02 13:35:02.666969 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2482/4636] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:02.796357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:02.798189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:02.817064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:02.817633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:02.818203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:02.818956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:02.819457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:02.821020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:02.870054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:03.203528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:03.212288 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fb842b40-70af-4f19-b3de-cac4a60ee305 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 1.193525 Nov 02 13:35:03.219934 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2155/4637] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:02 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:03.235792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:03.236705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:03.251432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:03.263983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:03.264766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:03.265919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:03.266582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:03.267233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:03.616750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:03.634607 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19597fc4-5623-4475-81ca-15aa0c51fd71 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.842168 Nov 02 13:35:03.636545 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2483/4638] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:02 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:04.211923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:04.221688 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9575ea89-fb23-4283-98da-6b03267c376f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 0.993780 Nov 02 13:35:04.236433 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2156/4639] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:03 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:04.244518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:04.245431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:04.263532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:04.265685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:04.267589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:04.270464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:04.273721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:04.275410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:04.639859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:04.649816 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8c1d965-ff97-43c6-a018-4a98e38fdaca tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.410130 Nov 02 13:35:04.658447 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2484/4640] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:04 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:04.662926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:04.663724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:04.675349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:04.676194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:04.676527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:04.677233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:04.677854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:04.678281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:05.173849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:05.192863 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16cb5b0d-d121-4c0e-aca6-959d47f0d50e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.536014 Nov 02 13:35:05.232926 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2157/4641] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:04 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:05.257160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:05.258042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:05.271260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:05.273046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:05.277964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:05.279167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:05.282058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:05.282833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:05.654428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:05.674294 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-933d3fd8-188d-4e98-b5d8-eb1bbd5900d3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 0.420903 Nov 02 13:35:05.680316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:05.681182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:05.705850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:05.706546 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2485/4642] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:05 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:05.707466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:05.708156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:05.709257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:05.709945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:05.710592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:05.863527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-241048014", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07df1b69-fb68-402d-a0e1-7135ff448b95"}], "security_groups": [{"name": "tempest-securitygroup--1261024409"}], "key_name": "tempest-keypair-1658238931", "user_data": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:06.261830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] validate_networks() for [('07df1b69-fb68-402d-a0e1-7135ff448b95', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:35:07.127566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:35:07.129449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:35:07.130975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:35:07.131697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:35:07.132489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:35:07.145241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:07.147596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:07.150193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:07.151672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:07.152916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:07.157470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:07.207023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:35:07.232865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:07.244749 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-177fe671-37e7-4e55-bf94-045fe0e4a96f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 1.568052 Nov 02 13:35:07.247909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for user 284102156ef9461e93e4af60f9496aa2 and project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:35:07.274753 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2158/4643] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:05 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:07.313466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:07.320623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:35:07.324111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:35:07.332371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:07.345325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:07.347052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:07.348497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:07.349359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:07.351210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:07.352268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:07.449245 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e451765-eea5-4529-8ccc-2582eedae886 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.594121 Nov 02 13:35:07.450734 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2486/4644] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:35:05 2022] POST /compute/v2.1/servers => generated 404 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:35:07.458182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:07.461901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:07.528717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:07.529554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:07.530142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:07.531606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:07.532209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:07.532780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:07.853481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:07.866832 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44f7f7ed-088a-4818-97d1-dc31a084f09b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 0.414623 Nov 02 13:35:07.870023 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2487/4645] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:07 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:07.893563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-740ec963-c6d0-4340-b63d-240ddcb3d072 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:07.894960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-740ec963-c6d0-4340-b63d-240ddcb3d072 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:08.010323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-740ec963-c6d0-4340-b63d-240ddcb3d072 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:08.020276 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-740ec963-c6d0-4340-b63d-240ddcb3d072 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1245 microversion: 2.1 time: 0.134663 Nov 02 13:35:08.044797 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2488/4646] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:07 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1245 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:08.101982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:08.113324 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e8bd8eb9-1955-45a7-b115-1205be272d67 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.817737 Nov 02 13:35:08.134939 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2159/4647] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:07 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:08.283465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:08.284721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:08.332847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:08.336456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:08.345624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:08.349324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:08.350654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:08.352125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:08.593642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:08.605691 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a571c66d-a1e2-45bf-afcf-37f57beb2563 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.328491 Nov 02 13:35:08.606354 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2489/4648] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:08 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:08.898299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:08.899184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:08.916581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:08.917337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:08.919918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:08.920784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:08.922211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:08.924056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:09.056412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:09.057790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:09.074104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:09.074908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:09.075955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:09.077980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:09.078731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:09.080014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:09.266369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:09.275004 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1155ead9-e7e0-4461-8002-cc14f5d4e552 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 0.381632 Nov 02 13:35:09.275645 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2160/4649] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:08 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:09.293174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:09.294272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:09.297126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:09.307772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:09.308272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:09.308720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:09.309959 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-453ccfb6-8d5d-4359-ac42-6b222f2263d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1297 microversion: 2.1 time: 0.257656 Nov 02 13:35:09.311096 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2490/4650] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:09 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1297 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:09.314223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:09.314807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:09.315293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:09.629360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:09.635477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:09.670023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:09.670589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:09.672835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:09.674014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:09.674649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:09.675289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:09.771812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:09.781296 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0f3f0b7-636b-488f-9fc4-ddab8561a78f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1500 microversion: 2.1 time: 0.496324 Nov 02 13:35:09.782046 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2161/4651] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:09 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1500 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:10.023859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:10.048219 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f8e9cbc-99c1-465f-a0e9-6739776b8a7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.422723 Nov 02 13:35:10.059626 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2491/4652] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:09 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:10.304907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:10.305530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:10.319774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:10.325656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:10.326121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:10.326871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:10.327975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:10.333681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:10.334297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:10.351051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:10.354357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:10.355151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:10.359401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:10.367399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:10.368130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:10.371590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:10.621413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:10.638917 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc626274-8010-49c5-ba15-fc04187704ea tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1303 microversion: 2.1 time: 0.306166 Nov 02 13:35:10.650084 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2492/4653] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:10 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:10.802487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:10.809291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:10.812313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:10.818530 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-adab792f-566a-46e6-9c0e-c0b1671badb8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 0.518620 Nov 02 13:35:10.820258 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2162/4654] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:10 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:10.826905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:10.828086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:10.829445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:10.830499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:10.831145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:10.834780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:11.083478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:11.084107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:11.105492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:11.110737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:11.111483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:11.112272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:11.113726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:11.114183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:11.305663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:11.323803 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a9bdaf39-846b-4442-8cc8-9c31cb66c585 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 200 len: 1477 microversion: 2.1 time: 0.521529 Nov 02 13:35:11.334854 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2493/4655] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:10 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 1477 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:11.378968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-837a7196-dcaa-4932-a6ef-7653160037fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-91833352"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:11.383455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-837a7196-dcaa-4932-a6ef-7653160037fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:11.410383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-837a7196-dcaa-4932-a6ef-7653160037fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:11.411071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-837a7196-dcaa-4932-a6ef-7653160037fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:11.411742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-837a7196-dcaa-4932-a6ef-7653160037fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:11.412620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-837a7196-dcaa-4932-a6ef-7653160037fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:11.413753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-837a7196-dcaa-4932-a6ef-7653160037fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:11.415929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-837a7196-dcaa-4932-a6ef-7653160037fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:11.767224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:11.793488 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d44f789-9010-4359-bbba-a7e637ceb9fc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.713985 Nov 02 13:35:11.794808 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2163/4656] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:11 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:11.819830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:11.823186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:11.856226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:11.856734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:11.871066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:11.876082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:11.878570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:11.884471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.037461 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-837a7196-dcaa-4932-a6ef-7653160037fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd/action" status: 202 len: 0 microversion: 2.1 time: 0.688493 Nov 02 13:35:12.038148 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2494/4657] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:35:11 2022] POST /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:35:12.086955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:12.089573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:12.099309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.100210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.100936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.101901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.102566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.103456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.459211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:12.468504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-942b3551-62cf-43f0-98b1-d3ee7802fe4a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1371 microversion: 2.1 time: 0.668971 Nov 02 13:35:12.479485 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2164/4658] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:11 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1371 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:12.487789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-dd78401a-c805-4d79-a3ba-50cc93399fc8 req-ba386fad-1dfe-44d9-9cc0-dbdf320125dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21f8474-c128-4b53-bff0-430576924452", "name": "network-vif-plugged", "status": "completed", "tag": "40df3459-8d21-4266-8914-4f5dec968db6"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:12.509793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-dd78401a-c805-4d79-a3ba-50cc93399fc8 req-ba386fad-1dfe-44d9-9cc0-dbdf320125dd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.510298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-dd78401a-c805-4d79-a3ba-50cc93399fc8 req-ba386fad-1dfe-44d9-9cc0-dbdf320125dd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.510737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-dd78401a-c805-4d79-a3ba-50cc93399fc8 req-ba386fad-1dfe-44d9-9cc0-dbdf320125dd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.668299 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-dd78401a-c805-4d79-a3ba-50cc93399fc8 req-ba386fad-1dfe-44d9-9cc0-dbdf320125dd service nova] Creating event network-vif-plugged:40df3459-8d21-4266-8914-4f5dec968db6 for instance e21f8474-c128-4b53-bff0-430576924452 on n-h2-858384-19 Nov 02 13:35:12.685545 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-dd78401a-c805-4d79-a3ba-50cc93399fc8 req-ba386fad-1dfe-44d9-9cc0-dbdf320125dd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210432 Nov 02 13:35:12.688714 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2165/4659] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:12.711594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a79fe4f1-9285-4917-9ca2-7717aec9cac9 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786d34310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:12.839376 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a79fe4f1-9285-4917-9ca2-7717aec9cac9 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.145198 Nov 02 13:35:12.841346 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2166/4660] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:12 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:12.850602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:12.851770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:12.862459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.863311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.863925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:12.865402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:12.866437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:12.867855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:13.352870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:13.363430 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1e9c1f3f-7729-4f1a-ae85-eadd978284da tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 1.310432 Nov 02 13:35:13.385073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2495/4661] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:12 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:13.497137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:13.498512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:13.531297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:13.539890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:13.540615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:13.541652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:13.542279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:13.542881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:13.845780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:13.863502 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d556107c-5c3b-41ee-b082-b06e0c90dbe7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 1.019827 Nov 02 13:35:13.864120 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2167/4662] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:12 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:13.887460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad8ede23-19ef-430a-894b-aa4d6c2a4fdd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786d78f70>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:13.955784 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad8ede23-19ef-430a-894b-aa4d6c2a4fdd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.070606 Nov 02 13:35:13.963892 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2168/4663] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:13 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:14.078896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:14.092339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31cc6d4d-233c-4542-a78f-84e6d0a3e952 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1371 microversion: 2.1 time: 0.599673 Nov 02 13:35:14.097403 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2496/4664] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:13 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1371 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:14.324144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-95b6a692-c0ae-4b57-a3ee-d664785e747f req-f0c292fd-227c-4691-ad64-29c8b57d0354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97fc922-3426-43e9-916a-32c813e2751f", "tag": "72dfa9f8-135f-463d-86a6-20514260ceef"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:14.362292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-95b6a692-c0ae-4b57-a3ee-d664785e747f req-f0c292fd-227c-4691-ad64-29c8b57d0354 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:14.364485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-95b6a692-c0ae-4b57-a3ee-d664785e747f req-f0c292fd-227c-4691-ad64-29c8b57d0354 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:14.366148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-95b6a692-c0ae-4b57-a3ee-d664785e747f req-f0c292fd-227c-4691-ad64-29c8b57d0354 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:14.393012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:14.393634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:14.402604 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-95b6a692-c0ae-4b57-a3ee-d664785e747f req-f0c292fd-227c-4691-ad64-29c8b57d0354 service nova] Creating event network-changed:72dfa9f8-135f-463d-86a6-20514260ceef for instance f97fc922-3426-43e9-916a-32c813e2751f on n-h1-858384-19 Nov 02 13:35:14.409951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:14.410473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:14.411010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:14.411658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:14.412112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:14.412546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:14.419711 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-95b6a692-c0ae-4b57-a3ee-d664785e747f req-f0c292fd-227c-4691-ad64-29c8b57d0354 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099015 Nov 02 13:35:14.421633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2169/4665] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:14.807069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:14.818345 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e5209626-6c83-4ad7-89bc-3fb550d074ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1365 microversion: 2.1 time: 0.429958 Nov 02 13:35:14.820414 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2497/4666] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:14 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:14.892074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:14.893129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:14.907092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:14.912229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:14.916404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:14.918444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:14.919652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:14.920956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:14.996543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fbe13931-61e7-4a7a-b6ca-1a9ab90b0057 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7860fb280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:15.150338 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fbe13931-61e7-4a7a-b6ca-1a9ab90b0057 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.179601 Nov 02 13:35:15.152100 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2498/4667] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:14 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:15.183942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:15.184992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:15.210651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:15.211523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:15.212269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:15.213496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:15.214274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:15.214995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:15.640463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:15.656618 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0308077-43a8-4701-a490-508ec85fd856 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1371 microversion: 2.1 time: 0.501966 Nov 02 13:35:15.658226 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2499/4668] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:15 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1371 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:15.667844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:15.683422 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-85d6b359-93a1-477b-853a-0589e29e4d5f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.797325 Nov 02 13:35:15.685039 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2170/4669] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:14 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:15.788643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1263441147", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "72b9835d-a72b-4fca-a474-8e3cbf534984"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:15.852045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:15.853204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:15.880099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] validate_networks() for [('72b9835d-a72b-4fca-a474-8e3cbf534984', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:35:15.892862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:15.894344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:15.894756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:15.901899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:15.902397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:15.902849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:16.230150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:16.256252 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2e746f78-84fb-4fc1-8ffb-aa7bb49eac9d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1551 microversion: 2.1 time: 0.411765 Nov 02 13:35:16.256862 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2171/4670] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:15 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1551 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:16.269209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5695adf9-146c-434f-bdb7-b443da1f6069 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786d1fc10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:16.363757 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5695adf9-146c-434f-bdb7-b443da1f6069 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.105080 Nov 02 13:35:16.373210 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2172/4671] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:16 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:16.379774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-11b3d41b-ea55-4e54-b210-632680455032 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:16.380560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-11b3d41b-ea55-4e54-b210-632680455032 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:16.392168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b3d41b-ea55-4e54-b210-632680455032 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:16.393945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b3d41b-ea55-4e54-b210-632680455032 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:16.395036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b3d41b-ea55-4e54-b210-632680455032 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:16.407541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b3d41b-ea55-4e54-b210-632680455032 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:16.408032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b3d41b-ea55-4e54-b210-632680455032 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:16.408481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b3d41b-ea55-4e54-b210-632680455032 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:16.532720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:35:16.533142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:35:16.533616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:35:16.534023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:35:16.534434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:35:16.556752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:16.558032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:16.558677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:16.562532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:16.564177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:16.567442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:16.586304 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-11b3d41b-ea55-4e54-b210-632680455032 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.211278 Nov 02 13:35:16.587412 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2173/4672] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:35:16 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/os-interface => generated 285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:16.611034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Getting quotas for project 2a21c1ac1702478d88530bda40420ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:35:16.617770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Getting quotas for user d6a5ce7d3f404128bf98a6a7aec9cd80 and project 2a21c1ac1702478d88530bda40420ba7. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:35:16.632928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:35:16.635549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:35:16.684239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:16.685117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:16.707144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:16.710532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:16.714318 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c769f70e-738c-49fc-9a4c-0947fa068502 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.000340 Nov 02 13:35:16.714981 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2500/4673] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:35:15 2022] POST /compute/v2.1/servers => generated 382 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:35:16.722368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:16.724080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:16.724722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:16.727318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:16.728227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:16.728845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:16.743971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:16.744469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:16.744911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:16.745622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:16.746078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:16.750737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:16.995863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:17.007375 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6410c33-502c-4bb4-afe5-f868b413db31 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1371 microversion: 2.1 time: 0.327585 Nov 02 13:35:17.009262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2174/4674] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:16 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:17.016512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e6822450-80c7-48bf-96f7-3161b297965f tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:17.017487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e6822450-80c7-48bf-96f7-3161b297965f tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:17.104094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e6822450-80c7-48bf-96f7-3161b297965f tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:17.119698 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e6822450-80c7-48bf-96f7-3161b297965f tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1229 microversion: 2.1 time: 0.108732 Nov 02 13:35:17.121320 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2175/4675] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:17 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:17.206838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:17.216355 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-496c5c21-5b6d-4e52-ba42-570fd15aaff9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.493075 Nov 02 13:35:17.218242 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2501/4676] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:16 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:17.383572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be4ffa4a-7b6f-444a-a89a-d89dca0f8893 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786d78670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:17.508820 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-be4ffa4a-7b6f-444a-a89a-d89dca0f8893 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.131675 Nov 02 13:35:17.520185 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2176/4677] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:17 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:18.034853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:18.035537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:18.062281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:18.067168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:18.067714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:18.068466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:18.068924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:18.071714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:18.087038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:18.150584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:18.151821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:18.161589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:18.162090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:18.162530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:18.163279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:18.163745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:18.164177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:18.294594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:18.302097 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ab5acbd-28b8-41c5-b437-175af6ef1ff4 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1233 microversion: 2.1 time: 0.156548 Nov 02 13:35:18.311709 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2177/4678] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:18 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1233 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:18.317105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:18.322866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:18.338552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:18.339348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:18.340066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:18.340973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:18.341439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:18.341871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:18.494627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:18.505902 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c54d1f7b-3126-4cbe-a437-9c9d5cd676ab tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1371 microversion: 2.1 time: 0.475791 Nov 02 13:35:18.521176 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2502/4679] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:18 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1371 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:18.540857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1fab016c-0ba4-48b6-8ac6-e767feb4e847 req-9f4c812a-b3df-4ba6-b6c9-a049604ae4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd242457-066d-4e86-abf9-57bf36514bcd", "name": "network-vif-plugged", "status": "completed", "tag": "639d7e7f-258a-4287-b436-3767a87f3bc6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:18.575374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1fab016c-0ba4-48b6-8ac6-e767feb4e847 req-9f4c812a-b3df-4ba6-b6c9-a049604ae4b6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:18.576452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:18.577288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1fab016c-0ba4-48b6-8ac6-e767feb4e847 req-9f4c812a-b3df-4ba6-b6c9-a049604ae4b6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:18.578610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1fab016c-0ba4-48b6-8ac6-e767feb4e847 req-9f4c812a-b3df-4ba6-b6c9-a049604ae4b6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:18.584054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:18.586313 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-00ad4445-5deb-43a6-951c-5bb9a8eabdd9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.273233 Nov 02 13:35:18.586910 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2178/4680] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:18 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:18.600654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d3e77008-ad3a-46de-b762-ad67e74d0684 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f9da0d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:18.614363 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1fab016c-0ba4-48b6-8ac6-e767feb4e847 req-9f4c812a-b3df-4ba6-b6c9-a049604ae4b6 service nova] Creating event network-vif-plugged:639d7e7f-258a-4287-b436-3767a87f3bc6 for instance dd242457-066d-4e86-abf9-57bf36514bcd on n-h1-858384-19 Nov 02 13:35:18.615259 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1fab016c-0ba4-48b6-8ac6-e767feb4e847 req-9f4c812a-b3df-4ba6-b6c9-a049604ae4b6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091993 Nov 02 13:35:18.618316 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2503/4681] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:18.664616 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d3e77008-ad3a-46de-b762-ad67e74d0684 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.076623 Nov 02 13:35:18.665206 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2179/4682] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:18 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:18.733906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7130a2e0-3496-414c-ae8a-6f76d5df2232 req-1e38e3ee-8aed-4eb1-99c1-9328963fa616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21f8474-c128-4b53-bff0-430576924452", "tag": "40df3459-8d21-4266-8914-4f5dec968db6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:18.769040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7130a2e0-3496-414c-ae8a-6f76d5df2232 req-1e38e3ee-8aed-4eb1-99c1-9328963fa616 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:18.773771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7130a2e0-3496-414c-ae8a-6f76d5df2232 req-1e38e3ee-8aed-4eb1-99c1-9328963fa616 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:18.776028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7130a2e0-3496-414c-ae8a-6f76d5df2232 req-1e38e3ee-8aed-4eb1-99c1-9328963fa616 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:18.802094 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7130a2e0-3496-414c-ae8a-6f76d5df2232 req-1e38e3ee-8aed-4eb1-99c1-9328963fa616 service nova] Creating event network-changed:40df3459-8d21-4266-8914-4f5dec968db6 for instance e21f8474-c128-4b53-bff0-430576924452 on n-h2-858384-19 Nov 02 13:35:18.817161 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7130a2e0-3496-414c-ae8a-6f76d5df2232 req-1e38e3ee-8aed-4eb1-99c1-9328963fa616 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087702 Nov 02 13:35:18.818351 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2504/4683] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:19.334724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:19.335378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:19.349535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:19.350034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:19.350480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:19.356835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:19.357561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:19.358123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:19.534305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:19.535010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:19.550686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:19.563505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:19.563833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:19.564232 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-24e04b2a-afe5-4f78-9185-06344dad2c22 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1281 microversion: 2.1 time: 0.231779 Nov 02 13:35:19.568029 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2180/4684] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:19 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1281 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:19.570284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:19.571819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:19.574513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:19.574960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:19.622077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:19.623008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:19.636947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:19.637457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:19.638074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:19.638621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:19.642330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:19.642856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:19.877542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:19.887100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22ba9e81-ee28-4433-bbe3-f001c4f811e6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1371 microversion: 2.1 time: 0.357511 Nov 02 13:35:19.888308 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2505/4685] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:19 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:19.912386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad6c558c-f655-4398-bab7-689c44dcf07a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78607f280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:20.026599 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ad6c558c-f655-4398-bab7-689c44dcf07a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.119269 Nov 02 13:35:20.048160 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2506/4686] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:19 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:20.598784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:20.599610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:20.621071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:20.621790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:20.622423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:20.625139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:20.630632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:20.631457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:20.943301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:21.010133 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7702b70-6c1a-4783-a568-5131fe83d58a tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1287 microversion: 2.1 time: 0.413023 Nov 02 13:35:21.024424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:21.028477 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2507/4687] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:20 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1287 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:21.064456 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a4964a51-55b4-400e-b432-4ee82d9cb2fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 1.444156 Nov 02 13:35:21.067670 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2181/4688] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:19 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:21.071056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:21.098526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:21.110193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c84289a1-1157-454b-affb-73a660eed1ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787c508b0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:21.126335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:21.128700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:21.129976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:21.132215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:21.133845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:21.143635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:21.203175 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c84289a1-1157-454b-affb-73a660eed1ca tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.127227 Nov 02 13:35:21.203850 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2182/4689] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:21 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:21.351438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:21.365708 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6203f34d-d638-4caa-aa8e-62aec2743409 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1371 microversion: 2.1 time: 0.307204 Nov 02 13:35:21.367614 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2508/4690] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:21 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:22.059784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:22.061715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:22.075507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:22.076021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:22.076550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:22.090572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:22.095079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:22.095548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:22.096417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:22.096699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:22.119853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:22.129571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:22.132314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:22.144116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:22.147238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:22.149840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:22.507263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:22.515891 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-37d52c98-b44a-42f0-b6ac-ab9a0a49ce66 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.426283 Nov 02 13:35:22.516937 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2509/4691] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:22 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:22.535539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a14d2bfe-1081-4577-a197-7c000ae021ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786016ee0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:22.621039 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a14d2bfe-1081-4577-a197-7c000ae021ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.102820 Nov 02 13:35:22.630450 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2510/4692] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:22 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:22.637249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:22.641293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:22.644464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:22.649074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:22.649695 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4931599-7083-4603-9883-266a0e782043 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1329 microversion: 2.1 time: 0.595327 Nov 02 13:35:22.650814 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2183/4693] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:22 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1329 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:22.672247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:22.683541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:22.687614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:22.691385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:22.692153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:22.697870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:23.007656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f057c7e1-c0f8-4471-9222-37eb09e6e190 req-691cfdae-759a-4208-b178-63fd0f1f329a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97fc922-3426-43e9-916a-32c813e2751f", "name": "network-vif-plugged", "status": "completed", "tag": "72dfa9f8-135f-463d-86a6-20514260ceef"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:23.039759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f057c7e1-c0f8-4471-9222-37eb09e6e190 req-691cfdae-759a-4208-b178-63fd0f1f329a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:23.040424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f057c7e1-c0f8-4471-9222-37eb09e6e190 req-691cfdae-759a-4208-b178-63fd0f1f329a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:23.040971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f057c7e1-c0f8-4471-9222-37eb09e6e190 req-691cfdae-759a-4208-b178-63fd0f1f329a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:23.082469 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f057c7e1-c0f8-4471-9222-37eb09e6e190 req-691cfdae-759a-4208-b178-63fd0f1f329a service nova] Creating event network-vif-plugged:72dfa9f8-135f-463d-86a6-20514260ceef for instance f97fc922-3426-43e9-916a-32c813e2751f on n-h1-858384-19 Nov 02 13:35:23.093961 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f057c7e1-c0f8-4471-9222-37eb09e6e190 req-691cfdae-759a-4208-b178-63fd0f1f329a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090906 Nov 02 13:35:23.096288 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2184/4694] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:35:23.543846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:23.551306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:23.552555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:23.570204 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-57425e2f-9c63-41b5-8270-415c24cdd805 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1371 microversion: 2.1 time: 0.937319 Nov 02 13:35:23.572896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:23.579887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:23.580678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:23.581772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:23.582564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:23.583361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:23.588276 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2511/4695] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:22 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1371 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:23.641996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4bec5490-ff10-4f76-bf0b-333c0be766f4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786060670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:23.709406 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4bec5490-ff10-4f76-bf0b-333c0be766f4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.074047 Nov 02 13:35:23.710118 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2512/4696] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:23 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:23.721310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:23.721939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:23.728639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:23.729340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:23.730162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:23.731054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:23.731717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:23.732402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:23.941628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:23.953653 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-067df729-db5f-4062-ad45-4e66c1343702 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.408312 Nov 02 13:35:23.954233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:23.964442 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed1d6155-5027-46c2-8425-4fa3b4a50f27 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1329 microversion: 2.1 time: 0.253237 Nov 02 13:35:23.965565 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2513/4697] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:23 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1329 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:23.970183 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2185/4698] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:23 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:24.082727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-69abbae8-c49f-4d8f-9a19-9581f5723aab req-a53b08e5-d2a5-4a76-8e64-fa11d9eeb1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71014514-432e-4c20-be59-075d18a70e6f", "tag": "83cb9e82-ad5f-441c-b8dc-cad558ae8ff4"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:24.103370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-69abbae8-c49f-4d8f-9a19-9581f5723aab req-a53b08e5-d2a5-4a76-8e64-fa11d9eeb1f1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:24.112810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-69abbae8-c49f-4d8f-9a19-9581f5723aab req-a53b08e5-d2a5-4a76-8e64-fa11d9eeb1f1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:24.113280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-69abbae8-c49f-4d8f-9a19-9581f5723aab req-a53b08e5-d2a5-4a76-8e64-fa11d9eeb1f1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:24.145604 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-69abbae8-c49f-4d8f-9a19-9581f5723aab req-a53b08e5-d2a5-4a76-8e64-fa11d9eeb1f1 service nova] Creating event network-changed:83cb9e82-ad5f-441c-b8dc-cad558ae8ff4 for instance 71014514-432e-4c20-be59-075d18a70e6f on n-h1-858384-19 Nov 02 13:35:24.155697 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-69abbae8-c49f-4d8f-9a19-9581f5723aab req-a53b08e5-d2a5-4a76-8e64-fa11d9eeb1f1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076239 Nov 02 13:35:24.156780 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2514/4699] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:24.602343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:24.603183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:24.614598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=70 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:24.620548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:24.621407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:24.621962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:24.623327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:24.626628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:24.627357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:24.727728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bab316d5-47fd-4815-a6ef-412b33ff663a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786060ee0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:24.824034 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bab316d5-47fd-4815-a6ef-412b33ff663a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.092845 Nov 02 13:35:24.835195 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2515/4700] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:24 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:25.012117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:25.013525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:25.028224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:25.031822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:25.033687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:25.039278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:25.040002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:25.040657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:25.363366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:25.372691 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edee3d20-32bc-4a2b-a3f0-fdf1c5677538 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.366210 Nov 02 13:35:25.375818 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2516/4701] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:25 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:25.394809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:25.401386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:25.402014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:25.415790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:25.417265 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d45d6723-e9b0-4bd5-899f-063777f3a276 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1371 microversion: 2.1 time: 0.818990 Nov 02 13:35:25.418771 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2186/4702] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:24 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1371 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:25.436822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:25.442093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:25.443190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:25.443819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:25.444338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:25.795996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:25.804025 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69ca4056-acf0-45fe-9c3b-0b09d0a9ae92 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1329 microversion: 2.1 time: 0.415288 Nov 02 13:35:25.804607 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2517/4703] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:25 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1329 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:25.848584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc838be9-df9f-4eae-9e39-83dc68d5619e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786d1fd30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:25.959243 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc838be9-df9f-4eae-9e39-83dc68d5619e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.114891 Nov 02 13:35:25.968951 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2187/4704] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:25 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:26.401536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:26.402068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:26.422287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:26.426954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:26.427562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:26.433557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:26.434046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:26.434488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:26.449544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:26.450161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:26.468881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:26.469413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:26.469665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:26.470388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:26.475585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:26.479065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:26.586447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:26.628103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=18 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:26.743331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:26.755094 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b547b73-af14-459b-a5c8-819de27000a9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.357504 Nov 02 13:35:26.756257 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2518/4705] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:26 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:26.797709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:26.813527 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-be059b5c-5dbf-4498-a135-a21696b2e605 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1561 microversion: 2.1 time: 0.368007 Nov 02 13:35:26.814744 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2188/4706] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:26 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1561 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:26.844471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:26.846462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:26.851496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-618e48ef-8e3a-4f36-ae99-2e74fd6048e1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:26.856558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-618e48ef-8e3a-4f36-ae99-2e74fd6048e1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:26.871939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-618e48ef-8e3a-4f36-ae99-2e74fd6048e1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:26.872457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-618e48ef-8e3a-4f36-ae99-2e74fd6048e1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:26.872898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-618e48ef-8e3a-4f36-ae99-2e74fd6048e1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:26.874281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-618e48ef-8e3a-4f36-ae99-2e74fd6048e1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:26.874972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-618e48ef-8e3a-4f36-ae99-2e74fd6048e1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:26.875106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:26.875542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:26.875759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-618e48ef-8e3a-4f36-ae99-2e74fd6048e1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:26.876341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:26.877646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:26.878303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:26.878923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:27.099611 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-618e48ef-8e3a-4f36-ae99-2e74fd6048e1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.263817 Nov 02 13:35:27.107725 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2189/4707] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:35:26 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-interface => generated 285 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:27.112308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce1d21c2-8f7c-4998-91a8-a9bf7448b515 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786f8f820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:27.121736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:27.171441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:27.188087 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-795f9b62-32cc-4da7-9369-49e3d249ff2e tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1329 microversion: 2.1 time: 0.356656 Nov 02 13:35:27.189564 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2519/4708] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:26 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1329 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:27.235096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce1d21c2-8f7c-4998-91a8-a9bf7448b515 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.131898 Nov 02 13:35:27.236578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2190/4709] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:27 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:27.783520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:27.784604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:27.807415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:27.808155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:27.808768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:27.809624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:27.810218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:27.811485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:28.193167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:28.205831 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-382dcb35-2cc5-486b-bc84-bc0eef09c693 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.429953 Nov 02 13:35:28.222518 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2520/4710] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:27 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:28.240522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:28.241562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:28.254980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59ba62cf-8e15-4909-9bfe-542161c5cedd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786148430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:28.255332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:28.255874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:28.256395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:28.257212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:28.257745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:28.258428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:28.343580 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59ba62cf-8e15-4909-9bfe-542161c5cedd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.092338 Nov 02 13:35:28.350738 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2521/4711] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:28 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:29.245468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:29.249428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:29.272022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:29.283248 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc29d4aa-b028-4e57-941b-ebc57e5acce7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1329 microversion: 2.1 time: 1.059063 Nov 02 13:35:29.286359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:29.287849 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2191/4712] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:28 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1329 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:29.301808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:29.301808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:29.301808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:29.301808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:29.301808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:29.362411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c0658346-e7e6-4eef-bc3d-1ccd7065ad8f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787c50820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:29.453137 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c0658346-e7e6-4eef-bc3d-1ccd7065ad8f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.095164 Nov 02 13:35:29.458010 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2192/4713] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:29 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:29.607753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:29.618141 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-810bb943-adbc-45d3-a8b0-5d7ba33d4317 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.385556 Nov 02 13:35:29.635544 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2522/4714] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:29 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:30.316417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:30.318503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:30.332963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:30.334540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:30.336729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:30.337805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:30.340595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:30.341294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:30.453764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5d8fd869-4d28-495e-9755-cecc6817a02d req-d4a26500-469c-437e-b2c1-fe3470fa1e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97fc922-3426-43e9-916a-32c813e2751f", "tag": "72dfa9f8-135f-463d-86a6-20514260ceef"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:30.484105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5d8fd869-4d28-495e-9755-cecc6817a02d req-d4a26500-469c-437e-b2c1-fe3470fa1e08 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:30.484754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5d8fd869-4d28-495e-9755-cecc6817a02d req-d4a26500-469c-437e-b2c1-fe3470fa1e08 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:30.485767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5d8fd869-4d28-495e-9755-cecc6817a02d req-d4a26500-469c-437e-b2c1-fe3470fa1e08 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:30.527333 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5d8fd869-4d28-495e-9755-cecc6817a02d req-d4a26500-469c-437e-b2c1-fe3470fa1e08 service nova] Creating event network-changed:72dfa9f8-135f-463d-86a6-20514260ceef for instance f97fc922-3426-43e9-916a-32c813e2751f on n-h1-858384-19 Nov 02 13:35:30.562552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5d8fd869-4d28-495e-9755-cecc6817a02d req-d4a26500-469c-437e-b2c1-fe3470fa1e08 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113297 Nov 02 13:35:30.565017 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2523/4715] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:35:30.583905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82e7a213-4fff-4000-9d4b-590167a5869e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7862b0940>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:30.646184 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82e7a213-4fff-4000-9d4b-590167a5869e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.079779 Nov 02 13:35:30.647505 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2524/4716] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:30 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:30.652515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:30.653497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:30.678243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:30.678753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:30.679233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:30.679986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:30.680527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:30.680877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:30.807548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:30.818340 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-001b5b72-a3ef-492c-b867-3fecda155c00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1329 microversion: 2.1 time: 0.507735 Nov 02 13:35:30.822627 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2193/4717] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:30 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1329 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:31.017063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:31.026981 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-42efafb4-1c83-4f17-ae94-f33b7e34bc5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.378288 Nov 02 13:35:31.048558 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2525/4718] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:30 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:31.658323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-de6ebf29-da4d-446d-b79c-216ae37a2701 req-5b0f9d6c-ea8d-4947-8fbd-7afa943c4738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71014514-432e-4c20-be59-075d18a70e6f", "name": "network-vif-plugged", "status": "completed", "tag": "83cb9e82-ad5f-441c-b8dc-cad558ae8ff4"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:31.663549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a06e32d3-a2f3-4d71-a039-6bb1d2112523 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7861ef8b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:31.694600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-de6ebf29-da4d-446d-b79c-216ae37a2701 req-5b0f9d6c-ea8d-4947-8fbd-7afa943c4738 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:31.698107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-de6ebf29-da4d-446d-b79c-216ae37a2701 req-5b0f9d6c-ea8d-4947-8fbd-7afa943c4738 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:31.698761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-de6ebf29-da4d-446d-b79c-216ae37a2701 req-5b0f9d6c-ea8d-4947-8fbd-7afa943c4738 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:31.729675 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-de6ebf29-da4d-446d-b79c-216ae37a2701 req-5b0f9d6c-ea8d-4947-8fbd-7afa943c4738 service nova] Creating event network-vif-plugged:83cb9e82-ad5f-441c-b8dc-cad558ae8ff4 for instance 71014514-432e-4c20-be59-075d18a70e6f on n-h1-858384-19 Nov 02 13:35:31.746931 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-de6ebf29-da4d-446d-b79c-216ae37a2701 req-5b0f9d6c-ea8d-4947-8fbd-7afa943c4738 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094783 Nov 02 13:35:31.749618 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2194/4719] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:31.766029 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a06e32d3-a2f3-4d71-a039-6bb1d2112523 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.106259 Nov 02 13:35:31.786408 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2526/4720] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:31 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:31.847410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:31.848434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:31.861308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:31.868314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:31.869023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:31.870109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:31.870741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:31.871378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:32.057485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:32.058161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:32.075328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:32.075808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:32.076355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:32.088124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:32.089941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:32.090428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:32.324401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:32.334798 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f6376f7-70db-4e75-8c48-d5ba167af045 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1329 microversion: 2.1 time: 0.491353 Nov 02 13:35:32.340260 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2195/4721] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:31 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1329 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:32.418158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:32.446963 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-63a19be2-65d9-438b-b3c2-ee4737d1e154 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.393817 Nov 02 13:35:32.447895 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2527/4722] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:32 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:32.782455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1b8f640-fc63-44b6-8715-458a943051fb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f8880d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:32.856353 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e1b8f640-fc63-44b6-8715-458a943051fb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.078168 Nov 02 13:35:32.857182 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2196/4723] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:32 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:33.361449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:33.362128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:33.374997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:33.375438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:33.375886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:33.376611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:33.377060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:33.381124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:33.419633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:33.480298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:33.481192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:33.492128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:33.496851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:33.503040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:33.504040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:33.504663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:33.505274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:33.705289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:33.724080 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35c3b0d5-b9fe-4549-85fc-545645704738 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1329 microversion: 2.1 time: 0.369652 Nov 02 13:35:33.727452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:33.728196 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2528/4724] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:33 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1329 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:33.737434 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62ed02b8-5c2d-41f5-a059-d3e00ae86444 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.262203 Nov 02 13:35:33.754941 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2197/4725] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:33 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:33.874335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bea9d79a-d2fb-426a-8e4f-79521fc60259 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7861efca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:33.983612 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bea9d79a-d2fb-426a-8e4f-79521fc60259 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.113139 Nov 02 13:35:33.993388 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2529/4726] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:33 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:34.754339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:34.755795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:34.764397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:34.765048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:34.768576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:34.769365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:34.770048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:34.771490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:34.773164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:34.773978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:34.781096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:34.781592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:34.782034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:34.782752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:34.785475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:34.785944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:34.998755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:35.011436 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a91a19d-6e37-4102-9ac5-8a0624c1ebbb tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.252581 Nov 02 13:35:35.012843 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2530/4727] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:34 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:35.018690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e69fcd2-a866-4f13-bc19-46544fdda782 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786298160>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:35.055596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:35.070004 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-faa0937d-56f1-41dc-8923-9a8f8da243c7 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1525 microversion: 2.1 time: 0.319641 Nov 02 13:35:35.081775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2198/4728] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:34 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1525 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:35.097639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:35.098517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:35.106577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:35.108166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:35.109178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:35.110215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:35.110910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:35.112094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:35.141900 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] HTTP exception thrown: Instance is not a member of specified network Nov 02 13:35:35.148257 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e69fcd2-a866-4f13-bc19-46544fdda782 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.133972 Nov 02 13:35:35.149321 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2531/4729] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:35 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Request method failure captured: Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f/ips/invalid HTTP/1.1 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnITzCutDC0SFqycVXVLisIqd4e8ZpcDl91lRjXcAr1IhH2R9WPmuz7EhMoOfvcFkpCIOUIA6AAUPEuW4TFdS-8WOQxN4fwXfLAqxARBv2BzEc9hn-XIUBjy4HK6fxPPp4h9EG2NomjpYpD6uXhc7r6zDKwgOYtrr-oELJhI32iaTXw Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2a21c1ac1702478d88530bda40420ba7 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-953784253 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-953784253 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2a21c1ac1702478d88530bda40420ba7 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-953784253 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerAddressesNegativeTestJSON-953784253-project Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: d6a5ce7d3f404128bf98a6a7aec9cd80 Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-953784253-project Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance is not a member of specified network Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': '71014514-432e-4c20-be59-075d18a70e6f', 'id': 'invalid'} Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Nov 02 13:35:35.151039 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:35.158948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:35:35.158948 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4706dca1-8d7a-43ca-903e-c0c63f9967be tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.059025 Nov 02 13:35:35.158948 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2199/4730] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 13:35:35 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f/ips/invalid => generated 91 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:35:35.176650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a05f8d2b-ead5-430e-aee9-73dc29589c1b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:35.177688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a05f8d2b-ead5-430e-aee9-73dc29589c1b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Failed to fetch instance by id 999 {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:35:35.178639 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-a05f8d2b-ead5-430e-aee9-73dc29589c1b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] HTTP exception thrown: Instance 999 could not be found. Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a05f8d2b-ead5-430e-aee9-73dc29589c1b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Request method failure captured: Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnITzCutDC0SFqycVXVLisIqd4e8ZpcDl91lRjXcAr1IhH2R9WPmuz7EhMoOfvcFkpCIOUIA6AAUPEuW4TFdS-8WOQxN4fwXfLAqxARBv2BzEc9hn-XIUBjy4HK6fxPPp4h9EG2NomjpYpD6uXhc7r6zDKwgOYtrr-oELJhI32iaTXw Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2a21c1ac1702478d88530bda40420ba7 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-953784253 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-953784253 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2a21c1ac1702478d88530bda40420ba7 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-953784253 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerAddressesNegativeTestJSON-953784253-project Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: d6a5ce7d3f404128bf98a6a7aec9cd80 Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-953784253-project Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 999 could not be found. Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'server_id': '999'} Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 13:35:35.181820 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:35.196815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a05f8d2b-ead5-430e-aee9-73dc29589c1b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:35:35.196815 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a05f8d2b-ead5-430e-aee9-73dc29589c1b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020283 Nov 02 13:35:35.203955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:35.204576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:35.208828 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2532/4731] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:35:35 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:35:35.212419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:35.213032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:35.213572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:35.214391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:35.214954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:35.215536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:35.253949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:35:35.355473 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f0a04f36-7f32-42a2-b73d-a8a07ae91bec tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "DELETE /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 204 len: 0 microversion: 2.1 time: 0.156211 Nov 02 13:35:35.359715 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2200/4732] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:35:35 2022] DELETE /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:35:35.366934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:35.367790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:35.376634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:35.377471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:35.378167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:35.379169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:35.379981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:35.380687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:35.587053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:35.604928 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89b80cb7-18a7-4b6f-874d-5b1215870375 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1531 microversion: 2.1 time: 0.243773 Nov 02 13:35:35.609725 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2533/4733] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:35 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1531 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:36.040593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:36.041947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:36.054936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:36.055755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:36.056372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:36.057269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:36.057888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:36.058503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:36.177270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee766c17-16c7-4d3f-a7cb-3e76ef6057fd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786298ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:36.246426 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee766c17-16c7-4d3f-a7cb-3e76ef6057fd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.073668 Nov 02 13:35:36.247516 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2534/4734] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:36 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:36.284489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:36.289080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:36.299212 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7b05b8dc-7784-4e8b-992a-18938149b4c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.262818 Nov 02 13:35:36.315993 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2201/4735] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:36 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:36.656306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:36.657275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:36.695805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:36.696951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:36.697593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:36.698525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:36.699682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:36.700746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:37.054653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:37.067558 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-812018ea-dfb0-4423-8015-4c6b354193ae tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1531 microversion: 2.1 time: 0.434111 Nov 02 13:35:37.083140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2535/4736] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:36 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1531 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:37.267068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-492401bd-cea2-47a4-8737-ac850437253e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786fd6940>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:37.330659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:37.333546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:37.352235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:37.352747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:37.353202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:37.353930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:37.354393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:37.361975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:37.363640 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-492401bd-cea2-47a4-8737-ac850437253e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.102572 Nov 02 13:35:37.364254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2202/4737] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:37 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:37.594107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:37.602774 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69bf221e-6a51-482e-b508-a6117b11e714 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1527 microversion: 2.1 time: 0.282435 Nov 02 13:35:37.603715 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2536/4738] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:37 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1527 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:38.098142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:38.099259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:38.118381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:38.119062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:38.121223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:38.122245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:38.127606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:38.129145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:38.197748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-53c658bb-0c6b-4241-a0ab-fad626068b96 req-565f834d-3da5-49c8-b5b6-ebe81f49960f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71014514-432e-4c20-be59-075d18a70e6f", "name": "network-vif-deleted", "tag": "83cb9e82-ad5f-441c-b8dc-cad558ae8ff4"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:38.247741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-53c658bb-0c6b-4241-a0ab-fad626068b96 req-565f834d-3da5-49c8-b5b6-ebe81f49960f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:38.258913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-53c658bb-0c6b-4241-a0ab-fad626068b96 req-565f834d-3da5-49c8-b5b6-ebe81f49960f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:38.263319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-53c658bb-0c6b-4241-a0ab-fad626068b96 req-565f834d-3da5-49c8-b5b6-ebe81f49960f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:38.329763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-53c658bb-0c6b-4241-a0ab-fad626068b96 req-565f834d-3da5-49c8-b5b6-ebe81f49960f service nova] Creating event network-vif-deleted:83cb9e82-ad5f-441c-b8dc-cad558ae8ff4 for instance 71014514-432e-4c20-be59-075d18a70e6f on n-h1-858384-19 Nov 02 13:35:38.348738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a5ce7d3f404128bf98a6a7aec9cd80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a21c1ac1702478d88530bda40420ba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:38.378304 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-53c658bb-0c6b-4241-a0ab-fad626068b96 req-565f834d-3da5-49c8-b5b6-ebe81f49960f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177161 Nov 02 13:35:38.384501 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2537/4739] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:38.390366 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a0576f0a-9dca-4fca-ac5b-8c085676b75b tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 200 len: 1489 microversion: 2.1 time: 0.299228 Nov 02 13:35:38.397063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-334cf1f0-cf9f-46d5-81ae-2aaf9e414854 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7862b0d30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:38.411584 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2203/4740] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:38 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 1489 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:38.485459 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-334cf1f0-cf9f-46d5-81ae-2aaf9e414854 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.098949 Nov 02 13:35:38.494604 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2538/4741] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:38 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:38.640740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:38.641437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:38.660072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:38.660874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:38.661560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:38.662516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:38.663259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:38.663920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:38.993269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:39.001886 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a75804e9-22db-4114-97af-a2fdabbe84be tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1507 microversion: 2.1 time: 0.368192 Nov 02 13:35:39.003027 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2204/4742] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:38 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:39.027954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:39.029053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:39.042253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:39.043171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:39.043874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:39.045439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:39.048747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:39.049572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:39.254953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:39.266251 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da52a6dd-c9cb-4873-94c8-d5638020121a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1520 microversion: 2.1 time: 0.242398 Nov 02 13:35:39.267508 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2539/4743] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:39 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:39.292194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b801a76-aac0-4af1-b35a-46a270c0d174 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:39.296005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b801a76-aac0-4af1-b35a-46a270c0d174 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: cb7fda55-581b-420f-aac3-130077a8d089] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:39.312270 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-5b801a76-aac0-4af1-b35a-46a270c0d174 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] HTTP exception thrown: Instance cb7fda55-581b-420f-aac3-130077a8d089 could not be found. Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b801a76-aac0-4af1-b35a-46a270c0d174 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Request method failure captured: Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/cb7fda55-581b-420f-aac3-130077a8d089/action HTTP/1.1 Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 14 Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnHi7jP3BREzNNxMlaHpTkHTAhpl4YuS15cqc7AF8LZUEXF-7lvm87GGJSejO1Ngp59zhuvznS7N8Hp-FmGbmJ1gJUTodwrnMGNso2bPIBMjI2J9vGT9OMBHmDkPSV1QxO58NX1-FPgIu3P9_ttyV5w2TDOTyKt4vpmdeDQUnv6oULM Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9758bd03bdc949d495c293221823196c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9758bd03bdc949d495c293221823196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 9485351c342740638c6a30b05cd0b162 Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: {"rescue": {}} Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance cb7fda55-581b-420f-aac3-130077a8d089 could not be found. Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'cb7fda55-581b-420f-aac3-130077a8d089', 'body': {'rescue': {}}} Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb7fda55-581b-420f-aac3-130077a8d089 could not be found. Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb7fda55-581b-420f-aac3-130077a8d089 could not be found. Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.325209 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:39.331309 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:39.331309 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:39.331309 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:35:39.331309 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:35:39.331309 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb7fda55-581b-420f-aac3-130077a8d089 could not be found. Nov 02 13:35:39.331309 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.331309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b801a76-aac0-4af1-b35a-46a270c0d174 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Returning 404 to user: Instance cb7fda55-581b-420f-aac3-130077a8d089 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:35:39.331309 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b801a76-aac0-4af1-b35a-46a270c0d174 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/cb7fda55-581b-420f-aac3-130077a8d089/action" status: 404 len: 111 microversion: 2.1 time: 0.041421 Nov 02 13:35:39.331309 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2205/4744] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:35:39 2022] POST /compute/v2.1/servers/cb7fda55-581b-420f-aac3-130077a8d089/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:35:39.340970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3315641d-d8ad-4b93-890c-8d2bce2b7941 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:39.343049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3315641d-d8ad-4b93-890c-8d2bce2b7941 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:39.350110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3315641d-d8ad-4b93-890c-8d2bce2b7941 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:39.351163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3315641d-d8ad-4b93-890c-8d2bce2b7941 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:39.351857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3315641d-d8ad-4b93-890c-8d2bce2b7941 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:39.352975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3315641d-d8ad-4b93-890c-8d2bce2b7941 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:39.353839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3315641d-d8ad-4b93-890c-8d2bce2b7941 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:39.354844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3315641d-d8ad-4b93-890c-8d2bce2b7941 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:39.426101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:39.428802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] [instance: 71014514-432e-4c20-be59-075d18a70e6f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:39.441059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:39.442484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:39.443128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:39.444702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:39.445939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:39.446546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:39.469340 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] HTTP exception thrown: Instance 71014514-432e-4c20-be59-075d18a70e6f could not be found. Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Request method failure captured: Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f HTTP/1.1 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnITzCutDC0SFqycVXVLisIqd4e8ZpcDl91lRjXcAr1IhH2R9WPmuz7EhMoOfvcFkpCIOUIA6AAUPEuW4TFdS-8WOQxN4fwXfLAqxARBv2BzEc9hn-XIUBjy4HK6fxPPp4h9EG2NomjpYpD6uXhc7r6zDKwgOYtrr-oELJhI32iaTXw Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2a21c1ac1702478d88530bda40420ba7 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-953784253 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2a21c1ac1702478d88530bda40420ba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-953784253 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2a21c1ac1702478d88530bda40420ba7 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-953784253 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerAddressesNegativeTestJSON-953784253-project Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: d6a5ce7d3f404128bf98a6a7aec9cd80 Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-953784253-project Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 71014514-432e-4c20-be59-075d18a70e6f could not be found. Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '71014514-432e-4c20-be59-075d18a70e6f'} Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71014514-432e-4c20-be59-075d18a70e6f could not be found. Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71014514-432e-4c20-be59-075d18a70e6f could not be found. Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.472434 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:39.477320 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.477320 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:39.477320 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:39.477320 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:39.477320 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:35:39.477320 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:35:39.477320 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71014514-432e-4c20-be59-075d18a70e6f could not be found. Nov 02 13:35:39.477320 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:39.478851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] Returning 404 to user: Instance 71014514-432e-4c20-be59-075d18a70e6f could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:35:39.480129 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d348717f-6b6e-4bac-8e47-c0d73d48bd00 tempest-ServerAddressesNegativeTestJSON-953784253 tempest-ServerAddressesNegativeTestJSON-953784253-project] 10.222.0.113 "GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f" status: 404 len: 111 microversion: 2.1 time: 0.058303 Nov 02 13:35:39.480889 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2206/4745] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:39 2022] GET /compute/v2.1/servers/71014514-432e-4c20-be59-075d18a70e6f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:35:39.500082 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3315641d-d8ad-4b93-890c-8d2bce2b7941 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action" status: 202 len: 0 microversion: 2.1 time: 0.164284 Nov 02 13:35:39.505983 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2540/4746] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:35:39 2022] POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:35:39.543668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:39.544827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:39.549977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1fd12dc9-0562-40c9-b0cd-157ce8c29b8c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786ff25e0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:39.558912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:39.560210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:39.561400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:39.562576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:39.563287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:39.563890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:39.652364 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1fd12dc9-0562-40c9-b0cd-157ce8c29b8c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1415 microversion: 2.1 time: 0.118272 Nov 02 13:35:39.661184 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2207/4747] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:39 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1415 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:39.914631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:39.937159 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ec170ddc-c2a5-4da6-895a-a197ac3a3273 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1525 microversion: 2.1 time: 0.405270 Nov 02 13:35:39.951188 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2541/4748] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:39 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1525 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:40.670112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b2244e1-6668-475a-8a10-6b0d81798173 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f888b80>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:40.736813 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b2244e1-6668-475a-8a10-6b0d81798173 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1424 microversion: 2.1 time: 0.071589 Nov 02 13:35:40.753869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4629d352-f602-413f-9359-875f60fa3f36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786130dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:40.759583 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2208/4749] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:40 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:40.814786 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4629d352-f602-413f-9359-875f60fa3f36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 200 len: 1424 microversion: 2.1 time: 0.064942 Nov 02 13:35:40.831822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94904ad3-77c0-48b1-81cf-2d6679b78e97 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786ff2310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:40.837158 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2542/4750] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:35:40 2022] GET /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 1424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:40.976540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:40.977168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:40.993102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:40.995172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:40.999218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.003835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:41.004671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:41.007170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.312209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:41.322284 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d099b7e1-8f57-4a7a-8d3d-ca9635dc0d0f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1505 microversion: 2.1 time: 0.351007 Nov 02 13:35:41.330009 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2543/4751] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:40 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:41.355745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:41.365052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:41.377486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:41.378875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:41.379544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.380661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:41.381430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:41.382262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.429903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lazy-loading 'flavor' on Instance uuid 30e23861-9b9f-4579-ba97-d9e3851ce40e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:35:41.448234 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] HTTP exception thrown: Cannot 'rescue' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state paused Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Request method failure captured: Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action HTTP/1.1 Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 14 Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHi7jP3BREzNNxMlaHpTkHTAhpl4YuS15cqc7AF8LZUEXF-7lvm87GGJSejO1Ngp59zhuvznS7N8Hp-FmGbmJ1gJUTodwrnMGNso2bPIBMjI2J9vGT9OMBHmDkPSV1QxO58NX1-FPgIu3P9_ttyV5w2TDOTyKt4vpmdeDQUnv6oULM Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9758bd03bdc949d495c293221823196c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9758bd03bdc949d495c293221823196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 9485351c342740638c6a30b05cd0b162 Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: {"rescue": {}} Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot 'rescue' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state paused Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '30e23861-9b9f-4579-ba97-d9e3851ce40e', 'body': {'rescue': {}}} Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30e23861-9b9f-4579-ba97-d9e3851ce40e in vm_state paused. Cannot rescue while the instance is in this state. Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state paused Nov 02 13:35:41.450871 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:41.455954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:41.455954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:41.455954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:41.455954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:41.455954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:41.455954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:35:41.455954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:35:41.455954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state paused Nov 02 13:35:41.455954 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:35:41.456763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Returning 409 to user: Cannot 'rescue' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state paused {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:35:41.458276 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fe5dec02-5fb2-422d-a88a-fc7ce48c5961 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action" status: 409 len: 144 microversion: 2.1 time: 0.106712 Nov 02 13:35:41.459364 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2544/4752] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:35:41 2022] POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action => generated 144 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:35:41.469566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cdeddd1d-1ab4-4b4a-9f8e-b65b39f4e3c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:41.470173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cdeddd1d-1ab4-4b4a-9f8e-b65b39f4e3c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:41.477624 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94904ad3-77c0-48b1-81cf-2d6679b78e97 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 204 len: 0 microversion: 2.1 time: 0.649542 Nov 02 13:35:41.478252 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2209/4753] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:40 2022] DELETE /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:35:41.487377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:41.487997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:41.492208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeddd1d-1ab4-4b4a-9f8e-b65b39f4e3c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:41.492719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeddd1d-1ab4-4b4a-9f8e-b65b39f4e3c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:41.493197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeddd1d-1ab4-4b4a-9f8e-b65b39f4e3c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.493924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeddd1d-1ab4-4b4a-9f8e-b65b39f4e3c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:41.494392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeddd1d-1ab4-4b4a-9f8e-b65b39f4e3c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:41.494861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cdeddd1d-1ab4-4b4a-9f8e-b65b39f4e3c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.501427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:41.505133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:41.505602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.506768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:41.507821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:41.508620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.582686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:35:41.689999 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cdeddd1d-1ab4-4b4a-9f8e-b65b39f4e3c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action" status: 202 len: 0 microversion: 2.1 time: 0.225597 Nov 02 13:35:41.695256 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2545/4754] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:35:41 2022] POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:35:41.702611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:41.704487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:41.712639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:41.714046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:41.714902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.715924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:41.717764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:41.718868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:41.817720 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66544f31-0056-4043-a870-a0330f2e17d3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 204 len: 0 microversion: 2.1 time: 0.334360 Nov 02 13:35:41.820969 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2210/4755] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:35:41 2022] DELETE /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:35:41.999919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-856943039", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "47bb2f77-f27b-4713-bfef-5f74b66d9d9d"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:42.149041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] validate_networks() for [('47bb2f77-f27b-4713-bfef-5f74b66d9d9d', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:35:42.268487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:42.277352 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69eb5c09-bfaf-4bc7-b55e-06a2a9fbbb7f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1512 microversion: 2.1 time: 0.580259 Nov 02 13:35:42.308325 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2546/4756] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:41 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1512 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:42.799764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:35:42.800401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:35:42.802754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:35:42.803375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:35:42.804238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:35:42.816831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:42.817690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:42.818309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:42.819695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:42.820338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:42.820921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:42.886880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:35:42.899723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for user be8bee2d23fa481193b5a23cf2348a73 and project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:35:42.934411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:35:42.943348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:35:43.096277 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-12918502-1bf2-4ca4-832f-7b5d071429b3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.101478 Nov 02 13:35:43.096958 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2211/4757] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:35:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:35:43.110079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d2684c60-7cf7-482a-9c33-a9462ac215de tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:43.112419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d2684c60-7cf7-482a-9c33-a9462ac215de tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:43.242940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d2684c60-7cf7-482a-9c33-a9462ac215de tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:43.272480 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d2684c60-7cf7-482a-9c33-a9462ac215de tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1211 microversion: 2.1 time: 0.167658 Nov 02 13:35:43.274093 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2547/4758] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:43 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1211 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:43.334340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:43.339313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:43.384425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:43.385610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:43.387787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:43.389444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:43.395099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:43.395849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:43.623652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6000ba32-40ef-455c-b679-ec5d0949a99d req-3cd9d09d-3e1c-4473-887c-7c458fe8e05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd242457-066d-4e86-abf9-57bf36514bcd", "name": "network-vif-unplugged", "status": "completed", "tag": "639d7e7f-258a-4287-b436-3767a87f3bc6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:43.646314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6000ba32-40ef-455c-b679-ec5d0949a99d req-3cd9d09d-3e1c-4473-887c-7c458fe8e05d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:43.653158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6000ba32-40ef-455c-b679-ec5d0949a99d req-3cd9d09d-3e1c-4473-887c-7c458fe8e05d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:43.653641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6000ba32-40ef-455c-b679-ec5d0949a99d req-3cd9d09d-3e1c-4473-887c-7c458fe8e05d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:43.681762 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6000ba32-40ef-455c-b679-ec5d0949a99d req-3cd9d09d-3e1c-4473-887c-7c458fe8e05d service nova] Creating event network-vif-unplugged:639d7e7f-258a-4287-b436-3767a87f3bc6 for instance dd242457-066d-4e86-abf9-57bf36514bcd on n-h1-858384-19 Nov 02 13:35:43.712825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6000ba32-40ef-455c-b679-ec5d0949a99d req-3cd9d09d-3e1c-4473-887c-7c458fe8e05d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093798 Nov 02 13:35:43.713442 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2548/4759] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:35:44.236882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:44.251972 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8edee608-4248-49c5-b32b-df6b7708518a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1520 microversion: 2.1 time: 0.931182 Nov 02 13:35:44.263920 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2212/4760] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:43 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1520 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:44.302885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:44.303763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:44.338070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:44.338790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:44.339607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:44.340488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:44.343073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:44.343843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:44.511352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:44.523900 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f0252c9a-6249-40e9-be54-46b83456591a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1263 microversion: 2.1 time: 0.223916 Nov 02 13:35:44.525277 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2549/4761] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:44 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1263 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:45.562882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:45.565149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:45.581377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:45.582402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:45.585674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:45.588434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:45.589102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:45.590575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:45.689336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:45.703391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-87bd23a1-4e68-45e3-91aa-57c58b82b5fe tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1269 microversion: 2.1 time: 0.144590 Nov 02 13:35:45.704052 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2213/4762] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:45 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1269 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:46.389382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1bacd921-c051-4f63-aa39-e1631416132c req-1ec7a18c-fe1c-425f-bba1-70e83661ff97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd242457-066d-4e86-abf9-57bf36514bcd", "name": "network-vif-deleted", "tag": "639d7e7f-258a-4287-b436-3767a87f3bc6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:46.434087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1bacd921-c051-4f63-aa39-e1631416132c req-1ec7a18c-fe1c-425f-bba1-70e83661ff97 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:46.439786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1bacd921-c051-4f63-aa39-e1631416132c req-1ec7a18c-fe1c-425f-bba1-70e83661ff97 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:46.440361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1bacd921-c051-4f63-aa39-e1631416132c req-1ec7a18c-fe1c-425f-bba1-70e83661ff97 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:46.457556 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1bacd921-c051-4f63-aa39-e1631416132c req-1ec7a18c-fe1c-425f-bba1-70e83661ff97 service nova] Creating event network-vif-deleted:639d7e7f-258a-4287-b436-3767a87f3bc6 for instance dd242457-066d-4e86-abf9-57bf36514bcd on n-h1-858384-19 Nov 02 13:35:46.468324 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1bacd921-c051-4f63-aa39-e1631416132c req-1ec7a18c-fe1c-425f-bba1-70e83661ff97 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083616 Nov 02 13:35:46.469557 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2550/4763] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:35:46.736629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:46.737891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:46.752340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:46.753029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:46.756847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:46.758156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:46.758788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:46.759583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:46.881199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:46.900096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b7affa0-97e8-4879-ba67-63d2c0eb9471 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1269 microversion: 2.1 time: 0.167798 Nov 02 13:35:46.900818 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2214/4764] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:46 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:47.036291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:47.039688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:47.056243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:47.056825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:47.058660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:47.062155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:47.064433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:47.065422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:47.135983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lazy-loading 'flavor' on Instance uuid 30e23861-9b9f-4579-ba97-d9e3851ce40e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:35:47.153067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:47.328323 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bae18adb-ea8a-4edb-b5b8-b7154c60f26e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action" status: 200 len: 32 microversion: 2.1 time: 0.296642 Nov 02 13:35:47.329188 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2551/4765] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:35:47 2022] POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action => generated 32 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:35:47.338675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:47.339496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:47.350822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:47.352593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:47.354891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:47.355940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:47.358983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:47.359912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:47.836067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:47.836067 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3e590c52-4fd0-4d36-abb8-5377631b943f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.499552 Nov 02 13:35:47.836067 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2215/4766] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:47 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:47.949815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:47.951884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:47.984384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:47.984878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:47.985318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:47.992559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:47.993057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:47.993746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:48.351561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:48.363591 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6d7f0501-0fb1-45e9-92f6-86f69cdffba5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1311 microversion: 2.1 time: 0.434422 Nov 02 13:35:48.364193 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2552/4767] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:47 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1311 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:48.859035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:48.859612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:48.878041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:48.878536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:48.878983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:48.879756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:48.880207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:48.880825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:49.133319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:49.145402 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2d90901c-8db8-4951-bcf9-0eab1d5a90ef tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.290737 Nov 02 13:35:49.145997 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2216/4768] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:48 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:49.331556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47aa16c2-87e7-4158-9ffd-b537ae7b9d06", "tag": "3ede940d-da9c-4ba7-a37c-85ac3fe55cdf"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:49.355190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:49.359631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:49.364428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:49.386602 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] Creating event network-changed:3ede940d-da9c-4ba7-a37c-85ac3fe55cdf for instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 on n-h2-858384-19 Nov 02 13:35:49.394127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:49.395037 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071009 Nov 02 13:35:49.395901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:49.397404 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2553/4769] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:49.413221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:49.413980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:49.414584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:49.415765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:49.416987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:49.416987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:49.584206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:49.585442 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] 10.222.0.113 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001632 Nov 02 13:35:49.585983 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2554/4770] 10.222.0.113 () {56 vars in 891 bytes} [Wed Nov 2 13:35:49 2022] GET /compute/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 13:35:49.594791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:49.601466 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] 10.222.0.113 "GET /compute/v2/" status: 200 len: 380 microversion: 2.1 time: 0.001654 Nov 02 13:35:49.608898 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2555/4771] 10.222.0.113 () {54 vars in 1040 bytes} [Wed Nov 2 13:35:49 2022] GET /compute/v2/ => generated 380 bytes in 15 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Nov 02 13:35:49.610495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:49.611850 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] 10.222.0.113 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001643 Nov 02 13:35:49.612470 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2556/4772] 10.222.0.113 () {54 vars in 1046 bytes} [Wed Nov 2 13:35:49 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:49.621416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:49.622661 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0093f1cf-903f-4935-81a1-7aaa18418bed req-15c748fe-6096-4da0-8c35-1dd26713277b service nova] 10.222.0.113 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001412 Nov 02 13:35:49.623340 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2557/4773] 10.222.0.113 () {56 vars in 891 bytes} [Wed Nov 2 13:35:49 2022] GET /compute/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 13:35:49.749941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:49.783014 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-594f2832-9e59-471e-8a57-071cb76f0ff4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1311 microversion: 2.1 time: 0.398579 Nov 02 13:35:49.800035 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2217/4774] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:49 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1311 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:50.173711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:50.174695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:50.182819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:50.183662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:50.184959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:50.188240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:50.189322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:50.190868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:50.405776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:50.414273 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bc33242d-80c5-4766-ac4d-dc5c6c9319df tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.248589 Nov 02 13:35:50.419156 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2558/4775] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:50 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:50.816017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:50.816951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:50.824197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:50.824917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:50.827312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:50.828411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:50.829088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:50.829755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:51.009796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:51.022440 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c905e0fb-7928-405b-8e40-f0b941b2b749 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1311 microversion: 2.1 time: 0.210555 Nov 02 13:35:51.037792 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2218/4776] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:50 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1311 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:51.452410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:51.453778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:51.462482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:51.463346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:51.464079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:51.464968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:51.465575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:51.466316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:51.580715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f087b866-0fb0-4493-906d-0fd1bc91fc6b tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Action: 'create', calling method: .version_select at 0x7fe78791d040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1533012471", "metadata": {"Type": "work"}}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:51.661713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:51.677602 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16cac5e7-3d67-4077-bcf4-a55adc66e801 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.239861 Nov 02 13:35:51.678524 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2559/4777] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:51 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:51.981038 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f087b866-0fb0-4493-906d-0fd1bc91fc6b tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.535905 Nov 02 13:35:51.982687 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2219/4778] 10.222.0.113 () {60 vars in 1161 bytes} [Wed Nov 2 13:35:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 538 msecs (HTTP/1.1 200) 10 headers in 449 bytes (2 switches on core 0) Nov 02 13:35:51.996266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa7de595-b7ac-4bd9-ace0-5ebd8bd4a5a8 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Calling method '.version_select at 0x7fe786a78310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:52.054915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:52.062033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:52.071321 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fa7de595-b7ac-4bd9-ace0-5ebd8bd4a5a8 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04" status: 200 len: 353 microversion: 2.1 time: 0.078753 Nov 02 13:35:52.072273 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2560/4779] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:35:51 2022] GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:35:52.084949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:52.085904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:52.086550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:52.087870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:52.088472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:52.089225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:52.262622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:52.271319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cfa3ee2d-5fb4-4996-b290-d11995d62b44 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1311 microversion: 2.1 time: 0.227799 Nov 02 13:35:52.275542 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2220/4780] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:52 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1311 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:52.706549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:52.707316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:52.709457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=70 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:52.733611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:52.734113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:52.734753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:52.736091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:52.736714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:52.737342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:53.024810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:53.034945 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a302720f-685c-4adc-baa1-289dfb17b817 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.333468 Nov 02 13:35:53.039012 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2561/4781] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:52 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:53.086338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:53.086924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:53.092597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a7d65267-54cd-488f-b756-0a469a68e894 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Calling method '.version_select at 0x7fe786922940>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:53.203661 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a7d65267-54cd-488f-b756-0a469a68e894 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04" status: 200 len: 353 microversion: 2.1 time: 0.119080 Nov 02 13:35:53.205338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2221/4782] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:35:53 2022] GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:35:53.300751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:53.301566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:53.311544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:53.314378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:53.315504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:53.316475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:53.317394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:53.318039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:53.318733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:53.512350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:53.521533 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06463c8d-e8c5-4056-9d5e-9e7c38ef5a89 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1311 microversion: 2.1 time: 0.227346 Nov 02 13:35:53.522777 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2562/4783] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:53 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1311 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:54.064095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:54.065081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:54.077575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:54.078513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:54.079263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:54.080422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:54.081043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:54.081634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:54.221575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4fa5319b-6e05-43ee-9b95-aae93fec252b tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Calling method '.version_select at 0x7fe786a780d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:54.313645 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4fa5319b-6e05-43ee-9b95-aae93fec252b tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04" status: 200 len: 354 microversion: 2.1 time: 0.097646 Nov 02 13:35:54.314242 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2563/4784] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:35:54 2022] GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:35:54.328925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-14330919-641b-43d5-9963-f1ca9275a0c5 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Calling method '.version_select at 0x7fe786c78310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:54.366104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:54.388471 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-14330919-641b-43d5-9963-f1ca9275a0c5 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04" status: 200 len: 354 microversion: 2.1 time: 0.064314 Nov 02 13:35:54.388837 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2564/4785] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:35:54 2022] GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:35:54.393231 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d7a6ba9-d576-4c79-bddc-5b018dd8d7fa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.333959 Nov 02 13:35:54.393930 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2222/4786] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:54 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:54.405847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-312803c2-2f2a-44f9-8f19-80614e042118 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Calling method '.version_select at 0x7fe786c784c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:54.501224 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-312803c2-2f2a-44f9-8f19-80614e042118 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04" status: 202 len: 0 microversion: 2.1 time: 0.101535 Nov 02 13:35:54.508273 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2565/4787] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:35:54 2022] DELETE /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:35:54.516713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-248e8068-7090-4653-afa5-e444849dd462 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Calling method '.version_select at 0x7fe78f888e50>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:54.546256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:54.547146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:54.556866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:54.558833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:54.563874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:54.564939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:54.565718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:54.566324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:54.648037 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-248e8068-7090-4653-afa5-e444849dd462 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04" status: 200 len: 353 microversion: 2.1 time: 0.135673 Nov 02 13:35:54.648806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2223/4788] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:35:54 2022] GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:54.814613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:54.823421 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e9164ab-bdd2-418f-990f-46e39837916b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1311 microversion: 2.1 time: 0.281962 Nov 02 13:35:54.824252 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2566/4789] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:54 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1311 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:55.423142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:55.424483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:55.426621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:55.433930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:55.434473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:55.435229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:55.436182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:55.436852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:55.437479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:55.668030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c411d8f1-7e8a-4f69-b64b-fb0535dcb0e0 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Calling method '.version_select at 0x7fe786c78670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:55.750367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c411d8f1-7e8a-4f69-b64b-fb0535dcb0e0 tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04" status: 200 len: 353 microversion: 2.1 time: 0.086543 Nov 02 13:35:55.751628 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2567/4790] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:35:55 2022] GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:55.859003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:55.860113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:55.867897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:55.868610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:55.869226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:55.870269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:55.870883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:55.871502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:56.111518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:56.121943 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-947f2998-bb97-47f1-bbdf-5d7cfa3fdc5b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1311 microversion: 2.1 time: 0.267816 Nov 02 13:35:56.123132 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2568/4791] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:55 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1311 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:56.142542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-bd55b0a1-432c-4fac-ac67-fb8a676570a9 req-65e1e108-0929-4e0a-b5d1-783e26a8946c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aa16c2-87e7-4158-9ffd-b537ae7b9d06", "name": "network-vif-plugged", "status": "completed", "tag": "3ede940d-da9c-4ba7-a37c-85ac3fe55cdf"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:56.154864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bd55b0a1-432c-4fac-ac67-fb8a676570a9 req-65e1e108-0929-4e0a-b5d1-783e26a8946c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:56.156011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bd55b0a1-432c-4fac-ac67-fb8a676570a9 req-65e1e108-0929-4e0a-b5d1-783e26a8946c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:56.156780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bd55b0a1-432c-4fac-ac67-fb8a676570a9 req-65e1e108-0929-4e0a-b5d1-783e26a8946c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:56.196125 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-bd55b0a1-432c-4fac-ac67-fb8a676570a9 req-65e1e108-0929-4e0a-b5d1-783e26a8946c service nova] Creating event network-vif-plugged:3ede940d-da9c-4ba7-a37c-85ac3fe55cdf for instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 on n-h2-858384-19 Nov 02 13:35:56.206182 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-bd55b0a1-432c-4fac-ac67-fb8a676570a9 req-65e1e108-0929-4e0a-b5d1-783e26a8946c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081330 Nov 02 13:35:56.209799 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2569/4792] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:56.264651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:56.284293 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ab1e7b75-a050-49be-9ea9-50192951530a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.867784 Nov 02 13:35:56.284892 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2224/4793] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:55 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:56.767951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d1c1607-e436-421d-9357-78a24d12cccf tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Calling method '.version_select at 0x7fe7861ef0d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:56.827758 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d1c1607-e436-421d-9357-78a24d12cccf tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04" status: 200 len: 353 microversion: 2.1 time: 0.066005 Nov 02 13:35:56.828582 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2570/4794] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:35:56 2022] GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:35:57.146338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:57.147528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:57.157048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:57.157877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:57.158594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:57.159509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:57.160216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:57.160797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:57.309124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:57.309377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:57.311079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:57.318500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:57.318865 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ba3666b-4fd2-4cc7-82de-47a627fcbf3b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1311 microversion: 2.1 time: 0.177662 Nov 02 13:35:57.331195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:57.331790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:57.331918 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2225/4795] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:57 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1311 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:57.332742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:57.333305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:57.333837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:57.492537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:57.502045 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3d4c71fa-0d3b-484c-8273-c7d614e3b286 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.197250 Nov 02 13:35:57.503280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2571/4796] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:57 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:35:57.843371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-405f3991-ffa2-4ef3-b505-ece3c8f5d20b tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Calling method '.version_select at 0x7fe78f888e50>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:57.881615 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-405f3991-ffa2-4ef3-b505-ece3c8f5d20b tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] HTTP exception thrown: Volume 7bf45ea3-fa75-4b18-9435-e62e7951ba04 could not be found. Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-405f3991-ffa2-4ef3-b505-ece3c8f5d20b tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Request method failure captured: Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 HTTP/1.1 Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnI3spJa55VD6qLhpGyrPiA-92POkW10BlS5hAe0tgcMGH_IU2qbJLiOg3WahwVvIKo6Lf-l6WS1COBww_rTHftAlCULTTpeHorGGUw96Xujv8Lg6D-hDfdYoEWyQpKeiJ6ONNnVsjZO2RV1PSwYyn_MWNxq4DO6nCVBJD4LVkoBxRo Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: a05b05e12bd041e5af4a8c5b8cbbfc4b Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesGetTestJSON-857196458 Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a05b05e12bd041e5af4a8c5b8cbbfc4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a05b05e12bd041e5af4a8c5b8cbbfc4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a05b05e12bd041e5af4a8c5b8cbbfc4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a05b05e12bd041e5af4a8c5b8cbbfc4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesGetTestJSON-857196458 Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: a05b05e12bd041e5af4a8c5b8cbbfc4b Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesGetTestJSON-857196458 Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesGetTestJSON-857196458-project Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 50f1ac6eb59444c1a59895a3f60bd73a Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesGetTestJSON-857196458-project Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: exception: Volume 7bf45ea3-fa75-4b18-9435-e62e7951ba04 could not be found. Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7bf45ea3-fa75-4b18-9435-e62e7951ba04'} Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7bf45ea3-fa75-4b18-9435-e62e7951ba04 could not be found. (HTTP 404) (Request-ID: req-d05bfd8d-a6a9-4023-93d3-dea682baf615) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:35:57.886426 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7bf45ea3-fa75-4b18-9435-e62e7951ba04 could not be found. Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7bf45ea3-fa75-4b18-9435-e62e7951ba04 could not be found. Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7bf45ea3-fa75-4b18-9435-e62e7951ba04 could not be found. Nov 02 13:35:57.891297 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:35:57.899857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-405f3991-ffa2-4ef3-b505-ece3c8f5d20b tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] Returning 404 to user: Volume 7bf45ea3-fa75-4b18-9435-e62e7951ba04 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:35:57.902163 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-405f3991-ffa2-4ef3-b505-ece3c8f5d20b tempest-VolumesGetTestJSON-857196458 tempest-VolumesGetTestJSON-857196458-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04" status: 404 len: 109 microversion: 2.1 time: 0.063451 Nov 02 13:35:57.902923 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2226/4797] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:35:57 2022] GET /compute/v2.1/os-volumes/7bf45ea3-fa75-4b18-9435-e62e7951ba04 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:35:58.343439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:58.344072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:58.361219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:58.361728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:58.362190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:58.362901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:58.363404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:58.363846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:58.540107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:58.541388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:58.567907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:58.568421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:58.568868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:58.569598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:58.570057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:58.576930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:58.585217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:35:58.629648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:58.640472 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c78a6495-f5a5-4f34-a731-123b8b41d097 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1492 microversion: 2.1 time: 0.302047 Nov 02 13:35:58.656976 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2572/4798] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:58 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1492 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:58.670440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:35:58.671364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:58.678063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:58.678860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:58.679615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:58.680709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:58.681503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:58.682168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:58.714491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lazy-loading 'flavor' on Instance uuid 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:35:58.819017 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90b1fefe-1578-45f4-8bbf-fe75687160d8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06/action" status: 202 len: 0 microversion: 2.1 time: 0.152889 Nov 02 13:35:58.821904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2573/4799] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:35:58 2022] POST /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:35:58.831180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:58.832098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:58.838562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:58.839152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:58.839521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:58.840237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:58.840695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:58.841670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:58.857974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:58.869216 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bd76c18c-9684-4455-a1eb-48b723c25ddf tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.347155 Nov 02 13:35:58.871441 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2227/4800] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:58 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:59.027808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:35:59.040951 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-703171c1-e363-4288-88be-55bd50b67192 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1500 microversion: 2.1 time: 0.214388 Nov 02 13:35:59.042250 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2574/4801] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:58 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1500 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:35:59.896059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:35:59.896598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:35:59.903420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:59.904116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:59.904764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:35:59.905488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:35:59.906070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:35:59.906606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:00.057937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:00.070009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:00.070650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:00.085450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:00.085733 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3d6fef8f-4299-4125-b332-118f3ffc52b7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.193375 Nov 02 13:36:00.087487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:00.087739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:00.088463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:00.088877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:00.089396 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2228/4802] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:35:59 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:00.090028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:00.305012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:00.315662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45f18723-81fa-4cfd-8351-998b5f107607 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 200 len: 1483 microversion: 2.1 time: 0.251477 Nov 02 13:36:00.317506 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2575/4803] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:00 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 1483 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:00.338398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-422686ca-4d7a-4e2e-abc2-35612c1a6a90 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1138150799"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:00.341652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-422686ca-4d7a-4e2e-abc2-35612c1a6a90 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:00.348002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-422686ca-4d7a-4e2e-abc2-35612c1a6a90 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:00.348675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-422686ca-4d7a-4e2e-abc2-35612c1a6a90 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:00.349556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-422686ca-4d7a-4e2e-abc2-35612c1a6a90 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:00.350429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-422686ca-4d7a-4e2e-abc2-35612c1a6a90 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:00.351041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-422686ca-4d7a-4e2e-abc2-35612c1a6a90 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:00.351707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-422686ca-4d7a-4e2e-abc2-35612c1a6a90 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:00.621254 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-422686ca-4d7a-4e2e-abc2-35612c1a6a90 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06/action" status: 202 len: 0 microversion: 2.1 time: 0.286501 Nov 02 13:36:00.623717 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2229/4804] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:36:00 2022] POST /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:36:00.641550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93686843-02bc-4a38-bc32-f1f98976f984 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7862cbdc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:00.715014 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93686843-02bc-4a38-bc32-f1f98976f984 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.084977 Nov 02 13:36:00.719213 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2576/4805] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:00 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:01.110176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:01.110880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:01.118376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:01.119391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:01.120009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:01.120889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:01.121347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:01.122483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:01.311447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:01.319519 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2d62a130-0d62-4306-953f-3c8dec961454 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.213473 Nov 02 13:36:01.331135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2230/4806] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:01 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:01.737154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6294b17-16a4-4d2a-a506-7fdfd41f3602 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786c78310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:01.823886 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c6294b17-16a4-4d2a-a506-7fdfd41f3602 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.096314 Nov 02 13:36:01.827147 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2577/4807] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:01 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:02.349247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:02.349700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:02.376648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:02.377369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:02.377987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:02.378970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:02.379667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:02.380394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:02.596915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:02.605085 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-11c79dae-86a1-4eb1-b654-f367a80588d7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1506 microversion: 2.1 time: 0.264319 Nov 02 13:36:02.607795 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2231/4808] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:02 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:02.628947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e316f051-ec65-4994-8f43-e3f28cdb7f0a"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:02.637449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:02.645642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:02.646108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:02.646656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:02.647593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:02.648719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:02.649246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:02.672944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:02.693287 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] HTTP exception thrown: Cannot 'attach_volume' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state rescued Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Request method failure captured: Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/os-volume_attachments HTTP/1.1 Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 74 Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHi7jP3BREzNNxMlaHpTkHTAhpl4YuS15cqc7AF8LZUEXF-7lvm87GGJSejO1Ngp59zhuvznS7N8Hp-FmGbmJ1gJUTodwrnMGNso2bPIBMjI2J9vGT9OMBHmDkPSV1QxO58NX1-FPgIu3P9_ttyV5w2TDOTyKt4vpmdeDQUnv6oULM Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9758bd03bdc949d495c293221823196c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9758bd03bdc949d495c293221823196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 9485351c342740638c6a30b05cd0b162 Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: {"volumeAttachment": {"volumeId": "e316f051-ec65-4994-8f43-e3f28cdb7f0a"}} Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot 'attach_volume' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state rescued Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'server_id': '30e23861-9b9f-4579-ba97-d9e3851ce40e', 'body': {'volumeAttachment': {'volumeId': 'e316f051-ec65-4994-8f43-e3f28cdb7f0a'}}} Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30e23861-9b9f-4579-ba97-d9e3851ce40e in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 13:36:02.696229 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state rescued Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state rescued Nov 02 13:36:02.702277 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:36:02.704162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Returning 409 to user: Cannot 'attach_volume' instance 30e23861-9b9f-4579-ba97-d9e3851ce40e while it is in vm_state rescued {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:36:02.705345 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4877ab23-7db6-47fe-bab3-b8ad108588a1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.080606 Nov 02 13:36:02.706662 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2578/4809] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:36:02 2022] POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:36:02.714942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40ca44cb-f35a-4955-8bc4-28202f3bed5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:02.715516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40ca44cb-f35a-4955-8bc4-28202f3bed5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:02.725174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40ca44cb-f35a-4955-8bc4-28202f3bed5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:02.725852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40ca44cb-f35a-4955-8bc4-28202f3bed5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:02.726708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40ca44cb-f35a-4955-8bc4-28202f3bed5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:02.727872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40ca44cb-f35a-4955-8bc4-28202f3bed5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:02.728436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40ca44cb-f35a-4955-8bc4-28202f3bed5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:02.729189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40ca44cb-f35a-4955-8bc4-28202f3bed5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:02.826532 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40ca44cb-f35a-4955-8bc4-28202f3bed5e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action" status: 202 len: 0 microversion: 2.1 time: 0.113935 Nov 02 13:36:02.830391 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2232/4810] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:36:02 2022] POST /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:36:02.841040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:02.841909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:02.843811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d8e629ef-815d-47ce-896c-e7ce7aaa9942 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786922280>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:02.870678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:02.872799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:02.873486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:02.874791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:02.875635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:02.878114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:02.913822 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d8e629ef-815d-47ce-896c-e7ce7aaa9942 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.073364 Nov 02 13:36:02.915024 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2233/4811] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:02 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:03.117133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:03.127990 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2546c3ba-19da-40da-a07f-aa3a647ed7b4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1514 microversion: 2.1 time: 0.295913 Nov 02 13:36:03.128594 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2579/4812] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:02 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:03.952654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-139f9e6f-faa5-4fce-9ad7-746a63ec0fa4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78683bc10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:04.018075 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-139f9e6f-faa5-4fce-9ad7-746a63ec0fa4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.087246 Nov 02 13:36:04.018681 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2234/4813] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:03 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:04.151788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:04.152558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:04.160922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:04.161848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:04.162611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:04.163531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:04.164147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:04.164742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:04.352814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:04.362352 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e12f7b36-28fb-45ac-aa56-09994688b5a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1514 microversion: 2.1 time: 0.214535 Nov 02 13:36:04.367540 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2580/4814] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:04 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:05.036529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9881569c-d48d-4508-a5a3-0d8f6ea5d740 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78684be50>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:05.092959 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9881569c-d48d-4508-a5a3-0d8f6ea5d740 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.062172 Nov 02 13:36:05.093576 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2235/4815] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:05 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:05.388934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:05.389578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:05.396051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:05.396741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:05.397361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:05.398224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:05.398704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:05.399318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:05.555836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:05.568370 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3aadd750-edff-48ce-81e6-ed85d1a903e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1514 microversion: 2.1 time: 0.184250 Nov 02 13:36:05.569102 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2581/4816] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:05 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:05.866825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-fd9e8fa6-46c0-452d-829a-24b60b572c12 req-fde84081-2e16-45e2-95dc-d2c5bb068ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aa16c2-87e7-4158-9ffd-b537ae7b9d06", "name": "network-vif-plugged", "status": "completed", "tag": "3ede940d-da9c-4ba7-a37c-85ac3fe55cdf"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:05.884940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fd9e8fa6-46c0-452d-829a-24b60b572c12 req-fde84081-2e16-45e2-95dc-d2c5bb068ad2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:05.885519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fd9e8fa6-46c0-452d-829a-24b60b572c12 req-fde84081-2e16-45e2-95dc-d2c5bb068ad2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:05.885835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fd9e8fa6-46c0-452d-829a-24b60b572c12 req-fde84081-2e16-45e2-95dc-d2c5bb068ad2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:05.921357 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-fd9e8fa6-46c0-452d-829a-24b60b572c12 req-fde84081-2e16-45e2-95dc-d2c5bb068ad2 service nova] Creating event network-vif-plugged:3ede940d-da9c-4ba7-a37c-85ac3fe55cdf for instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 on n-h2-858384-19 Nov 02 13:36:05.930060 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-fd9e8fa6-46c0-452d-829a-24b60b572c12 req-fde84081-2e16-45e2-95dc-d2c5bb068ad2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067008 Nov 02 13:36:05.930990 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2236/4817] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:06.111311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5cd94384-1105-410d-9e78-fc246cf40960 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786006ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:06.167624 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5cd94384-1105-410d-9e78-fc246cf40960 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.060565 Nov 02 13:36:06.177865 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2582/4818] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:06 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:06.592975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:06.594379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:06.602891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:06.603580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:06.604352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:06.605311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:06.606565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:06.607413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:06.839079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:06.848372 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da995cb0-9ed6-406e-b727-c9f60da0f179 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1520 microversion: 2.1 time: 0.259372 Nov 02 13:36:06.849442 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2237/4819] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:06 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:07.187984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9395855c-c4fa-40e3-bdef-a72bdf39504e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786a781f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:07.270498 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9395855c-c4fa-40e3-bdef-a72bdf39504e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.089558 Nov 02 13:36:07.279924 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2583/4820] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:07 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:08.290400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5917b08f-3e1a-4464-9730-cf3e8c03ff33 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786fd61f0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:08.393328 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5917b08f-3e1a-4464-9730-cf3e8c03ff33 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.108628 Nov 02 13:36:08.404292 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2238/4821] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:08 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:09.420335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e71e8038-3de1-4097-8b75-9b3a749b8044 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786314940>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:09.501966 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e71e8038-3de1-4097-8b75-9b3a749b8044 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.094707 Nov 02 13:36:09.503020 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2584/4822] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:09 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:09.525544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-55620cb3-7412-4590-a40b-88530cb1babc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'create', calling method: .version_select at 0x7fe786922160>, body: {"keypair": {"name": "tempest-keypair-1666140159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPSHlso3GhH9nJ0I+hwjMKc3xH18L4s/lV8zeDMFvlNY6Y9yr0Zt7CnxEj5gwRsB+aOuaCtUjogBi0NoWgJDvNgWnfap/5ER7FjnOFUelQ5G1Ln93q+VeZ8XdvCqtjpdA=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:09.596248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-55620cb3-7412-4590-a40b-88530cb1babc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Getting quotas for project 9758bd03bdc949d495c293221823196c. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:36:09.609823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-55620cb3-7412-4590-a40b-88530cb1babc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Getting quotas for user 9485351c342740638c6a30b05cd0b162 and project 9758bd03bdc949d495c293221823196c. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:36:09.663281 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-55620cb3-7412-4590-a40b-88530cb1babc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141922 Nov 02 13:36:09.664679 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2239/4823] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:36:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:10.520322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-24034ac8-532b-4f99-97d9-41e98b7a6bff tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7861308b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:10.603339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-24034ac8-532b-4f99-97d9-41e98b7a6bff tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.088442 Nov 02 13:36:10.604940 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2585/4824] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:10 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:11.620327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-78204858-920c-4f11-95e8-274022da5f07 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786922670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:11.720349 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-78204858-920c-4f11-95e8-274022da5f07 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.104130 Nov 02 13:36:11.721098 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2240/4825] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:11 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:12.383626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-901143881", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbdb2ec4-00fc-4cf0-b85a-b4db9563a6b5"}], "security_groups": [{"name": "tempest-securitygroup--584910010"}], "key_name": "tempest-keypair-1666140159", "user_data": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:12.587694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] validate_networks() for [('dbdb2ec4-00fc-4cf0-b85a-b4db9563a6b5', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:36:12.742187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b69ba50e-114d-4d5d-b5b6-e39b5de5362d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78fa30430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:12.837662 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b69ba50e-114d-4d5d-b5b6-e39b5de5362d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.102455 Nov 02 13:36:12.859488 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2241/4826] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:12 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:13.567946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:36:13.568480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:36:13.568862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:36:13.569438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:36:13.570040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:36:13.584251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:13.584761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:13.585209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:13.585963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:13.586431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:13.586867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:13.626741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Getting quotas for project 9758bd03bdc949d495c293221823196c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:36:13.634552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Getting quotas for user 9485351c342740638c6a30b05cd0b162 and project 9758bd03bdc949d495c293221823196c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:36:13.651023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:36:13.655422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:36:13.751316 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1b4fd2d-4e24-4ba2-9562-505589879ddd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.373512 Nov 02 13:36:13.754683 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2586/4827] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:36:12 2022] POST /compute/v2.1/servers => generated 410 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:36:13.768120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-143b35c5-7b63-4f36-bd1b-c8a4438bb2d5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:13.768738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-143b35c5-7b63-4f36-bd1b-c8a4438bb2d5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:13.866418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90efabbc-6d0f-43c0-9fa1-c071d6ceb70b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786a16700>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:13.885979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-143b35c5-7b63-4f36-bd1b-c8a4438bb2d5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:13.913319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-143b35c5-7b63-4f36-bd1b-c8a4438bb2d5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1249 microversion: 2.1 time: 0.150913 Nov 02 13:36:13.914199 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2242/4828] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:13 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1249 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:13.936245 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90efabbc-6d0f-43c0-9fa1-c071d6ceb70b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1443 microversion: 2.1 time: 0.080672 Nov 02 13:36:13.946535 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2587/4829] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:13 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:14.946394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:14.947029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:14.955015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-028a2c27-f07e-4dc2-ad31-6246939324e9 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f908f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:14.972733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:14.979792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:14.980454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:14.983525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:14.985226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:14.985910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:15.163414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:15.188283 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ffa731d8-f8de-4fa3-87f1-99f891f2faf9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1245 microversion: 2.1 time: 0.250031 Nov 02 13:36:15.190047 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2243/4830] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:14 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1245 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:16.216426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:16.218039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:16.230147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:16.232560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:16.233382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:16.235133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:16.235871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:16.236624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:16.376179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:16.390856 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a712e204-cd19-46ee-9376-e64b4020795a tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1307 microversion: 2.1 time: 0.180423 Nov 02 13:36:16.393919 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2244/4831] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:16 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:17.422203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:17.422878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:17.445216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:17.445727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:17.447905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:17.451207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:17.451803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:17.454596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:17.820747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:17.837256 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-41a9d1c3-4e19-4b4d-95eb-357221b5ef87 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.423602 Nov 02 13:36:17.838329 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2245/4832] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:17 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:18.866943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:18.868452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:18.891418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:18.893010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:18.894219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:18.894968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:18.899336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:18.899846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:19.498191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:19.516333 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-050c1cc9-c8bd-4e75-b88f-1610be638320 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.654119 Nov 02 13:36:19.517281 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2246/4833] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:18 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:19.529601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-751d78de-9691-4f50-b3f0-5e1d8b65096c req-ea322ef9-fa96-455f-ac4b-1187b6705763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c00a03-1b4e-490c-814c-84c520dbab62", "tag": "80ac27ba-28f7-4264-a76a-90fa9b06560a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:19.585745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-751d78de-9691-4f50-b3f0-5e1d8b65096c req-ea322ef9-fa96-455f-ac4b-1187b6705763 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:19.588103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-751d78de-9691-4f50-b3f0-5e1d8b65096c req-ea322ef9-fa96-455f-ac4b-1187b6705763 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:19.588738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-751d78de-9691-4f50-b3f0-5e1d8b65096c req-ea322ef9-fa96-455f-ac4b-1187b6705763 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:19.646206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-751d78de-9691-4f50-b3f0-5e1d8b65096c req-ea322ef9-fa96-455f-ac4b-1187b6705763 service nova] Creating event network-changed:80ac27ba-28f7-4264-a76a-90fa9b06560a for instance 16c00a03-1b4e-490c-814c-84c520dbab62 on n-h1-858384-19 Nov 02 13:36:19.662719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-751d78de-9691-4f50-b3f0-5e1d8b65096c req-ea322ef9-fa96-455f-ac4b-1187b6705763 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142320 Nov 02 13:36:19.666590 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2247/4834] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:20.542510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:20.544394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:20.560724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:20.566698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:20.566698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:20.566698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:20.569425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:20.569951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:20.876846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:20.888310 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-44d8acb5-97f3-48e3-bd0f-0e5f8b1bb48e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.348779 Nov 02 13:36:20.889465 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2248/4835] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:20 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:21.921193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:21.921795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:21.935884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:21.936411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:21.936821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:21.937645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:21.938269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:21.939141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:22.183261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:22.203176 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a822eb6f-cdb6-4539-8ac0-02ab85e4eff7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.285368 Nov 02 13:36:22.204095 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2249/4836] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:21 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:23.227657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:23.229084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:23.251241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:23.254958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:23.255432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:23.256171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:23.256633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:23.257068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:23.612583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:23.614166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=21 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:23.647692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:23.696462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:23.913091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:23.941086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:23.944833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:23.956983 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e6f9936-c166-4c4d-a76e-3520f6d3cf56 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.732630 Nov 02 13:36:23.958441 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2250/4837] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:23 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:24.982356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:24.984087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:25.005258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:25.007073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:25.007789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:25.011595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:25.013048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:25.025882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:25.377410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:25.388247 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04accdf7-1a43-4416-b59c-43fd4cc0be34 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.411359 Nov 02 13:36:25.389323 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2251/4838] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:24 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:25.897697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:25.898210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:25.900254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:25.922413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:25.922413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:25.922413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:25.922994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:25.923475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:25.923910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:25.978788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:36:26.129073 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ae3ee80a-d373-4730-b486-334aec5bd1b8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "DELETE /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 204 len: 0 microversion: 2.32 time: 0.737951 Nov 02 13:36:26.130908 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2252/4839] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:36:25 2022] DELETE /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 0 bytes in 741 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:36:26.143575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:26.145659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:26.153425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:26.154291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:26.154961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:26.155712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:26.156244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:26.156681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:26.469380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:26.485169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:26.493786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:26.497522 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-97535783-ad7e-463c-ac0c-db82bdd7bcad tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2956 microversion: 2.32 time: 0.362058 Nov 02 13:36:26.498118 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2253/4840] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:26 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2956 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:26.526059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-449d336b-fdfb-4cba-81a2-62fed53b9df7 req-e141f284-a10a-4af7-a404-08a82464dd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c00a03-1b4e-490c-814c-84c520dbab62", "name": "network-vif-plugged", "status": "completed", "tag": "80ac27ba-28f7-4264-a76a-90fa9b06560a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:26.537765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-449d336b-fdfb-4cba-81a2-62fed53b9df7 req-e141f284-a10a-4af7-a404-08a82464dd20 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:26.538252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-449d336b-fdfb-4cba-81a2-62fed53b9df7 req-e141f284-a10a-4af7-a404-08a82464dd20 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:26.538705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-449d336b-fdfb-4cba-81a2-62fed53b9df7 req-e141f284-a10a-4af7-a404-08a82464dd20 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:26.553162 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-449d336b-fdfb-4cba-81a2-62fed53b9df7 req-e141f284-a10a-4af7-a404-08a82464dd20 service nova] Creating event network-vif-plugged:80ac27ba-28f7-4264-a76a-90fa9b06560a for instance 16c00a03-1b4e-490c-814c-84c520dbab62 on n-h1-858384-19 Nov 02 13:36:26.560250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-449d336b-fdfb-4cba-81a2-62fed53b9df7 req-e141f284-a10a-4af7-a404-08a82464dd20 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042076 Nov 02 13:36:26.561131 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2254/4841] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:26.566289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:26.567165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:26.574650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:26.575309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:26.575698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:26.576419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:26.577247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:26.577531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:26.833737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:26.842795 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-52e70159-5c6e-43bd-81c1-564fa2b88956 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.280646 Nov 02 13:36:26.843634 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2255/4842] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:26 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:27.530304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:27.531751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:27.550986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:27.551759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:27.552395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:27.553278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:27.553899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:27.554490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:27.868345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:27.885822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:27.887961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:27.889494 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4f220bfa-9929-4e09-8577-fceb0d296485 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2956 microversion: 2.32 time: 0.363837 Nov 02 13:36:27.892092 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2256/4843] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:27 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2956 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:36:27.907388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:27.908446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:27.921271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:27.926400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:27.926921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:27.927712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:27.928188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:27.928629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:28.031856 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-028a2c27-f07e-4dc2-ad31-6246939324e9 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1452 microversion: 2.1 time: 13.082774 Nov 02 13:36:28.032683 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2588/4844] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:14 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1452 bytes in 13084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:28.047591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f0c21d70-ca12-478e-ba23-b09f83e4cbe9 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786a78430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:28.108289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:28.116882 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f0c21d70-ca12-478e-ba23-b09f83e4cbe9 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 200 len: 1452 microversion: 2.1 time: 0.074130 Nov 02 13:36:28.118291 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2589/4845] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:28 2022] GET /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:28.132904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8ff3dbcb-2dab-4fa9-bc13-3340d8d7b49f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786bb2c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:28.141186 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6455adc1-b2b9-47fa-b8fd-e1ded50508ab tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.247674 Nov 02 13:36:28.142161 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2257/4846] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:27 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:28.926410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:28.928240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:28.936678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:28.937426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:28.938397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:28.939351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:28.939920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:28.940407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:29.188857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8ff3dbcb-2dab-4fa9-bc13-3340d8d7b49f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 204 len: 0 microversion: 2.1 time: 1.060333 Nov 02 13:36:29.191273 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2590/4847] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:28 2022] DELETE /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 0 bytes in 1064 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:36:29.198041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:29.198666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:29.215093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:29.215689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:29.217087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:29.218808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:29.220323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:29.220768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:29.222863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:29.237222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:29.239271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:29.241262 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f38d4528-d85f-470c-8cee-c9ab2b993399 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2956 microversion: 2.32 time: 0.325010 Nov 02 13:36:29.256307 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2258/4848] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:28 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2956 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:29.277949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:29.278796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:29.286745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:29.287259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:29.287879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:29.288663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:29.289329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:29.289910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:29.321849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:36:29.395321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:29.404790 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f0fd1037-941d-41f2-bd72-d40182e8edd7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.212360 Nov 02 13:36:29.405390 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2591/4849] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:29 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:29.445471 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05e7250b-32ef-430a-8cac-abd37482ea96 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 204 len: 0 microversion: 2.1 time: 0.187398 Nov 02 13:36:29.446372 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2259/4850] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:36:29 2022] DELETE /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:36:29.614841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1472221710", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "47bb2f77-f27b-4713-bfef-5f74b66d9d9d"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:29.690784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] validate_networks() for [('47bb2f77-f27b-4713-bfef-5f74b66d9d9d', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:36:30.154237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:36:30.155146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:36:30.155626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:36:30.156049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:36:30.156476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:36:30.169549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:30.170089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:30.170463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:30.171211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:30.171842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:30.172473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:30.198230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:36:30.204182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for user be8bee2d23fa481193b5a23cf2348a73 and project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:36:30.227290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:36:30.229462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:36:30.275086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:30.275827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:30.283396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:30.283871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:30.284317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:30.285216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:30.285832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:30.286422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:30.312910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-176d20b3-ddf5-4938-b8bb-57cb84ba158d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.701453 Nov 02 13:36:30.313648 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2592/4851] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:36:29 2022] POST /compute/v2.1/servers => generated 382 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:36:30.329954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-075c6443-9799-4bb5-b4bf-2d8c773542b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:30.330582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-075c6443-9799-4bb5-b4bf-2d8c773542b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:30.440695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-075c6443-9799-4bb5-b4bf-2d8c773542b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:30.449639 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-075c6443-9799-4bb5-b4bf-2d8c773542b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1212 microversion: 2.1 time: 0.123940 Nov 02 13:36:30.450261 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2593/4852] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:30 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1212 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:30.461390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:30.463521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:30.474516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:30.475325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:30.476294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:30.477181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:30.477792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:30.478379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:30.595468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:30.607690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:30.609500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:30.610805 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-159b3ca7-e683-49ff-8eed-e19511ed215e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2956 microversion: 2.32 time: 0.340314 Nov 02 13:36:30.631140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2260/4853] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:30 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2956 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:30.758286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:30.771590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1b690c0-2ecc-4373-bd37-b10149021894 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1374 microversion: 2.1 time: 0.314279 Nov 02 13:36:30.772402 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2594/4854] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:30 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1374 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:31.475320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:31.475737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:31.491632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:31.492157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:31.496585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:31.497831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:31.497952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:31.498301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:31.607023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:31.616650 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0e21bd3f-1d0c-4809-99ff-f5b44a36ed11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1264 microversion: 2.1 time: 0.146423 Nov 02 13:36:31.617250 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2261/4855] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:31 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:31.648140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:31.649623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:31.660508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:31.661386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:31.662284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:31.663537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:31.664283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:31.664929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:31.798207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:31.798972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:31.811207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:31.812277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:31.812958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:31.813885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:31.816203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:31.818223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:32.006023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:32.025269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:32.032164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:32.036821 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e575e188-7053-4c9c-8e46-cd1ff4d85ee8 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2956 microversion: 2.32 time: 0.392916 Nov 02 13:36:32.040818 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2595/4856] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:31 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2956 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:32.257469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-529bb764-815a-4711-8bfe-dbe18ae3812d req-c0f78365-5af8-4939-86ba-e750a06963b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-unplugged", "status": "completed", "tag": "f973e9e0-60ad-4e52-aef0-171fdb0226e1"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:32.275887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-529bb764-815a-4711-8bfe-dbe18ae3812d req-c0f78365-5af8-4939-86ba-e750a06963b4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:32.279937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-529bb764-815a-4711-8bfe-dbe18ae3812d req-c0f78365-5af8-4939-86ba-e750a06963b4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:32.280764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-529bb764-815a-4711-8bfe-dbe18ae3812d req-c0f78365-5af8-4939-86ba-e750a06963b4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:32.306349 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-529bb764-815a-4711-8bfe-dbe18ae3812d req-c0f78365-5af8-4939-86ba-e750a06963b4 service nova] Creating event network-vif-unplugged:f973e9e0-60ad-4e52-aef0-171fdb0226e1 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:32.325425 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-529bb764-815a-4711-8bfe-dbe18ae3812d req-c0f78365-5af8-4939-86ba-e750a06963b4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071768 Nov 02 13:36:32.326330 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2596/4857] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:36:32.648378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:32.649509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:32.668613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:32.669314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:32.670889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:32.672490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:32.678368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:32.679127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:32.844230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:32.858279 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a4b453a-0901-4724-8cdb-8837e9d6f8d4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1270 microversion: 2.1 time: 0.215514 Nov 02 13:36:32.859249 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2597/4858] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:32 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:33.069048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:33.069902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:33.072038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:33.082696 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1823677-6800-45a1-b284-ffaa5a54672e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1569 microversion: 2.1 time: 1.291149 Nov 02 13:36:33.083319 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2262/4859] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:31 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1569 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:33.083701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:33.085735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:33.086930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:33.088249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:33.089072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:33.089844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:33.109940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1e7e0d0f-2c0d-4f8b-8119-07742d4b6ae3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:33.110365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1e7e0d0f-2c0d-4f8b-8119-07742d4b6ae3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:33.119511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e7e0d0f-2c0d-4f8b-8119-07742d4b6ae3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:33.120208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e7e0d0f-2c0d-4f8b-8119-07742d4b6ae3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:33.121798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e7e0d0f-2c0d-4f8b-8119-07742d4b6ae3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:33.123054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e7e0d0f-2c0d-4f8b-8119-07742d4b6ae3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:33.123718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e7e0d0f-2c0d-4f8b-8119-07742d4b6ae3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:33.124323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e7e0d0f-2c0d-4f8b-8119-07742d4b6ae3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:33.498921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:33.512812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:33.515276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:33.517783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da0c5d5c-ed92-48e7-9d11-362ed3202196 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2956 microversion: 2.32 time: 0.453813 Nov 02 13:36:33.520313 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2598/4860] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:33 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2956 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:33.609275 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1e7e0d0f-2c0d-4f8b-8119-07742d4b6ae3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.503798 Nov 02 13:36:33.610156 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2263/4861] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:36:33 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-interface => generated 285 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:36:33.886951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:33.887728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:33.913305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:33.914706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:33.918555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:33.925975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:33.927849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:33.929986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:34.141686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:34.153634 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eb7e6ef1-3814-4c38-8360-ab71423f821c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1270 microversion: 2.1 time: 0.273354 Nov 02 13:36:34.161690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1ea4f763-7c16-4301-bd4d-59613eea5882 req-61600a72-bc77-45f2-bb86-cf5d6608463f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aa16c2-87e7-4158-9ffd-b537ae7b9d06", "name": "network-vif-deleted", "tag": "3ede940d-da9c-4ba7-a37c-85ac3fe55cdf"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:34.177249 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2599/4862] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:33 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1270 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:34.189425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1ea4f763-7c16-4301-bd4d-59613eea5882 req-61600a72-bc77-45f2-bb86-cf5d6608463f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:34.190936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1ea4f763-7c16-4301-bd4d-59613eea5882 req-61600a72-bc77-45f2-bb86-cf5d6608463f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:34.191736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1ea4f763-7c16-4301-bd4d-59613eea5882 req-61600a72-bc77-45f2-bb86-cf5d6608463f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:34.245210 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1ea4f763-7c16-4301-bd4d-59613eea5882 req-61600a72-bc77-45f2-bb86-cf5d6608463f service nova] Creating event network-vif-deleted:3ede940d-da9c-4ba7-a37c-85ac3fe55cdf for instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 on n-h2-858384-19 Nov 02 13:36:34.270560 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1ea4f763-7c16-4301-bd4d-59613eea5882 req-61600a72-bc77-45f2-bb86-cf5d6608463f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112177 Nov 02 13:36:34.274907 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2264/4863] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:34.427641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-unplugged", "status": "completed", "tag": "a59140df-02b2-48d4-9f91-b051ae369f57"}, {"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-unplugged", "status": "completed", "tag": "2e49e2c7-c69b-46c6-87ac-2018188af28c"}, {"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-unplugged", "status": "completed", "tag": "bae0f565-113c-46c6-8652-ba244ff3de95"}, {"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-unplugged", "status": "completed", "tag": "8e6ea7b1-cf33-429d-8374-e26f5239f9f6"}, {"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-unplugged", "status": "completed", "tag": "2ff943a8-9281-45f9-9a6c-37130580d8a5"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:34.444395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:34.444957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:34.445329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:34.470306 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] Creating event network-vif-unplugged:a59140df-02b2-48d4-9f91-b051ae369f57 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:34.470824 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] Creating event network-vif-unplugged:2e49e2c7-c69b-46c6-87ac-2018188af28c for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:34.471371 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] Creating event network-vif-unplugged:bae0f565-113c-46c6-8652-ba244ff3de95 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:34.471837 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] Creating event network-vif-unplugged:8e6ea7b1-cf33-429d-8374-e26f5239f9f6 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:34.472326 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] Creating event network-vif-unplugged:2ff943a8-9281-45f9-9a6c-37130580d8a5 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:34.501258 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-83f5019b-1128-4352-a30f-e41db0e14012 req-2385dfa2-9675-48aa-a337-6b9c8ce82213 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.077265 Nov 02 13:36:34.502602 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2600/4864] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:34.554457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:34.555306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:34.576206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:34.576703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:34.577141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:34.577897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:34.578311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:34.578743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:35.072952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:35.083038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:35.097548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:35.102801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:35.108416 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4f7b1e17-8d59-4f67-9043-77e0309cb49d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2935 microversion: 2.32 time: 0.559127 Nov 02 13:36:35.111130 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2265/4865] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:34 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2935 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:35.204023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:35.206072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:35.219754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:35.220697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:35.221356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:35.222277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:35.229268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:35.230557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:35.328878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:35.338011 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f81de0e-ce56-4daa-91e5-b4593727b6b2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1270 microversion: 2.1 time: 0.139826 Nov 02 13:36:35.351974 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2601/4866] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:35 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:36.148077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:36.149936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:36.161902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:36.162532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:36.163568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:36.164692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:36.165716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:36.166588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:36.298202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-55d324fc-aefc-46cc-a0b1-9f1265de4b34 req-8c8453e5-70a2-407e-ba9e-0c8974e044e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c00a03-1b4e-490c-814c-84c520dbab62", "tag": "80ac27ba-28f7-4264-a76a-90fa9b06560a"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:36.310393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-55d324fc-aefc-46cc-a0b1-9f1265de4b34 req-8c8453e5-70a2-407e-ba9e-0c8974e044e8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:36.310883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-55d324fc-aefc-46cc-a0b1-9f1265de4b34 req-8c8453e5-70a2-407e-ba9e-0c8974e044e8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:36.311362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-55d324fc-aefc-46cc-a0b1-9f1265de4b34 req-8c8453e5-70a2-407e-ba9e-0c8974e044e8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:36.326841 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-55d324fc-aefc-46cc-a0b1-9f1265de4b34 req-8c8453e5-70a2-407e-ba9e-0c8974e044e8 service nova] Creating event network-changed:80ac27ba-28f7-4264-a76a-90fa9b06560a for instance 16c00a03-1b4e-490c-814c-84c520dbab62 on n-h1-858384-19 Nov 02 13:36:36.341012 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-55d324fc-aefc-46cc-a0b1-9f1265de4b34 req-8c8453e5-70a2-407e-ba9e-0c8974e044e8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044882 Nov 02 13:36:36.345444 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2602/4867] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:36:36.376500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:36.377793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:36.390851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:36.398472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:36.399534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:36.402479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:36.407472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:36.408665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:36.639688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:36.650119 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bcdb2950-8686-4cf0-94ee-f939cbdeec66 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1312 microversion: 2.1 time: 0.277803 Nov 02 13:36:36.651559 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2603/4868] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:36 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:37.019334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:37.039783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:37.048580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:37.053847 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9c503c7-692e-409f-96a4-705299a60bb9 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2914 microversion: 2.32 time: 0.909987 Nov 02 13:36:37.055169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2266/4869] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:36 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2914 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:37.462948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-41865afa-b003-46ad-b9db-6ff94a458574 req-0a0ef378-5067-42bd-a7bd-6eb8779df6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-deleted", "tag": "2e49e2c7-c69b-46c6-87ac-2018188af28c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:37.486977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-41865afa-b003-46ad-b9db-6ff94a458574 req-0a0ef378-5067-42bd-a7bd-6eb8779df6e9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:37.486977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-41865afa-b003-46ad-b9db-6ff94a458574 req-0a0ef378-5067-42bd-a7bd-6eb8779df6e9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:37.487317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-41865afa-b003-46ad-b9db-6ff94a458574 req-0a0ef378-5067-42bd-a7bd-6eb8779df6e9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:37.504750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-41865afa-b003-46ad-b9db-6ff94a458574 req-0a0ef378-5067-42bd-a7bd-6eb8779df6e9 service nova] Creating event network-vif-deleted:2e49e2c7-c69b-46c6-87ac-2018188af28c for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:37.521248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-41865afa-b003-46ad-b9db-6ff94a458574 req-0a0ef378-5067-42bd-a7bd-6eb8779df6e9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061971 Nov 02 13:36:37.521823 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2604/4870] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:37.682541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:37.684699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:37.695243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:37.697255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:37.699138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:37.700317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:37.701011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:37.701709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:38.109287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:38.109593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:38.137440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:38.137757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:38.138204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:38.138931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:38.139884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:38.140328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:38.497056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:38.513126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:38.518559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:38.523406 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15fb6a10-d283-4d54-9892-5691f9bcbd9b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2754 microversion: 2.32 time: 0.433853 Nov 02 13:36:38.526074 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2605/4871] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:38 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2754 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:38.551510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:38.568448 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0a21da8c-1484-4eb3-97f0-3c20cf477de8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1312 microversion: 2.1 time: 0.894258 Nov 02 13:36:38.569549 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2267/4872] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:37 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1312 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:39.560167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:39.560796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:39.584657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-08b0e395-eede-4119-ad8b-121751853fce req-5594dbc3-edeb-437d-b998-2331e458244c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f169f362-c1bc-4f18-82d1-b9a374465550", "tag": "2cdee1e3-4520-4371-908d-a2d305795caf"}, {"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-deleted", "tag": "bae0f565-113c-46c6-8652-ba244ff3de95"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:39.595748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:39.596247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:39.596690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:39.597405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:39.597861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:39.608158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:39.625648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-08b0e395-eede-4119-ad8b-121751853fce req-5594dbc3-edeb-437d-b998-2331e458244c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:39.626144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-08b0e395-eede-4119-ad8b-121751853fce req-5594dbc3-edeb-437d-b998-2331e458244c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:39.626575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-08b0e395-eede-4119-ad8b-121751853fce req-5594dbc3-edeb-437d-b998-2331e458244c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:39.711702 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-08b0e395-eede-4119-ad8b-121751853fce req-5594dbc3-edeb-437d-b998-2331e458244c service nova] Creating event network-changed:2cdee1e3-4520-4371-908d-a2d305795caf for instance f169f362-c1bc-4f18-82d1-b9a374465550 on n-h2-858384-19 Nov 02 13:36:39.716422 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-08b0e395-eede-4119-ad8b-121751853fce req-5594dbc3-edeb-437d-b998-2331e458244c service nova] Creating event network-vif-deleted:bae0f565-113c-46c6-8652-ba244ff3de95 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:39.751096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-08b0e395-eede-4119-ad8b-121751853fce req-5594dbc3-edeb-437d-b998-2331e458244c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.170259 Nov 02 13:36:39.754187 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2268/4873] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:36:39.776182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:39.777252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:39.791859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:39.803691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:39.805153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:39.805932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:39.806414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:39.813449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:39.939274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:39.949209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:39.951609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:39.954575 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d022d08-7bb7-43e5-845b-2ba64d3ad891 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2708 microversion: 2.32 time: 0.400478 Nov 02 13:36:39.960533 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2606/4874] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:39 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2708 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:40.225926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:40.237924 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-39696fbf-797f-4570-bc1d-9b307ce30ad7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1312 microversion: 2.1 time: 0.475939 Nov 02 13:36:40.238913 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2269/4875] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:39 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1312 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:40.989472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:40.990489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:40.999206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:41.003013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:41.007803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:41.017867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:41.020211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:41.021773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:41.025418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:41.028219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:41.263026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:41.264029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:41.273003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:41.273897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:41.274709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:41.275756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:41.276497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:41.277387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:41.338658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:41.354705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:41.356660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:41.358057 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d3d16982-8c45-4707-9f08-20b10af397b6 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2502 microversion: 2.32 time: 0.372840 Nov 02 13:36:41.359318 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2607/4876] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:40 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2502 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:41.888587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d40dbfff-dec1-47a3-8364-dbeb00684207 req-08a251f1-7e17-49f8-9715-c43c20b55c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-deleted", "tag": "8e6ea7b1-cf33-429d-8374-e26f5239f9f6"}, {"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-deleted", "tag": "f973e9e0-60ad-4e52-aef0-171fdb0226e1"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:41.910536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d40dbfff-dec1-47a3-8364-dbeb00684207 req-08a251f1-7e17-49f8-9715-c43c20b55c77 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:41.911021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d40dbfff-dec1-47a3-8364-dbeb00684207 req-08a251f1-7e17-49f8-9715-c43c20b55c77 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:41.911482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d40dbfff-dec1-47a3-8364-dbeb00684207 req-08a251f1-7e17-49f8-9715-c43c20b55c77 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:41.928436 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d40dbfff-dec1-47a3-8364-dbeb00684207 req-08a251f1-7e17-49f8-9715-c43c20b55c77 service nova] Creating event network-vif-deleted:8e6ea7b1-cf33-429d-8374-e26f5239f9f6 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:41.929377 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d40dbfff-dec1-47a3-8364-dbeb00684207 req-08a251f1-7e17-49f8-9715-c43c20b55c77 service nova] Creating event network-vif-deleted:f973e9e0-60ad-4e52-aef0-171fdb0226e1 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:41.938293 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d40dbfff-dec1-47a3-8364-dbeb00684207 req-08a251f1-7e17-49f8-9715-c43c20b55c77 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053723 Nov 02 13:36:41.939632 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2608/4877] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:36:42.010427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:42.052988 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af9194e0-2086-46f7-8c22-4ce1efba365b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1312 microversion: 2.1 time: 0.795379 Nov 02 13:36:42.075938 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2270/4878] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:41 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1312 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:42.400430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:42.401298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:42.411328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:42.412062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:42.412687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:42.413583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:42.414376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:42.415006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:42.505038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:42.524209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:42.525960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:42.528241 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2998af69-954f-466d-89d4-dc396509f58a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 2163 microversion: 2.32 time: 0.137707 Nov 02 13:36:42.529389 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2609/4879] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:42 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 2163 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:43.100646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:43.102664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:43.115468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:43.116482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:43.122918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:43.125265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:43.127251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:43.127995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:43.558972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:43.559842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:43.576033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:43.576545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:43.580977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:43.583996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:43.584516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:43.589868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:43.605212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:43.620212 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a9082edc-19fb-443b-8c05-d318150d7d54 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1312 microversion: 2.1 time: 0.524145 Nov 02 13:36:43.620831 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2271/4880] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:43 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1312 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:43.753374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:43.766289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:43.767949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:43.769459 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bee67e77-0c5c-44b7-99f5-a6c3abb1040a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.215405 Nov 02 13:36:43.770477 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2610/4881] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:43 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:36:43.982224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f0425e87-695d-4aa8-9428-b70facadd339 req-53732d25-50c1-4072-92f8-c9c672dbd6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92501d48-e60f-45b8-b514-cbdb9a7d159f", "name": "network-vif-deleted", "tag": "2ff943a8-9281-45f9-9a6c-37130580d8a5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:44.002053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f0425e87-695d-4aa8-9428-b70facadd339 req-53732d25-50c1-4072-92f8-c9c672dbd6a9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:44.002964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f0425e87-695d-4aa8-9428-b70facadd339 req-53732d25-50c1-4072-92f8-c9c672dbd6a9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:44.003576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f0425e87-695d-4aa8-9428-b70facadd339 req-53732d25-50c1-4072-92f8-c9c672dbd6a9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:44.032541 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f0425e87-695d-4aa8-9428-b70facadd339 req-53732d25-50c1-4072-92f8-c9c672dbd6a9 service nova] Creating event network-vif-deleted:2ff943a8-9281-45f9-9a6c-37130580d8a5 for instance 92501d48-e60f-45b8-b514-cbdb9a7d159f on n-h1-858384-19 Nov 02 13:36:44.044630 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f0425e87-695d-4aa8-9428-b70facadd339 req-53732d25-50c1-4072-92f8-c9c672dbd6a9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066589 Nov 02 13:36:44.046507 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2272/4882] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:44.451239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8e3bd1e3-2e23-4836-8e67-54aed856c972 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:44.451993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8e3bd1e3-2e23-4836-8e67-54aed856c972 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:44.460980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e3bd1e3-2e23-4836-8e67-54aed856c972 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:44.461479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e3bd1e3-2e23-4836-8e67-54aed856c972 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:44.461921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e3bd1e3-2e23-4836-8e67-54aed856c972 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:44.462658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e3bd1e3-2e23-4836-8e67-54aed856c972 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:44.463085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e3bd1e3-2e23-4836-8e67-54aed856c972 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:44.468597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e3bd1e3-2e23-4836-8e67-54aed856c972 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:44.521716 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8e3bd1e3-2e23-4836-8e67-54aed856c972 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/ips" status: 200 len: 145 microversion: 2.1 time: 0.075446 Nov 02 13:36:44.524680 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2611/4883] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:36:44 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/ips => generated 145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:44.649241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:44.650640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:44.656173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ccd28998-db33-42b7-8adb-9f0a59af1291 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:44.656741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ccd28998-db33-42b7-8adb-9f0a59af1291 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:44.661572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:44.662221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:44.662765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:44.664347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:44.665036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:44.665712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:44.666791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccd28998-db33-42b7-8adb-9f0a59af1291 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:44.667915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccd28998-db33-42b7-8adb-9f0a59af1291 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:44.668367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccd28998-db33-42b7-8adb-9f0a59af1291 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:44.669139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccd28998-db33-42b7-8adb-9f0a59af1291 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:44.669607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccd28998-db33-42b7-8adb-9f0a59af1291 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:44.670290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccd28998-db33-42b7-8adb-9f0a59af1291 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:44.705009 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ccd28998-db33-42b7-8adb-9f0a59af1291 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/ips" status: 200 len: 150 microversion: 2.1 time: 0.055381 Nov 02 13:36:44.706227 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2612/4884] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:36:44 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:44.802652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:44.807453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:44.815958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:44.816604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:44.817148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:44.818115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:44.818810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:44.819353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:44.830233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:44.948322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:44.962576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:44.968170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:44.969975 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88bee460-1d00-4b92-a524-fa86e0b5299b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.171489 Nov 02 13:36:44.974668 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2613/4885] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:44 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:44.975778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:44.987212 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-754b9f22-b75e-4bca-8984-ddd9e27e5e39 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1312 microversion: 2.1 time: 0.343428 Nov 02 13:36:45.003041 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2273/4886] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:44 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1312 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:46.009964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:46.013159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:46.014270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:46.016429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:46.037946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:46.038446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:46.038893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:46.039644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:46.040104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:46.040539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:46.043376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:46.044003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:46.044443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:46.045185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:46.049577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:46.050454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:46.249331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:46.262550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:46.275889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:46.277267 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-beb0b5b6-a0a7-4a03-9de6-01410968d27b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.276697 Nov 02 13:36:46.295428 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2614/4887] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:45 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:46.524169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:46.546819 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-18c3d5e3-96c6-4d38-90c2-1fd9df078140 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1312 microversion: 2.1 time: 0.540730 Nov 02 13:36:46.558798 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2274/4888] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:46 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1312 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:46.700971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-961b10e4-cae1-4e3f-95ad-f8c02d8a6a21 req-c77fe8e4-6c8b-4983-8a87-905e336d6e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f169f362-c1bc-4f18-82d1-b9a374465550", "name": "network-vif-plugged", "status": "completed", "tag": "2cdee1e3-4520-4371-908d-a2d305795caf"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:46.713323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-961b10e4-cae1-4e3f-95ad-f8c02d8a6a21 req-c77fe8e4-6c8b-4983-8a87-905e336d6e29 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:46.717232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-961b10e4-cae1-4e3f-95ad-f8c02d8a6a21 req-c77fe8e4-6c8b-4983-8a87-905e336d6e29 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:46.723891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-961b10e4-cae1-4e3f-95ad-f8c02d8a6a21 req-c77fe8e4-6c8b-4983-8a87-905e336d6e29 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:46.754652 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-961b10e4-cae1-4e3f-95ad-f8c02d8a6a21 req-c77fe8e4-6c8b-4983-8a87-905e336d6e29 service nova] Creating event network-vif-plugged:2cdee1e3-4520-4371-908d-a2d305795caf for instance f169f362-c1bc-4f18-82d1-b9a374465550 on n-h2-858384-19 Nov 02 13:36:46.793957 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-961b10e4-cae1-4e3f-95ad-f8c02d8a6a21 req-c77fe8e4-6c8b-4983-8a87-905e336d6e29 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096415 Nov 02 13:36:46.794644 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2615/4889] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:47.317172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:47.319442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:47.334760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:47.336849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:47.337325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:47.340593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:47.343226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:47.345428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:47.504915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:47.518659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:47.521786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:47.523152 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-816f012f-c2bf-4d36-aa9c-e2d6f6c22059 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.213470 Nov 02 13:36:47.524257 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2275/4890] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:47 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:47.585703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:47.586500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:47.601013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:47.601770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:47.604276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:47.606579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:47.607728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:47.613118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:47.701253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b60e6e8a-a17f-4bfc-8b16-4dd0349c27ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ba45898-f216-47a3-9138-8d245cba1476"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:47.704611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b60e6e8a-a17f-4bfc-8b16-4dd0349c27ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:47.712795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60e6e8a-a17f-4bfc-8b16-4dd0349c27ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:47.713747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60e6e8a-a17f-4bfc-8b16-4dd0349c27ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:47.715545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60e6e8a-a17f-4bfc-8b16-4dd0349c27ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:47.716883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60e6e8a-a17f-4bfc-8b16-4dd0349c27ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:47.717700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60e6e8a-a17f-4bfc-8b16-4dd0349c27ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:47.718359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60e6e8a-a17f-4bfc-8b16-4dd0349c27ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:47.953233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:47.970342 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d279ac4-4a61-42da-ad84-5ee1e9243994 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1312 microversion: 2.1 time: 0.389105 Nov 02 13:36:47.971737 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2616/4891] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:47 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1312 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:48.224267 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b60e6e8a-a17f-4bfc-8b16-4dd0349c27ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.527929 Nov 02 13:36:48.233753 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2276/4892] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:36:47 2022] POST /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:36:48.552005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:48.555892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:48.584893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:48.588456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:48.592741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:48.594030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:48.596311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:48.597090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:48.644135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2fa2a92a-05e5-4b6e-a5c4-baf4fc124469 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8712247-5667-4ede-a5d1-4d89699be7ab"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:48.654714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2fa2a92a-05e5-4b6e-a5c4-baf4fc124469 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:48.680507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fa2a92a-05e5-4b6e-a5c4-baf4fc124469 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:48.681316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fa2a92a-05e5-4b6e-a5c4-baf4fc124469 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:48.682042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fa2a92a-05e5-4b6e-a5c4-baf4fc124469 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:48.683393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fa2a92a-05e5-4b6e-a5c4-baf4fc124469 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:48.683954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fa2a92a-05e5-4b6e-a5c4-baf4fc124469 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:48.684701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fa2a92a-05e5-4b6e-a5c4-baf4fc124469 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:48.713411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:48.725270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:48.727052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:48.728935 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aeab9935-19aa-4b3b-beb0-bebfaa07f3b1 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.181904 Nov 02 13:36:48.730901 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2617/4893] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:48 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:36:48.994271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:48.997205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:49.012133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:49.013037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:49.013648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:49.014624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:49.015359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:49.015973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:49.222634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:49.236386 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1adf2b83-0886-4a00-adcc-bfc5965ccc2a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 200 len: 1493 microversion: 2.1 time: 0.245852 Nov 02 13:36:49.237667 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2618/4894] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:36:48 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 1493 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:49.262523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47116923-0e6b-446e-9609-d22425482c46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1957094956"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:49.265699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47116923-0e6b-446e-9609-d22425482c46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:49.275876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47116923-0e6b-446e-9609-d22425482c46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:49.277260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47116923-0e6b-446e-9609-d22425482c46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:49.278167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47116923-0e6b-446e-9609-d22425482c46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:49.279631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47116923-0e6b-446e-9609-d22425482c46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:49.280805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47116923-0e6b-446e-9609-d22425482c46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:49.281513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47116923-0e6b-446e-9609-d22425482c46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:49.626181 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47116923-0e6b-446e-9609-d22425482c46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550/action" status: 202 len: 0 microversion: 2.1 time: 0.368407 Nov 02 13:36:49.627027 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2619/4895] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:36:49 2022] POST /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 13:36:49.640603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4ec7fa98-7880-40e3-8250-48ed3f3847fb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786a165e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:49.705043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4ec7fa98-7880-40e3-8250-48ed3f3847fb tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.069081 Nov 02 13:36:49.707210 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2620/4896] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:49 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:49.761121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:49.762291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:49.769072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:49.769572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:49.770279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:49.771224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:49.771850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:49.772670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:49.856217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:49.867472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:49.869143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:49.870823 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5494fc2e-597b-4d68-b133-fcc945036478 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.114033 Nov 02 13:36:49.871735 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2621/4897] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:49 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:36:50.724989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-51acdb61-eaee-4eab-806c-3bb3a29d0496 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786bb2a60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:50.782958 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-51acdb61-eaee-4eab-806c-3bb3a29d0496 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.062142 Nov 02 13:36:50.783930 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2622/4898] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:50 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:50.901570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:50.902200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:50.908724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:50.909441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:50.910084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:50.910938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:50.911286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:50.911889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:50.988083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:51.006674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:51.008443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:51.010083 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83563e99-bb84-4026-a973-7df25adf7b7c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.112817 Nov 02 13:36:51.011218 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2623/4899] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:50 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:36:51.802580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0fcf226a-ae91-43b4-8c50-3910721281c4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7862cb820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:51.857265 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0fcf226a-ae91-43b4-8c50-3910721281c4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.058724 Nov 02 13:36:51.858342 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2624/4900] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:51 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:52.037449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:52.038052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:52.049553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:52.049984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:52.050435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:52.051493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:52.051954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:52.052741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:52.143497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:52.154577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:52.156088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:52.157542 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0e5e650-cba0-4f83-9b54-402bf180877f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.124302 Nov 02 13:36:52.158732 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2625/4901] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:52 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:52.878782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-882d021e-7d8b-4062-82d7-8ae618c55f78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786a06ee0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:52.936886 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-882d021e-7d8b-4062-82d7-8ae618c55f78 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.065210 Nov 02 13:36:52.937750 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2626/4902] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:52 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:53.196104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:53.197070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:53.207678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:53.208871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:53.210717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:53.212076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:53.212709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:53.213334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:53.337589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:53.351291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:53.354035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:53.357540 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34cb12cc-8f84-4d80-b93a-216488e1bd11 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.177213 Nov 02 13:36:53.359353 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2627/4903] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:53 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:53.957004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e140429-5c9a-4e0c-9432-4521e74118e7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786314160>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:54.019436 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e140429-5c9a-4e0c-9432-4521e74118e7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.066512 Nov 02 13:36:54.020027 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2628/4904] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:53 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:54.392489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:54.393167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:54.407854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:54.411996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:54.413299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:54.413896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:54.418526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:54.419103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:54.419788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:54.518494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:54.535551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:54.538283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:54.541638 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f2e09986-828f-45e2-9ef8-25a7e7c99b50 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.153274 Nov 02 13:36:54.542461 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2629/4905] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:54 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:55.038953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f0746e7-fbaa-4612-994e-93e33820a2f4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f98e280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:55.093763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f0746e7-fbaa-4612-994e-93e33820a2f4 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.060772 Nov 02 13:36:55.102206 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2630/4906] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:55 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:55.570114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:55.571641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:55.582307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:55.583342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:55.583342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:55.583998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:55.584647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:55.585088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:55.688505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:55.708095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:55.709894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:55.711412 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fea0025c-304a-4037-97eb-decc68d60db0 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.146951 Nov 02 13:36:55.726059 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2631/4907] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:55 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:36:56.175473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b97d4651-e95a-4ac8-ac22-613796e90d11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786a061f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:56.225193 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b97d4651-e95a-4ac8-ac22-613796e90d11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.111376 Nov 02 13:36:56.234306 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2632/4908] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:56 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:56.418297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-639de6db-6809-472a-9295-cdaca064f698 req-27140043-205a-43d8-877d-d1d31c3e4e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f169f362-c1bc-4f18-82d1-b9a374465550", "name": "network-vif-plugged", "status": "completed", "tag": "2cdee1e3-4520-4371-908d-a2d305795caf"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:36:56.432672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-639de6db-6809-472a-9295-cdaca064f698 req-27140043-205a-43d8-877d-d1d31c3e4e9c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:56.434089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-639de6db-6809-472a-9295-cdaca064f698 req-27140043-205a-43d8-877d-d1d31c3e4e9c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:56.434823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-639de6db-6809-472a-9295-cdaca064f698 req-27140043-205a-43d8-877d-d1d31c3e4e9c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:56.453257 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-639de6db-6809-472a-9295-cdaca064f698 req-27140043-205a-43d8-877d-d1d31c3e4e9c service nova] Creating event network-vif-plugged:2cdee1e3-4520-4371-908d-a2d305795caf for instance f169f362-c1bc-4f18-82d1-b9a374465550 on n-h2-858384-19 Nov 02 13:36:56.461366 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-639de6db-6809-472a-9295-cdaca064f698 req-27140043-205a-43d8-877d-d1d31c3e4e9c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047096 Nov 02 13:36:56.465322 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2633/4909] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:36:56.753170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:56.758179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:56.775017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:56.775542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:56.777349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:56.778094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:56.778694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:56.779154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:56.852544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:56.865958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:56.867843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:56.869303 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1b46218-962e-42fa-b0c3-5b651a1ca792 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.129772 Nov 02 13:36:56.870817 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2634/4910] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:56 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:57.246748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c6b399b-7302-4f09-8cba-38d0a80d57c6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f89a0d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:57.389793 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c6b399b-7302-4f09-8cba-38d0a80d57c6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.151739 Nov 02 13:36:57.390826 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2635/4911] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:57 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:36:57.897530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:57.898817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:57.911987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:57.912850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:57.915614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:57.916713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:57.921090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:57.921909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:58.050313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:58.063555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:58.066041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:58.076540 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-94f95dca-2419-4b54-8326-30485e477dfe tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.181300 Nov 02 13:36:58.079058 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2636/4912] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:57 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:58.407897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-128a121b-670b-4163-969e-5822f95781f7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7861303a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:58.481707 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-128a121b-670b-4163-969e-5822f95781f7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.078404 Nov 02 13:36:58.482853 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2637/4913] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:58 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:36:58.667371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:59.113756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:59.122915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:36:59.143802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:59.146005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:59.149403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:59.150466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:36:59.151907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:36:59.155105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:36:59.320914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:59.331642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:36:59.341640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:59.343690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:36:59.348584 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-38488bf3-87a9-4560-9f1d-e36366a8ca2f tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.239238 Nov 02 13:36:59.359672 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2638/4914] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:36:59 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:36:59.498916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-52bbe606-95d2-4514-ac7b-6be55ac44a92 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f908ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:36:59.618204 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-52bbe606-95d2-4514-ac7b-6be55ac44a92 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.120836 Nov 02 13:36:59.619012 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2639/4915] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:36:59 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:00.380073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:00.380759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:00.397138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:00.397948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:00.398558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:00.399481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:00.400097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:00.400851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:00.499648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:00.514539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:00.517364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:00.518741 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b78f850a-7092-46d3-82ca-a196ea402dff tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.142770 Nov 02 13:37:00.531797 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2640/4916] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:00 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:37:00.636626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9fef5e99-7b48-4fec-a7c4-9d85f8a7a206 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f9085e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:00.717168 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9fef5e99-7b48-4fec-a7c4-9d85f8a7a206 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.085448 Nov 02 13:37:00.721033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2641/4917] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:00 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:01.546229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:01.547750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:01.563485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:01.566351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:01.567909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:01.570127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:01.572076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:01.574863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:01.734307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:01.746840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:01.761827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:01.763541 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-27b96afe-1d8b-487a-92e3-433e62a1af7a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.221563 Nov 02 13:37:01.764566 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2642/4918] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:01 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:37:01.770343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8cbdc19c-264e-4f7c-8b82-40ff21e63f98 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787763c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:02.114143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8cbdc19c-264e-4f7c-8b82-40ff21e63f98 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.348198 Nov 02 13:37:02.114796 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2643/4919] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:01 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:02.460749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:02.796646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:02.798334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:02.817495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:02.818029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:02.819444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:02.821131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:02.821632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:02.822033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:02.960845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:02.977433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:02.980039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:02.981656 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f8086683-7d64-44e5-906d-dc0404eb7632 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.191854 Nov 02 13:37:02.982991 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2644/4920] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:02 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:37:03.131493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09268778-4e69-4638-a820-67451172b042 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787a98af0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:03.203160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09268778-4e69-4638-a820-67451172b042 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.075350 Nov 02 13:37:03.204164 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2645/4921] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:03 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:04.008754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:04.009963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:04.028735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:04.029242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:04.029689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:04.030423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:04.030880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:04.031346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:04.200117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:04.211879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:04.214039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:04.230750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a6202d79-d5a1-49a4-bbef-6f123c10cb7b tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.226816 Nov 02 13:37:04.236966 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2646/4922] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:04 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:37:04.255744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d307255-1c3f-4510-a87c-7eae374ffa91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786e45670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:04.314132 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d307255-1c3f-4510-a87c-7eae374ffa91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.075880 Nov 02 13:37:04.315731 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2647/4923] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:04 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:05.265461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:05.266223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:05.284334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:05.284830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:05.285274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:05.288106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:05.288600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:05.289055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:05.434857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:05.467922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:05.471495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:05.476218 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3705e29e-05dc-4895-977e-e9ce37eec691 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.216723 Nov 02 13:37:05.481657 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2648/4924] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:05 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:37:05.488695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-86843667-e059-40a6-84a9-9a85633cff15 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786e45ca0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:05.595954 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-86843667-e059-40a6-84a9-9a85633cff15 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.112112 Nov 02 13:37:05.608717 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2649/4925] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:05 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:06.538977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:06.540157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:06.565039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:06.576594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:06.578234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:06.580039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:06.586446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:06.587151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:06.718550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:06.765757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:06.771823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:06.774284 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8e44bec-9fb3-47a8-a5ee-aee9ede3e312 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.259345 Nov 02 13:37:06.775470 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2650/4926] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:06 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:37:06.804136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84e21f75-f0e0-46aa-9ffd-c23398981d83 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786e45a60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:06.862078 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84e21f75-f0e0-46aa-9ffd-c23398981d83 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.085193 Nov 02 13:37:06.862684 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2651/4927] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:06 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:07.820853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:07.822218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:07.844399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:07.846208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:07.847416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:07.848387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:07.850006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:07.850903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:08.034396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:08.051457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:08.055529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:08.057339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09b3fde0-61d1-4b9d-8220-21f8b94d1180 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.241865 Nov 02 13:37:08.058603 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2652/4928] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:07 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:37:08.068319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-329b965e-7692-4f1c-b59f-a9bb3fc0db36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7862b0430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:08.248804 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-329b965e-7692-4f1c-b59f-a9bb3fc0db36 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.188751 Nov 02 13:37:08.260059 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2653/4929] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:08 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:09.092726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:09.093415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:09.111546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:09.112429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:09.113034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:09.115193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:09.115993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:09.117304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:09.253526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:09.268815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:09.270696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:09.272107 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00ded47f-9312-49cc-b246-08608a6e2f90 tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1608 microversion: 2.32 time: 0.187431 Nov 02 13:37:09.278485 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2654/4930] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:09 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1608 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:37:09.285385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8a9b786-0a66-4ea1-b92f-f3a4f260271f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786a2b670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:09.420784 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8a9b786-0a66-4ea1-b92f-f3a4f260271f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.138741 Nov 02 13:37:09.422306 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2655/4931] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:09 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:10.321616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:10.323049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:10.325158 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2fa2a92a-05e5-4b6e-a5c4-baf4fc124469 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 21.685435 Nov 02 13:37:10.333611 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2277/4932] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:36:48 2022] POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/os-volume_attachments => generated 194 bytes in 21698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:37:10.378896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:10.385897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:10.386664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:10.387624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:10.390174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:10.395784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:10.438697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a5bdf96-0c59-40a7-8a09-d06497668887 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78fa30a60>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:10.575532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:10.576217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:10.576487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:10.583032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lazy-loading 'fault' on Instance uuid 92501d48-e60f-45b8-b514-cbdb9a7d159f {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:37:10.688939 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a5bdf96-0c59-40a7-8a09-d06497668887 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.254782 Nov 02 13:37:10.694627 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2278/4933] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:10 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:10.756623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:10.784816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:10.791899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '533414d2d1ae4de09cce393f8f6c8b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71c9ac6a19e84cfb8ba6d86da5292fbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:10.811981 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f864a35-abbc-4977-9fb2-c219de32266e tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 200 len: 1613 microversion: 2.32 time: 0.501911 Nov 02 13:37:10.834280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2656/4934] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:10 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 1613 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:37:11.710876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9ccf4f2-5bf0-4140-91c0-beb3347c2bde tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f888310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:11.841514 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9ccf4f2-5bf0-4140-91c0-beb3347c2bde tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.132655 Nov 02 13:37:11.842440 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2279/4935] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:11 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:11.857908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:11.859143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:11.871787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:11.872286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:11.872722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:11.873426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:11.873876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:11.874299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:11.927202 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] HTTP exception thrown: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Request method failure captured: Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f HTTP/1.1 Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnDH0sxjD71XJkHemK1IbGFtqM9_FvM8sGltv0aBteWbkuXTKe09wWOPdPxZAJuLmuyYvC3B4Xo7viHtKeN3ugVGMWsGSW8yZEdG93mZe4f4lj9wqrkm2zVSlV8UbqDIRc4wZKJnK1pzEf5ylNSWB7qKk5musBc5qbRNfkrANzgfPCg Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 71c9ac6a19e84cfb8ba6d86da5292fbe Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TaggedBootDevicesTest-962451186 Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TaggedBootDevicesTest-962451186 Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 71c9ac6a19e84cfb8ba6d86da5292fbe Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TaggedBootDevicesTest-962451186 Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TaggedBootDevicesTest-962451186-project Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 533414d2d1ae4de09cce393f8f6c8b8e Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TaggedBootDevicesTest-962451186-project Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '92501d48-e60f-45b8-b514-cbdb9a7d159f'} Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:11.932698 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:37:11.937157 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:11.937157 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:37:11.937157 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:37:11.937157 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:37:11.937157 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:37:11.937157 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:37:11.937157 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:11.937157 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:11.941682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Returning 404 to user: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:37:11.942796 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d96d14ff-c238-40ce-96cb-17c744fb5d3d tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 404 len: 111 microversion: 2.32 time: 0.101059 Nov 02 13:37:11.946387 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2657/4936] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:11 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:37:11.955558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-23cf9ccf-ef2f-4047-af09-49dc2f556a2c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '.version_select at 0x7fe786707a60>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:12.015065 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-23cf9ccf-ef2f-4047-af09-49dc2f556a2c tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-461846968" status: 204 len: 0 microversion: 2.32 time: 0.063574 Nov 02 13:37:12.019053 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2280/4937] 10.222.0.113 () {60 vars in 1264 bytes} [Wed Nov 2 13:37:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-461846968 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:37:12.901893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf56be9b-f0b9-4c6c-bd60-88775ee17b8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786a2ba60>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:13.081860 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf56be9b-f0b9-4c6c-bd60-88775ee17b8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1417 microversion: 2.1 time: 0.219804 Nov 02 13:37:13.082529 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2658/4938] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:12 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1417 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:14.100914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-297bf891-45e8-4e07-83b0-097c91a83b77 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786708dc0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:14.200934 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-297bf891-45e8-4e07-83b0-097c91a83b77 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1426 microversion: 2.1 time: 0.100932 Nov 02 13:37:14.203458 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2281/4939] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:14 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1426 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:14.219182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9b3fd1d4-df07-43bf-baeb-0e4f02d0423f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78f9084c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:14.349118 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9b3fd1d4-df07-43bf-baeb-0e4f02d0423f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 200 len: 1426 microversion: 2.1 time: 0.134953 Nov 02 13:37:14.352873 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2659/4940] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:37:14 2022] GET /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 1426 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:14.604043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1104251301", "imageRef": "2766e52f-a97d-4866-a778-d4633fa99645", "flavorRef": "452", "networks": [{"uuid": "47bb2f77-f27b-4713-bfef-5f74b66d9d9d"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:14.729357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] validate_networks() for [('47bb2f77-f27b-4713-bfef-5f74b66d9d9d', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:37:15.769655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:37:15.770402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:37:15.770539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:37:15.771771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:37:15.772390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:37:15.813296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:15.815761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:15.816396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:15.820570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:15.821771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:15.825166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:15.880292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:37:15.892185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for user be8bee2d23fa481193b5a23cf2348a73 and project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:37:15.932889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:37:15.935635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2766e52f-a97d-4866-a778-d4633fa99645',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:37:16.045617 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dd4d711c-e914-4d2a-8696-049a3197135e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.443611 Nov 02 13:37:16.046879 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2282/4941] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:37:14 2022] POST /compute/v2.1/servers => generated 382 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:37:16.059440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-134ad498-6b82-4a6c-b98d-0b4c36bc9e84 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:16.060294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-134ad498-6b82-4a6c-b98d-0b4c36bc9e84 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:16.178953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-134ad498-6b82-4a6c-b98d-0b4c36bc9e84 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:16.196949 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-134ad498-6b82-4a6c-b98d-0b4c36bc9e84 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1212 microversion: 2.1 time: 0.143112 Nov 02 13:37:16.199993 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2660/4942] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:16 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1212 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:17.234333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-77e7f57d-7455-4f9d-8828-8fdba26fe6df tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:17.235219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-77e7f57d-7455-4f9d-8828-8fdba26fe6df tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:17.477321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-77e7f57d-7455-4f9d-8828-8fdba26fe6df tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:17.498592 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-77e7f57d-7455-4f9d-8828-8fdba26fe6df tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1212 microversion: 2.1 time: 0.276789 Nov 02 13:37:17.502700 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2283/4943] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:17 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1212 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:18.531417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:18.531934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:18.552080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:18.552596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:18.553082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:18.553857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:18.554321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:18.554762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:18.856905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:18.866255 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8ba887b6-4966-4f60-8c7e-66d8ffd32d46 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1208 microversion: 2.1 time: 0.339515 Nov 02 13:37:18.889582 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2661/4944] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:18 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1208 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:19.126773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5f884af3-982b-43e2-8579-100b50426617 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: .version_select at 0x7fe786708310>, body: {"keypair": {"name": "tempest-keypair-673475872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsUIsMp2Rzm9b98tOK+Akib8ir8Hj8tKdZvjLSKUFv0U8VwcpJhpF/Y5XUlaX5PH4MqumdTvo2DWiy2woX9YFizImw7SkCIzoO/Fxn2WLJ9aMqzI6A6PcodLPn+66kQCQ=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:19.182869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-5f884af3-982b-43e2-8579-100b50426617 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:37:19.208889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-5f884af3-982b-43e2-8579-100b50426617 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for user 284102156ef9461e93e4af60f9496aa2 and project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:37:19.332712 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5f884af3-982b-43e2-8579-100b50426617 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.208362 Nov 02 13:37:19.337022 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2284/4945] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:37:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:19.602053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-79431409-7dc8-477a-9ba3-3fd85f74c684 req-082febcf-a1d9-4973-a1bb-aeb94d28e9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f169f362-c1bc-4f18-82d1-b9a374465550", "name": "network-vif-unplugged", "status": "completed", "tag": "2cdee1e3-4520-4371-908d-a2d305795caf"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:19.623706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-79431409-7dc8-477a-9ba3-3fd85f74c684 req-082febcf-a1d9-4973-a1bb-aeb94d28e9b6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:19.632069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-79431409-7dc8-477a-9ba3-3fd85f74c684 req-082febcf-a1d9-4973-a1bb-aeb94d28e9b6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:19.633052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-79431409-7dc8-477a-9ba3-3fd85f74c684 req-082febcf-a1d9-4973-a1bb-aeb94d28e9b6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:19.666379 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-79431409-7dc8-477a-9ba3-3fd85f74c684 req-082febcf-a1d9-4973-a1bb-aeb94d28e9b6 service nova] Creating event network-vif-unplugged:2cdee1e3-4520-4371-908d-a2d305795caf for instance f169f362-c1bc-4f18-82d1-b9a374465550 on n-h2-858384-19 Nov 02 13:37:19.679812 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-79431409-7dc8-477a-9ba3-3fd85f74c684 req-082febcf-a1d9-4973-a1bb-aeb94d28e9b6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083731 Nov 02 13:37:19.682060 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2662/4946] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:19.890699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:19.898700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:19.917685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:19.923754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:19.924565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:19.925614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:19.927518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:19.928246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:20.308507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:20.320936 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cebecfbc-90a1-4614-b442-55a98195530d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1272 microversion: 2.1 time: 0.434093 Nov 02 13:37:20.322479 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2285/4947] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:19 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1272 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:20.825416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:20.826661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:20.834882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:20.835634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:20.836275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:20.837479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:20.838160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:20.838987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:20.872371 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] HTTP exception thrown: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Request method failure captured: Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f HTTP/1.1 Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnDH0sxjD71XJkHemK1IbGFtqM9_FvM8sGltv0aBteWbkuXTKe09wWOPdPxZAJuLmuyYvC3B4Xo7viHtKeN3ugVGMWsGSW8yZEdG93mZe4f4lj9wqrkm2zVSlV8UbqDIRc4wZKJnK1pzEf5ylNSWB7qKk5musBc5qbRNfkrANzgfPCg Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 71c9ac6a19e84cfb8ba6d86da5292fbe Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TaggedBootDevicesTest-962451186 Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TaggedBootDevicesTest-962451186 Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 71c9ac6a19e84cfb8ba6d86da5292fbe Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TaggedBootDevicesTest-962451186 Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TaggedBootDevicesTest-962451186-project Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 533414d2d1ae4de09cce393f8f6c8b8e Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TaggedBootDevicesTest-962451186-project Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '92501d48-e60f-45b8-b514-cbdb9a7d159f'} Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:37:20.875219 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:20.883004 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:37:20.888992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Returning 404 to user: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:37:20.890620 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3fe55819-6213-4824-8c30-32ec49ea280a tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "DELETE /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 404 len: 111 microversion: 2.32 time: 0.071511 Nov 02 13:37:20.891995 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2663/4948] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:37:20 2022] DELETE /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:37:20.902030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:20.902745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] [instance: 92501d48-e60f-45b8-b514-cbdb9a7d159f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:20.922395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:20.934008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:20.934520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:20.935422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:20.943402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:20.945469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:20.997670 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] HTTP exception thrown: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Request method failure captured: Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f HTTP/1.1 Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnDH0sxjD71XJkHemK1IbGFtqM9_FvM8sGltv0aBteWbkuXTKe09wWOPdPxZAJuLmuyYvC3B4Xo7viHtKeN3ugVGMWsGSW8yZEdG93mZe4f4lj9wqrkm2zVSlV8UbqDIRc4wZKJnK1pzEf5ylNSWB7qKk5musBc5qbRNfkrANzgfPCg Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 71c9ac6a19e84cfb8ba6d86da5292fbe Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TaggedBootDevicesTest-962451186 Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/71c9ac6a19e84cfb8ba6d86da5292fbe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TaggedBootDevicesTest-962451186 Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 71c9ac6a19e84cfb8ba6d86da5292fbe Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TaggedBootDevicesTest-962451186 Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TaggedBootDevicesTest-962451186-project Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 533414d2d1ae4de09cce393f8f6c8b8e Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TaggedBootDevicesTest-962451186-project Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '92501d48-e60f-45b8-b514-cbdb9a7d159f'} Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:37:21.004087 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:37:21.011188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:37:21.011188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:37:21.011188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:37:21.011188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:37:21.011188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:37:21.011188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:37:21.011188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. Nov 02 13:37:21.011188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:37:21.014398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] Returning 404 to user: Instance 92501d48-e60f-45b8-b514-cbdb9a7d159f could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:37:21.017260 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d78ea8d5-bac5-4cb1-9e24-ef0452a0f1de tempest-TaggedBootDevicesTest-962451186 tempest-TaggedBootDevicesTest-962451186-project] 10.222.0.113 "GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f" status: 404 len: 111 microversion: 2.32 time: 0.121275 Nov 02 13:37:21.020023 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2286/4949] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:37:20 2022] GET /compute/v2.1/servers/92501d48-e60f-45b8-b514-cbdb9a7d159f => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:37:21.352241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:21.353463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:21.365138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:21.366038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:21.369569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:21.370877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:21.372871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:21.375598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:21.608196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:21.624462 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d6dbedf5-be2a-4ec3-b43a-dc28e4eefa6e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1270 microversion: 2.1 time: 0.278566 Nov 02 13:37:21.627622 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2664/4950] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:21 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1270 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:22.654646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:22.654646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:22.691886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:22.700106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:22.700663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:22.704995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:22.706063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:22.709661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:23.301015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:23.315589 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b60ab28f-f842-4e4a-ba20-9e98de743fec tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.668732 Nov 02 13:37:23.354247 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2287/4951] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:22 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:24.342795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:24.344367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:24.364449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:24.366835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:24.370075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:24.371848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:24.373687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:24.375775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:24.745233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:24.768697 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb990e10-1d4d-49ee-a289-c5a6fa4fd028 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.429780 Nov 02 13:37:24.776060 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2665/4952] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:24 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:25.544739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-622802350", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07df1b69-fb68-402d-a0e1-7135ff448b95"}], "security_groups": [{"name": "tempest-securitygroup--747748382"}], "key_name": "tempest-keypair-673475872", "user_data": "}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:25.794711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:25.796105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:25.811167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=48 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:25.823442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:25.831994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:25.832803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:25.836997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:25.837786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:25.838571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:25.856842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:26.128356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] validate_networks() for [('07df1b69-fb68-402d-a0e1-7135ff448b95', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:37:26.201933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:26.412726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:26.422879 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b6cbe57-d822-46c6-9263-c6a2b0dd83c0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.632965 Nov 02 13:37:26.431457 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2666/4953] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:25 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:27.462999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:27.472254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:27.502321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:27.507948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:27.508630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:27.510705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:27.515039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:27.515908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:27.626190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:37:27.626830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:37:27.627415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:37:27.627943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:37:27.628460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:37:27.648505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:27.652434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:27.656277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:27.658173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:27.667066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:27.667664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:27.717775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:37:27.729626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for user 284102156ef9461e93e4af60f9496aa2 and project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:37:27.776564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:37:27.783755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:37:27.925693 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63d3ecea-c0bc-47d0-b6cb-bf231d302689 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.388618 Nov 02 13:37:27.935837 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2288/4954] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:37:25 2022] POST /compute/v2.1/servers => generated 403 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:37:27.965828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5aebdaff-1f32-4824-a15f-613b08562292 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:27.972994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5aebdaff-1f32-4824-a15f-613b08562292 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:28.274649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aebdaff-1f32-4824-a15f-613b08562292 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:28.310671 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5aebdaff-1f32-4824-a15f-613b08562292 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1244 microversion: 2.1 time: 0.370211 Nov 02 13:37:28.329338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2289/4955] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:27 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1244 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:28.365557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-59f53d1e-465e-43b7-b382-49e3c8e9a982 req-d349b9a1-560a-47fb-8391-772a2a641db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084627dd-d1aa-4bc1-8968-9d0ca71baee2", "tag": "9974ad22-b414-4796-81e8-62170566e875"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:28.410373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-59f53d1e-465e-43b7-b382-49e3c8e9a982 req-d349b9a1-560a-47fb-8391-772a2a641db0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:28.412914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-59f53d1e-465e-43b7-b382-49e3c8e9a982 req-d349b9a1-560a-47fb-8391-772a2a641db0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:28.413624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-59f53d1e-465e-43b7-b382-49e3c8e9a982 req-d349b9a1-560a-47fb-8391-772a2a641db0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:28.474445 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-59f53d1e-465e-43b7-b382-49e3c8e9a982 req-d349b9a1-560a-47fb-8391-772a2a641db0 service nova] Creating event network-changed:9974ad22-b414-4796-81e8-62170566e875 for instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 on n-h1-858384-19 Nov 02 13:37:28.522342 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-59f53d1e-465e-43b7-b382-49e3c8e9a982 req-d349b9a1-560a-47fb-8391-772a2a641db0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188844 Nov 02 13:37:28.534946 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2290/4956] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:28.553735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:28.570778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bc0a1673-c563-48c5-b3c8-95b9be008dd7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 1.112413 Nov 02 13:37:28.576713 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2667/4957] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:27 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:29.361089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:29.367633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:29.409284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:29.409782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:29.410228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:29.410966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:29.415463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:29.415962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:29.606121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:29.606736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:29.641033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:29.646196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:29.648988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:29.650384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:29.651036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:29.651545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:29.679620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=93 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:29.791622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:29.817236 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bff09433-e5b8-48d5-81fe-5878bbc89bad tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1248 microversion: 2.1 time: 0.469339 Nov 02 13:37:29.823072 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2291/4958] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:29 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1248 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:30.033187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c54f6044-efc0-4119-8020-945112ca8dc8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:30.053052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c54f6044-efc0-4119-8020-945112ca8dc8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:30.053737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c54f6044-efc0-4119-8020-945112ca8dc8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:30.055376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c54f6044-efc0-4119-8020-945112ca8dc8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:30.188417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c54f6044-efc0-4119-8020-945112ca8dc8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Going to try to stop instance {{(pid=120929) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:37:30.324504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c54f6044-efc0-4119-8020-945112ca8dc8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/action" status: 202 len: 0 microversion: 2.1 time: 0.295826 Nov 02 13:37:30.336226 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2292/4959] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:37:30 2022] POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:37:30.358673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:30.371881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:30.382606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:30.391773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:30.394986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:30.396036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:30.396802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:30.397452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:30.598905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:30.608572 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a17c982-f84c-464b-9eec-33287b5b4793 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 1.010129 Nov 02 13:37:30.620386 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2668/4960] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:29 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:30.846899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:30.847663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:30.868949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:30.869483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:30.869949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:30.870709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:30.877174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:30.879572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:31.557006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:31.570452 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-537aef5f-8d12-4aa1-bdc6-bfc23040626c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1304 microversion: 2.1 time: 0.726306 Nov 02 13:37:31.572404 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2669/4961] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:30 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1304 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:31.642104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:31.644171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:31.667732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:31.671199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:31.673966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:31.674752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:31.675277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:31.682997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:31.847693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:31.868084 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1f7bd4f6-0799-4680-9120-e28766dd6893 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 1.529784 Nov 02 13:37:31.875914 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2293/4962] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:30 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:32.510291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:32.524041 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1dce70c7-6080-430c-8e7c-00f6d8678a30 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.893771 Nov 02 13:37:32.528173 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2670/4963] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:31 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:32.610978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:32.615372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:32.654352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:32.664368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:32.665498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:32.669486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:32.670911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:32.692247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:32.818385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:32.909505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:32.910630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:32.943763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:32.944599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:32.945408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:32.946713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:32.951776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:32.953129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:33.123262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:33.137299 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-666784b2-3e8f-491a-83c9-6cb9adf6496d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1302 microversion: 2.1 time: 0.534124 Nov 02 13:37:33.163150 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2294/4964] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:32 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1302 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:33.578997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:33.580568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:33.587931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:33.588428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:33.588868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:33.589594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:33.590047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:33.590467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:33.724674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:33.752707 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9b263fcd-d32f-4b69-8b04-f0821bfa60c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.850194 Nov 02 13:37:33.753343 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2671/4965] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:32 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:34.172145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:34.172786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:34.195775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:34.198354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:34.200412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:34.203742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:34.204882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:34.213680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:34.428273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:34.438020 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90660266-a1ea-4a3b-848e-2504060b979b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.863982 Nov 02 13:37:34.446044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:34.467179 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2295/4966] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:33 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:34.467576 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77625373-a29e-4b40-823a-b1cedb10259c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1302 microversion: 2.1 time: 0.291412 Nov 02 13:37:34.467576 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2672/4967] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:34 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1302 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:34.788465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:34.789769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:34.819571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:34.820093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:34.823648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:34.828753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:34.829347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:34.832052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:35.491460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:35.492077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:35.527495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:35.547342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:35.548267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:35.549329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:35.550006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:35.550972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:35.598542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:35.623728 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e1917067-a019-4969-a93a-681e4bed5dc5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.841352 Nov 02 13:37:35.624366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2296/4968] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:34 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:35.659676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:35.666032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:35.705858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:35.706648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:35.707306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:35.711569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:35.714275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:35.714976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:36.249856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:36.263697 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae9aa447-7499-4e98-aa97-e86e74608560 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.782725 Nov 02 13:37:36.269282 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2673/4969] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:35 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:36.457761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:36.467497 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-727a761b-0e3f-4be9-b9f1-7743b16aab61 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.842008 Nov 02 13:37:36.483942 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2297/4970] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:35 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:36.662488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:36.663259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:36.698053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:36.702862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:36.706214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:36.707682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:36.717770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:36.718685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:37.246212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:37.260381 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8526bfa-4e52-417b-98b7-a3d95c3387ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.612434 Nov 02 13:37:37.264830 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2674/4971] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:36 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:37.299287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:37.303345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:37.322152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:37.322649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:37.323167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:37.327532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:37.330659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:37.331263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:37.512562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:37.514719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:37.522636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:37.523440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:37.524096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:37.525522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:37.526306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:37.530648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:37.589968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:37.606759 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-78a63fba-c3ea-44cf-aa5c-4c4c1e2bc558 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.313257 Nov 02 13:37:37.608254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2298/4972] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:37 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:37.872100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:37.894902 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e934fa5d-f927-4de4-bd3f-2253dc34ceb8 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.388974 Nov 02 13:37:37.910180 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2675/4973] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:37 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:37.978613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de741164-bd10-4e5e-858b-f84895f85575 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Action: 'create', calling method: .version_select at 0x7fe7867631f0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-905060575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9XLKYmT7A+7DdbBtnbMTTbfJrwCiIB+R5+oEEI1w7EcJOXQtnUIqdrhtcwOoYVcCR6nmZpyJpfZERE54DZ0rMxvff4QofIFLDRsMDS5GqULqGRf4PEJbFhFtkQdXEqbw=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:37.989423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:38.002179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-de741164-bd10-4e5e-858b-f84895f85575 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Getting quotas for project 374b4c5a60fe42a6857b430d38750d8e. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:37:38.010217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-de741164-bd10-4e5e-858b-f84895f85575 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Getting quotas for user 892fbe677b334c899bdbf3e9b7bbb55b and project 374b4c5a60fe42a6857b430d38750d8e. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:37:38.048816 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de741164-bd10-4e5e-858b-f84895f85575 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.074504 Nov 02 13:37:38.073853 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2299/4974] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:37:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:38.286088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a263884d-9cd9-4873-b6ee-27e233958a81 req-d28b11a2-2c24-461e-b96e-9d27263d575e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9bb2256-24c1-4246-83bb-50eb3a869aab", "tag": "f8a4981f-357b-42a3-9414-c4df6ccea508"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:38.309986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:38.310626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:38.318152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:38.318649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:38.319089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:38.329181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a263884d-9cd9-4873-b6ee-27e233958a81 req-d28b11a2-2c24-461e-b96e-9d27263d575e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:38.329888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a263884d-9cd9-4873-b6ee-27e233958a81 req-d28b11a2-2c24-461e-b96e-9d27263d575e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:38.333052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a263884d-9cd9-4873-b6ee-27e233958a81 req-d28b11a2-2c24-461e-b96e-9d27263d575e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:38.334458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:38.339889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:38.340351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:38.354495 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a263884d-9cd9-4873-b6ee-27e233958a81 req-d28b11a2-2c24-461e-b96e-9d27263d575e service nova] Creating event network-changed:f8a4981f-357b-42a3-9414-c4df6ccea508 for instance c9bb2256-24c1-4246-83bb-50eb3a869aab on n-h2-858384-19 Nov 02 13:37:38.363492 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a263884d-9cd9-4873-b6ee-27e233958a81 req-d28b11a2-2c24-461e-b96e-9d27263d575e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078565 Nov 02 13:37:38.365198 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2676/4975] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:38.634558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:38.635559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:38.648018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:38.649344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:38.655403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:38.656403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:38.657192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:38.667944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:38.786961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:38.798432 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6cc5c89-0771-4df7-87f3-9fbb757fa683 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.493917 Nov 02 13:37:38.811516 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2300/4976] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:38 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:38.921025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:38.921642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:38.924602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:38.932625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:38.933123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:38.933562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:38.934269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:38.934720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:38.947552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:39.530813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:39.545808 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7caa1828-947e-42a5-9ec4-ba35bf9e780f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.628634 Nov 02 13:37:39.546412 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2301/4977] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:38 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:39.832478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:39.833098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:39.849794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:39.850293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:39.850734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:39.851921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:39.851921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:39.852382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:39.941706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:39.982699 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22b766c9-b4a7-4fa5-a57b-9c8779932bf5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 1.353814 Nov 02 13:37:39.995671 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2677/4978] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:38 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:40.236280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:40.252629 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-85f793d9-ea21-4f1a-9812-a08b75d83a1f tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.423987 Nov 02 13:37:40.253589 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2302/4979] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:39 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:40.577543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:40.578204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:40.590611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:40.591196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:40.591654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:40.592411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:40.592870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:40.593301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:40.932952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:40.945798 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4713c969-6fc8-41a3-b28b-8603b647da8d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.372717 Nov 02 13:37:40.964235 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2678/4980] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:40 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:41.033437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:41.034028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:41.043984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.047808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.049686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:41.053508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.054197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.056093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:41.286864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:41.287855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:41.299981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.302112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.302873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:41.304337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.306437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.307547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:41.430031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:41.440111 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-134d3381-5404-4661-9b6d-623c20cce45e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.410037 Nov 02 13:37:41.450689 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2303/4981] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:41 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:41.766078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:41.803941 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68b0619a-311d-4607-91d0-c242e1ae7dd9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.523034 Nov 02 13:37:41.816362 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2679/4982] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:41 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:41.962756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1502123926", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bab92cb1-4bc9-43cc-817b-403457d11ef9", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-905060575", "security_groups": [{"name": "tempest-secgroup-smoke-457412479"}], "networks": [{"uuid": "e49f6af9-d774-4cd2-abec-357478839bf2"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:41.977005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:41.979048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:41.986706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.987500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.988252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:41.989176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:41.990286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:41.990949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:42.205999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:42.215267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] validate_networks() for [('e49f6af9-d774-4cd2-abec-357478839bf2', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:37:42.224079 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-43225ea0-a8a0-40d3-8a26-3e9a0d6e007c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.251187 Nov 02 13:37:42.225190 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2680/4983] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:41 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:42.499310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:42.503846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:42.521463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:42.522808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:42.523488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:42.525522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:42.538136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:42.538901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:42.863073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:42.874658 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a37c5b2e-37e3-467c-b763-78a125476f4d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.399017 Nov 02 13:37:42.879729 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2681/4984] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:42 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:42.892358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:42.896680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:42.917477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:42.919260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:42.921374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:42.924491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:42.925444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:42.926970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:43.174941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:43.193068 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-baae925d-043e-4188-b19d-ff469c583c67 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.311848 Nov 02 13:37:43.193949 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2682/4985] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:42 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:43.258068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:43.258950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:43.271699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:43.274332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:43.274974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:43.280010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:43.280705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:43.281635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:43.675761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:43.689838 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-53fe3a21-496e-4109-b166-b11cb58e322c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.434628 Nov 02 13:37:43.692220 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2683/4986] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:43 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:43.906916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:43.908008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:43.922902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:43.923688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:43.926035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:43.927019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:43.931351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:43.932005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:43.978744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:37:43.979928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:37:43.980417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:37:43.980829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:37:43.981242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:37:44.002445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:44.004051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:44.009832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:44.013090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:44.013772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:44.014379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:44.065989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Getting quotas for project 374b4c5a60fe42a6857b430d38750d8e. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:37:44.079449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Getting quotas for user 892fbe677b334c899bdbf3e9b7bbb55b and project 374b4c5a60fe42a6857b430d38750d8e. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:37:44.297186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:44.301147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:37:44.304149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bab92cb1-4bc9-43cc-817b-403457d11ef9',volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:37:44.308650 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4d60c8b9-9f80-4b5e-885d-2977ae98b35c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.406938 Nov 02 13:37:44.309257 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2684/4987] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:43 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:44.333051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:44.333684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:44.361346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:44.361852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:44.362303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:44.363027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:44.370168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:44.370972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:44.452426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:44.631501 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-536ca61b-c4b1-491e-9c65-89c74dc5b983 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.673180 Nov 02 13:37:44.643870 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2304/4988] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:37:41 2022] POST /compute/v2.1/servers => generated 407 bytes in 2686 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:37:44.651219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dec643f9-d6a6-4bac-875a-98e805f3d3ee tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:44.653379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dec643f9-d6a6-4bac-875a-98e805f3d3ee tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:44.996305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:45.012369 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-791d50d5-d5a8-4046-a856-51a9790e85c1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.687675 Nov 02 13:37:45.014973 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2685/4989] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:44 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:45.026667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:45.028062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:45.036892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:45.054610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:45.057935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:45.060706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:45.061474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:45.065243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:45.563402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:45.576806 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4197202e-f7ec-4b87-985c-9400b6dd8c68 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.558117 Nov 02 13:37:45.579142 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2686/4990] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:45 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:45.618896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:45.620743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:45.633141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:45.633925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:45.634932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:45.635868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:45.638329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:45.639422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:45.888433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dec643f9-d6a6-4bac-875a-98e805f3d3ee tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:45.896040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=31 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:45.903018 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dec643f9-d6a6-4bac-875a-98e805f3d3ee tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1101 microversion: 2.1 time: 1.257261 Nov 02 13:37:45.904706 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2305/4991] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:44 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1101 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:46.042310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:46.043070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:46.064307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:46.064873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:46.065325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:46.066074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:46.066532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:46.066964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:46.091202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:46.111508 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-07fec7fd-5185-4970-b95c-ec503d8418c5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.523000 Nov 02 13:37:46.116049 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2687/4992] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:45 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:46.334313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:46.361577 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c17b760-1f8a-4561-8dcb-c218f5fdee9c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.324900 Nov 02 13:37:46.362188 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2306/4993] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:46 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:46.605145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:46.608080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:46.616829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:46.617772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:46.618557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:46.619769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:46.620825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:46.621439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:46.863155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:46.874481 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bd4a1d08-cad2-4dbd-af19-637a8b6f6c18 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.275839 Nov 02 13:37:46.875381 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2688/4994] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:46 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:46.932905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:46.934394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:46.946963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:46.947682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:46.948245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:46.949001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:46.949469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:46.950186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:47.071843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:47.082751 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b3405ed2-2363-4fcb-9599-9b70f3874183 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1199 microversion: 2.1 time: 0.157487 Nov 02 13:37:47.084104 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2307/4995] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:46 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1199 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:47.140769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:47.141395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:47.162079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:47.162500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:47.162952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:47.163714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:47.164176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:47.164689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:47.391848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:47.393047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:47.405559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:47.408042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:47.411540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:47.414012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:47.416340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:47.417108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:47.422697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:47.439919 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-78a4caf1-23dd-4d4c-8fb9-006648108fdd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.303619 Nov 02 13:37:47.440800 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2689/4996] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:47 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:47.900364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:47.901024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:47.918470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:47.918470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:47.918470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:47.918833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:47.919297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:47.919936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:47.955887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:47.975267 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-76402c9c-86d5-4d04-b388-5c57d20da49a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.583380 Nov 02 13:37:47.975971 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2308/4997] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:47 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:48.112620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:48.113785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:48.127306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:48.128045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:48.131687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:48.133578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:48.134278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:48.142203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:48.162253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:48.181732 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d62ad24a-3bb9-4b32-b1fa-2cd39252125c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.285802 Nov 02 13:37:48.187476 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2690/4998] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:47 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:48.310869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:48.319841 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ffd76532-7470-4021-838f-4bff63eddb1c tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1217 microversion: 2.1 time: 0.213628 Nov 02 13:37:48.337241 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2309/4999] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:48 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:48.470120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:48.470868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:48.480064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:48.483450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:48.488456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:48.489622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:48.490194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:48.490715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:48.823206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:48.836440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ab9f3303-deed-49fc-a534-2b322384dfb5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.368965 Nov 02 13:37:48.839515 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2691/5000] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:48 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:49.001383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:49.001990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:49.016392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:49.017183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:49.017795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:49.018660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:49.019307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:49.019891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:49.205808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:49.207246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:49.223358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:49.224088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:49.225239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:49.226145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:49.227336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:49.227982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:49.632763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:49.645213 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e0085ccc-0b3c-4e30-81c3-030ecf7fb41a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.443209 Nov 02 13:37:49.647140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2692/5001] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:49 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:49.655784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:49.666897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:49.690070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:49.690766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:49.694777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:49.701740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:49.702526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:49.703092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:49.819898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:49.829573 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b3e18d7f-d193-4f7e-818c-b4a6836811c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.832191 Nov 02 13:37:49.830800 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2310/5002] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:48 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:49.842458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:49.852602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f9b452f4-b1dc-4d47-b0de-73f9cdb2a3a5 req-79eeac1a-2e8c-4237-a0e5-50a3a21067ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084627dd-d1aa-4bc1-8968-9d0ca71baee2", "name": "network-vif-plugged", "status": "completed", "tag": "9974ad22-b414-4796-81e8-62170566e875"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:49.868688 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb185128-c09b-4827-8084-0d25d5b0802a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1217 microversion: 2.1 time: 0.214378 Nov 02 13:37:49.874127 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2693/5003] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:49 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:49.892956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f9b452f4-b1dc-4d47-b0de-73f9cdb2a3a5 req-79eeac1a-2e8c-4237-a0e5-50a3a21067ba service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:49.893773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:49.894754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:49.899853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f9b452f4-b1dc-4d47-b0de-73f9cdb2a3a5 req-79eeac1a-2e8c-4237-a0e5-50a3a21067ba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:49.900787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f9b452f4-b1dc-4d47-b0de-73f9cdb2a3a5 req-79eeac1a-2e8c-4237-a0e5-50a3a21067ba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:49.913971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:49.916970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:49.918075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:49.919501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:49.921424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:49.923366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:49.931700 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f9b452f4-b1dc-4d47-b0de-73f9cdb2a3a5 req-79eeac1a-2e8c-4237-a0e5-50a3a21067ba service nova] Creating event network-vif-plugged:9974ad22-b414-4796-81e8-62170566e875 for instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 on n-h1-858384-19 Nov 02 13:37:49.948085 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f9b452f4-b1dc-4d47-b0de-73f9cdb2a3a5 req-79eeac1a-2e8c-4237-a0e5-50a3a21067ba service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114593 Nov 02 13:37:49.950439 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2311/5004] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:50.312831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:50.325987 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-43a45277-dd3e-4282-9876-9420124320de tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.450341 Nov 02 13:37:50.340237 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2694/5005] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:49 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:50.682954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:50.684369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:50.711103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:50.714994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:50.717026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:50.719388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:50.720207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:50.721849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:50.853901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:50.854528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:50.870153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:50.870681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:50.871185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:50.872285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:50.872749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:50.873390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:51.205587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:51.215958 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4577081-ac02-45c0-abdf-360edd3e3514 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1312 microversion: 2.1 time: 0.545008 Nov 02 13:37:51.220524 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2312/5006] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:50 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1312 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:51.226608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:51.236025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:51.251638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:51.252607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:51.253220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:51.254130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:51.254753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:51.255384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:51.560360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:51.574866 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4d7de15c-92bf-42f7-927b-c4cdcf5f6f48 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.724804 Nov 02 13:37:51.576382 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2695/5007] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:50 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:51.584413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:51.585369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:51.599677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:51.600613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:51.601278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:51.602671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:51.603436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:51.605123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:51.818931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:51.829800 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5bd44228-5bee-41f2-8e76-43cd9714047a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1284 microversion: 2.1 time: 0.606988 Nov 02 13:37:51.850869 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2313/5008] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:51 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1284 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:51.984431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-adf91566-c891-4cfc-ac23-f0df3c403591 req-ab0b4971-9aaf-4b48-bdc7-f525f488948f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bb2256-24c1-4246-83bb-50eb3a869aab", "name": "network-vif-plugged", "status": "completed", "tag": "f8a4981f-357b-42a3-9414-c4df6ccea508"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:52.007626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-adf91566-c891-4cfc-ac23-f0df3c403591 req-ab0b4971-9aaf-4b48-bdc7-f525f488948f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:52.008642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-adf91566-c891-4cfc-ac23-f0df3c403591 req-ab0b4971-9aaf-4b48-bdc7-f525f488948f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:52.010191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-adf91566-c891-4cfc-ac23-f0df3c403591 req-ab0b4971-9aaf-4b48-bdc7-f525f488948f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:52.015105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:52.033943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:52.037304 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-adf91566-c891-4cfc-ac23-f0df3c403591 req-ab0b4971-9aaf-4b48-bdc7-f525f488948f service nova] Creating event network-vif-plugged:f8a4981f-357b-42a3-9414-c4df6ccea508 for instance c9bb2256-24c1-4246-83bb-50eb3a869aab on n-h2-858384-19 Nov 02 13:37:52.047776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1889c635-e4e0-4e1a-aaaf-95ee9d5c04dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.466282 Nov 02 13:37:52.049855 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-adf91566-c891-4cfc-ac23-f0df3c403591 req-ab0b4971-9aaf-4b48-bdc7-f525f488948f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069596 Nov 02 13:37:52.051796 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2696/5009] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:51 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:52.052893 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2314/5010] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:37:52.241611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-325ea0ca-fecd-4353-8f27-bc0410ba7406 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef0a06cf-44be-4ea1-9720-0a9c6bccbc81"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:52.247160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-325ea0ca-fecd-4353-8f27-bc0410ba7406 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:52.284807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-325ea0ca-fecd-4353-8f27-bc0410ba7406 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:52.286131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-325ea0ca-fecd-4353-8f27-bc0410ba7406 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:52.287666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-325ea0ca-fecd-4353-8f27-bc0410ba7406 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:52.296153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-325ea0ca-fecd-4353-8f27-bc0410ba7406 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:52.298708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-325ea0ca-fecd-4353-8f27-bc0410ba7406 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:52.299419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-325ea0ca-fecd-4353-8f27-bc0410ba7406 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:52.667222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:52.667951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:52.696239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:52.696937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:52.697394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:52.698142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:52.698598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:52.699026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:52.845031 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-325ea0ca-fecd-4353-8f27-bc0410ba7406 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609111 Nov 02 13:37:52.854295 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2697/5011] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:37:52 2022] POST /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 194 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:52.866794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:52.867867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:52.885852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:52.886494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:52.887150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:52.889178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:52.891143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:52.893788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:53.306350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:53.321147 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d9d186a7-e6ca-401b-8bb3-a03a5da0d6d0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.464267 Nov 02 13:37:53.322225 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2698/5012] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:52 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:53.333358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:53.336997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:53.349696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:53.356034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:53.356617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:53.357587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:53.358542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:53.358716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:53.838613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:53.893106 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f01b35b3-1252-4ba0-82f0-4cf1fea3c221 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1492 microversion: 2.1 time: 1.630066 Nov 02 13:37:53.893810 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2315/5013] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:52 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1492 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:53.906517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:53.911594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:53.936740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:53.939053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:53.939915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:53.942062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:53.947296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:53.948930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:53.996692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:54.016166 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-496fa61a-de62-44ac-88f9-67fa6f5c7bb2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1284 microversion: 2.1 time: 0.690457 Nov 02 13:37:54.019488 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2699/5014] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:53 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1284 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:54.052862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:54.053732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:54.059711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:54.091333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:54.093018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:54.093539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:54.095180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:54.096326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:54.097371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:54.190228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:37:54.199946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:54.408031 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7882eba2-84d1-438f-ad11-a285a8394a9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 204 len: 0 microversion: 2.1 time: 0.380405 Nov 02 13:37:54.410128 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2700/5015] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:37:54 2022] DELETE /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:37:54.423358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5c6c70dc-eda0-4337-9fc5-c2e9fbb1b2ee req-975088e1-4b5b-4a84-a236-bdce772388f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d69a6e-5de9-4dfc-b377-9f50068906b0", "tag": "e25a428f-563b-4402-8188-e1f4d3257186"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:54.454673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5c6c70dc-eda0-4337-9fc5-c2e9fbb1b2ee req-975088e1-4b5b-4a84-a236-bdce772388f9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:54.455506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5c6c70dc-eda0-4337-9fc5-c2e9fbb1b2ee req-975088e1-4b5b-4a84-a236-bdce772388f9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:54.456065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5c6c70dc-eda0-4337-9fc5-c2e9fbb1b2ee req-975088e1-4b5b-4a84-a236-bdce772388f9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:54.482515 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5c6c70dc-eda0-4337-9fc5-c2e9fbb1b2ee req-975088e1-4b5b-4a84-a236-bdce772388f9 service nova] Creating event network-changed:e25a428f-563b-4402-8188-e1f4d3257186 for instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 on n-h1-858384-19 Nov 02 13:37:54.490062 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5c6c70dc-eda0-4337-9fc5-c2e9fbb1b2ee req-975088e1-4b5b-4a84-a236-bdce772388f9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077383 Nov 02 13:37:54.497710 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2701/5016] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:54.503761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:54.509730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:54.527903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:54.531586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:54.532201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:54.534883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:54.535645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:54.538820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:54.619936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:54.638065 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16b2f0ea-2fe5-4e52-bb7e-390da7847e8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1369 microversion: 2.1 time: 0.740821 Nov 02 13:37:54.641982 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2316/5017] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:53 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1369 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:54.650299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:54.653637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:54.671827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:54.672588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:54.673486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:54.674469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:54.678211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:54.678930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:55.072386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:55.097108 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-56ed9978-f7b1-46c6-ae56-dd841e549ecc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.597641 Nov 02 13:37:55.097991 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2702/5018] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:54 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:55.110769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:55.111623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:55.122872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:55.123665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:55.124990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:55.129469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:55.130751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:55.131397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:55.211592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:55.226216 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22476db3-820d-4010-a73c-4942f100b5aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1498 microversion: 2.1 time: 0.579493 Nov 02 13:37:55.227283 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2317/5019] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:54 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1498 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:55.560429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:55.575376 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c21f03a4-7be5-4a0f-9d03-7d0290dbcee8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1284 microversion: 2.1 time: 0.476001 Nov 02 13:37:55.576671 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2703/5020] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:55 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1284 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:55.673117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:55.673117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:55.679363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:55.681083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:55.681837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:55.684673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:55.685735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:55.686423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:56.060421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:56.130115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:56.131702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:56.140491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:37:56.144074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:56.145087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:56.147297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:56.148935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:56.149664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:56.150538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:56.209217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:56.230638 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-41b42238-c32c-4d2c-9031-a3a7eb07b444 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1558 microversion: 2.1 time: 0.568481 Nov 02 13:37:56.232183 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2318/5021] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:55 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1558 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:56.260037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:56.265928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:56.283581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:56.286866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:56.287784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:56.290235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:56.293154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:56.293895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:56.597319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:56.609622 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-98b30c6e-3c85-40c0-a94a-5b53b56dca4d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1725 microversion: 2.1 time: 0.484463 Nov 02 13:37:56.623630 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2704/5022] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:56 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1725 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:56.643035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b04f32f9-5cc3-4d7c-8dd9-6fcf1755a578 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:56.644670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b04f32f9-5cc3-4d7c-8dd9-6fcf1755a578 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:56.653820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b04f32f9-5cc3-4d7c-8dd9-6fcf1755a578 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:56.654542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b04f32f9-5cc3-4d7c-8dd9-6fcf1755a578 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:56.657875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b04f32f9-5cc3-4d7c-8dd9-6fcf1755a578 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:56.662468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b04f32f9-5cc3-4d7c-8dd9-6fcf1755a578 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:56.667065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b04f32f9-5cc3-4d7c-8dd9-6fcf1755a578 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:56.667939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b04f32f9-5cc3-4d7c-8dd9-6fcf1755a578 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:56.978540 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b04f32f9-5cc3-4d7c-8dd9-6fcf1755a578 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.353407 Nov 02 13:37:56.979506 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2705/5023] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:37:56 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab/os-interface => generated 284 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:37:56.987970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:56.987970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:57.005253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:57.005901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:57.006455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:57.007367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:57.008012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:57.008550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:57.725022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:57.740990 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-37eda97c-7c15-4cd1-9c25-b42061050442 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.760274 Nov 02 13:37:57.743442 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2706/5024] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:56 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:57.753879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:57.762372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:57.771566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:57.771799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:57.772372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:57.772931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:57.773338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:57.783599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:58.990210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:59.016916 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93a167fc-fedd-47e9-94f0-4225034b87f4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1702 microversion: 2.1 time: 1.271845 Nov 02 13:37:59.043968 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2707/5025] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:57 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1702 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:59.056507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:59.083047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:59.104571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:59.107740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:59.113021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:59.114110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:59.115254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:59.116536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:59.632212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:59.656021 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9cbeef97-4f28-4a60-9837-7a3bd6bbf906 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1498 microversion: 2.1 time: 3.402945 Nov 02 13:37:59.657205 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2319/5026] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:56 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1498 bytes in 3406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:37:59.663607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7fd67dd9-cb04-47fe-8ab8-f3c445f5b484 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:37:59.681335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fd67dd9-cb04-47fe-8ab8-f3c445f5b484 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:59.682125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fd67dd9-cb04-47fe-8ab8-f3c445f5b484 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:59.682980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fd67dd9-cb04-47fe-8ab8-f3c445f5b484 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:59.708250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:37:59.721912 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a383ba47-819c-4500-b74e-906850dd5580 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.676050 Nov 02 13:37:59.728238 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2708/5027] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:59 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:37:59.758747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7fd67dd9-cb04-47fe-8ab8-f3c445f5b484 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Going to try to start instance {{(pid=120929) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 13:37:59.875719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7fd67dd9-cb04-47fe-8ab8-f3c445f5b484 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/action" status: 202 len: 0 microversion: 2.1 time: 0.216853 Nov 02 13:37:59.885333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:37:59.885965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:37:59.889913 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2320/5028] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:37:59 2022] POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:37:59.893134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:59.893678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:59.894202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:37:59.894972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:37:59.896876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:37:59.897332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:00.274081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:00.298330 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9078a576-5552-4ee6-84b2-93689aec187a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1711 microversion: 2.1 time: 0.417682 Nov 02 13:38:00.314934 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2709/5029] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:37:59 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1711 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:00.689446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:00.690291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:00.705852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:00.706920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:00.708408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:00.709567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:00.710333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:00.716806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:00.759877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:00.760913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:00.780019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:00.781334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:00.782886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:00.784633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:00.787572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:00.796851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:01.105632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:01.119032 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-978a45a3-504e-4087-af13-eb62aba85a91 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1498 microversion: 2.1 time: 0.435584 Nov 02 13:38:01.119672 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2321/5030] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:00 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1498 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:01.154810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-bab55896-4e3b-4050-b20a-a0f4c92aee94 req-49ebf30a-60f2-4615-a236-7d629c295093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9bb2256-24c1-4246-83bb-50eb3a869aab", "tag": "f8a4981f-357b-42a3-9414-c4df6ccea508"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:01.172778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bab55896-4e3b-4050-b20a-a0f4c92aee94 req-49ebf30a-60f2-4615-a236-7d629c295093 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:01.173261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bab55896-4e3b-4050-b20a-a0f4c92aee94 req-49ebf30a-60f2-4615-a236-7d629c295093 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:01.173712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bab55896-4e3b-4050-b20a-a0f4c92aee94 req-49ebf30a-60f2-4615-a236-7d629c295093 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:01.204015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-bab55896-4e3b-4050-b20a-a0f4c92aee94 req-49ebf30a-60f2-4615-a236-7d629c295093 service nova] Creating event network-changed:f8a4981f-357b-42a3-9414-c4df6ccea508 for instance c9bb2256-24c1-4246-83bb-50eb3a869aab on n-h2-858384-19 Nov 02 13:38:01.217492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-bab55896-4e3b-4050-b20a-a0f4c92aee94 req-49ebf30a-60f2-4615-a236-7d629c295093 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072301 Nov 02 13:38:01.220355 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2322/5031] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:01.323921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:01.325008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:01.339642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:01.340479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:01.341621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:01.343623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:01.346768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:01.347414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:01.699181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:01.709564 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dd77c718-6275-4475-b0d9-4e0cc769ae44 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.962232 Nov 02 13:38:01.716281 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2710/5032] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:00 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:02.011632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:02.028114 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d5dc1a40-c8a0-479f-8895-59b48b215f78 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1711 microversion: 2.1 time: 0.709756 Nov 02 13:38:02.029344 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2323/5033] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:01 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1711 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:02.149586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:02.150609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:02.165719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:02.166664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:02.174312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:02.175484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:02.176416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:02.177114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:02.363583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:02.373104 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d24a859e-093a-48d0-b193-81e54e828d4c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1456 microversion: 2.1 time: 0.227685 Nov 02 13:38:02.387659 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2711/5034] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:02 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1456 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:02.568050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e7deec4d-fcb1-419c-a434-4cd23a668358 req-38519f55-52d1-43bd-8477-10a7750cf514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084627dd-d1aa-4bc1-8968-9d0ca71baee2", "name": "network-vif-deleted", "tag": "9974ad22-b414-4796-81e8-62170566e875"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:02.605969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e7deec4d-fcb1-419c-a434-4cd23a668358 req-38519f55-52d1-43bd-8477-10a7750cf514 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:02.606474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e7deec4d-fcb1-419c-a434-4cd23a668358 req-38519f55-52d1-43bd-8477-10a7750cf514 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:02.609256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e7deec4d-fcb1-419c-a434-4cd23a668358 req-38519f55-52d1-43bd-8477-10a7750cf514 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:02.638213 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e7deec4d-fcb1-419c-a434-4cd23a668358 req-38519f55-52d1-43bd-8477-10a7750cf514 service nova] Creating event network-vif-deleted:9974ad22-b414-4796-81e8-62170566e875 for instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 on n-h1-858384-19 Nov 02 13:38:02.667502 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e7deec4d-fcb1-419c-a434-4cd23a668358 req-38519f55-52d1-43bd-8477-10a7750cf514 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099413 Nov 02 13:38:02.670269 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2324/5035] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:02.738559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:02.739204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:02.751258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:02.752009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:02.760764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:02.761835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:02.762476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:02.763099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:03.036061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:03.044464 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10256da1-2d7e-49cb-b43d-260420431aec tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.310010 Nov 02 13:38:03.052441 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2712/5036] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:02 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:03.062544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:03.064120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:03.079851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:03.080526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:03.081092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:03.082740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:03.083454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:03.084014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:03.397868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:03.398634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:03.409042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:03.410770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:03.413258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:03.415197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:03.416564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:03.417386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:03.494786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:03.495696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:03.506501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:03.507337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lazy-loading 'fault' on Instance uuid 084627dd-d1aa-4bc1-8968-9d0ca71baee2 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:38:03.629449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:03.651744 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e5453d85-0178-4b2c-915f-cea73eecdc40 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 200 len: 1302 microversion: 2.1 time: 0.257637 Nov 02 13:38:03.668047 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2713/5037] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:03 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 1302 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:03.950597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:03.968998 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-55614283-18d1-4a21-b780-7f1e89d3b9e4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1711 microversion: 2.1 time: 0.914717 Nov 02 13:38:03.970817 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2325/5038] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:03 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1711 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:04.084253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:04.084253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:04.098650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:04.099728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:04.100427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:04.103790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:04.104357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:04.104903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:04.592984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:04.606539 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-26c6bc40-e5d2-44ff-8f78-0aef60e51f70 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.530251 Nov 02 13:38:04.607785 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2714/5039] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:04 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:04.690791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:04.691449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:04.704852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:04.706003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:04.706777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:04.707902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:04.708819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:04.709413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:04.733888 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 HTTP/1.1 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '084627dd-d1aa-4bc1-8968-9d0ca71baee2'} Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:04.736701 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:04.743553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:04.743553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:04.743553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:04.743553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:04.743553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:04.743553 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:04.747319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:04.748468 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-14bfbdab-8848-4295-bfe7-ddf3ab74793f tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 404 len: 111 microversion: 2.1 time: 0.070146 Nov 02 13:38:04.749594 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2326/5040] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:04 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:38:04.761676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ccac846d-092e-424e-a9d6-25b600ab3080 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe787bc89d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:04.999387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:05.000009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:05.009264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:05.009758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:05.010194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:05.010910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:05.015902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:05.016403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:05.312774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:05.325651 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a66992e3-6546-4ceb-966b-0de4b5ba799e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1715 microversion: 2.1 time: 0.330365 Nov 02 13:38:05.326603 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2327/5041] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:04 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1715 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:05.630021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:05.630526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:05.646650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:05.647164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:05.647609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:05.648996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:05.649560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:05.650094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:05.994904 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ccac846d-092e-424e-a9d6-25b600ab3080 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 204 len: 0 microversion: 2.1 time: 1.241165 Nov 02 13:38:05.995539 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2715/5042] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:04 2022] DELETE /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 0 bytes in 1243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:38:06.004226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:06.005109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:06.019480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:06.020322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:06.020961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:06.021895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:06.022762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:06.024216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:06.075299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:38:06.095081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:06.127987 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a25b2ea2-55e2-46ab-87f0-318146344245 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.501740 Nov 02 13:38:06.157807 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2328/5043] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:05 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:06.176789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:06.268465 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3eac0209-a561-45bd-b43d-6685bc523bc2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 204 len: 0 microversion: 2.1 time: 0.268026 Nov 02 13:38:06.271086 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2716/5044] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:38:05 2022] DELETE /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:38:06.436911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-564741320", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "47bb2f77-f27b-4713-bfef-5f74b66d9d9d"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:06.514464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] validate_networks() for [('47bb2f77-f27b-4713-bfef-5f74b66d9d9d', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:38:07.158311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:07.160183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:07.171649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:07.172924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:07.173657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:07.174839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:07.175445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:07.176109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:07.801508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:07.825719 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e2ba2f48-5bdc-41d8-9acd-06836b070401 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.672132 Nov 02 13:38:07.826806 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2717/5045] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:07 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:07.855453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:38:07.856631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:38:07.857818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:38:07.858298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:38:07.858789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:38:07.877087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:07.880955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:07.881171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:07.884439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:07.885183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:07.887105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:07.954249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:38:07.966842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Getting quotas for user be8bee2d23fa481193b5a23cf2348a73 and project 2c84219a3a5940359107491dec2ac311. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:38:08.022971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:38:08.026933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:38:08.105806 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5bef8816-f3e7-4c02-8dbe-f73ef7fa4847 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.679982 Nov 02 13:38:08.107338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2329/5046] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:38:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:38:08.119825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f0ece5c2-1daa-446e-814e-da4d42b2fa16 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:08.120453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f0ece5c2-1daa-446e-814e-da4d42b2fa16 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:08.260130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f0ece5c2-1daa-446e-814e-da4d42b2fa16 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:08.278363 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f0ece5c2-1daa-446e-814e-da4d42b2fa16 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1211 microversion: 2.1 time: 0.156637 Nov 02 13:38:08.283141 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2718/5047] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:08 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1211 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:08.860599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:08.862205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:08.882192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:08.882876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:08.883600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:08.884502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:08.889145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:08.889824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:09.305778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:09.306611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:09.318201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:09.325307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:09.326040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:09.327000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:09.327744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:09.331972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:09.465110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:09.478395 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-25cd3956-c5e1-4841-a873-4375c090962e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1215 microversion: 2.1 time: 0.177959 Nov 02 13:38:09.480709 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2719/5048] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:09 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:10.151039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:10.168402 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f002208-8106-4ab5-8476-c0206f5ef529 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 1.320628 Nov 02 13:38:10.171908 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2330/5049] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:08 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:10.426395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:10.429590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:10.446071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:10.450911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:10.453158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:10.454163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:10.455985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:10.456739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:10.504597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:10.505688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:10.510625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:10.513810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lazy-loading 'flavor' on Instance uuid 16c00a03-1b4e-490c-814c-84c520dbab62 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:38:10.531311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:10.532668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:10.536409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:10.537487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:10.541019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:10.543077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:10.795788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:10.811704 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-06336dfd-8a5b-401b-9f10-4d276eb1620d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1263 microversion: 2.1 time: 0.312483 Nov 02 13:38:10.812339 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2331/5050] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:10 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1263 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:10.892115 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f859201e-5b64-4f5b-9196-5d96bcce0e74 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/action" status: 200 len: 32 microversion: 2.1 time: 0.469534 Nov 02 13:38:10.894091 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2720/5051] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:38:10 2022] POST /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/action => generated 32 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:38:10.903470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:10.904271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:10.957600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:10.960645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:10.962317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:10.963378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:10.964904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:10.966177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:11.202603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:11.204480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:11.214152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:11.215216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:11.216024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:11.217036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:11.217750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:11.218686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:11.615860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:11.626728 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0f0c570e-5ac5-47d7-bcec-21025c6b7992 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.432137 Nov 02 13:38:11.628149 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2721/5052] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:11 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:11.721884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:11.746754 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-931cac5c-3bcc-4c2e-81e8-5828dec2bd96 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.847200 Nov 02 13:38:11.747891 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2332/5053] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:10 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:11.838219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:11.839134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:11.848264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:11.849047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:11.849642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:11.850530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:11.851939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:11.852550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:11.927751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a108fe75-1a07-488c-bbd4-e61d869385a9 req-72f69f44-cdc7-42c1-abc2-1c90c4b552a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f169f362-c1bc-4f18-82d1-b9a374465550", "name": "network-vif-deleted", "tag": "2cdee1e3-4520-4371-908d-a2d305795caf"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:11.952028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a108fe75-1a07-488c-bbd4-e61d869385a9 req-72f69f44-cdc7-42c1-abc2-1c90c4b552a5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:11.952781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a108fe75-1a07-488c-bbd4-e61d869385a9 req-72f69f44-cdc7-42c1-abc2-1c90c4b552a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:11.953416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a108fe75-1a07-488c-bbd4-e61d869385a9 req-72f69f44-cdc7-42c1-abc2-1c90c4b552a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:11.957892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:11.967054 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a108fe75-1a07-488c-bbd4-e61d869385a9 req-72f69f44-cdc7-42c1-abc2-1c90c4b552a5 service nova] Creating event network-vif-deleted:2cdee1e3-4520-4371-908d-a2d305795caf for instance f169f362-c1bc-4f18-82d1-b9a374465550 on n-h2-858384-19 Nov 02 13:38:11.973237 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a108fe75-1a07-488c-bbd4-e61d869385a9 req-72f69f44-cdc7-42c1-abc2-1c90c4b552a5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049964 Nov 02 13:38:11.974080 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2333/5054] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:38:12.001462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:12.012923 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-377539e3-d5a2-4939-9a80-cb88dd69f493 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1269 microversion: 2.1 time: 0.178803 Nov 02 13:38:12.018287 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2722/5055] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:11 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:12.655489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:12.656377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:12.677282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:12.678201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:12.680217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:12.681021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:12.681982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:12.682605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:12.770009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:12.770732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:12.788212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:12.795571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:12.797313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:12.801316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:12.806929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:12.811149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:13.198482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:13.216345 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ca754a8-e715-4807-bc33-00b31fc8915f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.450375 Nov 02 13:38:13.234125 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2723/5056] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:12 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:13.240213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:13.249896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:13.250832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:13.252077 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-33207924-6ef7-4446-870a-e599d778664f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.599188 Nov 02 13:38:13.253788 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2334/5057] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:12 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:13.262891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:13.264961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:13.265711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-0aaae0a6-1b31-4d59-b55a-194cd1dbaf6f req-d99f39e8-d915-41ad-9653-a051b0a9a2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d69a6e-5de9-4dfc-b377-9f50068906b0", "name": "network-vif-plugged", "status": "completed", "tag": "e25a428f-563b-4402-8188-e1f4d3257186"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:13.267738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:13.268721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:13.269803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:13.270413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:13.294443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0aaae0a6-1b31-4d59-b55a-194cd1dbaf6f req-d99f39e8-d915-41ad-9653-a051b0a9a2ce service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:13.295121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0aaae0a6-1b31-4d59-b55a-194cd1dbaf6f req-d99f39e8-d915-41ad-9653-a051b0a9a2ce service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:13.295568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0aaae0a6-1b31-4d59-b55a-194cd1dbaf6f req-d99f39e8-d915-41ad-9653-a051b0a9a2ce service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:13.317245 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-0aaae0a6-1b31-4d59-b55a-194cd1dbaf6f req-d99f39e8-d915-41ad-9653-a051b0a9a2ce service nova] Creating event network-vif-plugged:e25a428f-563b-4402-8188-e1f4d3257186 for instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 on n-h1-858384-19 Nov 02 13:38:13.327956 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-0aaae0a6-1b31-4d59-b55a-194cd1dbaf6f req-d99f39e8-d915-41ad-9653-a051b0a9a2ce service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072879 Nov 02 13:38:13.331237 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2335/5058] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:13.843866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:13.853341 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f07daee6-fd80-4e2f-b86a-c79d513099fc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.617668 Nov 02 13:38:13.856245 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2724/5059] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:13 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:14.263547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:14.264590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:14.280692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:14.281505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:14.289437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:14.290666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:14.291779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:14.293141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:14.294934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:14.298725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:14.300138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:14.301032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:14.301776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:14.303804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:14.304686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:14.305407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:14.779323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:14.803988 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f4c6a4c-d5ce-4516-a8fa-147f6c07dc28 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.548182 Nov 02 13:38:14.815149 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2336/5060] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:14 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:14.881746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:14.883014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:14.891970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:14.892583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:14.893126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:14.894088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:14.894655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:14.895754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:14.906490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:14.915064 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca926fdd-96fe-4df1-ba20-905bfa6cf76f tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1272 microversion: 2.1 time: 0.638872 Nov 02 13:38:14.915702 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2725/5061] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:14 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1272 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:15.549690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:15.568322 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7711c1ba-9500-4906-81a6-5b2d91e46197 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.689849 Nov 02 13:38:15.569132 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2337/5062] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:14 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:15.836463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:15.837221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:15.849495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:15.855603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:15.856594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:15.858208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:15.860185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:15.860905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:15.938726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:15.939819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:15.947631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:15.948518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:15.949209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:15.950320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:15.951005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:15.951698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:16.152352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:16.183526 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f4cd4b0-6f91-4599-a666-b15d747e5365 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.354975 Nov 02 13:38:16.204454 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2726/5063] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:15 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:16.342216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:16.350507 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d49db814-49a5-4111-99b7-bdd5830fbff8 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1460 microversion: 2.1 time: 0.416201 Nov 02 13:38:16.351745 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2338/5064] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:15 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1460 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:16.375805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:16.376794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:16.391268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:16.393852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:16.395089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:16.397474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:16.398887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:16.402204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:16.593844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:16.595475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:16.611235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:16.611748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:16.612187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:16.612905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:16.613367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:16.613803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:16.702281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:16.715724 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f58e06ba-9adb-48f1-996d-a8286619419b tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1460 microversion: 2.1 time: 0.343220 Nov 02 13:38:16.722829 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2727/5065] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:16 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1460 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:16.773679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6cd15331-426d-4869-b2b3-03ecf7afaba2 req-ac9866ad-804c-4495-8280-07bda68622dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb7a6675-f3e7-4785-9548-2f6ec451789f", "tag": "9b198dd3-8ad9-4e0a-92b4-29f5be7399f8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:16.798464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6cd15331-426d-4869-b2b3-03ecf7afaba2 req-ac9866ad-804c-4495-8280-07bda68622dc service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:16.803522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6cd15331-426d-4869-b2b3-03ecf7afaba2 req-ac9866ad-804c-4495-8280-07bda68622dc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:16.804660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6cd15331-426d-4869-b2b3-03ecf7afaba2 req-ac9866ad-804c-4495-8280-07bda68622dc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:16.839059 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6cd15331-426d-4869-b2b3-03ecf7afaba2 req-ac9866ad-804c-4495-8280-07bda68622dc service nova] Creating event network-changed:9b198dd3-8ad9-4e0a-92b4-29f5be7399f8 for instance cb7a6675-f3e7-4785-9548-2f6ec451789f on n-h1-858384-19 Nov 02 13:38:16.850254 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6cd15331-426d-4869-b2b3-03ecf7afaba2 req-ac9866ad-804c-4495-8280-07bda68622dc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093171 Nov 02 13:38:16.852591 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2728/5066] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:16.988676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:16.999982 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-680f51cd-18bb-4825-bb3c-3b5676013ab2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.409899 Nov 02 13:38:17.001130 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2339/5067] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:16 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:17.214205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:17.216899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:17.233685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:17.235784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:17.237233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:17.238732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:17.240934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:17.242301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:17.800855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:17.816837 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b4323a00-4b9b-43f5-ace0-db83529e1500 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.606053 Nov 02 13:38:17.818483 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2729/5068] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:17 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:18.026652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:18.027939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:18.031544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:18.033340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:18.063654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:18.068461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:18.069296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:18.070286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:18.072423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:18.073588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:18.512135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:18.529315 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-59e96541-f270-4698-9840-b9c2e0423c25 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.502259 Nov 02 13:38:18.546704 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2340/5069] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:18 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:18.841929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:18.843514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:18.847372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:18.855498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:18.856123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:18.856723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:18.857712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:18.858258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:18.858772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:19.557918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:19.558518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:19.575176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:19.576683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:19.577149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:19.580233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:19.580741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:19.582537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:19.625071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:19.643000 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4dd5695e-c2bc-4bcc-8d06-61d1e8569535 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.805011 Nov 02 13:38:19.650512 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2730/5070] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:18 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:19.945670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-25c07988-9a82-49e8-b257-1c8bb3e3aefd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:19.948413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25c07988-9a82-49e8-b257-1c8bb3e3aefd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:19.949174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25c07988-9a82-49e8-b257-1c8bb3e3aefd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:19.949937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25c07988-9a82-49e8-b257-1c8bb3e3aefd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:19.950991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25c07988-9a82-49e8-b257-1c8bb3e3aefd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:19.953023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25c07988-9a82-49e8-b257-1c8bb3e3aefd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:19.953757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25c07988-9a82-49e8-b257-1c8bb3e3aefd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:19.990130 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-25c07988-9a82-49e8-b257-1c8bb3e3aefd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.213075 Nov 02 13:38:20.006107 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2731/5071] 10.222.0.113 () {58 vars in 1190 bytes} [Wed Nov 2 13:38:19 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:20.024064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:20.032688 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a734c1ef-03f7-4589-ad01-254e9768cd72 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.482759 Nov 02 13:38:20.033824 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2341/5072] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:19 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:20.202823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-7649907", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "availability_zone": "nova:n-h1-858384-19", "networks": [{"uuid": "e6cbbbf8-34ff-424f-bf6e-3181064479a7"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:20.295020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] validate_networks() for [('e6cbbbf8-34ff-424f-bf6e-3181064479a7', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:38:20.675466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:20.676255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:20.685347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:20.685843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:20.690240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:20.691011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:20.693795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:20.694820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:21.095057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:21.107458 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-78693f3f-bd59-4f48-8afd-5e48a2946bed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.437319 Nov 02 13:38:21.108086 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2342/5073] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:20 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:21.137633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:21.138660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:21.164459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:21.170359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:21.175792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:21.176814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:21.177452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:21.178052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:21.730053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:21.742843 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec1b43cb-d9ab-4a5b-8ec6-6a8d54ea084b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.633522 Nov 02 13:38:21.751338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2343/5074] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:21 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:22.057833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:38:22.058827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:38:22.059386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:38:22.059997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:38:22.061677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:38:22.087907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:22.092056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:22.092690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:22.093654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:22.094273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:22.098237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:22.134622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:22.135208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:22.187414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:22.188063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:22.188528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:22.189284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:22.189741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:22.190176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:22.213197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Getting quotas for project 459eeaac191e4ab7ae1c40b7d204a8e7. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:38:22.222094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Getting quotas for user f17b83b4a50d42c4b60eb71ea6bc7d09 and project 459eeaac191e4ab7ae1c40b7d204a8e7. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:38:22.249147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:38:22.252226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:38:22.382649 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c5d6ba5c-eb2d-43fe-88cb-0d3778765477 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.183871 Nov 02 13:38:22.384157 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2732/5075] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:38:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:38:22.404647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-49660d71-8fc4-4555-8600-331c38a04dba req-8237bd94-9873-48ad-9ec8-01f058090b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d69a6e-5de9-4dfc-b377-9f50068906b0", "tag": "e25a428f-563b-4402-8188-e1f4d3257186"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:22.421156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-49660d71-8fc4-4555-8600-331c38a04dba req-8237bd94-9873-48ad-9ec8-01f058090b07 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:22.423520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-49660d71-8fc4-4555-8600-331c38a04dba req-8237bd94-9873-48ad-9ec8-01f058090b07 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:22.424124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-49660d71-8fc4-4555-8600-331c38a04dba req-8237bd94-9873-48ad-9ec8-01f058090b07 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:22.444564 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-49660d71-8fc4-4555-8600-331c38a04dba req-8237bd94-9873-48ad-9ec8-01f058090b07 service nova] Creating event network-changed:e25a428f-563b-4402-8188-e1f4d3257186 for instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 on n-h1-858384-19 Nov 02 13:38:22.450856 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-49660d71-8fc4-4555-8600-331c38a04dba req-8237bd94-9873-48ad-9ec8-01f058090b07 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065284 Nov 02 13:38:22.452292 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2733/5076] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:22.460840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d979e172-0fd2-443f-83cc-20726147acbd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:22.462015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d979e172-0fd2-443f-83cc-20726147acbd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:22.754788 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d979e172-0fd2-443f-83cc-20726147acbd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1330 microversion: 2.1 time: 0.299830 Nov 02 13:38:22.758976 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2734/5077] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:22 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1330 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:22.770408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:22.774926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:22.784242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:22.785167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:22.785769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:22.787620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:22.790008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:22.790722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:22.796403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:22.854583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:22.875523 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed0ef1a5-5e12-4561-9886-45e67970b3d0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.744841 Nov 02 13:38:22.878903 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2344/5078] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:22 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:23.317667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:23.336969 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b951bdb5-26f1-4434-87b8-61f2fa336912 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.570761 Nov 02 13:38:23.357715 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2735/5079] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:22 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:23.788959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da6c8bc2-04ab-49cc-97d6-d973c418da57 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:23.790541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da6c8bc2-04ab-49cc-97d6-d973c418da57 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:23.802005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6c8bc2-04ab-49cc-97d6-d973c418da57 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:23.807177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6c8bc2-04ab-49cc-97d6-d973c418da57 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:23.809245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6c8bc2-04ab-49cc-97d6-d973c418da57 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:23.810975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6c8bc2-04ab-49cc-97d6-d973c418da57 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:23.818052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6c8bc2-04ab-49cc-97d6-d973c418da57 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:23.821693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6c8bc2-04ab-49cc-97d6-d973c418da57 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:23.924532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:23.925287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:23.960847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:23.961287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:23.964042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:23.966645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:23.970490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:23.971735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:24.142991 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da6c8bc2-04ab-49cc-97d6-d973c418da57 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1347 microversion: 2.1 time: 0.363169 Nov 02 13:38:24.168740 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2345/5080] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:23 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1347 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:24.372644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:24.375125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:24.395671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:24.395671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:24.395671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:24.395671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:24.398891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:24.398891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:24.829428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:24.838415 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da5831ff-0e87-4bf0-9633-d63301f9d4d6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.478342 Nov 02 13:38:24.841917 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2346/5081] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:24 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:25.166098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42527927-201c-402e-a26f-c5cba6793245 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:25.166798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-42527927-201c-402e-a26f-c5cba6793245 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:25.183725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42527927-201c-402e-a26f-c5cba6793245 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:25.187062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42527927-201c-402e-a26f-c5cba6793245 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:25.189041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42527927-201c-402e-a26f-c5cba6793245 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:25.189971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42527927-201c-402e-a26f-c5cba6793245 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:25.190104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:25.196468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42527927-201c-402e-a26f-c5cba6793245 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:25.196930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42527927-201c-402e-a26f-c5cba6793245 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:25.209539 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-744652c1-1495-41cd-a781-4fcdf128e7ed tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 1.289610 Nov 02 13:38:25.211011 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2736/5082] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:23 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:25.868284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:25.869706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:25.876825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:25.877772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:25.878508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:25.879517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:25.880155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:25.880757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:25.969028 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-42527927-201c-402e-a26f-c5cba6793245 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1427 microversion: 2.1 time: 0.806843 Nov 02 13:38:25.987587 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2347/5083] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:25 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1427 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:25.999159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-42d9b352-f614-43e7-adc4-3104252f1df5 req-3168f122-46fc-43a7-b8db-372423fd0183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7a6675-f3e7-4785-9548-2f6ec451789f", "name": "network-vif-plugged", "status": "completed", "tag": "9b198dd3-8ad9-4e0a-92b4-29f5be7399f8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:26.019286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42d9b352-f614-43e7-adc4-3104252f1df5 req-3168f122-46fc-43a7-b8db-372423fd0183 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:26.020094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42d9b352-f614-43e7-adc4-3104252f1df5 req-3168f122-46fc-43a7-b8db-372423fd0183 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:26.020996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42d9b352-f614-43e7-adc4-3104252f1df5 req-3168f122-46fc-43a7-b8db-372423fd0183 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:26.036287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-42d9b352-f614-43e7-adc4-3104252f1df5 req-3168f122-46fc-43a7-b8db-372423fd0183 service nova] Creating event network-vif-plugged:9b198dd3-8ad9-4e0a-92b4-29f5be7399f8 for instance cb7a6675-f3e7-4785-9548-2f6ec451789f on n-h1-858384-19 Nov 02 13:38:26.044262 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-42d9b352-f614-43e7-adc4-3104252f1df5 req-3168f122-46fc-43a7-b8db-372423fd0183 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050276 Nov 02 13:38:26.045253 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2348/5084] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:26.241130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:26.243297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:26.252214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:26.255545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:26.265154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:26.270206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:26.283104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:26.283588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:26.596294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:26.644743 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-010f530c-ab0b-48b6-9436-7ec5be176e32 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.767496 Nov 02 13:38:26.653624 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2737/5085] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:25 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:26.892609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:26.906466 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99ff11d9-be21-47d4-9b01-e86886adec70 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.673757 Nov 02 13:38:26.907642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2349/5086] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:26 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:27.000365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ecfcd3cc-30cc-4199-9bcc-e433a320c066 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:27.000996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ecfcd3cc-30cc-4199-9bcc-e433a320c066 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:27.004324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:27.025820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecfcd3cc-30cc-4199-9bcc-e433a320c066 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.026337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecfcd3cc-30cc-4199-9bcc-e433a320c066 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.026794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecfcd3cc-30cc-4199-9bcc-e433a320c066 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.033921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecfcd3cc-30cc-4199-9bcc-e433a320c066 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.035652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecfcd3cc-30cc-4199-9bcc-e433a320c066 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.037031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecfcd3cc-30cc-4199-9bcc-e433a320c066 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.335722 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ecfcd3cc-30cc-4199-9bcc-e433a320c066 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1425 microversion: 2.1 time: 0.338515 Nov 02 13:38:27.340137 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2738/5087] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:26 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1425 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:27.678545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:27.679251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:27.702053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.703018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.704846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.706570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.708746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.710902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.938917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:27.941947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:27.957717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.961609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.962817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:27.968292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:27.971969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:27.976580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:28.344958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:28.372974 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-154fa535-5460-4d6f-8542-eb078a4eb2e5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1311 microversion: 2.1 time: 0.700290 Nov 02 13:38:28.376613 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2350/5088] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:27 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1311 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:28.437976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-384e4872-740c-4fc4-aad3-8d67dfe4f4d1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:28.441886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-384e4872-740c-4fc4-aad3-8d67dfe4f4d1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:28.458526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-384e4872-740c-4fc4-aad3-8d67dfe4f4d1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:28.460810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-384e4872-740c-4fc4-aad3-8d67dfe4f4d1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:28.461497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-384e4872-740c-4fc4-aad3-8d67dfe4f4d1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:28.465138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-384e4872-740c-4fc4-aad3-8d67dfe4f4d1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:28.465761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-384e4872-740c-4fc4-aad3-8d67dfe4f4d1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:28.466622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-384e4872-740c-4fc4-aad3-8d67dfe4f4d1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:28.796269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:28.814140 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7aba694d-9655-4ae2-b248-8fb5ebb24ed3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.882529 Nov 02 13:38:28.815654 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2739/5089] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:27 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:28.824998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5d12f866-2544-43ab-ad7c-f916b50011ba req-4a161d3b-ef2c-48a6-8d39-b46a198b562f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d69a6e-5de9-4dfc-b377-9f50068906b0", "tag": "e25a428f-563b-4402-8188-e1f4d3257186"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:28.855939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5d12f866-2544-43ab-ad7c-f916b50011ba req-4a161d3b-ef2c-48a6-8d39-b46a198b562f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:28.858342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5d12f866-2544-43ab-ad7c-f916b50011ba req-4a161d3b-ef2c-48a6-8d39-b46a198b562f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:28.859651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5d12f866-2544-43ab-ad7c-f916b50011ba req-4a161d3b-ef2c-48a6-8d39-b46a198b562f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:28.892328 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5d12f866-2544-43ab-ad7c-f916b50011ba req-4a161d3b-ef2c-48a6-8d39-b46a198b562f service nova] Creating event network-changed:e25a428f-563b-4402-8188-e1f4d3257186 for instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 on n-h1-858384-19 Nov 02 13:38:28.920102 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5d12f866-2544-43ab-ad7c-f916b50011ba req-4a161d3b-ef2c-48a6-8d39-b46a198b562f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102698 Nov 02 13:38:28.921954 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2740/5090] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:28.997278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:29.017670 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-384e4872-740c-4fc4-aad3-8d67dfe4f4d1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 0.620754 Nov 02 13:38:29.021829 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2351/5091] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:28 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:29.410745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:29.412249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:29.431743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:29.432817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:29.434505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:29.436511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:29.440611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:29.444876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:29.844524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:29.845417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:29.856668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:29.860239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:29.860941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:29.861875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:29.865988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:29.866878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:30.037930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:30.046806 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a840b4b5-1e4e-46e9-8fc9-62e4a04a00a7 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1492 microversion: 2.1 time: 0.640446 Nov 02 13:38:30.052056 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2741/5092] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:29 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1492 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:30.086217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b8582a4-c4f8-4725-b743-de658005f0bc tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:30.087986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b8582a4-c4f8-4725-b743-de658005f0bc tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:30.102765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8582a4-c4f8-4725-b743-de658005f0bc tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:30.103292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8582a4-c4f8-4725-b743-de658005f0bc tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:30.106523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8582a4-c4f8-4725-b743-de658005f0bc tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:30.107353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8582a4-c4f8-4725-b743-de658005f0bc tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:30.110488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8582a4-c4f8-4725-b743-de658005f0bc tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:30.110961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b8582a4-c4f8-4725-b743-de658005f0bc tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:30.451096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:30.465420 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-478748e6-d958-4e4e-ae9b-43fef4ff7600 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.624849 Nov 02 13:38:30.493771 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2352/5093] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:29 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:30.504747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b5b8f436-616b-40da-b983-743e1a50ca74 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-207269393"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:30.509718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b5b8f436-616b-40da-b983-743e1a50ca74 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:30.521267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5b8f436-616b-40da-b983-743e1a50ca74 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:30.522235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5b8f436-616b-40da-b983-743e1a50ca74 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:30.524799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5b8f436-616b-40da-b983-743e1a50ca74 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:30.527656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5b8f436-616b-40da-b983-743e1a50ca74 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:30.528437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5b8f436-616b-40da-b983-743e1a50ca74 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:30.529109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5b8f436-616b-40da-b983-743e1a50ca74 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:31.048022 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b5b8f436-616b-40da-b983-743e1a50ca74 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "POST /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f/action" status: 202 len: 0 microversion: 2.1 time: 0.551706 Nov 02 13:38:31.050696 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2353/5094] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:38:30 2022] POST /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:38:31.073760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9713f6e1-5858-4607-b38c-dc98d4696b11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7866ec0d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:31.168018 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9713f6e1-5858-4607-b38c-dc98d4696b11 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6" status: 200 len: 1416 microversion: 2.1 time: 0.108776 Nov 02 13:38:31.168947 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2354/5095] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:38:31 2022] GET /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 => generated 1416 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:31.173601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-42c2aada-bcaa-44b7-985b-353fb391ecfe req-bf93aa49-ccc7-4178-9ffd-660cfcec973b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d69a6e-5de9-4dfc-b377-9f50068906b0", "tag": "e25a428f-563b-4402-8188-e1f4d3257186"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:31.186138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42c2aada-bcaa-44b7-985b-353fb391ecfe req-bf93aa49-ccc7-4178-9ffd-660cfcec973b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:31.186937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42c2aada-bcaa-44b7-985b-353fb391ecfe req-bf93aa49-ccc7-4178-9ffd-660cfcec973b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:31.188209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-42c2aada-bcaa-44b7-985b-353fb391ecfe req-bf93aa49-ccc7-4178-9ffd-660cfcec973b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:31.204113 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-42c2aada-bcaa-44b7-985b-353fb391ecfe req-bf93aa49-ccc7-4178-9ffd-660cfcec973b service nova] Creating event network-changed:e25a428f-563b-4402-8188-e1f4d3257186 for instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 on n-h1-858384-19 Nov 02 13:38:31.212247 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-42c2aada-bcaa-44b7-985b-353fb391ecfe req-bf93aa49-ccc7-4178-9ffd-660cfcec973b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041984 Nov 02 13:38:31.214239 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2355/5096] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:31.222278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a9389dd-7625-48d0-b122-b373909832d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7866d4040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:31.297429 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6a9389dd-7625-48d0-b122-b373909832d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6" status: 200 len: 1416 microversion: 2.1 time: 0.081641 Nov 02 13:38:31.298038 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2356/5097] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:38:31 2022] GET /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 => generated 1416 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:31.312812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6c6ee98-cbee-45c9-b568-b82864cd73cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786734c10>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:31.472698 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b8582a4-c4f8-4725-b743-de658005f0bc tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 1.404023 Nov 02 13:38:31.474981 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2742/5098] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:30 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:31.497953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:31.498800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:31.507080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:31.508313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:31.509053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:31.510084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:31.511104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:31.511814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:31.511935 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6c6ee98-cbee-45c9-b568-b82864cd73cc tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6" status: 204 len: 0 microversion: 2.1 time: 0.201550 Nov 02 13:38:31.512851 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2357/5099] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:31 2022] DELETE /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:38:31.523805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcda5fe6-3ced-40d5-a179-71bd4073364e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe786706280>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:31.546852 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-dcda5fe6-3ced-40d5-a179-71bd4073364e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Image not found. Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcda5fe6-3ced-40d5-a179-71bd4073364e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 HTTP/1.1 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: exception: Image not found. Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6'} Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 13:38:31.550437 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 could not be found. Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:38:31.556032 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:31.564765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcda5fe6-3ced-40d5-a179-71bd4073364e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Image not found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:31.565699 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dcda5fe6-3ced-40d5-a179-71bd4073364e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6" status: 404 len: 62 microversion: 2.1 time: 0.048343 Nov 02 13:38:31.566294 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2358/5100] 10.222.0.113 () {58 vars in 1238 bytes} [Wed Nov 2 13:38:31 2022] GET /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:38:31.581872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:31.582624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:31.610510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:31.611572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:31.612025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:31.614452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:31.615989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:31.615989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:31.871678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:31.886312 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88d07413-1597-40f4-92b7-c7743f165e71 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.393027 Nov 02 13:38:31.887426 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2743/5101] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:31 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:32.498651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb162a6c-8a8b-4abd-8538-6f238120b3cd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:32.500064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb162a6c-8a8b-4abd-8538-6f238120b3cd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:32.503068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:32.514268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb162a6c-8a8b-4abd-8538-6f238120b3cd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:32.516300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb162a6c-8a8b-4abd-8538-6f238120b3cd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:32.517445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb162a6c-8a8b-4abd-8538-6f238120b3cd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:32.518484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb162a6c-8a8b-4abd-8538-6f238120b3cd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:32.519765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb162a6c-8a8b-4abd-8538-6f238120b3cd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:32.520426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb162a6c-8a8b-4abd-8538-6f238120b3cd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:32.525806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:32.542923 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9dd6559d-f767-4bd6-847a-cbcfa671ef0c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1504 microversion: 2.1 time: 0.971217 Nov 02 13:38:32.545242 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2359/5102] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:31 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1504 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:32.753589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:32.911989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:32.913513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:32.927656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:32.928876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:32.932881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:32.935260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:32.936866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:32.938499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:33.010039 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb162a6c-8a8b-4abd-8538-6f238120b3cd tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 0.509576 Nov 02 13:38:33.012425 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2744/5103] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:32 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:33.266570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-73afa18d-1b56-4b22-8aa6-a40797e0b212 req-ada8024a-96c0-4969-a955-90e5fe93eba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9143d09c-d322-4796-bffb-6c151d950ddc", "tag": "ca55cd62-51e3-4b06-a4f8-af044726bc72"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:33.281173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-73afa18d-1b56-4b22-8aa6-a40797e0b212 req-ada8024a-96c0-4969-a955-90e5fe93eba0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:33.282002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-73afa18d-1b56-4b22-8aa6-a40797e0b212 req-ada8024a-96c0-4969-a955-90e5fe93eba0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:33.282729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-73afa18d-1b56-4b22-8aa6-a40797e0b212 req-ada8024a-96c0-4969-a955-90e5fe93eba0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:33.289041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:33.305000 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-47079880-a029-4d4e-9897-e5d69b628d3d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.397257 Nov 02 13:38:33.305950 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2360/5104] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:32 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:33.326661 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-73afa18d-1b56-4b22-8aa6-a40797e0b212 req-ada8024a-96c0-4969-a955-90e5fe93eba0 service nova] Creating event network-changed:ca55cd62-51e3-4b06-a4f8-af044726bc72 for instance 9143d09c-d322-4796-bffb-6c151d950ddc on n-h1-858384-19 Nov 02 13:38:33.337996 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-73afa18d-1b56-4b22-8aa6-a40797e0b212 req-ada8024a-96c0-4969-a955-90e5fe93eba0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072126 Nov 02 13:38:33.338837 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2745/5105] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:33.571659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:33.572307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:33.586988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:33.587571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:33.588015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:33.588747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:33.591580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:33.594184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:33.902847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:33.916373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1dbb18f9-c61a-4b17-848f-c9d226090f7e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1510 microversion: 2.1 time: 0.351589 Nov 02 13:38:33.917090 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2361/5106] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:33 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:34.035211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-65461128-485d-4d0f-b2d8-e52d3223bf02 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:34.036668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-65461128-485d-4d0f-b2d8-e52d3223bf02 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:34.045530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65461128-485d-4d0f-b2d8-e52d3223bf02 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:34.046320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65461128-485d-4d0f-b2d8-e52d3223bf02 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:34.046933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65461128-485d-4d0f-b2d8-e52d3223bf02 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:34.047916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65461128-485d-4d0f-b2d8-e52d3223bf02 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:34.048445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65461128-485d-4d0f-b2d8-e52d3223bf02 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:34.049086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65461128-485d-4d0f-b2d8-e52d3223bf02 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:34.245879 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-65461128-485d-4d0f-b2d8-e52d3223bf02 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 0.215186 Nov 02 13:38:34.246490 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2746/5107] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:34 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:34.336461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:34.338010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:34.347757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:34.348734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:34.349412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:34.350556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:34.351529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:34.352187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:35.031033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:35.031853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:35.047537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:35.049079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:35.050526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:35.053062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:35.056134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:35.057121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:35.067360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:35.081359 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9503248-16e2-4911-891b-f4ec9ad931aa tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.752404 Nov 02 13:38:35.082728 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2362/5108] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:34 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:35.269825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f2e347a6-590e-4c53-b018-26e46d5a0694 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:35.270434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f2e347a6-590e-4c53-b018-26e46d5a0694 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:35.286717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2e347a6-590e-4c53-b018-26e46d5a0694 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:35.287282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2e347a6-590e-4c53-b018-26e46d5a0694 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:35.290176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2e347a6-590e-4c53-b018-26e46d5a0694 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:35.291369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2e347a6-590e-4c53-b018-26e46d5a0694 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:35.292662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2e347a6-590e-4c53-b018-26e46d5a0694 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:35.293374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2e347a6-590e-4c53-b018-26e46d5a0694 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:35.512490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f2e347a6-590e-4c53-b018-26e46d5a0694 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 0.246123 Nov 02 13:38:35.527915 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2363/5109] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:35 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:35.631678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:35.646627 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d0839c1c-5a9d-4c56-93c5-9ad3929b9e03 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1510 microversion: 2.1 time: 0.617628 Nov 02 13:38:35.648802 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2747/5110] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:35 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1510 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:36.109321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:36.110021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:36.121583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:36.122454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:36.127928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:36.129070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:36.132494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:36.133422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:36.474265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:36.487927 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-171ff94c-a9f6-427a-ac40-9f7bb8e39bff tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.383310 Nov 02 13:38:36.488546 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2364/5111] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:36 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:36.536809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-278f07b4-5844-4368-8880-02276de47481 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:36.538883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-278f07b4-5844-4368-8880-02276de47481 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:36.557019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278f07b4-5844-4368-8880-02276de47481 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:36.557767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278f07b4-5844-4368-8880-02276de47481 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:36.558389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278f07b4-5844-4368-8880-02276de47481 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:36.561224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278f07b4-5844-4368-8880-02276de47481 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:36.562200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278f07b4-5844-4368-8880-02276de47481 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:36.563286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-278f07b4-5844-4368-8880-02276de47481 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:36.672192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:36.672743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:36.683245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:36.684043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:36.684814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:36.685656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:36.686120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:36.686558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:36.997695 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-278f07b4-5844-4368-8880-02276de47481 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 0.465204 Nov 02 13:38:36.999446 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2748/5112] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:36 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:37.066122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:37.079802 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c0170f5-23b0-46c8-89fb-94225ab67c8e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1510 microversion: 2.1 time: 0.412210 Nov 02 13:38:37.096786 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2365/5113] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:36 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:37.515006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:37.515771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:37.536069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:37.542010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:37.543473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:37.544755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:37.546479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:37.559094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:37.789358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a1e32166-89fb-41af-a453-160b7cc33bb7 req-4a226398-fcc0-44ec-be69-5670a6fba396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7a6675-f3e7-4785-9548-2f6ec451789f", "name": "network-vif-plugged", "status": "completed", "tag": "9b198dd3-8ad9-4e0a-92b4-29f5be7399f8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:37.806199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a1e32166-89fb-41af-a453-160b7cc33bb7 req-4a226398-fcc0-44ec-be69-5670a6fba396 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:37.806872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a1e32166-89fb-41af-a453-160b7cc33bb7 req-4a226398-fcc0-44ec-be69-5670a6fba396 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:37.807512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a1e32166-89fb-41af-a453-160b7cc33bb7 req-4a226398-fcc0-44ec-be69-5670a6fba396 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:37.815561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:37.828214 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a1e32166-89fb-41af-a453-160b7cc33bb7 req-4a226398-fcc0-44ec-be69-5670a6fba396 service nova] Creating event network-vif-plugged:9b198dd3-8ad9-4e0a-92b4-29f5be7399f8 for instance cb7a6675-f3e7-4785-9548-2f6ec451789f on n-h1-858384-19 Nov 02 13:38:37.836331 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35235e98-26cb-4fb6-a89c-3e3dc79136ec tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.326053 Nov 02 13:38:37.838757 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a1e32166-89fb-41af-a453-160b7cc33bb7 req-4a226398-fcc0-44ec-be69-5670a6fba396 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054940 Nov 02 13:38:37.840161 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2749/5114] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:37 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:37.841399 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2366/5115] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:38:38.021200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-583e1fc1-13ba-4ff1-8ba6-168dec8f4dac tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:38.022692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-583e1fc1-13ba-4ff1-8ba6-168dec8f4dac tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:38.032534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583e1fc1-13ba-4ff1-8ba6-168dec8f4dac tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:38.036827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583e1fc1-13ba-4ff1-8ba6-168dec8f4dac tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:38.038195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583e1fc1-13ba-4ff1-8ba6-168dec8f4dac tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:38.041015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583e1fc1-13ba-4ff1-8ba6-168dec8f4dac tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:38.043864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583e1fc1-13ba-4ff1-8ba6-168dec8f4dac tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:38.044744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-583e1fc1-13ba-4ff1-8ba6-168dec8f4dac tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:38.116380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:38.118079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:38.124933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:38.125658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:38.126289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:38.127209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:38.127814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:38.128546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:38.516945 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-583e1fc1-13ba-4ff1-8ba6-168dec8f4dac tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 0.499631 Nov 02 13:38:38.519837 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2750/5116] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:38 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:38.569674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:38.580741 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d7d6d99-cbb7-4ebd-b47a-a31dd91292f3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1510 microversion: 2.1 time: 0.475112 Nov 02 13:38:38.583301 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2367/5117] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:38 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:38.866216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:38.867573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:38.882650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:38.892743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:38.893879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:38.908344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:38.909636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:38.910750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:39.212875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:39.229456 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a9f195c5-5874-4a7a-a5b4-af726e3bee51 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1740 microversion: 2.1 time: 0.366697 Nov 02 13:38:39.248621 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2751/5118] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:38 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:39.546382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-242f499b-f5be-44d9-9505-b1e5f2d377e9 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:39.547014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-242f499b-f5be-44d9-9505-b1e5f2d377e9 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:39.566023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-242f499b-f5be-44d9-9505-b1e5f2d377e9 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:39.566988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-242f499b-f5be-44d9-9505-b1e5f2d377e9 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:39.566988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-242f499b-f5be-44d9-9505-b1e5f2d377e9 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:39.567881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-242f499b-f5be-44d9-9505-b1e5f2d377e9 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:39.568346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-242f499b-f5be-44d9-9505-b1e5f2d377e9 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:39.569348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-242f499b-f5be-44d9-9505-b1e5f2d377e9 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:39.608817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:39.609327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:39.618017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:39.618809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:39.619278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:39.620161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:39.620783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:39.621375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:39.886211 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-242f499b-f5be-44d9-9505-b1e5f2d377e9 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 0.343602 Nov 02 13:38:39.888266 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2368/5119] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:39 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:39.911588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:39.932943 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89714bd8-1bc4-409f-b814-04fc938e48f5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1510 microversion: 2.1 time: 0.327480 Nov 02 13:38:39.954615 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2752/5120] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:39 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1510 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:40.259636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:40.263351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:40.275218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:40.278819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:40.283513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:40.285257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:40.285985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:40.286686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:40.654065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:40.668130 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f52457e0-2d61-410c-9907-5c876ac57654 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1720 microversion: 2.1 time: 0.416094 Nov 02 13:38:40.670115 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2369/5121] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:40 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1720 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:40.872227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:40.873080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:40.883013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:40.884468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:40.885194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:40.886964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:40.887721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:40.888420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:40.909834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e993fe1e-20cc-4f89-94d4-b903cb6800a1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:40.910513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e993fe1e-20cc-4f89-94d4-b903cb6800a1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:40.919495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=70 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:40.921084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e993fe1e-20cc-4f89-94d4-b903cb6800a1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:40.921640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e993fe1e-20cc-4f89-94d4-b903cb6800a1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:40.923680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e993fe1e-20cc-4f89-94d4-b903cb6800a1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:40.926941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e993fe1e-20cc-4f89-94d4-b903cb6800a1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:40.927567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:40.928358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e993fe1e-20cc-4f89-94d4-b903cb6800a1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:40.928358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e993fe1e-20cc-4f89-94d4-b903cb6800a1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:41.067416 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] HTTP exception thrown: Cannot 'detach_volume' instance 16c00a03-1b4e-490c-814c-84c520dbab62 while it is in vm_state rescued Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Request method failure captured: Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments/ef0a06cf-44be-4ea1-9720-0a9c6bccbc81 HTTP/1.1 Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHi7jP3BREzNNxMlaHpTkHTAhpl4YuS15cqc7AF8LZUEXF-7lvm87GGJSejO1Ngp59zhuvznS7N8Hp-FmGbmJ1gJUTodwrnMGNso2bPIBMjI2J9vGT9OMBHmDkPSV1QxO58NX1-FPgIu3P9_ttyV5w2TDOTyKt4vpmdeDQUnv6oULM Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9758bd03bdc949d495c293221823196c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9758bd03bdc949d495c293221823196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 9485351c342740638c6a30b05cd0b162 Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot 'detach_volume' instance 16c00a03-1b4e-490c-814c-84c520dbab62 while it is in vm_state rescued Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'server_id': '16c00a03-1b4e-490c-814c-84c520dbab62', 'id': 'ef0a06cf-44be-4ea1-9720-0a9c6bccbc81'} Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 16c00a03-1b4e-490c-814c-84c520dbab62 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 16c00a03-1b4e-490c-814c-84c520dbab62 while it is in vm_state rescued Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:41.070179 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:41.077589 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:41.077589 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:41.077589 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:41.077589 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:41.077589 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 16c00a03-1b4e-490c-814c-84c520dbab62 while it is in vm_state rescued Nov 02 13:38:41.077589 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:41.077589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Returning 409 to user: Cannot 'detach_volume' instance 16c00a03-1b4e-490c-814c-84c520dbab62 while it is in vm_state rescued {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:41.077589 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef44ec1d-1b80-41c8-b3e3-1e68138617bd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "DELETE /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments/ef0a06cf-44be-4ea1-9720-0a9c6bccbc81" status: 409 len: 152 microversion: 2.1 time: 0.205920 Nov 02 13:38:41.079637 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2753/5122] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:38:40 2022] DELETE /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments/ef0a06cf-44be-4ea1-9720-0a9c6bccbc81 => generated 152 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:38:41.086277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:41.087010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:41.119944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:41.120872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:41.121589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:41.124635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:41.124635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:41.126834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:41.407730 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e993fe1e-20cc-4f89-94d4-b903cb6800a1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 0.501523 Nov 02 13:38:41.408366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2370/5123] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:40 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:41.447879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-415d1eff-801c-4d22-8cc2-f6d0412abf21 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:41.454099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-415d1eff-801c-4d22-8cc2-f6d0412abf21 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:41.480887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415d1eff-801c-4d22-8cc2-f6d0412abf21 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:41.483394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415d1eff-801c-4d22-8cc2-f6d0412abf21 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:41.483875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415d1eff-801c-4d22-8cc2-f6d0412abf21 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:41.486332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415d1eff-801c-4d22-8cc2-f6d0412abf21 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:41.486818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415d1eff-801c-4d22-8cc2-f6d0412abf21 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:41.487932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-415d1eff-801c-4d22-8cc2-f6d0412abf21 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:41.503151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:41.520601 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d23b0adc-5512-42cb-adf5-a7c0e77c4b22 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1510 microversion: 2.1 time: 0.439402 Nov 02 13:38:41.526004 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2754/5124] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:41 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:41.583839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0cc13e22-6b31-47a5-93b5-52f5bfbed239 req-c66a1b3b-774a-4c0c-b993-189b5c2d9524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9143d09c-d322-4796-bffb-6c151d950ddc", "name": "network-vif-plugged", "status": "completed", "tag": "ca55cd62-51e3-4b06-a4f8-af044726bc72"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:41.606820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0cc13e22-6b31-47a5-93b5-52f5bfbed239 req-c66a1b3b-774a-4c0c-b993-189b5c2d9524 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:41.607599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0cc13e22-6b31-47a5-93b5-52f5bfbed239 req-c66a1b3b-774a-4c0c-b993-189b5c2d9524 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:41.608884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0cc13e22-6b31-47a5-93b5-52f5bfbed239 req-c66a1b3b-774a-4c0c-b993-189b5c2d9524 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:41.648177 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0cc13e22-6b31-47a5-93b5-52f5bfbed239 req-c66a1b3b-774a-4c0c-b993-189b5c2d9524 service nova] Creating event network-vif-plugged:ca55cd62-51e3-4b06-a4f8-af044726bc72 for instance 9143d09c-d322-4796-bffb-6c151d950ddc on n-h1-858384-19 Nov 02 13:38:41.656618 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0cc13e22-6b31-47a5-93b5-52f5bfbed239 req-c66a1b3b-774a-4c0c-b993-189b5c2d9524 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129250 Nov 02 13:38:41.658223 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2755/5125] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:41.675067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:41.768240 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-415d1eff-801c-4d22-8cc2-f6d0412abf21 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/action" status: 202 len: 0 microversion: 2.1 time: 0.358491 Nov 02 13:38:41.786769 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2371/5126] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:38:41 2022] POST /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:38:41.800974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:41.806355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:41.825196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:41.826897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:41.828122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:41.828990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:41.829825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:41.830361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:42.379604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:42.396550 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be8783d8-e135-4ed8-a793-705560b87e11 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1728 microversion: 2.1 time: 0.603067 Nov 02 13:38:42.399600 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2756/5127] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:41 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1728 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:42.435983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4dca8d5f-a9c2-4ccf-a09a-2e489deaf4a7 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:42.437570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4dca8d5f-a9c2-4ccf-a09a-2e489deaf4a7 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:42.464192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dca8d5f-a9c2-4ccf-a09a-2e489deaf4a7 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:42.464658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dca8d5f-a9c2-4ccf-a09a-2e489deaf4a7 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:42.467180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dca8d5f-a9c2-4ccf-a09a-2e489deaf4a7 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:42.468507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dca8d5f-a9c2-4ccf-a09a-2e489deaf4a7 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:42.469466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dca8d5f-a9c2-4ccf-a09a-2e489deaf4a7 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:42.469912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4dca8d5f-a9c2-4ccf-a09a-2e489deaf4a7 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:42.551084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:42.552077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:42.569428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:42.570319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:42.570995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:42.572055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:42.575961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:42.580116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:43.252713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:43.269828 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f27014e-3a4a-4056-b36a-66c2027779d2 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1510 microversion: 2.1 time: 0.724599 Nov 02 13:38:43.273050 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2757/5128] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:42 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1510 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:43.286713 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4dca8d5f-a9c2-4ccf-a09a-2e489deaf4a7 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1467 microversion: 2.1 time: 0.859428 Nov 02 13:38:43.294801 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2372/5129] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:42 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1467 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:43.423749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:43.425291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:43.435773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:43.436508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:43.436988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:43.437690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:43.438130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:43.442591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:43.796711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:43.837459 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c6c74392-a0a7-41a4-b684-62277994d149 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1728 microversion: 2.1 time: 0.417619 Nov 02 13:38:43.841171 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2758/5130] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:43 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1728 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:44.297833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:44.298502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:44.310679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.313183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2c096741-90f5-4ea6-b095-9656b705a398 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:44.315637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2c096741-90f5-4ea6-b095-9656b705a398 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:44.316412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.316995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:44.317806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.318389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.318892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:44.330798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c096741-90f5-4ea6-b095-9656b705a398 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.331633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c096741-90f5-4ea6-b095-9656b705a398 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.332059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c096741-90f5-4ea6-b095-9656b705a398 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:44.333536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c096741-90f5-4ea6-b095-9656b705a398 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.336497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c096741-90f5-4ea6-b095-9656b705a398 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.337029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c096741-90f5-4ea6-b095-9656b705a398 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:44.550051 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2c096741-90f5-4ea6-b095-9656b705a398 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1653 microversion: 2.1 time: 0.241859 Nov 02 13:38:44.551058 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2759/5131] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:44 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1653 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:44.578848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a0ecf25b-5ebb-4077-9e85-a85b1e442c8e tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:44.579751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a0ecf25b-5ebb-4077-9e85-a85b1e442c8e tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:44.590848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0ecf25b-5ebb-4077-9e85-a85b1e442c8e tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.591958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0ecf25b-5ebb-4077-9e85-a85b1e442c8e tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.592639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0ecf25b-5ebb-4077-9e85-a85b1e442c8e tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:44.595139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0ecf25b-5ebb-4077-9e85-a85b1e442c8e tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.595815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0ecf25b-5ebb-4077-9e85-a85b1e442c8e tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.596430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0ecf25b-5ebb-4077-9e85-a85b1e442c8e tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:44.730357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:44.753113 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a0b7060-51a4-47b7-b787-a3e66f404efd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1492 microversion: 2.1 time: 0.458989 Nov 02 13:38:44.765608 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2373/5132] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:44 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1492 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:44.782489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:44.783074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:44.790864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.791917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.792705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:44.793938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.794850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.795552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:44.820905 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a0ecf25b-5ebb-4077-9e85-a85b1e442c8e tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1653 microversion: 2.1 time: 0.247645 Nov 02 13:38:44.821702 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2760/5133] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:44 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1653 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:44.846130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea110863-beb4-4ffa-b21f-64dd065053e1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:44.846936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ea110863-beb4-4ffa-b21f-64dd065053e1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:44.847266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:38:44.857952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea110863-beb4-4ffa-b21f-64dd065053e1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.860613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea110863-beb4-4ffa-b21f-64dd065053e1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.861250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea110863-beb4-4ffa-b21f-64dd065053e1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:44.867477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea110863-beb4-4ffa-b21f-64dd065053e1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:44.868288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea110863-beb4-4ffa-b21f-64dd065053e1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:44.871634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea110863-beb4-4ffa-b21f-64dd065053e1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:45.054878 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6a0ee0d-3036-4987-97ed-8da808c6307d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 204 len: 0 microversion: 2.1 time: 0.276751 Nov 02 13:38:45.055874 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2374/5134] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:38:44 2022] DELETE /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:38:45.063642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:45.064374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:45.078504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:45.079014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:45.079522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:45.080202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:45.083595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:45.086494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:45.134015 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ea110863-beb4-4ffa-b21f-64dd065053e1 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1653 microversion: 2.1 time: 0.291234 Nov 02 13:38:45.142670 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2761/5135] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:44 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1653 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:45.142670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c24c0009-279b-44b7-98f5-8966cb60f787 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7875475e0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:45.174642 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-c24c0009-279b-44b7-98f5-8966cb60f787 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Image not found. Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c24c0009-279b-44b7-98f5-8966cb60f787 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 HTTP/1.1 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6'} Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 to delete Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 could not be found. Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:45.176644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c24c0009-279b-44b7-98f5-8966cb60f787 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:45.181011 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c24c0009-279b-44b7-98f5-8966cb60f787 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6" status: 404 len: 62 microversion: 2.1 time: 0.042392 Nov 02 13:38:45.186303 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2762/5136] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:45 2022] DELETE /compute/v2.1/images/6bccd6e1-8cb1-4ff4-8bdd-72811781f7e6 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:38:45.189770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:45.189770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:45.196078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:45.197043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:45.197733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:45.198695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:45.199630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:45.200451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:45.261653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:38:45.357289 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.compute.api [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Instance is already in deleting state, ignoring this request Nov 02 13:38:45.358981 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da50b5bc-3df9-49a9-85c1-16f355fce6cd tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 204 len: 0 microversion: 2.1 time: 0.176040 Nov 02 13:38:45.360180 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2763/5137] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:38:45 2022] DELETE /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:38:45.389067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:45.389912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:45.414689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:45.416742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:45.417449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:45.418285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:45.420282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:45.421280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:45.422334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:45.433214 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8aec509b-17d5-43a9-86da-cf93598fb068 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1728 microversion: 2.1 time: 0.375676 Nov 02 13:38:45.444119 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2375/5138] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:45 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1728 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:45.456085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1336660006", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "availability_zone": "nova:n-h2-858384-19", "networks": [{"uuid": "e6cbbbf8-34ff-424f-bf6e-3181064479a7"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:45.612856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] validate_networks() for [('e6cbbbf8-34ff-424f-bf6e-3181064479a7', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:38:45.679236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:45.692721 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-936bfab6-c963-4db2-a694-8b6e91648f5c tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1498 microversion: 2.1 time: 0.314282 Nov 02 13:38:45.710161 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2764/5139] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:45 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1498 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:46.462210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:46.462837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:46.489708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:46.490235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:46.490696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:46.493429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:46.493911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:46.500967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:46.792062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:38:46.793172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:38:46.795011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:38:46.795848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:38:46.796835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:38:46.825389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:46.828649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:46.829740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:46.832790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:46.835307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:46.836137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:46.836929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:46.861223 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ecc64e5d-b784-42f6-9361-eaacc8e7fcdc tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1728 microversion: 2.1 time: 0.404195 Nov 02 13:38:46.862911 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2765/5140] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:46 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1728 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:46.875943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:46.879379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:46.909924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:46.910432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:46.910965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:46.911746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:46.912848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:46.913377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:46.918465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Getting quotas for project 459eeaac191e4ab7ae1c40b7d204a8e7. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:38:46.934882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Getting quotas for user f17b83b4a50d42c4b60eb71ea6bc7d09 and project 459eeaac191e4ab7ae1c40b7d204a8e7. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:38:46.966613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:38:46.970242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:38:47.085970 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a9edd26-10d3-4776-bb23-3fa64e5c7edb tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.641058 Nov 02 13:38:47.086880 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2376/5141] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:38:45 2022] POST /compute/v2.1/servers => generated 382 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:38:47.098696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc274a59-63bf-433a-a004-6c9c537c4031 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:47.099388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc274a59-63bf-433a-a004-6c9c537c4031 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:47.183857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:47.192918 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb028c02-649b-4a68-9c0a-4863ab288058 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1498 microversion: 2.1 time: 0.328662 Nov 02 13:38:47.193576 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2766/5142] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:46 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1498 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:47.252104 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc274a59-63bf-433a-a004-6c9c537c4031 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1333 microversion: 2.1 time: 0.157728 Nov 02 13:38:47.253186 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2377/5143] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:47 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1333 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:47.426077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-edffadbd-2a52-48b6-af60-716c768f53af req-4c53d2cd-b509-4cb0-9d82-711b5a55c786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7a6675-f3e7-4785-9548-2f6ec451789f", "name": "network-vif-unplugged", "status": "completed", "tag": "9b198dd3-8ad9-4e0a-92b4-29f5be7399f8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:47.437388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-edffadbd-2a52-48b6-af60-716c768f53af req-4c53d2cd-b509-4cb0-9d82-711b5a55c786 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:47.438462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-edffadbd-2a52-48b6-af60-716c768f53af req-4c53d2cd-b509-4cb0-9d82-711b5a55c786 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:47.439330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-edffadbd-2a52-48b6-af60-716c768f53af req-4c53d2cd-b509-4cb0-9d82-711b5a55c786 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:47.454854 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-edffadbd-2a52-48b6-af60-716c768f53af req-4c53d2cd-b509-4cb0-9d82-711b5a55c786 service nova] Creating event network-vif-unplugged:9b198dd3-8ad9-4e0a-92b4-29f5be7399f8 for instance cb7a6675-f3e7-4785-9548-2f6ec451789f on n-h1-858384-19 Nov 02 13:38:47.462475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-edffadbd-2a52-48b6-af60-716c768f53af req-4c53d2cd-b509-4cb0-9d82-711b5a55c786 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040546 Nov 02 13:38:47.463895 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2767/5144] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:47.889432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:47.892893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:47.967194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:47.967783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:47.970870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:47.973906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:47.974427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:47.974877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:48.223052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:48.223915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:48.245394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:48.246080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:48.246825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:48.259829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:48.260342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:48.260802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:48.496485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:48.513759 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0df9f951-d42d-496f-a0b6-ab16de0036c8 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1728 microversion: 2.1 time: 0.625039 Nov 02 13:38:48.516100 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2378/5145] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:47 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1728 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:48.543632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcd6a628-2cef-4711-b262-0654bad655aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:48.544316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dcd6a628-2cef-4711-b262-0654bad655aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:48.586938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcd6a628-2cef-4711-b262-0654bad655aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:48.589008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcd6a628-2cef-4711-b262-0654bad655aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:48.589470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcd6a628-2cef-4711-b262-0654bad655aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:48.593210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcd6a628-2cef-4711-b262-0654bad655aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:48.593722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcd6a628-2cef-4711-b262-0654bad655aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:48.594161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcd6a628-2cef-4711-b262-0654bad655aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:48.811006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:48.830212 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c37cf4cc-0d56-4147-9cb5-4fd20a6f6266 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1498 microversion: 2.1 time: 0.612819 Nov 02 13:38:48.840398 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2768/5146] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:48 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1498 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:48.868894 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dcd6a628-2cef-4711-b262-0654bad655aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1422 microversion: 2.1 time: 0.348631 Nov 02 13:38:48.870502 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2379/5147] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:48 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1422 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:49.544282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:49.545645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:49.561145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:49.565535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:49.567318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:49.572622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:49.575729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:49.580384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:49.862910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:49.864124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:49.875222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:49.876072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:49.877324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:49.878423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:49.879236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:49.879886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:50.087688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:50.119496 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9534dc94-6d20-44c7-8af2-848bb1067546 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1734 microversion: 2.1 time: 0.577143 Nov 02 13:38:50.139956 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2769/5148] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:49 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1734 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:50.153013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f10bf566-2a7b-47e8-9dfa-b76666487644 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:50.154114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f10bf566-2a7b-47e8-9dfa-b76666487644 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:50.168600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f10bf566-2a7b-47e8-9dfa-b76666487644 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:50.169355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f10bf566-2a7b-47e8-9dfa-b76666487644 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:50.169988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f10bf566-2a7b-47e8-9dfa-b76666487644 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:50.170874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f10bf566-2a7b-47e8-9dfa-b76666487644 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:50.171808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f10bf566-2a7b-47e8-9dfa-b76666487644 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:50.172409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f10bf566-2a7b-47e8-9dfa-b76666487644 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:50.244950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be8bee2d23fa481193b5a23cf2348a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c84219a3a5940359107491dec2ac311', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:38:50.253414 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a0dbdcd-2c59-4efa-9511-828cd0c813aa tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 200 len: 1456 microversion: 2.1 time: 0.395079 Nov 02 13:38:50.263591 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2380/5149] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:49 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 1456 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:50.278895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-fe8786ee-5070-423f-ab93-80622fed6b9c req-94c23772-ba27-4483-bacc-edb8eb9ee6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb7a6675-f3e7-4785-9548-2f6ec451789f", "name": "network-vif-deleted", "tag": "9b198dd3-8ad9-4e0a-92b4-29f5be7399f8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:50.293233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fe8786ee-5070-423f-ab93-80622fed6b9c req-94c23772-ba27-4483-bacc-edb8eb9ee6f8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:50.293983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fe8786ee-5070-423f-ab93-80622fed6b9c req-94c23772-ba27-4483-bacc-edb8eb9ee6f8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:50.294577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fe8786ee-5070-423f-ab93-80622fed6b9c req-94c23772-ba27-4483-bacc-edb8eb9ee6f8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:50.311885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:50.317442 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-fe8786ee-5070-423f-ab93-80622fed6b9c req-94c23772-ba27-4483-bacc-edb8eb9ee6f8 service nova] Creating event network-vif-deleted:9b198dd3-8ad9-4e0a-92b4-29f5be7399f8 for instance cb7a6675-f3e7-4785-9548-2f6ec451789f on n-h1-858384-19 Nov 02 13:38:50.324493 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-fe8786ee-5070-423f-ab93-80622fed6b9c req-94c23772-ba27-4483-bacc-edb8eb9ee6f8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058962 Nov 02 13:38:50.325334 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2381/5150] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:50.331874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0a7b2f7-861c-40e2-8682-3c489f48d1b5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:50.336291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f0a7b2f7-861c-40e2-8682-3c489f48d1b5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:50.339189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f10bf566-2a7b-47e8-9dfa-b76666487644 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1428 microversion: 2.1 time: 0.197981 Nov 02 13:38:50.345308 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2770/5151] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:50 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1428 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:50.348259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a7b2f7-861c-40e2-8682-3c489f48d1b5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:50.348910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a7b2f7-861c-40e2-8682-3c489f48d1b5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:50.349993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a7b2f7-861c-40e2-8682-3c489f48d1b5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:50.351045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a7b2f7-861c-40e2-8682-3c489f48d1b5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:50.351690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a7b2f7-861c-40e2-8682-3c489f48d1b5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:50.352385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0a7b2f7-861c-40e2-8682-3c489f48d1b5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:50.570360 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f0a7b2f7-861c-40e2-8682-3c489f48d1b5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.242333 Nov 02 13:38:50.579377 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2382/5152] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:38:50 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-interface => generated 285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:51.281279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.282066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: cb7a6675-f3e7-4785-9548-2f6ec451789f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:51.302589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.306973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.307467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.308216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.310312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.310727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.369955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6be929b4-6bdb-4121-addf-4ba91cf0682a tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.370552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6be929b4-6bdb-4121-addf-4ba91cf0682a tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:51.371973 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance cb7a6675-f3e7-4785-9548-2f6ec451789f could not be found. Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f HTTP/1.1 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance cb7a6675-f3e7-4785-9548-2f6ec451789f could not be found. Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'cb7a6675-f3e7-4785-9548-2f6ec451789f'} Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb7a6675-f3e7-4785-9548-2f6ec451789f could not be found. Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb7a6675-f3e7-4785-9548-2f6ec451789f could not be found. Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.377920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.385508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.385508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.385508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:51.385508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:51.385508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb7a6675-f3e7-4785-9548-2f6ec451789f could not be found. Nov 02 13:38:51.385508 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.387839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance cb7a6675-f3e7-4785-9548-2f6ec451789f could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:51.389514 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90742cb8-bff8-4910-89ae-0dad18511f3a tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f" status: 404 len: 111 microversion: 2.1 time: 0.112384 Nov 02 13:38:51.390401 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2771/5153] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:51 2022] GET /compute/v2.1/servers/cb7a6675-f3e7-4785-9548-2f6ec451789f => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:38:51.404844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6be929b4-6bdb-4121-addf-4ba91cf0682a tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.405407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6be929b4-6bdb-4121-addf-4ba91cf0682a tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.405879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.406645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:51.407780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6be929b4-6bdb-4121-addf-4ba91cf0682a tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.408614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6be929b4-6bdb-4121-addf-4ba91cf0682a tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.413447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6be929b4-6bdb-4121-addf-4ba91cf0682a tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.414065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6be929b4-6bdb-4121-addf-4ba91cf0682a tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.419955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.420888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.421583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.423720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.424519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.425238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.451769 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 HTTP/1.1 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '084627dd-d1aa-4bc1-8968-9d0ca71baee2'} Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:51.460935 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.467499 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.471679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:51.477836 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12302865-e8d6-4cd6-858c-1f65a76b3068 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 404 len: 111 microversion: 2.1 time: 0.077892 Nov 02 13:38:51.487705 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2772/5154] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:38:51 2022] DELETE /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:38:51.501627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.506481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 084627dd-d1aa-4bc1-8968-9d0ca71baee2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:51.523377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.524208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.524652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.533785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.534523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.534983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.580298 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 HTTP/1.1 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '084627dd-d1aa-4bc1-8968-9d0ca71baee2'} Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.585577 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.591369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.591369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.591369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:51.591369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:51.591369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. Nov 02 13:38:51.591369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.596002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance 084627dd-d1aa-4bc1-8968-9d0ca71baee2 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:51.597115 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8e04eb4c-9231-4a10-9c47-524f5ac04cb0 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2" status: 404 len: 111 microversion: 2.1 time: 0.100504 Nov 02 13:38:51.600078 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2773/5155] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:51 2022] GET /compute/v2.1/servers/084627dd-d1aa-4bc1-8968-9d0ca71baee2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:38:51.616323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd3e5acc-694a-448b-82fc-fd9bc9d2c486 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78761e8b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.660054 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-fd3e5acc-694a-448b-82fc-fd9bc9d2c486 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Image not found. Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd3e5acc-694a-448b-82fc-fd9bc9d2c486 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 HTTP/1.1 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '2766e52f-a97d-4866-a778-d4633fa99645'} Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2766e52f-a97d-4866-a778-d4633fa99645 to delete Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2766e52f-a97d-4866-a778-d4633fa99645 could not be found. Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.662727 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd3e5acc-694a-448b-82fc-fd9bc9d2c486 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd3e5acc-694a-448b-82fc-fd9bc9d2c486 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645" status: 404 len: 62 microversion: 2.1 time: 0.061107 Nov 02 13:38:51.668618 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2774/5156] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:51 2022] DELETE /compute/v2.1/images/2766e52f-a97d-4866-a778-d4633fa99645 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:38:51.675416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.678450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:51.714325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.716047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.717350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.719082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.719763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.721023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.746006 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 HTTP/1.1 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f169f362-c1bc-4f18-82d1-b9a374465550'} Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:51.747996 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.753956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.757682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:51.759007 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f77f41e6-8dfa-4d95-a157-d9888c91517b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 404 len: 111 microversion: 2.1 time: 0.087792 Nov 02 13:38:51.760410 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2775/5157] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:38:51 2022] DELETE /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:38:51.774587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.776140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: f169f362-c1bc-4f18-82d1-b9a374465550] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:51.785340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.786190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.787746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.789127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.790048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.790739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.812876 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 HTTP/1.1 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f169f362-c1bc-4f18-82d1-b9a374465550'} Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.817711 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.825960 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.825960 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.825960 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:51.825960 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:51.825960 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. Nov 02 13:38:51.825960 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.825960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance f169f362-c1bc-4f18-82d1-b9a374465550 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:51.825960 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20ba27a2-5f31-462f-9d5f-854c2552176b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550" status: 404 len: 111 microversion: 2.1 time: 0.057472 Nov 02 13:38:51.825960 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2776/5158] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:51 2022] GET /compute/v2.1/servers/f169f362-c1bc-4f18-82d1-b9a374465550 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:38:51.836181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa4c64ff-9363-4a11-8145-958beb1083d5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7878b1940>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.871739 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-fa4c64ff-9363-4a11-8145-958beb1083d5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Image not found. Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa4c64ff-9363-4a11-8145-958beb1083d5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 HTTP/1.1 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'c0aca971-186a-44c2-8d6e-f00d1bc56d36'} Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c0aca971-186a-44c2-8d6e-f00d1bc56d36 to delete Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c0aca971-186a-44c2-8d6e-f00d1bc56d36 could not be found. Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.874043 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:38:51.879518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.884485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa4c64ff-9363-4a11-8145-958beb1083d5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:51.886143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fa4c64ff-9363-4a11-8145-958beb1083d5 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36" status: 404 len: 62 microversion: 2.1 time: 0.057974 Nov 02 13:38:51.887339 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2777/5159] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:51 2022] DELETE /compute/v2.1/images/c0aca971-186a-44c2-8d6e-f00d1bc56d36 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:38:51.913847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.916014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:51.937213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.938400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.939225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.940814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:51.941721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:51.944471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:51.966814 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 HTTP/1.1 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '47aa16c2-87e7-4158-9ffd-b537ae7b9d06'} Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:51.969099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:51.976232 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:51.978813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:51.979984 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-63da64e9-8ae3-4868-a509-57dbf06fb78e tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 404 len: 111 microversion: 2.1 time: 0.088627 Nov 02 13:38:51.981073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2778/5160] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:38:51 2022] DELETE /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:38:51.996904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:51.998368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 47aa16c2-87e7-4158-9ffd-b537ae7b9d06] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:52.005772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.006586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.007489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.008918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.009637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.010328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.031514 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 HTTP/1.1 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '47aa16c2-87e7-4158-9ffd-b537ae7b9d06'} Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.033604 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.041173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.041173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.041173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:52.041173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:52.041173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. Nov 02 13:38:52.041173 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.042943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance 47aa16c2-87e7-4158-9ffd-b537ae7b9d06 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:52.051166 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3305185f-18be-4ffe-a7e2-38e00434cd1b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06" status: 404 len: 111 microversion: 2.1 time: 0.058474 Nov 02 13:38:52.054954 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2779/5161] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:51 2022] GET /compute/v2.1/servers/47aa16c2-87e7-4158-9ffd-b537ae7b9d06 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:38:52.064598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-472bede4-b775-4b98-8c5a-9de47ae360a3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe78761e160>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:52.086322 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6be929b4-6bdb-4121-addf-4ba91cf0682a tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1470 microversion: 2.1 time: 0.723437 Nov 02 13:38:52.090722 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2383/5162] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:51 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1470 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:52.114713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-472bede4-b775-4b98-8c5a-9de47ae360a3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Image not found. Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-472bede4-b775-4b98-8c5a-9de47ae360a3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 HTTP/1.1 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: exception: Image not found. Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '619af08c-c624-48a4-a10c-2bdf53aeca66'} Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 619af08c-c624-48a4-a10c-2bdf53aeca66 to delete Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 619af08c-c624-48a4-a10c-2bdf53aeca66 could not be found. Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.117786 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-472bede4-b775-4b98-8c5a-9de47ae360a3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Image not found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-472bede4-b775-4b98-8c5a-9de47ae360a3 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66" status: 404 len: 62 microversion: 2.1 time: 0.061034 Nov 02 13:38:52.124301 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2780/5163] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:52 2022] DELETE /compute/v2.1/images/619af08c-c624-48a4-a10c-2bdf53aeca66 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:38:52.132140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:52.133236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:52.145946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.146889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.147623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.148454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.151042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.151642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.173978 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd HTTP/1.1 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'dd242457-066d-4e86-abf9-57bf36514bcd'} Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:52.175822 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.181974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:52.183817 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9dcb5990-af58-46d8-906f-8235f4cfb1ad tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 404 len: 111 microversion: 2.1 time: 0.056490 Nov 02 13:38:52.187449 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2384/5164] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:38:52 2022] DELETE /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:38:52.195039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:52.195707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: dd242457-066d-4e86-abf9-57bf36514bcd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:52.216229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.216844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.217311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.218755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.218755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.218985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.263333 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd HTTP/1.1 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'dd242457-066d-4e86-abf9-57bf36514bcd'} Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.264924 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.271790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.271790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.271790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:52.271790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:52.271790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. Nov 02 13:38:52.271790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.271790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance dd242457-066d-4e86-abf9-57bf36514bcd could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:52.271790 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8aa3d159-f98a-4289-8389-95401a77cd3d tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd" status: 404 len: 111 microversion: 2.1 time: 0.077196 Nov 02 13:38:52.271790 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2781/5165] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:52 2022] GET /compute/v2.1/servers/dd242457-066d-4e86-abf9-57bf36514bcd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:38:52.277791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd10d2a7-b067-4ac6-bdab-fd1ed0abdc9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '.version_select at 0x7fe7866ba790>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:52.322115 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-fd10d2a7-b067-4ac6-bdab-fd1ed0abdc9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Image not found. Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd10d2a7-b067-4ac6-bdab-fd1ed0abdc9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 HTTP/1.1 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: exception: Image not found. Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '1addfb67-b27a-4cda-80ed-256596a7b892'} Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1addfb67-b27a-4cda-80ed-256596a7b892 to delete Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1addfb67-b27a-4cda-80ed-256596a7b892 could not be found. Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.325337 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 13:38:52.329873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.335230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd10d2a7-b067-4ac6-bdab-fd1ed0abdc9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Image not found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:52.336336 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd10d2a7-b067-4ac6-bdab-fd1ed0abdc9b tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892" status: 404 len: 62 microversion: 2.1 time: 0.063292 Nov 02 13:38:52.337860 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2385/5166] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:52 2022] DELETE /compute/v2.1/images/1addfb67-b27a-4cda-80ed-256596a7b892 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:38:52.346992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:52.347727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:52.359399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.361932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.364585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.366274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.366878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.369285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.404043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 HTTP/1.1 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '59cb0435-5222-4140-af24-8cea35c0daa6'} Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:52.409713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-54bb2389-43c3-4e08-9585-c3dd9649d5a6 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "DELETE /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 404 len: 111 microversion: 2.1 time: 0.068862 Nov 02 13:38:52.416477 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2782/5167] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:38:52 2022] DELETE /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:38:52.421503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:52.422349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] [instance: 59cb0435-5222-4140-af24-8cea35c0daa6] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:52.440391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.441186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.444980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.446917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.450148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.451603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.469811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e3bc5310-0d85-4138-ab6c-fcf04895d7db req-52fb5459-6378-4bb6-b0eb-32425aba957e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c00a03-1b4e-490c-814c-84c520dbab62", "tag": "80ac27ba-28f7-4264-a76a-90fa9b06560a"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:52.485233 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] HTTP exception thrown: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.490593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e3bc5310-0d85-4138-ab6c-fcf04895d7db req-52fb5459-6378-4bb6-b0eb-32425aba957e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Request method failure captured: Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 HTTP/1.1 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnGCIIDa48jtzKV0rto1mz3tKDvDSCbGDJW2NTBpsyCguseh8AUTrLBeqx2aua8goFqOC19ybSN2YrcT_SJAV7cuKhOyImzOy3Wcv2z7VvyW5oDcj2S1xEZs7S_0K65C99Oytm0vCRVtgAXZG3UwW0XyZwUv4ScLbcMA8p8TLLIGO_c Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c84219a3a5940359107491dec2ac311"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c84219a3a5940359107491dec2ac311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c84219a3a5940359107491dec2ac311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2c84219a3a5940359107491dec2ac311 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ImagesTestJSON-905066305 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: be8bee2d23fa481193b5a23cf2348a73 Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ImagesTestJSON-905066305-project Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '59cb0435-5222-4140-af24-8cea35c0daa6'} Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.491096 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:38:52.497699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:38:52.497699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:38:52.497699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:38:52.497699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:38:52.497699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. Nov 02 13:38:52.497699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:38:52.498689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e3bc5310-0d85-4138-ab6c-fcf04895d7db req-52fb5459-6378-4bb6-b0eb-32425aba957e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:52.498689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e3bc5310-0d85-4138-ab6c-fcf04895d7db req-52fb5459-6378-4bb6-b0eb-32425aba957e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:52.500573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] Returning 404 to user: Instance 59cb0435-5222-4140-af24-8cea35c0daa6 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:38:52.503041 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fa50ac02-d24e-4c3c-ad55-e1f91b51c767 tempest-ImagesTestJSON-905066305 tempest-ImagesTestJSON-905066305-project] 10.222.0.113 "GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6" status: 404 len: 111 microversion: 2.1 time: 0.085482 Nov 02 13:38:52.504479 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2386/5168] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:52 2022] GET /compute/v2.1/servers/59cb0435-5222-4140-af24-8cea35c0daa6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:38:52.524063 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e3bc5310-0d85-4138-ab6c-fcf04895d7db req-52fb5459-6378-4bb6-b0eb-32425aba957e service nova] Creating event network-changed:80ac27ba-28f7-4264-a76a-90fa9b06560a for instance 16c00a03-1b4e-490c-814c-84c520dbab62 on n-h1-858384-19 Nov 02 13:38:52.536089 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e3bc5310-0d85-4138-ab6c-fcf04895d7db req-52fb5459-6378-4bb6-b0eb-32425aba957e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070199 Nov 02 13:38:52.537638 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2783/5169] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:53.116073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5477f7cf-7a02-4a61-8210-2b7540d79141 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:53.117002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5477f7cf-7a02-4a61-8210-2b7540d79141 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:53.131477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5477f7cf-7a02-4a61-8210-2b7540d79141 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:53.134984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5477f7cf-7a02-4a61-8210-2b7540d79141 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:53.137996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5477f7cf-7a02-4a61-8210-2b7540d79141 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:53.139002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5477f7cf-7a02-4a61-8210-2b7540d79141 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:53.142674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5477f7cf-7a02-4a61-8210-2b7540d79141 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:53.146183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5477f7cf-7a02-4a61-8210-2b7540d79141 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:54.232768 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5477f7cf-7a02-4a61-8210-2b7540d79141 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1470 microversion: 2.1 time: 1.121866 Nov 02 13:38:54.259759 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2387/5170] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:53 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1470 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:54.575270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0cd6bafb-af8c-43b8-85a4-ec763f88c422 req-4444c71d-2972-4153-b5c0-ff67318b345c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c00a03-1b4e-490c-814c-84c520dbab62", "tag": "80ac27ba-28f7-4264-a76a-90fa9b06560a"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:54.599338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0cd6bafb-af8c-43b8-85a4-ec763f88c422 req-4444c71d-2972-4153-b5c0-ff67318b345c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:54.600354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0cd6bafb-af8c-43b8-85a4-ec763f88c422 req-4444c71d-2972-4153-b5c0-ff67318b345c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:54.601037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0cd6bafb-af8c-43b8-85a4-ec763f88c422 req-4444c71d-2972-4153-b5c0-ff67318b345c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:54.637436 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0cd6bafb-af8c-43b8-85a4-ec763f88c422 req-4444c71d-2972-4153-b5c0-ff67318b345c service nova] Creating event network-changed:80ac27ba-28f7-4264-a76a-90fa9b06560a for instance 16c00a03-1b4e-490c-814c-84c520dbab62 on n-h1-858384-19 Nov 02 13:38:54.659973 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0cd6bafb-af8c-43b8-85a4-ec763f88c422 req-4444c71d-2972-4153-b5c0-ff67318b345c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082963 Nov 02 13:38:54.662060 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2784/5171] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:54.779333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-61b02e2f-f111-4c60-8708-c9caf21c6e78 req-e230eada-ae03-4daf-8186-d5b3208c650f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872c0da2-0bff-41df-91eb-fdf491ee2020", "tag": "e1daf163-efc4-4e32-b9ab-8c49062ba612"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:38:54.792236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-61b02e2f-f111-4c60-8708-c9caf21c6e78 req-e230eada-ae03-4daf-8186-d5b3208c650f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:54.793120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-61b02e2f-f111-4c60-8708-c9caf21c6e78 req-e230eada-ae03-4daf-8186-d5b3208c650f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:54.793931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-61b02e2f-f111-4c60-8708-c9caf21c6e78 req-e230eada-ae03-4daf-8186-d5b3208c650f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:54.807796 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-61b02e2f-f111-4c60-8708-c9caf21c6e78 req-e230eada-ae03-4daf-8186-d5b3208c650f service nova] Creating event network-changed:e1daf163-efc4-4e32-b9ab-8c49062ba612 for instance 872c0da2-0bff-41df-91eb-fdf491ee2020 on n-h2-858384-19 Nov 02 13:38:54.813367 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-61b02e2f-f111-4c60-8708-c9caf21c6e78 req-e230eada-ae03-4daf-8186-d5b3208c650f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041794 Nov 02 13:38:54.814575 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2388/5172] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:38:55.275293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47c68990-bcf8-4076-8554-032b456a8de0 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:55.276908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47c68990-bcf8-4076-8554-032b456a8de0 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:55.288191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47c68990-bcf8-4076-8554-032b456a8de0 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:55.289215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47c68990-bcf8-4076-8554-032b456a8de0 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:55.290309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47c68990-bcf8-4076-8554-032b456a8de0 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:55.292791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47c68990-bcf8-4076-8554-032b456a8de0 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:55.295892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47c68990-bcf8-4076-8554-032b456a8de0 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:55.300045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47c68990-bcf8-4076-8554-032b456a8de0 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:55.978178 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47c68990-bcf8-4076-8554-032b456a8de0 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1470 microversion: 2.1 time: 0.713097 Nov 02 13:38:55.983184 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2785/5173] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:55 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1470 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:57.004506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:57.014074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c437952e-e389-466b-9309-67f79d2cd523 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:57.020124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c437952e-e389-466b-9309-67f79d2cd523 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:57.039264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c437952e-e389-466b-9309-67f79d2cd523 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:57.040500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c437952e-e389-466b-9309-67f79d2cd523 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:57.040959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c437952e-e389-466b-9309-67f79d2cd523 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:57.046327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c437952e-e389-466b-9309-67f79d2cd523 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:57.047659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c437952e-e389-466b-9309-67f79d2cd523 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:57.048117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c437952e-e389-466b-9309-67f79d2cd523 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:57.251821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:57.356286 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c437952e-e389-466b-9309-67f79d2cd523 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1470 microversion: 2.1 time: 0.353842 Nov 02 13:38:57.369000 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2389/5174] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:57 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:38:58.384775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-148518b5-dc1a-4402-9c9c-413155c7d389 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:58.385459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-148518b5-dc1a-4402-9c9c-413155c7d389 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:58.391514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=88 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:38:58.410235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148518b5-dc1a-4402-9c9c-413155c7d389 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:58.410733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148518b5-dc1a-4402-9c9c-413155c7d389 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:58.411216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148518b5-dc1a-4402-9c9c-413155c7d389 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:58.412304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148518b5-dc1a-4402-9c9c-413155c7d389 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:58.412795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148518b5-dc1a-4402-9c9c-413155c7d389 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:58.413236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-148518b5-dc1a-4402-9c9c-413155c7d389 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:58.783281 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-148518b5-dc1a-4402-9c9c-413155c7d389 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1470 microversion: 2.1 time: 0.400110 Nov 02 13:38:58.783995 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2786/5175] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:58 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1470 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:38:59.811536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db18b45a-72f0-4dfc-b04d-414dc693c09d tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:38:59.812245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-db18b45a-72f0-4dfc-b04d-414dc693c09d tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:38:59.828607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db18b45a-72f0-4dfc-b04d-414dc693c09d tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:59.831021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db18b45a-72f0-4dfc-b04d-414dc693c09d tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:59.831706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db18b45a-72f0-4dfc-b04d-414dc693c09d tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:38:59.835621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db18b45a-72f0-4dfc-b04d-414dc693c09d tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:38:59.837591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db18b45a-72f0-4dfc-b04d-414dc693c09d tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:38:59.841349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db18b45a-72f0-4dfc-b04d-414dc693c09d tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:00.766693 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-db18b45a-72f0-4dfc-b04d-414dc693c09d tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1470 microversion: 2.1 time: 0.958572 Nov 02 13:39:00.774326 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2390/5176] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:38:59 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1470 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:01.798434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5b7c851f-4469-4d25-8e33-25efd4728d69 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:01.799941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5b7c851f-4469-4d25-8e33-25efd4728d69 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:01.832923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7c851f-4469-4d25-8e33-25efd4728d69 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:01.835448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7c851f-4469-4d25-8e33-25efd4728d69 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:01.836248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7c851f-4469-4d25-8e33-25efd4728d69 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:01.843358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7c851f-4469-4d25-8e33-25efd4728d69 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:01.844371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7c851f-4469-4d25-8e33-25efd4728d69 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:01.845349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b7c851f-4469-4d25-8e33-25efd4728d69 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:01.943210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b64973e0-265e-4e99-9674-29b4058eb572 req-4a81932f-e8d5-4e35-bf40-dcea4eda2455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872c0da2-0bff-41df-91eb-fdf491ee2020", "name": "network-vif-plugged", "status": "completed", "tag": "e1daf163-efc4-4e32-b9ab-8c49062ba612"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:01.972517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b64973e0-265e-4e99-9674-29b4058eb572 req-4a81932f-e8d5-4e35-bf40-dcea4eda2455 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:01.973349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b64973e0-265e-4e99-9674-29b4058eb572 req-4a81932f-e8d5-4e35-bf40-dcea4eda2455 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:01.975212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b64973e0-265e-4e99-9674-29b4058eb572 req-4a81932f-e8d5-4e35-bf40-dcea4eda2455 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:02.004367 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b64973e0-265e-4e99-9674-29b4058eb572 req-4a81932f-e8d5-4e35-bf40-dcea4eda2455 service nova] Creating event network-vif-plugged:e1daf163-efc4-4e32-b9ab-8c49062ba612 for instance 872c0da2-0bff-41df-91eb-fdf491ee2020 on n-h2-858384-19 Nov 02 13:39:02.010190 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b64973e0-265e-4e99-9674-29b4058eb572 req-4a81932f-e8d5-4e35-bf40-dcea4eda2455 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072023 Nov 02 13:39:02.011319 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2391/5177] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:39:02.368850 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5b7c851f-4469-4d25-8e33-25efd4728d69 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1470 microversion: 2.1 time: 0.575310 Nov 02 13:39:02.370548 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2787/5178] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:01 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1470 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:03.399540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d4752d8a-15ab-4b92-9051-cbdf7111cb81 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:03.400381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d4752d8a-15ab-4b92-9051-cbdf7111cb81 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:03.407943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4752d8a-15ab-4b92-9051-cbdf7111cb81 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:03.408521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4752d8a-15ab-4b92-9051-cbdf7111cb81 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:03.409031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4752d8a-15ab-4b92-9051-cbdf7111cb81 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:03.409803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4752d8a-15ab-4b92-9051-cbdf7111cb81 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:03.410328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4752d8a-15ab-4b92-9051-cbdf7111cb81 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:03.410953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4752d8a-15ab-4b92-9051-cbdf7111cb81 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:03.700487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:03.724912 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d4752d8a-15ab-4b92-9051-cbdf7111cb81 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1470 microversion: 2.1 time: 0.332244 Nov 02 13:39:03.727873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2392/5179] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:03 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1470 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:04.774404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc5a4485-7296-438c-ad46-7fc0a0d68cd2 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:04.777757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cc5a4485-7296-438c-ad46-7fc0a0d68cd2 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:04.802256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5a4485-7296-438c-ad46-7fc0a0d68cd2 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:04.802921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5a4485-7296-438c-ad46-7fc0a0d68cd2 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:04.803404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5a4485-7296-438c-ad46-7fc0a0d68cd2 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:04.804202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5a4485-7296-438c-ad46-7fc0a0d68cd2 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:04.804669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5a4485-7296-438c-ad46-7fc0a0d68cd2 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:04.805105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc5a4485-7296-438c-ad46-7fc0a0d68cd2 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:05.284668 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc5a4485-7296-438c-ad46-7fc0a0d68cd2 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1656 microversion: 2.1 time: 0.536411 Nov 02 13:39:05.285268 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2788/5180] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:04 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1656 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:05.314741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8bbc3235-0d99-4920-9a57-29c3e23ec2aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:05.315527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8bbc3235-0d99-4920-9a57-29c3e23ec2aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:05.331912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbc3235-0d99-4920-9a57-29c3e23ec2aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:05.333356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbc3235-0d99-4920-9a57-29c3e23ec2aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:05.335022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbc3235-0d99-4920-9a57-29c3e23ec2aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:05.336641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbc3235-0d99-4920-9a57-29c3e23ec2aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:05.340143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbc3235-0d99-4920-9a57-29c3e23ec2aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:05.341005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbc3235-0d99-4920-9a57-29c3e23ec2aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:05.846542 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8bbc3235-0d99-4920-9a57-29c3e23ec2aa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1656 microversion: 2.1 time: 0.538646 Nov 02 13:39:05.847977 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2393/5181] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:05 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1656 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:05.874221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-08c6641f-223e-41a1-ad12-80a5b21d97a8 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:05.875735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-08c6641f-223e-41a1-ad12-80a5b21d97a8 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:05.889036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08c6641f-223e-41a1-ad12-80a5b21d97a8 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:05.889541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08c6641f-223e-41a1-ad12-80a5b21d97a8 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:05.890762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08c6641f-223e-41a1-ad12-80a5b21d97a8 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:05.891863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08c6641f-223e-41a1-ad12-80a5b21d97a8 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:05.893144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08c6641f-223e-41a1-ad12-80a5b21d97a8 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:05.894004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08c6641f-223e-41a1-ad12-80a5b21d97a8 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:06.296579 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-08c6641f-223e-41a1-ad12-80a5b21d97a8 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1656 microversion: 2.1 time: 0.424768 Nov 02 13:39:06.299410 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2789/5182] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:05 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1656 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:06.328451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:06.329750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:06.347105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:06.350859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:06.351616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:06.352498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:06.353087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:06.354567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:06.433711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:39:06.581620 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1ba3043a-24d3-446a-9a7d-ff1cc90dcb86 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "DELETE /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 204 len: 0 microversion: 2.1 time: 0.259653 Nov 02 13:39:06.583352 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2394/5183] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:39:06 2022] DELETE /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:39:06.593356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6ff2c6fa-670b-4009-8462-3885cfcf2816 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:06.594246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6ff2c6fa-670b-4009-8462-3885cfcf2816 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:06.603918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ff2c6fa-670b-4009-8462-3885cfcf2816 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:06.604840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ff2c6fa-670b-4009-8462-3885cfcf2816 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:06.605829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ff2c6fa-670b-4009-8462-3885cfcf2816 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:06.607091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ff2c6fa-670b-4009-8462-3885cfcf2816 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:06.607764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ff2c6fa-670b-4009-8462-3885cfcf2816 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:06.608464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ff2c6fa-670b-4009-8462-3885cfcf2816 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:07.003477 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6ff2c6fa-670b-4009-8462-3885cfcf2816 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1662 microversion: 2.1 time: 0.415419 Nov 02 13:39:07.004223 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2790/5184] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:06 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1662 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:08.029040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ac513a8c-a4eb-451a-83a3-9ec280ab4061 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:08.031478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ac513a8c-a4eb-451a-83a3-9ec280ab4061 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:08.045662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac513a8c-a4eb-451a-83a3-9ec280ab4061 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:08.046414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac513a8c-a4eb-451a-83a3-9ec280ab4061 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:08.047326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac513a8c-a4eb-451a-83a3-9ec280ab4061 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:08.048657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac513a8c-a4eb-451a-83a3-9ec280ab4061 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:08.049816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac513a8c-a4eb-451a-83a3-9ec280ab4061 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:08.051243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac513a8c-a4eb-451a-83a3-9ec280ab4061 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:08.269824 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ac513a8c-a4eb-451a-83a3-9ec280ab4061 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1662 microversion: 2.1 time: 0.244673 Nov 02 13:39:08.270399 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2395/5185] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:08 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1662 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:09.048186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-608695c4-9a6a-4f8a-a562-7228701fe66d req-a3a782ea-9692-4d76-b209-9a96e19bc1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872c0da2-0bff-41df-91eb-fdf491ee2020", "name": "network-vif-deleted", "tag": "e1daf163-efc4-4e32-b9ab-8c49062ba612"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:09.060816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-608695c4-9a6a-4f8a-a562-7228701fe66d req-a3a782ea-9692-4d76-b209-9a96e19bc1db service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:09.061654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-608695c4-9a6a-4f8a-a562-7228701fe66d req-a3a782ea-9692-4d76-b209-9a96e19bc1db service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:09.062300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-608695c4-9a6a-4f8a-a562-7228701fe66d req-a3a782ea-9692-4d76-b209-9a96e19bc1db service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:09.078334 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-608695c4-9a6a-4f8a-a562-7228701fe66d req-a3a782ea-9692-4d76-b209-9a96e19bc1db service nova] Creating event network-vif-deleted:e1daf163-efc4-4e32-b9ab-8c49062ba612 for instance 872c0da2-0bff-41df-91eb-fdf491ee2020 on n-h2-858384-19 Nov 02 13:39:09.087261 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-608695c4-9a6a-4f8a-a562-7228701fe66d req-a3a782ea-9692-4d76-b209-9a96e19bc1db service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042949 Nov 02 13:39:09.094314 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2791/5186] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:09.294894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:09.295524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:09.308227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:09.308733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:09.309181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:09.313994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:09.314489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:09.314935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:09.372530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:09.403735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:09.404414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:09.404985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lazy-loading 'fault' on Instance uuid 872c0da2-0bff-41df-91eb-fdf491ee2020 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:09.561228 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-732b5079-e7d1-45b4-9822-b7f39ae4d409 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 200 len: 1460 microversion: 2.1 time: 0.268749 Nov 02 13:39:09.563665 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2396/5187] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:09 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 1460 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:09.805661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:09.806265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:09.821614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:09.822122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:09.822569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:09.832305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:09.833922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:09.834405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:09.912719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:39:10.181442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3ff077e5-1ffd-4ad9-8247-d11cf8759eb9 req-9c765e94-e368-4653-8450-86636f169cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d69a6e-5de9-4dfc-b377-9f50068906b0", "tag": "e25a428f-563b-4402-8188-e1f4d3257186"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:10.212951 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6fe3f487-689f-4289-aca2-1a305ad48599 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 204 len: 0 microversion: 2.1 time: 0.411339 Nov 02 13:39:10.214607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ff077e5-1ffd-4ad9-8247-d11cf8759eb9 req-9c765e94-e368-4653-8450-86636f169cd1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:10.217054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ff077e5-1ffd-4ad9-8247-d11cf8759eb9 req-9c765e94-e368-4653-8450-86636f169cd1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:10.217881 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2792/5188] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:39:09 2022] DELETE /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:39:10.218470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ff077e5-1ffd-4ad9-8247-d11cf8759eb9 req-9c765e94-e368-4653-8450-86636f169cd1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:10.224720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:10.229504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:10.246958 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3ff077e5-1ffd-4ad9-8247-d11cf8759eb9 req-9c765e94-e368-4653-8450-86636f169cd1 service nova] Creating event network-changed:e25a428f-563b-4402-8188-e1f4d3257186 for instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 on n-h1-858384-19 Nov 02 13:39:10.253271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:10.253780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:10.254125 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3ff077e5-1ffd-4ad9-8247-d11cf8759eb9 req-9c765e94-e368-4653-8450-86636f169cd1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394120 Nov 02 13:39:10.256199 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2397/5189] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:39:10.258441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:10.259500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:10.263948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:10.264420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:10.588145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:10.589785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:10.591761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 872c0da2-0bff-41df-91eb-fdf491ee2020] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:10.597647 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1f8fdc3d-bece-45dd-89ab-6da5bf366d5a tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1585 microversion: 2.1 time: 0.377899 Nov 02 13:39:10.610619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:10.611428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:10.612028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:10.612918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:10.613793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:10.614919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:10.615725 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2793/5190] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:10 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1585 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:10.643317 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] HTTP exception thrown: Instance 872c0da2-0bff-41df-91eb-fdf491ee2020 could not be found. Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Request method failure captured: Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 HTTP/1.1 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnLLHtPy4gF_59I0GOshLVIegg9MG-0ISl9kJe8JBMkxNglFP6havSpsv-ITFjrp__fx_XpYET7YuEq0NBhhugvSuzk1A5tu6LR7Uf3Dmwa_6l99dKIrHAiLEO-Fcg4ypVSSDSd6PWFE1tUaMV4vZjhBBhfxgW5_8Z0s02exzzOMA6w Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 459eeaac191e4ab7ae1c40b7d204a8e7 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestServerMultinode-671321214 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/459eeaac191e4ab7ae1c40b7d204a8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/459eeaac191e4ab7ae1c40b7d204a8e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_459eeaac191e4ab7ae1c40b7d204a8e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/459eeaac191e4ab7ae1c40b7d204a8e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestServerMultinode-671321214 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 459eeaac191e4ab7ae1c40b7d204a8e7 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestServerMultinode-671321214 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestServerMultinode-671321214-project-admin Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f17b83b4a50d42c4b60eb71ea6bc7d09 Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestServerMultinode-671321214-project-admin Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 872c0da2-0bff-41df-91eb-fdf491ee2020 could not be found. Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '872c0da2-0bff-41df-91eb-fdf491ee2020'} Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872c0da2-0bff-41df-91eb-fdf491ee2020 could not be found. Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872c0da2-0bff-41df-91eb-fdf491ee2020 could not be found. Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:10.649321 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:10.655014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:10.655014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:10.655014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:10.655014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:10.655014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:10.655014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872c0da2-0bff-41df-91eb-fdf491ee2020 could not be found. Nov 02 13:39:10.655014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:10.657077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Returning 404 to user: Instance 872c0da2-0bff-41df-91eb-fdf491ee2020 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:10.658271 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a07d1385-dd3f-4eea-9f27-ffd1e08dd0fa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020" status: 404 len: 111 microversion: 2.1 time: 0.073565 Nov 02 13:39:10.660000 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2398/5191] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:10 2022] GET /compute/v2.1/servers/872c0da2-0bff-41df-91eb-fdf491ee2020 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:39:10.669197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:10.669197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:10.679978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:10.680477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:10.680922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:10.681649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:10.682107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:10.682537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:10.754271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:39:10.935910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-51c4d155-9589-4a41-87ea-219c631104b5 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "DELETE /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 204 len: 0 microversion: 2.1 time: 0.271505 Nov 02 13:39:10.940330 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2794/5192] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:39:10 2022] DELETE /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:39:10.946580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ef799ce3-4f1e-4956-987b-79acafc49336 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:10.947656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ef799ce3-4f1e-4956-987b-79acafc49336 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:10.951370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:10.957140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef799ce3-4f1e-4956-987b-79acafc49336 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:10.958897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef799ce3-4f1e-4956-987b-79acafc49336 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:10.959674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef799ce3-4f1e-4956-987b-79acafc49336 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:10.961183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef799ce3-4f1e-4956-987b-79acafc49336 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:10.961921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef799ce3-4f1e-4956-987b-79acafc49336 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:10.962623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef799ce3-4f1e-4956-987b-79acafc49336 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:11.296863 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ef799ce3-4f1e-4956-987b-79acafc49336 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1659 microversion: 2.1 time: 0.355197 Nov 02 13:39:11.299198 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2399/5193] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:10 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1659 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:11.633497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:11.634955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:11.649172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:11.652030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:11.652493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:11.653313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:11.653868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:11.654204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:11.731947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:12.085278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:12.093699 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6ccae41f-0356-46b0-accb-4870e89e9595 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1585 microversion: 2.1 time: 0.468161 Nov 02 13:39:12.104893 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2795/5194] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:11 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1585 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:12.325603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c48f4ab1-1203-4711-9940-42e340c990b4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:12.326905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c48f4ab1-1203-4711-9940-42e340c990b4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:12.336749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48f4ab1-1203-4711-9940-42e340c990b4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:12.337315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48f4ab1-1203-4711-9940-42e340c990b4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:12.337846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48f4ab1-1203-4711-9940-42e340c990b4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:12.338654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48f4ab1-1203-4711-9940-42e340c990b4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:12.339670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48f4ab1-1203-4711-9940-42e340c990b4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:12.342627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c48f4ab1-1203-4711-9940-42e340c990b4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:12.560242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:12.560242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:12.573101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:12.573765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:12.574215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:12.574933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:12.576929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:12.577383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:12.600943 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c48f4ab1-1203-4711-9940-42e340c990b4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1659 microversion: 2.1 time: 0.279750 Nov 02 13:39:12.607162 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2400/5195] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:12 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1659 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:12.745069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lazy-loading 'services' on Instance uuid e21f8474-c128-4b53-bff0-430576924452 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:12.906308 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4315a865-6fa2-4a62-8fd3-9942e6735780 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/os-volume_attachments/f8712247-5667-4ede-a5d1-4d89699be7ab" status: 202 len: 0 microversion: 2.1 time: 0.348447 Nov 02 13:39:12.910630 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2796/5196] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:39:12 2022] DELETE /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/os-volume_attachments/f8712247-5667-4ede-a5d1-4d89699be7ab => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:13.122001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:13.122631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:13.144712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:13.146004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:13.149446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:13.150395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:13.151318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:13.152661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:13.456175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:13.465215 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-29c591d4-af49-4cee-9013-e671bbb076b5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1585 microversion: 2.1 time: 0.347024 Nov 02 13:39:13.465919 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2401/5197] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:13 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1585 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:13.543757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0663dd79-091b-46ae-be87-47d7998e1e34 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Action: 'create', calling method: .version_select at 0x7fe787623b80>, body: {"keypair": {"name": "tempest-keypair-1755565027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnBD3b3lFDv4yuuMj1ayfv9FAB6NPe4Ywn7SHdlLKW4cl3PrPa41dspVs7/4IBPblVV31Kh1/PhS6YsiVBieboQH0XQytTeqHLF+rAaUKVeOfFNaRrm4qRplcFAzM2fYw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:13.563416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0663dd79-091b-46ae-be87-47d7998e1e34 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Getting quotas for project fa2fc76e90ca4f64afd5dc4379dde865. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:39:13.569528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0663dd79-091b-46ae-be87-47d7998e1e34 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Getting quotas for user 4cc6ad8e3d8742099eb404a447c75015 and project fa2fc76e90ca4f64afd5dc4379dde865. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:39:13.585614 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0663dd79-091b-46ae-be87-47d7998e1e34 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [502537fa-e8ab-4b94-bfc3-a3d2264ac5f5] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:39:13.634547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-927f95c6-df4c-43d3-bf34-ae4bd15f5efa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:13.635183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-927f95c6-df4c-43d3-bf34-ae4bd15f5efa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:13.645664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927f95c6-df4c-43d3-bf34-ae4bd15f5efa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:13.646368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927f95c6-df4c-43d3-bf34-ae4bd15f5efa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:13.646523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927f95c6-df4c-43d3-bf34-ae4bd15f5efa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:13.650677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927f95c6-df4c-43d3-bf34-ae4bd15f5efa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:13.651202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927f95c6-df4c-43d3-bf34-ae4bd15f5efa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:13.651644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927f95c6-df4c-43d3-bf34-ae4bd15f5efa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:14.186591 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-927f95c6-df4c-43d3-bf34-ae4bd15f5efa tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1659 microversion: 2.1 time: 0.556722 Nov 02 13:39:14.187103 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2402/5198] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:13 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1659 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:14.491826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:14.492652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:14.511435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:14.513078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:14.514061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:14.515730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:14.520007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:14.521692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:14.597606 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [None req-0663dd79-091b-46ae-be87-47d7998e1e34 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [502537fa-e8ab-4b94-bfc3-a3d2264ac5f5] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 38026. Nov 02 13:39:14.618047 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0663dd79-091b-46ae-be87-47d7998e1e34 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.189534 Nov 02 13:39:14.618922 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2797/5199] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:39:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:15.015608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:15.032432 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1fc2269d-2862-43a8-a236-c4af369b661d tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1585 microversion: 2.1 time: 0.546133 Nov 02 13:39:15.033395 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2403/5200] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:14 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1585 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:15.215934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2fb2173b-fdc7-4944-b881-9aca76db1fd4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:15.217150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2fb2173b-fdc7-4944-b881-9aca76db1fd4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:15.236059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb2173b-fdc7-4944-b881-9aca76db1fd4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:15.240817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb2173b-fdc7-4944-b881-9aca76db1fd4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:15.241294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb2173b-fdc7-4944-b881-9aca76db1fd4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:15.244789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb2173b-fdc7-4944-b881-9aca76db1fd4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:15.245530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb2173b-fdc7-4944-b881-9aca76db1fd4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:15.250481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb2173b-fdc7-4944-b881-9aca76db1fd4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:15.569324 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2fb2173b-fdc7-4944-b881-9aca76db1fd4 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1659 microversion: 2.1 time: 0.357799 Nov 02 13:39:15.573969 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2798/5201] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:15 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1659 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:15.908381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-faafcde1-f73c-4fff-9556-869399f8735e req-20e05eda-d708-4f4a-a6b0-ec7a4743d1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9143d09c-d322-4796-bffb-6c151d950ddc", "name": "network-vif-deleted", "tag": "ca55cd62-51e3-4b06-a4f8-af044726bc72"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:15.939659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-faafcde1-f73c-4fff-9556-869399f8735e req-20e05eda-d708-4f4a-a6b0-ec7a4743d1ba service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:15.942340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-faafcde1-f73c-4fff-9556-869399f8735e req-20e05eda-d708-4f4a-a6b0-ec7a4743d1ba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:15.943652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-faafcde1-f73c-4fff-9556-869399f8735e req-20e05eda-d708-4f4a-a6b0-ec7a4743d1ba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:16.026651 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-faafcde1-f73c-4fff-9556-869399f8735e req-20e05eda-d708-4f4a-a6b0-ec7a4743d1ba service nova] Creating event network-vif-deleted:ca55cd62-51e3-4b06-a4f8-af044726bc72 for instance 9143d09c-d322-4796-bffb-6c151d950ddc on n-h1-858384-19 Nov 02 13:39:16.044220 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-faafcde1-f73c-4fff-9556-869399f8735e req-20e05eda-d708-4f4a-a6b0-ec7a4743d1ba service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139804 Nov 02 13:39:16.052643 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2404/5202] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:16.061851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:16.062529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:16.074172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:16.075866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:16.077287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:16.080444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:16.084157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:16.086499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:16.252962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:16.268211 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12df8a4d-58ef-4251-a145-d2a6f1485636 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1399 microversion: 2.1 time: 0.210959 Nov 02 13:39:16.271373 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2799/5203] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:16 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1399 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:16.598783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:16.599557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:16.609986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:16.615500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:16.616339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:16.617288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:16.621684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:16.622363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:16.702354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:16.702890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:16.703423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:16.706540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lazy-loading 'fault' on Instance uuid 9143d09c-d322-4796-bffb-6c151d950ddc {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:16.935310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-307560198", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f3b29fbd-2a00-4888-8a6b-1517fb31f0e1"}], "security_groups": [{"name": "tempest-securitygroup--1998201965"}], "key_name": "tempest-keypair-1755565027", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:16.965744 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8495d4fe-a110-4b0e-98b7-5e2c5829c4ee tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 200 len: 1457 microversion: 2.1 time: 0.370924 Nov 02 13:39:16.967796 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2405/5204] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:16 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 1457 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:17.131404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] validate_networks() for [('f3b29fbd-2a00-4888-8a6b-1517fb31f0e1', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:39:17.297923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:17.298926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:17.314272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:17.315335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:17.319368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:17.320449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:17.321240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:17.322776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:17.470837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:17.510373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f52d03b0-fc7f-47e8-819d-05c598962d63 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1232 microversion: 2.1 time: 0.217086 Nov 02 13:39:17.510986 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2406/5205] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:17 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1232 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:17.996199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:17.997486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] [instance: 9143d09c-d322-4796-bffb-6c151d950ddc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:18.006190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:18.006681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:18.007131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:18.007862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:18.008317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:18.008739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:18.026904 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] HTTP exception thrown: Instance 9143d09c-d322-4796-bffb-6c151d950ddc could not be found. Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Request method failure captured: Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc HTTP/1.1 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnLLHtPy4gF_59I0GOshLVIegg9MG-0ISl9kJe8JBMkxNglFP6havSpsv-ITFjrp__fx_XpYET7YuEq0NBhhugvSuzk1A5tu6LR7Uf3Dmwa_6l99dKIrHAiLEO-Fcg4ypVSSDSd6PWFE1tUaMV4vZjhBBhfxgW5_8Z0s02exzzOMA6w Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 459eeaac191e4ab7ae1c40b7d204a8e7 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestServerMultinode-671321214 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/459eeaac191e4ab7ae1c40b7d204a8e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/459eeaac191e4ab7ae1c40b7d204a8e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_459eeaac191e4ab7ae1c40b7d204a8e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/459eeaac191e4ab7ae1c40b7d204a8e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestServerMultinode-671321214 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 459eeaac191e4ab7ae1c40b7d204a8e7 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestServerMultinode-671321214 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestServerMultinode-671321214-project-admin Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f17b83b4a50d42c4b60eb71ea6bc7d09 Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestServerMultinode-671321214-project-admin Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 9143d09c-d322-4796-bffb-6c151d950ddc could not be found. Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '9143d09c-d322-4796-bffb-6c151d950ddc'} Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9143d09c-d322-4796-bffb-6c151d950ddc could not be found. Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9143d09c-d322-4796-bffb-6c151d950ddc could not be found. Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:18.029336 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:18.034672 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:18.034672 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:18.034672 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:18.034672 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:18.034672 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:18.034672 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9143d09c-d322-4796-bffb-6c151d950ddc could not be found. Nov 02 13:39:18.034672 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:18.037293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] Returning 404 to user: Instance 9143d09c-d322-4796-bffb-6c151d950ddc could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:18.038351 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dcb1893b-a421-4e5d-bfbb-fb0e4aa91345 tempest-TestServerMultinode-671321214 tempest-TestServerMultinode-671321214-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc" status: 404 len: 111 microversion: 2.1 time: 0.046617 Nov 02 13:39:18.039642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2407/5206] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:17 2022] GET /compute/v2.1/servers/9143d09c-d322-4796-bffb-6c151d950ddc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:39:18.105302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7cbb1d08-81be-4173-961e-b7e63f15979b req-7fe9b560-d910-4c69-b849-dec4e2238c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d69a6e-5de9-4dfc-b377-9f50068906b0", "name": "network-vif-deleted", "tag": "e25a428f-563b-4402-8188-e1f4d3257186"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:18.126076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7cbb1d08-81be-4173-961e-b7e63f15979b req-7fe9b560-d910-4c69-b849-dec4e2238c0e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:18.129246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7cbb1d08-81be-4173-961e-b7e63f15979b req-7fe9b560-d910-4c69-b849-dec4e2238c0e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:18.130913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7cbb1d08-81be-4173-961e-b7e63f15979b req-7fe9b560-d910-4c69-b849-dec4e2238c0e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:18.151406 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7cbb1d08-81be-4173-961e-b7e63f15979b req-7fe9b560-d910-4c69-b849-dec4e2238c0e service nova] Creating event network-vif-deleted:e25a428f-563b-4402-8188-e1f4d3257186 for instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 on n-h1-858384-19 Nov 02 13:39:18.156728 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7cbb1d08-81be-4173-961e-b7e63f15979b req-7fe9b560-d910-4c69-b849-dec4e2238c0e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055522 Nov 02 13:39:18.157945 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2408/5207] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:39:18.245567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Getting quotas for project fa2fc76e90ca4f64afd5dc4379dde865. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:39:18.253359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Getting quotas for user 4cc6ad8e3d8742099eb404a447c75015 and project fa2fc76e90ca4f64afd5dc4379dde865. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:39:18.268130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:39:18.269094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:39:18.269830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:39:18.270962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:39:18.271713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:39:18.281486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:18.282509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:18.283343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:18.290641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:18.291372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:18.291989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:18.323750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Getting quotas for project fa2fc76e90ca4f64afd5dc4379dde865. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:39:18.339221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Getting quotas for user 4cc6ad8e3d8742099eb404a447c75015 and project fa2fc76e90ca4f64afd5dc4379dde865. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:39:18.356577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:39:18.359494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:39:18.434175 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8aa9a4e-c5d2-4587-bbb1-196cc020d022 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 1.504063 Nov 02 13:39:18.435391 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2800/5208] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:39:16 2022] POST /compute/v2.1/servers => generated 411 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:39:18.451335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eaa1f984-867d-428e-a40e-37ca6b26c599 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:18.452187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eaa1f984-867d-428e-a40e-37ca6b26c599 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:18.534226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:18.535220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:18.562114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:18.562862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:18.563494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:18.570965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:18.572873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:18.573339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:18.621244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eaa1f984-867d-428e-a40e-37ca6b26c599 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:18.632211 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eaa1f984-867d-428e-a40e-37ca6b26c599 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1281 microversion: 2.1 time: 0.188221 Nov 02 13:39:18.633514 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2409/5209] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:18 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:18.787703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:18.806903 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1959fa29-1811-438b-83e3-96af9159c5f0 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1232 microversion: 2.1 time: 0.273876 Nov 02 13:39:18.820545 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2801/5210] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:18 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1232 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:19.657072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2efc6a8a-2da0-4d7a-984a-758844373247 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:19.658309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2efc6a8a-2da0-4d7a-984a-758844373247 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:19.765468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2efc6a8a-2da0-4d7a-984a-758844373247 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:19.785050 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2efc6a8a-2da0-4d7a-984a-758844373247 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1281 microversion: 2.1 time: 0.131908 Nov 02 13:39:19.804924 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2410/5211] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:19 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:19.836165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:19.836840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:19.851722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:19.852126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:19.855456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:19.856251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:19.856730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:19.859017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:20.041008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:20.054936 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4bc54fe6-007e-4b53-8fcc-a9df79745fea tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1232 microversion: 2.1 time: 0.220241 Nov 02 13:39:20.055712 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2802/5212] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:19 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1232 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:20.823693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:20.827190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:20.859867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:20.861752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:20.865571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:20.868885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:20.869613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:20.872926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:21.078147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:21.079425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:21.107557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:21.108174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:21.108631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:21.109679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:21.110330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:21.111721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:21.219850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:21.236999 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d984fbc8-6ec6-408c-9d74-43a4bf3bec23 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1333 microversion: 2.1 time: 0.420939 Nov 02 13:39:21.237149 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2411/5213] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:20 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1333 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:21.247818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b4bc885-cf22-405f-a750-8e78a85e9423 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:21.270565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4bc885-cf22-405f-a750-8e78a85e9423 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:21.272022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4bc885-cf22-405f-a750-8e78a85e9423 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:21.275306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4bc885-cf22-405f-a750-8e78a85e9423 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:21.296329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:21.311228 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d21f4a7-62d1-4d7b-8da6-5b392df997bf tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1232 microversion: 2.1 time: 0.237114 Nov 02 13:39:21.313653 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2803/5214] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:21 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1232 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:21.315942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:21.344014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b4bc885-cf22-405f-a750-8e78a85e9423 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Going to try to stop instance {{(pid=120929) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:39:21.458172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b4bc885-cf22-405f-a750-8e78a85e9423 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/action" status: 202 len: 0 microversion: 2.1 time: 0.217664 Nov 02 13:39:21.458805 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2412/5215] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:39:21 2022] POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:21.474456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:21.475060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:21.491806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:21.493305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:21.493764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:21.495676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:21.496924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:21.498887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:22.003429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:22.011779 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d7598c74-e0fe-471e-acfc-3f704535f108 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1679 microversion: 2.1 time: 0.548456 Nov 02 13:39:22.022371 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2804/5216] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:21 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1679 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:22.266133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:22.267193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:22.296683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:22.297685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:22.299649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:22.300545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:22.302470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:22.304472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:22.344484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:22.346076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:22.361554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:22.366402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:22.367311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:22.368440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:22.369848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:22.371812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:22.639740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:22.649232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e930073-6492-425e-bfd9-9293a2a3d3c5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1232 microversion: 2.1 time: 0.311285 Nov 02 13:39:22.655983 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2805/5217] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:22 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1232 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:23.041824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:23.043384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:23.045485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:23.055077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:23.055384 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c0a8050b-e4ea-498b-a8c8-52829a0489cb tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1339 microversion: 2.1 time: 0.795264 Nov 02 13:39:23.055980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:23.056117 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2413/5218] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:22 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1339 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:23.057263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:23.058123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:23.058691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:23.059663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:23.325044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:23.339144 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a87606fa-9070-47ea-a9a3-5c34ff848973 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1679 microversion: 2.1 time: 0.302130 Nov 02 13:39:23.340073 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2806/5219] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:23 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1679 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:23.687824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:23.688641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:23.724313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:23.726367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:23.727050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:23.728007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:23.728661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:23.729954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:24.098496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:24.099397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:24.111834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:24.114872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:24.116378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:24.119203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:24.121245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:24.122359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:24.360816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:24.374747 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1f11eed-8e19-460e-8bdc-492160e36db5 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1232 microversion: 2.1 time: 0.700572 Nov 02 13:39:24.376012 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2414/5220] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:23 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1232 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:24.390181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a79d1631-25af-4973-947f-fae064c792ee tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:24.393938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a79d1631-25af-4973-947f-fae064c792ee tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:24.412192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a79d1631-25af-4973-947f-fae064c792ee tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:24.412707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a79d1631-25af-4973-947f-fae064c792ee tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:24.413155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a79d1631-25af-4973-947f-fae064c792ee tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:24.413891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a79d1631-25af-4973-947f-fae064c792ee tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:24.414353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a79d1631-25af-4973-947f-fae064c792ee tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:24.414785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a79d1631-25af-4973-947f-fae064c792ee tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:24.479735 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a79d1631-25af-4973-947f-fae064c792ee tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab/ips" status: 200 len: 148 microversion: 2.1 time: 0.096246 Nov 02 13:39:24.481186 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2415/5221] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:39:24 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab/ips => generated 148 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:24.495787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:24.496862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:24.512426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:24.519344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:24.520701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:24.522057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:24.522765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:24.523598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:24.747757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:24.762401 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-86bb22f6-2bfd-4889-9a2c-edb4ddc1c810 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 0.667884 Nov 02 13:39:24.784017 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2807/5222] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:24 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:24.828457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ba45898-f216-47a3-9138-8d245cba1476"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:24.835645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:24.859035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:24.862215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:24.865817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:24.868203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:24.872285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:24.873031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.063080 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Invalid volume: volume 2ba45898-f216-47a3-9138-8d245cba1476 is already attached to instances: f97fc922-3426-43e9-916a-32c813e2751f Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab/os-volume_attachments HTTP/1.1 Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 74 Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: {"volumeAttachment": {"volumeId": "2ba45898-f216-47a3-9138-8d245cba1476"}} Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid volume: volume 2ba45898-f216-47a3-9138-8d245cba1476 is already attached to instances: f97fc922-3426-43e9-916a-32c813e2751f Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'server_id': 'c9bb2256-24c1-4246-83bb-50eb3a869aab', 'body': {'volumeAttachment': {'volumeId': '2ba45898-f216-47a3-9138-8d245cba1476'}}} Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in attach_volume Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4971, in _check_volume_already_attached Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ba45898-f216-47a3-9138-8d245cba1476 is already attached to instances: f97fc922-3426-43e9-916a-32c813e2751f Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:39:25.066147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ba45898-f216-47a3-9138-8d245cba1476 is already attached to instances: f97fc922-3426-43e9-916a-32c813e2751f Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ba45898-f216-47a3-9138-8d245cba1476 is already attached to instances: f97fc922-3426-43e9-916a-32c813e2751f Nov 02 13:39:25.071862 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:25.076590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 400 to user: Invalid volume: volume 2ba45898-f216-47a3-9138-8d245cba1476 is already attached to instances: f97fc922-3426-43e9-916a-32c813e2751f {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:25.077676 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5f4cf93b-4c4c-41b8-b539-cce38da14fd1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.292123 Nov 02 13:39:25.078451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2808/5223] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:39:24 2022] POST /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab/os-volume_attachments => generated 174 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:39:25.089107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:25.089612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:25.099871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.100507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.100795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.101522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.101968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.102404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.144364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:39:25.246996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:25.259236 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4669a5e2-5703-47ea-ae0d-efce8741240a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1679 microversion: 2.1 time: 0.776672 Nov 02 13:39:25.260404 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2416/5224] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:24 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1679 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:25.305247 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9848eba2-8be7-4dc5-abd1-53cc863d233c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 204 len: 0 microversion: 2.1 time: 0.220653 Nov 02 13:39:25.305856 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2809/5225] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:39:25 2022] DELETE /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:39:25.314868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:25.315794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:25.323130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.324049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.324650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.325536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.326152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.326735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.407039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:25.408120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:25.419496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:25.428920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.429506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.430183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.431745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.432375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.433823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.618238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:25.628522 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6b6aa107-334f-4990-a62f-c90af8bba700 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1232 microversion: 2.1 time: 0.229342 Nov 02 13:39:25.631888 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2810/5226] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:25 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1232 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:25.786925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:25.788144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:25.797219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.800046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.801491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.803822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:25.806417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:25.807141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:25.818883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:25.877350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:25.902280 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a7f12579-cde5-4a61-852b-b3ed6da7d3fa tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1682 microversion: 2.1 time: 0.591859 Nov 02 13:39:25.903494 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2417/5227] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:25 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1682 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:26.257900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f899bf86-3fef-4983-a7a0-178e67d021af req-bb5bf214-9a41-4613-ac1f-88aca4bb55ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8321a514-447c-4c22-8c24-a7ca091d25ef", "tag": "80daf188-fd85-4ed2-8834-4e74ffa34dcb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:26.271943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f899bf86-3fef-4983-a7a0-178e67d021af req-bb5bf214-9a41-4613-ac1f-88aca4bb55ce service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.273020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f899bf86-3fef-4983-a7a0-178e67d021af req-bb5bf214-9a41-4613-ac1f-88aca4bb55ce service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.275984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f899bf86-3fef-4983-a7a0-178e67d021af req-bb5bf214-9a41-4613-ac1f-88aca4bb55ce service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.289809 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f899bf86-3fef-4983-a7a0-178e67d021af req-bb5bf214-9a41-4613-ac1f-88aca4bb55ce service nova] Creating event network-changed:80daf188-fd85-4ed2-8834-4e74ffa34dcb for instance 8321a514-447c-4c22-8c24-a7ca091d25ef on n-h2-858384-19 Nov 02 13:39:26.296026 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f899bf86-3fef-4983-a7a0-178e67d021af req-bb5bf214-9a41-4613-ac1f-88aca4bb55ce service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168525 Nov 02 13:39:26.297738 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2418/5228] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:26.308062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:26.310199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:26.319202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.320056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.320725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.321676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.322400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.323048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.565204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:26.578720 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-939f21ca-0f45-4027-91a3-7dd56a51034e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 0.791959 Nov 02 13:39:26.579408 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2811/5229] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:25 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:26.654663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:26.655522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:26.669820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.670580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.671334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.672222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.672845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.673469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.808749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:26.824066 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0cf4bde5-9d00-4909-8afa-0acfa5cff0e9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1679 microversion: 2.1 time: 0.524530 Nov 02 13:39:26.824659 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2419/5230] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:26 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1679 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:26.933312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:26.934248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:26.946827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.947359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.951751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:26.952593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:26.953080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:26.953703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:27.277930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:27.302374 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41f428fa-5cfe-490a-9dee-20c758722029 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1232 microversion: 2.1 time: 0.639954 Nov 02 13:39:27.303885 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2812/5231] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:26 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1232 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:27.522246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:27.543236 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1e961f26-3a2d-4707-91d3-eb350ef1a4b5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1682 microversion: 2.1 time: 0.617015 Nov 02 13:39:27.567462 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2420/5232] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:26 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1682 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:27.607419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:27.608046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:27.618749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:27.624174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:27.624871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:27.626669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:27.627840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:27.630096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:27.855581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:27.856488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:27.872867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:27.875058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:27.877121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:27.878115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:27.880372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:27.882428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:28.310647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:28.349939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=14 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:28.550418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:28.567823 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20078cd2-f769-4c78-ba25-259376d91a1b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 0.968782 Nov 02 13:39:28.585616 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2813/5233] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:27 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:28.599642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:28.601150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:28.621369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:28.623372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:28.624761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:28.627049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:28.627781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:28.629882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:28.711862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:28.712367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:28.713004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:28.713633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lazy-loading 'fault' on Instance uuid e0d69a6e-5de9-4dfc-b377-9f50068906b0 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:29.094015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892fbe677b334c899bdbf3e9b7bbb55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374b4c5a60fe42a6857b430d38750d8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:29.108680 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1fd9f925-8210-4425-af4d-53696955a9e2 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 200 len: 1191 microversion: 2.1 time: 0.519693 Nov 02 13:39:29.109175 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2814/5234] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:28 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 1191 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:29.120646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:29.133103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:29.184971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:29.185476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:29.185926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:29.186665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:29.187151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:29.191940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:29.261772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:29.276835 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-439cae37-fd21-4b4a-9697-cbb5ccd6de8c tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1679 microversion: 2.1 time: 1.428561 Nov 02 13:39:29.277798 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2421/5235] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:27 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1679 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:29.594583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:29.595286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:29.601517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:29.602254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:29.602686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:29.609592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:29.610424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:29.611285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:29.779769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:29.882026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:29.883128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:29.900101 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-81ab3124-994e-452c-9da6-88613fcb75b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 0.309880 Nov 02 13:39:29.901456 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2422/5236] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:29 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:29.909925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-774190fe-aed2-4d38-9874-2913c553ae66 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1682 microversion: 2.1 time: 0.789224 Nov 02 13:39:29.910805 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2815/5237] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:29 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1682 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:30.134020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:30.135235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] [instance: e0d69a6e-5de9-4dfc-b377-9f50068906b0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:30.142282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.142970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.143706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.146017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.146730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.147558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.165205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] HTTP exception thrown: Instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 could not be found. Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Request method failure captured: Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 HTTP/1.1 Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnGp6a4XAcl7VqaUwwUtRckC0jo-BNJY1AtEyg0nuHn-2e1mlORTVn1y3enLLBRHXpb6LB_CaDKJIbWw1R7tdZP6ShqznCv8GHJD-ybWOmUTjHYYn50aOWQkXJQA2l40JiLMhM0b8qMpdL2Q_gJ44P-s8UragPyaMPKK7QwesBEgLfs Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 374b4c5a60fe42a6857b430d38750d8e Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBackupRestore-127686451 Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/374b4c5a60fe42a6857b430d38750d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/374b4c5a60fe42a6857b430d38750d8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_374b4c5a60fe42a6857b430d38750d8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/374b4c5a60fe42a6857b430d38750d8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBackupRestore-127686451 Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 374b4c5a60fe42a6857b430d38750d8e Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBackupRestore-127686451 Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBackupRestore-127686451-project Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 892fbe677b334c899bdbf3e9b7bbb55b Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBackupRestore-127686451-project Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 could not be found. Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e0d69a6e-5de9-4dfc-b377-9f50068906b0'} Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 could not be found. Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 could not be found. Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:30.167492 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.172900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:30.172900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:30.172900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:30.172900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:30.172900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:30.172900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 could not be found. Nov 02 13:39:30.172900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:30.174425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Returning 404 to user: Instance e0d69a6e-5de9-4dfc-b377-9f50068906b0 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:30.175960 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f237a7f1-4a93-4316-92b4-b4f713976c81 tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0" status: 404 len: 111 microversion: 2.1 time: 0.045676 Nov 02 13:39:30.180335 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2423/5238] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:30 2022] GET /compute/v2.1/servers/e0d69a6e-5de9-4dfc-b377-9f50068906b0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:39:30.218480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-257eccf3-fc70-4cf6-a87f-6214dec87e36 req-ce7172d9-8d17-429c-a8a6-cfb1336b7d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bb2256-24c1-4246-83bb-50eb3a869aab", "name": "network-vif-deleted", "tag": "f8a4981f-357b-42a3-9414-c4df6ccea508"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:30.235321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-257eccf3-fc70-4cf6-a87f-6214dec87e36 req-ce7172d9-8d17-429c-a8a6-cfb1336b7d8c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.236701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-257eccf3-fc70-4cf6-a87f-6214dec87e36 req-ce7172d9-8d17-429c-a8a6-cfb1336b7d8c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.238140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-257eccf3-fc70-4cf6-a87f-6214dec87e36 req-ce7172d9-8d17-429c-a8a6-cfb1336b7d8c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.261825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-257eccf3-fc70-4cf6-a87f-6214dec87e36 req-ce7172d9-8d17-429c-a8a6-cfb1336b7d8c service nova] Creating event network-vif-deleted:f8a4981f-357b-42a3-9414-c4df6ccea508 for instance c9bb2256-24c1-4246-83bb-50eb3a869aab on n-h2-858384-19 Nov 02 13:39:30.277909 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-257eccf3-fc70-4cf6-a87f-6214dec87e36 req-ce7172d9-8d17-429c-a8a6-cfb1336b7d8c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063036 Nov 02 13:39:30.279148 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2816/5239] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:30.309971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:30.311255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:30.321043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.321882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.322525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.325965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.326669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.329088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.671201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:30.691487 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f7dd1c3c-1b35-495e-91f6-1943aa9c09c7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1679 microversion: 2.1 time: 0.387747 Nov 02 13:39:30.693908 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2424/5240] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:30 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1679 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:30.697331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b27b001c-7a89-4d59-aa0a-cc6e325480db tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] Calling method '.version_select at 0x7fe786aa71f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:30.729693 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b27b001c-7a89-4d59-aa0a-cc6e325480db tempest-TestVolumeBackupRestore-127686451 tempest-TestVolumeBackupRestore-127686451-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-905060575" status: 202 len: 0 microversion: 2.1 time: 0.038223 Nov 02 13:39:30.730337 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2817/5241] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-905060575 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:30.926854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:30.928225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:30.938018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:30.942814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:30.946473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.949444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.951211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.956293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.957311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.958432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.963738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.964600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.965830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:30.967555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:30.970397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:30.971231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:31.361565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:31.394037 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91305356-689e-4f16-b2d5-68db05cd6e65 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1615 microversion: 2.1 time: 0.462046 Nov 02 13:39:31.400307 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2818/5242] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:30 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1615 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:31.432865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:31.446171 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f793e5a-036c-44ac-9ca0-93050cc49231 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 0.524779 Nov 02 13:39:31.446806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2425/5243] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:30 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:31.722252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:31.724366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:31.737342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:31.740107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:31.740731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:31.741507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:31.745136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:31.745619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:32.158145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:32.181098 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aa29b5a0-fedd-4c36-96b9-dc1c9ed56ede tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1679 microversion: 2.1 time: 0.461821 Nov 02 13:39:32.183915 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2819/5244] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:31 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1679 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:32.432640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:32.434098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:32.464488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:32.469916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:32.470732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:32.475248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:32.476078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:32.477930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:32.478783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:32.480724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:32.509875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:32.525982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:32.526747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:32.527863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:32.533444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:32.542504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:32.662216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:32.663161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:32.668610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:32.669290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lazy-loading 'fault' on Instance uuid c9bb2256-24c1-4246-83bb-50eb3a869aab {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:32.928257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:32.958323 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9697408b-2c78-49df-b70a-05ae5d804439 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 200 len: 1334 microversion: 2.1 time: 0.535141 Nov 02 13:39:32.967473 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2426/5245] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:32 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 1334 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:33.209473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:33.210590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:33.211212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:33.224113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:33.224619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:33.233615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:33.241167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:33.242100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:33.242100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:33.246359 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d10b67bf-50c5-4f93-912e-7328115af145 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 0.778190 Nov 02 13:39:33.252422 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2820/5246] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:32 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:33.932093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:33.941052 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a9a0f2c-f808-4e6a-a385-86e0b6d9acdc tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1656 microversion: 2.1 time: 0.735055 Nov 02 13:39:33.965251 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2427/5247] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:33 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1656 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:33.971578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-018c3980-b723-4dae-a27c-12acbf3b370a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:33.985333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-018c3980-b723-4dae-a27c-12acbf3b370a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:33.994712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:33.994860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-018c3980-b723-4dae-a27c-12acbf3b370a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:33.995370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:33.997208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-018c3980-b723-4dae-a27c-12acbf3b370a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:34.003544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:34.014415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:34.015157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:34.018250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:34.018911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:34.020318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:34.085234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-018c3980-b723-4dae-a27c-12acbf3b370a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Going to try to start instance {{(pid=120928) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 13:39:34.094049 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab HTTP/1.1 Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'c9bb2256-24c1-4246-83bb-50eb3a869aab'} Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:34.095989 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:34.101590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:34.101590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:34.101590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:34.101590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:34.101590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:34.101590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:39:34.101590 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:34.104334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:34.106694 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-814c9131-381a-4812-87b8-b87799189e51 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 404 len: 111 microversion: 2.1 time: 0.114639 Nov 02 13:39:34.106694 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2428/5248] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:33 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:39:34.134740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a0e47c8-5b49-4771-98e7-e165def700a7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '.version_select at 0x7fe7866ba3a0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:34.175239 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a0e47c8-5b49-4771-98e7-e165def700a7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673475872" status: 202 len: 0 microversion: 2.1 time: 0.046839 Nov 02 13:39:34.178955 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2429/5249] 10.222.0.113 () {58 vars in 1223 bytes} [Wed Nov 2 13:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673475872 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:34.245558 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-018c3980-b723-4dae-a27c-12acbf3b370a tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/action" status: 202 len: 0 microversion: 2.1 time: 0.278650 Nov 02 13:39:34.247342 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2821/5250] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:39:33 2022] POST /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:34.256238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:34.257220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:34.282670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:34.283639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:34.288381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:34.290934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:34.293750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:34.294769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:34.296080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:34.298146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:34.307036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:34.312799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:34.313276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:34.331856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:34.332387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:34.332850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:34.823216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:34.834240 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be55abe8-742b-4d9d-b7f6-cf78c203e996 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 0.557093 Nov 02 13:39:34.834751 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2822/5251] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:34 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:35.477482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:35.491715 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2169c036-571a-4450-9e1f-594b4af48f28 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1665 microversion: 2.1 time: 1.240173 Nov 02 13:39:35.492495 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2430/5252] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:34 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1665 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:35.859145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:35.859847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:35.880624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:35.881241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:35.881693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:35.882280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:35.882781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:35.883175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:36.520480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:36.521297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:36.539867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:36.540417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:36.566013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:36.567992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:36.568663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:36.574718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:36.579675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:36.796850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:36.809030 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-682d49f2-a737-4a52-82e9-8710eb287538 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 0.954490 Nov 02 13:39:36.818554 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2823/5253] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:35 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:37.336526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:37.344843 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f8cc549a-bd05-4ab2-9c71-dde0b1332232 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1665 microversion: 2.1 time: 0.828223 Nov 02 13:39:37.356996 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2431/5254] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:36 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1665 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:37.472722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee5e8abc-5aab-46b6-baa4-356afc47421b tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Action: 'create', calling method: .version_select at 0x7fe786c6f040>, body: {"keypair": {"name": "tempest-keypair-1383255852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/bQnCBq3fGkqE72UEatnQuFVQCH3H1z2X2mr2SlLT0nCu1po+9UV0kDHM3hJOxcLiuf/RfPomXa0tKUGWd+JtHyOnkefG+edAch1KbFunVr9k3ELjGbgHDMqCx4ueedg=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:37.503618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-ee5e8abc-5aab-46b6-baa4-356afc47421b tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Getting quotas for project b70197f1a93b478398b14900c12e8863. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:39:37.518791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-ee5e8abc-5aab-46b6-baa4-356afc47421b tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Getting quotas for user dddb08b841ae477484ff07f8e0aaea44 and project b70197f1a93b478398b14900c12e8863. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:39:37.620239 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee5e8abc-5aab-46b6-baa4-356afc47421b tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.160557 Nov 02 13:39:37.621033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2824/5255] 10.222.0.113 () {62 vars in 1205 bytes} [Wed Nov 2 13:39:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:39:37.843676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:37.844903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:37.860505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:37.864062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:37.868159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:37.873104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:37.876466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:37.876930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:38.264657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:38.273086 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-045b0931-a64c-41e8-aef1-222a9634b38b tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 0.433435 Nov 02 13:39:38.273671 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2432/5256] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:37 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:38.377026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:38.377761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:38.398907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:38.399692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:38.400300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:38.401241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:38.401859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:38.402485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:38.778065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ed8cf6bb-0fa7-4235-a8c6-6b937ef6160a req-af45e402-26da-439e-84ab-0349aa626bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8321a514-447c-4c22-8c24-a7ca091d25ef", "name": "network-vif-plugged", "status": "completed", "tag": "80daf188-fd85-4ed2-8834-4e74ffa34dcb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:38.790855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ed8cf6bb-0fa7-4235-a8c6-6b937ef6160a req-af45e402-26da-439e-84ab-0349aa626bce service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:38.795191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ed8cf6bb-0fa7-4235-a8c6-6b937ef6160a req-af45e402-26da-439e-84ab-0349aa626bce service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:38.795770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ed8cf6bb-0fa7-4235-a8c6-6b937ef6160a req-af45e402-26da-439e-84ab-0349aa626bce service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:38.817120 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ed8cf6bb-0fa7-4235-a8c6-6b937ef6160a req-af45e402-26da-439e-84ab-0349aa626bce service nova] Creating event network-vif-plugged:80daf188-fd85-4ed2-8834-4e74ffa34dcb for instance 8321a514-447c-4c22-8c24-a7ca091d25ef on n-h2-858384-19 Nov 02 13:39:38.832616 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ed8cf6bb-0fa7-4235-a8c6-6b937ef6160a req-af45e402-26da-439e-84ab-0349aa626bce service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184432 Nov 02 13:39:38.835888 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2433/5257] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:39:38.940269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:38.950348 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da74ce99-b867-4803-b88c-45aa5f01bcd5 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1669 microversion: 2.1 time: 0.577464 Nov 02 13:39:38.955006 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2825/5258] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:38 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1669 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:39.036661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:39.037250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:39.057131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.058002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.058692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.059660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.060645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.061293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.200275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lazy-loading 'services' on Instance uuid f97fc922-3426-43e9-916a-32c813e2751f {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:39.305885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:39.306688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:39.319220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.320874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.325584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.326514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.327313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.327953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.389598 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad5731a3-007d-44c7-b5e7-35a7e3c2620e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments/2ba45898-f216-47a3-9138-8d245cba1476" status: 202 len: 0 microversion: 2.1 time: 0.358254 Nov 02 13:39:39.392746 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2434/5259] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:39:39 2022] DELETE /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments/2ba45898-f216-47a3-9138-8d245cba1476 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:39.419289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9de46752-d1be-4841-b30e-00dd23c6aaa6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:39.429186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9de46752-d1be-4841-b30e-00dd23c6aaa6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:39.465486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9de46752-d1be-4841-b30e-00dd23c6aaa6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.466078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9de46752-d1be-4841-b30e-00dd23c6aaa6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.466622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9de46752-d1be-4841-b30e-00dd23c6aaa6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.467457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9de46752-d1be-4841-b30e-00dd23c6aaa6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:39.469646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9de46752-d1be-4841-b30e-00dd23c6aaa6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:39.470109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9de46752-d1be-4841-b30e-00dd23c6aaa6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:39.570110 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9de46752-d1be-4841-b30e-00dd23c6aaa6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163114 Nov 02 13:39:39.577505 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2435/5260] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:39 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:40.595372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d1aa337-2bc3-4418-a530-b9b09ea359c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:40.598359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1d1aa337-2bc3-4418-a530-b9b09ea359c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:40.614802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1aa337-2bc3-4418-a530-b9b09ea359c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:40.615380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1aa337-2bc3-4418-a530-b9b09ea359c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:40.615829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1aa337-2bc3-4418-a530-b9b09ea359c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:40.623040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1aa337-2bc3-4418-a530-b9b09ea359c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:40.623488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1aa337-2bc3-4418-a530-b9b09ea359c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:40.623937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d1aa337-2bc3-4418-a530-b9b09ea359c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:40.703485 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d1aa337-2bc3-4418-a530-b9b09ea359c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122778 Nov 02 13:39:40.704438 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2436/5261] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:40 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:40.737233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:40.754506 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-883fa5d9-edfb-4342-9917-3874a6d7ec5a tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1407 microversion: 2.1 time: 1.455220 Nov 02 13:39:40.774758 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2826/5262] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:39 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1407 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:41.716406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4c7f968-c325-49b5-b1d8-4eea099b2c39 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:41.718796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4c7f968-c325-49b5-b1d8-4eea099b2c39 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:41.737527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:41.739859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4c7f968-c325-49b5-b1d8-4eea099b2c39 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:41.740322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4c7f968-c325-49b5-b1d8-4eea099b2c39 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:41.740814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4c7f968-c325-49b5-b1d8-4eea099b2c39 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:41.741544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4c7f968-c325-49b5-b1d8-4eea099b2c39 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:41.742047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4c7f968-c325-49b5-b1d8-4eea099b2c39 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:41.742481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4c7f968-c325-49b5-b1d8-4eea099b2c39 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:41.783614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:41.784486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:41.799573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:41.800892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:41.801354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:41.806515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:41.807270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:41.807721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:41.816719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4c7f968-c325-49b5-b1d8-4eea099b2c39 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103452 Nov 02 13:39:41.817222 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2437/5263] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:41 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:42.183589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:42.213961 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b1abe88e-3edb-48b3-a25e-1797bf402274 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1593 microversion: 2.1 time: 0.432952 Nov 02 13:39:42.224774 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2827/5264] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:41 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1593 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:42.245325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49802c59-d064-42e8-9919-5776b3a64d6e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:42.246010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49802c59-d064-42e8-9919-5776b3a64d6e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:42.258662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49802c59-d064-42e8-9919-5776b3a64d6e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:42.259303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49802c59-d064-42e8-9919-5776b3a64d6e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:42.259846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49802c59-d064-42e8-9919-5776b3a64d6e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:42.264750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49802c59-d064-42e8-9919-5776b3a64d6e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:42.265356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49802c59-d064-42e8-9919-5776b3a64d6e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:42.267983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49802c59-d064-42e8-9919-5776b3a64d6e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:42.431887 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49802c59-d064-42e8-9919-5776b3a64d6e tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192484 Nov 02 13:39:42.433281 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2438/5265] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:39:42 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:42.705590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1175737978", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ce1cf61e-169f-4e97-8de1-38c66ae9b6a0"}, {"port": "393ebc4f-0e1c-4b0f-a87e-243e38c2925b", "tag": "port-1"}, {"port": "a1701be5-ce69-4eb1-b195-3b9262f740d0", "tag": "port-2"}, {"uuid": "09caa999-d1e2-4301-a629-b824a279ec7b", "tag": "net-1"}, {"uuid": "09caa999-d1e2-4301-a629-b824a279ec7b"}, {"uuid": "7d06b024-ab9d-444b-a01a-6cbb23ee0553", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7d06b024-ab9d-444b-a01a-6cbb23ee0553", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f988f648-c0ec-4c3f-8502-29f54c776bef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d9ec28c4-5bc9-465b-9c32-5b2ac4468f82", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "71878eca-76a3-41c0-9ebc-df5802c2ba47", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1660440120"}], "key_name": "tempest-keypair-1383255852", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:42.830457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c74cbd1-1458-4e90-8f8e-6c8f6f310fec tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:42.834402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c74cbd1-1458-4e90-8f8e-6c8f6f310fec tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:42.852258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c74cbd1-1458-4e90-8f8e-6c8f6f310fec tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:42.860813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c74cbd1-1458-4e90-8f8e-6c8f6f310fec tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:42.862337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c74cbd1-1458-4e90-8f8e-6c8f6f310fec tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:42.864908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c74cbd1-1458-4e90-8f8e-6c8f6f310fec tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:42.867020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c74cbd1-1458-4e90-8f8e-6c8f6f310fec tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:42.868392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c74cbd1-1458-4e90-8f8e-6c8f6f310fec tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:42.962390 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c74cbd1-1458-4e90-8f8e-6c8f6f310fec tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136562 Nov 02 13:39:42.968091 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2439/5266] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:42 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:43.489041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] validate_networks() for [('ce1cf61e-169f-4e97-8de1-38c66ae9b6a0', None, None, None, None, None), (None, None, '393ebc4f-0e1c-4b0f-a87e-243e38c2925b', None, None, None), (None, None, 'a1701be5-ce69-4eb1-b195-3b9262f740d0', None, None, None), ('09caa999-d1e2-4301-a629-b824a279ec7b', None, None, None, None, None), ('09caa999-d1e2-4301-a629-b824a279ec7b', None, None, None, None, None), ('7d06b024-ab9d-444b-a01a-6cbb23ee0553', '10.2.2.100', None, None, None, None), ('7d06b024-ab9d-444b-a01a-6cbb23ee0553', '10.2.2.200', None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:39:43.981409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d769843-cdbe-4f2e-a570-e77e9e9fc03b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:43.984461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d769843-cdbe-4f2e-a570-e77e9e9fc03b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:44.000904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d769843-cdbe-4f2e-a570-e77e9e9fc03b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:44.004504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d769843-cdbe-4f2e-a570-e77e9e9fc03b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:44.004991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d769843-cdbe-4f2e-a570-e77e9e9fc03b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:44.005754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d769843-cdbe-4f2e-a570-e77e9e9fc03b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:44.010424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d769843-cdbe-4f2e-a570-e77e9e9fc03b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:44.010962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d769843-cdbe-4f2e-a570-e77e9e9fc03b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:44.101306 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d769843-cdbe-4f2e-a570-e77e9e9fc03b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125911 Nov 02 13:39:44.106385 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2440/5267] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:43 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:45.119624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dba43645-cb29-4fe0-aae7-5e2a5f996c5e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:45.121936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dba43645-cb29-4fe0-aae7-5e2a5f996c5e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:45.137045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba43645-cb29-4fe0-aae7-5e2a5f996c5e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:45.138454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba43645-cb29-4fe0-aae7-5e2a5f996c5e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:45.139310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba43645-cb29-4fe0-aae7-5e2a5f996c5e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:45.144601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba43645-cb29-4fe0-aae7-5e2a5f996c5e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:45.146497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba43645-cb29-4fe0-aae7-5e2a5f996c5e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:45.149301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dba43645-cb29-4fe0-aae7-5e2a5f996c5e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:45.284630 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dba43645-cb29-4fe0-aae7-5e2a5f996c5e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171395 Nov 02 13:39:45.286287 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2441/5268] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:45 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:39:46.301210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff7a9436-319d-4009-816c-8fad8d2305ae tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:46.303452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ff7a9436-319d-4009-816c-8fad8d2305ae tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:46.338036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff7a9436-319d-4009-816c-8fad8d2305ae tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:46.338573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff7a9436-319d-4009-816c-8fad8d2305ae tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:46.339034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff7a9436-319d-4009-816c-8fad8d2305ae tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:46.339822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff7a9436-319d-4009-816c-8fad8d2305ae tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:46.340281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff7a9436-319d-4009-816c-8fad8d2305ae tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:46.351282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff7a9436-319d-4009-816c-8fad8d2305ae tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:46.476010 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff7a9436-319d-4009-816c-8fad8d2305ae tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181648 Nov 02 13:39:46.488595 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2442/5269] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:46 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:39:46.918909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:46.919898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:46.933120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:46.936702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:46.937407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:46.939604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:46.943726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:46.947379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:47.366029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:47.381153 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9cc44d7b-2ff2-4270-a58d-7de9cd9e4521 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1593 microversion: 2.1 time: 0.465195 Nov 02 13:39:47.381792 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2443/5270] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:46 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1593 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:47.400778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5ca1b691-6eed-4cbd-9d94-7986163672a4 req-3ced9640-005d-4b9a-871b-92576f608cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8321a514-447c-4c22-8c24-a7ca091d25ef", "tag": "80daf188-fd85-4ed2-8834-4e74ffa34dcb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:47.428611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5ca1b691-6eed-4cbd-9d94-7986163672a4 req-3ced9640-005d-4b9a-871b-92576f608cc1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:47.429104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5ca1b691-6eed-4cbd-9d94-7986163672a4 req-3ced9640-005d-4b9a-871b-92576f608cc1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:47.429537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5ca1b691-6eed-4cbd-9d94-7986163672a4 req-3ced9640-005d-4b9a-871b-92576f608cc1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:47.484424 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5ca1b691-6eed-4cbd-9d94-7986163672a4 req-3ced9640-005d-4b9a-871b-92576f608cc1 service nova] Creating event network-changed:80daf188-fd85-4ed2-8834-4e74ffa34dcb for instance 8321a514-447c-4c22-8c24-a7ca091d25ef on n-h2-858384-19 Nov 02 13:39:47.507519 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5ca1b691-6eed-4cbd-9d94-7986163672a4 req-3ced9640-005d-4b9a-871b-92576f608cc1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110456 Nov 02 13:39:47.510297 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2444/5271] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:47.558986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b497c73-a040-45cf-94ee-464fec5128bf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:47.562994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b497c73-a040-45cf-94ee-464fec5128bf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:47.563288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:47.580927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b497c73-a040-45cf-94ee-464fec5128bf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:47.585564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b497c73-a040-45cf-94ee-464fec5128bf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:47.587936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b497c73-a040-45cf-94ee-464fec5128bf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:47.588832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b497c73-a040-45cf-94ee-464fec5128bf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:47.593031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b497c73-a040-45cf-94ee-464fec5128bf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:47.593641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b497c73-a040-45cf-94ee-464fec5128bf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:47.720301 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b497c73-a040-45cf-94ee-464fec5128bf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208530 Nov 02 13:39:47.720918 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2445/5272] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:47 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:48.228116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:48.228715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:48.247194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:48.247769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:48.248231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:48.248990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:48.249459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:48.249892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:48.467283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lazy-loading 'services' on Instance uuid 16c00a03-1b4e-490c-814c-84c520dbab62 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:48.707020 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b68b46c1-bf92-4e50-b026-bf9c561875a0 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "DELETE /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments/ef0a06cf-44be-4ea1-9720-0a9c6bccbc81" status: 202 len: 0 microversion: 2.1 time: 0.481830 Nov 02 13:39:48.709853 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2446/5273] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:39:48 2022] DELETE /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments/ef0a06cf-44be-4ea1-9720-0a9c6bccbc81 => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:39:48.728464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8fcd2de1-8b88-430e-a619-fb2e9893adc1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:48.745224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8fcd2de1-8b88-430e-a619-fb2e9893adc1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:48.778576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcd2de1-8b88-430e-a619-fb2e9893adc1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:48.799024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcd2de1-8b88-430e-a619-fb2e9893adc1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:48.801086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcd2de1-8b88-430e-a619-fb2e9893adc1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:48.804825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcd2de1-8b88-430e-a619-fb2e9893adc1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:48.811957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcd2de1-8b88-430e-a619-fb2e9893adc1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:48.818493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcd2de1-8b88-430e-a619-fb2e9893adc1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:48.911367 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8fcd2de1-8b88-430e-a619-fb2e9893adc1 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195183 Nov 02 13:39:48.913345 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2447/5274] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:48 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:48.923634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65d0e9dc-0263-44b8-981c-4441c4397f77 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:48.930324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-65d0e9dc-0263-44b8-981c-4441c4397f77 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:48.949768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65d0e9dc-0263-44b8-981c-4441c4397f77 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:48.958661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65d0e9dc-0263-44b8-981c-4441c4397f77 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:48.960323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65d0e9dc-0263-44b8-981c-4441c4397f77 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:48.965846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65d0e9dc-0263-44b8-981c-4441c4397f77 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:48.979932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65d0e9dc-0263-44b8-981c-4441c4397f77 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:48.981222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65d0e9dc-0263-44b8-981c-4441c4397f77 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:49.040937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:49.078399 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-65d0e9dc-0263-44b8-981c-4441c4397f77 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157411 Nov 02 13:39:49.079567 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2448/5275] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:48 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:49.796622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:39:49.797361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:39:49.797722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:39:49.798228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:39:49.798742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:39:49.811078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:49.811744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:49.812331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:49.813171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:49.813717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:49.814323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:49.840837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Getting quotas for project b70197f1a93b478398b14900c12e8863. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:39:49.848942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Getting quotas for user dddb08b841ae477484ff07f8e0aaea44 and project b70197f1a93b478398b14900c12e8863. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:39:49.936517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-85a46692-99b4-4294-a119-7ccc9cb25491 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:49.949824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-85a46692-99b4-4294-a119-7ccc9cb25491 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:49.969510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85a46692-99b4-4294-a119-7ccc9cb25491 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:49.970352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85a46692-99b4-4294-a119-7ccc9cb25491 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:49.971182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85a46692-99b4-4294-a119-7ccc9cb25491 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:49.972492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85a46692-99b4-4294-a119-7ccc9cb25491 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:49.973307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85a46692-99b4-4294-a119-7ccc9cb25491 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:49.985655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85a46692-99b4-4294-a119-7ccc9cb25491 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:50.040070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:39:50.043617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f988f648-c0ec-4c3f-8502-29f54c776bef',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d9ec28c4-5bc9-465b-9c32-5b2ac4468f82',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71878eca-76a3-41c0-9ebc-df5802c2ba47',volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:39:50.110454 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-85a46692-99b4-4294-a119-7ccc9cb25491 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183469 Nov 02 13:39:50.112068 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2449/5276] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:49 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:50.124031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0499920f-7548-4d07-9c7b-1db79ca5d27e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:50.130268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0499920f-7548-4d07-9c7b-1db79ca5d27e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:50.141586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0499920f-7548-4d07-9c7b-1db79ca5d27e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:50.142697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0499920f-7548-4d07-9c7b-1db79ca5d27e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:50.143787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0499920f-7548-4d07-9c7b-1db79ca5d27e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:50.145289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0499920f-7548-4d07-9c7b-1db79ca5d27e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:50.146357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0499920f-7548-4d07-9c7b-1db79ca5d27e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:50.147424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0499920f-7548-4d07-9c7b-1db79ca5d27e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:50.225097 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0499920f-7548-4d07-9c7b-1db79ca5d27e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109907 Nov 02 13:39:50.226896 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2450/5277] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:50 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:39:50.324520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:50.325026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:50.333003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:50.333807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:50.334469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:50.335725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:50.336376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:50.337621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:50.420826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:39:50.617358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-30f4dd8d-775c-42ea-bd1b-1bcce4715845 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 204 len: 0 microversion: 2.1 time: 0.302784 Nov 02 13:39:50.635266 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2451/5278] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:39:50 2022] DELETE /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:39:50.654287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:50.655424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:50.675895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:50.676655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:50.677410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:50.692052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:50.692888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:50.694207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:50.841160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-552f897a-0f41-4e5f-aab3-203efd78e34c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.42 time: 8.140402 Nov 02 13:39:50.848451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2828/5279] 10.222.0.113 () {62 vars in 1194 bytes} [Wed Nov 2 13:39:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 8144 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:39:50.873099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f4e9abbe-22e0-4273-bb0d-0a6f1fb3a35d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:50.880748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f4e9abbe-22e0-4273-bb0d-0a6f1fb3a35d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:50.985532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4e9abbe-22e0-4273-bb0d-0a6f1fb3a35d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:50.996845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4e9abbe-22e0-4273-bb0d-0a6f1fb3a35d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:50.998900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4e9abbe-22e0-4273-bb0d-0a6f1fb3a35d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:51.000306 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f4e9abbe-22e0-4273-bb0d-0a6f1fb3a35d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1290 microversion: 2.42 time: 0.147330 Nov 02 13:39:51.001469 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2829/5280] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:39:50 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1290 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:39:51.130105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e56651c3-5a29-40c6-a3c8-a93cb7d631ba tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:51.133188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e56651c3-5a29-40c6-a3c8-a93cb7d631ba tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:51.148761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e56651c3-5a29-40c6-a3c8-a93cb7d631ba tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:51.149243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e56651c3-5a29-40c6-a3c8-a93cb7d631ba tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:51.149695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e56651c3-5a29-40c6-a3c8-a93cb7d631ba tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:51.154632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e56651c3-5a29-40c6-a3c8-a93cb7d631ba tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:51.155207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e56651c3-5a29-40c6-a3c8-a93cb7d631ba tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:51.155671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e56651c3-5a29-40c6-a3c8-a93cb7d631ba tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:51.229784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:51.232248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:51.236431 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e56651c3-5a29-40c6-a3c8-a93cb7d631ba tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113223 Nov 02 13:39:51.238656 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2830/5281] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:51 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:39:51.249880 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16fe4635-8c1e-4e94-a02c-83f3f633e40b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1686 microversion: 2.1 time: 0.610042 Nov 02 13:39:51.250663 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2452/5282] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:50 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1686 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:52.031903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f4de368a-0145-4787-97c2-a50b76e5f3a9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:52.032531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f4de368a-0145-4787-97c2-a50b76e5f3a9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:52.126870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4de368a-0145-4787-97c2-a50b76e5f3a9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:52.144573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4de368a-0145-4787-97c2-a50b76e5f3a9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:52.145830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4de368a-0145-4787-97c2-a50b76e5f3a9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:52.147271 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f4de368a-0145-4787-97c2-a50b76e5f3a9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1290 microversion: 2.42 time: 0.121325 Nov 02 13:39:52.148384 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2831/5283] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:39:52 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:39:52.252399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-02c6b191-4710-4c25-9255-c4333aec2eb4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:52.262066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-02c6b191-4710-4c25-9255-c4333aec2eb4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:52.275478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:52.276684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:52.287690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02c6b191-4710-4c25-9255-c4333aec2eb4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:52.294271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:52.295501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02c6b191-4710-4c25-9255-c4333aec2eb4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:52.296822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:52.297178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02c6b191-4710-4c25-9255-c4333aec2eb4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:52.298188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02c6b191-4710-4c25-9255-c4333aec2eb4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:52.298880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:52.299616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02c6b191-4710-4c25-9255-c4333aec2eb4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:52.300661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:52.301359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02c6b191-4710-4c25-9255-c4333aec2eb4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:52.302110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:52.305787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:52.381302 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-02c6b191-4710-4c25-9255-c4333aec2eb4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134900 Nov 02 13:39:52.382427 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2453/5284] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:52 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:52.663473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:52.679373 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-befd8f89-a844-4069-a092-3a2e8c07e681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1686 microversion: 2.1 time: 0.407235 Nov 02 13:39:52.682334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2832/5285] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:52 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1686 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:39:53.179788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:53.180410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:53.192138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.193018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.193463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:53.196288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.196764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.198749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:53.396244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75b8c321-7c1d-45b8-9033-01acad502313 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:53.399466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75b8c321-7c1d-45b8-9033-01acad502313 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:53.417628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b8c321-7c1d-45b8-9033-01acad502313 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.418505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b8c321-7c1d-45b8-9033-01acad502313 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.419148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b8c321-7c1d-45b8-9033-01acad502313 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:53.422432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b8c321-7c1d-45b8-9033-01acad502313 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.423095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b8c321-7c1d-45b8-9033-01acad502313 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.424653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b8c321-7c1d-45b8-9033-01acad502313 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:53.509857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75b8c321-7c1d-45b8-9033-01acad502313 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116136 Nov 02 13:39:53.511693 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2833/5286] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:53 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:39:53.649191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:53.669694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:53.671342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:53.689608 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-02f4711e-5622-46e1-9d26-bca9e960e3e9 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1580 microversion: 2.42 time: 0.497772 Nov 02 13:39:53.695444 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2454/5287] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:39:53 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1580 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:39:53.714218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:53.714833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:53.726085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.726981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.727681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:53.730940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:53.731635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:53.732246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:54.197863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:54.211374 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-048e459d-5584-45aa-8020-bdd6c5ebcb2e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1686 microversion: 2.1 time: 0.497519 Nov 02 13:39:54.212438 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2834/5288] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:53 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1686 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:54.529958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-95ce0665-2db8-4a0b-a362-2f9de0dacc40 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:54.541827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-95ce0665-2db8-4a0b-a362-2f9de0dacc40 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:54.561471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95ce0665-2db8-4a0b-a362-2f9de0dacc40 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:54.562340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95ce0665-2db8-4a0b-a362-2f9de0dacc40 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:54.563552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95ce0665-2db8-4a0b-a362-2f9de0dacc40 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:54.567968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95ce0665-2db8-4a0b-a362-2f9de0dacc40 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:54.568782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95ce0665-2db8-4a0b-a362-2f9de0dacc40 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:54.569486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95ce0665-2db8-4a0b-a362-2f9de0dacc40 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:54.698266 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-95ce0665-2db8-4a0b-a362-2f9de0dacc40 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179361 Nov 02 13:39:54.701532 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2455/5289] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:54 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:54.722946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:54.724251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:54.748625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:54.752114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:54.753568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:54.754597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:54.757016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:54.757681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:54.922833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:54.944231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:54.961944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:54.965874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d526cd3e-eb30-4d89-9d17-898f86b54abf tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1598 microversion: 2.42 time: 0.247718 Nov 02 13:39:54.967834 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2835/5290] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:39:54 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1598 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:39:55.243592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:55.244487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:55.260668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:55.264844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:55.266686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:55.276757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:55.279741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:55.281646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:55.713823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20761c47-30c3-475c-a2e6-0d8894d807e5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:55.716407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20761c47-30c3-475c-a2e6-0d8894d807e5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:55.728025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:39:55.745848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20761c47-30c3-475c-a2e6-0d8894d807e5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:55.746643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20761c47-30c3-475c-a2e6-0d8894d807e5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:55.747147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20761c47-30c3-475c-a2e6-0d8894d807e5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:55.747925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20761c47-30c3-475c-a2e6-0d8894d807e5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:55.748391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20761c47-30c3-475c-a2e6-0d8894d807e5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:55.748827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20761c47-30c3-475c-a2e6-0d8894d807e5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:55.764880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:55.781535 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff6bcdf1-d006-488f-b484-fb43386439f4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1618 microversion: 2.1 time: 0.543688 Nov 02 13:39:55.782149 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2456/5291] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:55 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1618 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:55.853034 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20761c47-30c3-475c-a2e6-0d8894d807e5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143467 Nov 02 13:39:55.854241 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2836/5292] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:55 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:55.886764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b49c3c84-311a-4ff8-bd5f-c32b6e1d7758 req-42fa0638-97fa-4750-978b-e855a1b81a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97fc922-3426-43e9-916a-32c813e2751f", "name": "network-vif-deleted", "tag": "72dfa9f8-135f-463d-86a6-20514260ceef"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:55.912020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b49c3c84-311a-4ff8-bd5f-c32b6e1d7758 req-42fa0638-97fa-4750-978b-e855a1b81a0c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:55.920502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b49c3c84-311a-4ff8-bd5f-c32b6e1d7758 req-42fa0638-97fa-4750-978b-e855a1b81a0c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:55.921426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b49c3c84-311a-4ff8-bd5f-c32b6e1d7758 req-42fa0638-97fa-4750-978b-e855a1b81a0c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:55.948909 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b49c3c84-311a-4ff8-bd5f-c32b6e1d7758 req-42fa0638-97fa-4750-978b-e855a1b81a0c service nova] Creating event network-vif-deleted:72dfa9f8-135f-463d-86a6-20514260ceef for instance f97fc922-3426-43e9-916a-32c813e2751f on n-h1-858384-19 Nov 02 13:39:55.961992 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b49c3c84-311a-4ff8-bd5f-c32b6e1d7758 req-42fa0638-97fa-4750-978b-e855a1b81a0c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079518 Nov 02 13:39:55.963282 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2457/5293] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:56.004927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:56.006539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:56.030820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.032855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.037265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.040902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.042400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.043424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.559486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:56.570944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:56.580551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:56.585887 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-339296db-ebcf-4eba-b026-ccdde85a574d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1598 microversion: 2.42 time: 0.582948 Nov 02 13:39:56.588624 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2837/5294] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:39:55 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1598 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:39:56.814177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:56.816037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:56.829771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.842208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.843059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.844102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.848462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.849190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.867502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01a8335a-a5e0-4181-8a66-906a05b088c9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:56.871676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01a8335a-a5e0-4181-8a66-906a05b088c9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:56.896836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a8335a-a5e0-4181-8a66-906a05b088c9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.897607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a8335a-a5e0-4181-8a66-906a05b088c9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.898249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a8335a-a5e0-4181-8a66-906a05b088c9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.900505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a8335a-a5e0-4181-8a66-906a05b088c9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.901187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a8335a-a5e0-4181-8a66-906a05b088c9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.901823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01a8335a-a5e0-4181-8a66-906a05b088c9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.962047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:56.962542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:56.962984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:56.963485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lazy-loading 'fault' on Instance uuid f97fc922-3426-43e9-916a-32c813e2751f {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:39:56.988865 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01a8335a-a5e0-4181-8a66-906a05b088c9 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126789 Nov 02 13:39:56.990063 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2838/5295] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:56 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:39:57.108751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:57.120784 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-73474b84-5dd0-498e-8e1d-807d2a508c1f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 200 len: 1335 microversion: 2.1 time: 0.310912 Nov 02 13:39:57.121965 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2458/5296] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:56 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 1335 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:39:57.620639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:57.621674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:57.635230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:57.636287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:57.636947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:57.637866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:57.640184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:57.641228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.002061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-677f67eb-a55c-43d7-bfad-9d488f2a6acd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:58.009568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-677f67eb-a55c-43d7-bfad-9d488f2a6acd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:58.019526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-677f67eb-a55c-43d7-bfad-9d488f2a6acd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.020288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-677f67eb-a55c-43d7-bfad-9d488f2a6acd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.021501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-677f67eb-a55c-43d7-bfad-9d488f2a6acd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.022888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-677f67eb-a55c-43d7-bfad-9d488f2a6acd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.023564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-677f67eb-a55c-43d7-bfad-9d488f2a6acd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.024170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-677f67eb-a55c-43d7-bfad-9d488f2a6acd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.067290 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-677f67eb-a55c-43d7-bfad-9d488f2a6acd tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069311 Nov 02 13:39:58.068450 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2459/5297] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:39:57 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:39:58.151671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:58.152592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:58.161809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.169349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.170089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.173701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.174485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.176240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.184333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:58.195312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:58.196854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:58.241124 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ead03d1-6a61-472a-a167-cf4e0ac2da10 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1666 microversion: 2.42 time: 0.582268 Nov 02 13:39:58.250802 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2839/5298] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:39:57 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1666 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:39:58.273611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:58.276054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:58.283353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.284152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.284935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.285867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.286501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.287136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.343626 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] HTTP exception thrown: Cannot 'reboot' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Request method failure captured: Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12/action HTTP/1.1 Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 28 Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHi7jP3BREzNNxMlaHpTkHTAhpl4YuS15cqc7AF8LZUEXF-7lvm87GGJSejO1Ngp59zhuvznS7N8Hp-FmGbmJ1gJUTodwrnMGNso2bPIBMjI2J9vGT9OMBHmDkPSV1QxO58NX1-FPgIu3P9_ttyV5w2TDOTyKt4vpmdeDQUnv6oULM Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9758bd03bdc949d495c293221823196c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9758bd03bdc949d495c293221823196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 9485351c342740638c6a30b05cd0b162 Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: {"reboot": {"type": "HARD"}} Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot 'reboot' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '66ed7862-b20d-457d-84d7-7259ba577d12', 'body': {'reboot': {'type': 'HARD'}}} Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 66ed7862-b20d-457d-84d7-7259ba577d12 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:39:58.355093 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued Nov 02 13:39:58.361729 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.365931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Returning 409 to user: Cannot 'reboot' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:58.367457 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb42f090-cdcf-4c76-ad92-ddca867ba77b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12/action" status: 409 len: 145 microversion: 2.1 time: 0.114845 Nov 02 13:39:58.372477 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2840/5299] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:39:58 2022] POST /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12/action => generated 145 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:39:58.428499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:39:58.439468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:58.457565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.459368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.460165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.461184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.462047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.462819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.520402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] HTTP exception thrown: Cannot 'rebuild' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Request method failure captured: Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12/action HTTP/1.1 Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 65 Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHi7jP3BREzNNxMlaHpTkHTAhpl4YuS15cqc7AF8LZUEXF-7lvm87GGJSejO1Ngp59zhuvznS7N8Hp-FmGbmJ1gJUTodwrnMGNso2bPIBMjI2J9vGT9OMBHmDkPSV1QxO58NX1-FPgIu3P9_ttyV5w2TDOTyKt4vpmdeDQUnv6oULM Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9758bd03bdc949d495c293221823196c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9758bd03bdc949d495c293221823196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 9485351c342740638c6a30b05cd0b162 Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot 'rebuild' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '66ed7862-b20d-457d-84d7-7259ba577d12', 'body': {'rebuild': {'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1'}}} Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 66ed7862-b20d-457d-84d7-7259ba577d12 in vm_state rescued. Cannot rebuild while the instance is in this state. Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:39:58.537132 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued Nov 02 13:39:58.543374 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:39:58.549275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Returning 409 to user: Cannot 'rebuild' instance 66ed7862-b20d-457d-84d7-7259ba577d12 while it is in vm_state rescued {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:58.551964 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75b7a82c-3522-4728-b72a-7ad0004ad4a2 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "POST /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12/action" status: 409 len: 146 microversion: 2.1 time: 0.159342 Nov 02 13:39:58.556760 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2841/5300] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:39:58 2022] POST /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12/action => generated 146 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:39:58.582660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:58.592440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:58.619880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.621248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.622475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.626809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:58.628498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:58.631729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:58.705522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:39:58.938370 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9448e143-6ac9-43d9-ad76-753ece3c7a2b tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "DELETE /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 204 len: 0 microversion: 2.1 time: 0.365685 Nov 02 13:39:58.947000 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2842/5301] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:39:58 2022] DELETE /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:39:58.977531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:59.002289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:59.017251 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f HTTP/1.1 Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f97fc922-3426-43e9-916a-32c813e2751f'} Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:39:59.019850 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:59.027790 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:39:59.027790 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:39:59.027790 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:39:59.027790 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:39:59.027790 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:39:59.027790 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:39:59.027790 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:39:59.033041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:39:59.037640 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8ab80408-8d11-42ec-86b8-aa777a4bd27a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 404 len: 111 microversion: 2.1 time: 0.890421 Nov 02 13:39:59.038794 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2460/5302] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:58 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 111 bytes in 894 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:39:59.044871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.045337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.045789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:59.046778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.056150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.056995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:59.057524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b1b3f29-ed48-4b06-b33c-fd9a94f15273 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '.version_select at 0x7fe786658700>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:59.121550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3b1b3f29-ed48-4b06-b33c-fd9a94f15273 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658238931" status: 202 len: 0 microversion: 2.1 time: 0.076740 Nov 02 13:39:59.126563 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2461/5303] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:39:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658238931 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:39:59.288958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:39:59.292785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:39:59.325391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.327750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.333832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:59.335474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:39:59.339009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:39:59.340520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:39:59.811400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:39:59.820452 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-305f21a0-4a8d-41dd-913c-74f66c07f756 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1694 microversion: 2.1 time: 0.865910 Nov 02 13:39:59.826957 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2843/5304] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:39:58 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1694 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:00.147226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:00.164880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:00.166498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:00.167747 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5ff6400d-69c5-456b-80b1-d98b5ba47106 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1760 microversion: 2.42 time: 0.890747 Nov 02 13:40:00.168309 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2462/5305] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:39:59 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1760 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:40:00.861294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:00.863394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:00.879834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:00.885586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:00.886442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:00.886575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:00.888190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:00.888666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:00.889941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:01.198286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:01.198912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:01.211375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:01.211896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:01.212384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:01.216046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:01.216535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:01.216988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:01.254433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:01.282536 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-56cd36cd-2def-4015-a4f9-b39ee0ad2613 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1694 microversion: 2.1 time: 0.416656 Nov 02 13:40:01.282536 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2844/5306] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:00 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1694 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:01.901097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:01.928131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:01.930241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:01.936393 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bab736b0-473c-456f-bd54-1e755951da56 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1760 microversion: 2.42 time: 0.742471 Nov 02 13:40:01.941873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2463/5307] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:01 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1760 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:02.133810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5925bd03-a364-4784-a0c1-17e44fa1d8a1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: .version_select at 0x7fe786e455e0>, body: {"keypair": {"name": "tempest-keypair-2110679414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwMs6GijPK2iqwWaoJUzap6wuTozHaxI6r1Fwx5Ctoegl13kNZfIXcD5pDbUQwfBmYE7DJslI50sxnRxEYtI5tVO/YedwP5Iu/DdJSGX0KPOeNEgw7iMr8foY0zP1G3vg=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:02.167660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:02.222692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5925bd03-a364-4784-a0c1-17e44fa1d8a1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:40:02.257170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5925bd03-a364-4784-a0c1-17e44fa1d8a1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for user 284102156ef9461e93e4af60f9496aa2 and project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:40:02.294645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:02.295604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:02.317390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:02.317894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:02.318352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:02.319082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:02.319583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:02.320020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:02.367532 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5925bd03-a364-4784-a0c1-17e44fa1d8a1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.237782 Nov 02 13:40:02.375691 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2845/5308] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:40:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:02.949606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:02.958620 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f0790731-0afa-4318-8c1a-bd8815758734 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1694 microversion: 2.1 time: 0.667829 Nov 02 13:40:02.964117 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2464/5309] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:02 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1694 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:02.971035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:02.972349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:02.981155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:02.985968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:02.986498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:02.987594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:02.988566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:02.990082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:03.446449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:03.461597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:03.465423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:03.472943 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-04f94173-058e-49d8-8554-792fdf0ae42f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1807 microversion: 2.42 time: 0.503452 Nov 02 13:40:03.476921 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2846/5310] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:02 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1807 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:03.991734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:03.992201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:04.015670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:04.020040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:04.020519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:04.021301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:04.021777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:04.022945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:04.077026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:04.507439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:04.510290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:04.571280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:04.573782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:04.574874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:04.578472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:04.579269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:04.586528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:05.324908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:05.333220 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-15173bd4-26f3-44a2-be12-2b0e6c0d603c tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1694 microversion: 2.1 time: 1.347801 Nov 02 13:40:05.339891 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2465/5311] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:03 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1694 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:05.378852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-97622d23-2b70-4e14-a4aa-bb84ea1304a0 req-ab62b61f-07c5-41e4-95e5-e3b550a29ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c00a03-1b4e-490c-814c-84c520dbab62", "name": "network-vif-unplugged", "status": "completed", "tag": "80ac27ba-28f7-4264-a76a-90fa9b06560a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:05.409648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-97622d23-2b70-4e14-a4aa-bb84ea1304a0 req-ab62b61f-07c5-41e4-95e5-e3b550a29ed3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:05.419554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-97622d23-2b70-4e14-a4aa-bb84ea1304a0 req-ab62b61f-07c5-41e4-95e5-e3b550a29ed3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:05.420269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-97622d23-2b70-4e14-a4aa-bb84ea1304a0 req-ab62b61f-07c5-41e4-95e5-e3b550a29ed3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:05.468898 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-97622d23-2b70-4e14-a4aa-bb84ea1304a0 req-ab62b61f-07c5-41e4-95e5-e3b550a29ed3 service nova] Creating event network-vif-unplugged:80ac27ba-28f7-4264-a76a-90fa9b06560a for instance 16c00a03-1b4e-490c-814c-84c520dbab62 on n-h1-858384-19 Nov 02 13:40:05.483708 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-97622d23-2b70-4e14-a4aa-bb84ea1304a0 req-ab62b61f-07c5-41e4-95e5-e3b550a29ed3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108352 Nov 02 13:40:05.484604 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2466/5312] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:40:05.541598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:05.566485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:05.573203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:05.574777 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-167a958a-9e9e-4d6a-9c0c-41f1d9b280f3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1807 microversion: 2.42 time: 1.074800 Nov 02 13:40:05.576062 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2847/5313] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:04 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1807 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:05.929554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1845398038", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07df1b69-fb68-402d-a0e1-7135ff448b95"}], "security_groups": [{"name": "tempest-securitygroup--1068108296"}], "key_name": "tempest-keypair-2110679414", "user_data": "}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:06.359920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:06.364842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:06.376368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:06.380950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:06.383471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:06.384499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:06.387464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:06.389851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:06.398421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] validate_networks() for [('07df1b69-fb68-402d-a0e1-7135ff448b95', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:40:06.432111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:06.614007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:06.633467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-66120eaf-8867-4085-8d48-c7b36e5e3ca5 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1627 microversion: 2.1 time: 0.277155 Nov 02 13:40:06.635322 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2848/5314] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:06 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1627 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:06.649041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:06.652053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:06.676370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:06.677256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:06.677944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:06.678925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:06.679714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:06.680402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:06.967101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:06.988668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:06.990369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:06.992857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2cd62551-88b5-43e0-90bd-10c8f25bfdf6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1807 microversion: 2.42 time: 0.356062 Nov 02 13:40:06.995568 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2849/5315] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:06 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1807 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:07.670577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:07.671306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:07.688101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:07.688597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:07.689039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:07.696717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:07.697765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:07.698558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:07.792036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:07.808852 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3c5559c2-4224-4b54-8916-4c02e680a196 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 200 len: 1627 microversion: 2.1 time: 0.150179 Nov 02 13:40:07.812012 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2850/5316] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:07 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 1627 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:08.023014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d4084a48-826e-45df-b165-4688252e5dbc req-48bfcd21-19c9-4bbd-9ca0-0772c884876f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c00a03-1b4e-490c-814c-84c520dbab62", "name": "network-vif-deleted", "tag": "80ac27ba-28f7-4264-a76a-90fa9b06560a"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:08.087015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d4084a48-826e-45df-b165-4688252e5dbc req-48bfcd21-19c9-4bbd-9ca0-0772c884876f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:08.087575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d4084a48-826e-45df-b165-4688252e5dbc req-48bfcd21-19c9-4bbd-9ca0-0772c884876f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:08.088023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d4084a48-826e-45df-b165-4688252e5dbc req-48bfcd21-19c9-4bbd-9ca0-0772c884876f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:08.143768 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d4084a48-826e-45df-b165-4688252e5dbc req-48bfcd21-19c9-4bbd-9ca0-0772c884876f service nova] Creating event network-vif-deleted:80ac27ba-28f7-4264-a76a-90fa9b06560a for instance 16c00a03-1b4e-490c-814c-84c520dbab62 on n-h1-858384-19 Nov 02 13:40:08.169882 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d4084a48-826e-45df-b165-4688252e5dbc req-48bfcd21-19c9-4bbd-9ca0-0772c884876f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153931 Nov 02 13:40:08.170553 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2851/5317] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:08.199012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:08.202674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:08.241136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:08.242430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:08.245819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:08.251522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:08.267398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:08.268093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:08.422389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:40:08.423510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:40:08.424982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:40:08.425734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:40:08.437279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:40:08.461168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:08.462637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:08.463080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:08.464027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:08.469071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:08.469632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:08.525992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:40:08.542863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for user 284102156ef9461e93e4af60f9496aa2 and project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:40:08.605487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:40:08.612467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:40:08.770826 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-494cb1fe-a7dc-406b-abca-05a559e25f3a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.846148 Nov 02 13:40:08.775378 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2467/5318] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:40:05 2022] POST /compute/v2.1/servers => generated 404 bytes in 2856 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:40:08.790868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ceac48bf-1487-4ad2-b022-980b1c990916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:08.791745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ceac48bf-1487-4ad2-b022-980b1c990916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:09.069009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ceac48bf-1487-4ad2-b022-980b1c990916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:09.088129 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ceac48bf-1487-4ad2-b022-980b1c990916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1246 microversion: 2.1 time: 0.305379 Nov 02 13:40:09.088736 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2468/5319] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:08 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1246 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:09.105712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:09.115104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:09.115896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 16c00a03-1b4e-490c-814c-84c520dbab62] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:09.142348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:09.142942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:09.145928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:09.147487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:09.148676 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b044bb0-725f-4fb5-b215-06500e8c7b81 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1854 microversion: 2.42 time: 0.969783 Nov 02 13:40:09.151145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:09.151937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:09.152429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:09.152880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:09.165664 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2852/5320] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:08 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1854 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:09.200463 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] HTTP exception thrown: Instance 16c00a03-1b4e-490c-814c-84c520dbab62 could not be found. Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Request method failure captured: Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 HTTP/1.1 Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnHi7jP3BREzNNxMlaHpTkHTAhpl4YuS15cqc7AF8LZUEXF-7lvm87GGJSejO1Ngp59zhuvznS7N8Hp-FmGbmJ1gJUTodwrnMGNso2bPIBMjI2J9vGT9OMBHmDkPSV1QxO58NX1-FPgIu3P9_ttyV5w2TDOTyKt4vpmdeDQUnv6oULM Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9758bd03bdc949d495c293221823196c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9758bd03bdc949d495c293221823196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 9485351c342740638c6a30b05cd0b162 Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 16c00a03-1b4e-490c-814c-84c520dbab62 could not be found. Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '16c00a03-1b4e-490c-814c-84c520dbab62'} Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c00a03-1b4e-490c-814c-84c520dbab62 could not be found. Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c00a03-1b4e-490c-814c-84c520dbab62 could not be found. Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:09.202172 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c00a03-1b4e-490c-814c-84c520dbab62 could not be found. Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Returning 404 to user: Instance 16c00a03-1b4e-490c-814c-84c520dbab62 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:40:09.207102 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d0c5aca-1a8b-4cbd-92e2-29bec8939e63 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62" status: 404 len: 111 microversion: 2.1 time: 0.113762 Nov 02 13:40:09.213098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96c21451-e612-4247-bb35-4d3f1a4a02ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '.version_select at 0x7fe786c6f8b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:09.231773 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2469/5321] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:09 2022] GET /compute/v2.1/servers/16c00a03-1b4e-490c-814c-84c520dbab62 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:40:09.260638 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-96c21451-e612-4247-bb35-4d3f1a4a02ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666140159" status: 202 len: 0 microversion: 2.1 time: 0.051243 Nov 02 13:40:09.264960 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2853/5322] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666140159 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:40:10.116081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:10.116721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:10.126389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:10.138126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:10.139710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:10.143517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:10.150503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:10.159612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:10.195596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:10.198338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:10.225246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:10.225834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:10.226382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:10.227481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:10.228194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:10.228747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:10.359474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:10.369612 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c11de653-4d6f-426a-8039-389a8cb3ccf7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1298 microversion: 2.1 time: 0.259370 Nov 02 13:40:10.370204 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2470/5323] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:10 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1298 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:10.805363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:10.833310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:10.840982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:10.854000 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4cb60687-4894-4b4d-8cd0-fadf4b04c568 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1854 microversion: 2.42 time: 0.662966 Nov 02 13:40:10.866977 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2854/5324] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:10 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1854 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:11.395759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:11.397021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:11.404078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:11.404871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:11.405487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:11.411874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:11.412664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:11.413291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:11.532879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:11.547881 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1ad2fe5c-1455-4e76-b2a7-7f2c0befe231 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1304 microversion: 2.1 time: 0.156920 Nov 02 13:40:11.553763 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2471/5325] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:11 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:11.900106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:11.901320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:11.912105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:11.919947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:11.920882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:11.928186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:11.928927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:11.929580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:12.150936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e9e0f602-d93d-426f-8787-3b26cd8cbe3f req-d062f08e-fef9-4176-bb4a-918a0e8a9e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "tag": "6e67bb33-ef7e-44f8-b657-358f6fcace76"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:12.160151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:12.179362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e9e0f602-d93d-426f-8787-3b26cd8cbe3f req-d062f08e-fef9-4176-bb4a-918a0e8a9e4e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:12.180354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e9e0f602-d93d-426f-8787-3b26cd8cbe3f req-d062f08e-fef9-4176-bb4a-918a0e8a9e4e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:12.180961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e9e0f602-d93d-426f-8787-3b26cd8cbe3f req-d062f08e-fef9-4176-bb4a-918a0e8a9e4e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:12.214180 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e9e0f602-d93d-426f-8787-3b26cd8cbe3f req-d062f08e-fef9-4176-bb4a-918a0e8a9e4e service nova] Creating event network-changed:6e67bb33-ef7e-44f8-b657-358f6fcace76 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:40:12.223585 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e9e0f602-d93d-426f-8787-3b26cd8cbe3f req-d062f08e-fef9-4176-bb4a-918a0e8a9e4e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076266 Nov 02 13:40:12.224975 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2472/5326] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:12.295668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:12.540923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:12.559999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:12.571252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:12.578223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:12.579758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:12.583760 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-86c34988-449f-4d6e-8ae8-1fa85ae575c0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1854 microversion: 2.42 time: 0.687408 Nov 02 13:40:12.588235 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2855/5327] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:11 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1854 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:12.599073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:12.603833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:12.604518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:12.605454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:12.606138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:12.606574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:12.886001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:12.897287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6ce896cc-e557-42d4-a142-7954d68712c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1304 microversion: 2.1 time: 0.323166 Nov 02 13:40:12.899938 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2473/5328] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:12 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1304 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:13.614276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:13.614883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:13.622109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:13.622600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:13.626670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:13.627568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:13.630264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:13.630917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:13.928951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:13.930214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:13.945326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:13.957119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:13.957631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:13.958090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:13.963659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:13.964386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:13.972237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:13.974783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:13.976622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:13.978116 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5983fbab-14ee-4b13-9cab-3cecf93619d0 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1875 microversion: 2.42 time: 0.368289 Nov 02 13:40:13.979233 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2856/5329] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:13 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1875 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:14.576698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:14.587495 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e541235b-5e89-4ee2-a3e7-1bd4fe4eca68 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.663911 Nov 02 13:40:14.597000 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2474/5330] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:13 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:14.894769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9a39e1f3-d8f1-492a-9399-2718f3aba486 req-6c0eda16-d877-40c8-9cca-431ea18b65c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "tag": "393ebc4f-0e1c-4b0f-a87e-243e38c2925b"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:14.916248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9a39e1f3-d8f1-492a-9399-2718f3aba486 req-6c0eda16-d877-40c8-9cca-431ea18b65c5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:14.919227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9a39e1f3-d8f1-492a-9399-2718f3aba486 req-6c0eda16-d877-40c8-9cca-431ea18b65c5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:14.919686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9a39e1f3-d8f1-492a-9399-2718f3aba486 req-6c0eda16-d877-40c8-9cca-431ea18b65c5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:14.948164 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9a39e1f3-d8f1-492a-9399-2718f3aba486 req-6c0eda16-d877-40c8-9cca-431ea18b65c5 service nova] Creating event network-changed:393ebc4f-0e1c-4b0f-a87e-243e38c2925b for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:40:14.959683 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9a39e1f3-d8f1-492a-9399-2718f3aba486 req-6c0eda16-d877-40c8-9cca-431ea18b65c5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068920 Nov 02 13:40:14.962385 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2857/5331] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:15.006842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:15.008313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:15.021250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:15.022077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:15.023633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:15.028359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:15.029125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:15.029892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:15.625470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:15.626302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:15.640852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:15.641265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:15.641713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:15.646068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:15.646825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:15.647498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:15.738437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:15.758754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:15.760272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:15.761444 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0023ada9-a9c5-465d-9767-e770be79794f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1875 microversion: 2.42 time: 0.759475 Nov 02 13:40:15.781398 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2475/5332] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:15 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1875 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:16.148602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:16.157114 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c2cbf1f-2fdc-4a95-abfc-842887767690 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.536672 Nov 02 13:40:16.163885 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2858/5333] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:15 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:16.795385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:16.796241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:16.808946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:16.809445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:16.809888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:16.810602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:16.811053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:16.819569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.005489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-42a3c5db-2937-4344-a17d-419a0fcbfa8d req-a9859bba-3128-4201-a67b-d67f2f716c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187f7043-8fce-4714-b73c-12336bc51326", "tag": "59a616e6-7f0e-4997-8ea1-0fc767f76feb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:17.036095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-42a3c5db-2937-4344-a17d-419a0fcbfa8d req-a9859bba-3128-4201-a67b-d67f2f716c20 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.036611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-42a3c5db-2937-4344-a17d-419a0fcbfa8d req-a9859bba-3128-4201-a67b-d67f2f716c20 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.037065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-42a3c5db-2937-4344-a17d-419a0fcbfa8d req-a9859bba-3128-4201-a67b-d67f2f716c20 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.070242 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-42a3c5db-2937-4344-a17d-419a0fcbfa8d req-a9859bba-3128-4201-a67b-d67f2f716c20 service nova] Creating event network-changed:59a616e6-7f0e-4997-8ea1-0fc767f76feb for instance 187f7043-8fce-4714-b73c-12336bc51326 on n-h1-858384-19 Nov 02 13:40:17.085689 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-42a3c5db-2937-4344-a17d-419a0fcbfa8d req-a9859bba-3128-4201-a67b-d67f2f716c20 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097219 Nov 02 13:40:17.086334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2859/5334] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:40:17.187135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:17.187872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:17.205249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.206211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.213381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.215640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:17.216158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:17.216649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:17.794908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:17.805659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ac5611a8-4a2e-49f3-8fd4-325980ee9984 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.622761 Nov 02 13:40:17.809135 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2860/5335] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:17 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:17.973679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:17.983159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:17.996327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:17.997743 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af86f11f-e6ec-4ad4-91df-3c11aef7c4dc tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1896 microversion: 2.42 time: 1.207156 Nov 02 13:40:18.001702 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2476/5336] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:16 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1896 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:18.833457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:18.834646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:18.849718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:18.851395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:18.852701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:18.855761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:18.857133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:18.860150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:19.030156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:19.030773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:19.035860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:19.059960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:19.062912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:19.063796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:19.066623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:19.067334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:19.069564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:19.078461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:19.374680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:19.382883 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e2fa08da-2a72-4dd4-a239-a413feb5d060 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.553948 Nov 02 13:40:19.384561 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2861/5337] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:18 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:19.390888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b973b325-166d-4942-ac87-851783652e52 req-7f705211-7a8a-4ac6-a4a8-454d463cf681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "tag": "a1701be5-ce69-4eb1-b195-3b9262f740d0"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:19.414851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b973b325-166d-4942-ac87-851783652e52 req-7f705211-7a8a-4ac6-a4a8-454d463cf681 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:19.417099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b973b325-166d-4942-ac87-851783652e52 req-7f705211-7a8a-4ac6-a4a8-454d463cf681 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:19.418512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b973b325-166d-4942-ac87-851783652e52 req-7f705211-7a8a-4ac6-a4a8-454d463cf681 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:19.455575 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b973b325-166d-4942-ac87-851783652e52 req-7f705211-7a8a-4ac6-a4a8-454d463cf681 service nova] Creating event network-changed:a1701be5-ce69-4eb1-b195-3b9262f740d0 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:40:19.466103 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b973b325-166d-4942-ac87-851783652e52 req-7f705211-7a8a-4ac6-a4a8-454d463cf681 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079570 Nov 02 13:40:19.467015 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2862/5338] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:19.972077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:19.981916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:19.991775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:19.997878 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83e79557-0fad-4222-88b9-bbedadbbb32d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1896 microversion: 2.42 time: 0.971474 Nov 02 13:40:20.005044 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2477/5339] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:19 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1896 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:40:20.412854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:20.414403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:20.430164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:20.432648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:20.433868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:20.436564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:20.437205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:20.438984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:20.761443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:20.774052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b98320e6-21c9-4b04-9d13-60dd359dea33 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.367120 Nov 02 13:40:20.777713 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2863/5340] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:20 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:21.031320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:21.032542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:21.042305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:21.051946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:21.052663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:21.053780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:21.054630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:21.055304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:21.551016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:21.565534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:21.573119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:21.574549 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-394353cd-2f0f-4fbf-a8bf-3fb217b39f4c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1896 microversion: 2.42 time: 0.547161 Nov 02 13:40:21.585832 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2478/5341] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:21 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1896 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:21.660307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:21.661147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:21.674630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:21.675157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:21.675621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:21.676359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:21.676819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:21.677279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:21.744629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:40:21.800810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:21.801980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:21.813839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:21.815850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:21.817437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:21.819829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:21.820701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:21.823222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:21.942189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93389a60-e111-4c3a-b54c-9b17d128c6e3 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "DELETE /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 204 len: 0 microversion: 2.1 time: 0.288350 Nov 02 13:40:21.942937 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2864/5342] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:40:21 2022] DELETE /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:40:21.955642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1bef777b-28bc-4bf4-bfdd-bc2a1eed9a08 req-cd93338e-2dd8-41c7-b3ff-ee07a02e0f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "tag": "fdd3b4be-ad92-43da-ad44-b7b675e78b9d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:21.965868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1bef777b-28bc-4bf4-bfdd-bc2a1eed9a08 req-cd93338e-2dd8-41c7-b3ff-ee07a02e0f97 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:21.966682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1bef777b-28bc-4bf4-bfdd-bc2a1eed9a08 req-cd93338e-2dd8-41c7-b3ff-ee07a02e0f97 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:21.967935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1bef777b-28bc-4bf4-bfdd-bc2a1eed9a08 req-cd93338e-2dd8-41c7-b3ff-ee07a02e0f97 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:21.981365 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1bef777b-28bc-4bf4-bfdd-bc2a1eed9a08 req-cd93338e-2dd8-41c7-b3ff-ee07a02e0f97 service nova] Creating event network-changed:fdd3b4be-ad92-43da-ad44-b7b675e78b9d for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:40:21.987230 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1bef777b-28bc-4bf4-bfdd-bc2a1eed9a08 req-cd93338e-2dd8-41c7-b3ff-ee07a02e0f97 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039455 Nov 02 13:40:21.988707 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2865/5343] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:21.995768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:21.996707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:22.009696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:22.010199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:22.010649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:22.011395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:22.012196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:22.012807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:22.367229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:22.375752 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aba3528f-7e28-4236-8f38-06d34f8725ae tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1513 microversion: 2.1 time: 0.385658 Nov 02 13:40:22.382177 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2866/5344] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:21 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1513 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:22.442876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:22.458631 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4db1c247-1fc6-4ac9-8903-eefbdf137168 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.656706 Nov 02 13:40:22.458893 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2479/5345] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:21 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:22.603982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:22.604601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:22.618917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:22.619469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:22.620974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:22.621741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:22.622202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:22.622834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:23.021666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:23.024107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:23.040297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:23.044700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:23.052714 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-550b4145-5c74-4ad7-8888-1e6a71fa4d8d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1896 microversion: 2.42 time: 0.452603 Nov 02 13:40:23.053978 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2867/5346] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:22 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1896 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:23.410152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:23.411065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:23.426418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:23.427370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:23.428092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:23.429082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:23.435965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:23.436815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:23.482495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:23.483545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:23.507638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:23.521363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:23.523932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:23.524723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:23.525198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:23.525637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:24.195803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:24.203854 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22edb262-26e3-4701-ae3d-cb027b31635f tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1513 microversion: 2.1 time: 0.797808 Nov 02 13:40:24.204428 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2480/5347] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:23 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1513 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:24.211285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:24.211906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:24.233849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:24.234347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:24.234803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:24.235538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:24.236038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:24.236477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:24.246339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:24.261272 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aeb0f7c3-2c77-4a61-9386-7040a38aff06 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.783046 Nov 02 13:40:24.280382 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2868/5348] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:23 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:24.290365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-46ca1755-ea3b-4f67-af7e-3c697046454c req-16692230-2911-4e7f-9de7-7c8e6db3867a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "tag": "eff1b854-90e0-44a2-85d1-8014a6f1d2e6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:24.303810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-46ca1755-ea3b-4f67-af7e-3c697046454c req-16692230-2911-4e7f-9de7-7c8e6db3867a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:24.304571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-46ca1755-ea3b-4f67-af7e-3c697046454c req-16692230-2911-4e7f-9de7-7c8e6db3867a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:24.305243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-46ca1755-ea3b-4f67-af7e-3c697046454c req-16692230-2911-4e7f-9de7-7c8e6db3867a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:24.322955 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-46ca1755-ea3b-4f67-af7e-3c697046454c req-16692230-2911-4e7f-9de7-7c8e6db3867a service nova] Creating event network-changed:eff1b854-90e0-44a2-85d1-8014a6f1d2e6 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:40:24.329524 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-46ca1755-ea3b-4f67-af7e-3c697046454c req-16692230-2911-4e7f-9de7-7c8e6db3867a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046857 Nov 02 13:40:24.332611 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2869/5349] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:24.578655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-03c0995e-cf31-4bfd-bb7a-0fbdab3ebba9 req-83c43f77-2574-4dc4-9630-d5e86b1cac3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ed7862-b20d-457d-84d7-7259ba577d12", "name": "network-vif-deleted", "tag": "cc79c635-dc0b-4a6c-a9ef-7d9430045f8d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:24.641512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-03c0995e-cf31-4bfd-bb7a-0fbdab3ebba9 req-83c43f77-2574-4dc4-9630-d5e86b1cac3e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:24.643724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-03c0995e-cf31-4bfd-bb7a-0fbdab3ebba9 req-83c43f77-2574-4dc4-9630-d5e86b1cac3e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:24.645454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-03c0995e-cf31-4bfd-bb7a-0fbdab3ebba9 req-83c43f77-2574-4dc4-9630-d5e86b1cac3e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:24.727140 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-03c0995e-cf31-4bfd-bb7a-0fbdab3ebba9 req-83c43f77-2574-4dc4-9630-d5e86b1cac3e service nova] Creating event network-vif-deleted:cc79c635-dc0b-4a6c-a9ef-7d9430045f8d for instance 66ed7862-b20d-457d-84d7-7259ba577d12 on n-h2-858384-19 Nov 02 13:40:24.746616 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-03c0995e-cf31-4bfd-bb7a-0fbdab3ebba9 req-83c43f77-2574-4dc4-9630-d5e86b1cac3e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174537 Nov 02 13:40:24.747522 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2870/5350] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:40:24.953631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:24.971366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:24.975079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:24.976384 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fdf9e505-c28c-4469-9650-8d1d7999d3ac tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1896 microversion: 2.42 time: 0.770418 Nov 02 13:40:24.976980 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2481/5351] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:24 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1896 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:25.232528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:25.234002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:25.248220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:25.249378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:25.250361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:25.251561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:25.252258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:25.252898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:25.291529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:25.292153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:25.300657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:25.301082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:25.301606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:25.302252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:25.302681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:25.303229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:25.331737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:25.346701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:25.348249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:25.349517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lazy-loading 'fault' on Instance uuid 66ed7862-b20d-457d-84d7-7259ba577d12 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:40:25.658889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:25.672169 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f2195d7e-98fb-442c-ba0e-f580bb2a3409 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 200 len: 1316 microversion: 2.1 time: 0.444164 Nov 02 13:40:25.683246 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2871/5352] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:25 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:25.806911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:25.820705 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5c283103-4af9-493f-8e0b-d86a5e8961f7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.532851 Nov 02 13:40:25.822430 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2482/5353] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:25 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:26.007083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:26.008192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:26.011165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:26.026579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.027287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.028464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.029362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.031672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.032153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.155508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7309d83b-7b25-4eee-a07a-69eb3bfe7af3 req-a6a4e62b-4e75-4339-b736-c806a2502a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187f7043-8fce-4714-b73c-12336bc51326", "name": "network-vif-plugged", "status": "completed", "tag": "59a616e6-7f0e-4997-8ea1-0fc767f76feb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:26.166545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7309d83b-7b25-4eee-a07a-69eb3bfe7af3 req-a6a4e62b-4e75-4339-b736-c806a2502a39 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.167336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7309d83b-7b25-4eee-a07a-69eb3bfe7af3 req-a6a4e62b-4e75-4339-b736-c806a2502a39 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.168217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7309d83b-7b25-4eee-a07a-69eb3bfe7af3 req-a6a4e62b-4e75-4339-b736-c806a2502a39 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.183618 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7309d83b-7b25-4eee-a07a-69eb3bfe7af3 req-a6a4e62b-4e75-4339-b736-c806a2502a39 service nova] Creating event network-vif-plugged:59a616e6-7f0e-4997-8ea1-0fc767f76feb for instance 187f7043-8fce-4714-b73c-12336bc51326 on n-h1-858384-19 Nov 02 13:40:26.192496 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7309d83b-7b25-4eee-a07a-69eb3bfe7af3 req-a6a4e62b-4e75-4339-b736-c806a2502a39 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040085 Nov 02 13:40:26.193480 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2483/5354] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:40:26.398603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9216c624-6692-409d-ae26-e721efa81b04 req-86ed5968-3f2e-4961-931f-1d4b230d4245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "tag": "73d16813-eb06-4ed3-a474-c5a0a0fc8989"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:26.419446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9216c624-6692-409d-ae26-e721efa81b04 req-86ed5968-3f2e-4961-931f-1d4b230d4245 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.420139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9216c624-6692-409d-ae26-e721efa81b04 req-86ed5968-3f2e-4961-931f-1d4b230d4245 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.420750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9216c624-6692-409d-ae26-e721efa81b04 req-86ed5968-3f2e-4961-931f-1d4b230d4245 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.451271 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9216c624-6692-409d-ae26-e721efa81b04 req-86ed5968-3f2e-4961-931f-1d4b230d4245 service nova] Creating event network-changed:73d16813-eb06-4ed3-a474-c5a0a0fc8989 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:40:26.459995 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9216c624-6692-409d-ae26-e721efa81b04 req-86ed5968-3f2e-4961-931f-1d4b230d4245 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068106 Nov 02 13:40:26.460730 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2484/5355] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:40:26.467678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:26.487605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:26.490332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:26.496434 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b1b5ebf-1499-4e90-9ade-d179a71e0179 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1896 microversion: 2.42 time: 0.493522 Nov 02 13:40:26.498631 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2872/5356] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:26 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1896 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:26.714122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:26.715254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 66ed7862-b20d-457d-84d7-7259ba577d12] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:26.726375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.727382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.728088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.729056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.729737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.730407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.747812 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] HTTP exception thrown: Instance 66ed7862-b20d-457d-84d7-7259ba577d12 could not be found. Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Request method failure captured: Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 HTTP/1.1 Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnHi7jP3BREzNNxMlaHpTkHTAhpl4YuS15cqc7AF8LZUEXF-7lvm87GGJSejO1Ngp59zhuvznS7N8Hp-FmGbmJ1gJUTodwrnMGNso2bPIBMjI2J9vGT9OMBHmDkPSV1QxO58NX1-FPgIu3P9_ttyV5w2TDOTyKt4vpmdeDQUnv6oULM Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9758bd03bdc949d495c293221823196c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9758bd03bdc949d495c293221823196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 9485351c342740638c6a30b05cd0b162 Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 66ed7862-b20d-457d-84d7-7259ba577d12 could not be found. Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '66ed7862-b20d-457d-84d7-7259ba577d12'} Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66ed7862-b20d-457d-84d7-7259ba577d12 could not be found. Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66ed7862-b20d-457d-84d7-7259ba577d12 could not be found. Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:26.749881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:40:26.757828 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:26.757828 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:26.757828 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:40:26.757828 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:40:26.757828 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:40:26.757828 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:40:26.757828 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66ed7862-b20d-457d-84d7-7259ba577d12 could not be found. Nov 02 13:40:26.757828 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:40:26.760638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Returning 404 to user: Instance 66ed7862-b20d-457d-84d7-7259ba577d12 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:40:26.761955 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3b8c225e-ffc5-411c-93fc-1ace097361c7 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12" status: 404 len: 111 microversion: 2.1 time: 0.059221 Nov 02 13:40:26.763204 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2485/5357] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:26 2022] GET /compute/v2.1/servers/66ed7862-b20d-457d-84d7-7259ba577d12 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:40:26.772124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:26.772632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:26.785843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.785843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.785843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.787617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.787617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.787617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.826445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:40:26.846791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:26.847384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:26.857085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.857589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.858027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.867511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:26.868077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:26.868524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:26.989218 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-72c27985-b615-4f07-9863-639567e98e2e tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "DELETE /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 204 len: 0 microversion: 2.1 time: 0.219660 Nov 02 13:40:26.990508 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2873/5358] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:40:26 2022] DELETE /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:40:27.002512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:27.003673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:27.011363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:27.012506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:27.013156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:27.014314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:27.014974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:27.015673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:27.178366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:27.188019 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ff23d0a-e18c-4b91-97be-df41ab561e8c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.345699 Nov 02 13:40:27.192164 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2486/5359] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:26 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:27.289618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:27.298028 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3bf505c6-8a28-4f98-bfda-fc2a0993cbde tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.302860 Nov 02 13:40:27.299519 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2874/5360] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:26 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:27.524889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:27.525501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:27.533477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:27.536764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:27.537464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:27.538423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:27.540355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:27.541028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:27.574587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:27.882540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:27.893439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:27.896655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:27.898218 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bacdebea-2991-40f8-b30a-9fe2a3ec45d2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.377366 Nov 02 13:40:27.916092 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2487/5361] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:27 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:28.214764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:28.216851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:28.233157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:28.233657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:28.234736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:28.235506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:28.236188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:28.236737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:28.328256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:28.328910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:28.335847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:28.336343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:28.336840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:28.337547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:28.338000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:28.338424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:28.562545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:28.575348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:28.575564 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0ea41e2-3c0b-4507-9c2b-3c73471a6e65 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.251681 Nov 02 13:40:28.576310 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2488/5362] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:28 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:28.583459 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3d6bc248-2063-4ab2-9ee1-46016c98f2fb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.372787 Nov 02 13:40:28.599003 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2875/5363] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:28 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:28.607636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-67553a07-f6c3-4928-aa4a-6c4367bd1b12 req-ea6d5b48-2129-41a1-981c-ee9ebb121326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "tag": "2d74b6f6-a4a2-4b1c-90ef-23ce37676e10"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:28.621991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-67553a07-f6c3-4928-aa4a-6c4367bd1b12 req-ea6d5b48-2129-41a1-981c-ee9ebb121326 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:28.622502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-67553a07-f6c3-4928-aa4a-6c4367bd1b12 req-ea6d5b48-2129-41a1-981c-ee9ebb121326 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:28.622957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-67553a07-f6c3-4928-aa4a-6c4367bd1b12 req-ea6d5b48-2129-41a1-981c-ee9ebb121326 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:28.640212 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-67553a07-f6c3-4928-aa4a-6c4367bd1b12 req-ea6d5b48-2129-41a1-981c-ee9ebb121326 service nova] Creating event network-changed:2d74b6f6-a4a2-4b1c-90ef-23ce37676e10 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:40:28.645686 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-67553a07-f6c3-4928-aa4a-6c4367bd1b12 req-ea6d5b48-2129-41a1-981c-ee9ebb121326 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067991 Nov 02 13:40:28.646840 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2489/5364] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:28.928480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:28.929214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:28.935809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:28.936411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:28.936929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:28.937743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:28.938267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:28.938774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:29.346378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:29.356720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:29.358527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:29.359756 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29050f94-14a2-497f-9d37-70b53877fbbb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.435820 Nov 02 13:40:29.360533 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2876/5365] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:28 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:29.604251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:29.605723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:29.606667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:29.607982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:29.616565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:29.618080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:29.618648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:29.619426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:29.620415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:29.621271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:29.621726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:29.622548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:29.623295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:29.623735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:29.630245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:29.630703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:29.915495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:29.923731 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6dadec0b-bd24-4f3c-b8ed-563c177d7340 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1372 microversion: 2.1 time: 0.320889 Nov 02 13:40:29.924681 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2877/5366] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:29 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:29.927897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:29.935845 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b692a07c-6afb-44fe-9552-0cbb71981638 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.338397 Nov 02 13:40:29.936624 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2490/5367] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:29 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:30.388774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:30.390013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:30.398586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.399407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.400056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.400972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.401637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.402249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.658695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:30.668572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:30.670073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:30.671268 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75dc0f3d-d8db-4709-ac0d-a6408320590f tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.286735 Nov 02 13:40:30.671844 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2878/5368] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:30 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:30.952821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:30.954176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:30.960868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:30.961480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:30.963971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.964765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.966848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.967879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.968572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.971645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.977827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.979034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.979710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:30.990834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:30.991660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:30.992126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:31.140901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:31.149897 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9071f56c-5900-4139-a184-c75c154892c4 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1526 microversion: 2.1 time: 0.193543 Nov 02 13:40:31.150509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2879/5369] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:30 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1526 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:31.375302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:31.390856 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a8b6ea2d-14e5-47ee-a6ff-ae8872d2d5d2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1562 microversion: 2.1 time: 0.443234 Nov 02 13:40:31.395094 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2491/5370] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:30 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1562 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:31.437537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a3156c71-4a6c-44ca-80b4-0fe91eec7c8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:31.438856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a3156c71-4a6c-44ca-80b4-0fe91eec7c8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:31.448439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3156c71-4a6c-44ca-80b4-0fe91eec7c8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:31.458627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3156c71-4a6c-44ca-80b4-0fe91eec7c8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:31.459192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3156c71-4a6c-44ca-80b4-0fe91eec7c8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:31.460195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3156c71-4a6c-44ca-80b4-0fe91eec7c8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:31.460831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3156c71-4a6c-44ca-80b4-0fe91eec7c8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:31.461448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3156c71-4a6c-44ca-80b4-0fe91eec7c8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:31.528923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4254fdc1-c7a7-427f-a2e6-56cf65cc48d2 req-33c520e7-741d-4988-8090-7488fe44d270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e23861-9b9f-4579-ba97-d9e3851ce40e", "name": "network-vif-deleted", "tag": "a44cd156-66cc-4374-92ca-e88bd40334eb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:31.542538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4254fdc1-c7a7-427f-a2e6-56cf65cc48d2 req-33c520e7-741d-4988-8090-7488fe44d270 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:31.543666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4254fdc1-c7a7-427f-a2e6-56cf65cc48d2 req-33c520e7-741d-4988-8090-7488fe44d270 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:31.545787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4254fdc1-c7a7-427f-a2e6-56cf65cc48d2 req-33c520e7-741d-4988-8090-7488fe44d270 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:31.572038 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4254fdc1-c7a7-427f-a2e6-56cf65cc48d2 req-33c520e7-741d-4988-8090-7488fe44d270 service nova] Creating event network-vif-deleted:a44cd156-66cc-4374-92ca-e88bd40334eb for instance 30e23861-9b9f-4579-ba97-d9e3851ce40e on n-h1-858384-19 Nov 02 13:40:31.586413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4254fdc1-c7a7-427f-a2e6-56cf65cc48d2 req-33c520e7-741d-4988-8090-7488fe44d270 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064948 Nov 02 13:40:31.587229 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2492/5371] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:31.616810 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a3156c71-4a6c-44ca-80b4-0fe91eec7c8d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200954 Nov 02 13:40:31.617442 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2880/5372] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:40:31 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:40:31.703644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:31.704386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:31.714432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:31.714991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:31.715493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:31.716217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:31.717284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:31.717731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:32.161000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:32.172358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:32.174383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:32.181483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:32.182165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:32.182678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:32.182982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:32.183247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:32.183971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:32.184431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:32.185571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:32.190566 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-733e929f-42a6-46c4-8dce-adaad23f3d48 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.492682 Nov 02 13:40:32.195510 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2493/5373] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:31 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:32.228734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:32.229227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:32.230010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:32.230696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lazy-loading 'fault' on Instance uuid 30e23861-9b9f-4579-ba97-d9e3851ce40e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:40:32.394536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9485351c342740638c6a30b05cd0b162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9758bd03bdc949d495c293221823196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:32.404120 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c09cbc7-6d0f-4bdf-85bf-805921c76e35 tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 200 len: 1316 microversion: 2.1 time: 0.235760 Nov 02 13:40:32.420278 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2881/5374] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:32 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:33.227298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:33.228705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:33.237083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:33.238357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:33.239061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:33.240093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:33.240794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:33.241899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:33.428366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:33.431410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] [instance: 30e23861-9b9f-4579-ba97-d9e3851ce40e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:33.441302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:33.441800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:33.442244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:33.443032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:33.443570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:33.444001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:33.462273 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] HTTP exception thrown: Instance 30e23861-9b9f-4579-ba97-d9e3851ce40e could not be found. Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Request method failure captured: Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e HTTP/1.1 Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHi7jP3BREzNNxMlaHpTkHTAhpl4YuS15cqc7AF8LZUEXF-7lvm87GGJSejO1Ngp59zhuvznS7N8Hp-FmGbmJ1gJUTodwrnMGNso2bPIBMjI2J9vGT9OMBHmDkPSV1QxO58NX1-FPgIu3P9_ttyV5w2TDOTyKt4vpmdeDQUnv6oULM Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9758bd03bdc949d495c293221823196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9758bd03bdc949d495c293221823196c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9758bd03bdc949d495c293221823196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9758bd03bdc949d495c293221823196c Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1500025699 Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 9485351c342740638c6a30b05cd0b162 Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1500025699-project Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 30e23861-9b9f-4579-ba97-d9e3851ce40e could not be found. Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '30e23861-9b9f-4579-ba97-d9e3851ce40e'} Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e23861-9b9f-4579-ba97-d9e3851ce40e could not be found. Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e23861-9b9f-4579-ba97-d9e3851ce40e could not be found. Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:33.464182 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:40:33.470295 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:33.470295 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:33.470295 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:40:33.470295 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:40:33.470295 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:40:33.470295 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:40:33.470295 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e23861-9b9f-4579-ba97-d9e3851ce40e could not be found. Nov 02 13:40:33.470295 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:33.474692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] Returning 404 to user: Instance 30e23861-9b9f-4579-ba97-d9e3851ce40e could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:40:33.476108 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00cfe1cb-9d8c-498d-9d9b-4778d65a966d tempest-ServerRescueNegativeTestJSON-1500025699 tempest-ServerRescueNegativeTestJSON-1500025699-project] 10.222.0.113 "GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e" status: 404 len: 111 microversion: 2.1 time: 0.053675 Nov 02 13:40:33.477288 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2882/5375] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:33 2022] GET /compute/v2.1/servers/30e23861-9b9f-4579-ba97-d9e3851ce40e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:40:33.697964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:33.712164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:33.714911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:33.718647 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b5386a05-b443-43da-bcd7-701883918a84 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.498445 Nov 02 13:40:33.722846 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2494/5376] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:33 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:34.017339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-42639c46-15b2-462d-9940-a33d754db62f req-7cb151e9-c2ba-4904-a9ce-14bac7cc22bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187f7043-8fce-4714-b73c-12336bc51326", "tag": "59a616e6-7f0e-4997-8ea1-0fc767f76feb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:34.028420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-42639c46-15b2-462d-9940-a33d754db62f req-7cb151e9-c2ba-4904-a9ce-14bac7cc22bf service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:34.029177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-42639c46-15b2-462d-9940-a33d754db62f req-7cb151e9-c2ba-4904-a9ce-14bac7cc22bf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:34.029841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-42639c46-15b2-462d-9940-a33d754db62f req-7cb151e9-c2ba-4904-a9ce-14bac7cc22bf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:34.043103 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-42639c46-15b2-462d-9940-a33d754db62f req-7cb151e9-c2ba-4904-a9ce-14bac7cc22bf service nova] Creating event network-changed:59a616e6-7f0e-4997-8ea1-0fc767f76feb for instance 187f7043-8fce-4714-b73c-12336bc51326 on n-h1-858384-19 Nov 02 13:40:34.049173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-42639c46-15b2-462d-9940-a33d754db62f req-7cb151e9-c2ba-4904-a9ce-14bac7cc22bf service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035002 Nov 02 13:40:34.050189 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2883/5377] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:34.753881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:34.756254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:34.779141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:34.782919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:34.783666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:34.785021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:34.786060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:34.786579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:35.006835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:35.016620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:35.018493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:35.019726 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c0f159fb-7b27-473d-87b5-56da5f14912a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.272319 Nov 02 13:40:35.020290 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2495/5378] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:34 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:36.046789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:36.048629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:36.056547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:36.057619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:36.058265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:36.059265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:36.059898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:36.060323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:36.400524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:36.420981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:36.435206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:36.437615 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9b2d18d4-8a23-4103-8eb9-ee60b2b5524d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.394625 Nov 02 13:40:36.451872 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2884/5379] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:36 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:37.465759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:37.466391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:37.474834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:37.475365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:37.477313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:37.477313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:37.477313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:37.477625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:37.682620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:37.692653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:37.694225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:37.695505 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b57e6fb-c815-4ce7-abff-4fc2b822dc95 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.234825 Nov 02 13:40:37.696155 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2496/5380] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:37 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:38.729841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:38.731324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:38.741091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:38.741879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:38.742319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:38.743234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:38.744322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:38.744855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:38.749702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:38.997815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:39.008790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:39.010196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:39.011504 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9da0a87a-3d6b-4941-aa02-db6a9a7bfcfd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.286082 Nov 02 13:40:39.012403 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2885/5381] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:38 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:39.855951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-493664002", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": "none"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:39.920845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:40:39.921288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:40:39.921765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:40:39.926302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:40:39.926302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:40:39.932476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:39.932963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:39.933407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:39.934140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:39.934600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:39.935032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:39.952504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Getting quotas for project b3e17910233c46e79e9f2b4751f27d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:40:39.957823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Getting quotas for user 0f2abe353ef440f6931b3669f80d38fb and project b3e17910233c46e79e9f2b4751f27d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:40:39.972266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:40:39.974963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:40:40.026907 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d42a9536-0af5-4e9a-b54e-5015d69ecbde tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.57 time: 0.297035 Nov 02 13:40:40.027607 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2497/5382] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:40:39 2022] POST /compute/v2.1/servers => generated 382 bytes in 300 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:40:40.040413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:40.041038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:40.041822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aa25cd09-9c4a-4706-aa0d-b3a06863e293 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:40.042626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aa25cd09-9c4a-4706-aa0d-b3a06863e293 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:40.053033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:40.053611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:40.054053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:40.054764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:40.055803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:40.056227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:40.140705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aa25cd09-9c4a-4706-aa0d-b3a06863e293 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:40.155864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aa25cd09-9c4a-4706-aa0d-b3a06863e293 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:40.157769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aa25cd09-9c4a-4706-aa0d-b3a06863e293 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:40.158952 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aa25cd09-9c4a-4706-aa0d-b3a06863e293 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1280 microversion: 2.57 time: 0.123555 Nov 02 13:40:40.159558 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2886/5383] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:40 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1280 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:40.339896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:40.351401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:40.353055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:40.355099 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c390debf-8f85-4664-a4db-df7f28236707 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.317934 Nov 02 13:40:40.370486 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2498/5384] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:40 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:41.185426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:41.186081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:41.195186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:41.195687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:41.196136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:41.196854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:41.197521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:41.197752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:41.272766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:41.282106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:41.284792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:41.286043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-307a3145-fc53-4d83-9c20-fd7b50c004ad tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1332 microversion: 2.57 time: 0.104621 Nov 02 13:40:41.286699 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2887/5385] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:41 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:41.382059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:41.382720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:41.390216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:41.390966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:41.392144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:41.392854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:41.393469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:41.394047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:41.592588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:41.602147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:41.603663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:41.604816 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-774cb9dc-5b8f-4e83-83c9-a52b65716bfe tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.227242 Nov 02 13:40:41.605369 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2499/5386] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:41 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:42.313920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:42.315166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:42.322990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:42.323528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:42.323976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:42.324719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:42.325182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:42.325615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:42.395429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:42.405251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:42.406887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:42.409365 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c252d262-637d-4881-b35e-d935bdf6113f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1338 microversion: 2.57 time: 0.100903 Nov 02 13:40:42.410039 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2888/5387] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:42 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:42.632022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:42.632736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:42.640199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:42.640791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:42.641305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:42.642574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:42.643583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:42.643746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:42.869354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:42.883551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:42.885476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:42.886649 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f78df95c-15b6-40f3-883e-b39e4454b22c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.259258 Nov 02 13:40:42.887419 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2500/5388] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:42 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:40:43.439929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:43.441241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:43.447962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:43.448584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:43.449027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:43.449729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:43.450592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:43.451434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:43.805834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:43.815658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:43.817182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:43.818329 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a882d93f-6d18-41f3-aeb4-8c55ab4b9c0e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1338 microversion: 2.57 time: 0.385113 Nov 02 13:40:43.819210 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2889/5389] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:43 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1338 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:40:43.918370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:43.918940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:43.921885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:43.928700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:43.929203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:43.929575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:43.930336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:43.930793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:43.931255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:44.141789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:44.151581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:44.153073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:44.154264 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b33b71b5-f949-4636-b60a-96424deef289 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.240231 Nov 02 13:40:44.154848 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2501/5390] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:43 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:44.846631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:44.847424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:44.854315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:44.854806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:44.855280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:44.855990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:44.856458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:44.856890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:44.929405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:44.937654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:44.941121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:44.942287 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4a5b30c-d495-499b-9be5-09082b4cc24b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1338 microversion: 2.57 time: 0.100322 Nov 02 13:40:44.942864 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2890/5391] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:44 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:45.182540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:45.183349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:45.192463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:45.193102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:45.193697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:45.194594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:45.195196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:45.195627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:45.384998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:45.395956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:45.397463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:45.398708 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6db4a339-ba5e-4f18-89cb-aa4bbaa6a06d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.221531 Nov 02 13:40:45.399289 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2502/5392] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:45 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:45.967224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:45.967825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:45.975442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:45.975924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:45.976363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:45.977051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:45.977506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:45.977932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.042513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.051816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.053323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.054516 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1607ee0b-0e7d-4e65-af03-56badcd891b7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1359 microversion: 2.57 time: 0.091299 Nov 02 13:40:46.055083 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2891/5393] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:45 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1359 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:46.081198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:46.084110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:46.090427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.090952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.091373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.092086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.092549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.092984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.173383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:40:46.173807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:40:46.174284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:40:46.174695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:40:46.175126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:40:46.241592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:46.248555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.249019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.249889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.250266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.252099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.252572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.286338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7dfc9ef3-6875-4f69-b54b-3493f4ed2632 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "POST /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5/action" status: 202 len: 1140 microversion: 2.57 time: 0.210331 Nov 02 13:40:46.295284 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2503/5394] 10.222.0.113 () {62 vars in 1325 bytes} [Wed Nov 2 13:40:46 2022] POST /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5/action => generated 1140 bytes in 220 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Nov 02 13:40:46.312043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:46.312806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:46.321487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.322375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.323060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.324040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.325113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.325776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.402127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.411414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.412959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.414347 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2772fa2c-a5ef-4a87-a35a-85755c166af3 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.109116 Nov 02 13:40:46.414919 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2892/5395] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:46 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:46.427768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:46.428401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:46.434879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.435419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.435868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.436811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.437463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.439051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.444595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:46.464672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae1eec50-3922-452b-850b-8dd81674bb23 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:46.467309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae1eec50-3922-452b-850b-8dd81674bb23 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:46.474066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae1eec50-3922-452b-850b-8dd81674bb23 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.474563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae1eec50-3922-452b-850b-8dd81674bb23 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.475526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae1eec50-3922-452b-850b-8dd81674bb23 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.476557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae1eec50-3922-452b-850b-8dd81674bb23 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.477069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae1eec50-3922-452b-850b-8dd81674bb23 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.477508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae1eec50-3922-452b-850b-8dd81674bb23 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.512974 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae1eec50-3922-452b-850b-8dd81674bb23 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053614 Nov 02 13:40:46.515274 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2893/5396] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:40:46 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:40:46.608162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:46.608661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:46.624437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.624998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.625469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.626958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.627500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.627922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.647267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.660067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.661999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.663854 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e2a3b9be-f704-41c9-be09-3718f028f856 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.239868 Nov 02 13:40:46.665188 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2504/5397] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:46 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:46.682475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:40:46.802545 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93482334-b4f3-410b-9583-840dcfceca15 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 204 len: 0 microversion: 2.1 time: 0.198367 Nov 02 13:40:46.803196 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2894/5398] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:40:46 2022] DELETE /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:40:46.811298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:46.812204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:46.818924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.819456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.819894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.820587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:46.821038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:46.821464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:46.961693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:46.970936 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b7171f6-f126-46c8-b60e-c7a480404f06 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1675 microversion: 2.1 time: 0.162344 Nov 02 13:40:46.971785 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2505/5399] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:46 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:47.442238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:47.443041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:47.450336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:47.451104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:47.451582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:47.452503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:47.453111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:47.454228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:47.537021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:47.549794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:47.551391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:47.552656 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-655f248a-395e-4783-ad07-b44c4d81afc5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.115256 Nov 02 13:40:47.553257 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2895/5400] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:47 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:47.694203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:47.694858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:47.701640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:47.702122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:47.702560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:47.703302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:47.704389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:47.704838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:47.897247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:47.906435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:47.910490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:47.911707 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1aae49c0-8e2c-4afe-8ef1-769a00437bc2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.221665 Nov 02 13:40:47.912282 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2506/5401] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:47 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:47.998057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:47.998775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:48.005964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:48.006454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:48.006899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:48.007647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:48.008104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:48.008558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:48.158067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:48.166632 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b8894366-6ef2-44ae-824e-38bee6f7e549 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1675 microversion: 2.1 time: 0.174702 Nov 02 13:40:48.167313 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2896/5402] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:47 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:48.580512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:48.581349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:48.588371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:48.589119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:48.589626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:48.590488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:48.591256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:48.591755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:48.687495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:48.696375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:48.698090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:48.699480 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d7f99382-ad4a-4ba1-900e-0ab9d5dedf18 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.123326 Nov 02 13:40:48.700188 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2507/5403] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:48 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:48.940364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:48.941257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:48.948570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:48.949149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:48.949662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:48.950468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:48.951036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:48.951583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:49.167366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:49.185047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:49.186969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:49.189044 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8cc592cf-2ad9-4105-ac7f-2879f5dae611 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.253061 Nov 02 13:40:49.189629 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2897/5404] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:48 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:49.192119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:49.192999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:49.200739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:49.201507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:49.202186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:49.203199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:49.204560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:49.205249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:49.305080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:49.314499 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22602f29-74ce-44b6-ab45-463ada7e35a8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1607 microversion: 2.1 time: 0.127042 Nov 02 13:40:49.315607 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2508/5405] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:49 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1607 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:49.386434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a2a39bcb-362d-4c48-8225-969d06827d43 req-f3d5b4dd-d7ea-4d40-8cfa-3f9b5d9b44b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21f8474-c128-4b53-bff0-430576924452", "name": "network-vif-deleted", "tag": "40df3459-8d21-4266-8914-4f5dec968db6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:49.406625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a2a39bcb-362d-4c48-8225-969d06827d43 req-f3d5b4dd-d7ea-4d40-8cfa-3f9b5d9b44b6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:49.408065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a2a39bcb-362d-4c48-8225-969d06827d43 req-f3d5b4dd-d7ea-4d40-8cfa-3f9b5d9b44b6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:49.408696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a2a39bcb-362d-4c48-8225-969d06827d43 req-f3d5b4dd-d7ea-4d40-8cfa-3f9b5d9b44b6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:49.448883 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a2a39bcb-362d-4c48-8225-969d06827d43 req-f3d5b4dd-d7ea-4d40-8cfa-3f9b5d9b44b6 service nova] Creating event network-vif-deleted:40df3459-8d21-4266-8914-4f5dec968db6 for instance e21f8474-c128-4b53-bff0-430576924452 on n-h2-858384-19 Nov 02 13:40:49.467299 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a2a39bcb-362d-4c48-8225-969d06827d43 req-f3d5b4dd-d7ea-4d40-8cfa-3f9b5d9b44b6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084729 Nov 02 13:40:49.470764 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2898/5406] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:49.728653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:49.729470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:49.736429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:49.736998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:49.737779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:49.738562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:49.739140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:49.739643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:49.811571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:49.820516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:49.822017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:49.823207 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a962634b-89a8-4bc2-b54e-e54bb8dbc288 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.098758 Nov 02 13:40:49.823779 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2509/5407] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:49 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:50.218476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:50.220479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:50.225218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:50.230914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:50.231572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:50.232082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:50.232852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:50.233373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:50.233867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:50.342897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:50.344049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:50.351648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:50.352688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:50.356603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:50.358498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:50.359482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:50.361594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:50.362336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:50.363379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:50.454409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:50.465614 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6a1b4e4a-f17f-46d7-bf57-dc868cb2d8a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 200 len: 1607 microversion: 2.1 time: 0.127448 Nov 02 13:40:50.466448 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2510/5408] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:50 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 1607 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:50.475711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:50.491384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:50.492900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:50.494063 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ba50119d-70c0-498f-8fe1-653d64ed5eef tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.280585 Nov 02 13:40:50.515362 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2899/5409] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:50 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:50.849548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:50.850831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:50.859131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:50.859639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:50.860938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:50.861709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:50.862174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:50.862870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:50.935794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:50.945940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:50.947729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:50.949101 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d3616426-5b05-4d66-b02f-18e26b6eca75 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.104652 Nov 02 13:40:50.950179 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2511/5410] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:50 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:51.491045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:51.491686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:51.498690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:51.499205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:51.499790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:51.501097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:51.501938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:51.502744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:51.517535 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] HTTP exception thrown: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Request method failure captured: Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 HTTP/1.1 Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHuSNcPxkmMXWkj7-jh5s6q2etFyI21tJAdj2sGxkhQe0gQ1gPSUhnFgKWfFxu8l7eD2TadND-vfDOGldgWczShNSNApnMVHhi7izQmKs-mEnIeMUbIkCFWs5BeNpp2SiZr6KH8yDG6e2TMF_l2PKwhGbTokmwpI5i5sDlaUEgcu_k Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0d4a470b46934c96845dd659f4752b3b Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e21f8474-c128-4b53-bff0-430576924452'} Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:40:51.519223 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:51.525134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:40:51.525134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:40:51.525134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:40:51.525134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:40:51.525134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:40:51.525134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:40:51.525134 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:40:51.525134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Returning 404 to user: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:40:51.525134 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7decf7d9-0a96-41db-bd23-57c75532b8c2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 404 len: 111 microversion: 2.1 time: 0.033992 Nov 02 13:40:51.526128 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2900/5411] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:51 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:40:51.534239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91c7a8bf-08d4-4b78-b261-cb1fb69912b4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '.version_select at 0x7fe7860bdc10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:51.534452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:51.534452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:51.541106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:51.541733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:51.543043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:51.543920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:51.544478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:51.545144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:51.558183 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91c7a8bf-08d4-4b78-b261-cb1fb69912b4 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-41107667" status: 202 len: 0 microversion: 2.1 time: 0.030928 Nov 02 13:40:51.562083 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2901/5412] 10.222.0.113 () {58 vars in 1220 bytes} [Wed Nov 2 13:40:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-41107667 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:40:51.814137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:51.824483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:51.826208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:51.827670 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8bfabdec-ed45-4f24-bf48-4ec54e45cee5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.300589 Nov 02 13:40:51.828521 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2512/5413] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:51 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:40:51.977155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:51.977774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:51.984580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:51.986314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:51.986784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:51.988408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:51.988408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:51.988945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:52.070176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:52.082097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:52.084349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:52.086517 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d0274a14-00ed-4333-b2cc-d90ed604a71e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.113483 Nov 02 13:40:52.087965 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2902/5414] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:51 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:52.422115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c076fb53-998a-4fc2-80f9-e5bd85549eae tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'create', calling method: .version_select at 0x7fe786d78280>, body: {"keypair": {"name": "tempest-keypair-1460930157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMag3hgd8Dt+OZkjzhruI+2vQfdvNoihPvwjw6xIdH9oXNHlsH7Lp4sRpKI1U0Zua7jmqpx3AreIN4hVJIcwvEvgUa3gRWXslOqqw8OEac80LdRII0x5oGlmI9BsN4/9Ag=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:52.439317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c076fb53-998a-4fc2-80f9-e5bd85549eae tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Getting quotas for project caaf4dc4c8fb46e6b6497a9f289825bf. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:40:52.444771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c076fb53-998a-4fc2-80f9-e5bd85549eae tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Getting quotas for user 0d4a470b46934c96845dd659f4752b3b and project caaf4dc4c8fb46e6b6497a9f289825bf. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:40:52.470745 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c076fb53-998a-4fc2-80f9-e5bd85549eae tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052521 Nov 02 13:40:52.471415 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2513/5415] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:40:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:52.856383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:52.857078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:52.869652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:52.870148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:52.870581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:52.876893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:52.886228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:52.886961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:52.933555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:53.116398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:53.117031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:53.138268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:53.138780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:53.139268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:53.140111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:53.140576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:53.141261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:53.244468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:53.264053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:53.268273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:53.269485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f5ae6d57-08a7-416a-890f-9b69a5321297 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.418185 Nov 02 13:40:53.272863 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2903/5416] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:52 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:53.280356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:53.301439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:53.303927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:53.305511 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-31835024-d25c-4ca0-86c6-d0b5babce8eb tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.195518 Nov 02 13:40:53.306103 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2514/5417] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:53 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:54.317351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:54.318798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:54.327034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:54.329371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:54.336122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:54.337587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:54.342926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:54.346171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:54.349034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:54.349753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:54.355626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:54.356066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:54.356518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:54.357245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:54.357704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:54.358129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:54.482395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:54.493056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:54.496184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:54.498255 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-666cd9d1-3ca5-4191-b164-03f100a584aa tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.166681 Nov 02 13:40:54.499444 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2515/5418] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:54 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:54.537123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-328188680", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a9d0f9f-afcf-4d5e-a109-679a014b3254"}], "security_groups": [{"name": "tempest-securitygroup--2125966689"}], "key_name": "tempest-keypair-1460930157", "user_data": "}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:54.632044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:54.642747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:54.644277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:54.645941 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b1c2bdd2-4b26-4aca-bf1e-bc43fbd807b6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.334265 Nov 02 13:40:54.669171 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2904/5419] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:54 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:54.675735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] validate_networks() for [('9a9d0f9f-afcf-4d5e-a109-679a014b3254', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:40:55.179551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:40:55.180203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:40:55.180961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:40:55.181407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:40:55.181888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:40:55.192640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:55.193136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:55.193657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:55.194377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:55.194841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:55.195314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:55.214863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Getting quotas for project caaf4dc4c8fb46e6b6497a9f289825bf. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:40:55.220090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Getting quotas for user 0d4a470b46934c96845dd659f4752b3b and project caaf4dc4c8fb46e6b6497a9f289825bf. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:40:55.233572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:40:55.236007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:40:55.295406 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-087aad72-061a-4462-9a01-e6a71e05fd3e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.767121 Nov 02 13:40:55.304941 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2516/5420] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:40:54 2022] POST /compute/v2.1/servers => generated 404 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:40:55.316400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12153a09-3e48-49ea-9f7b-fba73128dbba tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:55.318694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12153a09-3e48-49ea-9f7b-fba73128dbba tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:55.389491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12153a09-3e48-49ea-9f7b-fba73128dbba tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:55.397235 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12153a09-3e48-49ea-9f7b-fba73128dbba tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1241 microversion: 2.1 time: 0.090677 Nov 02 13:40:55.399431 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2905/5421] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:55 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:55.530351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:55.533086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:55.540907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:55.541831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:55.542818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:55.543306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:55.543954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:55.544567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:55.624487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:55.635169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:55.637024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:55.638420 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff2d4fd3-d835-4c4d-96e3-3e1030d03085 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.112567 Nov 02 13:40:55.639342 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2517/5422] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:55 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:55.679784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:55.682211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:55.697038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:55.697900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:55.698504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:55.699412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:55.700169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:55.701481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:55.946125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:55.958092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:55.959875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:55.961077 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0e1534a-1c4a-48d8-adab-f48670c681c3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.288618 Nov 02 13:40:55.961649 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2906/5423] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:55 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:56.423277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:56.424513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:56.431008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:56.431904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:56.432505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:56.433221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:56.434077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:56.434959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:56.504855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:56.512832 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-96d76ddf-bb50-409e-83eb-e60874ecd6d7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1293 microversion: 2.1 time: 0.094767 Nov 02 13:40:56.513411 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2518/5424] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:56 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:56.665375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:56.666746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:56.669874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:56.676515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:56.677231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:56.677849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:56.678746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:56.679242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:56.679851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:56.786517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:56.796322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:56.799343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:56.800750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e3d8a841-483e-4665-999b-837e3702c1b8 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.140162 Nov 02 13:40:56.815705 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2907/5425] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:56 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:56.988874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:56.990397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:57.000433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:57.001378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:57.002053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:57.002999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:57.003862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:57.004523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:57.269209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:57.282074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:57.284123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:57.285521 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-230824ce-7276-4cdd-b936-e665228b0340 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.301315 Nov 02 13:40:57.299356 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2519/5426] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:56 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:57.546982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:57.558628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:57.565296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:57.567040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:57.567040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:57.567040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:57.568029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:57.568029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:57.727830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:57.743041 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-55627f05-b16c-4ea8-badc-8392f3656bcd tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.199456 Nov 02 13:40:57.743981 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2908/5427] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:57 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:40:57.828797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:57.829678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:57.837493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:57.838432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:57.839031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:57.839933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:57.840543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:57.841136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:57.944958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:57.954561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:57.956405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:57.957818 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-410a40b4-96cc-4708-9524-993d71728693 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.134243 Nov 02 13:40:57.958668 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2520/5428] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:57 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:58.319675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:58.325981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:58.355625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:58.358596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:58.359343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:58.362304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:58.363372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:58.364019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:58.695799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-74838ec5-1bde-4d6f-bc96-b0f416a2f33f req-29e0c8c1-61c6-4b0e-a556-1afa11328e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24929ae5-b7e1-4ccc-b7aa-9229fa92c614", "tag": "121a1ff1-f3f1-46f8-a4a0-f3c0cb6c625c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:58.731056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-74838ec5-1bde-4d6f-bc96-b0f416a2f33f req-29e0c8c1-61c6-4b0e-a556-1afa11328e5b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:58.732020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-74838ec5-1bde-4d6f-bc96-b0f416a2f33f req-29e0c8c1-61c6-4b0e-a556-1afa11328e5b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:58.732702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-74838ec5-1bde-4d6f-bc96-b0f416a2f33f req-29e0c8c1-61c6-4b0e-a556-1afa11328e5b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:58.743057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:58.755362 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-74838ec5-1bde-4d6f-bc96-b0f416a2f33f req-29e0c8c1-61c6-4b0e-a556-1afa11328e5b service nova] Creating event network-changed:121a1ff1-f3f1-46f8-a4a0-f3c0cb6c625c for instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 on n-h2-858384-19 Nov 02 13:40:58.757678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:58.759478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:58.762565 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-45e1404d-e8f2-4eac-b538-e550611aecb5 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.452796 Nov 02 13:40:58.767208 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-74838ec5-1bde-4d6f-bc96-b0f416a2f33f req-29e0c8c1-61c6-4b0e-a556-1afa11328e5b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075046 Nov 02 13:40:58.768127 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2521/5429] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:40:58.776392 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2909/5430] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:58 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:40:58.782689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e41bd9eb-93db-44c0-b0f8-2ec580214740 req-d91f4746-435c-4ccb-be1b-b7dc17c25743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-plugged", "status": "completed", "tag": "393ebc4f-0e1c-4b0f-a87e-243e38c2925b"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:40:58.791438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:58.792093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:58.799432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:58.799927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:58.800632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:58.801352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:58.802049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:58.802693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:58.808030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e41bd9eb-93db-44c0-b0f8-2ec580214740 req-d91f4746-435c-4ccb-be1b-b7dc17c25743 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:58.808543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e41bd9eb-93db-44c0-b0f8-2ec580214740 req-d91f4746-435c-4ccb-be1b-b7dc17c25743 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:58.809067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e41bd9eb-93db-44c0-b0f8-2ec580214740 req-d91f4746-435c-4ccb-be1b-b7dc17c25743 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:58.830522 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e41bd9eb-93db-44c0-b0f8-2ec580214740 req-d91f4746-435c-4ccb-be1b-b7dc17c25743 service nova] Creating event network-vif-plugged:393ebc4f-0e1c-4b0f-a87e-243e38c2925b for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:40:58.847144 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e41bd9eb-93db-44c0-b0f8-2ec580214740 req-d91f4746-435c-4ccb-be1b-b7dc17c25743 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076106 Nov 02 13:40:58.850806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2522/5431] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:40:58.981904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:58.987271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:58.989581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:58.994680 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-facd6689-c129-442f-be34-ba332cb6555d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.217093 Nov 02 13:40:58.995547 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2910/5432] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:40:58 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:40:58.998063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:59.002937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:59.002937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:59.003862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:59.004589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:59.005047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:59.121163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:59.123986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:40:59.141898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:59.145028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:40:59.146487 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a301dfe1-64bf-40b3-997c-4dab6359aa7e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.165556 Nov 02 13:40:59.159139 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2523/5433] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:58 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:40:59.799316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:40:59.800106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:40:59.807480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:59.808083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:59.808665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:40:59.809517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:40:59.810095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:40:59.810633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:00.015274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:00.020790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:00.021418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:00.027254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:00.029104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:00.030824 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2ce3653b-d8b9-49aa-b0ec-83ac8724cb63 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.237466 Nov 02 13:41:00.031675 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2911/5434] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:40:59 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:00.034675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:00.035201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:00.040401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:00.041176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:00.041653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:00.042095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:00.177805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:00.178497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:00.184096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:00.184668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:00.185176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:00.185797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:00.186505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:00.187187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:00.187685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:00.193789 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a8f92fb-3796-4ef2-bb0e-3681fc220763 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.177509 Nov 02 13:41:00.194653 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2524/5435] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:00 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:00.272941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:00.281234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:00.282931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:00.284129 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31148491-7f4f-4d78-8f48-8a75baefa03c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.111128 Nov 02 13:41:00.284702 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2912/5436] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:00 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:00.892599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3618ee43-9b28-4211-92ae-9dcff77cf04b req-c388a640-79da-436c-95eb-bbc49b529b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-plugged", "status": "completed", "tag": "eff1b854-90e0-44a2-85d1-8014a6f1d2e6"}, {"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-plugged", "status": "completed", "tag": "2d74b6f6-a4a2-4b1c-90ef-23ce37676e10"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:00.902347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3618ee43-9b28-4211-92ae-9dcff77cf04b req-c388a640-79da-436c-95eb-bbc49b529b42 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:00.902831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3618ee43-9b28-4211-92ae-9dcff77cf04b req-c388a640-79da-436c-95eb-bbc49b529b42 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:00.903298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3618ee43-9b28-4211-92ae-9dcff77cf04b req-c388a640-79da-436c-95eb-bbc49b529b42 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:00.915348 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3618ee43-9b28-4211-92ae-9dcff77cf04b req-c388a640-79da-436c-95eb-bbc49b529b42 service nova] Creating event network-vif-plugged:eff1b854-90e0-44a2-85d1-8014a6f1d2e6 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:41:00.915854 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3618ee43-9b28-4211-92ae-9dcff77cf04b req-c388a640-79da-436c-95eb-bbc49b529b42 service nova] Creating event network-vif-plugged:2d74b6f6-a4a2-4b1c-90ef-23ce37676e10 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:41:00.921276 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3618ee43-9b28-4211-92ae-9dcff77cf04b req-c388a640-79da-436c-95eb-bbc49b529b42 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032663 Nov 02 13:41:00.922377 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2525/5437] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:01.057901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:01.058575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:01.066254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:01.066746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:01.067217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:01.067928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:01.068406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:01.068821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:01.218280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:01.219021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:01.226802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:01.227344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:01.227788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:01.228693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:01.228947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:01.230221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:01.263528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:01.278865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:01.280449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:01.281956 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69a30ed2-d169-4733-a0b5-67599ccc5264 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.227857 Nov 02 13:41:01.282545 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2913/5438] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:01 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:01.310368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:01.311338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:01.319663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:01.320720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:01.321169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:01.322094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:01.322699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:01.323166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:01.399683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:01.408872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:01.410470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:01.411770 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-420eb3a1-173d-4f85-b8c1-39de053a5a8a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.105576 Nov 02 13:41:01.412558 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2914/5439] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:01 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:01.646471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:01.654277 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-43bb3b9d-495b-48d0-86d8-58a4df6e71a7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.440316 Nov 02 13:41:01.654787 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2526/5440] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:01 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:02.308863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:02.311142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:02.320992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:02.321747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:02.322419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:02.323756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:02.324597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:02.325276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:02.440151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:02.441439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:02.454838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:02.455359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:02.455803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:02.456518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:02.456973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:02.457396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:02.651549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:02.653538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:02.661241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:02.663070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:02.664476 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-798e342e-d9a0-4132-aea5-62bf4a337463 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.230290 Nov 02 13:41:02.665531 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2527/5441] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:02 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:02.665833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:02.667834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:02.669132 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-57e7229f-7765-4ea6-8d9c-4584fa7d1f77 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.365948 Nov 02 13:41:02.670009 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2915/5442] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:02 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:02.681091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:02.690231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:02.697164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:02.697951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:02.699321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:02.700298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:02.700945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:02.701568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:03.148404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:03.163837 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0584735b-d078-4fca-af2f-39e4d650b816 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.489788 Nov 02 13:41:03.165439 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2528/5443] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:02 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:03.691906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:03.692936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:03.699913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:03.701203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:03.706519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:03.707413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:03.708097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:03.709148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:03.710485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:03.711021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:03.717693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:03.718195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:03.718686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:03.719467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:03.720115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:03.720804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:03.825252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:03.845130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:03.847013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:03.848449 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2033d585-8cec-45b3-8756-d5fa77b29e83 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.161837 Nov 02 13:41:03.851709 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2916/5444] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:03 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:03.970353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:03.980920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:03.982572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:03.983843 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-19cdce10-2b7e-4c63-bcf1-0620b150b238 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.287970 Nov 02 13:41:03.990092 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2529/5445] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:03 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:04.009689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-974919a4-8067-447e-8188-721ef83e1270 req-4617e507-d91e-4f8e-8f0d-0137bd740825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-plugged", "status": "completed", "tag": "6e67bb33-ef7e-44f8-b657-358f6fcace76"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:04.020488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-974919a4-8067-447e-8188-721ef83e1270 req-4617e507-d91e-4f8e-8f0d-0137bd740825 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:04.020970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-974919a4-8067-447e-8188-721ef83e1270 req-4617e507-d91e-4f8e-8f0d-0137bd740825 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:04.021629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-974919a4-8067-447e-8188-721ef83e1270 req-4617e507-d91e-4f8e-8f0d-0137bd740825 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:04.035370 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-974919a4-8067-447e-8188-721ef83e1270 req-4617e507-d91e-4f8e-8f0d-0137bd740825 service nova] Creating event network-vif-plugged:6e67bb33-ef7e-44f8-b657-358f6fcace76 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:41:04.041552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-974919a4-8067-447e-8188-721ef83e1270 req-4617e507-d91e-4f8e-8f0d-0137bd740825 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039590 Nov 02 13:41:04.042694 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2917/5446] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:04.188470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:04.189205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:04.195246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:04.195738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:04.196179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:04.196884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:04.197340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:04.197770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:04.337519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:04.345374 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-034b5911-1927-4d6e-aa3b-5a4d2cfb4ca7 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.161419 Nov 02 13:41:04.345953 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2530/5447] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:04 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:04.882274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:04.882977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:04.890340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:04.891531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:04.891970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:04.892863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:04.893315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:04.893739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:04.966586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:04.976440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:04.977919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:04.979149 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ce875aa-2d39-4887-b0a0-78e7a3657d16 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.101194 Nov 02 13:41:04.980214 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2918/5448] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:04 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:05.015001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:05.017189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:05.025461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:05.026235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:05.026680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:05.027461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:05.028078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:05.028526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:05.206506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:05.225603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:05.227790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:05.237189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:05.238923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:05.240117 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e8445fe4-a802-41ff-a788-431831742618 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.229490 Nov 02 13:41:05.240694 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2531/5449] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:05 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:05.369779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:05.370391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:05.377733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:05.378151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:05.378589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:05.379337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:05.379910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:05.380345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:05.397097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:05.535063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:05.544659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7de003c0-f305-4d1e-9136-4a645408a2ad tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.178715 Nov 02 13:41:05.545713 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2919/5450] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:05 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:06.006701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:06.007907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:06.016571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.019389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.020497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.021731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.022524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.023341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.078951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6b7f7c76-9009-4749-93a0-312867060be0 req-0418c977-82e2-47b2-b401-821417f7e47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-plugged", "status": "completed", "tag": "73d16813-eb06-4ed3-a474-c5a0a0fc8989"}, {"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-plugged", "status": "completed", "tag": "fdd3b4be-ad92-43da-ad44-b7b675e78b9d"}, {"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-plugged", "status": "completed", "tag": "a1701be5-ce69-4eb1-b195-3b9262f740d0"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:06.090512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6b7f7c76-9009-4749-93a0-312867060be0 req-0418c977-82e2-47b2-b401-821417f7e47a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.091158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6b7f7c76-9009-4749-93a0-312867060be0 req-0418c977-82e2-47b2-b401-821417f7e47a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.092873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6b7f7c76-9009-4749-93a0-312867060be0 req-0418c977-82e2-47b2-b401-821417f7e47a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.106442 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6b7f7c76-9009-4749-93a0-312867060be0 req-0418c977-82e2-47b2-b401-821417f7e47a service nova] Creating event network-vif-plugged:73d16813-eb06-4ed3-a474-c5a0a0fc8989 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:41:06.107194 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6b7f7c76-9009-4749-93a0-312867060be0 req-0418c977-82e2-47b2-b401-821417f7e47a service nova] Creating event network-vif-plugged:fdd3b4be-ad92-43da-ad44-b7b675e78b9d for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:41:06.107884 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6b7f7c76-9009-4749-93a0-312867060be0 req-0418c977-82e2-47b2-b401-821417f7e47a service nova] Creating event network-vif-plugged:a1701be5-ce69-4eb1-b195-3b9262f740d0 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:41:06.111532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:06.114752 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6b7f7c76-9009-4749-93a0-312867060be0 req-0418c977-82e2-47b2-b401-821417f7e47a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043429 Nov 02 13:41:06.115726 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2920/5451] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:06.123201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:06.125461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:06.126573 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-adde2c44-b201-424f-924a-8be40e886d67 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.124539 Nov 02 13:41:06.127177 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2532/5452] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:06 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:06.268550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:06.269259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:06.275718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.276205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.276650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.277354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.277812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.278242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.475519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:06.485348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:06.486769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:06.488250 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-66b3faf4-16a7-4b81-a538-de5e80c90381 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.224771 Nov 02 13:41:06.488821 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2921/5453] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:06 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:06.572750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:06.573454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:06.580721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.581202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.581655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.582339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:06.582794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:06.583371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:06.725365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:06.734150 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f52fb0ed-3fc6-4a98-a6d4-6e178fe441a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.165322 Nov 02 13:41:06.735353 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2533/5454] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:06 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:07.152498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.153054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:07.160163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.160653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.161101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.161813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.162275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.162711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.180418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:07.236393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:07.245542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:07.254047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:07.254047 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-809db407-5211-4417-bd54-c95f9d0d795f tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.105006 Nov 02 13:41:07.254047 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2922/5455] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:07.516050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.516664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:07.523483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.523962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.524395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.525213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.525670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.526095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.722181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:07.731656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:07.733149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:07.734777 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3b8d811-91e3-436d-906e-5be6111dc19e tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1884 microversion: 2.42 time: 0.222794 Nov 02 13:41:07.735333 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2534/5456] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1884 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:07.758950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:07.759694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:07.767471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.767969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.768451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.769171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:07.769668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:07.770106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:07.941983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:07.951823 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfaff9f0-235c-44d8-b180-58a67ebb87ab tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.196753 Nov 02 13:41:07.952445 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2923/5457] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:07 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:08.134235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1d8be3df-a3cc-4f0f-8d69-c888899b9427 req-2329961d-95be-45ac-853b-f601a1f0bfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24929ae5-b7e1-4ccc-b7aa-9229fa92c614", "name": "network-vif-plugged", "status": "completed", "tag": "121a1ff1-f3f1-46f8-a4a0-f3c0cb6c625c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:08.144970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1d8be3df-a3cc-4f0f-8d69-c888899b9427 req-2329961d-95be-45ac-853b-f601a1f0bfc5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:08.145543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1d8be3df-a3cc-4f0f-8d69-c888899b9427 req-2329961d-95be-45ac-853b-f601a1f0bfc5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:08.146080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1d8be3df-a3cc-4f0f-8d69-c888899b9427 req-2329961d-95be-45ac-853b-f601a1f0bfc5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:08.158514 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1d8be3df-a3cc-4f0f-8d69-c888899b9427 req-2329961d-95be-45ac-853b-f601a1f0bfc5 service nova] Creating event network-vif-plugged:121a1ff1-f3f1-46f8-a4a0-f3c0cb6c625c for instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 on n-h2-858384-19 Nov 02 13:41:08.164263 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1d8be3df-a3cc-4f0f-8d69-c888899b9427 req-2329961d-95be-45ac-853b-f601a1f0bfc5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033837 Nov 02 13:41:08.165507 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2535/5458] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:08.279952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:08.280718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:08.291263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:08.291760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:08.292206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:08.292921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:08.293379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:08.293807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:08.364305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:08.372902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:08.374401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:08.376361 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed030847-5808-42c5-8002-17e398f79433 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.100443 Nov 02 13:41:08.376943 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2924/5459] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:08 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:08.763282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:08.764203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:08.766890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:08.772540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:08.773023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:08.773460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:08.774161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:08.774614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:08.775039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:08.978299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:08.978808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:08.985192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:08.985426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:08.985919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:08.986361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:08.987152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:08.988047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:08.988648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:08.995268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:08.996859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:08.998195 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b3b32b4-5e6b-4528-9170-959d200608dd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 2841 microversion: 2.42 time: 0.241033 Nov 02 13:41:08.998984 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2536/5460] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:08 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 2841 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:09.027056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c661ef99-8a22-43ac-afad-8285c6172600 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:09.027588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c661ef99-8a22-43ac-afad-8285c6172600 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:09.035344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c661ef99-8a22-43ac-afad-8285c6172600 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:09.036198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c661ef99-8a22-43ac-afad-8285c6172600 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:09.036777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c661ef99-8a22-43ac-afad-8285c6172600 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:09.038033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c661ef99-8a22-43ac-afad-8285c6172600 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:09.038842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c661ef99-8a22-43ac-afad-8285c6172600 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:09.039425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c661ef99-8a22-43ac-afad-8285c6172600 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:09.129820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:09.137839 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9680facd-c85a-4961-a319-960c5a27aed0 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1367 microversion: 2.1 time: 0.165455 Nov 02 13:41:09.138418 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2925/5461] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:08 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:09.178364 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c661ef99-8a22-43ac-afad-8285c6172600 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.155102 Nov 02 13:41:09.183146 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2537/5462] 10.222.0.113 () {60 vars in 1321 bytes} [Wed Nov 2 13:41:09 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3/os-interface => generated 1831 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:09.403260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:09.403899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:09.412040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:09.412532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:09.412975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:09.413711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:09.414368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:09.414811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:09.491627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:09.501058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:09.502536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:09.503752 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ecd793a-3748-445c-8b79-b7bd0dc6eff7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.104560 Nov 02 13:41:09.504919 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2926/5463] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:09 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:10.162092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:10.163799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:10.170703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:10.171532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:10.172124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:10.172850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:10.173507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:10.173948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:10.465199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:10.478478 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-14925b3e-2901-45be-b4f8-f4a4882c3902 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1552 microversion: 2.1 time: 0.320593 Nov 02 13:41:10.479088 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2538/5464] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:10 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1552 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:10.505572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0bdec8bd-1c2e-45b9-b3e8-781793b35666 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:10.506138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0bdec8bd-1c2e-45b9-b3e8-781793b35666 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:10.516280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bdec8bd-1c2e-45b9-b3e8-781793b35666 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:10.516779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bdec8bd-1c2e-45b9-b3e8-781793b35666 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:10.517226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bdec8bd-1c2e-45b9-b3e8-781793b35666 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:10.517946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bdec8bd-1c2e-45b9-b3e8-781793b35666 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:10.518432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bdec8bd-1c2e-45b9-b3e8-781793b35666 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:10.518819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bdec8bd-1c2e-45b9-b3e8-781793b35666 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:10.530087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:10.531065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:10.542363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:10.543238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:10.543903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:10.547654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:10.548465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:10.549086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:10.642421 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0bdec8bd-1c2e-45b9-b3e8-781793b35666 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142624 Nov 02 13:41:10.643023 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2927/5465] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:41:10 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:10.672416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:10.681648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:10.684450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:10.686145 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38e87466-e453-424c-af9f-571ef7b8f65d tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.160203 Nov 02 13:41:10.687623 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2539/5466] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:10 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:10.749190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-db47a97f-b253-4608-aaf0-787e30fc3bfa req-1c0f2e50-4b3d-4066-b4fc-8f5cd73f8dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "tag": "6e67bb33-ef7e-44f8-b657-358f6fcace76"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:10.766728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-db47a97f-b253-4608-aaf0-787e30fc3bfa req-1c0f2e50-4b3d-4066-b4fc-8f5cd73f8dd0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:10.767564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-db47a97f-b253-4608-aaf0-787e30fc3bfa req-1c0f2e50-4b3d-4066-b4fc-8f5cd73f8dd0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:10.768198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-db47a97f-b253-4608-aaf0-787e30fc3bfa req-1c0f2e50-4b3d-4066-b4fc-8f5cd73f8dd0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:10.783564 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-db47a97f-b253-4608-aaf0-787e30fc3bfa req-1c0f2e50-4b3d-4066-b4fc-8f5cd73f8dd0 service nova] Creating event network-changed:6e67bb33-ef7e-44f8-b657-358f6fcace76 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:41:10.790922 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-db47a97f-b253-4608-aaf0-787e30fc3bfa req-1c0f2e50-4b3d-4066-b4fc-8f5cd73f8dd0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044899 Nov 02 13:41:10.791998 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2928/5467] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:11.715207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:11.716549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:11.724537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:11.724537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:11.725119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:11.725912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:11.726586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:11.727162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:11.800817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:11.808986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:11.810467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:11.811667 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f731374c-9259-442b-a643-d69bfecedb53 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.100429 Nov 02 13:41:11.812379 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2540/5468] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:11 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:11.912932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-31ba85ec-70c6-4f3c-b762-169636e30a05 req-5850ba8c-fe7d-4c33-aaa0-db70c00d325e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24929ae5-b7e1-4ccc-b7aa-9229fa92c614", "tag": "121a1ff1-f3f1-46f8-a4a0-f3c0cb6c625c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:11.927155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-31ba85ec-70c6-4f3c-b762-169636e30a05 req-5850ba8c-fe7d-4c33-aaa0-db70c00d325e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:11.928024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-31ba85ec-70c6-4f3c-b762-169636e30a05 req-5850ba8c-fe7d-4c33-aaa0-db70c00d325e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:11.928563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-31ba85ec-70c6-4f3c-b762-169636e30a05 req-5850ba8c-fe7d-4c33-aaa0-db70c00d325e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:11.942211 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-31ba85ec-70c6-4f3c-b762-169636e30a05 req-5850ba8c-fe7d-4c33-aaa0-db70c00d325e service nova] Creating event network-changed:121a1ff1-f3f1-46f8-a4a0-f3c0cb6c625c for instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 on n-h2-858384-19 Nov 02 13:41:11.948549 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-31ba85ec-70c6-4f3c-b762-169636e30a05 req-5850ba8c-fe7d-4c33-aaa0-db70c00d325e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039969 Nov 02 13:41:11.949516 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2929/5469] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:12.838476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:12.839094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:12.846783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:12.847306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:12.847746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:12.848460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:12.848914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:12.849344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:12.924101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:12.933123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:12.934676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:12.936104 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bf4a4c66-c4f3-418d-831b-321d8f2bcf5c tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.101959 Nov 02 13:41:12.936675 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2541/5470] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:12 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:13.369849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:13.375355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:13.376108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Searching by: {'deleted': False, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:41:13.382453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:13.382927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:13.383394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:13.384114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:13.384562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:13.384984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:13.408819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:41:13.435747 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e51b4b6-c44c-4021-9f28-5e97837d9a63 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.070117 Nov 02 13:41:13.436334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2930/5471] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 13:41:13 2022] GET /compute/v2.1/servers => generated 341 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:13.449487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:13.454433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:13.455334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Searching by: {'deleted': False, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:41:13.460685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:13.461259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:13.461768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:13.462918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:13.463424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:13.463857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:13.478173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:13.492807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:41:13.528496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:13.534570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:13.535059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:13.535528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:13.647432 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c673e414-e8e9-469b-b22a-e48f1a15fb58 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/detail" status: 200 len: 1715 microversion: 2.1 time: 0.201727 Nov 02 13:41:13.648178 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2542/5472] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:41:13 2022] GET /compute/v2.1/servers/detail => generated 1715 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:13.672335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc3c9bc4-b7e1-4973-b5f0-20e5b932d256 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:13.679837 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc3c9bc4-b7e1-4973-b5f0-20e5b932d256 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.012316 Nov 02 13:41:13.680373 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2931/5473] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:41:13 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:13.964438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:13.965037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:13.973969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:13.974268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:13.974689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:13.975524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:13.976031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:13.976466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:14.048219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:14.056919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:14.058419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:14.059635 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e4abcb1-4652-4314-93da-6de21d1bab65 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.100206 Nov 02 13:41:14.060203 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2543/5474] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:13 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:14.157674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:14.158258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:14.164800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:14.165291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:14.165732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:14.166456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:14.166895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:14.167404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:14.202674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:41:14.298829 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6a8fc32e-b311-4bd3-ba06-db67d92b41b9 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "DELETE /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 204 len: 0 microversion: 2.1 time: 0.144930 Nov 02 13:41:14.299482 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2932/5475] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:41:14 2022] DELETE /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:41:14.308161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:14.309064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:14.317960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:14.318460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:14.318906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:14.319861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:14.320327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:14.320764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:14.470754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:14.481401 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2a6eb43f-49bf-4446-b747-9cb38cc17930 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1718 microversion: 2.1 time: 0.177425 Nov 02 13:41:14.482344 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2544/5476] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:14 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1718 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:15.091996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:15.092710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:15.101376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:15.101868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:15.102312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:15.103029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:15.103519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:15.103955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:15.174481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:15.182869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:15.184409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:15.185571 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f340b0b-4730-4fa0-8f16-2e36f1059ba7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.098065 Nov 02 13:41:15.186139 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2933/5477] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:15 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:15.506548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:15.507136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:15.514089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:15.514581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:15.515177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:15.515872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:15.516334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:15.516759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:15.656524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:15.664628 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-752f0035-f207-428e-b821-e04313cbc0f2 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1718 microversion: 2.1 time: 0.162308 Nov 02 13:41:15.665220 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2545/5478] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:15 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:16.212106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:16.212799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:16.219949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.220517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.221048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.221828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.222346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.222841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.291927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:16.302501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:16.304046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:16.305230 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c8d4d8c-d78b-4758-8849-c32481b466f5 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.097100 Nov 02 13:41:16.305804 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2934/5479] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:16 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:16.690634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:16.691312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:16.698816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.699342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.699784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.700487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:16.700942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:16.701367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:16.928282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cc6ad8e3d8742099eb404a447c75015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fc76e90ca4f64afd5dc4379dde865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:16.936166 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0ce065dd-137e-4de8-995c-50a5c549378f tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 200 len: 1718 microversion: 2.1 time: 0.250132 Nov 02 13:41:16.936945 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2546/5480] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:16 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 1718 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:17.161798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-585b79df-430f-4853-9ab5-33d6fa96e260 req-8d1eed34-9d54-4871-9ec4-c7546ce260aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8321a514-447c-4c22-8c24-a7ca091d25ef", "name": "network-vif-deleted", "tag": "80daf188-fd85-4ed2-8834-4e74ffa34dcb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:17.172389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-585b79df-430f-4853-9ab5-33d6fa96e260 req-8d1eed34-9d54-4871-9ec4-c7546ce260aa service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.172878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-585b79df-430f-4853-9ab5-33d6fa96e260 req-8d1eed34-9d54-4871-9ec4-c7546ce260aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.173309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-585b79df-430f-4853-9ab5-33d6fa96e260 req-8d1eed34-9d54-4871-9ec4-c7546ce260aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.185397 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-585b79df-430f-4853-9ab5-33d6fa96e260 req-8d1eed34-9d54-4871-9ec4-c7546ce260aa service nova] Creating event network-vif-deleted:80daf188-fd85-4ed2-8834-4e74ffa34dcb for instance 8321a514-447c-4c22-8c24-a7ca091d25ef on n-h2-858384-19 Nov 02 13:41:17.191420 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-585b79df-430f-4853-9ab5-33d6fa96e260 req-8d1eed34-9d54-4871-9ec4-c7546ce260aa service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033220 Nov 02 13:41:17.195361 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2935/5481] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:17.334347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:17.334982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:17.357041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.360340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.361189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.362482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.363370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.363991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.470107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:17.488648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:17.490302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:17.492207 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-454d2462-16f1-4fe6-9044-9ccd46d76aca tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1368 microversion: 2.57 time: 0.162892 Nov 02 13:41:17.492697 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2547/5482] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:17 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:17.961932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:17.962529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] [instance: 8321a514-447c-4c22-8c24-a7ca091d25ef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:17.969961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.970465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.970915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.971657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:17.972119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:17.972547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:17.987454 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] HTTP exception thrown: Instance 8321a514-447c-4c22-8c24-a7ca091d25ef could not be found. Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Request method failure captured: Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef HTTP/1.1 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnMBsO2txnN2T-DW9amCfp0ufR6hLbhQweS15wrBtNbbSar5zCfBNyJWVdhhSPGEo8Z7tdLgLhwHljk7hBOi4EzmJ2U7XhEcQZ0w7_CVdRzbsc7PEG42RbgifmhkHMuDXcZkiotuLuUZqEpfTeQhT_rcFZ2tIbqcL_0cyz0zNcFBnIU Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: fa2fc76e90ca4f64afd5dc4379dde865 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestManualDisk-506452630 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fa2fc76e90ca4f64afd5dc4379dde865"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fa2fc76e90ca4f64afd5dc4379dde865"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_fa2fc76e90ca4f64afd5dc4379dde865"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/fa2fc76e90ca4f64afd5dc4379dde865"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestManualDisk-506452630 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: fa2fc76e90ca4f64afd5dc4379dde865 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestManualDisk-506452630 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestManualDisk-506452630-project Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 4cc6ad8e3d8742099eb404a447c75015 Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestManualDisk-506452630-project Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 8321a514-447c-4c22-8c24-a7ca091d25ef could not be found. Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '8321a514-447c-4c22-8c24-a7ca091d25ef'} Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8321a514-447c-4c22-8c24-a7ca091d25ef could not be found. Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8321a514-447c-4c22-8c24-a7ca091d25ef could not be found. Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:17.989127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8321a514-447c-4c22-8c24-a7ca091d25ef could not be found. Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Returning 404 to user: Instance 8321a514-447c-4c22-8c24-a7ca091d25ef could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71897db3-d06b-436f-b017-172df4989692 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef" status: 404 len: 111 microversion: 2.1 time: 0.034111 Nov 02 13:41:17.995033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2936/5483] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:17 2022] GET /compute/v2.1/servers/8321a514-447c-4c22-8c24-a7ca091d25ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:41:18.004639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0e171c3e-2558-47d1-b2fc-6ba418b938b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] Calling method '.version_select at 0x7fe78f95a4c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:18.027135 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0e171c3e-2558-47d1-b2fc-6ba418b938b0 tempest-ServersTestManualDisk-506452630 tempest-ServersTestManualDisk-506452630-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755565027" status: 202 len: 0 microversion: 2.1 time: 0.027479 Nov 02 13:41:18.031745 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2548/5484] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:41:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1755565027 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:18.519142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:18.519870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:18.527531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:18.531152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:18.531888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:18.540848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:18.541531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:18.542135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:18.647100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:18.666939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:18.668608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:18.675102 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-574ad9f9-3b8f-422b-8bf0-1d78124cc6fd tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1374 microversion: 2.57 time: 0.160119 Nov 02 13:41:18.678956 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2937/5485] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:18 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:19.706077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:19.706844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:19.721184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:19.721703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:19.722259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:19.723072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:19.723874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:19.724321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:19.815176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:19.828602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:19.831143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:19.832791 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-895f0525-f0ed-40fd-884a-877396e551fc tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1374 microversion: 2.57 time: 0.133149 Nov 02 13:41:19.834149 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2549/5486] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:19 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1374 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:20.866194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:20.867530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:20.877637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:20.879951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:20.880662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:20.882734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:20.883440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:20.884070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:20.992640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:21.005180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:21.007163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:21.008657 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3ee3d03-55ee-49bd-9877-b4fea64d2f8e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1374 microversion: 2.57 time: 0.148218 Nov 02 13:41:21.009845 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2938/5487] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:20 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1374 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:22.043801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:22.044471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:22.052937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:22.053688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:22.054503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:22.055455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:22.056325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:22.057863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:22.190892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:22.205822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:22.207463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:22.213872 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a1e0a84-55f7-469e-a0d4-fcefb4bb3fc7 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1374 microversion: 2.57 time: 0.172770 Nov 02 13:41:22.218281 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2550/5488] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:22 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:23.244500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:23.245121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:23.254758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.255511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.256054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.257163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.257733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.258301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.327969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:23.337418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:23.338856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:23.340064 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-639e7672-e363-49a2-a104-2ed447fab3a1 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1359 microversion: 2.57 time: 0.099656 Nov 02 13:41:23.340632 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2939/5489] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:23 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1359 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:41:23.376940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:23.378169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:23.386162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.387459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.388127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.390968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.391615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.392165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.459554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:41:23.477159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:23.525301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:23.570477 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74eb53a5-e171-4833-862d-ca5a57d2c37a tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 204 len: 0 microversion: 2.57 time: 0.199311 Nov 02 13:41:23.571416 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2551/5490] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:41:23 2022] DELETE /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:41:23.581076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:23.581846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:23.584012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:23.590999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.591916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.592494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.593990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:23.594611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:23.595172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:23.696772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:23.708342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:23.709847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:23.711035 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cad3e674-f2c4-49d9-af86-a8ad65f86b1b tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1365 microversion: 2.57 time: 0.135136 Nov 02 13:41:23.727256 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2940/5491] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:23 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:24.739799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:24.741249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:24.752583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:24.754620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:24.759039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:24.760040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:24.760658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:24.761195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:24.862644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:24.876196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:24.877659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:24.879319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1efcf323-e9ee-49c2-8c2b-5d6772a5202e tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1365 microversion: 2.57 time: 0.144357 Nov 02 13:41:24.880523 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2552/5492] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:24 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:25.907962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:25.908575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:25.915542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:25.916259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:25.916865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:25.917736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:25.918361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:25.918954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:25.957672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:25.972303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:25.973050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:25.973736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:25.974355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lazy-loading 'fault' on Instance uuid ae90d7c2-c725-4994-ad48-91d080023cb5 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:41:26.092134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:26.101764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:26.107461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f2abe353ef440f6931b3669f80d38fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e17910233c46e79e9f2b4751f27d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:26.109291 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7baee5c1-5572-4671-9377-e982a354b714 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 200 len: 1370 microversion: 2.57 time: 0.205109 Nov 02 13:41:26.109905 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2941/5493] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:25 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:41:27.146424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:27.148378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] [instance: ae90d7c2-c725-4994-ad48-91d080023cb5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:27.161738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:27.162251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:27.163653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:27.164410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:27.164879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:27.165314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:27.185144 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] HTTP exception thrown: Instance ae90d7c2-c725-4994-ad48-91d080023cb5 could not be found. Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Request method failure captured: Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 HTTP/1.1 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnNXotm0ZM5eP6E5Okx11MvRxA92ER1xh0oywY7t53FZXRwe-O_TO8FK3IOCX0Ytme_YuRu68ExFHzdCN3m3b1wOSE9-IG35aSO-5PudNiQqRVuubSdOEkj_DmwitYw_Z9k4jSMrQEOCIkzv-itr4E9A7R3HSDxekED5DKbK69cSajI Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.57 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b3e17910233c46e79e9f2b4751f27d92 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerShowV257Test-463823761 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b3e17910233c46e79e9f2b4751f27d92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b3e17910233c46e79e9f2b4751f27d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b3e17910233c46e79e9f2b4751f27d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b3e17910233c46e79e9f2b4751f27d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerShowV257Test-463823761 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b3e17910233c46e79e9f2b4751f27d92 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerShowV257Test-463823761 Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerShowV257Test-463823761-project Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0f2abe353ef440f6931b3669f80d38fb Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerShowV257Test-463823761-project Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance ae90d7c2-c725-4994-ad48-91d080023cb5 could not be found. Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'ae90d7c2-c725-4994-ad48-91d080023cb5'} Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae90d7c2-c725-4994-ad48-91d080023cb5 could not be found. Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae90d7c2-c725-4994-ad48-91d080023cb5 could not be found. Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:27.194463 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.200847 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:27.200847 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:27.200847 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:27.200847 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:27.200847 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:27.200847 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae90d7c2-c725-4994-ad48-91d080023cb5 could not be found. Nov 02 13:41:27.200847 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:27.204742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] Returning 404 to user: Instance ae90d7c2-c725-4994-ad48-91d080023cb5 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:27.205865 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-423f4b01-eb09-4642-b15b-80226951c529 tempest-ServerShowV257Test-463823761 tempest-ServerShowV257Test-463823761-project] 10.222.0.113 "GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5" status: 404 len: 111 microversion: 2.57 time: 0.066953 Nov 02 13:41:27.207396 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2553/5494] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:41:27 2022] GET /compute/v2.1/servers/ae90d7c2-c725-4994-ad48-91d080023cb5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:41:30.577012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-722191052", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "94b733c9-8e75-4ffa-bceb-cac2d6466281"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:30.600085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:30.678402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] validate_networks() for [('94b733c9-8e75-4ffa-bceb-cac2d6466281', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:41:31.426221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:41:31.426737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:41:31.427347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:41:31.428151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:41:31.428654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:41:31.448508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:31.449451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:31.451541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:31.453645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:31.454327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:31.455206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:31.480905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Getting quotas for project 1ef94a0eaad84511aa75b1dcff04a430. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:41:31.493087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Getting quotas for user 64268f4882e741ef884abb5e5450b3d6 and project 1ef94a0eaad84511aa75b1dcff04a430. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:41:31.512976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:41:31.514015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:41:31.588934 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.428189 Nov 02 13:41:31.590034 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2942/5495] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:41:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:41:31.602541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d4757520-d045-4070-8888-93911614ca56 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:31.603324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d4757520-d045-4070-8888-93911614ca56 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:31.725621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d4757520-d045-4070-8888-93911614ca56 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:31.733173 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d4757520-d045-4070-8888-93911614ca56 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1220 microversion: 2.1 time: 0.134814 Nov 02 13:41:31.737678 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2554/5496] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:31 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:32.761421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:32.763299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:32.774754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:32.776220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:32.777088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:32.778043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:32.778674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:32.787849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:32.866119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:32.876946 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a216f3e4-6d85-48c9-b7a9-5cef4b05d693 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1272 microversion: 2.1 time: 0.121430 Nov 02 13:41:32.880011 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2943/5497] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:32 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:33.903241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:33.904776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:33.932077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:33.932818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:33.934851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:33.938838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:33.939366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:33.939814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:34.142281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:34.151918 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c5cb691c-dd52-44ca-b3e9-04cba06dd2e5 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1278 microversion: 2.1 time: 0.254108 Nov 02 13:41:34.161273 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2555/5498] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:33 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:35.182725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:35.183384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:35.191496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:35.192239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:35.192756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:35.193605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:35.194291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:35.194937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:35.377544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:35.387892 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca406e1c-716e-47be-b208-7497b94f2236 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1320 microversion: 2.1 time: 0.207557 Nov 02 13:41:35.387892 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2944/5499] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:35 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:35.992472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-93ff0115-ea6f-4e80-a150-acaf74f4b548 req-94a60ab7-07fc-48b1-a353-afe5bb9dc089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7af80dd-f817-4f3e-8e7c-d91ffb154e3c", "tag": "22d63743-136b-4975-9731-8710b5198450"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:36.007491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93ff0115-ea6f-4e80-a150-acaf74f4b548 req-94a60ab7-07fc-48b1-a353-afe5bb9dc089 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.008071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93ff0115-ea6f-4e80-a150-acaf74f4b548 req-94a60ab7-07fc-48b1-a353-afe5bb9dc089 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.011505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93ff0115-ea6f-4e80-a150-acaf74f4b548 req-94a60ab7-07fc-48b1-a353-afe5bb9dc089 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.031810 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-93ff0115-ea6f-4e80-a150-acaf74f4b548 req-94a60ab7-07fc-48b1-a353-afe5bb9dc089 service nova] Creating event network-changed:22d63743-136b-4975-9731-8710b5198450 for instance f7af80dd-f817-4f3e-8e7c-d91ffb154e3c on n-h1-858384-19 Nov 02 13:41:36.038967 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-93ff0115-ea6f-4e80-a150-acaf74f4b548 req-94a60ab7-07fc-48b1-a353-afe5bb9dc089 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050105 Nov 02 13:41:36.040305 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2556/5500] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:36.418362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:36.420134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:36.434946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.436058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.437275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.438629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:36.439672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:36.440672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:36.688001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:36.698000 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2550d343-0d32-4fc8-aae3-e48412a5595c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1320 microversion: 2.1 time: 0.292446 Nov 02 13:41:36.699981 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2945/5501] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:36 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1320 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:37.730876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:37.734675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:37.755136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.755860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.756492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.757410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:37.758030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:37.759193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:37.922132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:37.934411 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f7f65f16-2a7e-458c-9c76-568d62441b11 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1320 microversion: 2.1 time: 0.214522 Nov 02 13:41:37.935077 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2557/5502] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:37 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:38.962020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:38.963572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:38.975086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.976154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.976794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:38.977810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:38.978606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:38.979270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:39.161386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:39.174155 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d83f7e38-601d-4fa3-9d22-e2b51ec14086 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1320 microversion: 2.1 time: 0.217121 Nov 02 13:41:39.175256 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2946/5503] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:38 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:40.223677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:40.228820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:40.241246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:40.246436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.247026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.247873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.248667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:40.249305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:40.249909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:40.406864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:40.414930 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-01d29a3e-e08d-47ed-b7b8-d03986f34ffe tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1320 microversion: 2.1 time: 0.215759 Nov 02 13:41:40.422046 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2558/5504] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:40 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:41.439932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:41.440538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:41.448043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.449239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.449791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.450962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:41.451706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:41.452927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:41.472692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:41.504704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:41.613890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:41.621901 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b8a59610-1d04-4f3a-9da2-aeee93c5e5ac tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1320 microversion: 2.1 time: 0.186786 Nov 02 13:41:41.622666 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2947/5505] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:41 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:42.415389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-45f9cf78-deba-4692-b55c-cff31a07a359 req-53ccd502-a696-4200-abed-48b3635d3e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7af80dd-f817-4f3e-8e7c-d91ffb154e3c", "name": "network-vif-plugged", "status": "completed", "tag": "22d63743-136b-4975-9731-8710b5198450"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:42.423698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:42.431010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-45f9cf78-deba-4692-b55c-cff31a07a359 req-53ccd502-a696-4200-abed-48b3635d3e07 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:42.432518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-45f9cf78-deba-4692-b55c-cff31a07a359 req-53ccd502-a696-4200-abed-48b3635d3e07 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:42.433911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-45f9cf78-deba-4692-b55c-cff31a07a359 req-53ccd502-a696-4200-abed-48b3635d3e07 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:42.453594 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-45f9cf78-deba-4692-b55c-cff31a07a359 req-53ccd502-a696-4200-abed-48b3635d3e07 service nova] Creating event network-vif-plugged:22d63743-136b-4975-9731-8710b5198450 for instance f7af80dd-f817-4f3e-8e7c-d91ffb154e3c on n-h1-858384-19 Nov 02 13:41:42.460120 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-45f9cf78-deba-4692-b55c-cff31a07a359 req-53ccd502-a696-4200-abed-48b3635d3e07 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048294 Nov 02 13:41:42.461256 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2559/5506] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:42.650078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:42.651809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:42.662991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:42.663511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:42.664071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:42.664838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:42.665292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:42.665884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:42.827251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:42.836325 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9cb368a9-afde-424f-8ce5-9caac33e0542 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1320 microversion: 2.1 time: 0.193485 Nov 02 13:41:42.837013 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2948/5507] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:42 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:43.866048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:43.868148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:43.877363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.877924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.878369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.879282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:43.881831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:43.883034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:43.891149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:41:44.086001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:44.096635 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6fa3fc9-3da8-4ded-9207-2ba8daa43038 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1320 microversion: 2.1 time: 0.236429 Nov 02 13:41:44.100864 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2560/5508] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:43 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1320 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:45.128457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:45.129668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:45.137094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.137851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.138546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.140052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.140716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.141348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.290826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:45.300021 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7484bce1-d3f5-46c3-9917-6036c867bf58 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1510 microversion: 2.1 time: 0.176488 Nov 02 13:41:45.300614 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2949/5509] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:45 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:45.327524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:45.328914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:45.336843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.337529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.338123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.339027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.339686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.344120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.385434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:45.386431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bff25c0e-716e-4a0a-9753-d6bbbed1e3a3 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c/os-instance-actions/req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff" status: 200 len: 313 microversion: 2.1 time: 0.065079 Nov 02 13:41:45.387028 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2561/5510] 10.222.0.113 () {58 vars in 1424 bytes} [Wed Nov 2 13:41:45 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c/os-instance-actions/req-e60d572e-0fd2-4fea-ac22-f5d60a6c9aff => generated 313 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:45.402603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-52a2a394-582e-408f-87ed-d5b720ed2c46 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:45.405897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-52a2a394-582e-408f-87ed-d5b720ed2c46 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:45.412629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52a2a394-582e-408f-87ed-d5b720ed2c46 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.413361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52a2a394-582e-408f-87ed-d5b720ed2c46 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.413883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52a2a394-582e-408f-87ed-d5b720ed2c46 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.414783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52a2a394-582e-408f-87ed-d5b720ed2c46 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.415562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52a2a394-582e-408f-87ed-d5b720ed2c46 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.416146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52a2a394-582e-408f-87ed-d5b720ed2c46 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.517345 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-52a2a394-582e-408f-87ed-d5b720ed2c46 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "POST /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c/action" status: 202 len: 0 microversion: 2.1 time: 0.118608 Nov 02 13:41:45.519317 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2950/5511] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:41:45 2022] POST /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:41:45.539887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:45.540722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:45.554153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.554911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.555528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.556666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:45.557126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:45.557560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:45.811491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:45.825286 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d6803acf-8391-40eb-8319-9baa76825255 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1512 microversion: 2.1 time: 0.301505 Nov 02 13:41:45.828433 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2562/5512] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:45 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:46.860737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:46.862522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:46.871879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.872505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.872957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.874315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.874917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.875221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.932010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db44477d-90c7-4bba-9026-c66935ade779 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:46.933181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-db44477d-90c7-4bba-9026-c66935ade779 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:46.942278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db44477d-90c7-4bba-9026-c66935ade779 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.943323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db44477d-90c7-4bba-9026-c66935ade779 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.944021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db44477d-90c7-4bba-9026-c66935ade779 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.944985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db44477d-90c7-4bba-9026-c66935ade779 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:46.945518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db44477d-90c7-4bba-9026-c66935ade779 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:46.946015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db44477d-90c7-4bba-9026-c66935ade779 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:46.990660 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-db44477d-90c7-4bba-9026-c66935ade779 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/ips" status: 200 len: 149 microversion: 2.1 time: 0.062771 Nov 02 13:41:46.991460 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2563/5513] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:41:46 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/ips => generated 149 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:47.050207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:47.060528 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35d7a9ba-a91e-4b0b-8eaf-157383eab039 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1517 microversion: 2.1 time: 0.206407 Nov 02 13:41:47.062157 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2951/5514] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:46 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:48.087599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.088625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:48.098269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.099260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.100164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.101326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.102069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.103067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.375505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:48.388753 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ac684f2-8e56-477c-b343-144c9252848a tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1510 microversion: 2.1 time: 0.305667 Nov 02 13:41:48.390101 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2564/5515] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1510 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:48.422133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b7f6a77-aabd-4a90-a23c-77843b26cb4c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '.version_select at 0x7fe78611bdc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.422944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b7f6a77-aabd-4a90-a23c-77843b26cb4c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:48.431155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b7f6a77-aabd-4a90-a23c-77843b26cb4c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.431855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b7f6a77-aabd-4a90-a23c-77843b26cb4c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.432337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b7f6a77-aabd-4a90-a23c-77843b26cb4c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.433691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b7f6a77-aabd-4a90-a23c-77843b26cb4c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.434481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b7f6a77-aabd-4a90-a23c-77843b26cb4c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.435077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b7f6a77-aabd-4a90-a23c-77843b26cb4c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.491649 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b7f6a77-aabd-4a90-a23c-77843b26cb4c tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.074618 Nov 02 13:41:48.492400 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2952/5516] 10.222.0.113 () {58 vars in 1301 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c/os-instance-actions => generated 611 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:41:48.511697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.512334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:48.522290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.522729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.523627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.524919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.525640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.526508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.567872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:41:48.672382 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fad83744-b58c-46bb-9d31-a15bc0e8b3d9 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 204 len: 0 microversion: 2.1 time: 0.169118 Nov 02 13:41:48.676466 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2565/5517] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:41:48 2022] DELETE /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:41:48.687294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:48.687857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:48.709903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.710402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.710843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.711593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:48.712042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:48.714409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:48.925151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:48.940641 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-abff6ff8-17d0-4d0e-8bc5-21c999e53e9d tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1516 microversion: 2.1 time: 0.262826 Nov 02 13:41:48.941771 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2953/5518] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:48 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1516 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:41:49.543348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d7e8f223-48e9-40c4-89d2-ff3f15c0a681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bc87354-5426-4a63-843e-799345e02a70"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:49.547550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d7e8f223-48e9-40c4-89d2-ff3f15c0a681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:49.556985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7e8f223-48e9-40c4-89d2-ff3f15c0a681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:49.557475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7e8f223-48e9-40c4-89d2-ff3f15c0a681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:49.557918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7e8f223-48e9-40c4-89d2-ff3f15c0a681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:49.558634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7e8f223-48e9-40c4-89d2-ff3f15c0a681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:49.559449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7e8f223-48e9-40c4-89d2-ff3f15c0a681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:49.559546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7e8f223-48e9-40c4-89d2-ff3f15c0a681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:49.976872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:49.983639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:49.995085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:49.996554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:49.997566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:50.000100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:50.001123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:50.002189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:50.240599 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d7e8f223-48e9-40c4-89d2-ff3f15c0a681 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703002 Nov 02 13:41:50.241870 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2566/5519] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:41:49 2022] POST /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:50.276288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:50.285825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f596d260-ab81-4bde-944d-2a20b3daaa92 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1516 microversion: 2.1 time: 0.323147 Nov 02 13:41:50.286781 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2954/5520] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:49 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1516 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:51.217955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-284321fe-ed57-4aec-8df7-3b99e1b55ac0 req-5ec52f84-e626-4e6d-bf67-a452a8afe835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7af80dd-f817-4f3e-8e7c-d91ffb154e3c", "name": "network-vif-deleted", "tag": "22d63743-136b-4975-9731-8710b5198450"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:41:51.247992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-284321fe-ed57-4aec-8df7-3b99e1b55ac0 req-5ec52f84-e626-4e6d-bf67-a452a8afe835 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:51.248731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-284321fe-ed57-4aec-8df7-3b99e1b55ac0 req-5ec52f84-e626-4e6d-bf67-a452a8afe835 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:51.249079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-284321fe-ed57-4aec-8df7-3b99e1b55ac0 req-5ec52f84-e626-4e6d-bf67-a452a8afe835 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:51.280373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-284321fe-ed57-4aec-8df7-3b99e1b55ac0 req-5ec52f84-e626-4e6d-bf67-a452a8afe835 service nova] Creating event network-vif-deleted:22d63743-136b-4975-9731-8710b5198450 for instance f7af80dd-f817-4f3e-8e7c-d91ffb154e3c on n-h1-858384-19 Nov 02 13:41:51.286092 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-284321fe-ed57-4aec-8df7-3b99e1b55ac0 req-5ec52f84-e626-4e6d-bf67-a452a8afe835 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074769 Nov 02 13:41:51.287609 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2567/5521] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:41:51.316065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:51.317612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:51.342684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:51.344894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:51.347922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:51.348927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:51.351447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:51.354443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:51.592399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64268f4882e741ef884abb5e5450b3d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef94a0eaad84511aa75b1dcff04a430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:41:51.601923 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0bee615-d3da-427e-bb6a-38bc0aee7bae tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 200 len: 1305 microversion: 2.1 time: 0.295187 Nov 02 13:41:51.602520 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2955/5522] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:51 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 1305 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:41:52.627602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:41:52.629114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] [instance: f7af80dd-f817-4f3e-8e7c-d91ffb154e3c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:41:52.638559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:52.641610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:52.642264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:52.643621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:41:52.644241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:41:52.646042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:41:52.667515 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] HTTP exception thrown: Instance f7af80dd-f817-4f3e-8e7c-d91ffb154e3c could not be found. Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Request method failure captured: Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c HTTP/1.1 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnOJNYpIurUKJPDp3jbMq2gAnve9zifzvDO7M7c4O5P6SbnWRxaxdFtJpL9FW4T6kSHLZLRwFwnjarkhBfTOlTmtSZZ_JeY5n42dObTATCJajGL74IZDmAdx-Hqx0tLj6NTFq0d_qIV3hT7U50w9HNQFrkzkDJdwfaoBwJZewL0NEik Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 1ef94a0eaad84511aa75b1dcff04a430 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-InstanceActionsTestJSON-1724317555 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/1ef94a0eaad84511aa75b1dcff04a430"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/1ef94a0eaad84511aa75b1dcff04a430"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_1ef94a0eaad84511aa75b1dcff04a430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/1ef94a0eaad84511aa75b1dcff04a430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-InstanceActionsTestJSON-1724317555 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 1ef94a0eaad84511aa75b1dcff04a430 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1724317555 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-InstanceActionsTestJSON-1724317555-project Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 64268f4882e741ef884abb5e5450b3d6 Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-InstanceActionsTestJSON-1724317555-project Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f7af80dd-f817-4f3e-8e7c-d91ffb154e3c could not be found. Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f7af80dd-f817-4f3e-8e7c-d91ffb154e3c'} Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7af80dd-f817-4f3e-8e7c-d91ffb154e3c could not be found. Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7af80dd-f817-4f3e-8e7c-d91ffb154e3c could not be found. Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:41:52.671250 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.675699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:41:52.675699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:41:52.675699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:41:52.675699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:41:52.675699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:41:52.675699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7af80dd-f817-4f3e-8e7c-d91ffb154e3c could not be found. Nov 02 13:41:52.675699 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:41:52.677928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] Returning 404 to user: Instance f7af80dd-f817-4f3e-8e7c-d91ffb154e3c could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:41:52.678985 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d53f12f9-977e-4a59-915b-1fc34687bb24 tempest-InstanceActionsTestJSON-1724317555 tempest-InstanceActionsTestJSON-1724317555-project] 10.222.0.113 "GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c" status: 404 len: 111 microversion: 2.1 time: 0.056136 Nov 02 13:41:52.680236 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2568/5523] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:41:52 2022] GET /compute/v2.1/servers/f7af80dd-f817-4f3e-8e7c-d91ffb154e3c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:04.025062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bc87354-5426-4a63-843e-799345e02a70"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:04.028587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:04.037636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:04.039472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:04.053610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:04.061351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:04.062144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:04.063853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:04.067554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:04.068439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:04.288521 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Invalid volume: volume 4bc87354-5426-4a63-843e-799345e02a70 is already attached to instances: 187f7043-8fce-4714-b73c-12336bc51326 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments HTTP/1.1 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 74 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: {"volumeAttachment": {"volumeId": "4bc87354-5426-4a63-843e-799345e02a70"}} Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid volume: volume 4bc87354-5426-4a63-843e-799345e02a70 is already attached to instances: 187f7043-8fce-4714-b73c-12336bc51326 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'server_id': '187f7043-8fce-4714-b73c-12336bc51326', 'body': {'volumeAttachment': {'volumeId': '4bc87354-5426-4a63-843e-799345e02a70'}}} Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in attach_volume Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4971, in _check_volume_already_attached Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4bc87354-5426-4a63-843e-799345e02a70 is already attached to instances: 187f7043-8fce-4714-b73c-12336bc51326 Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:04.291144 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4bc87354-5426-4a63-843e-799345e02a70 is already attached to instances: 187f7043-8fce-4714-b73c-12336bc51326 Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4bc87354-5426-4a63-843e-799345e02a70 is already attached to instances: 187f7043-8fce-4714-b73c-12336bc51326 Nov 02 13:42:04.295592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:04.300543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 400 to user: Invalid volume: volume 4bc87354-5426-4a63-843e-799345e02a70 is already attached to instances: 187f7043-8fce-4714-b73c-12336bc51326 {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:04.301720 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c512dd31-c967-40a1-bc60-bb0c5bafd304 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.281052 Nov 02 13:42:04.302866 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2956/5524] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:42:04 2022] POST /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 174 bytes in 283 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:42:04.421145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:04.423175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:04.437534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:04.449987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:04.451476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:04.455822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:04.486453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:04.492646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:04.493149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:04.499864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:04.502226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:04.502909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:04.503690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:04.504199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:04.504641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:04.505442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:04.506005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:04.506590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:04.703806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lazy-loading 'services' on Instance uuid 187f7043-8fce-4714-b73c-12336bc51326 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:04.879211 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2cd989e3-1535-44ff-bb36-1d3e3710ee86 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments/4bc87354-5426-4a63-843e-799345e02a70" status: 202 len: 0 microversion: 2.1 time: 0.434784 Nov 02 13:42:04.880886 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2957/5525] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:42:04 2022] DELETE /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments/4bc87354-5426-4a63-843e-799345e02a70 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:04.892313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-780dd856-9223-4bea-99b8-a9298168426d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:04.897262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-780dd856-9223-4bea-99b8-a9298168426d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:04.909421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780dd856-9223-4bea-99b8-a9298168426d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:04.910450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780dd856-9223-4bea-99b8-a9298168426d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:04.912602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780dd856-9223-4bea-99b8-a9298168426d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:04.913906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780dd856-9223-4bea-99b8-a9298168426d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:04.914594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780dd856-9223-4bea-99b8-a9298168426d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:04.915578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780dd856-9223-4bea-99b8-a9298168426d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:05.012334 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-780dd856-9223-4bea-99b8-a9298168426d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126057 Nov 02 13:42:05.026245 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2958/5526] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:04 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:05.343921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:05.354638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:05.376621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:05.378932 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d85e8e3-d070-495c-ad0f-611278d062cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 2960 microversion: 2.42 time: 0.966345 Nov 02 13:42:05.379722 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2569/5527] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:42:04 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 2960 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:05.416993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f072be8-ce7f-4aea-a120-0b4457e40ad6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:05.417901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f072be8-ce7f-4aea-a120-0b4457e40ad6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:05.434664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f072be8-ce7f-4aea-a120-0b4457e40ad6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:05.438484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f072be8-ce7f-4aea-a120-0b4457e40ad6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:05.439781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f072be8-ce7f-4aea-a120-0b4457e40ad6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:05.442292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f072be8-ce7f-4aea-a120-0b4457e40ad6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:05.445636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f072be8-ce7f-4aea-a120-0b4457e40ad6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:05.446606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f072be8-ce7f-4aea-a120-0b4457e40ad6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:05.758010 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5f072be8-ce7f-4aea-a120-0b4457e40ad6 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.345593 Nov 02 13:42:05.759791 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2959/5528] 10.222.0.113 () {60 vars in 1321 bytes} [Wed Nov 2 13:42:05 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3/os-interface => generated 1831 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:42:06.033878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dbae5589-fd36-4372-8cac-2d34e9e64df9 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:06.039861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dbae5589-fd36-4372-8cac-2d34e9e64df9 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:06.056508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbae5589-fd36-4372-8cac-2d34e9e64df9 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:06.058700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbae5589-fd36-4372-8cac-2d34e9e64df9 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:06.062827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbae5589-fd36-4372-8cac-2d34e9e64df9 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:06.064226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbae5589-fd36-4372-8cac-2d34e9e64df9 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:06.065296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbae5589-fd36-4372-8cac-2d34e9e64df9 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:06.067846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbae5589-fd36-4372-8cac-2d34e9e64df9 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:06.147031 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dbae5589-fd36-4372-8cac-2d34e9e64df9 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124434 Nov 02 13:42:06.170252 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2570/5529] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:06 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:07.175835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2f0e679-c9ac-46dc-9745-fce1b15a28c3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:07.182308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b2f0e679-c9ac-46dc-9745-fce1b15a28c3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:07.213011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f0e679-c9ac-46dc-9745-fce1b15a28c3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:07.213517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f0e679-c9ac-46dc-9745-fce1b15a28c3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:07.213959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f0e679-c9ac-46dc-9745-fce1b15a28c3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:07.225172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f0e679-c9ac-46dc-9745-fce1b15a28c3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:07.225749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f0e679-c9ac-46dc-9745-fce1b15a28c3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:07.226208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2f0e679-c9ac-46dc-9745-fce1b15a28c3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:07.394632 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2f0e679-c9ac-46dc-9745-fce1b15a28c3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222519 Nov 02 13:42:07.398757 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2960/5530] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:07 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:08.143590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1407158462", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "27400ffc-a220-4173-91de-34834d56048e"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:08.307252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] validate_networks() for [('27400ffc-a220-4173-91de-34834d56048e', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:08.417462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e51919f2-37a0-4a6e-95e9-f10bdb8cf57a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:08.420695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e51919f2-37a0-4a6e-95e9-f10bdb8cf57a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:08.440968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51919f2-37a0-4a6e-95e9-f10bdb8cf57a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:08.444269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51919f2-37a0-4a6e-95e9-f10bdb8cf57a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:08.445107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51919f2-37a0-4a6e-95e9-f10bdb8cf57a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:08.447084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51919f2-37a0-4a6e-95e9-f10bdb8cf57a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:08.449329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51919f2-37a0-4a6e-95e9-f10bdb8cf57a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:08.451953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e51919f2-37a0-4a6e-95e9-f10bdb8cf57a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:08.516475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e51919f2-37a0-4a6e-95e9-f10bdb8cf57a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110738 Nov 02 13:42:08.517947 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2961/5531] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:08 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:09.541849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3f18add2-5781-4967-8506-25578c203dc8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:09.544109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3f18add2-5781-4967-8506-25578c203dc8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:09.569542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:09.570211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:09.570962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:09.571682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:09.572179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:09.591388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f18add2-5781-4967-8506-25578c203dc8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:09.592710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f18add2-5781-4967-8506-25578c203dc8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:09.593808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f18add2-5781-4967-8506-25578c203dc8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:09.597098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f18add2-5781-4967-8506-25578c203dc8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:09.603032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f18add2-5781-4967-8506-25578c203dc8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:09.605302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f18add2-5781-4967-8506-25578c203dc8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:09.608566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:09.614332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:09.616695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:09.617787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:09.619334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:09.628247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:09.677148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Getting quotas for project 7ce2cce2bbf6441a8bd42b9a406afd62. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:09.685579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Getting quotas for user 58c30435df4a4c8192b75edc456a393d and project 7ce2cce2bbf6441a8bd42b9a406afd62. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:09.709595 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3f18add2-5781-4967-8506-25578c203dc8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183757 Nov 02 13:42:09.710658 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2962/5532] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:09 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:09.720481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:09.725333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:09.809870 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fae8dda7-9d87-4cc2-aba7-2a4918af6526 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.958091 Nov 02 13:42:09.812041 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2571/5533] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:42:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:42:09.822972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5d08c32d-76c6-4856-83c2-4615a4c9b0b6 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:09.823707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5d08c32d-76c6-4856-83c2-4615a4c9b0b6 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:09.912878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5d08c32d-76c6-4856-83c2-4615a4c9b0b6 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:09.921588 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5d08c32d-76c6-4856-83c2-4615a4c9b0b6 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1220 microversion: 2.1 time: 0.102546 Nov 02 13:42:09.927024 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2963/5534] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:09 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:10.725148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d2f15fbe-4055-4019-b537-2d146f918627 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:10.728830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d2f15fbe-4055-4019-b537-2d146f918627 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:10.772172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2f15fbe-4055-4019-b537-2d146f918627 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:10.780112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2f15fbe-4055-4019-b537-2d146f918627 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:10.781420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2f15fbe-4055-4019-b537-2d146f918627 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:10.784110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2f15fbe-4055-4019-b537-2d146f918627 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:10.790798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2f15fbe-4055-4019-b537-2d146f918627 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:10.792198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2f15fbe-4055-4019-b537-2d146f918627 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:10.838032 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d2f15fbe-4055-4019-b537-2d146f918627 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118272 Nov 02 13:42:10.839225 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2572/5535] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:10 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:10.945319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:10.946670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:10.964248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:10.964745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:10.965193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:10.965916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:10.966426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:10.966841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:11.065861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:11.077840 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f3a0fcaa-4bd6-486c-b091-bdf3d13f4a0e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1272 microversion: 2.1 time: 0.136306 Nov 02 13:42:11.079219 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2964/5536] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:10 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:11.853128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4df51b89-ecbe-46ad-a226-6f34fae082dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:11.856095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4df51b89-ecbe-46ad-a226-6f34fae082dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:11.883332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4df51b89-ecbe-46ad-a226-6f34fae082dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:11.887839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4df51b89-ecbe-46ad-a226-6f34fae082dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:11.890040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4df51b89-ecbe-46ad-a226-6f34fae082dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:11.894322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4df51b89-ecbe-46ad-a226-6f34fae082dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:11.894819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4df51b89-ecbe-46ad-a226-6f34fae082dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:11.895314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4df51b89-ecbe-46ad-a226-6f34fae082dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:11.990172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4df51b89-ecbe-46ad-a226-6f34fae082dd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141691 Nov 02 13:42:11.995727 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2573/5537] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:11 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:12.104241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:12.104968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:12.121335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:12.123779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:12.126428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:12.127349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:12.128056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:12.130223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:12.275796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:12.296608 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-abdfdcd8-99eb-4bd0-864b-5c9728a350b3 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1278 microversion: 2.1 time: 0.192113 Nov 02 13:42:12.298862 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2965/5538] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:12 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:13.005026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-acc2e585-46a9-4fa6-b1d0-32572efee11b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:13.008079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-acc2e585-46a9-4fa6-b1d0-32572efee11b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:13.036465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acc2e585-46a9-4fa6-b1d0-32572efee11b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.038661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acc2e585-46a9-4fa6-b1d0-32572efee11b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.039328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acc2e585-46a9-4fa6-b1d0-32572efee11b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.042280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acc2e585-46a9-4fa6-b1d0-32572efee11b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.043376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acc2e585-46a9-4fa6-b1d0-32572efee11b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.046413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acc2e585-46a9-4fa6-b1d0-32572efee11b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.114074 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-acc2e585-46a9-4fa6-b1d0-32572efee11b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113580 Nov 02 13:42:13.115329 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2574/5539] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:12 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:13.323605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:13.324802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:13.337585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.339723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.342660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.343669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:13.344247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:13.344791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:13.640505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:13.660025 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-140cbf42-0873-4b16-b890-45883bd4b61e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1320 microversion: 2.1 time: 0.340719 Nov 02 13:42:13.660639 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2966/5540] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:13 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1320 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:14.132557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bd2a5a4b-e650-4fd5-ac3e-12fb11664e99 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:14.146815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bd2a5a4b-e650-4fd5-ac3e-12fb11664e99 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:14.168774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd2a5a4b-e650-4fd5-ac3e-12fb11664e99 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.169775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd2a5a4b-e650-4fd5-ac3e-12fb11664e99 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.170411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd2a5a4b-e650-4fd5-ac3e-12fb11664e99 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.173451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd2a5a4b-e650-4fd5-ac3e-12fb11664e99 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.188249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd2a5a4b-e650-4fd5-ac3e-12fb11664e99 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.189112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd2a5a4b-e650-4fd5-ac3e-12fb11664e99 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.298419 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bd2a5a4b-e650-4fd5-ac3e-12fb11664e99 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.173593 Nov 02 13:42:14.299326 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2575/5541] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:14 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326/os-volume_attachments => generated 25 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:42:14.419655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:14.420400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:14.439327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.443829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.444528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.446730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.447546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.451513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.545623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:42:14.671098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-8ca0c77e-1334-43c1-bf86-486226a2663d req-fc35f892-e1d4-4efc-889c-dc072f700ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93707bdb-b9dc-4602-b233-8a7d1a9c1b27", "tag": "da96bb9d-65b8-4dcf-9824-bb71558c3e27"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:14.686513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8ca0c77e-1334-43c1-bf86-486226a2663d req-fc35f892-e1d4-4efc-889c-dc072f700ffd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.687920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8ca0c77e-1334-43c1-bf86-486226a2663d req-fc35f892-e1d4-4efc-889c-dc072f700ffd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.688561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8ca0c77e-1334-43c1-bf86-486226a2663d req-fc35f892-e1d4-4efc-889c-dc072f700ffd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.710302 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-8ca0c77e-1334-43c1-bf86-486226a2663d req-fc35f892-e1d4-4efc-889c-dc072f700ffd service nova] Creating event network-changed:da96bb9d-65b8-4dcf-9824-bb71558c3e27 for instance 93707bdb-b9dc-4602-b233-8a7d1a9c1b27 on n-h1-858384-19 Nov 02 13:42:14.718286 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-8ca0c77e-1334-43c1-bf86-486226a2663d req-fc35f892-e1d4-4efc-889c-dc072f700ffd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052646 Nov 02 13:42:14.719945 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2576/5542] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 02 13:42:14.734535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:14.735702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:14.752191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.752979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.754185 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed6ee7c2-99a0-4dc1-9293-4a4975a8246b tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 204 len: 0 microversion: 2.1 time: 0.340387 Nov 02 13:42:14.754835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.757427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.759053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.759782 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2967/5543] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:42:14 2022] DELETE /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:42:14.764533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.770466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:14.775357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:14.790334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.792776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.793683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:14.796767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:14.797459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:14.799815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:15.070971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:15.095265 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00aacba8-2e8a-45da-bc65-1602b0d01004 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1686 microversion: 2.1 time: 0.324807 Nov 02 13:42:15.115793 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2968/5544] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:14 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1686 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:15.155036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:15.165412 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-79545be3-e958-4c81-9ecd-8c57b2adb904 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1320 microversion: 2.1 time: 0.443985 Nov 02 13:42:15.179879 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2577/5545] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:14 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1320 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:16.121729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:16.122583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:16.139848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.140840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.141814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.143315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.144691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.145912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.196167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:16.200323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:16.214682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.216396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.219886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.221205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:16.221922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:16.223430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:16.429097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:16.440963 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cb120b27-24c1-4539-9496-a33a755dbbc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1686 microversion: 2.1 time: 0.323615 Nov 02 13:42:16.442707 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2969/5546] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:16 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1686 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:16.538074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:16.547419 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0aefc84-b9f6-4c92-b4a3-579d99762238 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1320 microversion: 2.1 time: 0.359929 Nov 02 13:42:16.549395 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2578/5547] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:16 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:17.471971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:17.474704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:17.490332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:17.492501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:17.493524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:17.495055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:17.496141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:17.498063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:17.575415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:17.576910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:17.587059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:17.587799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:17.588411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:17.589440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:17.591412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:17.592275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:17.719245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:17.727604 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68c8a6d2-9f2b-45f0-8013-49b650030133 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1686 microversion: 2.1 time: 0.264089 Nov 02 13:42:17.729963 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2970/5548] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:17 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1686 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:17.869873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:17.878687 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0760a374-d224-4669-bd56-ff550b556033 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1320 microversion: 2.1 time: 0.309882 Nov 02 13:42:17.879701 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2579/5549] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:17 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:42:18.391959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-40d1bbb1-1b6c-4315-8717-f053ed5eeee9 req-eb5dc5a3-0543-49eb-9ce9-fcb971ce39bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187f7043-8fce-4714-b73c-12336bc51326", "name": "network-vif-deleted", "tag": "59a616e6-7f0e-4997-8ea1-0fc767f76feb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:18.402471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-40d1bbb1-1b6c-4315-8717-f053ed5eeee9 req-eb5dc5a3-0543-49eb-9ce9-fcb971ce39bf service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.403839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-40d1bbb1-1b6c-4315-8717-f053ed5eeee9 req-eb5dc5a3-0543-49eb-9ce9-fcb971ce39bf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.404714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-40d1bbb1-1b6c-4315-8717-f053ed5eeee9 req-eb5dc5a3-0543-49eb-9ce9-fcb971ce39bf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.427512 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-40d1bbb1-1b6c-4315-8717-f053ed5eeee9 req-eb5dc5a3-0543-49eb-9ce9-fcb971ce39bf service nova] Creating event network-vif-deleted:59a616e6-7f0e-4997-8ea1-0fc767f76feb for instance 187f7043-8fce-4714-b73c-12336bc51326 on n-h1-858384-19 Nov 02 13:42:18.441325 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-40d1bbb1-1b6c-4315-8717-f053ed5eeee9 req-eb5dc5a3-0543-49eb-9ce9-fcb971ce39bf service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052053 Nov 02 13:42:18.442195 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2971/5550] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:42:18.761220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:18.761992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:18.781062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.781559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.782003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.782910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.784556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.785418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.902090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:18.902593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:18.903463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:18.914959 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a932c1cf-c0d6-4bef-8050-70f5f4538b94 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1618 microversion: 2.1 time: 0.157899 Nov 02 13:42:18.922367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.923163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.923784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.924643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:18.925280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:18.925844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:18.931881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:18.932633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2580/5551] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:18 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1618 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:19.120785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:19.130158 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8e5a675-d189-4abf-a6a2-15b2e9aadf8e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1320 microversion: 2.1 time: 0.231926 Nov 02 13:42:19.131632 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2972/5552] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:18 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1320 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:19.943962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:19.944672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:19.955308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:19.956324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:19.959356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.960090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.961768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:19.964313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:19.964977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:19.967781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.079818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.081919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.085493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.088832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lazy-loading 'fault' on Instance uuid 187f7043-8fce-4714-b73c-12336bc51326 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:42:20.155487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:20.156745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:20.185583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:20.191836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.192364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.192813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.200347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:20.201254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:20.201868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:20.234956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:20.280604 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d035a0d-431c-4b2f-9781-0f3d7a35ebfd tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 200 len: 1336 microversion: 2.1 time: 0.339095 Nov 02 13:42:20.281956 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2581/5553] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:19 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 1336 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:20.831489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:20.841128 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-feecd8c3-9878-437f-b985-d82e8add4aeb tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1320 microversion: 2.1 time: 0.690034 Nov 02 13:42:20.843517 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2973/5554] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:20 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1320 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:21.305491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:21.306122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:21.321876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:21.322938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:21.328343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:21.334217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:21.334734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:21.336400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:21.366224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 HTTP/1.1 Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '187f7043-8fce-4714-b73c-12336bc51326'} Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:21.374836 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:42:21.378873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:21.378873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:21.378873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:21.378873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:21.378873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:21.378873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:42:21.378873 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:42:21.383382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:21.395072 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62e17d90-e5e7-4068-b95f-8d842c6be53d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 404 len: 111 microversion: 2.1 time: 0.089650 Nov 02 13:42:21.396417 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2582/5555] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:21 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:21.406746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d35717df-62d7-46cf-af76-d3f3331d56d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '.version_select at 0x7fe786aa7af0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:21.441973 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d35717df-62d7-46cf-af76-d3f3331d56d3 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110679414" status: 202 len: 0 microversion: 2.1 time: 0.040802 Nov 02 13:42:21.443365 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2974/5556] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:42:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110679414 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:42:21.867923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:21.868912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:21.906234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:21.912163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:21.913090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:21.913970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:21.914663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:21.915364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:22.313982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:22.327781 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38bf95e1-dde6-4240-ae92-c2fed10dba93 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1320 microversion: 2.1 time: 0.464099 Nov 02 13:42:22.344139 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2583/5557] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:21 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:22.485995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-51175f4c-67aa-4ca5-b7cf-bd9f673ef078 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: .version_select at 0x7fe785feab80>, body: {"keypair": {"name": "tempest-keypair-1147902698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWtVTVHK1w0rQbu3PZksiEw5p7Ct1IDZpVWLSkfui5TIa+i5wWeEtIqQ54PseVsTTXJtAINE2XFvYPPCBZgtKQMEn7H1MZ7xu2LHr8j9IRzjZ2nKnnEUHOjGG8jtQf68g=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:22.509237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-51175f4c-67aa-4ca5-b7cf-bd9f673ef078 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:22.516742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-51175f4c-67aa-4ca5-b7cf-bd9f673ef078 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for user 284102156ef9461e93e4af60f9496aa2 and project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:22.549763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-51175f4c-67aa-4ca5-b7cf-bd9f673ef078 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070938 Nov 02 13:42:22.550454 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2975/5558] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:42:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:23.157177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c1197c2c-d2d4-442d-8e6c-0deca646fdce req-b7bf1f44-bd7f-447f-9c8d-25c4b8dfa2da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93707bdb-b9dc-4602-b233-8a7d1a9c1b27", "name": "network-vif-plugged", "status": "completed", "tag": "da96bb9d-65b8-4dcf-9824-bb71558c3e27"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:23.181224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c1197c2c-d2d4-442d-8e6c-0deca646fdce req-b7bf1f44-bd7f-447f-9c8d-25c4b8dfa2da service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.184155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c1197c2c-d2d4-442d-8e6c-0deca646fdce req-b7bf1f44-bd7f-447f-9c8d-25c4b8dfa2da service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.185084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c1197c2c-d2d4-442d-8e6c-0deca646fdce req-b7bf1f44-bd7f-447f-9c8d-25c4b8dfa2da service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:23.208654 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c1197c2c-d2d4-442d-8e6c-0deca646fdce req-b7bf1f44-bd7f-447f-9c8d-25c4b8dfa2da service nova] Creating event network-vif-plugged:da96bb9d-65b8-4dcf-9824-bb71558c3e27 for instance 93707bdb-b9dc-4602-b233-8a7d1a9c1b27 on n-h1-858384-19 Nov 02 13:42:23.219227 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c1197c2c-d2d4-442d-8e6c-0deca646fdce req-b7bf1f44-bd7f-447f-9c8d-25c4b8dfa2da service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066114 Nov 02 13:42:23.220534 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2584/5559] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:23.355486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:23.356142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:23.375297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.375897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.376358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:23.377111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:23.377575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:23.378007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:23.691326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:23.706960 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-57db6e72-94a8-4c70-af0e-55ac26ba636d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1320 microversion: 2.1 time: 0.355347 Nov 02 13:42:23.707966 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2976/5560] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:23 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1320 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:24.733141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:24.734560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:24.741365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:24.741978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:24.742789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:24.743635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:24.744322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:24.744816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:24.938095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:24.954067 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aa73bf31-f8c3-4636-92f2-acb8111aad5f tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1320 microversion: 2.1 time: 0.226585 Nov 02 13:42:24.955422 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2585/5561] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:24 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:25.003768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1786195851", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07df1b69-fb68-402d-a0e1-7135ff448b95"}], "security_groups": [{"name": "tempest-securitygroup--114736772"}], "key_name": "tempest-keypair-1147902698", "user_data": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:25.153840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] validate_networks() for [('07df1b69-fb68-402d-a0e1-7135ff448b95', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:25.644409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:25.645096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:25.645586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:25.646008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:25.646730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:25.660688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.661212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.661708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.662650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.663841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.663841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.685277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:25.691944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Getting quotas for user 284102156ef9461e93e4af60f9496aa2 and project d0f7c4357f4a4f4aa03187f37a23736a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:25.709768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:25.712439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:25.773247 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10ad27d0-7fbc-4484-985d-4846fd7e1896 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.773794 Nov 02 13:42:25.773953 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2977/5562] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:42:24 2022] POST /compute/v2.1/servers => generated 403 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:42:25.791595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3dc25df3-7fd0-4112-8f10-30f1e306b4f5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:25.793053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3dc25df3-7fd0-4112-8f10-30f1e306b4f5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:25.869723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3dc25df3-7fd0-4112-8f10-30f1e306b4f5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:25.880158 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3dc25df3-7fd0-4112-8f10-30f1e306b4f5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1246 microversion: 2.1 time: 0.097991 Nov 02 13:42:25.881482 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2586/5563] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:25 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:25.977315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:25.977981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:25.986379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.987315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.988106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:25.988819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:25.989425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:25.989998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.189300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:26.198795 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79f3a34b-212d-419f-b1a2-f3382e052db7 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1508 microversion: 2.1 time: 0.225397 Nov 02 13:42:26.211362 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2978/5564] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:25 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:26.224707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4583b2a-b990-4fc2-bee1-012929918a37 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.225438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4583b2a-b990-4fc2-bee1-012929918a37 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.233466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4583b2a-b990-4fc2-bee1-012929918a37 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.234284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4583b2a-b990-4fc2-bee1-012929918a37 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.234954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4583b2a-b990-4fc2-bee1-012929918a37 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.235960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4583b2a-b990-4fc2-bee1-012929918a37 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.236995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4583b2a-b990-4fc2-bee1-012929918a37 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.237861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4583b2a-b990-4fc2-bee1-012929918a37 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.341441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:26.359072 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4583b2a-b990-4fc2-bee1-012929918a37 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "DELETE /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.139057 Nov 02 13:42:26.360516 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2587/5565] 10.222.0.113 () {58 vars in 1301 bytes} [Wed Nov 2 13:42:26 2022] DELETE /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27/os-server-password => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:42:26.373126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6466a447-2b44-4caa-8659-2e8b1a78557e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.374733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6466a447-2b44-4caa-8659-2e8b1a78557e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.410850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6466a447-2b44-4caa-8659-2e8b1a78557e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.411379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6466a447-2b44-4caa-8659-2e8b1a78557e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.414139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6466a447-2b44-4caa-8659-2e8b1a78557e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.416623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6466a447-2b44-4caa-8659-2e8b1a78557e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.417412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6466a447-2b44-4caa-8659-2e8b1a78557e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.417919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6466a447-2b44-4caa-8659-2e8b1a78557e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.460755 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6466a447-2b44-4caa-8659-2e8b1a78557e tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.083310 Nov 02 13:42:26.461439 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2979/5566] 10.222.0.113 () {58 vars in 1298 bytes} [Wed Nov 2 13:42:26 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27/os-server-password => generated 16 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 13:42:26.495050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.495640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.505765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.506448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.507050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.507986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.508588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.509176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.544202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:42:26.662223 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c0806700-573b-4424-8693-174d3e56f523 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "DELETE /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 204 len: 0 microversion: 2.1 time: 0.183651 Nov 02 13:42:26.675003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.675610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.679508 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2588/5567] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:42:26 2022] DELETE /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:42:26.683266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.685097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.686107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.687496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.687908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.688553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.868643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:26.878068 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17cc2f8c-ee07-4122-8f52-e40c0828d8d2 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1514 microversion: 2.1 time: 0.207641 Nov 02 13:42:26.880298 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2980/5568] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:26 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:26.907016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:26.908253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:26.916361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.917279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.917724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.918439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:26.918920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:26.919385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:26.989978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:26.999027 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ae71e802-eba5-4a3b-b320-c68525c607d1 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1298 microversion: 2.1 time: 0.097257 Nov 02 13:42:26.999647 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2589/5569] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:26 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:27.018512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-387ccd2a-82ce-4a32-b256-f1aa65bd75a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:27.019157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-387ccd2a-82ce-4a32-b256-f1aa65bd75a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:27.031316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387ccd2a-82ce-4a32-b256-f1aa65bd75a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:27.032087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387ccd2a-82ce-4a32-b256-f1aa65bd75a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:27.032533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387ccd2a-82ce-4a32-b256-f1aa65bd75a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:27.033248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387ccd2a-82ce-4a32-b256-f1aa65bd75a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:27.033705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387ccd2a-82ce-4a32-b256-f1aa65bd75a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:27.034133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387ccd2a-82ce-4a32-b256-f1aa65bd75a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:27.065992 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-387ccd2a-82ce-4a32-b256-f1aa65bd75a3 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/ips" status: 200 len: 144 microversion: 2.1 time: 0.052143 Nov 02 13:42:27.067447 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2981/5570] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:42:27 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/ips => generated 144 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:42:27.906104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:27.907470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:27.917227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:27.917974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:27.918772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:27.920005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:27.920777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:27.921369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:28.035018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:28.035665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:28.050108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:28.051133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:28.052967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:28.053867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:28.055505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:28.056795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:28.165293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:28.175712 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87758ee5-11b8-4c17-85ef-4e2ca6000579 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1304 microversion: 2.1 time: 0.145792 Nov 02 13:42:28.178197 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2982/5571] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:28 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1304 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:42:28.222115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:28.232811 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a95b9369-7238-415f-bab9-2ea5a040817d tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1514 microversion: 2.1 time: 0.332849 Nov 02 13:42:28.234175 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2590/5572] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:27 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1514 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:29.202762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:29.212504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:29.240406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.240898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.241505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.242372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.242975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.243570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.261313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:29.263450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:29.274083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.279426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.279426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.279862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.280649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.281081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.384198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c30435df4a4c8192b75edc456a393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ce2cce2bbf6441a8bd42b9a406afd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:29.400911 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4aba04a3-75b4-494b-b010-de785bb2cdb1 tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 200 len: 1472 microversion: 2.1 time: 0.143438 Nov 02 13:42:29.419693 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2591/5573] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:29 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:29.426122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-34de9344-29c6-4313-a52a-ed054c347052 req-7a06c635-5c0b-4115-ad72-2033d5389f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93707bdb-b9dc-4602-b233-8a7d1a9c1b27", "name": "network-vif-deleted", "tag": "da96bb9d-65b8-4dcf-9824-bb71558c3e27"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:29.438476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-34de9344-29c6-4313-a52a-ed054c347052 req-7a06c635-5c0b-4115-ad72-2033d5389f6a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.439331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-34de9344-29c6-4313-a52a-ed054c347052 req-7a06c635-5c0b-4115-ad72-2033d5389f6a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.440016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-34de9344-29c6-4313-a52a-ed054c347052 req-7a06c635-5c0b-4115-ad72-2033d5389f6a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.462021 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-34de9344-29c6-4313-a52a-ed054c347052 req-7a06c635-5c0b-4115-ad72-2033d5389f6a service nova] Creating event network-vif-deleted:da96bb9d-65b8-4dcf-9824-bb71558c3e27 for instance 93707bdb-b9dc-4602-b233-8a7d1a9c1b27 on n-h1-858384-19 Nov 02 13:42:29.469007 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-34de9344-29c6-4313-a52a-ed054c347052 req-7a06c635-5c0b-4115-ad72-2033d5389f6a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047363 Nov 02 13:42:29.470486 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2592/5574] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:29.638812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:29.650484 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ddcbac2-e1c8-402f-828d-e4b5f2eb4916 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1371 microversion: 2.1 time: 0.452352 Nov 02 13:42:29.651080 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2983/5575] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:29 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1371 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:29.676170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92aef610-290b-4b2f-a2aa-ff0b5f7ce378 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9675fbba-e584-4575-a4f6-c36f9fbadc58"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:29.679369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-92aef610-290b-4b2f-a2aa-ff0b5f7ce378 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:29.692033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aef610-290b-4b2f-a2aa-ff0b5f7ce378 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.692862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aef610-290b-4b2f-a2aa-ff0b5f7ce378 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.693540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aef610-290b-4b2f-a2aa-ff0b5f7ce378 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:29.694484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aef610-290b-4b2f-a2aa-ff0b5f7ce378 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:29.695196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aef610-290b-4b2f-a2aa-ff0b5f7ce378 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:29.696909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92aef610-290b-4b2f-a2aa-ff0b5f7ce378 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:30.136476 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-92aef610-290b-4b2f-a2aa-ff0b5f7ce378 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466367 Nov 02 13:42:30.139403 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2593/5576] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:42:29 2022] POST /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:30.430316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:30.431914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] [instance: 93707bdb-b9dc-4602-b233-8a7d1a9c1b27] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:30.442055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:30.442979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:30.444017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:30.446783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:30.446783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:30.446783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:30.465794 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] HTTP exception thrown: Instance 93707bdb-b9dc-4602-b233-8a7d1a9c1b27 could not be found. Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Request method failure captured: Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 HTTP/1.1 Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnOvudo3pW33RWNlEuh8ld8-U_Kmb-kgEojfVs-YmpKtNsB1LW9V7FUaDFjfRujTFE8U28F6XFkjswdBXCy_WoV6idJKZRkf73-Fa23ywoJSlJ3nkTPlLNuuppY8rcU0hrE_AtfkmNvNpth0oXgYuXTjKeyOtzUdxjBsODhZKQeXO_g Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 7ce2cce2bbf6441a8bd42b9a406afd62 Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerPasswordTestJSON-1559644008 Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7ce2cce2bbf6441a8bd42b9a406afd62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7ce2cce2bbf6441a8bd42b9a406afd62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_7ce2cce2bbf6441a8bd42b9a406afd62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/7ce2cce2bbf6441a8bd42b9a406afd62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerPasswordTestJSON-1559644008 Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 7ce2cce2bbf6441a8bd42b9a406afd62 Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1559644008 Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerPasswordTestJSON-1559644008-project Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 58c30435df4a4c8192b75edc456a393d Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerPasswordTestJSON-1559644008-project Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 93707bdb-b9dc-4602-b233-8a7d1a9c1b27 could not be found. Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '93707bdb-b9dc-4602-b233-8a7d1a9c1b27'} Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93707bdb-b9dc-4602-b233-8a7d1a9c1b27 could not be found. Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93707bdb-b9dc-4602-b233-8a7d1a9c1b27 could not be found. Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:42:30.467520 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:30.471575 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:42:30.471575 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:42:30.471575 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:42:30.471575 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:42:30.471575 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:42:30.471575 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93707bdb-b9dc-4602-b233-8a7d1a9c1b27 could not be found. Nov 02 13:42:30.471575 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:42:30.473132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] Returning 404 to user: Instance 93707bdb-b9dc-4602-b233-8a7d1a9c1b27 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:42:30.474211 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e0b6bd0-213e-4a8f-958c-9cec6fb3c0dc tempest-ServerPasswordTestJSON-1559644008 tempest-ServerPasswordTestJSON-1559644008-project] 10.222.0.113 "GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27" status: 404 len: 111 microversion: 2.1 time: 0.049408 Nov 02 13:42:30.478591 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2984/5577] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:30 2022] GET /compute/v2.1/servers/93707bdb-b9dc-4602-b233-8a7d1a9c1b27 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:42:30.678690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:30.680042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:30.688869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:30.692504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:30.693178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:30.695085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:30.700953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:30.701832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:31.064844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:31.079863 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4582e443-a2ab-4402-9d6d-976fc1b175bb tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1371 microversion: 2.1 time: 0.407554 Nov 02 13:42:31.096478 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2594/5578] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:30 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1371 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:31.491826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3ccf38f6-f4c4-4aec-8205-05e03c6ef8cd req-43c3442b-29b0-4de1-a157-0453bb2cc67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff9bbf6-6230-419e-8c8f-7518ff0057a8", "tag": "cfe63da6-9b22-4fed-a92a-e563ac62a075"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:31.514455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3ccf38f6-f4c4-4aec-8205-05e03c6ef8cd req-43c3442b-29b0-4de1-a157-0453bb2cc67f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:31.515325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3ccf38f6-f4c4-4aec-8205-05e03c6ef8cd req-43c3442b-29b0-4de1-a157-0453bb2cc67f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:31.515980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3ccf38f6-f4c4-4aec-8205-05e03c6ef8cd req-43c3442b-29b0-4de1-a157-0453bb2cc67f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:31.546390 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3ccf38f6-f4c4-4aec-8205-05e03c6ef8cd req-43c3442b-29b0-4de1-a157-0453bb2cc67f service nova] Creating event network-changed:cfe63da6-9b22-4fed-a92a-e563ac62a075 for instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 on n-h2-858384-19 Nov 02 13:42:31.553879 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3ccf38f6-f4c4-4aec-8205-05e03c6ef8cd req-43c3442b-29b0-4de1-a157-0453bb2cc67f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071273 Nov 02 13:42:31.555349 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2985/5579] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:32.109308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:32.113651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:32.129939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:32.132192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:32.132758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:32.135042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:32.136311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:32.137708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:32.439067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:32.462882 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e7e507f5-56a0-45ba-bd94-c8c042320ce5 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1371 microversion: 2.1 time: 0.358200 Nov 02 13:42:32.472016 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2595/5580] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:32 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:33.492269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:33.493617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:33.521453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:33.521582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:33.530410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:33.532445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:33.532936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:33.533381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:33.891476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:33.915644 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f57d7c0e-81a7-4e79-9324-502932d7747e tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1371 microversion: 2.1 time: 0.421408 Nov 02 13:42:33.918007 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2986/5581] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:33 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:34.942143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:34.942765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:34.948019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:34.964870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:34.965422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:34.965984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:34.966632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:34.967093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:34.967551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:35.389775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:35.405319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-97a951e6-fc06-4dc5-98b9-9ce6826a0661 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1371 microversion: 2.1 time: 0.467004 Nov 02 13:42:35.408197 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2596/5582] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:34 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1371 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:36.433365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:36.434631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:36.476240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:36.478590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:36.479796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:36.486224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:36.487012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:36.489342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:36.493321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:36.494607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:36.496816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:36.835218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:36.844006 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-111969f5-e048-4f83-b0bd-38aee8aa5e6c tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1371 microversion: 2.1 time: 0.415228 Nov 02 13:42:36.844603 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2987/5583] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:36 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:37.017914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5ee7fccd-1aae-4c83-af27-24aabb90494d req-c2cfd764-543e-4bd5-9c47-ed7a67967e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff9bbf6-6230-419e-8c8f-7518ff0057a8", "name": "network-vif-plugged", "status": "completed", "tag": "cfe63da6-9b22-4fed-a92a-e563ac62a075"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:37.032345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:37.037006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5ee7fccd-1aae-4c83-af27-24aabb90494d req-c2cfd764-543e-4bd5-9c47-ed7a67967e82 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:37.038041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5ee7fccd-1aae-4c83-af27-24aabb90494d req-c2cfd764-543e-4bd5-9c47-ed7a67967e82 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:37.038829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5ee7fccd-1aae-4c83-af27-24aabb90494d req-c2cfd764-543e-4bd5-9c47-ed7a67967e82 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:37.054413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5ee7fccd-1aae-4c83-af27-24aabb90494d req-c2cfd764-543e-4bd5-9c47-ed7a67967e82 service nova] Creating event network-vif-plugged:cfe63da6-9b22-4fed-a92a-e563ac62a075 for instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 on n-h2-858384-19 Nov 02 13:42:37.060800 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5ee7fccd-1aae-4c83-af27-24aabb90494d req-c2cfd764-543e-4bd5-9c47-ed7a67967e82 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054934 Nov 02 13:42:37.062077 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2597/5584] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:37.869726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:37.870492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:37.882621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:37.883609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:37.884632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:37.889662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:37.890232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:37.890686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.069940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Calling method '.version_select at 0x7fe785ff7430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:38.072521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.073310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.074110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.110098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:38.110921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.110921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.110921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.119743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:38.120654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:38.121889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:38.122250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0fee036a-42e0-4fb4-8228-4947e34570d7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1371 microversion: 2.1 time: 0.256523 Nov 02 13:42:38.123258 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2598/5585] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:37 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:38.129793 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a99dd2d9-c73e-4f19-9ce3-a6c5ee1a37ff tempest-PortsAdminExtendedAttrsTestJSON-542133735 tempest-PortsAdminExtendedAttrsTestJSON-542133735-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.496202 Nov 02 13:42:38.130386 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2988/5586] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:42:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:39.147014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:39.148406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:39.159987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:39.161440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:39.162069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:39.163832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:39.164408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:39.165091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:39.807517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:39.824375 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-652f049b-b436-4b2a-b490-18c83955c028 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1561 microversion: 2.1 time: 0.677873 Nov 02 13:42:39.825230 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2599/5587] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:39 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1561 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:39.853799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6b7b1471-0fdb-46c5-bd2b-7ea62178d533 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:39.854347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6b7b1471-0fdb-46c5-bd2b-7ea62178d533 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:39.866696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b7b1471-0fdb-46c5-bd2b-7ea62178d533 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:39.867226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b7b1471-0fdb-46c5-bd2b-7ea62178d533 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:39.867678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b7b1471-0fdb-46c5-bd2b-7ea62178d533 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:39.873880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b7b1471-0fdb-46c5-bd2b-7ea62178d533 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:39.874472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b7b1471-0fdb-46c5-bd2b-7ea62178d533 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:39.874924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b7b1471-0fdb-46c5-bd2b-7ea62178d533 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:40.162326 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6b7b1471-0fdb-46c5-bd2b-7ea62178d533 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.312632 Nov 02 13:42:40.172685 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2989/5588] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 13:42:39 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-interface => generated 285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:42.092314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-93752388-cf94-482d-81ba-f230ff072841 req-4d66adb7-97bf-4e6a-83ef-e77467e23623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff9bbf6-6230-419e-8c8f-7518ff0057a8", "tag": "cfe63da6-9b22-4fed-a92a-e563ac62a075"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:42.120294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93752388-cf94-482d-81ba-f230ff072841 req-4d66adb7-97bf-4e6a-83ef-e77467e23623 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:42.122054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93752388-cf94-482d-81ba-f230ff072841 req-4d66adb7-97bf-4e6a-83ef-e77467e23623 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:42.122618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-93752388-cf94-482d-81ba-f230ff072841 req-4d66adb7-97bf-4e6a-83ef-e77467e23623 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:42.151033 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-93752388-cf94-482d-81ba-f230ff072841 req-4d66adb7-97bf-4e6a-83ef-e77467e23623 service nova] Creating event network-changed:cfe63da6-9b22-4fed-a92a-e563ac62a075 for instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 on n-h2-858384-19 Nov 02 13:42:42.203975 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-93752388-cf94-482d-81ba-f230ff072841 req-4d66adb7-97bf-4e6a-83ef-e77467e23623 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115151 Nov 02 13:42:42.208531 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2600/5589] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:44.866659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-81c3497f-0575-4a32-bde4-762e8d0e25d9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:44.870148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-81c3497f-0575-4a32-bde4-762e8d0e25d9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:44.888806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c3497f-0575-4a32-bde4-762e8d0e25d9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.889369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c3497f-0575-4a32-bde4-762e8d0e25d9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.889673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c3497f-0575-4a32-bde4-762e8d0e25d9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.890389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c3497f-0575-4a32-bde4-762e8d0e25d9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.893115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c3497f-0575-4a32-bde4-762e8d0e25d9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.893581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c3497f-0575-4a32-bde4-762e8d0e25d9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.941286 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-81c3497f-0575-4a32-bde4-762e8d0e25d9 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079574 Nov 02 13:42:44.944602 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2990/5590] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:42:44 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:44.957228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d893d53-4ddd-4a6c-bf5d-c96b407985d6 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:44.958596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d893d53-4ddd-4a6c-bf5d-c96b407985d6 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:44.969315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d893d53-4ddd-4a6c-bf5d-c96b407985d6 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.970122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d893d53-4ddd-4a6c-bf5d-c96b407985d6 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.970736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d893d53-4ddd-4a6c-bf5d-c96b407985d6 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:44.971791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d893d53-4ddd-4a6c-bf5d-c96b407985d6 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:44.972405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d893d53-4ddd-4a6c-bf5d-c96b407985d6 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:44.972980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d893d53-4ddd-4a6c-bf5d-c96b407985d6 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:45.032514 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d893d53-4ddd-4a6c-bf5d-c96b407985d6 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/9675fbba-e584-4575-a4f6-c36f9fbadc58" status: 200 len: 194 microversion: 2.1 time: 0.080659 Nov 02 13:42:45.033904 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2601/5591] 10.222.0.113 () {58 vars in 1418 bytes} [Wed Nov 2 13:42:44 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/9675fbba-e584-4575-a4f6-c36f9fbadc58 => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:46.430095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-268694677", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "e2a90dcb-325f-44c1-b30e-ebec60ce1358"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:46.510798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] validate_networks() for [('e2a90dcb-325f-44c1-b30e-ebec60ce1358', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:42:47.209553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:42:47.210735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:42:47.211504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:42:47.212260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:42:47.213078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:42:47.227916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:47.229075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:47.229693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:47.231472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:47.232250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:47.232855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:47.259429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:42:47.268046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for user f883a8edef9b47319dc828211e497fe7 and project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:42:47.287046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:42:47.290391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:42:47.365447 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-33717242-ffb7-4472-9e1d-e7fe52a43e72 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.154858 Nov 02 13:42:47.366937 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2991/5592] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:42:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:42:47.383230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e750f347-4dc0-4df7-84eb-b3d55b07ad66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:47.383857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e750f347-4dc0-4df7-84eb-b3d55b07ad66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:47.519058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e750f347-4dc0-4df7-84eb-b3d55b07ad66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:47.545023 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e750f347-4dc0-4df7-84eb-b3d55b07ad66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1196 microversion: 2.1 time: 0.161498 Nov 02 13:42:47.549818 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2602/5593] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:47 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1196 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:47.718525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b3b8a4e-099c-4573-b733-51547f310168 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79d6bfa8-3933-49f0-94d8-0f7555dfc3b0"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:47.721706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b3b8a4e-099c-4573-b733-51547f310168 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:47.736795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b3b8a4e-099c-4573-b733-51547f310168 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:47.737299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b3b8a4e-099c-4573-b733-51547f310168 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:47.737764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b3b8a4e-099c-4573-b733-51547f310168 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:47.738565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b3b8a4e-099c-4573-b733-51547f310168 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:47.739032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b3b8a4e-099c-4573-b733-51547f310168 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:47.739461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b3b8a4e-099c-4573-b733-51547f310168 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.163546 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b3b8a4e-099c-4573-b733-51547f310168 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "POST /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.451273 Nov 02 13:42:48.165715 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2992/5594] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:42:47 2022] POST /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:42:48.570551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:48.571254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:48.612626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:48.614328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:48.615958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.618670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:48.622004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:48.624709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:48.822406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:48.838027 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2db2ae0-b878-4e10-a16b-4d0628cb9b24 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1248 microversion: 2.1 time: 0.272077 Nov 02 13:42:48.838647 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2603/5595] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:48 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1248 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:49.882460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:49.884454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:49.915259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:49.916212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:49.916983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:49.921060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:49.923310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:49.924855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:49.943956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:50.084154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:50.097959 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ac4af0fe-8f71-4bad-b575-644a55828662 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1254 microversion: 2.1 time: 0.228202 Nov 02 13:42:50.098670 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2993/5596] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:49 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1254 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:51.126582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:51.128265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:51.143298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.144058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.144774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.145683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:51.146389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:51.146986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:51.181902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=93,nova_cell1:UPDATE=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:51.647265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:51.660814 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22bffbf6-50e6-45de-87b8-dfe47d6a5c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1296 microversion: 2.1 time: 0.538108 Nov 02 13:42:51.663469 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2604/5597] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:51 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1296 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:52.207921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e86d91c2-357a-4987-9b9d-95b1b44f2132 req-c2f9d348-c507-4a5d-bb9e-c1e2f4666440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f05519-8017-40c4-b3b6-27d4e243bf5d", "tag": "799d54a1-ada4-4612-b54c-411914457307"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:52.238201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e86d91c2-357a-4987-9b9d-95b1b44f2132 req-c2f9d348-c507-4a5d-bb9e-c1e2f4666440 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.239010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e86d91c2-357a-4987-9b9d-95b1b44f2132 req-c2f9d348-c507-4a5d-bb9e-c1e2f4666440 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.240523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e86d91c2-357a-4987-9b9d-95b1b44f2132 req-c2f9d348-c507-4a5d-bb9e-c1e2f4666440 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.290671 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e86d91c2-357a-4987-9b9d-95b1b44f2132 req-c2f9d348-c507-4a5d-bb9e-c1e2f4666440 service nova] Creating event network-changed:799d54a1-ada4-4612-b54c-411914457307 for instance 81f05519-8017-40c4-b3b6-27d4e243bf5d on n-h1-858384-19 Nov 02 13:42:52.304673 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e86d91c2-357a-4987-9b9d-95b1b44f2132 req-c2f9d348-c507-4a5d-bb9e-c1e2f4666440 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101273 Nov 02 13:42:52.307706 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2994/5598] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:52.700765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:52.701816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:52.746227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.747340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.748267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:52.749665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:52.750681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:52.752126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:53.352628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:53.377156 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7b14c3d8-69f5-4d96-ac50-85d9c519f785 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1296 microversion: 2.1 time: 0.693415 Nov 02 13:42:53.389371 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2605/5599] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:52 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1296 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:54.413527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:54.414245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:54.425087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.425586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.426031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.426752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:54.427237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:54.427676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:54.667091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:54.677991 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fa39cb6e-2d86-4475-97a6-4e033a5795cd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1296 microversion: 2.1 time: 0.269475 Nov 02 13:42:54.693581 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2995/5600] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:54 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1296 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:55.706248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:55.707701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:55.716561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.717433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.718076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.720160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:55.721014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:55.721657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:55.901838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:55.911019 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a1c375ff-93bc-4269-b3d8-974ec6a47a6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1296 microversion: 2.1 time: 0.208759 Nov 02 13:42:55.912080 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2606/5601] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:55 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1296 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:56.936602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:56.937236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:56.944008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.944676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.945126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:56.946137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:56.946754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:56.947872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:57.125593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:57.133423 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1aea1370-81e3-477e-8d73-00d508b2dd47 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1296 microversion: 2.1 time: 0.202099 Nov 02 13:42:57.134034 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2996/5602] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:56 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1296 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:58.158069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:58.158698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:58.164424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:58.169049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.169571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.170027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.170759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.171254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.171692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.333571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:58.341867 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75814076-e77c-4538-a7ee-58a073986a0c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1296 microversion: 2.1 time: 0.187685 Nov 02 13:42:58.342476 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2607/5603] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:58 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1296 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:42:58.757889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9ba6901e-92a0-4446-a900-7c3e641ba28c req-81c1851f-86ad-4f94-9ee5-bb3bfcc8f03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f05519-8017-40c4-b3b6-27d4e243bf5d", "name": "network-vif-plugged", "status": "completed", "tag": "799d54a1-ada4-4612-b54c-411914457307"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:42:58.770684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:58.772332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:42:58.781310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9ba6901e-92a0-4446-a900-7c3e641ba28c req-81c1851f-86ad-4f94-9ee5-bb3bfcc8f03a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:58.781798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9ba6901e-92a0-4446-a900-7c3e641ba28c req-81c1851f-86ad-4f94-9ee5-bb3bfcc8f03a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:58.789095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9ba6901e-92a0-4446-a900-7c3e641ba28c req-81c1851f-86ad-4f94-9ee5-bb3bfcc8f03a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:58.805023 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9ba6901e-92a0-4446-a900-7c3e641ba28c req-81c1851f-86ad-4f94-9ee5-bb3bfcc8f03a service nova] Creating event network-vif-plugged:799d54a1-ada4-4612-b54c-411914457307 for instance 81f05519-8017-40c4-b3b6-27d4e243bf5d on n-h1-858384-19 Nov 02 13:42:58.812132 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9ba6901e-92a0-4446-a900-7c3e641ba28c req-81c1851f-86ad-4f94-9ee5-bb3bfcc8f03a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064659 Nov 02 13:42:58.813325 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2997/5604] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:42:59.365987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:42:59.367308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:42:59.376513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.377285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.377981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.379035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:42:59.379784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:42:59.380375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:42:59.611663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:42:59.628531 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b2180de-081e-42e9-b760-8dec44bc7c77 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1296 microversion: 2.1 time: 0.265845 Nov 02 13:42:59.646220 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2608/5605] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:42:59 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1296 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:00.657861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:00.658709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:00.675737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.677473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.679288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.680340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:00.684432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:00.685133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:00.935399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:00.946152 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7dfb19d0-5797-4015-9408-ff4cd5fe61df tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1477 microversion: 2.1 time: 0.295786 Nov 02 13:43:00.951704 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2998/5606] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:00 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1477 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:01.137264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-108823098", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:01.213059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] validate_networks() for [('e2a90dcb-325f-44c1-b30e-ebec60ce1358', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:01.778879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:01.779401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:01.779885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:01.780321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:01.780735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:01.790075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.790558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.790994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:01.791754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:01.792783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:01.793218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:01.812888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:01.820467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for user f883a8edef9b47319dc828211e497fe7 and project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:01.835725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:01.837986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: fbac5a50-1593-4b42-b0cb-cfc022c48096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:01.887219 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f46ccba-09d4-443b-85da-7ef490a2fd45 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.755077 Nov 02 13:43:01.888630 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2609/5607] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:43:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:43:01.900705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad40b953-2973-4506-977a-a29478ffbc01 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:01.901540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ad40b953-2973-4506-977a-a29478ffbc01 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: fbac5a50-1593-4b42-b0cb-cfc022c48096] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:01.935763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ad40b953-2973-4506-977a-a29478ffbc01 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: fbac5a50-1593-4b42-b0cb-cfc022c48096] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:43:02.344238 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ad40b953-2973-4506-977a-a29478ffbc01 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096" status: 204 len: 0 microversion: 2.1 time: 0.447416 Nov 02 13:43:02.347154 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 2999/5608] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:43:01 2022] DELETE /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:02.359391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-07d90867-071f-44c8-9231-8b1ea6265479 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.361271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-07d90867-071f-44c8-9231-8b1ea6265479 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: fbac5a50-1593-4b42-b0cb-cfc022c48096] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:02.376184 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-07d90867-071f-44c8-9231-8b1ea6265479 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-07d90867-071f-44c8-9231-8b1ea6265479 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096 HTTP/1.1 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fbac5a50-1593-4b42-b0cb-cfc022c48096'} Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:02.389486 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:02.393278 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:02.393278 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:02.393278 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:02.393278 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:43:02.393278 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:02.393278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-07d90867-071f-44c8-9231-8b1ea6265479 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:02.393278 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-07d90867-071f-44c8-9231-8b1ea6265479 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096" status: 404 len: 111 microversion: 2.1 time: 0.037991 Nov 02 13:43:02.393278 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2610/5609] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:02 2022] GET /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:02.475096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1717418997", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "e2a90dcb-325f-44c1-b30e-ebec60ce1358"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:02.564433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] validate_networks() for [('e2a90dcb-325f-44c1-b30e-ebec60ce1358', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:02.648428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b19bf1a-8d89-4f84-89be-82d5b71ca070 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.658184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6b19bf1a-8d89-4f84-89be-82d5b71ca070 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:02.669356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b19bf1a-8d89-4f84-89be-82d5b71ca070 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.670678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b19bf1a-8d89-4f84-89be-82d5b71ca070 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.671423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b19bf1a-8d89-4f84-89be-82d5b71ca070 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.672594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b19bf1a-8d89-4f84-89be-82d5b71ca070 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.673345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b19bf1a-8d89-4f84-89be-82d5b71ca070 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.674426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b19bf1a-8d89-4f84-89be-82d5b71ca070 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.721522 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b19bf1a-8d89-4f84-89be-82d5b71ca070 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.076450 Nov 02 13:43:02.726285 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2611/5610] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:43:02 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:43:02.873051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6cdddbb6-ab47-4276-b656-3f149ecbd26b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.873531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6cdddbb6-ab47-4276-b656-3f149ecbd26b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:02.884756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cdddbb6-ab47-4276-b656-3f149ecbd26b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.888704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cdddbb6-ab47-4276-b656-3f149ecbd26b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.891432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cdddbb6-ab47-4276-b656-3f149ecbd26b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.892303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cdddbb6-ab47-4276-b656-3f149ecbd26b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.892878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cdddbb6-ab47-4276-b656-3f149ecbd26b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.893421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cdddbb6-ab47-4276-b656-3f149ecbd26b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.941841 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6cdddbb6-ab47-4276-b656-3f149ecbd26b tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/9675fbba-e584-4575-a4f6-c36f9fbadc58" status: 200 len: 194 microversion: 2.1 time: 0.075419 Nov 02 13:43:02.948255 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2612/5611] 10.222.0.113 () {58 vars in 1418 bytes} [Wed Nov 2 13:43:02 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/9675fbba-e584-4575-a4f6-c36f9fbadc58 => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:02.955319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:02.956114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:02.963647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.966107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.966757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:02.967704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:02.968332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:02.968926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.090399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lazy-loading 'services' on Instance uuid 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:03.195946 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d8d844fa-274e-4971-8885-358cd57bc73e tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "DELETE /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/9675fbba-e584-4575-a4f6-c36f9fbadc58" status: 202 len: 0 microversion: 2.1 time: 0.244222 Nov 02 13:43:03.197554 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2613/5612] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:43:02 2022] DELETE /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/9675fbba-e584-4575-a4f6-c36f9fbadc58 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:43:03.326845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:03.327513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:03.329703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:03.331038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:03.331790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:03.354299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.355749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.356435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.357417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:03.358183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:03.358826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:03.394871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:03.405683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for user f883a8edef9b47319dc828211e497fe7 and project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:03.427356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:03.432176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:03.501990 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-24c64ed8-bb5f-4a0d-84dd-39634bfb2d35 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.031991 Nov 02 13:43:03.502928 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3000/5613] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:43:02 2022] POST /compute/v2.1/servers => generated 382 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:43:03.516374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c8e7661b-8a84-4ca1-84b4-f92c74f44b79 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:03.517556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c8e7661b-8a84-4ca1-84b4-f92c74f44b79 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:03.810140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c8e7661b-8a84-4ca1-84b4-f92c74f44b79 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:03.821292 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c8e7661b-8a84-4ca1-84b4-f92c74f44b79 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1225 microversion: 2.1 time: 0.310461 Nov 02 13:43:03.825327 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2614/5614] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:03 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1225 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:04.850895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:04.852157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:04.862322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.863248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.863903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.868069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:04.869063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:04.869701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:04.957230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:04.970517 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4423a695-5cef-4ee5-8f0c-4686439db91b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1277 microversion: 2.1 time: 0.125908 Nov 02 13:43:04.972095 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3001/5615] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:04 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:06.000952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:06.002590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:06.007397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:06.017955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:06.018978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:06.019813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:06.021093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:06.022341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:06.023374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:06.212270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:06.227958 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7badd7c2-6b2d-4cb4-ab7c-c3c0976d76f7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1283 microversion: 2.1 time: 0.231403 Nov 02 13:43:06.228848 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2615/5616] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:05 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1283 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:07.255678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:07.256936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:07.263155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:07.275651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.279437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.280117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.281177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:07.283631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:07.284441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:07.615742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:07.628476 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-693ea0ab-1ba6-4469-b7e6-e6b698ccea6f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1325 microversion: 2.1 time: 0.376684 Nov 02 13:43:07.643217 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3002/5617] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:07 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1325 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:08.658553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:08.662670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:08.669198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0a82fbac-d353-415d-b4be-740e7c3ef7d4 req-11cc1f94-0d86-4697-ac8e-02c779e710e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c85e3b-9187-490c-97c6-e7180f1fb777", "tag": "91f06409-0395-4358-84d9-6bbbc34cc133"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:08.689026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:08.690141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:08.690852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:08.691728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0a82fbac-d353-415d-b4be-740e7c3ef7d4 req-11cc1f94-0d86-4697-ac8e-02c779e710e1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:08.692182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:08.692302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0a82fbac-d353-415d-b4be-740e7c3ef7d4 req-11cc1f94-0d86-4697-ac8e-02c779e710e1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:08.692618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0a82fbac-d353-415d-b4be-740e7c3ef7d4 req-11cc1f94-0d86-4697-ac8e-02c779e710e1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:08.693063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:08.693651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:08.717468 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0a82fbac-d353-415d-b4be-740e7c3ef7d4 req-11cc1f94-0d86-4697-ac8e-02c779e710e1 service nova] Creating event network-changed:91f06409-0395-4358-84d9-6bbbc34cc133 for instance e3c85e3b-9187-490c-97c6-e7180f1fb777 on n-h2-858384-19 Nov 02 13:43:08.729013 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0a82fbac-d353-415d-b4be-740e7c3ef7d4 req-11cc1f94-0d86-4697-ac8e-02c779e710e1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065312 Nov 02 13:43:08.732752 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3003/5618] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:43:09.031586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:09.039970 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7385200-c3dc-4994-b126-44d1dceae917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1325 microversion: 2.1 time: 0.390153 Nov 02 13:43:09.072780 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2616/5619] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:08 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1325 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:10.080272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:10.083173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:10.094958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.096133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.096939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.097914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:10.098578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:10.099249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:10.352221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:10.371234 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19fe5c86-1e4d-4ee1-be8c-626d5718b28b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1325 microversion: 2.1 time: 0.290081 Nov 02 13:43:10.373572 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3004/5620] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:10 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1325 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:11.371567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53b1f41b-c5e3-4070-aec5-f2457bba0961 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:11.372320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-53b1f41b-c5e3-4070-aec5-f2457bba0961 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:11.382970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b1f41b-c5e3-4070-aec5-f2457bba0961 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.384239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b1f41b-c5e3-4070-aec5-f2457bba0961 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.385174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b1f41b-c5e3-4070-aec5-f2457bba0961 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.386707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b1f41b-c5e3-4070-aec5-f2457bba0961 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.387676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b1f41b-c5e3-4070-aec5-f2457bba0961 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.388431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53b1f41b-c5e3-4070-aec5-f2457bba0961 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.398806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:11.399454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:11.410481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.411190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.411718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.412640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.413280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.413799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.476712 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-53b1f41b-c5e3-4070-aec5-f2457bba0961 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/79d6bfa8-3933-49f0-94d8-0f7555dfc3b0" status: 200 len: 194 microversion: 2.1 time: 0.114504 Nov 02 13:43:11.483596 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2617/5621] 10.222.0.113 () {58 vars in 1418 bytes} [Wed Nov 2 13:43:11 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/79d6bfa8-3933-49f0-94d8-0f7555dfc3b0 => generated 194 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:11.490171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:11.491172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:11.502039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.502986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.503494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.504521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:11.505292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:11.506446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:11.626342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lazy-loading 'services' on Instance uuid 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:11.645467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:11.659701 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-50581bc5-51cc-4ff5-9087-fde0ae9c4c76 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1325 microversion: 2.1 time: 0.266052 Nov 02 13:43:11.661473 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3005/5622] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:11 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:11.725518 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a7dc6eb-e364-434b-93a8-438271190264 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "DELETE /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/79d6bfa8-3933-49f0-94d8-0f7555dfc3b0" status: 202 len: 0 microversion: 2.1 time: 0.240328 Nov 02 13:43:11.726766 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2618/5623] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:43:11 2022] DELETE /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments/79d6bfa8-3933-49f0-94d8-0f7555dfc3b0 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:43:12.685717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:12.686567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:12.703279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:12.704055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:12.704954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:12.706248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:12.707215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:12.708339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:13.134357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:13.152936 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87899f1f-3b7b-42c9-8c58-5e56e1dcd49c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1325 microversion: 2.1 time: 0.468043 Nov 02 13:43:13.153716 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3006/5624] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:12 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1325 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:14.174866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:14.178353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:14.186167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:14.186915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:14.194236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.194930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.195413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.196093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:14.196789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:14.196974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:14.360702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:14.369442 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7e2bd520-8766-43e0-8c9b-4be2ce6f57fc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1325 microversion: 2.1 time: 0.195961 Nov 02 13:43:14.370305 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2619/5625] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:14 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:15.404002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:15.404819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:15.412137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:15.413254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:15.418330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:15.420297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:15.420856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:15.421530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:15.422392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:15.422509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:15.618405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:15.638884 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90e9f64c-d7f7-4934-95d6-9fc7ef9b21d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1325 microversion: 2.1 time: 0.241102 Nov 02 13:43:15.658624 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3007/5626] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:15 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1325 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:16.665106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:16.665942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:16.675679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.680965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.684192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.685341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:16.686014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:16.688981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:16.987082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-75377209-b222-49cc-9cc6-082c4f34b789 req-c77ad5ee-37ac-45f2-a886-b8072e0c5afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c85e3b-9187-490c-97c6-e7180f1fb777", "name": "network-vif-plugged", "status": "completed", "tag": "91f06409-0395-4358-84d9-6bbbc34cc133"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:16.999466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:17.016981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-75377209-b222-49cc-9cc6-082c4f34b789 req-c77ad5ee-37ac-45f2-a886-b8072e0c5afe service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:17.021981 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cebeffde-087f-4cfc-8308-f3f109c1b755 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1325 microversion: 2.1 time: 0.349225 Nov 02 13:43:17.022777 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2620/5627] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:16 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:17.028142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-75377209-b222-49cc-9cc6-082c4f34b789 req-c77ad5ee-37ac-45f2-a886-b8072e0c5afe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:17.028906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-75377209-b222-49cc-9cc6-082c4f34b789 req-c77ad5ee-37ac-45f2-a886-b8072e0c5afe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:17.049052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-75377209-b222-49cc-9cc6-082c4f34b789 req-c77ad5ee-37ac-45f2-a886-b8072e0c5afe service nova] Creating event network-vif-plugged:91f06409-0395-4358-84d9-6bbbc34cc133 for instance e3c85e3b-9187-490c-97c6-e7180f1fb777 on n-h2-858384-19 Nov 02 13:43:17.054669 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-75377209-b222-49cc-9cc6-082c4f34b789 req-c77ad5ee-37ac-45f2-a886-b8072e0c5afe service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071829 Nov 02 13:43:17.055704 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3008/5628] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:18.049543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:18.051255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:18.064811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.065859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.066502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.067777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.068391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.069118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.287158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:18.298691 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-59deb349-ddfe-4cd3-9638-4e571879b648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1325 microversion: 2.1 time: 0.257279 Nov 02 13:43:18.299657 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2621/5629] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:18 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1325 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:18.521716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-315fe887-2784-4caf-8aa4-fd27cb6de046 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:18.524742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-315fe887-2784-4caf-8aa4-fd27cb6de046 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:18.532664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-315fe887-2784-4caf-8aa4-fd27cb6de046 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.533413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-315fe887-2784-4caf-8aa4-fd27cb6de046 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.534017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-315fe887-2784-4caf-8aa4-fd27cb6de046 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.534892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-315fe887-2784-4caf-8aa4-fd27cb6de046 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.535532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-315fe887-2784-4caf-8aa4-fd27cb6de046 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.536149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-315fe887-2784-4caf-8aa4-fd27cb6de046 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.570045 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-315fe887-2784-4caf-8aa4-fd27cb6de046 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052648 Nov 02 13:43:18.571224 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3009/5630] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:43:18 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:43:18.773635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-df97cbd6-749c-4528-90ab-4925e64dfff8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:18.777949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-df97cbd6-749c-4528-90ab-4925e64dfff8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:18.787370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df97cbd6-749c-4528-90ab-4925e64dfff8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.788094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df97cbd6-749c-4528-90ab-4925e64dfff8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.788686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df97cbd6-749c-4528-90ab-4925e64dfff8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.789632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df97cbd6-749c-4528-90ab-4925e64dfff8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.790421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df97cbd6-749c-4528-90ab-4925e64dfff8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.791045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df97cbd6-749c-4528-90ab-4925e64dfff8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.795853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:18.842686 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-df97cbd6-749c-4528-90ab-4925e64dfff8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073443 Nov 02 13:43:18.843895 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2622/5631] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:43:18 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:43:18.920698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:18.921182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:18.928815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.929638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.930228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:18.931295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:18.932566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:18.933203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:19.014345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:43:19.194708 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df728e42-a9f0-4a37-b0ea-50ab58f36185 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "DELETE /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 204 len: 0 microversion: 2.1 time: 0.277821 Nov 02 13:43:19.199495 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3010/5632] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:43:18 2022] DELETE /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:19.205185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:19.205959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:19.217652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:19.218700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:19.218700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:19.219322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:19.219778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:19.220206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:19.325840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:19.326624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:19.334222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:19.335195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:19.335813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:19.336993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:19.337664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:19.338864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:19.477113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:19.497092 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a4dbcfbd-540f-41e5-bff2-9c52519ae838 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1676 microversion: 2.1 time: 0.295727 Nov 02 13:43:19.498406 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2623/5633] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:19 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1676 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:19.601404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:19.610769 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a94d2e6a-afcd-4f5b-b0c1-e459884b3c13 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1506 microversion: 2.1 time: 0.291424 Nov 02 13:43:19.615876 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3011/5634] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:19 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:19.643986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:19.644964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:19.656542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:19.658432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:19.659151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:19.660117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:19.670728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:19.672015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.031567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:20.041060 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a2b5eda7-a4e6-4266-9b2e-2ee1f8f3e648 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1506 microversion: 2.1 time: 0.400979 Nov 02 13:43:20.046376 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2624/5635] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:19 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:20.068867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:20.070349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:20.078835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.080010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.080618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.082289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.082765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.083246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.086619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:20.148390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:43:20.318152 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-481506fd-37b8-4767-9751-6ea3bcd27a95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 204 len: 0 microversion: 2.1 time: 0.252831 Nov 02 13:43:20.320183 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3012/5636] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:43:20 2022] DELETE /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:20.329671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:20.330479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:20.346580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.349557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.350681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.352830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.353469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.354088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.522841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:20.524836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:20.546799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.547660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.548298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.549208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:20.549807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:20.550467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:20.865648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:20.887841 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ea7b9c65-0ac4-4e59-a477-e57831a7933d tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1676 microversion: 2.1 time: 0.369173 Nov 02 13:43:20.891429 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3013/5637] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:20 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1676 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:21.000689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:21.014413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-311fd159-f78e-4851-ac9f-33197706a97a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1512 microversion: 2.1 time: 0.688960 Nov 02 13:43:21.020659 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2625/5638] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:20 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1512 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:21.914133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:21.915368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:21.927089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.928157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.928750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:21.929756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:21.930418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:21.932605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.045661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:22.046860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:22.073612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.074814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.084587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.085630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:22.086332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:22.086949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:22.243941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:22.261270 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-623c4a99-b4ce-4068-a41d-42b9549af3f8 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1676 microversion: 2.1 time: 0.350936 Nov 02 13:43:22.262274 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3014/5639] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:21 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1676 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:22.602844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:22.613344 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a4b4957-646f-4f13-a2d9-4497009bad64 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1512 microversion: 2.1 time: 0.573953 Nov 02 13:43:22.614528 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2626/5640] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:22 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1512 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:23.285887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:23.286760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:23.295280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.295856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.296686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.298205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.298810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.299424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.492777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:23.502630 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ebfc9884-34fc-4b51-a61b-96d9bc39b801 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1676 microversion: 2.1 time: 0.220479 Nov 02 13:43:23.503282 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3015/5641] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:23 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:23.638166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:23.638780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:23.645661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.646144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.646589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:23.647361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:23.647815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:23.648247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.125869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:24.135511 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-45232491-5888-4e08-9451-224cda817e97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1512 microversion: 2.1 time: 0.500724 Nov 02 13:43:24.136568 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2627/5642] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:23 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:24.433830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-187ad1f3-a847-4198-a57e-97383a7ca89f req-06bf518c-ee17-4081-9308-00a29630dc78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c85e3b-9187-490c-97c6-e7180f1fb777", "name": "network-vif-deleted", "tag": "91f06409-0395-4358-84d9-6bbbc34cc133"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:24.451226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-187ad1f3-a847-4198-a57e-97383a7ca89f req-06bf518c-ee17-4081-9308-00a29630dc78 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.452900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-187ad1f3-a847-4198-a57e-97383a7ca89f req-06bf518c-ee17-4081-9308-00a29630dc78 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.453820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-187ad1f3-a847-4198-a57e-97383a7ca89f req-06bf518c-ee17-4081-9308-00a29630dc78 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.469255 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-187ad1f3-a847-4198-a57e-97383a7ca89f req-06bf518c-ee17-4081-9308-00a29630dc78 service nova] Creating event network-vif-deleted:91f06409-0395-4358-84d9-6bbbc34cc133 for instance e3c85e3b-9187-490c-97c6-e7180f1fb777 on n-h2-858384-19 Nov 02 13:43:24.477891 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-187ad1f3-a847-4198-a57e-97383a7ca89f req-06bf518c-ee17-4081-9308-00a29630dc78 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050786 Nov 02 13:43:24.479664 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3016/5643] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:24.528734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:24.529379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:24.545633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.546725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.547398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:24.548574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:24.556362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:24.558111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.123510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:25.134614 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49c2d6bb-6b56-4649-8c2b-9ae88e9713d1 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1608 microversion: 2.1 time: 0.612347 Nov 02 13:43:25.161905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:25.162629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:25.169351 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2628/5644] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:24 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1608 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:25.176595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.177024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.177628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.178708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.183898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.185854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.243717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:25.244736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:25.245400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:25.246013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lazy-loading 'fault' on Instance uuid e3c85e3b-9187-490c-97c6-e7180f1fb777 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:25.340006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:25.351574 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c4dd40fc-19a7-4f22-aa9e-04287fbd4d4e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 200 len: 1315 microversion: 2.1 time: 0.194511 Nov 02 13:43:25.356808 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3017/5645] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:25 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:26.177551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:26.178879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:26.198603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.199384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.200019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.201201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.201824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.202414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.271146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.272034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.272649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.273261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lazy-loading 'fault' on Instance uuid 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:26.372211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4a470b46934c96845dd659f4752b3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caaf4dc4c8fb46e6b6497a9f289825bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:26.381441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:26.383640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:26.387480 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17146503-6814-482e-98bc-4c0533fac6fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 200 len: 1331 microversion: 2.1 time: 0.213710 Nov 02 13:43:26.399939 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2629/5646] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:26 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 1331 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:26.412488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.415712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.416757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.424398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.424922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.425378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.450048 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 HTTP/1.1 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e3c85e3b-9187-490c-97c6-e7180f1fb777'} Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:26.452065 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:26.457652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:26.457652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:26.457652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:26.457652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:26.457652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:26.457652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:43:26.457652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:26.459824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:26.460888 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97df826d-4be6-4ffc-8845-ff6d03fe9010 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 404 len: 111 microversion: 2.1 time: 0.085626 Nov 02 13:43:26.462068 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3018/5647] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:26 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:26.481431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-34766ae5-e4aa-4a17-bf0f-4fb2e498240f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'create', calling method: .version_select at 0x7fe78f90e5e0>, body: {"keypair": {"name": "tempest-key-2066511212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhoqiAEnylBh5uMT2uZH7reQKhhyec6kloqvmkBkGev06RIFHzo4AiaTLKS9kOwMBCkqWbOmjXbuuEY8ekvChbXNrllQn2/JqLOj4tIZ1KjRClpH6NVTjkyKE3PILbveg=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:26.500118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-34766ae5-e4aa-4a17-bf0f-4fb2e498240f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:26.506447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-34766ae5-e4aa-4a17-bf0f-4fb2e498240f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for user f883a8edef9b47319dc828211e497fe7 and project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:26.511293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-547a09a4-75b1-4667-8435-18b562ed191e req-7ddc5048-7c7c-4612-8d4f-7c46ee777639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24929ae5-b7e1-4ccc-b7aa-9229fa92c614", "name": "network-vif-deleted", "tag": "121a1ff1-f3f1-46f8-a4a0-f3c0cb6c625c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:26.532023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-547a09a4-75b1-4667-8435-18b562ed191e req-7ddc5048-7c7c-4612-8d4f-7c46ee777639 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:26.538749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-547a09a4-75b1-4667-8435-18b562ed191e req-7ddc5048-7c7c-4612-8d4f-7c46ee777639 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:26.539245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-547a09a4-75b1-4667-8435-18b562ed191e req-7ddc5048-7c7c-4612-8d4f-7c46ee777639 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:26.546411 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-34766ae5-e4aa-4a17-bf0f-4fb2e498240f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.069277 Nov 02 13:43:26.553339 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2630/5648] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:43:26 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:26.561933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b33e3bb-db0d-4bd0-99ca-a4ba15f806ec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '.version_select at 0x7fe786fd3310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:26.574685 n-d-858384-19 devstack@n-api.service[120929]: WARNING oslo_db.sqlalchemy.utils [None req-9b33e3bb-db0d-4bd0-99ca-a4ba15f806ec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 13:43:26.585151 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b33e3bb-db0d-4bd0-99ca-a4ba15f806ec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.030353 Nov 02 13:43:26.592733 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2631/5649] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:43:26 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:26.595880 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-547a09a4-75b1-4667-8435-18b562ed191e req-7ddc5048-7c7c-4612-8d4f-7c46ee777639 service nova] Creating event network-vif-deleted:121a1ff1-f3f1-46f8-a4a0-f3c0cb6c625c for instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 on n-h2-858384-19 Nov 02 13:43:26.624915 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-547a09a4-75b1-4667-8435-18b562ed191e req-7ddc5048-7c7c-4612-8d4f-7c46ee777639 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119541 Nov 02 13:43:26.626907 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3019/5650] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:43:26.766977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1520927834", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "key_name": "tempest-key-2066511212", "networks": [{"uuid": "e2a90dcb-325f-44c1-b30e-ebec60ce1358"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:26.868914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] validate_networks() for [('e2a90dcb-325f-44c1-b30e-ebec60ce1358', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:27.430404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:27.432677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:27.442743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.443493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.445464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.446489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.447952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.448574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.473328 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] HTTP exception thrown: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Request method failure captured: Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 HTTP/1.1 Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHuSNcPxkmMXWkj7-jh5s6q2etFyI21tJAdj2sGxkhQe0gQ1gPSUhnFgKWfFxu8l7eD2TadND-vfDOGldgWczShNSNApnMVHhi7izQmKs-mEnIeMUbIkCFWs5BeNpp2SiZr6KH8yDG6e2TMF_l2PKwhGbTokmwpI5i5sDlaUEgcu_k Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0d4a470b46934c96845dd659f4752b3b Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '24929ae5-b7e1-4ccc-b7aa-9229fa92c614'} Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:27.475920 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:27.480969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:27.480969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:27.480969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:27.480969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:27.480969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:27.480969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:27.480969 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:27.482993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Returning 404 to user: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:27.483921 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-892f6d73-3a01-49d8-a008-2dc3cadee3bb tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 404 len: 111 microversion: 2.1 time: 0.060194 Nov 02 13:43:27.485460 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3020/5651] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:27 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:43:27.496744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:27.498349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:27.499033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:27.499672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:27.500202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:27.506109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d675750c-428c-4bcf-b0a9-2c45dbdf64fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '.version_select at 0x7fe785ff31f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:27.517551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.518203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.518742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.519789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:27.520459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:27.521356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:27.544713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d675750c-428c-4bcf-b0a9-2c45dbdf64fa tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460930157" status: 202 len: 0 microversion: 2.1 time: 0.054694 Nov 02 13:43:27.545758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:27.549035 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3021/5652] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:43:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460930157 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:43:27.556427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for user f883a8edef9b47319dc828211e497fe7 and project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:27.572365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:27.574943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:27.659294 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-544fe55c-8dc9-41ba-b748-c6df5513976f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.896040 Nov 02 13:43:27.660829 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2632/5653] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:43:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:43:27.676121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f7d43a02-981b-4360-995c-4845c72341af tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:27.677091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f7d43a02-981b-4360-995c-4845c72341af tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:27.792903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f7d43a02-981b-4360-995c-4845c72341af tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:27.797760 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f7d43a02-981b-4360-995c-4845c72341af tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1233 microversion: 2.1 time: 0.128831 Nov 02 13:43:27.804070 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3022/5654] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:27 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1233 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:28.826828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:28.827756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:28.842416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:28.843350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:28.844143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:28.845412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:28.846105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:28.846747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:29.137855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:29.151861 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5161712e-3951-44bf-866d-c51b34789364 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1285 microversion: 2.1 time: 0.330164 Nov 02 13:43:29.156121 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2633/5655] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:28 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1285 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:30.182617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:30.184991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:30.211829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.214082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.216403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.217319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:30.223165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:30.224160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:30.412435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:30.424536 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-882027fd-d11c-4cfe-ad20-d68a998f5177 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1291 microversion: 2.1 time: 0.247831 Nov 02 13:43:30.425241 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3023/5656] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:30 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1291 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:31.452816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:31.453431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:31.482014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.482531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.482985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.483747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:31.484208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:31.484649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:31.950179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:31.961493 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ac7c1fc7-a73e-46af-8ec7-e69b3f7656b1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1333 microversion: 2.1 time: 0.512524 Nov 02 13:43:31.962102 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2634/5657] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:31 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1333 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:32.987999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:32.988609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:33.003827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:33.004354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:33.004783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:33.005513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:33.006043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:33.006483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:33.548215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:33.560395 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4808a8ae-5fa0-4c6a-9ded-2b4bc6e0c537 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1333 microversion: 2.1 time: 0.576136 Nov 02 13:43:33.575033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3024/5658] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:32 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1333 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:34.592190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:34.593490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:34.611239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.613770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.616931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.618171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.620607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.621299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.867301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1fea8da1-6a87-413b-b909-3402c773683b req-f064babe-e7c7-4a1c-9775-53ed8688d1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebd34de4-a37a-418f-9cfa-ec64983ec253", "tag": "0eb37ef4-f3fc-4f7c-a191-c1de5d5d22f7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:34.904876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1fea8da1-6a87-413b-b909-3402c773683b req-f064babe-e7c7-4a1c-9775-53ed8688d1c8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:34.906343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1fea8da1-6a87-413b-b909-3402c773683b req-f064babe-e7c7-4a1c-9775-53ed8688d1c8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:34.906343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1fea8da1-6a87-413b-b909-3402c773683b req-f064babe-e7c7-4a1c-9775-53ed8688d1c8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:34.943160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1fea8da1-6a87-413b-b909-3402c773683b req-f064babe-e7c7-4a1c-9775-53ed8688d1c8 service nova] Creating event network-changed:0eb37ef4-f3fc-4f7c-a191-c1de5d5d22f7 for instance ebd34de4-a37a-418f-9cfa-ec64983ec253 on n-h1-858384-19 Nov 02 13:43:34.959477 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1fea8da1-6a87-413b-b909-3402c773683b req-f064babe-e7c7-4a1c-9775-53ed8688d1c8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102845 Nov 02 13:43:34.963184 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3025/5659] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:34.985418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:35.012204 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a213319-a825-4bd5-8d1b-08d2047804c6 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1333 microversion: 2.1 time: 0.422200 Nov 02 13:43:35.017728 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2635/5660] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:34 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1333 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:36.046890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:36.047679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:36.065822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:36.066492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:36.067146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:36.068025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:36.068628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:36.069196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:36.298977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:36.308543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c7b312df-307c-464d-bfac-2c4fa91fa0be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1333 microversion: 2.1 time: 0.270199 Nov 02 13:43:36.325951 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3026/5661] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:36 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1333 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:37.332769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:37.333387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:37.336292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:37.343766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.347879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.348573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:37.356294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:37.357023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:37.357644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:37.531200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:37.566007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:38.005891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:38.018297 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c4c5a35-cda8-47a5-aa8f-3274bfb6ba0f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1333 microversion: 2.1 time: 0.689385 Nov 02 13:43:38.020374 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2636/5662] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:37 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1333 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:38.703509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:38.704077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:38.707062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:38.707984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:38.732380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:38.732956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:38.733423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:38.734188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:38.734651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:38.735088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:38.773717 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] HTTP exception thrown: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Request method failure captured: Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 HTTP/1.1 Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHuSNcPxkmMXWkj7-jh5s6q2etFyI21tJAdj2sGxkhQe0gQ1gPSUhnFgKWfFxu8l7eD2TadND-vfDOGldgWczShNSNApnMVHhi7izQmKs-mEnIeMUbIkCFWs5BeNpp2SiZr6KH8yDG6e2TMF_l2PKwhGbTokmwpI5i5sDlaUEgcu_k Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0d4a470b46934c96845dd659f4752b3b Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '24929ae5-b7e1-4ccc-b7aa-9229fa92c614'} Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:38.775739 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Returning 404 to user: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:38.780147 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3d422daf-abf7-46d9-8ddd-39e0d76d7830 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "DELETE /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 404 len: 111 microversion: 2.1 time: 0.078070 Nov 02 13:43:38.785874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:38.786495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: 24929ae5-b7e1-4ccc-b7aa-9229fa92c614] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:38.788815 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3027/5663] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:43:38 2022] DELETE /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:38.814321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:38.814843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:38.815494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:38.816409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:38.816857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:38.817295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:38.843556 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] HTTP exception thrown: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Request method failure captured: Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 HTTP/1.1 Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnHuSNcPxkmMXWkj7-jh5s6q2etFyI21tJAdj2sGxkhQe0gQ1gPSUhnFgKWfFxu8l7eD2TadND-vfDOGldgWczShNSNApnMVHhi7izQmKs-mEnIeMUbIkCFWs5BeNpp2SiZr6KH8yDG6e2TMF_l2PKwhGbTokmwpI5i5sDlaUEgcu_k Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0d4a470b46934c96845dd659f4752b3b Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '24929ae5-b7e1-4ccc-b7aa-9229fa92c614'} Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:38.845364 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Returning 404 to user: Instance 24929ae5-b7e1-4ccc-b7aa-9229fa92c614 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-330e2ac2-c606-41a5-95bf-8b477874b975 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614" status: 404 len: 111 microversion: 2.1 time: 0.064979 Nov 02 13:43:38.851268 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2637/5664] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:38 2022] GET /compute/v2.1/servers/24929ae5-b7e1-4ccc-b7aa-9229fa92c614 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:43:39.044650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:39.045298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:39.055537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:39.056755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:39.057480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:39.059515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:39.061515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:39.063735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:39.303479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:39.314795 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-170312a4-172b-4c55-95fa-1c71cfc900bc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1333 microversion: 2.1 time: 0.274926 Nov 02 13:43:39.317668 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3028/5665] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:39 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1333 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:40.342722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:40.343353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:40.350090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:40.350579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:40.351016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:40.351776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:40.352227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:40.352654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:40.926490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:40.936678 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0252c601-4afa-4ee5-8f8f-32d25e3a08ff tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1333 microversion: 2.1 time: 0.597979 Nov 02 13:43:40.951137 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2638/5666] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:40 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1333 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:41.073267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8db0ba7c-71e9-4de9-b71e-f04b319f0059 req-1edfdbd0-79ac-4dea-b44a-a984dec6632c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd34de4-a37a-418f-9cfa-ec64983ec253", "name": "network-vif-plugged", "status": "completed", "tag": "0eb37ef4-f3fc-4f7c-a191-c1de5d5d22f7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:41.098922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8db0ba7c-71e9-4de9-b71e-f04b319f0059 req-1edfdbd0-79ac-4dea-b44a-a984dec6632c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:41.099649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8db0ba7c-71e9-4de9-b71e-f04b319f0059 req-1edfdbd0-79ac-4dea-b44a-a984dec6632c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:41.100519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8db0ba7c-71e9-4de9-b71e-f04b319f0059 req-1edfdbd0-79ac-4dea-b44a-a984dec6632c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:41.117941 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8db0ba7c-71e9-4de9-b71e-f04b319f0059 req-1edfdbd0-79ac-4dea-b44a-a984dec6632c service nova] Creating event network-vif-plugged:0eb37ef4-f3fc-4f7c-a191-c1de5d5d22f7 for instance ebd34de4-a37a-418f-9cfa-ec64983ec253 on n-h1-858384-19 Nov 02 13:43:41.124628 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8db0ba7c-71e9-4de9-b71e-f04b319f0059 req-1edfdbd0-79ac-4dea-b44a-a984dec6632c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058633 Nov 02 13:43:41.126415 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3029/5667] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:43:41.960187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:41.960806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:41.968776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:41.969276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:41.969721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:41.970435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:41.970892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:41.971384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.171717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:42.180165 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8a40d79f-827e-484a-b3bb-ce772b3dafb9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1333 microversion: 2.1 time: 0.223885 Nov 02 13:43:42.181954 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2639/5668] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:41 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1333 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:42.347503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:42.348159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:42.355840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.356334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.356781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.357812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.358274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.358706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.378684 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] HTTP exception thrown: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Request method failure captured: Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 HTTP/1.1 Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnHuSNcPxkmMXWkj7-jh5s6q2etFyI21tJAdj2sGxkhQe0gQ1gPSUhnFgKWfFxu8l7eD2TadND-vfDOGldgWczShNSNApnMVHhi7izQmKs-mEnIeMUbIkCFWs5BeNpp2SiZr6KH8yDG6e2TMF_l2PKwhGbTokmwpI5i5sDlaUEgcu_k Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0d4a470b46934c96845dd659f4752b3b Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e21f8474-c128-4b53-bff0-430576924452'} Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:42.380469 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Returning 404 to user: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfbd32cb-8787-439f-9222-d477c4aff649 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 404 len: 111 microversion: 2.1 time: 0.040430 Nov 02 13:43:42.385750 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3030/5669] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:43:42 2022] DELETE /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:42.393614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:42.396093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] [instance: e21f8474-c128-4b53-bff0-430576924452] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:42.403087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.403686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.404241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.405166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:42.405983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:42.406668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:42.423069 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] HTTP exception thrown: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Request method failure captured: Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 HTTP/1.1 Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnHuSNcPxkmMXWkj7-jh5s6q2etFyI21tJAdj2sGxkhQe0gQ1gPSUhnFgKWfFxu8l7eD2TadND-vfDOGldgWczShNSNApnMVHhi7izQmKs-mEnIeMUbIkCFWs5BeNpp2SiZr6KH8yDG6e2TMF_l2PKwhGbTokmwpI5i5sDlaUEgcu_k Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/caaf4dc4c8fb46e6b6497a9f289825bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: caaf4dc4c8fb46e6b6497a9f289825bf Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeTestJSON-742908409 Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 0d4a470b46934c96845dd659f4752b3b Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeTestJSON-742908409-project Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e21f8474-c128-4b53-bff0-430576924452'} Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:42.426694 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.432061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:42.432061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:42.432061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:42.432061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:42.432061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:42.432061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. Nov 02 13:43:42.432061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:42.432061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] Returning 404 to user: Instance e21f8474-c128-4b53-bff0-430576924452 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:42.434488 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7e3e0134-aa34-4cc9-9384-49e767a712d2 tempest-AttachVolumeTestJSON-742908409 tempest-AttachVolumeTestJSON-742908409-project] 10.222.0.113 "GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452" status: 404 len: 111 microversion: 2.1 time: 0.046969 Nov 02 13:43:42.435638 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2640/5670] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:42 2022] GET /compute/v2.1/servers/e21f8474-c128-4b53-bff0-430576924452 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:43.204264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:43.204890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:43.211021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.212881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.212881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.213112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.213475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.213908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.539699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:43.552192 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-601eb756-a837-4760-8b33-9c763217fbae tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1514 microversion: 2.1 time: 0.351603 Nov 02 13:43:43.552788 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3031/5671] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:43 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1514 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:43.577963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:43.578560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:43.585612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.586091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.586697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.587881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.588514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.589093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.824474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:43.836434 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eb7e20dd-cdfe-4769-9a4c-1f90ba577126 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1514 microversion: 2.1 time: 0.264592 Nov 02 13:43:43.855289 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2641/5672] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:43 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:43.862415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:43.862923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:43.869680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.870226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.870789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.871700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:43.872161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:43.872584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:43.907979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:43:43.979720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:44.089484 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-660462ea-0121-4823-b38f-e69add06d216 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 204 len: 0 microversion: 2.1 time: 0.231650 Nov 02 13:43:44.091789 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3032/5673] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:43:43 2022] DELETE /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:43:44.111458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:44.112085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:44.131396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:44.131919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:44.132546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:44.133656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:44.136019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:44.136497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:44.192683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:44.512044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:44.521049 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f2f399c-f1d3-4260-a4be-37c1aae822bb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1520 microversion: 2.1 time: 0.420705 Nov 02 13:43:44.525385 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2642/5674] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:44 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:45.551086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:45.552638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:45.566106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.566914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.567615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.568664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:45.569323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:45.570317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:45.829334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:45.842742 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3cbacd4f-298c-4b74-9497-ff220c007a3f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1520 microversion: 2.1 time: 0.296475 Nov 02 13:43:45.867016 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3033/5675] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:45 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:46.627440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-0e32177b-4f37-498d-b626-c849b23b3f6b req-1d5e98ff-0573-4cbd-a6d1-56518268c358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd34de4-a37a-418f-9cfa-ec64983ec253", "name": "network-vif-deleted", "tag": "0eb37ef4-f3fc-4f7c-a191-c1de5d5d22f7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:46.670631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0e32177b-4f37-498d-b626-c849b23b3f6b req-1d5e98ff-0573-4cbd-a6d1-56518268c358 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.678054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0e32177b-4f37-498d-b626-c849b23b3f6b req-1d5e98ff-0573-4cbd-a6d1-56518268c358 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.678526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0e32177b-4f37-498d-b626-c849b23b3f6b req-1d5e98ff-0573-4cbd-a6d1-56518268c358 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.709742 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-0e32177b-4f37-498d-b626-c849b23b3f6b req-1d5e98ff-0573-4cbd-a6d1-56518268c358 service nova] Creating event network-vif-deleted:0eb37ef4-f3fc-4f7c-a191-c1de5d5d22f7 for instance ebd34de4-a37a-418f-9cfa-ec64983ec253 on n-h1-858384-19 Nov 02 13:43:46.726439 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-0e32177b-4f37-498d-b626-c849b23b3f6b req-1d5e98ff-0573-4cbd-a6d1-56518268c358 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104485 Nov 02 13:43:46.727077 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2643/5676] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:43:46.876227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:46.878772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:46.901527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.901863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.902310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.903505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.904123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.904747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.958451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:46.958946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:46.959413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:46.960321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lazy-loading 'fault' on Instance uuid ebd34de4-a37a-418f-9cfa-ec64983ec253 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:43:47.056694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:47.071782 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c41aa5b7-17d9-4cca-b511-eff15ebbfcc8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 200 len: 1323 microversion: 2.1 time: 0.203401 Nov 02 13:43:47.073303 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3034/5677] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:46 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 1323 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:43:48.101229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:48.101995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:48.117012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:48.119876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:48.120791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:48.121496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:48.122102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:48.122669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:48.140918 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 HTTP/1.1 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'ebd34de4-a37a-418f-9cfa-ec64983ec253'} Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:43:48.143010 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:48.147413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:43:48.147413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:43:48.147413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:43:48.147413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:43:48.147413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:43:48.147413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:43:48.147413 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:43:48.148293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:43:48.149255 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-475a4e3f-31d0-4e05-a88c-4989283f0e3e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 404 len: 111 microversion: 2.1 time: 0.054171 Nov 02 13:43:48.151039 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2644/5678] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:48 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:43:48.159904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-212b25e3-c92c-42b7-a212-07f5f691623f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '.version_select at 0x7fe7860d28b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:48.194040 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-212b25e3-c92c-42b7-a212-07f5f691623f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-key-2066511212" status: 202 len: 0 microversion: 2.1 time: 0.038790 Nov 02 13:43:48.194991 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3035/5679] 10.222.0.113 () {58 vars in 1214 bytes} [Wed Nov 2 13:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2066511212 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:43:48.334678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1482286198", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "e2a90dcb-325f-44c1-b30e-ebec60ce1358"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:48.409626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] validate_networks() for [('e2a90dcb-325f-44c1-b30e-ebec60ce1358', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:43:49.468267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:43:49.473221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:43:49.473561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:43:49.474187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:43:49.474558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:43:49.485345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:49.486370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:49.486813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:49.487745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:49.488350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:49.488970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:49.543464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:43:49.573964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for user f883a8edef9b47319dc828211e497fe7 and project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:43:49.607383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:43:49.609836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:43:49.691003 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-520d092a-f3cc-408c-b082-ebd3f5df7106 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.360613 Nov 02 13:43:49.702794 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2645/5680] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:43:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:43:49.707656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efb28712-4e77-444f-b560-0e36f4a094ec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:49.709163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-efb28712-4e77-444f-b560-0e36f4a094ec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:49.826947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efb28712-4e77-444f-b560-0e36f4a094ec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:49.835127 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efb28712-4e77-444f-b560-0e36f4a094ec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1213 microversion: 2.1 time: 0.131559 Nov 02 13:43:49.837126 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3036/5681] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:49 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:50.866363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:50.867159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:50.887782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.888523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.889342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:50.890637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:50.902836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:50.905163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:51.090230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:51.099738 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc892786-4a56-401e-b0fa-e977870dcaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1265 microversion: 2.1 time: 0.240703 Nov 02 13:43:51.101697 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2646/5682] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:50 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:52.130528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:52.131264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:52.142010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.142507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.142952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.143795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:52.144297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:52.144679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:52.278038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:52.294515 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5404e366-6e22-4523-a8b5-f81021c41f11 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1271 microversion: 2.1 time: 0.164682 Nov 02 13:43:52.295210 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3037/5683] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:52 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:53.320807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:53.323050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:53.342591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.343410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.345333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.347247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:53.348940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:53.349833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:53.922481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:53.936938 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-986d1c35-a1c5-4772-a446-3daef37f7613 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1313 microversion: 2.1 time: 0.621554 Nov 02 13:43:53.945341 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2647/5684] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:53 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:54.969998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:54.970521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:54.982019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:54.982558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:54.983168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:54.983784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:54.984352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:54.984671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:55.383840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6759f9dd-f411-41d8-acf2-2611eea0bafa req-3e229c99-3e68-4c22-bc6a-333d80193b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9dd9263-e23f-4b02-af77-bee6a251194a", "tag": "08f65a60-99b2-4b1a-bcce-0a6b3ddb2a94"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:43:55.403633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6759f9dd-f411-41d8-acf2-2611eea0bafa req-3e229c99-3e68-4c22-bc6a-333d80193b9c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:55.404179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6759f9dd-f411-41d8-acf2-2611eea0bafa req-3e229c99-3e68-4c22-bc6a-333d80193b9c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:55.410227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6759f9dd-f411-41d8-acf2-2611eea0bafa req-3e229c99-3e68-4c22-bc6a-333d80193b9c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:55.436248 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6759f9dd-f411-41d8-acf2-2611eea0bafa req-3e229c99-3e68-4c22-bc6a-333d80193b9c service nova] Creating event network-changed:08f65a60-99b2-4b1a-bcce-0a6b3ddb2a94 for instance c9dd9263-e23f-4b02-af77-bee6a251194a on n-h1-858384-19 Nov 02 13:43:55.453647 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6759f9dd-f411-41d8-acf2-2611eea0bafa req-3e229c99-3e68-4c22-bc6a-333d80193b9c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074576 Nov 02 13:43:55.455092 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2648/5685] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:43:55.848500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:55.863086 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1ff847e8-73b4-497a-8770-30218e972f3c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1313 microversion: 2.1 time: 0.898200 Nov 02 13:43:55.878048 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3038/5686] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:54 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1313 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:56.889039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:56.889758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:56.904843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.905404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.906127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:56.907818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:56.910348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:56.911253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:57.080289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:57.090927 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f02f5796-1f73-44c6-ab09-83f4876de503 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1313 microversion: 2.1 time: 0.207013 Nov 02 13:43:57.108067 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2649/5687] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:56 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:58.120550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:58.121281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:58.124393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4691ef04-ac54-4232-9a2e-6bb4e4b16d7f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:58.125813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4691ef04-ac54-4232-9a2e-6bb4e4b16d7f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:58.129532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.130189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.130642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.131389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.131852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.132293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.135699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4691ef04-ac54-4232-9a2e-6bb4e4b16d7f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.136498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4691ef04-ac54-4232-9a2e-6bb4e4b16d7f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.137155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4691ef04-ac54-4232-9a2e-6bb4e4b16d7f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.139203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4691ef04-ac54-4232-9a2e-6bb4e4b16d7f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:58.140681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4691ef04-ac54-4232-9a2e-6bb4e4b16d7f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:58.141548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4691ef04-ac54-4232-9a2e-6bb4e4b16d7f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:58.178774 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4691ef04-ac54-4232-9a2e-6bb4e4b16d7f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/ips" status: 200 len: 150 microversion: 2.1 time: 0.061205 Nov 02 13:43:58.180031 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2650/5688] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:43:58 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/ips => generated 150 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:43:58.441714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:58.456099 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-242a8e13-0c89-4cd3-aeae-14d542c8e90d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1313 microversion: 2.1 time: 0.344608 Nov 02 13:43:58.457487 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3039/5689] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:58 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:43:59.485889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:43:59.487082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:43:59.500937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:59.502496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:59.503375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:59.505328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:43:59.506912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:43:59.508397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:43:59.561302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:59.597386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:43:59.772603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:43:59.781305 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe283b78-3c27-4a48-8512-4107407db57b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1313 microversion: 2.1 time: 0.300201 Nov 02 13:43:59.781896 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2651/5690] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:43:59 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:00.809832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:00.817987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:00.829876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:00.863265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.863923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.864526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.865399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.865996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.866564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.892334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc270101-e528-4ca7-a4d5-2a414e039ad8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "759f2b98-27e9-42c6-a4d8-5bf2d66021f1"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:00.896144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc270101-e528-4ca7-a4d5-2a414e039ad8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:00.907620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc270101-e528-4ca7-a4d5-2a414e039ad8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.908230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc270101-e528-4ca7-a4d5-2a414e039ad8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.908696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc270101-e528-4ca7-a4d5-2a414e039ad8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:00.909467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc270101-e528-4ca7-a4d5-2a414e039ad8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:00.910083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc270101-e528-4ca7-a4d5-2a414e039ad8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:00.910534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc270101-e528-4ca7-a4d5-2a414e039ad8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:01.164043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:01.179910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5415d459-b1d8-4285-aecd-8f555db1e342 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1313 microversion: 2.1 time: 0.376295 Nov 02 13:44:01.190567 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3040/5691] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:00 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:01.406986 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc270101-e528-4ca7-a4d5-2a414e039ad8 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "POST /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518030 Nov 02 13:44:01.416244 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2652/5692] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:44:00 2022] POST /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:02.207261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:02.208314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:02.221967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.222506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.223321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.224299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:02.225127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:02.225843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:02.478175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:02.491383 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1d9467e0-00a5-4100-90c7-d811a0d1b379 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1313 microversion: 2.1 time: 0.287217 Nov 02 13:44:02.507343 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3041/5693] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:02 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:03.531624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:03.537485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:03.557884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.561972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.562613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.565514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.567246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.567886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.921477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f49c9d2c-755b-48d8-874a-2839bbf7edbe req-5897bcf3-291d-4dd9-9467-45dc97302b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9dd9263-e23f-4b02-af77-bee6a251194a", "name": "network-vif-plugged", "status": "completed", "tag": "08f65a60-99b2-4b1a-bcce-0a6b3ddb2a94"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:03.957437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f49c9d2c-755b-48d8-874a-2839bbf7edbe req-5897bcf3-291d-4dd9-9467-45dc97302b5c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:03.958877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f49c9d2c-755b-48d8-874a-2839bbf7edbe req-5897bcf3-291d-4dd9-9467-45dc97302b5c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:03.960080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f49c9d2c-755b-48d8-874a-2839bbf7edbe req-5897bcf3-291d-4dd9-9467-45dc97302b5c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:03.993627 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f49c9d2c-755b-48d8-874a-2839bbf7edbe req-5897bcf3-291d-4dd9-9467-45dc97302b5c service nova] Creating event network-vif-plugged:08f65a60-99b2-4b1a-bcce-0a6b3ddb2a94 for instance c9dd9263-e23f-4b02-af77-bee6a251194a on n-h1-858384-19 Nov 02 13:44:04.013605 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f49c9d2c-755b-48d8-874a-2839bbf7edbe req-5897bcf3-291d-4dd9-9467-45dc97302b5c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092188 Nov 02 13:44:04.015576 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3042/5694] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:04.312591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:04.321232 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c51d12e5-2a86-42ce-a3f9-f0687c373c7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1313 microversion: 2.1 time: 0.806493 Nov 02 13:44:04.321830 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2653/5695] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:03 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1313 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:05.346573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:05.347506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:05.364454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.365519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.375684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.376738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:05.378096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:05.378861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:05.716697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:05.725355 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d943d68c-43eb-4013-8dbf-fde9dc903d36 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1313 microversion: 2.1 time: 0.384056 Nov 02 13:44:05.728732 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3043/5696] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:05 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:06.757897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:06.759482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:06.780278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:06.781333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:06.781966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:06.783772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:06.784904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:06.786097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:07.291275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:07.307015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b148c9aa-7fda-46da-be3c-e41e7304749f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1494 microversion: 2.1 time: 0.558909 Nov 02 13:44:07.317441 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2654/5697] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:06 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1494 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:07.496768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1482286198", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "e2a90dcb-325f-44c1-b30e-ebec60ce1358"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:07.598401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] validate_networks() for [('e2a90dcb-325f-44c1-b30e-ebec60ce1358', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:44:08.267734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:44:08.268428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:44:08.270062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:44:08.270729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:44:08.271490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:44:08.283833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.284874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.285555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.286619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:08.287367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:08.288260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:08.313025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:08.322791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for user f883a8edef9b47319dc828211e497fe7 and project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:08.344609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:44:08.348220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:44:08.467199 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5b263380-69b3-4679-b61a-9698334b1770 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.975125 Nov 02 13:44:08.470113 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3044/5698] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:44:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:44:08.489985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c2fb8c1b-1d67-4332-8053-c94d91cd175a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:08.500125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c2fb8c1b-1d67-4332-8053-c94d91cd175a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:08.545311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:08.750170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c2fb8c1b-1d67-4332-8053-c94d91cd175a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:08.793063 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c2fb8c1b-1d67-4332-8053-c94d91cd175a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1213 microversion: 2.1 time: 0.313364 Nov 02 13:44:08.807683 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2655/5699] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:08 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1213 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:09.825967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:09.826804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:09.842432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:09.848032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.850465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.851180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:09.854724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:09.857865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:09.858558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:09.983401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:09.998587 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1f97d9f9-670d-47ed-8183-ec1dfd7d4daf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1265 microversion: 2.1 time: 0.182606 Nov 02 13:44:09.999668 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3045/5700] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:09 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:11.008387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:11.010230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:11.028108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:11.028745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:11.035322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.043040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.046629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.047182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.048065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:11.051938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:11.053442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.053955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.054409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:11.060596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.061289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.061747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:11.136489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:44:11.236550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:11.251764 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74913b17-022d-483d-92e8-06cfdf7dd161 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1271 microversion: 2.1 time: 0.229529 Nov 02 13:44:11.256457 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3046/5701] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:11 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:11.333579 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-168ac645-a379-484e-be48-4ac4d41af0bb tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "DELETE /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 204 len: 0 microversion: 2.42 time: 0.749485 Nov 02 13:44:11.340691 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2656/5702] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:44:10 2022] DELETE /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:44:11.352228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:11.353133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:11.362165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.362668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.363158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:11.364804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:11.368018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:11.369420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:12.125647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:12.140436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:12.142578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:12.143942 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c62570ba-b830-4631-af51-bcb43bae7e83 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 2966 microversion: 2.42 time: 0.799745 Nov 02 13:44:12.144524 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3047/5703] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:11 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 2966 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:12.277802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:12.278724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:12.287905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:12.288640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:12.290006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:12.290759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:12.291294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:12.292530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:12.543993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:12.553333 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-84e165ea-d0ef-437f-998f-9b1de618664a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1313 microversion: 2.1 time: 0.280571 Nov 02 13:44:12.569195 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2657/5704] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:12 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:13.187471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:13.188890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:13.200295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:13.201334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:13.201963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:13.204119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:13.207714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:13.208171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:13.580807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:13.582056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:13.605424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:13.606156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:13.609974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:13.611191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:13.612121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:13.612729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:14.008081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:14.016801 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-260c8aca-5ba8-499e-b107-2bf4fa3e2e1b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1313 microversion: 2.1 time: 0.440470 Nov 02 13:44:14.018093 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2658/5705] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:13 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:14.124670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:14.137699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:14.143882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:14.145602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:14.146934 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1fa32a8a-d5fd-4003-9aa1-6e8f552cd62c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 2966 microversion: 2.42 time: 0.964452 Nov 02 13:44:14.152181 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3048/5706] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:13 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 2966 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:15.044067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:15.044663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:15.058575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.059079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.070742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.071721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.074157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.079608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.090749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:15.174871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-aa6e9b95-6e1c-446f-8379-24d493604868 req-5d2162ea-506e-474e-a819-372b0db88362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6ef169-22ef-40bf-b46d-850022099af7", "tag": "979e4ca8-d468-4fbe-9872-685752de542e"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:15.187730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-aa6e9b95-6e1c-446f-8379-24d493604868 req-5d2162ea-506e-474e-a819-372b0db88362 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.188614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-aa6e9b95-6e1c-446f-8379-24d493604868 req-5d2162ea-506e-474e-a819-372b0db88362 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.189293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-aa6e9b95-6e1c-446f-8379-24d493604868 req-5d2162ea-506e-474e-a819-372b0db88362 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.203901 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-aa6e9b95-6e1c-446f-8379-24d493604868 req-5d2162ea-506e-474e-a819-372b0db88362 service nova] Creating event network-changed:979e4ca8-d468-4fbe-9872-685752de542e for instance ab6ef169-22ef-40bf-b46d-850022099af7 on n-h2-858384-19 Nov 02 13:44:15.209700 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-aa6e9b95-6e1c-446f-8379-24d493604868 req-5d2162ea-506e-474e-a819-372b0db88362 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038460 Nov 02 13:44:15.212341 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3049/5707] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:44:15.221794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:15.222748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:15.229367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.229868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.230311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.231023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:15.231668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:15.232387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:15.552417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:15.569419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:15.572479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:15.575061 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ddb35ebe-697f-4bf8-afb8-43273a9ef8fa tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 2966 microversion: 2.42 time: 0.360189 Nov 02 13:44:15.576183 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3050/5708] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:15 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 2966 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:15.740181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:15.750704 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-347584cb-7d67-489e-aad3-2c34c123182e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1313 microversion: 2.1 time: 0.712338 Nov 02 13:44:15.770111 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2659/5709] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:15 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1313 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:16.195732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.196309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:16.203261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.203747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.204214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.204899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.205352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.205789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.310421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lazy-loading 'services' on Instance uuid 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:44:16.409280 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5cb24938-71d6-4c28-8bea-839e3eab8c88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments/759f2b98-27e9-42c6-a4d8-5bf2d66021f1" status: 202 len: 0 microversion: 2.1 time: 0.216380 Nov 02 13:44:16.411021 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3051/5710] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:44:16 2022] DELETE /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments/759f2b98-27e9-42c6-a4d8-5bf2d66021f1 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:44:16.419677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b3ee084b-b4fc-40da-bcb9-936049c8a1cf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.425054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b3ee084b-b4fc-40da-bcb9-936049c8a1cf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:16.438710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3ee084b-b4fc-40da-bcb9-936049c8a1cf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.440083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3ee084b-b4fc-40da-bcb9-936049c8a1cf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.441207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3ee084b-b4fc-40da-bcb9-936049c8a1cf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.442163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3ee084b-b4fc-40da-bcb9-936049c8a1cf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.442821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3ee084b-b4fc-40da-bcb9-936049c8a1cf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.443492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3ee084b-b4fc-40da-bcb9-936049c8a1cf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.497608 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b3ee084b-b4fc-40da-bcb9-936049c8a1cf tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082601 Nov 02 13:44:16.499328 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2660/5711] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:44:16 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:16.607901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.608905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:16.617610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.618638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.620030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.621035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.621738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.622565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.775456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:16.776366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:16.785775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.786775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.788472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:16.790617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:16.791406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:16.792049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.346410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:17.357810 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e8e9510f-c605-453a-b7a0-d2252fb01f1d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1313 microversion: 2.1 time: 0.587644 Nov 02 13:44:17.368162 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2661/5712] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:16 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:17.410222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5b2e27ec-545b-4885-9bd0-4a6ea0252a14 req-6653bb98-3c35-477d-b73d-c4176f6d5b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-unplugged", "status": "completed", "tag": "6e67bb33-ef7e-44f8-b657-358f6fcace76"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:17.427559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5b2e27ec-545b-4885-9bd0-4a6ea0252a14 req-6653bb98-3c35-477d-b73d-c4176f6d5b93 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.429756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5b2e27ec-545b-4885-9bd0-4a6ea0252a14 req-6653bb98-3c35-477d-b73d-c4176f6d5b93 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.431099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5b2e27ec-545b-4885-9bd0-4a6ea0252a14 req-6653bb98-3c35-477d-b73d-c4176f6d5b93 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.456682 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5b2e27ec-545b-4885-9bd0-4a6ea0252a14 req-6653bb98-3c35-477d-b73d-c4176f6d5b93 service nova] Creating event network-vif-unplugged:6e67bb33-ef7e-44f8-b657-358f6fcace76 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:17.464923 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5b2e27ec-545b-4885-9bd0-4a6ea0252a14 req-6653bb98-3c35-477d-b73d-c4176f6d5b93 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059023 Nov 02 13:44:17.466040 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2662/5713] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:17.513786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-01eeee42-9240-49c7-ba7b-d532eef47801 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:17.516165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-01eeee42-9240-49c7-ba7b-d532eef47801 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:17.532480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01eeee42-9240-49c7-ba7b-d532eef47801 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.533004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01eeee42-9240-49c7-ba7b-d532eef47801 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.536739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01eeee42-9240-49c7-ba7b-d532eef47801 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.537581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01eeee42-9240-49c7-ba7b-d532eef47801 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:17.538078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01eeee42-9240-49c7-ba7b-d532eef47801 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:17.538525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01eeee42-9240-49c7-ba7b-d532eef47801 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:17.627689 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-01eeee42-9240-49c7-ba7b-d532eef47801 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120102 Nov 02 13:44:17.636484 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2663/5714] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:44:17 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:17.797506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:17.818672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:17.825898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:17.829410 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7326d227-af6e-462b-8cd9-63c32553c058 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 2924 microversion: 2.42 time: 1.225962 Nov 02 13:44:17.830408 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3052/5715] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:16 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 2924 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:18.396428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:18.397361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:18.411057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.415001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.419671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.420708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.421264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.421771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.650081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1efa216-2249-49b3-8bc6-7ca4db14c089 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:18.650081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1efa216-2249-49b3-8bc6-7ca4db14c089 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:18.668751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:18.669705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:18.699160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1efa216-2249-49b3-8bc6-7ca4db14c089 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.700067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1efa216-2249-49b3-8bc6-7ca4db14c089 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.701011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1efa216-2249-49b3-8bc6-7ca4db14c089 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.702008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1efa216-2249-49b3-8bc6-7ca4db14c089 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.702698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1efa216-2249-49b3-8bc6-7ca4db14c089 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.703377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1efa216-2249-49b3-8bc6-7ca4db14c089 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.757149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:18.766451 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1efa216-2249-49b3-8bc6-7ca4db14c089 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129036 Nov 02 13:44:18.772166 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3053/5716] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:44:18 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:44:18.782761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:18.797196 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-500f364e-a55c-4df5-9e5a-bfe6551f8848 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1313 microversion: 2.1 time: 0.405394 Nov 02 13:44:18.801084 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2664/5717] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:18 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:18.861802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:18.863761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:18.893103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.894784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.895539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:18.899588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:18.901776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:18.904438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.424539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-2cb6d209-b3d1-4af3-af52-d1f10ed99c82 req-6d802fe6-185e-4d2d-b3e1-bacbdfb0147c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-deleted", "tag": "6e67bb33-ef7e-44f8-b657-358f6fcace76"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:19.451065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2cb6d209-b3d1-4af3-af52-d1f10ed99c82 req-6d802fe6-185e-4d2d-b3e1-bacbdfb0147c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.451569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2cb6d209-b3d1-4af3-af52-d1f10ed99c82 req-6d802fe6-185e-4d2d-b3e1-bacbdfb0147c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.451998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2cb6d209-b3d1-4af3-af52-d1f10ed99c82 req-6d802fe6-185e-4d2d-b3e1-bacbdfb0147c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.488842 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-2cb6d209-b3d1-4af3-af52-d1f10ed99c82 req-6d802fe6-185e-4d2d-b3e1-bacbdfb0147c service nova] Creating event network-vif-deleted:6e67bb33-ef7e-44f8-b657-358f6fcace76 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:19.495438 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-2cb6d209-b3d1-4af3-af52-d1f10ed99c82 req-6d802fe6-185e-4d2d-b3e1-bacbdfb0147c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270456 Nov 02 13:44:19.496244 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2665/5718] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:44:19.596137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7eeaa8d4-8e36-4e96-8403-bd5579f5e15d req-1a71cf91-8898-4d03-922c-b5eed5760c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-unplugged", "status": "completed", "tag": "73d16813-eb06-4ed3-a474-c5a0a0fc8989"}, {"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-unplugged", "status": "completed", "tag": "fdd3b4be-ad92-43da-ad44-b7b675e78b9d"}, {"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-unplugged", "status": "completed", "tag": "eff1b854-90e0-44a2-85d1-8014a6f1d2e6"}, {"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-unplugged", "status": "completed", "tag": "2d74b6f6-a4a2-4b1c-90ef-23ce37676e10"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:19.613532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7eeaa8d4-8e36-4e96-8403-bd5579f5e15d req-1a71cf91-8898-4d03-922c-b5eed5760c2c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.614015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7eeaa8d4-8e36-4e96-8403-bd5579f5e15d req-1a71cf91-8898-4d03-922c-b5eed5760c2c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.619720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7eeaa8d4-8e36-4e96-8403-bd5579f5e15d req-1a71cf91-8898-4d03-922c-b5eed5760c2c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.645465 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7eeaa8d4-8e36-4e96-8403-bd5579f5e15d req-1a71cf91-8898-4d03-922c-b5eed5760c2c service nova] Creating event network-vif-unplugged:73d16813-eb06-4ed3-a474-c5a0a0fc8989 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:19.646041 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7eeaa8d4-8e36-4e96-8403-bd5579f5e15d req-1a71cf91-8898-4d03-922c-b5eed5760c2c service nova] Creating event network-vif-unplugged:fdd3b4be-ad92-43da-ad44-b7b675e78b9d for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:19.646554 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7eeaa8d4-8e36-4e96-8403-bd5579f5e15d req-1a71cf91-8898-4d03-922c-b5eed5760c2c service nova] Creating event network-vif-unplugged:eff1b854-90e0-44a2-85d1-8014a6f1d2e6 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:19.647052 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7eeaa8d4-8e36-4e96-8403-bd5579f5e15d req-1a71cf91-8898-4d03-922c-b5eed5760c2c service nova] Creating event network-vif-unplugged:2d74b6f6-a4a2-4b1c-90ef-23ce37676e10 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:19.668651 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7eeaa8d4-8e36-4e96-8403-bd5579f5e15d req-1a71cf91-8898-4d03-922c-b5eed5760c2c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.077045 Nov 02 13:44:19.669413 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2666/5719] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:44:19.747971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:19.761400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:19.764545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:19.765853 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b5bb1332-c5b2-45d5-82e2-bc9e01974f44 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 2877 microversion: 2.42 time: 0.909368 Nov 02 13:44:19.766626 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3054/5720] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:18 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 2877 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:19.783456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d0a0c8e-810a-4fb9-8a7f-da83811b87c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:19.791407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1d0a0c8e-810a-4fb9-8a7f-da83811b87c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:19.799605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d0a0c8e-810a-4fb9-8a7f-da83811b87c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.800312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d0a0c8e-810a-4fb9-8a7f-da83811b87c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.801432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d0a0c8e-810a-4fb9-8a7f-da83811b87c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.802314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d0a0c8e-810a-4fb9-8a7f-da83811b87c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.803582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d0a0c8e-810a-4fb9-8a7f-da83811b87c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.804194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d0a0c8e-810a-4fb9-8a7f-da83811b87c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.823036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:19.824003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:19.834516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.837509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.839926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.842236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:19.842887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:19.844536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:19.904078 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d0a0c8e-810a-4fb9-8a7f-da83811b87c2 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127661 Nov 02 13:44:19.906045 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2667/5721] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:44:19 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:20.223335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:20.235698 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a0e551ac-aa76-4dbc-8454-3a0be67b44cc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1313 microversion: 2.1 time: 0.418347 Nov 02 13:44:20.236849 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3055/5722] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:19 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:20.798867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:20.800290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:20.820763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.829467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.831751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.833904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.835187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.838300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.918062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-950decf9-a747-400e-afdb-d681a5ffbcc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:20.922645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-950decf9-a747-400e-afdb-d681a5ffbcc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:20.937640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-950decf9-a747-400e-afdb-d681a5ffbcc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.938513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-950decf9-a747-400e-afdb-d681a5ffbcc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.939286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-950decf9-a747-400e-afdb-d681a5ffbcc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:20.940451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-950decf9-a747-400e-afdb-d681a5ffbcc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:20.941877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-950decf9-a747-400e-afdb-d681a5ffbcc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:20.942584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-950decf9-a747-400e-afdb-d681a5ffbcc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.032498 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-950decf9-a747-400e-afdb-d681a5ffbcc7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119263 Nov 02 13:44:21.040052 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3056/5723] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:44:20 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:21.265205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:21.265878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:21.282921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:21.288011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:21.289922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.293128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:21.296992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:21.301899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.608789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:21.619530 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9b0d03e7-541f-4264-84b9-c0e7a6cebf7f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1313 microversion: 2.1 time: 0.360356 Nov 02 13:44:21.620121 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3057/5724] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:21 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:21.640330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-873db911-7af2-4104-ad0b-6ba9a04bd783 req-2f9cbb65-e086-4c50-9eed-6c6a9e6fc8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-deleted", "tag": "73d16813-eb06-4ed3-a474-c5a0a0fc8989"}, {"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-deleted", "tag": "fdd3b4be-ad92-43da-ad44-b7b675e78b9d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:21.667958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-873db911-7af2-4104-ad0b-6ba9a04bd783 req-2f9cbb65-e086-4c50-9eed-6c6a9e6fc8b7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:21.668446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-873db911-7af2-4104-ad0b-6ba9a04bd783 req-2f9cbb65-e086-4c50-9eed-6c6a9e6fc8b7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:21.668881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-873db911-7af2-4104-ad0b-6ba9a04bd783 req-2f9cbb65-e086-4c50-9eed-6c6a9e6fc8b7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:21.691202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:21.705758 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-873db911-7af2-4104-ad0b-6ba9a04bd783 req-2f9cbb65-e086-4c50-9eed-6c6a9e6fc8b7 service nova] Creating event network-vif-deleted:73d16813-eb06-4ed3-a474-c5a0a0fc8989 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:21.713259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:21.714884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:21.718198 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-31d88554-9152-42d0-a9a5-6e2b0a467f20 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 2783 microversion: 2.42 time: 0.922090 Nov 02 13:44:21.718803 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2668/5725] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:20 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 2783 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:44:21.721706 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-873db911-7af2-4104-ad0b-6ba9a04bd783 req-2f9cbb65-e086-4c50-9eed-6c6a9e6fc8b7 service nova] Creating event network-vif-deleted:fdd3b4be-ad92-43da-ad44-b7b675e78b9d for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:21.738038 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-873db911-7af2-4104-ad0b-6ba9a04bd783 req-2f9cbb65-e086-4c50-9eed-6c6a9e6fc8b7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110365 Nov 02 13:44:21.743855 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3058/5726] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:22.052759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ca8d944b-c0b2-47bb-a572-d50c267bc9ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:22.057120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ca8d944b-c0b2-47bb-a572-d50c267bc9ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:22.066920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca8d944b-c0b2-47bb-a572-d50c267bc9ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.067848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca8d944b-c0b2-47bb-a572-d50c267bc9ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.068502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca8d944b-c0b2-47bb-a572-d50c267bc9ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.070691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca8d944b-c0b2-47bb-a572-d50c267bc9ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.071457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca8d944b-c0b2-47bb-a572-d50c267bc9ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.072799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca8d944b-c0b2-47bb-a572-d50c267bc9ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.131295 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ca8d944b-c0b2-47bb-a572-d50c267bc9ce tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083870 Nov 02 13:44:22.137492 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2669/5727] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:44:22 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:22.645970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:22.646843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:22.657002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.674260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.677862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.678736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.680687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.680687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.752346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:22.753118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:22.762764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.768246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.771722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:22.776168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:22.779088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:22.780465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:23.041626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:23.053213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:23.055293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:23.056658 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-67b5022d-7bec-4e0b-9791-8127dba935e4 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 2509 microversion: 2.42 time: 0.308743 Nov 02 13:44:23.068386 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2670/5728] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:22 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 2509 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:44:23.146275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6d4fabc-b7ab-4f04-9885-881654760ea7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:23.149816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6d4fabc-b7ab-4f04-9885-881654760ea7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:23.171305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d4fabc-b7ab-4f04-9885-881654760ea7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:23.171896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d4fabc-b7ab-4f04-9885-881654760ea7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:23.173746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d4fabc-b7ab-4f04-9885-881654760ea7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:23.176071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d4fabc-b7ab-4f04-9885-881654760ea7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:23.178290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d4fabc-b7ab-4f04-9885-881654760ea7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:23.178818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d4fabc-b7ab-4f04-9885-881654760ea7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:23.248665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:23.257432 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00fac2d9-b3c1-4419-a3ca-40d364ad9649 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1313 microversion: 2.1 time: 0.615932 Nov 02 13:44:23.258033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3059/5729] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:22 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:23.277094 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6d4fabc-b7ab-4f04-9885-881654760ea7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136647 Nov 02 13:44:23.286446 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2671/5730] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:44:23 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:23.458962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9b1939dc-cc2c-44dc-83ff-d5a3e4af3199 req-aaf42b55-fdf4-4755-aef3-ca007839ab9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6ef169-22ef-40bf-b46d-850022099af7", "name": "network-vif-plugged", "status": "completed", "tag": "979e4ca8-d468-4fbe-9872-685752de542e"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:23.478923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9b1939dc-cc2c-44dc-83ff-d5a3e4af3199 req-aaf42b55-fdf4-4755-aef3-ca007839ab9f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:23.481181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9b1939dc-cc2c-44dc-83ff-d5a3e4af3199 req-aaf42b55-fdf4-4755-aef3-ca007839ab9f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:23.482048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9b1939dc-cc2c-44dc-83ff-d5a3e4af3199 req-aaf42b55-fdf4-4755-aef3-ca007839ab9f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:23.522985 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9b1939dc-cc2c-44dc-83ff-d5a3e4af3199 req-aaf42b55-fdf4-4755-aef3-ca007839ab9f service nova] Creating event network-vif-plugged:979e4ca8-d468-4fbe-9872-685752de542e for instance ab6ef169-22ef-40bf-b46d-850022099af7 on n-h2-858384-19 Nov 02 13:44:23.535298 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9b1939dc-cc2c-44dc-83ff-d5a3e4af3199 req-aaf42b55-fdf4-4755-aef3-ca007839ab9f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079191 Nov 02 13:44:23.539047 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3060/5731] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:23.810526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a7db5e7a-9407-4ad5-805a-762cc530a72b req-78798766-e57a-4827-a818-2b9aecfbed50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-deleted", "tag": "eff1b854-90e0-44a2-85d1-8014a6f1d2e6"}, {"server_uuid": "157806f8-e608-431a-bf41-6497729ea2f3", "name": "network-vif-deleted", "tag": "2d74b6f6-a4a2-4b1c-90ef-23ce37676e10"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:23.825653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a7db5e7a-9407-4ad5-805a-762cc530a72b req-78798766-e57a-4827-a818-2b9aecfbed50 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:23.826495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a7db5e7a-9407-4ad5-805a-762cc530a72b req-78798766-e57a-4827-a818-2b9aecfbed50 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:23.827193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a7db5e7a-9407-4ad5-805a-762cc530a72b req-78798766-e57a-4827-a818-2b9aecfbed50 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:23.840126 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a7db5e7a-9407-4ad5-805a-762cc530a72b req-78798766-e57a-4827-a818-2b9aecfbed50 service nova] Creating event network-vif-deleted:eff1b854-90e0-44a2-85d1-8014a6f1d2e6 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:23.841025 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a7db5e7a-9407-4ad5-805a-762cc530a72b req-78798766-e57a-4827-a818-2b9aecfbed50 service nova] Creating event network-vif-deleted:2d74b6f6-a4a2-4b1c-90ef-23ce37676e10 for instance 157806f8-e608-431a-bf41-6497729ea2f3 on n-h2-858384-19 Nov 02 13:44:23.847306 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a7db5e7a-9407-4ad5-805a-762cc530a72b req-78798766-e57a-4827-a818-2b9aecfbed50 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042643 Nov 02 13:44:23.848501 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2672/5732] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:24.097396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:24.100230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:24.116308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.117660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.118279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.119233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.120473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.121676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.228476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:24.246473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:24.248026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:24.254140 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7bf1e7ee-ff5e-4623-9bc1-39ae75602dd3 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.158340 Nov 02 13:44:24.254785 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3061/5733] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:24 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:24.290269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:24.291663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:24.295569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2a5d707-537c-4ff5-8f67-d0b1757abd4f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:24.297738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2a5d707-537c-4ff5-8f67-d0b1757abd4f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:24.298989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.299761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.300259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.301636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.302203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.302831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.310966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a5d707-537c-4ff5-8f67-d0b1757abd4f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.311563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a5d707-537c-4ff5-8f67-d0b1757abd4f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.312013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a5d707-537c-4ff5-8f67-d0b1757abd4f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.316344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a5d707-537c-4ff5-8f67-d0b1757abd4f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:24.316886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a5d707-537c-4ff5-8f67-d0b1757abd4f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:24.317336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2a5d707-537c-4ff5-8f67-d0b1757abd4f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:24.402810 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2a5d707-537c-4ff5-8f67-d0b1757abd4f tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111340 Nov 02 13:44:24.409485 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3062/5734] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:44:24 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:24.546332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:24.555034 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a945a6e-0efe-4f90-ad46-593bf66ae867 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1313 microversion: 2.1 time: 0.270415 Nov 02 13:44:24.568811 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2673/5735] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:24 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:25.280848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:25.281681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:25.290158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.290652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.292764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.293617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.294095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.294532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.422208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-82358455-1054-4014-b10f-aa18e207fb60 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:25.425622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-82358455-1054-4014-b10f-aa18e207fb60 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:25.443384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82358455-1054-4014-b10f-aa18e207fb60 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.447732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82358455-1054-4014-b10f-aa18e207fb60 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.448421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82358455-1054-4014-b10f-aa18e207fb60 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.449304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82358455-1054-4014-b10f-aa18e207fb60 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.449911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82358455-1054-4014-b10f-aa18e207fb60 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.452835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82358455-1054-4014-b10f-aa18e207fb60 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.488174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:25.498880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:25.505754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:25.507481 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1541a59-efef-4190-a74f-0b17b3faa142 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.231267 Nov 02 13:44:25.508395 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3063/5736] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:25 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:25.534595 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-82358455-1054-4014-b10f-aa18e207fb60 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116647 Nov 02 13:44:25.539531 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2674/5737] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 13:44:25 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:44:25.583000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:25.583650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:25.596731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.597284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.597732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.598464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.599098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.599384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.712394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:25.712394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:25.728934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.729438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.729881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.730612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:25.731074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:25.739679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:25.805145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:44:25.998992 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7214912f-b93b-4186-92c3-3d0066b3c526 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 204 len: 0 microversion: 2.1 time: 0.292270 Nov 02 13:44:25.999893 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2675/5738] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:44:25 2022] DELETE /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:44:26.010449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:26.011476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:26.017790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.018577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.019280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.020237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.020878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.021496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.278169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:26.282768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:26.289657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:26.294417 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03c3ac1c-213a-457c-9622-f3fddfa15a88 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1686 microversion: 2.1 time: 0.288582 Nov 02 13:44:26.297542 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2188bdcb-a789-49ab-a40d-14d2da1a762e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1495 microversion: 2.1 time: 0.715449 Nov 02 13:44:26.313451 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2676/5739] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:26 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1686 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:26.317627 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3064/5740] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:25 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1495 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:26.324650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:26.325897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:26.334947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.336856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.338188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.339147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.339816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.340454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.541037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:26.541895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:26.552369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.555208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.563098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.564147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.564862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.566461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.661716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:26.675715 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5dd1c589-c630-456d-82ac-921f7333f77a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1494 microversion: 2.1 time: 0.356194 Nov 02 13:44:26.677933 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2677/5741] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:26 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1494 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:26.706329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:26.714588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:26.729947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.730715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.731555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.732808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:26.733483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:26.733999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:26.742553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:26.765019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:26.765019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:26.773372 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d2131b4d-9862-4046-8db6-7df3243b5cee tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.239069 Nov 02 13:44:26.801277 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3065/5742] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:26 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:26.958357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:26.981800 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b982ba55-7dc3-46ac-8e7a-1f96c701f841 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1495 microversion: 2.1 time: 0.275042 Nov 02 13:44:26.983649 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2678/5743] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:26 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1495 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:27.005683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:27.006183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:27.013964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.017650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.019244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.020161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.020823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.021571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.076286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:44:27.079661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:27.200200 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4b18380a-5bd9-4acf-b9ed-60cbbd0d47c9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 204 len: 0 microversion: 2.1 time: 0.198875 Nov 02 13:44:27.205678 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3066/5744] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:44:26 2022] DELETE /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:44:27.211034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:27.211828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:27.219301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.220239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.220781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.221630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.222148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.225525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.322693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:27.324943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:27.361805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.362677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.364170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.366918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.369579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.374897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.480723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:27.496553 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf96e994-de09-4845-be5b-ac488ec143f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1501 microversion: 2.1 time: 0.286733 Nov 02 13:44:27.497373 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2679/5745] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:27 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1501 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:27.665728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:27.676443 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-08979446-5edd-446b-8d80-37f8ef299d25 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1686 microversion: 2.1 time: 0.361022 Nov 02 13:44:27.684892 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3067/5746] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:27 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1686 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:27.805408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:27.806089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:27.822188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.822596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.823035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.823765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:27.824223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:27.824650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:27.949999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:27.965046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:27.966789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:27.968260 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6235f3b-93cd-465d-8e45-038f0fd8948c tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.170082 Nov 02 13:44:27.983692 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2680/5747] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:27 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:28.522602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:28.524402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:28.545179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.547494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.551683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.557962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.558500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.560728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.711866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:28.712665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:28.726446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.728423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.732668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.733959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:28.734658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:28.737191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:28.824559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:28.837663 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-61410e52-c84c-4fbc-bf15-e0dfcd4e5bb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1501 microversion: 2.1 time: 0.315372 Nov 02 13:44:28.842880 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3068/5748] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:28 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1501 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:28.979106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:29.000013 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-77d41936-fd14-4484-9c50-35712f3fb4f6 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1686 microversion: 2.1 time: 0.293960 Nov 02 13:44:29.000701 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2681/5749] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:28 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1686 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:29.023408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:29.027172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:29.034083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.034961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.035744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.036616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.037800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.038506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.195612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:29.211049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:29.220352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:29.222570 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-99999a95-1961-4655-a5d0-970d2b62379a tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.226300 Nov 02 13:44:29.235357 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3069/5750] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:28 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:44:29.871016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:29.871669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:29.886625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.888921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.889991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:29.891621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:29.893664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:29.894267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.032196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:30.034365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:30.049784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.050630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.051871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.053372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.057390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.060051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.252600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:30.263533 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edd84568-3a95-4ea4-bbfb-6e6348f2220a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1619 microversion: 2.1 time: 0.237719 Nov 02 13:44:30.266717 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3070/5751] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:30 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1619 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:30.280929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:30.281832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:30.298527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.300316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.301038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.304649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.305629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.306464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.435078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:30.450666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:30.454144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:30.459173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5e2f42fa-fe84-4d5b-a384-421f609bff85 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.189681 Nov 02 13:44:30.459792 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3071/5752] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:30 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:30.591402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c5e644a1-789c-4cb8-ab62-6268bc7d9f16 req-dfd81f81-d680-4311-a165-9266ebe5f9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff9bbf6-6230-419e-8c8f-7518ff0057a8", "name": "network-vif-deleted", "tag": "cfe63da6-9b22-4fed-a92a-e563ac62a075"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:30.609964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c5e644a1-789c-4cb8-ab62-6268bc7d9f16 req-dfd81f81-d680-4311-a165-9266ebe5f9e4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:30.610714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c5e644a1-789c-4cb8-ab62-6268bc7d9f16 req-dfd81f81-d680-4311-a165-9266ebe5f9e4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:30.615429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c5e644a1-789c-4cb8-ab62-6268bc7d9f16 req-dfd81f81-d680-4311-a165-9266ebe5f9e4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:30.650050 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c5e644a1-789c-4cb8-ab62-6268bc7d9f16 req-dfd81f81-d680-4311-a165-9266ebe5f9e4 service nova] Creating event network-vif-deleted:cfe63da6-9b22-4fed-a92a-e563ac62a075 for instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 on n-h2-858384-19 Nov 02 13:44:30.670080 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c5e644a1-789c-4cb8-ab62-6268bc7d9f16 req-dfd81f81-d680-4311-a165-9266ebe5f9e4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078985 Nov 02 13:44:30.682019 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3072/5753] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:30.760028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:30.776570 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ca517134-d9a0-4aeb-acd7-905d8738e9b4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1501 microversion: 2.1 time: 0.910564 Nov 02 13:44:30.777255 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2682/5754] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:29 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1501 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:31.300885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:31.301655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:31.326979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.327527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.331074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.332759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.334964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.336630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.447239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.447728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.448172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.448630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lazy-loading 'fault' on Instance uuid 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:44:31.579275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284102156ef9461e93e4af60f9496aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f7c4357f4a4f4aa03187f37a23736a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:31.594555 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ac9da6d7-a46c-49f2-aa50-6d39351b448a tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 200 len: 1336 microversion: 2.1 time: 0.293708 Nov 02 13:44:31.599245 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3073/5755] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:31 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 1336 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:31.619533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:31.625502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:31.656103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.675828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.677097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.686926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.687906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.692125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:31.963325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-536895b8-e567-4898-8df3-a14456f1ae92 req-a71b343a-2699-4261-80a0-fc16be4efa7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6ef169-22ef-40bf-b46d-850022099af7", "name": "network-vif-deleted", "tag": "979e4ca8-d468-4fbe-9872-685752de542e"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:31.982090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-536895b8-e567-4898-8df3-a14456f1ae92 req-a71b343a-2699-4261-80a0-fc16be4efa7a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:31.984303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-536895b8-e567-4898-8df3-a14456f1ae92 req-a71b343a-2699-4261-80a0-fc16be4efa7a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:31.986449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-536895b8-e567-4898-8df3-a14456f1ae92 req-a71b343a-2699-4261-80a0-fc16be4efa7a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.010139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:32.014101 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-536895b8-e567-4898-8df3-a14456f1ae92 req-a71b343a-2699-4261-80a0-fc16be4efa7a service nova] Creating event network-vif-deleted:979e4ca8-d468-4fbe-9872-685752de542e for instance ab6ef169-22ef-40bf-b46d-850022099af7 on n-h2-858384-19 Nov 02 13:44:32.024840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:32.026759 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-536895b8-e567-4898-8df3-a14456f1ae92 req-a71b343a-2699-4261-80a0-fc16be4efa7a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.639156 Nov 02 13:44:32.032001 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2683/5756] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:32.033136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:32.034962 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31307b64-c453-47af-a9b2-5cf5a7877996 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.434163 Nov 02 13:44:32.044071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:32.045590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:32.054812 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3074/5757] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:31 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:32.058936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.060794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.065795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.066741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.067363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.068206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.147322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.149518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.151008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.152842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lazy-loading 'fault' on Instance uuid ab6ef169-22ef-40bf-b46d-850022099af7 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:44:32.218172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:32.232542 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94eb1adf-37ea-485e-aca6-90a9f398476b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 200 len: 1303 microversion: 2.1 time: 0.199020 Nov 02 13:44:32.235376 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2684/5758] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:32 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 1303 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:32.622281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:32.623040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:32.637736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.638338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.638879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.639731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:32.640295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:32.641433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:32.670771 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 HTTP/1.1 Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7ff9bbf6-6230-419e-8c8f-7518ff0057a8'} Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:32.675387 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:32.681783 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:32.681783 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:32.681783 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:32.681783 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:32.681783 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:32.681783 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:32.681783 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:32.683440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:32.683440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b8d62653-5865-477f-8785-6336e641f6c7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 404 len: 111 microversion: 2.1 time: 0.065509 Nov 02 13:44:32.688033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3075/5759] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:32 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:32.697711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-58bb9061-4a42-430d-acef-ebe65e0201f0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '.version_select at 0x7fe78f83cd30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:32.734223 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-58bb9061-4a42-430d-acef-ebe65e0201f0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147902698" status: 202 len: 0 microversion: 2.1 time: 0.041754 Nov 02 13:44:32.735621 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2685/5760] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 13:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1147902698 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:44:33.061317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:33.061944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:33.078909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.079438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.079885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.080612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.081073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.081511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.210835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:33.227431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:33.231607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:33.234028 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d06af649-0a92-4cc1-bce7-c9e90b7f1737 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.175512 Nov 02 13:44:33.234906 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3076/5761] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:33 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:33.268257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:33.269438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:33.290609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.291139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.291595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.292333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.292802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.293237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.349474 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 HTTP/1.1 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'ab6ef169-22ef-40bf-b46d-850022099af7'} Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:33.353234 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:33.357964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:33.357964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:33.357964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:33.357964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:33.357964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:33.357964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:44:33.357964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:33.357964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:33.357964 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed589b7b-7c13-45d5-b04c-9a6a4e8b674c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 404 len: 111 microversion: 2.1 time: 0.092758 Nov 02 13:44:33.359792 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2686/5762] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:33 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:44:33.371825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:33.372330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:33.389766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.390266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.397054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.399156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.409868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.410328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.450177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:44:33.665302 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d6d20bc-65e0-42b1-a2fa-f52361bdf4a1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 204 len: 0 microversion: 2.1 time: 0.300637 Nov 02 13:44:33.666204 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3077/5763] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:44:33 2022] DELETE /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:44:33.677142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:33.677778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:33.704112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.706747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.707255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:33.708007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:33.711190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:33.712369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.112254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:34.129479 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-87510b80-4e2b-4f57-9790-f66f4de1e86a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1500 microversion: 2.1 time: 0.455537 Nov 02 13:44:34.155278 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2687/5764] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:33 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1500 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:34.269478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:34.271265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:34.280349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.281639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.282254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.283208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:34.283825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:34.284778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:34.365223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:34.376443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:34.378871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:34.380307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6d43c228-6738-48d9-b597-eef6abe1b043 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.115638 Nov 02 13:44:34.381124 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3078/5765] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:34 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:35.163338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:35.164663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:35.172576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.173418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.174094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.175079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.175805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.176318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.408148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:35.408741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:35.424600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.429913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.430834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.431794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:35.432426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:35.443341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:35.544474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:35.554696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:35.567503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:35.568891 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d835f4c-f3a3-4b8c-b330-ebaa1eff05ae tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.164729 Nov 02 13:44:35.570034 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3079/5766] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:35 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:44:35.599084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:35.612743 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-54759a5c-38fa-4230-802c-6413c1257d30 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1500 microversion: 2.1 time: 0.454754 Nov 02 13:44:35.616696 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2688/5767] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:35 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1500 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:36.604652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:36.605325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:36.612779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.616568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.617071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.617903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.618372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.618811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.642767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:36.644829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:36.652904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.653388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.653823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.654526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.654973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.671070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.839162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:36.854323 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d4160223-db16-454d-97b7-368ac61a9ba0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 200 len: 1458 microversion: 2.1 time: 0.213927 Nov 02 13:44:36.861935 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2689/5768] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:36 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 1458 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:36.869065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:36.878811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:36.891481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3a699c4a-c8f9-4c1c-954d-686088a2bc81 req-a890741e-5d8f-4a17-956f-77873881d426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9dd9263-e23f-4b02-af77-bee6a251194a", "name": "network-vif-deleted", "tag": "08f65a60-99b2-4b1a-bcce-0a6b3ddb2a94"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:36.892572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:36.895842 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4fe93fee-e477-4350-831e-49e2ee355a9d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.297183 Nov 02 13:44:36.916597 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3080/5769] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:36 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:36.920087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3a699c4a-c8f9-4c1c-954d-686088a2bc81 req-a890741e-5d8f-4a17-956f-77873881d426 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:36.920804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3a699c4a-c8f9-4c1c-954d-686088a2bc81 req-a890741e-5d8f-4a17-956f-77873881d426 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:36.921446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3a699c4a-c8f9-4c1c-954d-686088a2bc81 req-a890741e-5d8f-4a17-956f-77873881d426 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:36.954058 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3a699c4a-c8f9-4c1c-954d-686088a2bc81 req-a890741e-5d8f-4a17-956f-77873881d426 service nova] Creating event network-vif-deleted:08f65a60-99b2-4b1a-bcce-0a6b3ddb2a94 for instance c9dd9263-e23f-4b02-af77-bee6a251194a on n-h1-858384-19 Nov 02 13:44:36.965143 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3a699c4a-c8f9-4c1c-954d-686088a2bc81 req-a890741e-5d8f-4a17-956f-77873881d426 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101103 Nov 02 13:44:36.965787 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2690/5770] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:37.879955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:37.880603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:37.891674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.892154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.892647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.899052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.899951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.900549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.925417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:37.926210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:37.940585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.941088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.941563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.942266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:37.942721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:37.951130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:37.962793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:37.964309 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a HTTP/1.1 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'c9dd9263-e23f-4b02-af77-bee6a251194a'} Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:37.965982 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:37.970119 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:37.970119 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:37.970119 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:37.970119 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:37.970119 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:37.970119 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:44:37.970119 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:37.972169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:37.973547 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dfd9c70c-c3ea-4ca4-9554-300191471c58 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 404 len: 111 microversion: 2.1 time: 0.097528 Nov 02 13:44:37.976934 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3081/5771] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:37 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:38.080300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:38.092511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:38.093990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:38.095330 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-115f18ce-453a-48eb-99a4-4731d2ce2ee2 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.174375 Nov 02 13:44:38.101009 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2691/5772] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:37 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:44:38.184553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-749023294", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "e2a90dcb-325f-44c1-b30e-ebec60ce1358"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:38.262965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] validate_networks() for [('e2a90dcb-325f-44c1-b30e-ebec60ce1358', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:44:39.104916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:44:39.106311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:44:39.107959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:44:39.110633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:44:39.111460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:44:39.124017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.124939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.125900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.128415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.129477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.130146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.133777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:39.134345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:39.139312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:39.157044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:44:39.158150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.158651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.159086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.165198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for user f883a8edef9b47319dc828211e497fe7 and project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:44:39.165628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:39.166118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:39.166559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:39.196698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:44:39.199700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:44:39.242632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:39.301068 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0e7557d4-f212-421e-8697-5c29ceecb494 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.120813 Nov 02 13:44:39.306378 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3082/5773] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:44:38 2022] POST /compute/v2.1/servers => generated 382 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:44:39.319365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2763481a-bcda-48b1-9535-f9d98e2655f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:39.323734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2763481a-bcda-48b1-9535-f9d98e2655f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:39.344872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:39.359692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:39.366563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:39.372509 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6680ad7d-6071-417c-9603-3c3061b8ac02 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.242234 Nov 02 13:44:39.385789 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2692/5774] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:39 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:40.081651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2763481a-bcda-48b1-9535-f9d98e2655f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:40.092462 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2763481a-bcda-48b1-9535-f9d98e2655f9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1212 microversion: 2.1 time: 0.777934 Nov 02 13:44:40.094892 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3083/5775] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:39 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1212 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:40.402974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:40.403659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:40.410376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.410875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.411587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.412341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:40.413375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:40.413839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:40.560624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:40.583602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:40.591009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:40.594287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-482e0dc4-027d-41c5-9bc3-d3bdf2be4759 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.193478 Nov 02 13:44:40.596105 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2693/5776] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:40 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:41.123579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:41.126590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:41.156901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.160868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.162487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.169063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.170062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.171068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.388955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:41.418443 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bbb7ffbb-610a-4fd5-ae57-c3fc04c7cc99 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1264 microversion: 2.1 time: 0.301537 Nov 02 13:44:41.419668 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3084/5777] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:41 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1264 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:44:41.630968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:41.632862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:41.653702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.655377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.656230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.669313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:41.672548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:41.673323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:41.948445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:41.966704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:41.968486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:41.973172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-44063cf1-3d71-432a-8cd3-2dba782eb032 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.347003 Nov 02 13:44:41.974221 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2694/5778] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:41 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:42.462361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:42.462966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:42.482217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:42.483430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:42.484080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:42.488593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:42.489331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:42.489948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:42.833992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:42.849190 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ac817472-3719-444c-a1f4-4ecb8f4b148b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1270 microversion: 2.1 time: 0.390137 Nov 02 13:44:42.851961 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3085/5779] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:42 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1270 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:43.008383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:43.009897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:43.029878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.031824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.035783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:43.039326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.040788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.043343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:43.343314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:43.360939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:43.373667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:43.375789 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a177d16e-e480-4c11-a757-7512f2a79a36 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.372721 Nov 02 13:44:43.379981 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2695/5780] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:43 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:43.879340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:43.880663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:43.895687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.896653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.897713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:43.898668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:43.903722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:43.904424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.305402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:44.306484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:44.314338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:44.315155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:44.315769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.316646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:44.317253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:44.318224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.321633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:44.340188 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 HTTP/1.1 Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7ff9bbf6-6230-419e-8c8f-7518ff0057a8'} Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:44.342500 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.347994 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.351165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:44.352358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-518760bd-5b9e-434a-a35f-53c362148f98 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 404 len: 111 microversion: 2.1 time: 0.057428 Nov 02 13:44:44.353576 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2696/5781] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:44:44 2022] DELETE /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:44.373408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:44.374087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 7ff9bbf6-6230-419e-8c8f-7518ff0057a8] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:44.383255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:44.383760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:44.384209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.384989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:44.385490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:44.385922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.416874 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 HTTP/1.1 Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7ff9bbf6-6230-419e-8c8f-7518ff0057a8'} Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:44.418744 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.423276 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:44.423276 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:44.423276 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:44.423276 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:44.423276 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:44.423276 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. Nov 02 13:44:44.423276 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:44.423276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance 7ff9bbf6-6230-419e-8c8f-7518ff0057a8 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:44.423276 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b5434adb-55ef-4038-80c4-885c2fddbff4 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8" status: 404 len: 111 microversion: 2.1 time: 0.062141 Nov 02 13:44:44.425644 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2697/5782] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:44 2022] GET /compute/v2.1/servers/7ff9bbf6-6230-419e-8c8f-7518ff0057a8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:44.433433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:44.434461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:44.442815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:44.443613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:44.444944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.446434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:44.447291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:44.447968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:44.485936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:44.512340 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0130f57-66cb-4de1-9157-1274d56c3fdd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1312 microversion: 2.1 time: 0.633797 Nov 02 13:44:44.515911 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3086/5783] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:43 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1312 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:44.673258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:44.709382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:44.713691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:44.717405 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9fbd7d13-ad96-433a-9e8a-0df54c0f2e87 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.290695 Nov 02 13:44:44.719731 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2698/5784] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:44 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:45.210174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-37567604-b72b-4d1b-add4-edfc5f0a5ac4 req-7f3af240-931a-47a0-b964-e07b572856bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d5b06c-4838-412d-8aea-443640d6830e", "tag": "c06d7fdb-19b1-4e94-a870-d24802e338c6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:45.239310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-37567604-b72b-4d1b-add4-edfc5f0a5ac4 req-7f3af240-931a-47a0-b964-e07b572856bd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.240176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-37567604-b72b-4d1b-add4-edfc5f0a5ac4 req-7f3af240-931a-47a0-b964-e07b572856bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.241362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-37567604-b72b-4d1b-add4-edfc5f0a5ac4 req-7f3af240-931a-47a0-b964-e07b572856bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.255802 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-37567604-b72b-4d1b-add4-edfc5f0a5ac4 req-7f3af240-931a-47a0-b964-e07b572856bd service nova] Creating event network-changed:c06d7fdb-19b1-4e94-a870-d24802e338c6 for instance 79d5b06c-4838-412d-8aea-443640d6830e on n-h2-858384-19 Nov 02 13:44:45.262722 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-37567604-b72b-4d1b-add4-edfc5f0a5ac4 req-7f3af240-931a-47a0-b964-e07b572856bd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058962 Nov 02 13:44:45.264420 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3087/5785] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:44:45.541256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:45.541969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:45.556581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.559233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.559785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.561409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.563663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.564180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.750092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:45.751064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:45.775835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.781405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.782040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.787446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:45.790056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:45.792267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:45.982877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:46.003906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:46.006897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:46.008375 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b08c1dc-66ca-4749-a665-78f161909338 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1609 microversion: 2.42 time: 0.265120 Nov 02 13:44:46.010133 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3088/5786] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:45 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1609 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:46.124711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:46.140111 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ca1c5926-0ae9-4bf5-be8f-dde56546d483 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1312 microversion: 2.1 time: 0.605818 Nov 02 13:44:46.141377 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2699/5787] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:45 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1312 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:47.044045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:47.044747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:47.057731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.062677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.063317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.064105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.064568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.065160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.123709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.124183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.124714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.125878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lazy-loading 'fault' on Instance uuid 157806f8-e608-431a-bf41-6497729ea2f3 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:44:47.165972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:47.166664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:47.193799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.194532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.194995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.195803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:47.196455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:47.197213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:47.203698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:47.217622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:47.219704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:47.221485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3c5aab56-10e9-4b01-a4ea-4845acd4b1cd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1614 microversion: 2.42 time: 0.187973 Nov 02 13:44:47.222993 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3089/5788] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:47 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1614 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:47.429299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:47.451920 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd3447a1-1570-400e-8966-61374f24e740 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1312 microversion: 2.1 time: 0.291619 Nov 02 13:44:47.452858 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2700/5789] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:47 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1312 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:48.251449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:48.252880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:48.264013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.270065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.270845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.275410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.277109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.278650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.342985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.343885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.344540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.345226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lazy-loading 'fault' on Instance uuid 157806f8-e608-431a-bf41-6497729ea2f3 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:44:48.397897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:48.411263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:48.414466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dddb08b841ae477484ff07f8e0aaea44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70197f1a93b478398b14900c12e8863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:48.416169 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-816ee81c-ea86-41a0-ae97-463f4b31d941 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 200 len: 1614 microversion: 2.42 time: 0.169765 Nov 02 13:44:48.417256 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3090/5790] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:48 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 1614 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:44:48.475949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:48.479017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:48.494490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.497584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.498164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.499267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:48.501137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:48.501674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:48.764897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:48.775539 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e4f6780a-b5a3-47de-9563-3a2fd7aed734 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1312 microversion: 2.1 time: 0.304393 Nov 02 13:44:48.776826 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2701/5791] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:48 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1312 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:49.449599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:49.450842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:49.465218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:49.468769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.470939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.471432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:49.472194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.472652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.478125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:49.529543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] HTTP exception thrown: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Request method failure captured: Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 HTTP/1.1 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnLZSvkGSuAC0Agd3q8v8fAQlFBXvJnZNM0M-iVLDaRUazkTXXPfyAwYKzncabDFArk4Lp4pTVaJQ-VmUQh_0qARgMPVM_ZlZRtdm9_VSBWmE-ZBXHmapwkEzg6HiOKBVm-_s7bOpC0oofINDYUTfX86DbLxmYebIk57KMB1Qfa_90A Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b70197f1a93b478398b14900c12e8863 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-336392755 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b70197f1a93b478398b14900c12e8863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b70197f1a93b478398b14900c12e8863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b70197f1a93b478398b14900c12e8863"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b70197f1a93b478398b14900c12e8863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TaggedBootDevicesTest_v242-336392755 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b70197f1a93b478398b14900c12e8863 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-336392755 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TaggedBootDevicesTest_v242-336392755-project Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: dddb08b841ae477484ff07f8e0aaea44 Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TaggedBootDevicesTest_v242-336392755-project Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '157806f8-e608-431a-bf41-6497729ea2f3'} Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:49.531369 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Returning 404 to user: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:49.535608 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-483b2d5f-d81b-4e52-84fa-bef2b807344d tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 404 len: 111 microversion: 2.42 time: 0.088351 Nov 02 13:44:49.536798 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3091/5792] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:49 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:44:49.554175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-12133b1e-903a-49ff-8b78-163d1784abcd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '.version_select at 0x7fe78f8dfb80>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:49.623681 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-12133b1e-903a-49ff-8b78-163d1784abcd tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383255852" status: 204 len: 0 microversion: 2.42 time: 0.081802 Nov 02 13:44:49.624286 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2702/5793] 10.222.0.113 () {60 vars in 1267 bytes} [Wed Nov 2 13:44:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383255852 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:44:49.805758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:49.806390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:49.818070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.820027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.822473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:49.823405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:49.827701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:49.829738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.089907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:44:50.121176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:50.133963 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-333d8698-e5c7-4549-b564-c4ddc43b3e88 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1312 microversion: 2.1 time: 0.333183 Nov 02 13:44:50.135530 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3092/5794] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:49 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:50.194643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:50.195261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:50.205258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.206200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.207038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.208189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.208898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.210334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.240600 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 HTTP/1.1 Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '187f7043-8fce-4714-b73c-12336bc51326'} Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:50.242384 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.246881 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.250051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:50.252847 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9ee0b6d5-e68e-4aac-a91d-b11f2d2131e0 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 404 len: 111 microversion: 2.1 time: 0.065119 Nov 02 13:44:50.260642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2703/5795] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:44:50 2022] DELETE /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:50.265837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:50.267672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: 187f7043-8fce-4714-b73c-12336bc51326] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:50.288742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.289662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.292662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.293578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.296494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.297497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.350582 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 HTTP/1.1 Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '187f7043-8fce-4714-b73c-12336bc51326'} Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:50.356755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance 187f7043-8fce-4714-b73c-12336bc51326 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ddeebf80-b02a-416e-a2a3-52bb883e2cd7 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326" status: 404 len: 111 microversion: 2.1 time: 0.097207 Nov 02 13:44:50.361644 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3093/5796] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:50 2022] GET /compute/v2.1/servers/187f7043-8fce-4714-b73c-12336bc51326 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:44:50.370779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:50.371518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:50.379851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.380789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.381783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.383077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.384010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.384718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.401912 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab HTTP/1.1 Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'c9bb2256-24c1-4246-83bb-50eb3a869aab'} Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:50.404066 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.409581 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.414342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:50.415431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51187feb-14b0-44e0-900f-1dde49eb2006 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 404 len: 111 microversion: 2.1 time: 0.051148 Nov 02 13:44:50.416247 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2704/5797] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:44:50 2022] DELETE /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:50.425807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:50.432028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: c9bb2256-24c1-4246-83bb-50eb3a869aab] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:50.447564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.448067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.448522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.449248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:50.449705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:50.451372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:50.511174 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab HTTP/1.1 Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'c9bb2256-24c1-4246-83bb-50eb3a869aab'} Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:50.515590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.520690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:50.520690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:50.520690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:50.520690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:50.520690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:50.520690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. Nov 02 13:44:50.520690 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:50.522089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance c9bb2256-24c1-4246-83bb-50eb3a869aab could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:50.523018 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d310135-a273-416f-89ee-92301518761d tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab" status: 404 len: 111 microversion: 2.1 time: 0.102237 Nov 02 13:44:50.524195 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3094/5798] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:50 2022] GET /compute/v2.1/servers/c9bb2256-24c1-4246-83bb-50eb3a869aab => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:51.157639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:51.158261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:51.169854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.171712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.171712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.175600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:51.176102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:51.176556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:51.539527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:51.562425 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5764011e-2a85-45bf-8e65-2ce226bb601d tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1312 microversion: 2.1 time: 0.407249 Nov 02 13:44:51.564912 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2705/5799] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:51 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:52.586732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:52.588241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:52.602537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.603352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.603957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.606380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:52.606902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:52.618734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:52.887646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:52.897149 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29b9ccf5-0a12-4d26-a72c-dfbdd54ffc42 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1312 microversion: 2.1 time: 0.314333 Nov 02 13:44:52.898134 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3095/5800] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:52 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1312 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:53.924980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:53.925600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:53.942817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:53.943339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:53.944352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:53.945070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:53.945527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:53.945955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:54.440833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-afe07b83-6f9c-4bff-9d67-eb13f9c4086f req-ecf56ad3-fa6a-4760-83ae-4e21d817eda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d5b06c-4838-412d-8aea-443640d6830e", "name": "network-vif-plugged", "status": "completed", "tag": "c06d7fdb-19b1-4e94-a870-d24802e338c6"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:54.456469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-afe07b83-6f9c-4bff-9d67-eb13f9c4086f req-ecf56ad3-fa6a-4760-83ae-4e21d817eda0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:54.460389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-afe07b83-6f9c-4bff-9d67-eb13f9c4086f req-ecf56ad3-fa6a-4760-83ae-4e21d817eda0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:54.462533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-afe07b83-6f9c-4bff-9d67-eb13f9c4086f req-ecf56ad3-fa6a-4760-83ae-4e21d817eda0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:54.510725 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-afe07b83-6f9c-4bff-9d67-eb13f9c4086f req-ecf56ad3-fa6a-4760-83ae-4e21d817eda0 service nova] Creating event network-vif-plugged:c06d7fdb-19b1-4e94-a870-d24802e338c6 for instance 79d5b06c-4838-412d-8aea-443640d6830e on n-h2-858384-19 Nov 02 13:44:54.520969 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-afe07b83-6f9c-4bff-9d67-eb13f9c4086f req-ecf56ad3-fa6a-4760-83ae-4e21d817eda0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.477674 Nov 02 13:44:54.522160 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3096/5801] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:44:54.645828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:54.655167 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74ae18fc-faad-4a20-8c13-6e01173d2dee tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1312 microversion: 2.1 time: 0.733526 Nov 02 13:44:54.655795 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2706/5802] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:53 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1312 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:55.698657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:55.701476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:55.715853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:55.716778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:55.718253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:55.719598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:55.720314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:55.721575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:56.324097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:56.339104 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d6499da-a2c6-46fb-a76e-0fb7794af647 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1312 microversion: 2.1 time: 0.664333 Nov 02 13:44:56.339784 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3097/5803] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:55 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1312 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:56.587971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:56.589354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:56.605017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:56.606345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:56.607756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:56.608810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:56.612016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:56.612569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:56.635637 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f HTTP/1.1 Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f97fc922-3426-43e9-916a-32c813e2751f'} Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:56.637339 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:56.641068 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9739a6e9-710e-41b2-93e2-b4fa74672753 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 404 len: 111 microversion: 2.1 time: 0.055534 Nov 02 13:44:56.642641 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2707/5804] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:44:56 2022] DELETE /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:56.649620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:56.650750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] [instance: f97fc922-3426-43e9-916a-32c813e2751f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:56.660022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:56.661148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:56.661791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:56.669829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:56.670477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:56.670998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:56.689294 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] HTTP exception thrown: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Request method failure captured: Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f HTTP/1.1 Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnIFtyCZZHeys0W2RUqWIQ-sd4Honfa_A-Y2MQeUGRUl5Nr7MXRESzxYtgAXb2nJbq78im12Q7RIWfRxs4ZRlcxzeOfYU6e_uwg-ByDyVpG94r_giby77dXrhVRfDI3Y2l_84vBQMRQVktm1nzFmtkrBb2imDNzW6Z58U3EJdK3wnZs Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d0f7c4357f4a4f4aa03187f37a23736a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d0f7c4357f4a4f4aa03187f37a23736a Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2052754684 Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 284102156ef9461e93e4af60f9496aa2 Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeNegativeTest-2052754684-project Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f97fc922-3426-43e9-916a-32c813e2751f'} Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:56.691744 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.696844 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:56.696844 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:56.696844 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:56.696844 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:56.696844 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:56.696844 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. Nov 02 13:44:56.696844 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:56.701722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] Returning 404 to user: Instance f97fc922-3426-43e9-916a-32c813e2751f could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:56.704857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-290a7508-04bd-4129-9634-faa949eea426 tempest-AttachVolumeNegativeTest-2052754684 tempest-AttachVolumeNegativeTest-2052754684-project] 10.222.0.113 "GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f" status: 404 len: 111 microversion: 2.1 time: 0.060809 Nov 02 13:44:56.706452 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3098/5805] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:56 2022] GET /compute/v2.1/servers/f97fc922-3426-43e9-916a-32c813e2751f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:44:57.364789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:57.366732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:57.377146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:57.377641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:57.378085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:57.378796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:57.379312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:57.379747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.154573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:58.167093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-361361e5-cfc1-4925-bc4d-7ce97cd100ad tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1493 microversion: 2.1 time: 0.807719 Nov 02 13:44:58.168385 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2708/5806] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:57 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1493 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:58.192771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74d2cf4a-dc67-4c52-b7df-67c45c9320c7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:44:58.197544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74d2cf4a-dc67-4c52-b7df-67c45c9320c7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:58.208332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74d2cf4a-dc67-4c52-b7df-67c45c9320c7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.208815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74d2cf4a-dc67-4c52-b7df-67c45c9320c7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.209967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74d2cf4a-dc67-4c52-b7df-67c45c9320c7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.210995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74d2cf4a-dc67-4c52-b7df-67c45c9320c7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.211643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74d2cf4a-dc67-4c52-b7df-67c45c9320c7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.212233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74d2cf4a-dc67-4c52-b7df-67c45c9320c7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.309061 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74d2cf4a-dc67-4c52-b7df-67c45c9320c7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "PUT /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1088 microversion: 2.1 time: 0.121881 Nov 02 13:44:58.319344 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3099/5807] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:44:58 2022] PUT /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1088 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:58.331799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:58.332621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:58.339813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.340686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.341321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.342244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.342921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.343601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.545779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:58.546634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:58.554935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.555767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.556401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.557474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.558232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.558988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.579456 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] HTTP exception thrown: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Request method failure captured: Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 HTTP/1.1 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnLZSvkGSuAC0Agd3q8v8fAQlFBXvJnZNM0M-iVLDaRUazkTXXPfyAwYKzncabDFArk4Lp4pTVaJQ-VmUQh_0qARgMPVM_ZlZRtdm9_VSBWmE-ZBXHmapwkEzg6HiOKBVm-_s7bOpC0oofINDYUTfX86DbLxmYebIk57KMB1Qfa_90A Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b70197f1a93b478398b14900c12e8863 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-336392755 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b70197f1a93b478398b14900c12e8863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b70197f1a93b478398b14900c12e8863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b70197f1a93b478398b14900c12e8863"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b70197f1a93b478398b14900c12e8863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TaggedBootDevicesTest_v242-336392755 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b70197f1a93b478398b14900c12e8863 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-336392755 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TaggedBootDevicesTest_v242-336392755-project Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: dddb08b841ae477484ff07f8e0aaea44 Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TaggedBootDevicesTest_v242-336392755-project Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '157806f8-e608-431a-bf41-6497729ea2f3'} Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:58.582513 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.590094 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.599092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Returning 404 to user: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:58.600122 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e79170d-1e8f-4a95-9689-780d4f0eb830 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "DELETE /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 404 len: 111 microversion: 2.42 time: 0.062037 Nov 02 13:44:58.604319 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3100/5808] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:44:58 2022] DELETE /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:44:58.609534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:58.610423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] [instance: 157806f8-e608-431a-bf41-6497729ea2f3] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:58.617054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.618120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.618782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.619752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.620425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.621113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.657774 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] HTTP exception thrown: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Request method failure captured: Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 HTTP/1.1 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnLZSvkGSuAC0Agd3q8v8fAQlFBXvJnZNM0M-iVLDaRUazkTXXPfyAwYKzncabDFArk4Lp4pTVaJQ-VmUQh_0qARgMPVM_ZlZRtdm9_VSBWmE-ZBXHmapwkEzg6HiOKBVm-_s7bOpC0oofINDYUTfX86DbLxmYebIk57KMB1Qfa_90A Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b70197f1a93b478398b14900c12e8863 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-336392755 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b70197f1a93b478398b14900c12e8863"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b70197f1a93b478398b14900c12e8863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b70197f1a93b478398b14900c12e8863"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b70197f1a93b478398b14900c12e8863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TaggedBootDevicesTest_v242-336392755 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b70197f1a93b478398b14900c12e8863 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-336392755 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TaggedBootDevicesTest_v242-336392755-project Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: dddb08b841ae477484ff07f8e0aaea44 Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TaggedBootDevicesTest_v242-336392755-project Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '157806f8-e608-431a-bf41-6497729ea2f3'} Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.660412 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:44:58.665596 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.665596 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:44:58.665596 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:44:58.665596 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:44:58.665596 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:44:58.665596 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:44:58.665596 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. Nov 02 13:44:58.665596 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:44:58.670130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] Returning 404 to user: Instance 157806f8-e608-431a-bf41-6497729ea2f3 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:44:58.671500 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d7ca4ea8-728d-465e-a6f4-865a5098ed67 tempest-TaggedBootDevicesTest_v242-336392755 tempest-TaggedBootDevicesTest_v242-336392755-project] 10.222.0.113 "GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3" status: 404 len: 111 microversion: 2.42 time: 0.065874 Nov 02 13:44:58.672295 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3101/5809] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:44:58 2022] GET /compute/v2.1/servers/157806f8-e608-431a-bf41-6497729ea2f3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:44:58.773316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:58.796083 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0520372c-9873-4c5a-b48c-542e2f828ef0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1514 microversion: 2.1 time: 0.469285 Nov 02 13:44:58.796904 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2709/5810] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:58 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1514 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:58.823712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:58.824345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:58.834515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.836270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.838642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:58.840359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:58.841082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:58.841746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.727010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:44:59.741118 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-337cd08f-e46a-4ed1-aea0-24b509f4c2d2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1514 microversion: 2.1 time: 0.922768 Nov 02 13:44:59.744998 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3102/5811] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:44:58 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1514 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:44:59.768855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:44:59.769949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:44:59.781127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.783790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.785652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.787657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:44:59.790349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:44:59.790970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:44:59.843285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:00.024298 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40028360-0d25-4105-97d2-ca943c422271 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 204 len: 0 microversion: 2.1 time: 0.259842 Nov 02 13:45:00.024967 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2710/5812] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:44:59 2022] DELETE /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:00.034485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:00.035146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:00.047964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:00.049058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:00.049517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:00.050256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:00.050723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:00.051179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:00.584352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:00.602700 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fdb8222e-20f7-4141-bc92-2a575babb1d3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1520 microversion: 2.1 time: 0.572481 Nov 02 13:45:00.603636 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3103/5813] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:00 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1520 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:01.633557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:01.634895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:01.661441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:01.666469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:01.667125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:01.668110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:01.669917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:01.670528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:02.345270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:02.354504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ec81212-fac9-4048-bc15-c9e3e6178c65 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1520 microversion: 2.1 time: 0.725831 Nov 02 13:45:02.355140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2711/5814] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:01 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1520 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:03.382514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:03.384066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:03.398420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:03.400389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:03.401888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:03.403510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:03.404172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:03.405689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:03.507271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:03.812731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1f8ef6e0-d932-4d96-bcc5-806c50cc4dfb req-1f9b8de8-3bd6-428a-b7f0-f947f15ea570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d5b06c-4838-412d-8aea-443640d6830e", "name": "network-vif-deleted", "tag": "c06d7fdb-19b1-4e94-a870-d24802e338c6"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:03.839370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1f8ef6e0-d932-4d96-bcc5-806c50cc4dfb req-1f9b8de8-3bd6-428a-b7f0-f947f15ea570 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:03.839883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1f8ef6e0-d932-4d96-bcc5-806c50cc4dfb req-1f9b8de8-3bd6-428a-b7f0-f947f15ea570 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:03.840336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1f8ef6e0-d932-4d96-bcc5-806c50cc4dfb req-1f9b8de8-3bd6-428a-b7f0-f947f15ea570 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:03.869920 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1f8ef6e0-d932-4d96-bcc5-806c50cc4dfb req-1f9b8de8-3bd6-428a-b7f0-f947f15ea570 service nova] Creating event network-vif-deleted:c06d7fdb-19b1-4e94-a870-d24802e338c6 for instance 79d5b06c-4838-412d-8aea-443640d6830e on n-h2-858384-19 Nov 02 13:45:03.884326 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1f8ef6e0-d932-4d96-bcc5-806c50cc4dfb req-1f9b8de8-3bd6-428a-b7f0-f947f15ea570 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075565 Nov 02 13:45:03.885633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2712/5815] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:04.179612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:04.192283 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-780f85f2-67a3-4fd8-830d-2634f3b1255c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 200 len: 1478 microversion: 2.1 time: 0.816550 Nov 02 13:45:04.198794 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3104/5816] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:03 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 1478 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:05.223968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:05.226668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:05.247570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:05.248495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:05.249195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:05.250244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:05.250928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:05.251611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:05.304106 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e HTTP/1.1 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '79d5b06c-4838-412d-8aea-443640d6830e'} Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:45:05.311356 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:45:05.316071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:45:05.316071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:45:05.316071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:45:05.316071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:45:05.316071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:45:05.316071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:45:05.316071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:45:05.321821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:45:05.324369 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-338fe116-d558-4949-a908-352860a685e0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 404 len: 111 microversion: 2.1 time: 0.104987 Nov 02 13:45:05.326561 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2713/5817] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:05 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:45:05.560603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-650168405", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "e2a90dcb-325f-44c1-b30e-ebec60ce1358"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:05.711061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] validate_networks() for [('e2a90dcb-325f-44c1-b30e-ebec60ce1358', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:45:06.519845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:45:06.520337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:45:06.521570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:45:06.522055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:45:06.522602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:45:06.544192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:06.544804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:06.545478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:06.546655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:06.558128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:06.558944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:06.604932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:06.613022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Getting quotas for user f883a8edef9b47319dc828211e497fe7 and project dd81d663b98b4fae9f18c2df10cc9b99. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:06.630865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:45:06.633915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:45:06.710428 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1973478b-4851-404e-84a4-eb0475dc91a3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.153633 Nov 02 13:45:06.712351 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3105/5818] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:45:05 2022] POST /compute/v2.1/servers => generated 382 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:45:06.727952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d4f34d71-13bd-472c-bf81-3445d2a72c9a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:06.729553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d4f34d71-13bd-472c-bf81-3445d2a72c9a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:06.947749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d4f34d71-13bd-472c-bf81-3445d2a72c9a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:06.966777 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d4f34d71-13bd-472c-bf81-3445d2a72c9a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1212 microversion: 2.1 time: 0.244837 Nov 02 13:45:06.968156 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2714/5819] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:06 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1212 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:08.002397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:08.003745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:08.029210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:08.031633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:08.033482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:08.036243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:08.038342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:08.039082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:08.452055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:08.462916 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-013a0625-8937-4407-b483-104f9eb57b03 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1264 microversion: 2.1 time: 0.466024 Nov 02 13:45:08.465895 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3106/5820] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:07 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1264 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:09.490277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:09.491966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:09.504150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:09.509383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:09.509873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:09.510315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:09.511103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:09.515816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:09.516332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:09.798538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:09.807644 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fcaa3885-f16e-48de-9008-874e79cb0b09 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1270 microversion: 2.1 time: 0.321611 Nov 02 13:45:09.818835 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2715/5821] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:09 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1270 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:10.844404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:10.846098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:10.850277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=66 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:10.869465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:10.872460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:10.873173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:10.876822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:10.877635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:10.878310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:11.391758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:11.408057 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b4c4f6c8-f3b0-4c8f-8a61-b2536a26742a tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1312 microversion: 2.1 time: 0.567454 Nov 02 13:45:11.411618 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3107/5822] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:10 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1312 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:12.047968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6c1577da-a366-43fd-89aa-61ffe69c72e4 req-73f072d6-5514-4cbf-9cae-7efda86cfd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde648d0-0879-4385-91e5-6e38fc8d90e2", "tag": "77dcd9e2-0389-4a6e-8d8f-b817c0480749"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:12.113427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6c1577da-a366-43fd-89aa-61ffe69c72e4 req-73f072d6-5514-4cbf-9cae-7efda86cfd94 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:12.115452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6c1577da-a366-43fd-89aa-61ffe69c72e4 req-73f072d6-5514-4cbf-9cae-7efda86cfd94 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:12.116133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6c1577da-a366-43fd-89aa-61ffe69c72e4 req-73f072d6-5514-4cbf-9cae-7efda86cfd94 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:12.152484 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6c1577da-a366-43fd-89aa-61ffe69c72e4 req-73f072d6-5514-4cbf-9cae-7efda86cfd94 service nova] Creating event network-changed:77dcd9e2-0389-4a6e-8d8f-b817c0480749 for instance dde648d0-0879-4385-91e5-6e38fc8d90e2 on n-h2-858384-19 Nov 02 13:45:12.172622 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6c1577da-a366-43fd-89aa-61ffe69c72e4 req-73f072d6-5514-4cbf-9cae-7efda86cfd94 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128419 Nov 02 13:45:12.173946 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2716/5823] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:12.461866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:12.464462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:12.504861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:12.509382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:12.510219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:12.512106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:12.513278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:12.515721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:12.953592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:12.970533 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-425c8f1e-d2f3-42bc-8442-9d80779e69c1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1312 microversion: 2.1 time: 0.529221 Nov 02 13:45:12.977846 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3108/5824] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:12 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1312 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:14.007773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:14.009383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:14.016510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.017314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.017964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.018877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:14.019566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:14.020350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:14.352571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:14.371219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:14.383683 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0e771762-47e7-461c-97f2-9723446dbaf4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1312 microversion: 2.1 time: 0.381583 Nov 02 13:45:14.390546 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2717/5825] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:14 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1312 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:15.416268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:15.416996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:15.449367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.452752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.454420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:15.460685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:15.461298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:15.474902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:16.583815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:16.625505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:17.034319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:17.056560 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6226318b-d55e-4309-bfd8-7ac20f9e3af1 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1312 microversion: 2.1 time: 1.646298 Nov 02 13:45:17.061154 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3109/5826] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:15 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1312 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:18.102046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:18.104920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:18.108344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:18.127959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.133274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.137477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.141377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:18.141882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:18.142327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:18.828931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:18.843742 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d32545d1-f7e6-45de-b46b-11bf125eb4bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1312 microversion: 2.1 time: 0.752543 Nov 02 13:45:18.845365 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2718/5827] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:18 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1312 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:19.875970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:19.876897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:19.889809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.890587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.891079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:19.892452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:19.893074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:19.893680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:20.666460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:20.678734 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12b015ed-99b3-40c1-b023-42b5757aba9c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1312 microversion: 2.1 time: 0.809258 Nov 02 13:45:20.679384 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3110/5828] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:19 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1312 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:20.726564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-58d65a08-30cb-40f1-8d23-5e6bfa0233ff req-33689583-97d0-45d2-ad4a-255cac66af4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde648d0-0879-4385-91e5-6e38fc8d90e2", "name": "network-vif-plugged", "status": "completed", "tag": "77dcd9e2-0389-4a6e-8d8f-b817c0480749"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:20.761195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-58d65a08-30cb-40f1-8d23-5e6bfa0233ff req-33689583-97d0-45d2-ad4a-255cac66af4a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:20.763740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-58d65a08-30cb-40f1-8d23-5e6bfa0233ff req-33689583-97d0-45d2-ad4a-255cac66af4a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:20.765534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-58d65a08-30cb-40f1-8d23-5e6bfa0233ff req-33689583-97d0-45d2-ad4a-255cac66af4a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:20.794576 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-58d65a08-30cb-40f1-8d23-5e6bfa0233ff req-33689583-97d0-45d2-ad4a-255cac66af4a service nova] Creating event network-vif-plugged:77dcd9e2-0389-4a6e-8d8f-b817c0480749 for instance dde648d0-0879-4385-91e5-6e38fc8d90e2 on n-h2-858384-19 Nov 02 13:45:20.805699 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-58d65a08-30cb-40f1-8d23-5e6bfa0233ff req-33689583-97d0-45d2-ad4a-255cac66af4a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083650 Nov 02 13:45:20.809800 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2719/5829] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:21.708784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:21.710031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:21.730304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:21.731066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:21.732661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:21.733496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:21.736275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:21.736968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:22.268035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:22.278786 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3017973f-eb70-4d1a-96cf-c63829ea9f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1312 microversion: 2.1 time: 0.576046 Nov 02 13:45:22.279728 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3111/5830] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:21 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1312 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:23.304713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:23.305512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:23.321891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.322892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.323581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.324463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.325076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.325656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.644442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:23.654629 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3704821d-3eab-48ab-9b95-1d18ef68faa9 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1493 microversion: 2.1 time: 0.356225 Nov 02 13:45:23.658729 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2720/5831] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:23 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1493 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:23.689330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-94594415-5198-490d-a76e-ba18ae44f3e8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2126902165"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:23.692267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-94594415-5198-490d-a76e-ba18ae44f3e8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:23.708656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94594415-5198-490d-a76e-ba18ae44f3e8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.709149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94594415-5198-490d-a76e-ba18ae44f3e8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.711224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94594415-5198-490d-a76e-ba18ae44f3e8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.712094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94594415-5198-490d-a76e-ba18ae44f3e8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.712571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94594415-5198-490d-a76e-ba18ae44f3e8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.713018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94594415-5198-490d-a76e-ba18ae44f3e8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.868302 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-94594415-5198-490d-a76e-ba18ae44f3e8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "PUT /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1079 microversion: 2.1 time: 0.184403 Nov 02 13:45:23.870825 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3112/5832] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:45:23 2022] PUT /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1079 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:23.891732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:23.892619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:23.911820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.912577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.915410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:23.932945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:23.933854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:23.934460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:24.190754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:24.206561 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8fffba29-0679-4344-8964-5e188993010e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1505 microversion: 2.1 time: 0.322240 Nov 02 13:45:24.220439 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2721/5833] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:23 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:24.235147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:24.236114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:24.254299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:24.257485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:24.258989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:24.260197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:24.261719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:24.263138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:25.105675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:25.116481 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3215463f-b970-497f-a19e-0a1cbd0cef20 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1505 microversion: 2.1 time: 0.888519 Nov 02 13:45:25.117426 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3113/5834] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:24 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1505 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:25.143157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-817816f9-2772-414b-9015-cd17f1cc5ad4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:25.152516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-817816f9-2772-414b-9015-cd17f1cc5ad4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:25.153380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-817816f9-2772-414b-9015-cd17f1cc5ad4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:25.154067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-817816f9-2772-414b-9015-cd17f1cc5ad4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:25.191889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-817816f9-2772-414b-9015-cd17f1cc5ad4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Going to try to stop instance {{(pid=120929) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 13:45:25.309392 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-817816f9-2772-414b-9015-cd17f1cc5ad4 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "POST /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2/action" status: 202 len: 0 microversion: 2.1 time: 0.171729 Nov 02 13:45:25.310268 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2722/5835] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:45:25 2022] POST /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:45:25.320763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:25.321658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:25.329390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:25.331301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:25.334982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:25.335958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:25.336590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:25.337170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:25.772308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:25.786733 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de23a57e-c431-4049-890e-583d86416997 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.471348 Nov 02 13:45:25.803626 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3114/5836] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:25 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:26.827891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:26.829598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:26.837450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:26.838987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:26.839960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:26.840922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:26.841665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:26.842342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:27.581810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:27.596196 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04f63306-7a2d-4c25-ae68-de4b1a28b437 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.782445 Nov 02 13:45:27.607822 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2723/5837] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:26 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:28.626100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:28.631280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:28.642461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:28.643220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:28.643858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:28.644738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:28.645943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:28.646539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:28.916576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:28.939324 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-76906fe2-dec2-4e89-8c0d-8507c9f79205 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.321365 Nov 02 13:45:28.941101 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3115/5838] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:28 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:29.969547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:29.970851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:29.979347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:29.980214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:29.980894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:29.983095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:30.001823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:30.003157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:30.290458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:30.307242 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ee052dd-9373-4982-b685-03a577d4c207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.341739 Nov 02 13:45:30.308810 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2724/5839] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:29 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:31.334168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:31.335416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:31.344591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:31.345321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:31.345952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:31.346925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:31.347666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:31.348303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:31.975382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:31.985518 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed9b2942-b212-4b6a-8204-8d70959e4c62 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.655518 Nov 02 13:45:31.986117 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3116/5840] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:31 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:33.012181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:33.013803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:33.024907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:33.027469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:33.030787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:33.032282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:33.036150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:33.036872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:33.556233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:33.586740 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-238f7b97-2360-4949-916b-9b2ff36ffa66 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.578941 Nov 02 13:45:33.590661 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2725/5841] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:33 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:34.619042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:34.620745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:34.633792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.634594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.635265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.636292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:34.636910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:34.638429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:34.648877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:34.921499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:34.938220 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6877f43a-54a1-4a6c-bf99-6c3ab325f5cf tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.324743 Nov 02 13:45:34.938411 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3117/5842] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:34 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:35.962486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:35.963436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:35.971469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.972098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.972815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:35.974396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:35.974950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:35.975635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:36.292037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:36.300762 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4fa9100f-e42c-4186-a26a-7b2ae070b441 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.343481 Nov 02 13:45:36.301959 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2726/5843] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:35 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:37.327892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:37.329902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:37.340455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:37.341304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:37.342467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:37.343437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:37.344064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:37.344822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:37.615422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:37.624992 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c001b75c-1937-4a00-b61f-e02e5f99ae1c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.303901 Nov 02 13:45:37.625653 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3118/5844] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:37 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:38.659203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:38.659839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:38.679446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:38.680209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:38.683152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:38.684408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:38.686358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:38.687526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:39.018704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:39.030212 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d8b236ad-53d4-407f-8e94-b05e253f5207 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.380588 Nov 02 13:45:39.033883 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2727/5845] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:38 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:40.056916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:40.057552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:40.071159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:40.071987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:40.073111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:40.074040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:40.075241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:40.075845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:40.402973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:40.416733 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cb7e97ef-0f3d-42cb-85df-4110b534923f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.364497 Nov 02 13:45:40.419170 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3119/5846] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:40 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:41.444639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:41.447914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:41.458246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=26 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:41.462038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.463516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.463516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:41.464718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:41.465467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:41.467389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:41.896157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:41.904834 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-441a13a6-b6e0-4101-8b7e-27295ab2598c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.465852 Nov 02 13:45:41.906235 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2728/5847] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:41 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:42.743202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-954f52ee-b6c3-4674-967e-07a3019f9a63 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Action: 'create', calling method: .version_select at 0x7fe786c2c040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1938324026", "policies": ["affinity"]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:42.755099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=26 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:42.775722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-954f52ee-b6c3-4674-967e-07a3019f9a63 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:42.783437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-954f52ee-b6c3-4674-967e-07a3019f9a63 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:42.854161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-954f52ee-b6c3-4674-967e-07a3019f9a63 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:42.861135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-954f52ee-b6c3-4674-967e-07a3019f9a63 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:42.878670 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-954f52ee-b6c3-4674-967e-07a3019f9a63 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.365785 Nov 02 13:45:42.880201 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3120/5848] 10.222.0.113 () {60 vars in 1179 bytes} [Wed Nov 2 13:45:42 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:42.891203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d4af363-b9b7-4edc-8e9d-87202c085189 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Action: 'create', calling method: .version_select at 0x7fe7869504c0>, body: {"server_group": {"name": "tempest-server-group-849048945", "policies": ["affinity"]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:42.913316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0d4af363-b9b7-4edc-8e9d-87202c085189 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:42.921792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0d4af363-b9b7-4edc-8e9d-87202c085189 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:42.936516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:42.937608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:42.945915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:42.946762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:42.947811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:42.948778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:42.949513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:42.950236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:42.996846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0d4af363-b9b7-4edc-8e9d-87202c085189 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:43.009214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0d4af363-b9b7-4edc-8e9d-87202c085189 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:43.030247 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d4af363-b9b7-4edc-8e9d-87202c085189 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.142896 Nov 02 13:45:43.031587 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2729/5849] 10.222.0.113 () {60 vars in 1178 bytes} [Wed Nov 2 13:45:42 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:43.052215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2ffdb12-9668-4058-9ed4-5999f7077347 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Action: 'create', calling method: .version_select at 0x7fe786950940>, body: {"server_group": {"name": "tempest-server-group-849048945", "policies": ["affinity"]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:43.077096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b2ffdb12-9668-4058-9ed4-5999f7077347 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:43.084122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b2ffdb12-9668-4058-9ed4-5999f7077347 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:43.150263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b2ffdb12-9668-4058-9ed4-5999f7077347 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:43.155785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b2ffdb12-9668-4058-9ed4-5999f7077347 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:43.169660 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2ffdb12-9668-4058-9ed4-5999f7077347 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.130780 Nov 02 13:45:43.170360 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2730/5850] 10.222.0.113 () {60 vars in 1178 bytes} [Wed Nov 2 13:45:43 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:43.183480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f359147-d108-4abe-ab1a-fd00e07ee14c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.214605 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f359147-d108-4abe-ab1a-fd00e07ee14c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/1022c838-2712-4552-9864-8dca05354665" status: 204 len: 0 microversion: 2.1 time: 0.035268 Nov 02 13:45:43.219173 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2731/5851] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:45:43 2022] DELETE /compute/v2.1/os-server-groups/1022c838-2712-4552-9864-8dca05354665 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:43.225010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64aafc94-938e-4666-93b0-f8a68ea8202a tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.243424 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-64aafc94-938e-4666-93b0-f8a68ea8202a tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.022828 Nov 02 13:45:43.250745 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2732/5852] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:45:43 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:43.256594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9148d642-aee3-447b-bb79-07a3819fc056 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.274645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:43.283355 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-65c88e59-0b24-48d9-b99e-e040fa722c97 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.351421 Nov 02 13:45:43.292101 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9148d642-aee3-447b-bb79-07a3819fc056 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/af934e7f-6e8e-45d1-acf8-b9cece6bfb2a" status: 204 len: 0 microversion: 2.1 time: 0.039450 Nov 02 13:45:43.297018 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2733/5853] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:45:43 2022] DELETE /compute/v2.1/os-server-groups/af934e7f-6e8e-45d1-acf8-b9cece6bfb2a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:43.302450 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3121/5854] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:42 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:43.309619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-df1ea1bc-e052-41e9-9c5c-abc2185e247f tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.327611 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-df1ea1bc-e052-41e9-9c5c-abc2185e247f tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027353 Nov 02 13:45:43.328207 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2734/5855] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:45:43 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:43.343755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b9b5f3e-2aa4-4fe1-a4bf-c80ea7ea8ce6 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Action: 'create', calling method: .version_select at 0x7fe78611b310>, body: {"server_group": {"name": "tempest-server-group-732104526", "policies": ["affinity"]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:43.367913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7b9b5f3e-2aa4-4fe1-a4bf-c80ea7ea8ce6 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:43.374309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7b9b5f3e-2aa4-4fe1-a4bf-c80ea7ea8ce6 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:43.425252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7b9b5f3e-2aa4-4fe1-a4bf-c80ea7ea8ce6 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:43.431979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7b9b5f3e-2aa4-4fe1-a4bf-c80ea7ea8ce6 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:43.446513 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b9b5f3e-2aa4-4fe1-a4bf-c80ea7ea8ce6 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.107030 Nov 02 13:45:43.453417 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3122/5856] 10.222.0.113 () {60 vars in 1178 bytes} [Wed Nov 2 13:45:43 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:43.459533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-850f988a-91d7-45db-9322-ae17da2cd1cb tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.490160 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-850f988a-91d7-45db-9322-ae17da2cd1cb tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/66934163-fd4a-40c7-b4d6-4722a07ca084" status: 204 len: 0 microversion: 2.1 time: 0.035367 Nov 02 13:45:43.491595 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2735/5857] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:45:43 2022] DELETE /compute/v2.1/os-server-groups/66934163-fd4a-40c7-b4d6-4722a07ca084 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:45:43.499550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3b8c5750-56b4-4771-8120-858d5cd27b99 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.516544 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3b8c5750-56b4-4771-8120-858d5cd27b99 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.020531 Nov 02 13:45:43.517451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3123/5858] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:45:43 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:43.539610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ae24984f-d5a3-4c94-b87d-7ca0efd4bc6c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Action: 'create', calling method: .version_select at 0x7fe78f90cd30>, body: {"server_group": {"name": "tempest-server-group-1214821801", "policies": ["anti-affinity"]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:43.558013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ae24984f-d5a3-4c94-b87d-7ca0efd4bc6c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:43.564036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ae24984f-d5a3-4c94-b87d-7ca0efd4bc6c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:43.605765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:43.642344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ae24984f-d5a3-4c94-b87d-7ca0efd4bc6c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:43.658035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ae24984f-d5a3-4c94-b87d-7ca0efd4bc6c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_groups'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:43.674564 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ae24984f-d5a3-4c94-b87d-7ca0efd4bc6c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.144961 Nov 02 13:45:43.676040 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2736/5859] 10.222.0.113 () {60 vars in 1178 bytes} [Wed Nov 2 13:45:43 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:43.686545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e85489be-4aca-4e0a-b65d-37660cce09f0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.727338 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e85489be-4aca-4e0a-b65d-37660cce09f0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/7833cbb3-6447-49b9-9ee3-6d17a8c5794b" status: 204 len: 0 microversion: 2.1 time: 0.044463 Nov 02 13:45:43.728542 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3124/5860] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:45:43 2022] DELETE /compute/v2.1/os-server-groups/7833cbb3-6447-49b9-9ee3-6d17a8c5794b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:45:43.737759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2ff73534-84db-45ab-a023-0677168385d7 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:43.750015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2ff73534-84db-45ab-a023-0677168385d7 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016447 Nov 02 13:45:43.750744 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2737/5861] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:45:43 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:43.826411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-349968236", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "fe546bdb-d53c-42b0-91b9-daf9b7f9df7b"}]}, "os:scheduler_hints": {"group": "cac4d966-c2ae-4be3-b655-02aaf6ad8e75"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:43.909942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] validate_networks() for [('fe546bdb-d53c-42b0-91b9-daf9b7f9df7b', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:45:44.312316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:44.313685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:44.322080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.322809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.323472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.324370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.324988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.325580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.600597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:44.609508 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-76394049-18fc-4c27-a7ef-c01e44efcad7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.303982 Nov 02 13:45:44.611172 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2738/5862] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:44 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:44.926632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:45:44.927479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:45:44.927853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:45:44.928254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:45:44.928712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:45:44.945816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.946341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.946791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.947725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:44.948186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:44.948627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:44.971393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:44.979368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:44.993722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:45:44.996546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:45:45.073415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:45.084853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:45.133730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:45.148219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:45:45.156143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Getting quotas for user 154efd04b92947d980b7040d16d743be and project dbe5fdc5cb68458fa5e1eb8ef9969771. Resources: {'server_group_members'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:45:45.195038 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a393b75f-5a59-4adf-9a97-09368faf803b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.373545 Nov 02 13:45:45.201968 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3125/5863] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:45:43 2022] POST /compute/v2.1/servers => generated 382 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:45:45.209508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-545dd8d1-85bf-4fd9-804e-a35e5738978a tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:45.210134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-545dd8d1-85bf-4fd9-804e-a35e5738978a tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:45.318579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-545dd8d1-85bf-4fd9-804e-a35e5738978a tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:45.333027 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-545dd8d1-85bf-4fd9-804e-a35e5738978a tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1216 microversion: 2.1 time: 0.127763 Nov 02 13:45:45.338019 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2739/5864] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:45 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:45.638270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:45.639403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:45.652800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.653800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.655591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:45.656366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:45.659028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:45.661703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:46.114785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:46.125748 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d81ca40d-ede4-4a85-a74b-5930df0e7a83 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.493210 Nov 02 13:45:46.126352 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3126/5865] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:45 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:46.361026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:46.361718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:46.377329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:46.378008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:46.378562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:46.384165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:46.385148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:46.385767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:46.509539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:46.519232 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0f950e85-1f6e-454a-8baa-8435ea1bf0d2 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1220 microversion: 2.1 time: 0.162285 Nov 02 13:45:46.520167 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2740/5866] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:46 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1220 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:47.158001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:47.165350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:47.179701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:47.180462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:47.181127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:47.182003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:47.183645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:47.184264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:47.550671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:47.553790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:47.571818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:47.579947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:47.583012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:47.598713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:47.605765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:47.608300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:47.614654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:47.656939 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c74ce1bd-23a7-413d-841e-2340e129dd15 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.502724 Nov 02 13:45:47.658290 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3127/5867] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:47 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:48.087952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:48.103563 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9583bc99-d0b9-49dc-aaff-a226d043996b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1286 microversion: 2.1 time: 0.555928 Nov 02 13:45:48.105728 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2741/5868] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:47 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1286 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:48.697989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:48.698446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:48.716707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.717515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.718225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:48.719630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:48.720481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:48.723425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:48.994988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:49.006361 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f5271263-5d0f-4d67-83d3-5c15227b319c tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.312600 Nov 02 13:45:49.007012 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3128/5869] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:48 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:49.135974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:49.136899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:49.152876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:49.154890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:49.155954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:49.158250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:49.159822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:49.163529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:49.177484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:49.696914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:49.705957 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-23e8d9cc-355d-4c9b-ad19-0c7637883b1b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1316 microversion: 2.1 time: 0.575003 Nov 02 13:45:49.718530 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2742/5870] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:49 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:50.040739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:50.041641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:50.053990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.054885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.055058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.055743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.056323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.056674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.636688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:50.648111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89e0ea07-b08b-408d-9511-a8aac9aad2dc tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.611076 Nov 02 13:45:50.650605 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3129/5871] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:50 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:50.690709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-23b39580-5c4e-4510-b604-0ca4aeee48e8 req-ab48fe25-5b01-44f8-914c-7e03271b625e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd3d05b-7ad6-4085-9385-a0d86fbf3811", "tag": "7f7f75d6-a955-4d8d-9854-1e2986e449f7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:50.703644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-23b39580-5c4e-4510-b604-0ca4aeee48e8 req-ab48fe25-5b01-44f8-914c-7e03271b625e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.704605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-23b39580-5c4e-4510-b604-0ca4aeee48e8 req-ab48fe25-5b01-44f8-914c-7e03271b625e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.705294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-23b39580-5c4e-4510-b604-0ca4aeee48e8 req-ab48fe25-5b01-44f8-914c-7e03271b625e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.719383 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-23b39580-5c4e-4510-b604-0ca4aeee48e8 req-ab48fe25-5b01-44f8-914c-7e03271b625e service nova] Creating event network-changed:7f7f75d6-a955-4d8d-9854-1e2986e449f7 for instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 on n-h1-858384-19 Nov 02 13:45:50.727213 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-23b39580-5c4e-4510-b604-0ca4aeee48e8 req-ab48fe25-5b01-44f8-914c-7e03271b625e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040768 Nov 02 13:45:50.727891 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2743/5872] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:50.739421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:50.740188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:50.750979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.751765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.753009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:50.754504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:50.755188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:50.755811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.080486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:51.091530 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-18979662-6c50-47ec-abd3-66a882a242b0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1316 microversion: 2.1 time: 0.356916 Nov 02 13:45:51.103735 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3130/5873] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:50 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:51.676807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:51.677907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:51.695211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:51.696858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:51.699477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.702153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:51.703496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:51.704099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:51.964093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:51.997015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f1928017-02de-4f05-9a63-5d0ae7037780 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.326737 Nov 02 13:45:51.998959 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2744/5874] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:51 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:52.117813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:52.119172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:52.132437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.133183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.133694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.134660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:52.135905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:52.136712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:52.424014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:52.435698 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dae42be9-e04d-49e9-9927-3486d45bf7b3 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1316 microversion: 2.1 time: 0.323515 Nov 02 13:45:52.456362 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3131/5875] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:52 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:53.023786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:53.024531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:53.039130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.043749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.044371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.045131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.049031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.049763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.348319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:53.362015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1e0b6562-de91-46b4-b6a6-d175fa667063 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.343099 Nov 02 13:45:53.376509 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2745/5876] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:53 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:53.468486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:53.469212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:53.478519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.479067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.479785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.480799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:53.481313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:53.481879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:53.746035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:53.756294 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a9b6e7f9-0375-4fd9-bcc4-98c14a9a16de tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1316 microversion: 2.1 time: 0.295875 Nov 02 13:45:53.766023 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3132/5877] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:53 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:54.389745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:54.390359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:54.405369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.406324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.406751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.407735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.408348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.409470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.782482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:54.784425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:54.805745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.807317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.807993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.822053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:54.822544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:54.822782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:54.830608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:54.833892 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99a1a8c3-9915-442e-83ee-6be6cc89bb95 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1515 microversion: 2.1 time: 0.447962 Nov 02 13:45:54.835210 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2746/5878] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:54 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1515 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:54.958424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:55.169777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=30 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:55.259221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:55.270921 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4dff8d63-03df-4b02-8d3c-c50240f0aa69 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1316 microversion: 2.1 time: 0.493162 Nov 02 13:45:55.271820 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3133/5879] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:54 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:55.863277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:55.865459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:55.867821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=26 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:55.888831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:55.891170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:55.893016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:55.893958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:55.895738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:55.896295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.171728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.184968 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ca23fe91-d1a2-4623-baf1-e4442b28b43f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1492 microversion: 2.1 time: 0.327531 Nov 02 13:45:56.187276 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2747/5880] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:55 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1492 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:56.210948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20ce231b-965a-43bf-9045-d4fcdbfcb102 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-592966526"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:56.213594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20ce231b-965a-43bf-9045-d4fcdbfcb102 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:56.220942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ce231b-965a-43bf-9045-d4fcdbfcb102 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.221447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ce231b-965a-43bf-9045-d4fcdbfcb102 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.221895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ce231b-965a-43bf-9045-d4fcdbfcb102 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.224006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ce231b-965a-43bf-9045-d4fcdbfcb102 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.224676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ce231b-965a-43bf-9045-d4fcdbfcb102 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.225295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20ce231b-965a-43bf-9045-d4fcdbfcb102 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.297109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:56.297736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:56.317996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.318505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.318955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.320377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.320377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.320621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.328393 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20ce231b-965a-43bf-9045-d4fcdbfcb102 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "PUT /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1064 microversion: 2.1 time: 0.122660 Nov 02 13:45:56.328828 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3134/5881] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:45:56 2022] PUT /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1064 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:56.351179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:56.354665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:56.364273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.365120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.365765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.367182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.367934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.369327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.685360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.697074 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-36e63cbe-993a-4ff7-b0f2-86ac566c0f90 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1491 microversion: 2.1 time: 0.350229 Nov 02 13:45:56.697811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3135/5882] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:56 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1491 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:56.705319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-2c3c129b-9f39-4b31-9aa5-0b4f39bec2e3 req-88dff1cc-9850-4e96-955e-72026b408bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd3d05b-7ad6-4085-9385-a0d86fbf3811", "name": "network-vif-plugged", "status": "completed", "tag": "7f7f75d6-a955-4d8d-9854-1e2986e449f7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:56.720485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2c3c129b-9f39-4b31-9aa5-0b4f39bec2e3 req-88dff1cc-9850-4e96-955e-72026b408bc4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.721148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2c3c129b-9f39-4b31-9aa5-0b4f39bec2e3 req-88dff1cc-9850-4e96-955e-72026b408bc4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.721607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2c3c129b-9f39-4b31-9aa5-0b4f39bec2e3 req-88dff1cc-9850-4e96-955e-72026b408bc4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.737406 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-2c3c129b-9f39-4b31-9aa5-0b4f39bec2e3 req-88dff1cc-9850-4e96-955e-72026b408bc4 service nova] Creating event network-vif-plugged:7f7f75d6-a955-4d8d-9854-1e2986e449f7 for instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 on n-h1-858384-19 Nov 02 13:45:56.744511 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-2c3c129b-9f39-4b31-9aa5-0b4f39bec2e3 req-88dff1cc-9850-4e96-955e-72026b408bc4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045002 Nov 02 13:45:56.745246 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3136/5883] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:56.752886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:56.754541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:56.765720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.767376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:56.770455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.771089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.772010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:56.772878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:56.773500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:56.782138 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bfaa0f8f-ebc6-44a0-9fd9-6a8e9f1e4332 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1316 microversion: 2.1 time: 0.490360 Nov 02 13:45:56.789088 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2748/5884] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:56 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:57.135001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:57.149260 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9099c71d-9686-4c60-a938-60675264a02b tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1491 microversion: 2.1 time: 0.402530 Nov 02 13:45:57.150126 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3137/5885] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:56 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1491 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:57.173993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:57.174504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:57.184006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.184615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.185060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.186129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.186772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.187363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.249970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:57.428957 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3c960e45-f6f6-4056-bccf-0284a7aab1d7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 204 len: 0 microversion: 2.1 time: 0.259845 Nov 02 13:45:57.430053 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2749/5886] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:45:57 2022] DELETE /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:57.438317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:57.439811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:57.456036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.457549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.458391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.459273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.460358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.461271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.493490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:45:57.788411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:57.796905 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3df8f8c7-e74d-4e5f-b8ce-e2ef2784192e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1497 microversion: 2.1 time: 0.362406 Nov 02 13:45:57.797817 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3138/5887] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:57 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1497 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:57.814505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:57.814505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:57.819567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.820061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.820515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.821263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:57.821698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:57.822120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:57.993862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:58.002227 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2dadfde1-f225-4207-a128-bc83f7f6c569 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1316 microversion: 2.1 time: 0.194505 Nov 02 13:45:58.003188 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2750/5888] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:57 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:45:58.822638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:58.823279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:58.832248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:58.833914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:58.838101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:58.841454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:58.842213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:58.843993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.028494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:59.029111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:59.044369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.046149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.048659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.051842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.052504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.053191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.174672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:59.184271 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2593b727-c72c-4d29-963b-c0362db0763f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1497 microversion: 2.1 time: 0.365553 Nov 02 13:45:59.185488 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3139/5889] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:58 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1497 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:59.316588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:45:59.328319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22e4ef69-8c43-4ba0-b1e2-1772a57a19df tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1501 microversion: 2.1 time: 0.304879 Nov 02 13:45:59.329956 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2751/5890] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:59 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1501 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:45:59.354722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cc83446c-b12d-4567-8b70-8349b8350317 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:59.388628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.compute.server_groups [None req-cc83446c-b12d-4567-8b70-8349b8350317 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Querying cell 9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) for 1 instances {{(pid=120928) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 13:45:59.394393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc83446c-b12d-4567-8b70-8349b8350317 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.396703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc83446c-b12d-4567-8b70-8349b8350317 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.399783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cc83446c-b12d-4567-8b70-8349b8350317 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.434220 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cc83446c-b12d-4567-8b70-8349b8350317 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups/cac4d966-c2ae-4be3-b655-02aaf6ad8e75" status: 200 len: 222 microversion: 2.1 time: 0.083614 Nov 02 13:45:59.434991 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3140/5891] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:45:59 2022] GET /compute/v2.1/os-server-groups/cac4d966-c2ae-4be3-b655-02aaf6ad8e75 => generated 222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:45:59.446866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:59.447628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:59.457289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.459013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.459565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.460318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.460786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.461221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.518119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:45:59.669827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d6944880-8e24-4203-b661-738464a6d369 req-8ec8bef8-0d23-40c4-b9c3-41d4f2ea3e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde648d0-0879-4385-91e5-6e38fc8d90e2", "name": "network-vif-deleted", "tag": "77dcd9e2-0389-4a6e-8d8f-b817c0480749"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:45:59.697591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d6944880-8e24-4203-b661-738464a6d369 req-8ec8bef8-0d23-40c4-b9c3-41d4f2ea3e64 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.698108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d6944880-8e24-4203-b661-738464a6d369 req-8ec8bef8-0d23-40c4-b9c3-41d4f2ea3e64 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.701068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d6944880-8e24-4203-b661-738464a6d369 req-8ec8bef8-0d23-40c4-b9c3-41d4f2ea3e64 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.749995 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e6bdb1b-0386-4ea5-99d4-37acfc225a21 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 204 len: 0 microversion: 2.1 time: 0.306690 Nov 02 13:45:59.750744 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d6944880-8e24-4203-b661-738464a6d369 req-8ec8bef8-0d23-40c4-b9c3-41d4f2ea3e64 service nova] Creating event network-vif-deleted:77dcd9e2-0389-4a6e-8d8f-b817c0480749 for instance dde648d0-0879-4385-91e5-6e38fc8d90e2 on n-h2-858384-19 Nov 02 13:45:59.755786 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2752/5892] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:45:59 2022] DELETE /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:45:59.762003 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d6944880-8e24-4203-b661-738464a6d369 req-8ec8bef8-0d23-40c4-b9c3-41d4f2ea3e64 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097579 Nov 02 13:45:59.763764 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3141/5893] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:45:59.766787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:45:59.771565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:45:59.794347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.798892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.802833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:45:59.803686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:45:59.804181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:45:59.811540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.134318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:00.145716 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2fa3ce0-8dca-405f-a7fc-0209697fc710 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1507 microversion: 2.1 time: 0.388140 Nov 02 13:46:00.147208 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2753/5894] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:45:59 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:00.211744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:00.213767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:00.222315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.223060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.223771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.224718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.225385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.226042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.290209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:00.291444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:00.292337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:00.292763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lazy-loading 'fault' on Instance uuid dde648d0-0879-4385-91e5-6e38fc8d90e2 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:00.392449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:00.406736 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-263ea752-4302-4ccc-9632-40b6131f00fd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 200 len: 1313 microversion: 2.1 time: 0.198909 Nov 02 13:46:00.419971 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3142/5895] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:00 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:01.170072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.171319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.179616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.180103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.180750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.181625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.182085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.182519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.359946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:01.373495 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-156fd296-9efe-4dcb-897a-bfb85d97523c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1507 microversion: 2.1 time: 0.206117 Nov 02 13:46:01.374315 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2754/5896] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:01.436443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.439182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.455818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.458489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.459222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.460615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.461359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.462800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.492361 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 HTTP/1.1 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'dde648d0-0879-4385-91e5-6e38fc8d90e2'} Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.497288 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.503911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.503911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.503911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.503911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.503911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.503911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.503911 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.505492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.506463 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b61e77c-6b52-4d59-8122-303e77a0ffa2 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 404 len: 111 microversion: 2.1 time: 0.077419 Nov 02 13:46:01.507726 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3143/5897] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:01.523986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.524486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.531205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.531853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.532295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.533013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.533470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.533907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.550663 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 HTTP/1.1 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'dde648d0-0879-4385-91e5-6e38fc8d90e2'} Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.552593 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2d7e8cf3-4a4a-4f40-adc5-a7b2abb1f0fb tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 404 len: 111 microversion: 2.1 time: 0.034503 Nov 02 13:46:01.556890 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2755/5898] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:46:01 2022] DELETE /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:01.563197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.563829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: dde648d0-0879-4385-91e5-6e38fc8d90e2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.571264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.571900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.572508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.573234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.573709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.574127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.592603 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 HTTP/1.1 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'dde648d0-0879-4385-91e5-6e38fc8d90e2'} Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.594178 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.604908 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.604908 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.604908 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.604908 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.604908 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.604908 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. Nov 02 13:46:01.604908 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.604908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance dde648d0-0879-4385-91e5-6e38fc8d90e2 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.608073 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf9650d7-7ea2-4881-a0c8-00f1d3761264 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2" status: 404 len: 111 microversion: 2.1 time: 0.045156 Nov 02 13:46:01.608866 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3144/5899] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/dde648d0-0879-4385-91e5-6e38fc8d90e2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:46:01.620509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.621023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.630527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.631025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.631500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.632210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.632668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.633099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.688993 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e HTTP/1.1 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '79d5b06c-4838-412d-8aea-443640d6830e'} Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.690811 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-32983c49-aa99-4fe8-aec6-8e890889fd07 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 404 len: 111 microversion: 2.1 time: 0.078285 Nov 02 13:46:01.696093 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2756/5900] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:46:01 2022] DELETE /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:01.702754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.703591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 79d5b06c-4838-412d-8aea-443640d6830e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.711708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.712520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.712962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.713968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.714506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.714948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.756270 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e HTTP/1.1 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '79d5b06c-4838-412d-8aea-443640d6830e'} Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.759940 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.765189 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.765189 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.765189 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.765189 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.765189 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.765189 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. Nov 02 13:46:01.765189 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.767645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance 79d5b06c-4838-412d-8aea-443640d6830e could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.768872 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1b8536c-3c9f-4e99-8d36-c86c7ed7f5be tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e" status: 404 len: 111 microversion: 2.1 time: 0.070508 Nov 02 13:46:01.773715 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3145/5901] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/79d5b06c-4838-412d-8aea-443640d6830e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:01.781706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.782219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.789221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.789653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.790282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.791202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.791670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.792153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.807798 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 HTTP/1.1 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'ab6ef169-22ef-40bf-b46d-850022099af7'} Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.809673 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e4267044-46dc-4954-abc6-50c3d8906ea7 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 404 len: 111 microversion: 2.1 time: 0.033647 Nov 02 13:46:01.818446 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2757/5902] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:46:01 2022] DELETE /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:01.824259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.825099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ab6ef169-22ef-40bf-b46d-850022099af7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.832142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.832731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.833253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.834041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.834577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.835086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.853783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 HTTP/1.1 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'ab6ef169-22ef-40bf-b46d-850022099af7'} Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.855664 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance ab6ef169-22ef-40bf-b46d-850022099af7 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d1132b9-5fab-4d53-9e24-65952808dda3 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7" status: 404 len: 111 microversion: 2.1 time: 0.040959 Nov 02 13:46:01.860612 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3146/5903] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/ab6ef169-22ef-40bf-b46d-850022099af7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:01.868579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.869171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.875681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.876269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.876782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.877570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.878730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.879259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.883819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:01.894426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a HTTP/1.1 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'c9dd9263-e23f-4b02-af77-bee6a251194a'} Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.896630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94c1b3f5-7f5d-4d50-a0e4-98f4c9de0151 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 404 len: 111 microversion: 2.1 time: 0.033428 Nov 02 13:46:01.901015 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2758/5904] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:46:01 2022] DELETE /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:01.907669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.907865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: c9dd9263-e23f-4b02-af77-bee6a251194a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.914390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.914965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.915520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.916308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.917471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.917471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.933117 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a HTTP/1.1 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'c9dd9263-e23f-4b02-af77-bee6a251194a'} Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.934776 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance c9dd9263-e23f-4b02-af77-bee6a251194a could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a7a6bad-6006-4595-9d30-578417ae9917 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a" status: 404 len: 111 microversion: 2.1 time: 0.034535 Nov 02 13:46:01.941478 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3147/5905] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/c9dd9263-e23f-4b02-af77-bee6a251194a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:46:01.950118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.951520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.959644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.960448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.960833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.961532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.962235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.962668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:01.978587 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 HTTP/1.1 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'ebd34de4-a37a-418f-9cfa-ec64983ec253'} Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:01.980185 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9011143f-550c-406a-97ff-81e83d2a81ac tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 404 len: 111 microversion: 2.1 time: 0.036937 Nov 02 13:46:01.985916 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2759/5906] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:46:01 2022] DELETE /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:01.991447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:01.992071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: ebd34de4-a37a-418f-9cfa-ec64983ec253] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:01.998752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:01.999058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:01.999545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.000233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.000683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.001111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.016181 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 HTTP/1.1 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'ebd34de4-a37a-418f-9cfa-ec64983ec253'} Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.017730 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance ebd34de4-a37a-418f-9cfa-ec64983ec253 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6833e2b-e377-415a-a5f1-ce9ce6defa34 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253" status: 404 len: 111 microversion: 2.1 time: 0.033286 Nov 02 13:46:02.022747 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3148/5907] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:01 2022] GET /compute/v2.1/servers/ebd34de4-a37a-418f-9cfa-ec64983ec253 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:46:02.031362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:02.032306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:02.042936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.043815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.044267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.045109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.045627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.046074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.065079 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 HTTP/1.1 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e3c85e3b-9187-490c-97c6-e7180f1fb777'} Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:02.067458 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:02.072150 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f2057645-9a55-4d97-8890-addf3796168e tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 404 len: 111 microversion: 2.1 time: 0.043533 Nov 02 13:46:02.072969 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2760/5908] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:46:02 2022] DELETE /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:02.082817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:02.083535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: e3c85e3b-9187-490c-97c6-e7180f1fb777] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:02.091435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.092380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.093107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.094135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.094775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.095459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.119216 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 HTTP/1.1 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e3c85e3b-9187-490c-97c6-e7180f1fb777'} Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.121090 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.125713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.125713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.125713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.125713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:02.125713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:02.125713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. Nov 02 13:46:02.125713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.125713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance e3c85e3b-9187-490c-97c6-e7180f1fb777 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:02.126937 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c223f9c2-9861-4f89-97f7-b5e7e9bd3dec tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777" status: 404 len: 111 microversion: 2.1 time: 0.051981 Nov 02 13:46:02.127616 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3149/5909] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:02 2022] GET /compute/v2.1/servers/e3c85e3b-9187-490c-97c6-e7180f1fb777 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:02.136620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2c445da-57b9-448b-8d1d-29cfacb044bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:02.137367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e2c445da-57b9-448b-8d1d-29cfacb044bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: fbac5a50-1593-4b42-b0cb-cfc022c48096] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:02.143358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e2c445da-57b9-448b-8d1d-29cfacb044bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2c445da-57b9-448b-8d1d-29cfacb044bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096 HTTP/1.1 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fbac5a50-1593-4b42-b0cb-cfc022c48096'} Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.145026 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2c445da-57b9-448b-8d1d-29cfacb044bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e2c445da-57b9-448b-8d1d-29cfacb044bd tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096" status: 404 len: 111 microversion: 2.1 time: 0.013872 Nov 02 13:46:02.149253 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2761/5910] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:46:02 2022] DELETE /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:02.156075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2aa5f38e-da46-44f1-a010-a013e9279eb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:02.156697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2aa5f38e-da46-44f1-a010-a013e9279eb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: fbac5a50-1593-4b42-b0cb-cfc022c48096] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:02.162625 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-2aa5f38e-da46-44f1-a010-a013e9279eb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2aa5f38e-da46-44f1-a010-a013e9279eb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096 HTTP/1.1 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'fbac5a50-1593-4b42-b0cb-cfc022c48096'} Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:02.164300 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:02.168576 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:02.168576 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:02.168576 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:02.168576 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. Nov 02 13:46:02.168576 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:02.168576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2aa5f38e-da46-44f1-a010-a013e9279eb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance fbac5a50-1593-4b42-b0cb-cfc022c48096 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:02.168576 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2aa5f38e-da46-44f1-a010-a013e9279eb0 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096" status: 404 len: 111 microversion: 2.1 time: 0.013742 Nov 02 13:46:02.168576 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3150/5911] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:02 2022] GET /compute/v2.1/servers/fbac5a50-1593-4b42-b0cb-cfc022c48096 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:02.174614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:02.177029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:02.186061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.186942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.187675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.188634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.189329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.204676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.220955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:46:02.325808 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d264767-ebcc-438d-8e0a-32dedb73f58f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "DELETE /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 204 len: 0 microversion: 2.1 time: 0.154974 Nov 02 13:46:02.327570 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2762/5912] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:46:02 2022] DELETE /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:46:02.338396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:02.339254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:02.347770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.348278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.348933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.349868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.350206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.350725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.411525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:02.412903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:02.428884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.429511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.430029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.431071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.431651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.433339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.577204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:02.588837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:02.589496 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1043dcc7-2047-4c91-90bc-ebf7aad7075f tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1483 microversion: 2.1 time: 0.256804 Nov 02 13:46:02.591271 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3151/5913] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:02 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1483 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:02.621362 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9958bab6-dc46-4887-9692-3b059fc95f8b tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1465 microversion: 2.1 time: 0.223663 Nov 02 13:46:02.622338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2763/5914] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:02 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1465 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:02.672146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-312c2869-f1c7-4323-beca-206a8d3e79b3 req-9121e528-7b01-43ed-8287-5aef9936e290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd3d05b-7ad6-4085-9385-a0d86fbf3811", "name": "network-vif-deleted", "tag": "7f7f75d6-a955-4d8d-9854-1e2986e449f7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:02.689040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-312c2869-f1c7-4323-beca-206a8d3e79b3 req-9121e528-7b01-43ed-8287-5aef9936e290 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:02.690010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-312c2869-f1c7-4323-beca-206a8d3e79b3 req-9121e528-7b01-43ed-8287-5aef9936e290 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:02.694484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-312c2869-f1c7-4323-beca-206a8d3e79b3 req-9121e528-7b01-43ed-8287-5aef9936e290 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:02.709763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-312c2869-f1c7-4323-beca-206a8d3e79b3 req-9121e528-7b01-43ed-8287-5aef9936e290 service nova] Creating event network-vif-deleted:7f7f75d6-a955-4d8d-9854-1e2986e449f7 for instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 on n-h1-858384-19 Nov 02 13:46:02.717483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-312c2869-f1c7-4323-beca-206a8d3e79b3 req-9121e528-7b01-43ed-8287-5aef9936e290 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050621 Nov 02 13:46:02.718286 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3152/5915] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:03.617951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:03.618774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:03.631039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:03.635196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:03.635943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:03.643784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:03.645510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:03.646068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:03.646658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:03.647963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:03.671691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:03.672203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:03.672658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:03.682609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:03.683148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:03.683618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:03.727254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:03.727765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:03.728219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:03.728703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lazy-loading 'fault' on Instance uuid 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:03.780844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154efd04b92947d980b7040d16d743be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe5fdc5cb68458fa5e1eb8ef9969771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:03.791734 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a25a41d4-c390-48f5-a78b-66acfa6e9401 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 200 len: 1306 microversion: 2.1 time: 0.149036 Nov 02 13:46:03.791734 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3153/5916] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:03 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 1306 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:03.931576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:03.944567 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7c8ad511-b521-44b6-a006-ce888965e670 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1483 microversion: 2.1 time: 0.332022 Nov 02 13:46:03.945899 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2764/5917] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:03 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1483 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:04.817633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:04.818414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:04.827449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.829938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.833102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.833894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.836165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.836815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.867638 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] HTTP exception thrown: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Request method failure captured: Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 HTTP/1.1 Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnSGZC5VxYqYsz-3cU16YGNt-o-XnZB6fuRYbKaz3du0K84uA6Nf0_0NJm0KFZYjoE41nU_ujgFKQd7FXfzdWDYipExszvCtUTxBOV6OgeN-0j7QQsROL984FEIZEewg-3Mi9IwI6Ca8GqZqRaT8frMC4AqKgqrHQ_65UptxohGJbTM Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 154efd04b92947d980b7040d16d743be Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '9bd3d05b-7ad6-4085-9385-a0d86fbf3811'} Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:04.869501 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Returning 404 to user: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-121eb625-6e8b-4d21-9e4f-db22a16bc187 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 404 len: 111 microversion: 2.1 time: 0.061051 Nov 02 13:46:04.874361 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3154/5918] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:04 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:04.890906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0908b60a-6387-40d0-9213-8ac5382ca999 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:04.917393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.compute.server_groups [None req-0908b60a-6387-40d0-9213-8ac5382ca999 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Querying cell 9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) for 1 instances {{(pid=120929) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 13:46:04.920127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0908b60a-6387-40d0-9213-8ac5382ca999 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.920700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0908b60a-6387-40d0-9213-8ac5382ca999 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:04.921204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0908b60a-6387-40d0-9213-8ac5382ca999 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:04.960339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0908b60a-6387-40d0-9213-8ac5382ca999 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.075419 Nov 02 13:46:04.964944 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2765/5919] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 13:46:04 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:04.977646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:04.979256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:04.989497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a71049bb-3c2e-47c6-af13-0e70ad15f54e tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:04.999183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:04.999793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.001454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.002246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.007212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.007682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.017940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.compute.server_groups [None req-a71049bb-3c2e-47c6-af13-0e70ad15f54e tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Querying cell 9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6(cell1) for 1 instances {{(pid=120929) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 13:46:05.019713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a71049bb-3c2e-47c6-af13-0e70ad15f54e tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.024840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a71049bb-3c2e-47c6-af13-0e70ad15f54e tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.026935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a71049bb-3c2e-47c6-af13-0e70ad15f54e tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.093764 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a71049bb-3c2e-47c6-af13-0e70ad15f54e tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/os-server-groups/cac4d966-c2ae-4be3-b655-02aaf6ad8e75" status: 200 len: 184 microversion: 2.1 time: 0.114173 Nov 02 13:46:05.103763 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2766/5920] 10.222.0.113 () {58 vars in 1268 bytes} [Wed Nov 2 13:46:04 2022] GET /compute/v2.1/os-server-groups/cac4d966-c2ae-4be3-b655-02aaf6ad8e75 => generated 184 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:05.135813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:05.147540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:05.161985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.170308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.170819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.171641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.172298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.172739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.189430 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] HTTP exception thrown: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Request method failure captured: Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 HTTP/1.1 Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnSGZC5VxYqYsz-3cU16YGNt-o-XnZB6fuRYbKaz3du0K84uA6Nf0_0NJm0KFZYjoE41nU_ujgFKQd7FXfzdWDYipExszvCtUTxBOV6OgeN-0j7QQsROL984FEIZEewg-3Mi9IwI6Ca8GqZqRaT8frMC4AqKgqrHQ_65UptxohGJbTM Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 154efd04b92947d980b7040d16d743be Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '9bd3d05b-7ad6-4085-9385-a0d86fbf3811'} Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:05.192448 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Returning 404 to user: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05c4458a-aca8-4a25-8738-ad70ffaf5115 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 404 len: 111 microversion: 2.1 time: 0.067232 Nov 02 13:46:05.196985 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2767/5921] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:46:05 2022] DELETE /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:05.242255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-141acc48-f07b-4b95-ba7a-e0711bedf281 req-5f748e24-133e-4781-a28c-3e5912b7680c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f05519-8017-40c4-b3b6-27d4e243bf5d", "name": "network-vif-deleted", "tag": "799d54a1-ada4-4612-b54c-411914457307"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:05.270664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-141acc48-f07b-4b95-ba7a-e0711bedf281 req-5f748e24-133e-4781-a28c-3e5912b7680c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.283811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-141acc48-f07b-4b95-ba7a-e0711bedf281 req-5f748e24-133e-4781-a28c-3e5912b7680c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.287225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-141acc48-f07b-4b95-ba7a-e0711bedf281 req-5f748e24-133e-4781-a28c-3e5912b7680c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.328912 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-141acc48-f07b-4b95-ba7a-e0711bedf281 req-5f748e24-133e-4781-a28c-3e5912b7680c service nova] Creating event network-vif-deleted:799d54a1-ada4-4612-b54c-411914457307 for instance 81f05519-8017-40c4-b3b6-27d4e243bf5d on n-h1-858384-19 Nov 02 13:46:05.343246 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-141acc48-f07b-4b95-ba7a-e0711bedf281 req-5f748e24-133e-4781-a28c-3e5912b7680c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146707 Nov 02 13:46:05.343906 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2768/5922] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:05.358166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:05.358883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] [instance: 9bd3d05b-7ad6-4085-9385-a0d86fbf3811] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:05.361169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f883a8edef9b47319dc828211e497fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd81d663b98b4fae9f18c2df10cc9b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:05.373945 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3c362f93-c0d4-4201-af14-741975f9efe8 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 200 len: 1441 microversion: 2.1 time: 0.403517 Nov 02 13:46:05.375721 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3155/5923] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:04 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 1441 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:05.405039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:05.408504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.410954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.411746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.412864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:05.413592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:05.419302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:05.442723 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] HTTP exception thrown: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Request method failure captured: Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 HTTP/1.1 Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnSGZC5VxYqYsz-3cU16YGNt-o-XnZB6fuRYbKaz3du0K84uA6Nf0_0NJm0KFZYjoE41nU_ujgFKQd7FXfzdWDYipExszvCtUTxBOV6OgeN-0j7QQsROL984FEIZEewg-3Mi9IwI6Ca8GqZqRaT8frMC4AqKgqrHQ_65UptxohGJbTM Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 154efd04b92947d980b7040d16d743be Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '9bd3d05b-7ad6-4085-9385-a0d86fbf3811'} Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.445867 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.451415 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.451415 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.451415 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.451415 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:05.451415 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:05.451415 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. Nov 02 13:46:05.451415 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.452857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Returning 404 to user: Instance 9bd3d05b-7ad6-4085-9385-a0d86fbf3811 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:05.454064 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-832b8ada-62ea-4dc7-b151-e431f6390a5c tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811" status: 404 len: 111 microversion: 2.1 time: 0.109010 Nov 02 13:46:05.455307 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2769/5924] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:05 2022] GET /compute/v2.1/servers/9bd3d05b-7ad6-4085-9385-a0d86fbf3811 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:05.465729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c02df0ee-850a-4459-a153-487d943bc4a0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:05.480514 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-c02df0ee-850a-4459-a153-487d943bc4a0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] HTTP exception thrown: Instance group 7833cbb3-6447-49b9-9ee3-6d17a8c5794b could not be found. Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c02df0ee-850a-4459-a153-487d943bc4a0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Request method failure captured: Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-server-groups/7833cbb3-6447-49b9-9ee3-6d17a8c5794b HTTP/1.1 Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnSGZC5VxYqYsz-3cU16YGNt-o-XnZB6fuRYbKaz3du0K84uA6Nf0_0NJm0KFZYjoE41nU_ujgFKQd7FXfzdWDYipExszvCtUTxBOV6OgeN-0j7QQsROL984FEIZEewg-3Mi9IwI6Ca8GqZqRaT8frMC4AqKgqrHQ_65UptxohGJbTM Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 154efd04b92947d980b7040d16d743be Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance group 7833cbb3-6447-49b9-9ee3-6d17a8c5794b could not be found. Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7833cbb3-6447-49b9-9ee3-6d17a8c5794b'} Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7833cbb3-6447-49b9-9ee3-6d17a8c5794b could not be found. Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7833cbb3-6447-49b9-9ee3-6d17a8c5794b could not be found. Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.485865 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.489790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.489790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.489790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:05.489790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:05.489790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7833cbb3-6447-49b9-9ee3-6d17a8c5794b could not be found. Nov 02 13:46:05.489790 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.492625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c02df0ee-850a-4459-a153-487d943bc4a0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Returning 404 to user: Instance group 7833cbb3-6447-49b9-9ee3-6d17a8c5794b could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:05.494665 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c02df0ee-850a-4459-a153-487d943bc4a0 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/7833cbb3-6447-49b9-9ee3-6d17a8c5794b" status: 404 len: 117 microversion: 2.1 time: 0.033325 Nov 02 13:46:05.499375 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3156/5925] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:46:05 2022] DELETE /compute/v2.1/os-server-groups/7833cbb3-6447-49b9-9ee3-6d17a8c5794b => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:05.510948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1156ce40-b6bb-42f6-b279-d07b9bbf82bb tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:05.525235 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-1156ce40-b6bb-42f6-b279-d07b9bbf82bb tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] HTTP exception thrown: Instance group 66934163-fd4a-40c7-b4d6-4722a07ca084 could not be found. Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1156ce40-b6bb-42f6-b279-d07b9bbf82bb tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Request method failure captured: Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-server-groups/66934163-fd4a-40c7-b4d6-4722a07ca084 HTTP/1.1 Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnSGZC5VxYqYsz-3cU16YGNt-o-XnZB6fuRYbKaz3du0K84uA6Nf0_0NJm0KFZYjoE41nU_ujgFKQd7FXfzdWDYipExszvCtUTxBOV6OgeN-0j7QQsROL984FEIZEewg-3Mi9IwI6Ca8GqZqRaT8frMC4AqKgqrHQ_65UptxohGJbTM Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 154efd04b92947d980b7040d16d743be Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance group 66934163-fd4a-40c7-b4d6-4722a07ca084 could not be found. Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '66934163-fd4a-40c7-b4d6-4722a07ca084'} Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 66934163-fd4a-40c7-b4d6-4722a07ca084 could not be found. Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 66934163-fd4a-40c7-b4d6-4722a07ca084 could not be found. Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.527747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.532534 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.532534 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.532534 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:05.532534 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:05.532534 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 66934163-fd4a-40c7-b4d6-4722a07ca084 could not be found. Nov 02 13:46:05.532534 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.532534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1156ce40-b6bb-42f6-b279-d07b9bbf82bb tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Returning 404 to user: Instance group 66934163-fd4a-40c7-b4d6-4722a07ca084 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:05.532534 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1156ce40-b6bb-42f6-b279-d07b9bbf82bb tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/66934163-fd4a-40c7-b4d6-4722a07ca084" status: 404 len: 117 microversion: 2.1 time: 0.029107 Nov 02 13:46:05.534012 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2770/5926] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:46:05 2022] DELETE /compute/v2.1/os-server-groups/66934163-fd4a-40c7-b4d6-4722a07ca084 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:05.543297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-447933f9-841f-40c7-ad55-aaeb062b351f tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:05.568673 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-447933f9-841f-40c7-ad55-aaeb062b351f tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] HTTP exception thrown: Instance group af934e7f-6e8e-45d1-acf8-b9cece6bfb2a could not be found. Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-447933f9-841f-40c7-ad55-aaeb062b351f tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Request method failure captured: Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-server-groups/af934e7f-6e8e-45d1-acf8-b9cece6bfb2a HTTP/1.1 Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnSGZC5VxYqYsz-3cU16YGNt-o-XnZB6fuRYbKaz3du0K84uA6Nf0_0NJm0KFZYjoE41nU_ujgFKQd7FXfzdWDYipExszvCtUTxBOV6OgeN-0j7QQsROL984FEIZEewg-3Mi9IwI6Ca8GqZqRaT8frMC4AqKgqrHQ_65UptxohGJbTM Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 154efd04b92947d980b7040d16d743be Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance group af934e7f-6e8e-45d1-acf8-b9cece6bfb2a could not be found. Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'af934e7f-6e8e-45d1-acf8-b9cece6bfb2a'} Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group af934e7f-6e8e-45d1-acf8-b9cece6bfb2a could not be found. Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group af934e7f-6e8e-45d1-acf8-b9cece6bfb2a could not be found. Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.576466 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.581819 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.581819 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.581819 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:05.581819 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:05.581819 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group af934e7f-6e8e-45d1-acf8-b9cece6bfb2a could not be found. Nov 02 13:46:05.581819 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.585731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-447933f9-841f-40c7-ad55-aaeb062b351f tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Returning 404 to user: Instance group af934e7f-6e8e-45d1-acf8-b9cece6bfb2a could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:05.588681 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-447933f9-841f-40c7-ad55-aaeb062b351f tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/af934e7f-6e8e-45d1-acf8-b9cece6bfb2a" status: 404 len: 117 microversion: 2.1 time: 0.049221 Nov 02 13:46:05.594458 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3157/5927] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:46:05 2022] DELETE /compute/v2.1/os-server-groups/af934e7f-6e8e-45d1-acf8-b9cece6bfb2a => generated 117 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:05.599400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed1be080-28bb-4e6b-8697-aacb7a5d6f54 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:05.616163 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-ed1be080-28bb-4e6b-8697-aacb7a5d6f54 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] HTTP exception thrown: Instance group 1022c838-2712-4552-9864-8dca05354665 could not be found. Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed1be080-28bb-4e6b-8697-aacb7a5d6f54 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Request method failure captured: Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/os-server-groups/1022c838-2712-4552-9864-8dca05354665 HTTP/1.1 Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnSGZC5VxYqYsz-3cU16YGNt-o-XnZB6fuRYbKaz3du0K84uA6Nf0_0NJm0KFZYjoE41nU_ujgFKQd7FXfzdWDYipExszvCtUTxBOV6OgeN-0j7QQsROL984FEIZEewg-3Mi9IwI6Ca8GqZqRaT8frMC4AqKgqrHQ_65UptxohGJbTM Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dbe5fdc5cb68458fa5e1eb8ef9969771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dbe5fdc5cb68458fa5e1eb8ef9969771 Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerGroupTestJSON-1487782609 Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 154efd04b92947d980b7040d16d743be Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerGroupTestJSON-1487782609-project Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance group 1022c838-2712-4552-9864-8dca05354665 could not be found. Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '1022c838-2712-4552-9864-8dca05354665'} Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1022c838-2712-4552-9864-8dca05354665 could not be found. Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1022c838-2712-4552-9864-8dca05354665 could not be found. Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.617759 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:05.622779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:05.622779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:05.622779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:05.622779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:05.622779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1022c838-2712-4552-9864-8dca05354665 could not be found. Nov 02 13:46:05.622779 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:05.623808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed1be080-28bb-4e6b-8697-aacb7a5d6f54 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Returning 404 to user: Instance group 1022c838-2712-4552-9864-8dca05354665 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:05.624384 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed1be080-28bb-4e6b-8697-aacb7a5d6f54 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/1022c838-2712-4552-9864-8dca05354665" status: 404 len: 117 microversion: 2.1 time: 0.029618 Nov 02 13:46:05.625210 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2771/5928] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:46:05 2022] DELETE /compute/v2.1/os-server-groups/1022c838-2712-4552-9864-8dca05354665 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:05.638303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0295c078-870f-4dc0-b5e3-4b899525ce97 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:05.719712 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0295c078-870f-4dc0-b5e3-4b899525ce97 tempest-ServerGroupTestJSON-1487782609 tempest-ServerGroupTestJSON-1487782609-project] 10.222.0.113 "DELETE /compute/v2.1/os-server-groups/cac4d966-c2ae-4be3-b655-02aaf6ad8e75" status: 204 len: 0 microversion: 2.1 time: 0.072543 Nov 02 13:46:05.725683 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3158/5929] 10.222.0.113 () {58 vars in 1271 bytes} [Wed Nov 2 13:46:05 2022] DELETE /compute/v2.1/os-server-groups/cac4d966-c2ae-4be3-b655-02aaf6ad8e75 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:46:06.401772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:06.402439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] [instance: 81f05519-8017-40c4-b3b6-27d4e243bf5d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:06.416689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.417353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.417807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:06.421211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:06.421689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:06.422129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:06.460543 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] HTTP exception thrown: Instance 81f05519-8017-40c4-b3b6-27d4e243bf5d could not be found. Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Request method failure captured: Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d HTTP/1.1 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnPVRKwV-f2V2_wsllCiM7dLtAkZMQWrnCWqOkaEaJHJmbfY0jAUkxF_RKZITygEPGwgzRlFggK6X47FQU7xrI2k288k6zO4eBvrV2Lm0tNs5P_dgeUQyQIevMZliG9U7rmFKe5YhX0XHDuvYIlMZaNKIbsyah8XxfI-8DmMSc7N4uc Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dd81d663b98b4fae9f18c2df10cc9b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersTestJSON-806304078 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: dd81d663b98b4fae9f18c2df10cc9b99 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersTestJSON-806304078 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersTestJSON-806304078-project Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f883a8edef9b47319dc828211e497fe7 Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersTestJSON-806304078-project Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 81f05519-8017-40c4-b3b6-27d4e243bf5d could not be found. Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '81f05519-8017-40c4-b3b6-27d4e243bf5d'} Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f05519-8017-40c4-b3b6-27d4e243bf5d could not be found. Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f05519-8017-40c4-b3b6-27d4e243bf5d could not be found. Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:46:06.462591 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.467164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:46:06.467164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:46:06.467164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:46:06.467164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:46:06.467164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:46:06.467164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f05519-8017-40c4-b3b6-27d4e243bf5d could not be found. Nov 02 13:46:06.467164 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:46:06.468841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] Returning 404 to user: Instance 81f05519-8017-40c4-b3b6-27d4e243bf5d could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:46:06.470270 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-44784c28-d6c1-40a5-a79b-1eea57dc5681 tempest-ServersTestJSON-806304078 tempest-ServersTestJSON-806304078-project] 10.222.0.113 "GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d" status: 404 len: 111 microversion: 2.1 time: 0.072955 Nov 02 13:46:06.474915 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2772/5930] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:06 2022] GET /compute/v2.1/servers/81f05519-8017-40c4-b3b6-27d4e243bf5d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:46:28.972695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=61 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:28.973457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:29.219282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-114710519", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:29.356461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] validate_networks() for [('7253f73a-1c6f-46cb-9c46-c248c5f41208', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:46:30.235513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:30.238905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:30.491415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:46:30.492096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:46:30.492757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:46:30.493378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:46:30.494144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:46:30.500270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1248087424", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:30.517692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.518325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.518976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.527379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:30.530178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:30.534382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:30.594143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Getting quotas for project dce706ff2fb44a1bb9295245b85a8299. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:30.602648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] validate_networks() for [('0babba78-dc1c-4b58-944c-210f5092be54', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:46:30.604283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Getting quotas for user ca9dfb4b81524bceb10c14f3849ab09c and project dce706ff2fb44a1bb9295245b85a8299. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:30.651072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:46:30.656935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:46:30.738710 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05d45c12-3964-40a1-a69d-60b08a1b6cd6 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.772261 Nov 02 13:46:30.744354 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3159/5931] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:46:28 2022] POST /compute/v2.1/servers => generated 385 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:46:30.766035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2600910f-6d4e-4a38-a95a-f3a35955d0cd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:30.767105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2600910f-6d4e-4a38-a95a-f3a35955d0cd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:30.945301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2600910f-6d4e-4a38-a95a-f3a35955d0cd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:30.956615 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2600910f-6d4e-4a38-a95a-f3a35955d0cd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1217 microversion: 2.1 time: 0.206717 Nov 02 13:46:30.957974 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3160/5932] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:30 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:31.985574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:31.988379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:32.003959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:32.022841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:32.023470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:32.026571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:32.027431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:32.032636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:32.242083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:32.255821 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3aa0de1e-aba3-4c2d-b03f-5a67289e2e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1269 microversion: 2.1 time: 0.276337 Nov 02 13:46:32.258680 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3161/5933] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:31 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1269 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:32.601164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:46:32.602223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:46:32.602901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:46:32.603534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:46:32.604238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:46:32.625406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:32.628686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:32.630683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:32.636118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:32.636843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:32.637460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:32.686067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Getting quotas for project e484ea0314dd483d81c4e81be668cf49. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:32.702752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Getting quotas for user e24fb86a07244f4fb510617de48d98b5 and project e484ea0314dd483d81c4e81be668cf49. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:32.746217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:46:32.748559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:46:32.856196 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [47ea6434-e0ae-4224-b6a5-a3168bce624c] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:46:33.285348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:33.299999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:33.327071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.333714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.334338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:33.335269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:33.335847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:33.336392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:33.554877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:33.570825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-86b1fc45-ed61-4034-998d-c056b456995c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1275 microversion: 2.1 time: 0.290158 Nov 02 13:46:33.582839 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3162/5934] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:33 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:33.866282 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [47ea6434-e0ae-4224-b6a5-a3168bce624c] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 47556. Nov 02 13:46:33.871731 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4742627f-bbd8-4ee0-a737-abb854b13636 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.663922 Nov 02 13:46:33.872697 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2773/5935] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:46:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 3668 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:46:33.886348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-50586639-4215-4c07-8ebe-d5b3f17a0321 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:33.887290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-50586639-4215-4c07-8ebe-d5b3f17a0321 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:34.097974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-50586639-4215-4c07-8ebe-d5b3f17a0321 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:34.107348 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-50586639-4215-4c07-8ebe-d5b3f17a0321 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1221 microversion: 2.1 time: 0.226249 Nov 02 13:46:34.107958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3163/5936] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:33 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1221 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:34.598041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:34.598657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:34.611236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:34.611733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:34.612172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:34.613126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:34.615770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:34.616474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.136318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:35.137583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:35.156870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.164685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.165511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.166860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:35.167531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:35.168178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:35.405268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:35.411419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:35.449516 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29fb9366-462c-4c75-a584-eaf4a83b2738 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1225 microversion: 2.1 time: 0.313656 Nov 02 13:46:35.455187 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3164/5937] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:35 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1225 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:35.479170 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-71dd6b80-256f-4704-8c2e-b4a0b0c2e9c0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1317 microversion: 2.1 time: 0.861122 Nov 02 13:46:35.487220 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2774/5938] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:34 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1317 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:36.482143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:36.483195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:36.491218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:36.492621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:36.493893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:36.494972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:36.495647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:36.496444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:36.510961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:36.512902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:36.522623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:36.523976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:36.525494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:36.527267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:36.541039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:36.541891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:37.100979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:37.111254 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-faa83ebb-fb85-42e6-8a63-f8f24bef34a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1279 microversion: 2.1 time: 0.634275 Nov 02 13:46:37.115537 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3165/5939] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:36 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1279 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:37.214042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:37.233436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a01e694-669e-4238-bc7f-cd83d4d9a882 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1317 microversion: 2.1 time: 0.727204 Nov 02 13:46:37.236589 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2775/5940] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:36 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1317 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:38.145201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:38.146211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:38.156892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.160121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.160894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.161900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.162608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.163411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.258393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:38.259002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:38.270182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.271035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.272979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.289336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.292519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.294106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.859748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:38.860016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:38.871656 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a7dda21d-fbeb-452d-aa70-77104aa189f2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1279 microversion: 2.1 time: 0.741394 Nov 02 13:46:38.874607 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6b40899-9c75-43bd-a369-7d589398f4ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1317 microversion: 2.1 time: 0.620910 Nov 02 13:46:38.877602 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2776/5941] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:38 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:38.879609 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3166/5942] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:38 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1279 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:38.906021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-057bb80b-f066-4e19-9233-0fd6ce5e46dc req-08dfef70-184c-4074-939e-af6111146e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82211405-a402-49b1-a747-adada43272ed", "tag": "21777df3-edac-4055-8209-f14265c77538"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:38.927715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-057bb80b-f066-4e19-9233-0fd6ce5e46dc req-08dfef70-184c-4074-939e-af6111146e54 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:38.929125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-057bb80b-f066-4e19-9233-0fd6ce5e46dc req-08dfef70-184c-4074-939e-af6111146e54 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:38.933940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-057bb80b-f066-4e19-9233-0fd6ce5e46dc req-08dfef70-184c-4074-939e-af6111146e54 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:38.949563 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-057bb80b-f066-4e19-9233-0fd6ce5e46dc req-08dfef70-184c-4074-939e-af6111146e54 service nova] Creating event network-changed:21777df3-edac-4055-8209-f14265c77538 for instance 82211405-a402-49b1-a747-adada43272ed on n-h1-858384-19 Nov 02 13:46:38.956241 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-057bb80b-f066-4e19-9233-0fd6ce5e46dc req-08dfef70-184c-4074-939e-af6111146e54 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076471 Nov 02 13:46:38.957453 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2777/5943] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:39.914133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:39.914861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:39.916011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:39.916635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:39.934197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:39.934713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:39.935725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:39.936247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:39.937355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:39.939360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:39.939943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:39.941200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:39.941663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:39.943343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:39.943838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:39.949033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:40.543657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:40.557096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-21772c1c-0d1e-4946-ba78-3a18cf9e0d46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1321 microversion: 2.1 time: 0.652580 Nov 02 13:46:40.563979 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2778/5944] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:39 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1321 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:40.567075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:40.648916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:40.665690 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4ac406ea-3063-41aa-90c6-d1110ad57850 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1317 microversion: 2.1 time: 0.767986 Nov 02 13:46:40.679429 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3167/5945] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:39 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:41.152713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c54fdff7-d11a-4518-a16d-1e0cf71fd475 req-3ac425d5-940d-473d-84b7-a1e56925f2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7944ff2a-3114-464d-9ecf-c287973c180c", "tag": "2c92be66-37bc-431d-9fc4-1784271237fb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:41.191803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c54fdff7-d11a-4518-a16d-1e0cf71fd475 req-3ac425d5-940d-473d-84b7-a1e56925f2c5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.192308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c54fdff7-d11a-4518-a16d-1e0cf71fd475 req-3ac425d5-940d-473d-84b7-a1e56925f2c5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.194913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c54fdff7-d11a-4518-a16d-1e0cf71fd475 req-3ac425d5-940d-473d-84b7-a1e56925f2c5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.224487 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c54fdff7-d11a-4518-a16d-1e0cf71fd475 req-3ac425d5-940d-473d-84b7-a1e56925f2c5 service nova] Creating event network-changed:2c92be66-37bc-431d-9fc4-1784271237fb for instance 7944ff2a-3114-464d-9ecf-c287973c180c on n-h2-858384-19 Nov 02 13:46:41.232992 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c54fdff7-d11a-4518-a16d-1e0cf71fd475 req-3ac425d5-940d-473d-84b7-a1e56925f2c5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085956 Nov 02 13:46:41.234364 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2779/5946] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:46:41.587078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:41.603300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:41.620677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.623350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.629016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.630350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.634139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.634702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.699251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:41.701411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:41.728108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.730474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.738362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:41.739523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:41.740229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:41.741141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:42.151441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:42.160606 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7623d179-35cf-47ed-93a2-6d7a73b6fa89 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1317 microversion: 2.1 time: 0.469913 Nov 02 13:46:42.175631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:42.176158 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2780/5947] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:41 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:42.183616 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-27dea894-cb44-40bd-8b7a-fa2bc3ceb83e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1321 microversion: 2.1 time: 0.604336 Nov 02 13:46:42.184937 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3168/5948] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:41 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:43.186319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:43.187196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:43.191242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:43.192090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:43.200157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.201440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.202111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.203768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.204667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.205435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.209456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:43.210087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:43.224558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.225069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.225501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.226389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:43.226853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:43.227888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:43.647028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:43.657496 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4db932b2-9090-4e18-b8dc-b1f8af7503dc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1317 microversion: 2.1 time: 0.475392 Nov 02 13:46:43.659526 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2781/5949] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:43 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:43.691567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:43.705515 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-42649007-22a3-4370-9d76-7fdc5b7bc653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1321 microversion: 2.1 time: 0.499112 Nov 02 13:46:43.718885 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3169/5950] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:43 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:44.685895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:44.687189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:44.704631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.705359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.715843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.716622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.717109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.717552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.731577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:44.732863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:44.743986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:44.752047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.752609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.753071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:44.753824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:44.754290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:44.754728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:45.108736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:45.120381 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7bea8bf8-0e9d-4c0e-be07-4f595a019bbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1321 microversion: 2.1 time: 0.392733 Nov 02 13:46:45.121918 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3170/5951] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:44 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:45.129328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-25f303b8-dbef-484a-b066-3473a920a3e5 req-f382f96d-d3d1-4cbc-a5de-609c5276d8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82211405-a402-49b1-a747-adada43272ed", "name": "network-vif-plugged", "status": "completed", "tag": "21777df3-edac-4055-8209-f14265c77538"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:45.143628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-25f303b8-dbef-484a-b066-3473a920a3e5 req-f382f96d-d3d1-4cbc-a5de-609c5276d8f7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:45.144828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-25f303b8-dbef-484a-b066-3473a920a3e5 req-f382f96d-d3d1-4cbc-a5de-609c5276d8f7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:45.145519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-25f303b8-dbef-484a-b066-3473a920a3e5 req-f382f96d-d3d1-4cbc-a5de-609c5276d8f7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:45.149123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:45.160303 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-702c2cff-2fa0-4afe-bc6d-e98539294cf0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1317 microversion: 2.1 time: 0.480822 Nov 02 13:46:45.161531 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2782/5952] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:44 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:45.189804 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-25f303b8-dbef-484a-b066-3473a920a3e5 req-f382f96d-d3d1-4cbc-a5de-609c5276d8f7 service nova] Creating event network-vif-plugged:21777df3-edac-4055-8209-f14265c77538 for instance 82211405-a402-49b1-a747-adada43272ed on n-h1-858384-19 Nov 02 13:46:45.197316 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-25f303b8-dbef-484a-b066-3473a920a3e5 req-f382f96d-d3d1-4cbc-a5de-609c5276d8f7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073815 Nov 02 13:46:45.202579 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3171/5953] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:46.149711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:46.150340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:46.166215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.166819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.167368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.168371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.168976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.169553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.188436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:46.190668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:46.208699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.209639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.210949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.215152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:46.217174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:46.217934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:46.526299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:46.539338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a18b5b74-b56a-4e4b-9b39-1b34ed9bc037 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1321 microversion: 2.1 time: 0.393577 Nov 02 13:46:46.539945 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2783/5954] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:46 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:46.754367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:46.769102 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4dae6424-e6bd-491a-9941-e740f43b8e72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1317 microversion: 2.1 time: 0.585104 Nov 02 13:46:46.769717 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3172/5955] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:46 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:47.569799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:47.570575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:47.582831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.587646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.589811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:47.596720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.597354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.597810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:47.794981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:47.797434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:47.807331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.808586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.809414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:47.811698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:47.812615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:47.813454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.122842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:48.136680 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d782263-826c-49d3-8e7a-6c39d1614cdc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1503 microversion: 2.1 time: 0.347321 Nov 02 13:46:48.139038 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3173/5956] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:47 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:48.180716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:48.185215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:48.194330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:48.195472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:48.196162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.197412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:48.197782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:48.198230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.271361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lazy-loading 'flavor' on Instance uuid 82211405-a402-49b1-a747-adada43272ed {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:46:48.402766 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-341d4e6e-59a8-47dd-9b3a-40302039f49a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "POST /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed/action" status: 200 len: 32 microversion: 2.1 time: 0.231602 Nov 02 13:46:48.428087 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3174/5957] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:46:48 2022] POST /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:46:48.442617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:48.443670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:48.458584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:48.459519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:48.460486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.461644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:48.478146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:48.478836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.511954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:48.540470 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a1f5ba6c-377c-49e2-aaa9-19d92fe66653 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1321 microversion: 2.1 time: 0.974842 Nov 02 13:46:48.544259 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2784/5958] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:47 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1321 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:48.773200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:48.789737 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c9939d2d-525f-4cfa-855d-2365c7cc8b27 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.356096 Nov 02 13:46:48.791102 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3175/5959] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:48 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:48.890803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-729b6289-6b52-4ff8-9f97-0b150ab18661 req-eac0cde3-ac71-4b08-a176-18408e19735e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7944ff2a-3114-464d-9ecf-c287973c180c", "name": "network-vif-plugged", "status": "completed", "tag": "2c92be66-37bc-431d-9fc4-1784271237fb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:48.910637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-729b6289-6b52-4ff8-9f97-0b150ab18661 req-eac0cde3-ac71-4b08-a176-18408e19735e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:48.911161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-729b6289-6b52-4ff8-9f97-0b150ab18661 req-eac0cde3-ac71-4b08-a176-18408e19735e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:48.917578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-729b6289-6b52-4ff8-9f97-0b150ab18661 req-eac0cde3-ac71-4b08-a176-18408e19735e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:48.945868 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-729b6289-6b52-4ff8-9f97-0b150ab18661 req-eac0cde3-ac71-4b08-a176-18408e19735e service nova] Creating event network-vif-plugged:2c92be66-37bc-431d-9fc4-1784271237fb for instance 7944ff2a-3114-464d-9ecf-c287973c180c on n-h2-858384-19 Nov 02 13:46:48.959961 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-729b6289-6b52-4ff8-9f97-0b150ab18661 req-eac0cde3-ac71-4b08-a176-18408e19735e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072242 Nov 02 13:46:48.961121 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2785/5960] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:46:49.570809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:49.572036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:49.580483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.581271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.581889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:49.582987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.583475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.583905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:49.819481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:49.820952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:49.830875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.831474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.831990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:49.832716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:49.833229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:49.833750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:50.032024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:50.036857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:50.041979 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2d89282-7201-458b-9d95-61c83cafb270 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1321 microversion: 2.1 time: 0.475543 Nov 02 13:46:50.042582 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3176/5961] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:49 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:50.243325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:50.257426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f011b319-ae61-49df-a498-eb1b262ab3c9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.445235 Nov 02 13:46:50.271018 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2786/5962] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:49 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:51.074425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:51.075219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:51.112255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:51.113525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:51.115660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:51.116853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:51.117555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:51.120229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:51.287651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:51.288856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:51.296588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:51.297106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:51.297688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:51.302561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:51.303610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:51.304236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:51.510753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:51.519971 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f53bb309-4246-4e5a-86ad-5fc7bd5d2dbf tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.240454 Nov 02 13:46:51.520578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2787/5963] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:51 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:51.572711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:51.582580 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-92c383bf-0eff-4d55-8bdc-656727994cf0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.520453 Nov 02 13:46:51.583571 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3177/5964] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:51 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:51.761728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1431769952", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:51.827387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] validate_networks() for [('0babba78-dc1c-4b58-944c-210f5092be54', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:46:52.546803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:52.560254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:52.573814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:52.575194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:52.575701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:46:52.576177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:46:52.576495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:52.576628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:46:52.576988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:46:52.577396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:46:52.578217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:52.579822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:52.580490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:52.625465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:52.626935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:52.627596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:52.632149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:52.632870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:52.633343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:52.671405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Getting quotas for project e484ea0314dd483d81c4e81be668cf49. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:46:52.678565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Getting quotas for user e24fb86a07244f4fb510617de48d98b5 and project e484ea0314dd483d81c4e81be668cf49. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:46:52.697091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:46:52.700656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:46:52.768890 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1cccd723-717e-4821-b29a-461168985766 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.011075 Nov 02 13:46:52.777234 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2788/5965] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:46:51 2022] POST /compute/v2.1/servers => generated 382 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:46:52.787004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-560f45b4-f4bb-4ca8-b994-c4bc2afaf1a7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:52.787661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-560f45b4-f4bb-4ca8-b994-c4bc2afaf1a7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:53.127749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-560f45b4-f4bb-4ca8-b994-c4bc2afaf1a7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:53.148603 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-560f45b4-f4bb-4ca8-b994-c4bc2afaf1a7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1221 microversion: 2.1 time: 0.361538 Nov 02 13:46:53.150976 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2789/5966] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:52 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1221 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:53.284255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:53.300434 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-51dce0b6-a090-47f1-baec-edd364ff00bc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.759091 Nov 02 13:46:53.302806 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3178/5967] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:52 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:54.179030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:54.180426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:54.203004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:54.211218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:54.211822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:54.216666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:54.217176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:54.217634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:54.330328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:54.331727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:54.341852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:54.362193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:54.363481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:54.365757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:54.368514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:54.373390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:54.378272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:54.394804 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16a06b44-09ae-4db5-97ea-4c8ced4d66bd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1273 microversion: 2.1 time: 0.220695 Nov 02 13:46:54.395909 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2790/5968] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:54 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:54.864311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:54.901643 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74ccd842-52c5-4e2a-bd26-b6dd28beb20f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.575152 Nov 02 13:46:54.909812 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3179/5969] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:54 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:55.422171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:55.424456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:55.432347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.433340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.434213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:55.435789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.436487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.437540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:55.934524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:55.935995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:55.950510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.951296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.951930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:55.952879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:55.953494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:55.961500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:56.078179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:56.090890 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03fedbb9-4591-48cb-9e2d-49421e64a7d4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1279 microversion: 2.1 time: 0.672884 Nov 02 13:46:56.103142 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2791/5970] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:55 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1279 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:56.451423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:56.465703 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9cf55a02-3137-4177-a406-270bde14c7ca tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.535562 Nov 02 13:46:56.466978 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3180/5971] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:55 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:57.117557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:57.118187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:57.135145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:57.137908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:57.138394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:57.139194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:57.151769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:57.152081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:57.496488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:57.497999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:57.499696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:57.522961 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-25af2d52-1668-458c-96f2-1610418cfece tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1321 microversion: 2.1 time: 0.406013 Nov 02 13:46:57.526586 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2792/5972] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:57 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:57.527613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:57.530999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:57.531757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:57.544979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:57.545656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:57.546293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:57.807510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:57.847330 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a070f9de-cf0b-44c2-9c11-481d55220318 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.356664 Nov 02 13:46:57.848194 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3181/5973] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:57 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:58.549764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:58.550992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:58.559210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.560704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.561250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.562021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.562617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.563047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.872012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:46:58.872837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:46:58.881164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.881821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.882394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.883532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:58.884465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:58.885374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:58.964128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:58.972186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:46:58.981392 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1384bd27-e491-4afa-af37-341019b84c5d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1321 microversion: 2.1 time: 0.435172 Nov 02 13:46:58.982498 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2793/5974] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:58 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:46:59.231647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:46:59.256381 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8555243f-a4c3-4384-a68c-aca7dd46b4a2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.387750 Nov 02 13:46:59.257388 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3182/5975] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:46:58 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:46:59.609476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f7de74d3-60b1-4872-bee7-d77b5ea8a1f4 req-352a74cc-cfc5-4090-8af2-1517e23b1a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a534ecf4-5854-48e1-895c-118db7e315fa", "tag": "976b3ab9-cf71-431a-8d56-afbf86d8764c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:46:59.630652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f7de74d3-60b1-4872-bee7-d77b5ea8a1f4 req-352a74cc-cfc5-4090-8af2-1517e23b1a2d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:46:59.631861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f7de74d3-60b1-4872-bee7-d77b5ea8a1f4 req-352a74cc-cfc5-4090-8af2-1517e23b1a2d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:46:59.632521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f7de74d3-60b1-4872-bee7-d77b5ea8a1f4 req-352a74cc-cfc5-4090-8af2-1517e23b1a2d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:46:59.660985 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f7de74d3-60b1-4872-bee7-d77b5ea8a1f4 req-352a74cc-cfc5-4090-8af2-1517e23b1a2d service nova] Creating event network-changed:976b3ab9-cf71-431a-8d56-afbf86d8764c for instance a534ecf4-5854-48e1-895c-118db7e315fa on n-h1-858384-19 Nov 02 13:46:59.669345 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f7de74d3-60b1-4872-bee7-d77b5ea8a1f4 req-352a74cc-cfc5-4090-8af2-1517e23b1a2d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064542 Nov 02 13:46:59.669989 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2794/5976] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:47:00.010691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:00.011414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:00.029388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:00.031486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.031953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.032551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:00.033339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.033757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.034202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:00.285736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:00.286460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:00.303841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:00.309575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.310525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.311176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:00.312089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:00.318613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:00.319561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:00.446525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:00.463710 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-24ba8afe-a697-4b0a-ba6e-c23f47b899eb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1321 microversion: 2.1 time: 0.457193 Nov 02 13:47:00.464381 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3183/5977] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:00 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:01.018214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:01.027044 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-394269fc-dbf7-454f-85e7-1614bc9be706 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.746586 Nov 02 13:47:01.032381 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2795/5978] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:00 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:01.488926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:01.490555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:01.498247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:01.499010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:01.499726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:01.509927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:01.510607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:01.511269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:02.057865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:02.058420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:02.073174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:02.074603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:02.075644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:02.077162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:02.082199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:02.083019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:02.163364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:02.190547 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-073258cd-4fa8-4f52-bdaf-040e03ab7f93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1321 microversion: 2.1 time: 0.707141 Nov 02 13:47:02.192299 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3184/5979] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:01 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1321 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:02.418401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:02.443106 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4279e568-9f1e-468e-a329-ea57af5d73ae tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.389405 Nov 02 13:47:02.443736 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2796/5980] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:02 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:03.219876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:03.224525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:03.238615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.240188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.242146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.243294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.244200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.245953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.472378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:03.472986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:03.475155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:03.476853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:03.483586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.484587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.486222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.487220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:03.488018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:03.488808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:03.668921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:03.684247 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-98693697-a49c-4ef7-99e1-20f458af594a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1321 microversion: 2.1 time: 0.473632 Nov 02 13:47:03.685090 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3185/5981] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:03 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:03.905862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:03.951455 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d00c0daa-ab70-4be4-997f-620b9eeefebc tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.483191 Nov 02 13:47:03.953589 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2797/5982] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:03 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:04.718116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:04.720041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:04.739822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:04.742015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:04.743874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:04.744870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:04.748896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:04.749755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:04.980309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:04.981660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:05.005900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:05.007866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:05.011423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:05.012447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:05.013645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:05.017003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:05.152138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:05.170480 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-883d815b-3adf-420e-b914-1e46f31fa94c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1321 microversion: 2.1 time: 0.462986 Nov 02 13:47:05.171104 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3186/5983] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:04 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:05.832960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:05.842007 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1fda38f0-089b-4c6e-8a11-1b81c83f64c5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.865592 Nov 02 13:47:05.842794 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2798/5984] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:04 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:06.196826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:06.197449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:06.205576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:06.206074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:06.206524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:06.207280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:06.207745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:06.208177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:06.442944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:06.456514 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-70cf1cfa-fe5c-4c5f-a752-c31594bfa13c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1321 microversion: 2.1 time: 0.263839 Nov 02 13:47:06.457672 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3187/5985] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:06 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:06.868214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:06.869708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:06.881309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:06.884385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:06.884942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:06.888118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:06.888733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:06.889317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:06.961562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-987d31b3-0aed-4c1d-9008-7238e04e508c req-c7fdd69d-9193-4032-884d-d31ebd23782b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a534ecf4-5854-48e1-895c-118db7e315fa", "name": "network-vif-plugged", "status": "completed", "tag": "976b3ab9-cf71-431a-8d56-afbf86d8764c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:06.990619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-987d31b3-0aed-4c1d-9008-7238e04e508c req-c7fdd69d-9193-4032-884d-d31ebd23782b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:06.991105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-987d31b3-0aed-4c1d-9008-7238e04e508c req-c7fdd69d-9193-4032-884d-d31ebd23782b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:06.991563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-987d31b3-0aed-4c1d-9008-7238e04e508c req-c7fdd69d-9193-4032-884d-d31ebd23782b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:07.017722 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-987d31b3-0aed-4c1d-9008-7238e04e508c req-c7fdd69d-9193-4032-884d-d31ebd23782b service nova] Creating event network-vif-plugged:976b3ab9-cf71-431a-8d56-afbf86d8764c for instance a534ecf4-5854-48e1-895c-118db7e315fa on n-h1-858384-19 Nov 02 13:47:07.037176 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-987d31b3-0aed-4c1d-9008-7238e04e508c req-c7fdd69d-9193-4032-884d-d31ebd23782b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084532 Nov 02 13:47:07.038169 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3188/5986] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:47:07.347904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:07.360670 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-80e3b803-8fe9-4727-a49f-385da88e884e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.497741 Nov 02 13:47:07.361727 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2799/5987] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:06 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:07.481070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:07.482528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:07.491872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:07.492816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:07.493435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:07.494157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:07.494620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:07.495063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:08.178007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:08.191979 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd8ea45e-2457-4198-bac3-31c7213ee53c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1321 microversion: 2.1 time: 0.715192 Nov 02 13:47:08.217183 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3189/5988] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:07 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1321 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:08.385161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:08.385835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:08.403812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:08.404524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:08.405242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:08.406263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:08.407194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:08.407870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:08.820799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:08.841729 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-15700d94-e8f8-49e4-81bb-ef79d79ef938 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.460330 Nov 02 13:47:08.845910 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2800/5989] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:08 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:09.231880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:09.232703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:09.247604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.251608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.255968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.257038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.257532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.257995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.643302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:09.654137 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae6df23a-3d98-4115-9025-3a2c75b47a3b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1510 microversion: 2.1 time: 0.436764 Nov 02 13:47:09.655437 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3190/5990] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:09 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:09.680906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:09.682096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:09.690418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.691229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.691976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.692849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.693458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.694039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.728350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:47:09.849536 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0c69b14-429d-4a65-ab7d-237bd6739d78 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 204 len: 0 microversion: 2.1 time: 0.173914 Nov 02 13:47:09.859206 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2801/5991] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:47:09 2022] DELETE /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:47:09.859414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:09.860789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:09.870771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.871815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.872516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.873471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.874162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.874851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.878751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:09.880379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:09.893147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.893937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.894558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:09.896494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:09.897318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:09.899309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:10.290717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:10.305633 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b98da158-d5f8-4c80-9c39-4992b972ad4c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1516 microversion: 2.1 time: 0.450714 Nov 02 13:47:10.319138 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3191/5992] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:09 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1516 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:10.322415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:10.338072 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16a3ec0d-8da1-4125-80fa-bf56218a4884 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.466870 Nov 02 13:47:10.339081 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2802/5993] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:09 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:11.333810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:11.335619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:11.348850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.351643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.354001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.356794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.358999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.362991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.365239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:11.366133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:11.379073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.379667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.380183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.382419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:11.383654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:11.384702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:11.726439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:11.737224 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c9cebec8-d8fe-4935-9234-7f1346fcacf1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1516 microversion: 2.1 time: 0.409694 Nov 02 13:47:11.751983 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3192/5994] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:11 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1516 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:12.028371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:12.037093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b3977ea7-a69d-460a-ae60-8e32e848e588 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.676994 Nov 02 13:47:12.052373 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2803/5995] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:11 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:12.658988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-53d066e6-ce47-4ff4-a90e-563717ec0c1b req-afcb9037-156e-4a19-be6d-2c40ec71a369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a534ecf4-5854-48e1-895c-118db7e315fa", "name": "network-vif-deleted", "tag": "976b3ab9-cf71-431a-8d56-afbf86d8764c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:12.679241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-53d066e6-ce47-4ff4-a90e-563717ec0c1b req-afcb9037-156e-4a19-be6d-2c40ec71a369 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:12.680117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-53d066e6-ce47-4ff4-a90e-563717ec0c1b req-afcb9037-156e-4a19-be6d-2c40ec71a369 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:12.680844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-53d066e6-ce47-4ff4-a90e-563717ec0c1b req-afcb9037-156e-4a19-be6d-2c40ec71a369 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:12.715920 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-53d066e6-ce47-4ff4-a90e-563717ec0c1b req-afcb9037-156e-4a19-be6d-2c40ec71a369 service nova] Creating event network-vif-deleted:976b3ab9-cf71-431a-8d56-afbf86d8764c for instance a534ecf4-5854-48e1-895c-118db7e315fa on n-h1-858384-19 Nov 02 13:47:12.734010 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-53d066e6-ce47-4ff4-a90e-563717ec0c1b req-afcb9037-156e-4a19-be6d-2c40ec71a369 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083621 Nov 02 13:47:12.737526 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3193/5996] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:12.767648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:12.769977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:12.785856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:12.787327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:12.787327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:12.788239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:12.789012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:12.789706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:12.960387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:12.972423 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f1631706-421d-4e7f-a8ba-b7ae7bf54003 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 200 len: 1306 microversion: 2.1 time: 0.210704 Nov 02 13:47:12.973269 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2804/5997] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:12 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 1306 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:13.067661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:13.068374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:13.075058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:13.075836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:13.076472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:13.077199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:13.077659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:13.078702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:13.594351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:13.599077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:13.606153 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7a50caa1-ba4b-4d0b-9505-1f7e3334cee2 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.543749 Nov 02 13:47:13.606760 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3194/5998] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:13 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:13.996215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:13.996832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:14.012051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.012548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.013745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.016840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.017533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.017995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.049629 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa HTTP/1.1 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'a534ecf4-5854-48e1-895c-118db7e315fa'} Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:14.051371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.056815 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:14.056815 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:14.056815 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:14.056815 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:14.056815 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:14.056815 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:14.056815 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.058972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:14.063334 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b183cc85-30f2-4cdc-8e1b-87760b6cf62c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 404 len: 111 microversion: 2.1 time: 0.070407 Nov 02 13:47:14.073275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:14.074012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:14.080025 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2805/5999] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:13 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:14.098481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.098994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.102166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.102938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.103668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.104113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.444039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:14.452750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de095be6-de90-4c00-954a-d4d0ae4a8062 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.383978 Nov 02 13:47:14.453983 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3195/6000] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:14 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:14.524186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64c50f4d-0b49-4cbd-94e7-b80728723078 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64c50f4d-0b49-4cbd-94e7-b80728723078 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 163 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": 12345, "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi 12345 Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:14.534188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 02 13:47:14.538504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:14.541369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-64c50f4d-0b49-4cbd-94e7-b80728723078 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:14.542532 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-64c50f4d-0b49-4cbd-94e7-b80728723078 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.022447 Nov 02 13:47:14.543938 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2806/6001] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:14 2022] POST /compute/v2.1/servers => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:14.554567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:14.558047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:14.566906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.567831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.568506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.570979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.571739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.572411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.635199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:14.636193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:14.649705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.650574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.651237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.652162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.652786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.653392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.826599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:14.844339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c290f57a-c0b4-409c-87b5-701c9b7f3898 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.293086 Nov 02 13:47:14.847722 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3196/6002] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:14 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:14.874114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:14.875794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:14.882033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.882793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.883592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:14.885318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:14.886332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:14.886962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:15.028103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:15.043435 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de043c7c-4ca0-4046-af4f-975d1a2249be tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.414072 Nov 02 13:47:15.044199 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2807/6003] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:14 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:15.331574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:15.343073 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb095d08-3c77-41ce-bd91-523f849b0cd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.472436 Nov 02 13:47:15.364258 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3197/6004] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:14 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:16.070640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:16.071923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:16.087045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.088822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.089444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.095233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:16.095986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:16.096862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:16.503677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:16.526807 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-00408350-3ce4-45f7-a6d9-09804d99b5ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.451434 Nov 02 13:47:16.527591 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2808/6005] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:16 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:17.562072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:17.563556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:17.571004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:17.571585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:17.572033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:17.572749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:17.573431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:17.574307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:17.813831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:17.825795 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d9dfbe6b-8276-4cca-9ca0-ec821065eda5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.273017 Nov 02 13:47:17.827052 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3198/6006] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:17 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:18.405902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a5c41e3f-8e67-417a-94f1-1312d4e16c2f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1790669746", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5497d8c8-f796-4052-8e46-20cafe9ce3ba", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:18.512462 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-a5c41e3f-8e67-417a-94f1-1312d4e16c2f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Block Device 5497d8c8-f796-4052-8e46-20cafe9ce3ba is not bootable. Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a5c41e3f-8e67-417a-94f1-1312d4e16c2f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 358 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1790669746", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5497d8c8-f796-4052-8e46-20cafe9ce3ba", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: exception: Block Device 5497d8c8-f796-4052-8e46-20cafe9ce3ba is not bootable. Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1790669746', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5497d8c8-f796-4052-8e46-20cafe9ce3ba'}], 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5497d8c8-f796-4052-8e46-20cafe9ce3ba is not bootable. Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:18.528036 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5497d8c8-f796-4052-8e46-20cafe9ce3ba is not bootable. Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5497d8c8-f796-4052-8e46-20cafe9ce3ba is not bootable. Nov 02 13:47:18.533303 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:18.535677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a5c41e3f-8e67-417a-94f1-1312d4e16c2f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Block Device 5497d8c8-f796-4052-8e46-20cafe9ce3ba is not bootable. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:18.537702 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a5c41e3f-8e67-417a-94f1-1312d4e16c2f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.142831 Nov 02 13:47:18.542550 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2809/6007] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:18.548862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:18.551137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:18.557950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:18.558543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:18.559084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:18.559942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:18.560699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:18.565249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:18.850180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:18.850804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:18.866545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:18.867146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:18.868404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:18.870884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:18.871728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:18.872938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:18.889624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:18.903985 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0dcdea21-5cdf-4cda-a37c-952b38b03054 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.360023 Nov 02 13:47:18.904593 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3199/6008] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:18 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:18.933427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:18.934062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:18.964964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:18.965454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:18.969630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:18.970453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:18.970931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:18.971394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:19.330382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:19.339821 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7f7501aa-6cd6-46b3-816a-aef8df6a2e3e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1509 microversion: 2.1 time: 0.493513 Nov 02 13:47:19.345591 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2810/6009] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:18 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1509 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:19.426798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:19.444096 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e20ab501-16a6-484a-abca-8fdb5e0b13da tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.514577 Nov 02 13:47:19.445080 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3200/6010] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:18 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:20.368295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:20.368968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:20.392979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:20.393486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:20.393934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:20.394666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:20.395152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:20.395586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:20.868414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:20.894933 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed91bc87-cb8f-4a2e-b8b8-34497a6c133a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1489 microversion: 2.1 time: 0.531555 Nov 02 13:47:20.896136 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2811/6011] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:20 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1489 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:21.157037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2134618282", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:21.296007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] validate_networks() for [('7253f73a-1c6f-46cb-9c46-c248c5f41208', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:47:22.022782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:47:22.023825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:47:22.024742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:47:22.025273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:47:22.026048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:47:22.039876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.040776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.041588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.042686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.043470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.044124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.071623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Getting quotas for project dce706ff2fb44a1bb9295245b85a8299. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:47:22.082692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Getting quotas for user ca9dfb4b81524bceb10c14f3849ab09c and project dce706ff2fb44a1bb9295245b85a8299. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:47:22.103564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:47:22.106357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:47:22.197200 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4d0f42b-ef2c-4e32-92d5-1e91e2a2b09a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.053588 Nov 02 13:47:22.198363 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3201/6012] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:21 2022] POST /compute/v2.1/servers => generated 385 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:47:22.209536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63bb84e3-ce8d-4487-9ff8-6745c087a5ac tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:22.211251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63bb84e3-ce8d-4487-9ff8-6745c087a5ac tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:22.342912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f19bab2f-4580-4193-aaef-78840620efec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-658575580", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "destination_type": "local"}, {"source_type": "volume", "uuid": "95e2d2bc-6c9d-4bc5-95b6-9377d6ea0bd5", "destination_type": "invalid"}], "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f19bab2f-4580-4193-aaef-78840620efec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 494 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-658575580", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "destination_type": "local"}, {"source_type": "volume", "uuid": "95e2d2bc-6c9d-4bc5-95b6-9377d6ea0bd5", "destination_type": "invalid"}], "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-658575580', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '95e2d2bc-6c9d-4bc5-95b6-9377d6ea0bd5', 'destination_type': 'invalid'}], 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:22.351909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 02 13:47:22.356530 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:22.361044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f19bab2f-4580-4193-aaef-78840620efec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:22.362143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f19bab2f-4580-4193-aaef-78840620efec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.023473 Nov 02 13:47:22.366147 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3202/6013] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:22 2022] POST /compute/v2.1/servers => generated 155 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:22.373933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:22.375336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:22.383245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.384023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.384715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.385669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:22.386339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:22.387003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:22.818306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63bb84e3-ce8d-4487-9ff8-6745c087a5ac tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:22.826172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63bb84e3-ce8d-4487-9ff8-6745c087a5ac tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1218 microversion: 2.1 time: 0.620585 Nov 02 13:47:22.826948 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2812/6014] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:22 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1218 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:22.961451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:22.972734 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-543b03c5-85bf-4d65-88da-dd39194986c5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.603954 Nov 02 13:47:23.004772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:23.005255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:23.008057 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3203/6015] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:22 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:23.012026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.012521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.012960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.013661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.014113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.014540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.019890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:23.558281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:23.567714 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c92c93ce-b19b-4970-aa94-27b518d0b645 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.569573 Nov 02 13:47:23.579134 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2813/6016] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:22 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:23.635261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3660d74d-8c4b-4c4e-9561-ce7540c19c6b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-68751039", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3660d74d-8c4b-4c4e-9561-ce7540c19c6b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 490 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-68751039", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-68751039', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:23.641038 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3660d74d-8c4b-4c4e-9561-ce7540c19c6b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3660d74d-8c4b-4c4e-9561-ce7540c19c6b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.013019 Nov 02 13:47:23.644358 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3204/6017] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:23 2022] POST /compute/v2.1/servers => generated 624 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:47:23.655377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:23.656610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:23.663004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.663644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.663933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.665076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.665763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.666198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.859960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:23.860723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:23.869249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.870946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.872230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:23.878216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:23.879057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:23.880339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.016993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:24.033538 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90459fa2-c42f-4c0c-b56b-2d60364b823a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.383212 Nov 02 13:47:24.042334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:24.053703 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2814/6018] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:23 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:24.059866 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7ea597b-c1dd-4242-998c-6e5b0da7a745 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1288 microversion: 2.1 time: 0.213175 Nov 02 13:47:24.061301 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3205/6019] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:23 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1288 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:24.078707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:24.079748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:24.092878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.095004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.095674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.096406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.097177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.097774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.499163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:24.510364 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-91523ab0-ab0e-4474-97bc-0980ddc5668a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.443337 Nov 02 13:47:24.511265 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2815/6020] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:24 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:24.670899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4bb15b35-dbd2-492c-973c-ec02c1464799 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4bb15b35-dbd2-492c-973c-ec02c1464799 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 416 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:24.676997 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4bb15b35-dbd2-492c-973c-ec02c1464799 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4bb15b35-dbd2-492c-973c-ec02c1464799 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011877 Nov 02 13:47:24.685323 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3206/6021] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:24 2022] POST /compute/v2.1/servers => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:24.690008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:24.691084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:24.699972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.702880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.702880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:24.702880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:24.704906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:24.705992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.013950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:25.022617 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ea9a58e8-748f-4ba5-b533-98987dc8db4d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.338498 Nov 02 13:47:25.035533 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2816/6022] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:24 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:25.053716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:25.054541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:25.079965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.080536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.081068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.081877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.082423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.082937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.086374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:25.087075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:25.096873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.097859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.098510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.099775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:25.100391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:25.101306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:25.458335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:25.472681 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-be8983d9-ea23-423d-8da9-ecf41bddad32 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1318 microversion: 2.1 time: 0.390975 Nov 02 13:47:25.473276 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2817/6023] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:25 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:25.801457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:25.816838 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1dd8ec0-e0a2-45d8-99e0-5d171b8e8087 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.767356 Nov 02 13:47:25.820424 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3207/6024] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:25 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:25.979379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0e16e7e-7542-417b-9ae5-c388067edbb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1194468020", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": -1, "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:26.033842 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f0e16e7e-7542-417b-9ae5-c388067edbb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Flavor -1 could not be found. Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0e16e7e-7542-417b-9ae5-c388067edbb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 206 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1194468020", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": -1, "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: exception: Flavor -1 could not be found. Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1194468020', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': -1, 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:26.061564 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0e16e7e-7542-417b-9ae5-c388067edbb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f0e16e7e-7542-417b-9ae5-c388067edbb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.093881 Nov 02 13:47:26.068117 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2818/6025] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:25 2022] POST /compute/v2.1/servers => generated 73 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:47:26.079885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:26.080509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:26.097502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.098485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.099143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.101251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.102173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.102794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.501543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:26.502148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:26.521289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.521790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.522436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.523370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.523996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.524776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.746084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.760720 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e3605e82-28ac-4c97-a241-d55499052c93 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.685405 Nov 02 13:47:26.761645 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3208/6026] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:26 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:26.768211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ee2aa4e9-8c8b-4821-8f9f-20652dacf0dd req-866a898c-0559-4daf-8896-caa75a74b798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11826045-d4be-4857-956d-0052871ce042", "tag": "14ae07b7-6c3b-4cdb-88ca-9be0c308b765"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:26.779382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ee2aa4e9-8c8b-4821-8f9f-20652dacf0dd req-866a898c-0559-4daf-8896-caa75a74b798 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.780260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ee2aa4e9-8c8b-4821-8f9f-20652dacf0dd req-866a898c-0559-4daf-8896-caa75a74b798 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.781992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ee2aa4e9-8c8b-4821-8f9f-20652dacf0dd req-866a898c-0559-4daf-8896-caa75a74b798 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.803216 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ee2aa4e9-8c8b-4821-8f9f-20652dacf0dd req-866a898c-0559-4daf-8896-caa75a74b798 service nova] Creating event network-changed:14ae07b7-6c3b-4cdb-88ca-9be0c308b765 for instance 11826045-d4be-4857-956d-0052871ce042 on n-h1-858384-19 Nov 02 13:47:26.811749 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ee2aa4e9-8c8b-4821-8f9f-20652dacf0dd req-866a898c-0559-4daf-8896-caa75a74b798 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046975 Nov 02 13:47:26.815301 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3209/6027] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:47:26.824133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:26.825034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:26.835280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.837057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.837706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.839126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:26.839886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:26.840527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:26.964749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:26.982302 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5f9b6b43-c5d1-416a-9482-58c7b687f949 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1318 microversion: 2.1 time: 0.489421 Nov 02 13:47:26.983544 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2819/6028] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:26 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:27.285200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:27.294507 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2ff0a13-e8c8-40e0-83fb-c5af40be6c82 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.477283 Nov 02 13:47:27.314253 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3210/6029] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:26 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:27.510230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-13c53dc8-0541-430c-b555-e647b85d920c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-966111496", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-13c53dc8-0541-430c-b555-e647b85d920c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 172 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-966111496", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-966111496', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi -1 Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:27.514589 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-13c53dc8-0541-430c-b555-e647b85d920c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-13c53dc8-0541-430c-b555-e647b85d920c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.015255 Nov 02 13:47:27.520195 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2820/6030] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:27 2022] POST /compute/v2.1/servers => generated 145 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:27.529735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:27.532526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:27.542554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.543236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.543688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.544416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.544873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.545303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.868594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:27.878841 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-103643d7-af0d-4e50-a2b5-9a63170e98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.353909 Nov 02 13:47:27.879480 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3211/6031] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:27 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:27.904177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:27.904981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:27.913326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.914080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.914687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:27.915410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:27.916029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:27.916456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.005687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:28.006634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:28.022942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.023908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.024598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.025672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.026409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.027604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.180150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:28.200264 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b41810ec-0cec-4bdb-88e9-40823b2b9cc4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.298792 Nov 02 13:47:28.211559 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2821/6032] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:27 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:28.387071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:28.404946 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b420c7ee-dfc8-4060-a386-886dd4936180 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1318 microversion: 2.1 time: 0.403241 Nov 02 13:47:28.406281 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3212/6033] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:28 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:28.412418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-59ff6190-1a1e-4f65-ba4b-98e9a764d94a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1771153227", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:28.422276 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-59ff6190-1a1e-4f65-ba4b-98e9a764d94a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-59ff6190-1a1e-4f65-ba4b-98e9a764d94a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 216 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1771153227", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1771153227', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._validate_network_id( Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:28.424545 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:28.429284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:28.429284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:28.429284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:28.429284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:28.429284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:28.429284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:28.429284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 02 13:47:28.429284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:28.433512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-59ff6190-1a1e-4f65-ba4b-98e9a764d94a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:28.439146 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-59ff6190-1a1e-4f65-ba4b-98e9a764d94a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.034527 Nov 02 13:47:28.441048 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2822/6034] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:28 2022] POST /compute/v2.1/servers => generated 123 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:28.452168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:28.453601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:28.461746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.462871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.462871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:28.463562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:28.464030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:28.464469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.078447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.088451 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41aa4b28-a312-4519-b53a-aebbad87d834 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.643074 Nov 02 13:47:29.089585 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3213/6035] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:28 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:29.118259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:29.119185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:29.138353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.138850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.139318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.140231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.141122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.141871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.310337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.322853 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d0714cd-bec0-4543-8bd0-0b031c3e9ec8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.209038 Nov 02 13:47:29.325566 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2823/6036] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:29 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:29.440649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:29.441413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:29.461533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.462147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.463323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.467659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:29.469372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:29.470119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:29.744058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c244833d-82ee-4221-8dda-6dbe1c6618ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-27179941", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "key_name": "tempest-key-1960044292", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:29.793877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:29.805642 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ede90b7a-4e3a-4e71-9066-10a58c5f0fd9 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1318 microversion: 2.1 time: 0.378300 Nov 02 13:47:29.818302 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3214/6037] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:29 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:29.852434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-c244833d-82ee-4221-8dda-6dbe1c6618ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] validate_networks() for [('0babba78-dc1c-4b58-944c-210f5092be54', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:47:30.594141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:30.597982 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c244833d-82ee-4221-8dda-6dbe1c6618ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Invalid key_name provided. Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c244833d-82ee-4221-8dda-6dbe1c6618ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 245 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-27179941", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "key_name": "tempest-key-1960044292", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid key_name provided. Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-27179941', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'key_name': 'tempest-key-1960044292', 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1960044292 not found for user e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:30.600586 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Nov 02 13:47:30.607736 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:30.622390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c244833d-82ee-4221-8dda-6dbe1c6618ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid key_name provided. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:30.624952 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c244833d-82ee-4221-8dda-6dbe1c6618ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.883909 Nov 02 13:47:30.631952 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2824/6038] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:29 2022] POST /compute/v2.1/servers => generated 70 bytes in 891 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 13:47:30.638013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:30.638966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:30.647324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:30.658962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.659902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.660457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.661481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.662077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.662611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.838279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:30.843506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:30.852684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.853517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.854330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.856132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:30.857351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:30.858677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:30.989800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:30.997073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:31.008102 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12b21f3f-79d2-4a61-9dae-2d776d033b74 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.374583 Nov 02 13:47:31.009886 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3215/6039] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:30 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:31.040703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:31.041487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:31.050862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:31.052112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:31.052610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:31.053055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:31.055876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:31.056435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:31.056951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:31.078899 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1f824cca-5589-4b29-98c9-19e3ced9cf11 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1318 microversion: 2.1 time: 0.247428 Nov 02 13:47:31.079943 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2825/6040] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:30 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:31.376451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:31.385101 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0c96950-b6cf-4e76-88b5-9dffc72ffde6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.350002 Nov 02 13:47:31.386504 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3216/6041] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:31 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:31.587185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20147d3b-3660-4a79-813e-7a7091da770b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-270706326", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:31.717233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.security_group_api [None req-20147d3b-3660-4a79-813e-7a7091da770b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Neutron security group does_not_exist not found {{(pid=120929) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 02 13:47:31.719797 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-20147d3b-3660-4a79-813e-7a7091da770b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20147d3b-3660-4a79-813e-7a7091da770b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 257 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-270706326", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: exception: Unable to find security_group with name or id 'does_not_exist' Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-270706326', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Nov 02 13:47:31.751218 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Nov 02 13:47:31.756143 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:31.761347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20147d3b-3660-4a79-813e-7a7091da770b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:31.762220 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20147d3b-3660-4a79-813e-7a7091da770b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.180631 Nov 02 13:47:31.762829 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2826/6042] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:31 2022] POST /compute/v2.1/servers => generated 106 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:31.775030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:31.775589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:31.784423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:31.784915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:31.785394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:31.786108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:31.787006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:31.787006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.057843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:32.097415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:32.106871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:32.107849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:32.127103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.127774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.128221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.128955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.129441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.129881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.207989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:32.233170 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ed190e9-a9cc-42c6-bbde-add892e77440 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.464813 Nov 02 13:47:32.235977 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3217/6043] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:31 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:32.260330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:32.261147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:32.268040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.269593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.270237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.271180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.271811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.272413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.329939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:32.341423 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a63b07c2-4584-4cbb-9d0d-d9858db14507 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1318 microversion: 2.1 time: 0.238599 Nov 02 13:47:32.342034 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2827/6044] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:32 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:32.610931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:32.620530 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0484753-851d-4e93-b3bf-2dfa057c79b0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.364067 Nov 02 13:47:32.636677 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3218/6045] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:32 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:32.647241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81a29f5f-3eff-47e1-b4d6-30e4f23bed49 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:32.647991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-81a29f5f-3eff-47e1-b4d6-30e4f23bed49 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 69b2f49d-a3fb-44ed-b8aa-43001e85c120] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:32.655215 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-81a29f5f-3eff-47e1-b4d6-30e4f23bed49 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 69b2f49d-a3fb-44ed-b8aa-43001e85c120 could not be found. Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81a29f5f-3eff-47e1-b4d6-30e4f23bed49 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/69b2f49d-a3fb-44ed-b8aa-43001e85c120 HTTP/1.1 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 69b2f49d-a3fb-44ed-b8aa-43001e85c120 could not be found. Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '69b2f49d-a3fb-44ed-b8aa-43001e85c120'} Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b2f49d-a3fb-44ed-b8aa-43001e85c120 could not be found. Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b2f49d-a3fb-44ed-b8aa-43001e85c120 could not be found. Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:32.658056 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:32.666840 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:32.666840 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:32.666840 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:32.666840 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:32.666840 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:32.666840 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:32.666840 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b2f49d-a3fb-44ed-b8aa-43001e85c120 could not be found. Nov 02 13:47:32.666840 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:32.669389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81a29f5f-3eff-47e1-b4d6-30e4f23bed49 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 69b2f49d-a3fb-44ed-b8aa-43001e85c120 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:32.670461 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-81a29f5f-3eff-47e1-b4d6-30e4f23bed49 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "DELETE /compute/v2.1/servers/69b2f49d-a3fb-44ed-b8aa-43001e85c120" status: 404 len: 111 microversion: 2.1 time: 0.028071 Nov 02 13:47:32.671873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2828/6046] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:47:32 2022] DELETE /compute/v2.1/servers/69b2f49d-a3fb-44ed-b8aa-43001e85c120 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:47:32.697248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:32.698048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:32.707274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.707887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.708350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.709060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:32.710214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:32.710747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:32.987081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.002616 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-109d3ef1-7b70-4a48-9ada-fffb8dfff5fc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.325017 Nov 02 13:47:33.003915 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3219/6047] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:32 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:33.028390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:33.030388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:33.038069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:33.040576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.041287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.042093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.043134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.043911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.044625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.057921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e524726f-1b6b-4114-abf0-f7a8295856af req-e47b626c-e90f-4ff0-9980-429c2bda21fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11826045-d4be-4857-956d-0052871ce042", "name": "network-vif-plugged", "status": "completed", "tag": "14ae07b7-6c3b-4cdb-88ca-9be0c308b765"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:33.081260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e524726f-1b6b-4114-abf0-f7a8295856af req-e47b626c-e90f-4ff0-9980-429c2bda21fd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.083722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e524726f-1b6b-4114-abf0-f7a8295856af req-e47b626c-e90f-4ff0-9980-429c2bda21fd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.084385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e524726f-1b6b-4114-abf0-f7a8295856af req-e47b626c-e90f-4ff0-9980-429c2bda21fd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.117991 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e524726f-1b6b-4114-abf0-f7a8295856af req-e47b626c-e90f-4ff0-9980-429c2bda21fd service nova] Creating event network-vif-plugged:14ae07b7-6c3b-4cdb-88ca-9be0c308b765 for instance 11826045-d4be-4857-956d-0052871ce042 on n-h1-858384-19 Nov 02 13:47:33.127043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e524726f-1b6b-4114-abf0-f7a8295856af req-e47b626c-e90f-4ff0-9980-429c2bda21fd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073483 Nov 02 13:47:33.127967 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3220/6048] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:47:33.368773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:33.369935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:33.378637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.378987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.379683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.380651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.381881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.382300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.453547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.466232 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a15943d1-0b45-4b0e-91d9-8a3813061e7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.441018 Nov 02 13:47:33.476951 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2829/6049] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:33 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:33.495834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d045d6db-d3d3-4e08-a455-f06d09cc82a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:33.496637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d045d6db-d3d3-4e08-a455-f06d09cc82a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:47:33.497407 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d045d6db-d3d3-4e08-a455-f06d09cc82a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d045d6db-d3d3-4e08-a455-f06d09cc82a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 9223372036854775808 could not be found. Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '9223372036854775808'} Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:33.500460 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:33.506141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:33.506141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:33.506141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:33.506141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Nov 02 13:47:33.506141 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:33.508221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d045d6db-d3d3-4e08-a455-f06d09cc82a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:33.510344 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d045d6db-d3d3-4e08-a455-f06d09cc82a4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.020539 Nov 02 13:47:33.512047 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2830/6050] 10.222.0.113 () {58 vars in 1193 bytes} [Wed Nov 2 13:47:33 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:47:33.523581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:33.524474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:33.541900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.542410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.545330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.548113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.548621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.549072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.659154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.680077 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c99fe84-8d2a-45f2-8ee0-7ee44027a6e4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1318 microversion: 2.1 time: 0.317370 Nov 02 13:47:33.696397 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3221/6051] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:33 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:33.867287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:33.876947 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da5fb9e1-41d5-4f90-93dc-55e88019256e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.358863 Nov 02 13:47:33.899633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2831/6052] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:33 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:33.905670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:33.906420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:33.915926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.917220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.918003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:33.919069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:33.920181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:33.920934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.175431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:34.185005 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0cae228-36a8-42d7-a639-86a41e5106f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.284199 Nov 02 13:47:34.185975 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3222/6053] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:33 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:34.212878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-88117bb4-94a5-42ba-be53-d994cf14b2fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:34.214123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-88117bb4-94a5-42ba-be53-d994cf14b2fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Failed to fetch instance by id -1 {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 13:47:34.214878 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-88117bb4-94a5-42ba-be53-d994cf14b2fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance -1 could not be found. Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-88117bb4-94a5-42ba-be53-d994cf14b2fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance -1 could not be found. Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '-1'} Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:34.216622 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:34.221666 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:34.221666 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:34.221666 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Nov 02 13:47:34.221666 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:34.224492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-88117bb4-94a5-42ba-be53-d994cf14b2fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:34.226360 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-88117bb4-94a5-42ba-be53-d994cf14b2fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018625 Nov 02 13:47:34.227496 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2832/6054] 10.222.0.113 () {58 vars in 1142 bytes} [Wed Nov 2 13:47:34 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:47:34.237697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:34.238604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:34.246395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.247254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.248043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.249097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.250451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.251168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.510128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:34.533198 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-218f1adf-acee-40a8-a288-06e5c4ccc348 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.301245 Nov 02 13:47:34.533804 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3223/6055] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:34 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:34.564080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:34.565964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:34.576934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.578751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.580929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.582534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.583267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.583932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.708859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:34.709551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:34.728731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.729294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.729759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.730504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:34.730958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:34.731433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:34.926849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:34.941978 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0ba7a4d4-f785-4d62-a675-d2d43ed014ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.385814 Nov 02 13:47:34.962536 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2833/6056] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:34 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:34.969865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d578bdd-4674-400f-8f33-543bd4ec063b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:34.970627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d578bdd-4674-400f-8f33-543bd4ec063b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 41a35250-28f6-46d7-b8a7-0a9350f25166] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:34.980504 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-7d578bdd-4674-400f-8f33-543bd4ec063b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 41a35250-28f6-46d7-b8a7-0a9350f25166 could not be found. Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d578bdd-4674-400f-8f33-543bd4ec063b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/41a35250-28f6-46d7-b8a7-0a9350f25166/action HTTP/1.1 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 19 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: {"forceDelete": {}} Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 41a35250-28f6-46d7-b8a7-0a9350f25166 could not be found. Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '41a35250-28f6-46d7-b8a7-0a9350f25166', 'body': {'forceDelete': {}}} Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a35250-28f6-46d7-b8a7-0a9350f25166 could not be found. Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a35250-28f6-46d7-b8a7-0a9350f25166 could not be found. Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:34.999627 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:35.004766 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:35.004766 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:35.004766 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a35250-28f6-46d7-b8a7-0a9350f25166 could not be found. Nov 02 13:47:35.004766 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:35.006619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d578bdd-4674-400f-8f33-543bd4ec063b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 41a35250-28f6-46d7-b8a7-0a9350f25166 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:35.010493 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d578bdd-4674-400f-8f33-543bd4ec063b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/41a35250-28f6-46d7-b8a7-0a9350f25166/action" status: 404 len: 111 microversion: 2.1 time: 0.045364 Nov 02 13:47:35.011489 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2834/6057] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:34 2022] POST /compute/v2.1/servers/41a35250-28f6-46d7-b8a7-0a9350f25166/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:47:35.026927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:35.032507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:35.060925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.061679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.062793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.063728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.066459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.067066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.122142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:35.134926 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f9fc261-39f7-4717-818c-42065e924f33 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1318 microversion: 2.1 time: 0.432735 Nov 02 13:47:35.135557 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3224/6058] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:34 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:35.496979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:35.510876 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-02fb901c-8ff9-4a2b-8271-45d95e0d11a2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.492694 Nov 02 13:47:35.521897 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2835/6059] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:35 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:35.539941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:35.541230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:35.568115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.568883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.569544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.570764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.571599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.572275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.844644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:35.860661 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71647ce8-80d3-4a3a-9cf2-3a2a84aeaab7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.324883 Nov 02 13:47:35.861275 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3225/6060] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:35 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:35.889438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6abcccee-446c-4b71-b91e-02c4b8019167 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:35.892038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6abcccee-446c-4b71-b91e-02c4b8019167 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: f6f7c11e-8673-47d9-ace5-a0523c1c5f5f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:35.906283 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-6abcccee-446c-4b71-b91e-02c4b8019167 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance f6f7c11e-8673-47d9-ace5-a0523c1c5f5f could not be found. Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6abcccee-446c-4b71-b91e-02c4b8019167 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/f6f7c11e-8673-47d9-ace5-a0523c1c5f5f/action HTTP/1.1 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 39 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: {"os-getConsoleOutput": {"length": 10}} Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f6f7c11e-8673-47d9-ace5-a0523c1c5f5f could not be found. Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f6f7c11e-8673-47d9-ace5-a0523c1c5f5f', 'body': {'os-getConsoleOutput': {'length': 10}}} Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f7c11e-8673-47d9-ace5-a0523c1c5f5f could not be found. Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f7c11e-8673-47d9-ace5-a0523c1c5f5f could not be found. Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:35.923350 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:35.932264 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:35.932264 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:35.932264 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:35.932264 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:35.932264 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f7c11e-8673-47d9-ace5-a0523c1c5f5f could not be found. Nov 02 13:47:35.932264 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:35.932264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6abcccee-446c-4b71-b91e-02c4b8019167 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance f6f7c11e-8673-47d9-ace5-a0523c1c5f5f could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:35.932264 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6abcccee-446c-4b71-b91e-02c4b8019167 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/f6f7c11e-8673-47d9-ace5-a0523c1c5f5f/action" status: 404 len: 111 microversion: 2.1 time: 0.045592 Nov 02 13:47:35.932264 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2836/6061] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:35 2022] POST /compute/v2.1/servers/f6f7c11e-8673-47d9-ace5-a0523c1c5f5f/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:35.938153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:35.938819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:35.956746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.957254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.958800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:35.961433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:35.961953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:35.965471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.164103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:36.165066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:36.178446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.184267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.185094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.188092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.190498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.192057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.462773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:36.482036 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b197f98b-56ae-45a7-8f3b-425537caa24f tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1503 microversion: 2.1 time: 0.320893 Nov 02 13:47:36.483866 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2837/6062] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:36 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:36.510493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:36.516016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:36.530291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.537152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.537736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.538488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.538946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.539400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.609475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lazy-loading 'flavor' on Instance uuid 11826045-d4be-4857-956d-0052871ce042 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:47:36.718809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:36.749848 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af7fdadc-0137-4390-9ec9-801fd6030fa7 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "POST /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042/action" status: 200 len: 32 microversion: 2.1 time: 0.245297 Nov 02 13:47:36.751576 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2838/6063] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:36 2022] POST /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 13:47:36.782293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:36.785599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:36.844581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.846247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.847447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:36.851725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:36.853315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:36.855073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:37.066709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:37.079987 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-56f82e92-528a-4c65-a230-5079c51c1ff6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 1.144083 Nov 02 13:47:37.106222 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3226/6064] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:35 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:37.113537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:37.114425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:37.122396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.123281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.124023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:37.125555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.128133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.129086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:37.261941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:37.290381 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0663b53a-2808-4a98-8653-b3a0481cae12 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.520687 Nov 02 13:47:37.307546 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2839/6065] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:36 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:37.492451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:37.502317 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c37bc862-295a-449f-a47e-e8ff35fb3511 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.394051 Nov 02 13:47:37.503361 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3227/6066] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:37 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:37.527984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46eb0c06-dd20-4074-99d4-6251306258ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:37.529475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-46eb0c06-dd20-4074-99d4-6251306258ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 47b6341e-905a-4af4-80d5-cb7a0a667762] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:37.538559 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-46eb0c06-dd20-4074-99d4-6251306258ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 47b6341e-905a-4af4-80d5-cb7a0a667762 could not be found. Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46eb0c06-dd20-4074-99d4-6251306258ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/47b6341e-905a-4af4-80d5-cb7a0a667762 HTTP/1.1 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 47b6341e-905a-4af4-80d5-cb7a0a667762 could not be found. Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '47b6341e-905a-4af4-80d5-cb7a0a667762'} Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b6341e-905a-4af4-80d5-cb7a0a667762 could not be found. Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b6341e-905a-4af4-80d5-cb7a0a667762 could not be found. Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:37.540612 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:37.545070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:37.545070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:37.545070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:37.545070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b6341e-905a-4af4-80d5-cb7a0a667762 could not be found. Nov 02 13:47:37.545070 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:37.548842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46eb0c06-dd20-4074-99d4-6251306258ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 47b6341e-905a-4af4-80d5-cb7a0a667762 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:37.550024 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-46eb0c06-dd20-4074-99d4-6251306258ab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/47b6341e-905a-4af4-80d5-cb7a0a667762" status: 404 len: 111 microversion: 2.1 time: 0.026351 Nov 02 13:47:37.561207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:37.562546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:37.566101 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2840/6067] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:37 2022] GET /compute/v2.1/servers/47b6341e-905a-4af4-80d5-cb7a0a667762 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:37.570321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.571037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.571555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:37.572337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:37.572910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:37.573418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.053115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:38.074435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-093b9c12-cc9f-4857-bcf9-35fd4c21866c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.517426 Nov 02 13:47:38.078917 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3228/6068] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:37 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:38.107303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:38.108849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:38.118715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.119537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.120006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.121050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.121962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.122675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.336877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:38.337548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:38.348606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.349447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.350708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.351649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.352280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.352879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.364766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:38.379008 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d2b9602e-7eff-45d8-9d1c-4de728d96324 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.276837 Nov 02 13:47:38.405049 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2841/6069] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:38 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:38.475067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-597609d3-884d-4d97-aeb3-8a01332e8178 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1379419954", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-597609d3-884d-4d97-aeb3-8a01332e8178 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 238 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1379419954", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1379419954', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:38.522125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-597609d3-884d-4d97-aeb3-8a01332e8178 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:38.526897 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-597609d3-884d-4d97-aeb3-8a01332e8178 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.053601 Nov 02 13:47:38.534693 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2842/6070] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:38 2022] POST /compute/v2.1/servers => generated 139 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:38.537311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:38.538268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:38.548051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.548929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.549598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.550585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.551452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.552726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.720956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:38.731034 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f69b3a3-32c7-46ad-a374-73413fc10c1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.201880 Nov 02 13:47:38.732138 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2843/6071] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:38 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:38.755236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:38.755870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:38.762220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.762698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.763167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.763866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:38.764306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:38.765321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:38.833924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:38.851084 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1f1d8ed-8d13-4c64-a5e2-749197473327 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.520576 Nov 02 13:47:38.852099 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3229/6072] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:38 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:38.949896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:38.987586 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1cfc697-944b-44bd-a530-9a0672c17e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.236095 Nov 02 13:47:38.989775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2844/6073] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:38 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:39.174144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b807560b-71cc-4f43-9d83-13b197696ac3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-358390633", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b807560b-71cc-4f43-9d83-13b197696ac3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 234 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-358390633", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-358390633', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'notvalid' Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.180526 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 02 13:47:39.185846 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:39.190752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b807560b-71cc-4f43-9d83-13b197696ac3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:39.192546 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b807560b-71cc-4f43-9d83-13b197696ac3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.022715 Nov 02 13:47:39.193735 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3230/6074] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:39 2022] POST /compute/v2.1/servers => generated 133 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:39.205484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:39.206116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:39.216968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.218687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.219394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.220530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.221007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.221442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.518473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:39.527086 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c31643c5-2fd7-4df4-8143-d69b32a93d1e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.328593 Nov 02 13:47:39.559034 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2845/6075] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:39 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:39.562835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:39.563495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:39.574946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.575734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.579909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.580824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.581546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.582208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.877546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:39.878649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:39.886983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.887974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.888817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:39.890114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:39.894132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:39.895009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:40.066489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:40.090586 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10ad14f0-b517-49fa-b8d4-9bf858689133 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.532614 Nov 02 13:47:40.090982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3231/6076] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:39 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:40.123215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2bca0f4-aec7-4f50-8c76-65ec2c076481 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:40.126911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f2bca0f4-aec7-4f50-8c76-65ec2c076481 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 37ff46bc-0aa7-4a08-ac87-516b7d09226e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:40.145966 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-f2bca0f4-aec7-4f50-8c76-65ec2c076481 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 37ff46bc-0aa7-4a08-ac87-516b7d09226e could not be found. Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2bca0f4-aec7-4f50-8c76-65ec2c076481 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/37ff46bc-0aa7-4a08-ac87-516b7d09226e/action HTTP/1.1 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 13 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: {"pause": {}} Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 37ff46bc-0aa7-4a08-ac87-516b7d09226e could not be found. Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '37ff46bc-0aa7-4a08-ac87-516b7d09226e', 'body': {'pause': {}}} Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ff46bc-0aa7-4a08-ac87-516b7d09226e could not be found. Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ff46bc-0aa7-4a08-ac87-516b7d09226e could not be found. Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:40.166095 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:40.171949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:40.171949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:40.171949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ff46bc-0aa7-4a08-ac87-516b7d09226e could not be found. Nov 02 13:47:40.171949 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:40.174042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2bca0f4-aec7-4f50-8c76-65ec2c076481 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 37ff46bc-0aa7-4a08-ac87-516b7d09226e could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:40.176063 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f2bca0f4-aec7-4f50-8c76-65ec2c076481 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/37ff46bc-0aa7-4a08-ac87-516b7d09226e/action" status: 404 len: 111 microversion: 2.1 time: 0.058261 Nov 02 13:47:40.179997 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3232/6077] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:40 2022] POST /compute/v2.1/servers/37ff46bc-0aa7-4a08-ac87-516b7d09226e/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:40.189735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:40.190520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:40.201026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:40.201663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:40.203506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:40.208440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:40.208440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:40.208440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:40.349982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:40.395434 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03c49630-a556-430c-903d-795f528655b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.522828 Nov 02 13:47:40.396511 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2846/6078] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:39 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:40.756376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:40.769821 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-499722a4-72fb-40c8-81be-b47d69feb50c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.586893 Nov 02 13:47:40.773576 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3233/6079] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:40 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:40.799452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:40.801016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:40.807572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:40.808069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:40.816780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:40.817802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:40.818442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:40.819256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.208456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:41.226309 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-444a035b-775b-44ca-89e1-45b4b4a6692a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.431721 Nov 02 13:47:41.228070 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2847/6080] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:40 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:41.253357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-55aabe6b-f298-4b16-9972-03180400fa31 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:41.254520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-55aabe6b-f298-4b16-9972-03180400fa31 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:41.265849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55aabe6b-f298-4b16-9972-03180400fa31 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.270161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55aabe6b-f298-4b16-9972-03180400fa31 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.270914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55aabe6b-f298-4b16-9972-03180400fa31 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.272252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55aabe6b-f298-4b16-9972-03180400fa31 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.273186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55aabe6b-f298-4b16-9972-03180400fa31 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.274301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55aabe6b-f298-4b16-9972-03180400fa31 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.383630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:41.424598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:41.425335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:41.441493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.442848 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-55aabe6b-f298-4b16-9972-03180400fa31 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 202 len: 0 microversion: 2.1 time: 0.195090 Nov 02 13:47:41.443669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.449425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.450942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.451494 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3234/6081] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:41 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:47:41.453496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.455361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.464897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:41.472288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:41.507993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.511609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.512095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:41.518603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:41.521111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:41.523250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:42.008889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:42.048250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-478c7fe9-1121-408e-9cbf-d15102395b58 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.627850 Nov 02 13:47:42.050271 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2848/6082] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:41 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:42.497268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:42.516086 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2069aedc-1e28-4712-9491-b7b2e78f108e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1515 microversion: 2.1 time: 1.061203 Nov 02 13:47:42.516916 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3235/6083] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:41 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1515 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:43.075541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:43.078702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:43.088119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.088999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.090129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.091043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.091688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.092296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.551422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:43.552055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:43.559523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.560266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.561079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.561948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.562588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.563053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.734599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:43.747708 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc7e4e0a-c1ac-4856-b480-b4cd66dd4b0b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.678162 Nov 02 13:47:43.764681 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2849/6084] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:43 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:43.766975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:43.777136 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d36765ae-4aba-44ed-ab5e-9e95d1bcbdb9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1495 microversion: 2.1 time: 0.232186 Nov 02 13:47:43.778105 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3236/6085] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:43 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1495 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:43.802237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:43.802827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:43.811013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.815730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.816303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.817149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.818182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.820771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.853774 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Cannot 'pause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state paused Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action HTTP/1.1 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 13 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: {"pause": {}} Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: exception: Cannot 'pause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state paused Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c', 'body': {'pause': {}}} Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7944ff2a-3114-464d-9ecf-c287973c180c in vm_state paused. Cannot pause while the instance is in this state. Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state paused Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:43.856154 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:43.864229 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:43.864229 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:43.864229 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:43.864229 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state paused Nov 02 13:47:43.864229 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:43.865921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 409 to user: Cannot 'pause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state paused {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:43.866993 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e9c827fc-36dc-4763-a861-96cdcc30cce5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 409 len: 143 microversion: 2.1 time: 0.069102 Nov 02 13:47:43.878300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-beb7f5c3-681f-4d2e-9194-3728fae77e83 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:43.878861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-beb7f5c3-681f-4d2e-9194-3728fae77e83 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:43.884400 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2850/6086] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:43 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 143 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:47:43.886490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb7f5c3-681f-4d2e-9194-3728fae77e83 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.886983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb7f5c3-681f-4d2e-9194-3728fae77e83 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.887518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb7f5c3-681f-4d2e-9194-3728fae77e83 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.888307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb7f5c3-681f-4d2e-9194-3728fae77e83 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:43.888780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb7f5c3-681f-4d2e-9194-3728fae77e83 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:43.889251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-beb7f5c3-681f-4d2e-9194-3728fae77e83 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:43.995763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-beb7f5c3-681f-4d2e-9194-3728fae77e83 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 202 len: 0 microversion: 2.1 time: 0.123119 Nov 02 13:47:44.006214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:44.006830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:44.011425 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3237/6087] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:43 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:47:44.013844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.015078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.015887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.016998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.017812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.018417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.342085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:44.357216 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-29f724b0-97eb-4bac-85f1-111ac2237f98 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1502 microversion: 2.1 time: 0.354836 Nov 02 13:47:44.358096 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2851/6088] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:44 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1502 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:44.773828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:44.774559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:44.787048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.788118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.789411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:44.792478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:44.794865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:44.796271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.253910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:45.265307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dae6afb0-28a4-40ad-9773-f606e566bb84 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.496385 Nov 02 13:47:45.266640 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3238/6089] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:44 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:45.382046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:45.383271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:45.391391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.392167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.392780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.393658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:45.394277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:45.394883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:45.773147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:45.782378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e49c588b-e3b9-4dc7-9d32-88088a36bf46 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1502 microversion: 2.1 time: 0.404241 Nov 02 13:47:45.783254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2852/6090] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:45 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1502 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:46.296337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:46.298565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:46.307718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.308485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.310145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.312936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.314056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.314875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.808885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:46.809264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:46.832877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.833509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.835342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.837009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:46.839503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:46.840107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:46.884457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:46.900171 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-541a77d3-77c6-43af-b7d4-43ad856db937 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.613713 Nov 02 13:47:46.901869 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3239/6091] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:46 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:47.168431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:47.180457 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-41104ebb-cde1-4cc3-b7a7-2dd2e23caf41 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1502 microversion: 2.1 time: 0.377128 Nov 02 13:47:47.181779 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2853/6092] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:46 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1502 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:47.928475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:47.929276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:47.938292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:47.938789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:47.939407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:47.940131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:47.940616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:47.941023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.206591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:48.208448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:48.225336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.226019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.226628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.227929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:48.229279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:48.230264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:48.378924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.391936 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3c9db09c-1436-40dd-81fd-63f2872451f0 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.467429 Nov 02 13:47:48.392550 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3240/6093] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:47 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:48.499825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:48.513519 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9d64ffac-942d-447f-9206-5b74a466a489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1502 microversion: 2.1 time: 0.311828 Nov 02 13:47:48.520700 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2854/6094] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:48 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1502 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:49.418023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:49.418644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:49.443407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.443931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.444464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.445665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.446239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.446683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.540771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:49.541364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:49.556777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.557738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.558338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.559790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:49.560469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:49.561630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:49.844082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:49.853420 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b8e1f99-9806-42dc-8625-7f2d16e19bc1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1502 microversion: 2.1 time: 0.316454 Nov 02 13:47:49.853971 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2855/6095] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:49 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:50.121659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:50.156388 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f2e1622-b4e1-47f9-82d5-cb0db0143539 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.742906 Nov 02 13:47:50.158445 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3241/6096] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:49 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:50.882232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:50.883018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:50.897072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:50.898817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:50.899788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:50.900942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:50.903793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:50.905293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.188916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:51.189594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:51.206519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.207016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.207482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.208391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.209016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.210295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.250925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:51.256429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:51.277238 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-12af98df-95c1-47e4-9d05-a8074e46b4b8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.397314 Nov 02 13:47:51.305523 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2856/6097] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:50 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:51.330294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:51.330841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:51.349527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.350212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.350667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.351413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.352059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.352665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.695935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:51.714060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-453524ca-944e-4843-9960-84980e6a2c7d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.530177 Nov 02 13:47:51.715491 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3242/6098] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:51 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:51.870260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:51.884022 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b4d3b16-f814-4f5a-b4b5-1589e0383313 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.574333 Nov 02 13:47:51.901893 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2857/6099] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:51 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:51.911016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:51.915167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:51.926022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.926791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.927449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.928414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.929649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.930455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.955984 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa/action HTTP/1.1 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 28 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: {"reboot": {"type": "SOFT"}} Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a534ecf4-5854-48e1-895c-118db7e315fa', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:51.958847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-902c7c38-ea7f-41b0-ad6a-685422469ac2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa/action" status: 404 len: 111 microversion: 2.1 time: 0.053615 Nov 02 13:47:51.963910 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3243/6100] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:51 2022] POST /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:51.971831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:51.972759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:51.982624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.984427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.985065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:51.986819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:51.987744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:51.988343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.189670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:52.202330 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a00ea29f-0178-4852-a006-f7c39b190e10 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.231703 Nov 02 13:47:52.203599 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2858/6101] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:51 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:52.227976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:52.229552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:52.242211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:52.243785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:52.244398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.245313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:52.246104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:52.247328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.739068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:52.739978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:52.757086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:52.758102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:52.758911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.760008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:52.760760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:52.761511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:52.999764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:53.033292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-db0561a2-ee08-4618-8280-ffbe33f69318 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.802943 Nov 02 13:47:53.033503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:53.036860 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3244/6102] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:52 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:53.049770 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-46fc9022-5b4d-4f44-a882-5ed2fafb8b72 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.312275 Nov 02 13:47:53.050726 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2859/6103] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:52 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:53.060274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3b1042a-7318-433c-a18c-07cc01e84488 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:53.063162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e3b1042a-7318-433c-a18c-07cc01e84488 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: d5b4fd9d-5817-4971-83f7-24872a756030] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:53.069162 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-e3b1042a-7318-433c-a18c-07cc01e84488 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance d5b4fd9d-5817-4971-83f7-24872a756030 could not be found. Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3b1042a-7318-433c-a18c-07cc01e84488 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/d5b4fd9d-5817-4971-83f7-24872a756030/action HTTP/1.1 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 28 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: {"reboot": {"type": "SOFT"}} Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance d5b4fd9d-5817-4971-83f7-24872a756030 could not be found. Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'd5b4fd9d-5817-4971-83f7-24872a756030', 'body': {'reboot': {'type': 'SOFT'}}} Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b4fd9d-5817-4971-83f7-24872a756030 could not be found. Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b4fd9d-5817-4971-83f7-24872a756030 could not be found. Nov 02 13:47:53.071001 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.075970 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:53.075970 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.075970 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.075970 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:53.075970 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:53.075970 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:53.075970 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:53.075970 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b4fd9d-5817-4971-83f7-24872a756030 could not be found. Nov 02 13:47:53.075970 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.077446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e3b1042a-7318-433c-a18c-07cc01e84488 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance d5b4fd9d-5817-4971-83f7-24872a756030 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:53.078475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e3b1042a-7318-433c-a18c-07cc01e84488 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/d5b4fd9d-5817-4971-83f7-24872a756030/action" status: 404 len: 111 microversion: 2.1 time: 0.022484 Nov 02 13:47:53.079257 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3245/6104] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:53 2022] POST /compute/v2.1/servers/d5b4fd9d-5817-4971-83f7-24872a756030/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:53.087610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:53.088484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:53.095784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.096496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.097120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.098014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.098633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.099274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.348341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:53.360492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-11d8ab96-d108-4275-84ed-796a184cf5e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.276750 Nov 02 13:47:53.372912 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2860/6105] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:53 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:53.385107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:53.386399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:53.396988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.397862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.398588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.399661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.401241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.401924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.853130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:53.862749 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cf5ab6af-75f3-4bde-b1a4-85ade70417d3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.481933 Nov 02 13:47:53.874627 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3246/6106] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:53 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:53.890292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:53.895286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:53.924302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.924857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.925318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.926057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:53.926519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:53.928017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:53.973522 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa/action HTTP/1.1 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 65 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'a534ecf4-5854-48e1-895c-118db7e315fa', 'body': {'rebuild': {'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1'}}} Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 13:47:53.989167 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:53.994442 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e93acdd2-3749-41c7-8070-e2c6a4d954e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa/action" status: 404 len: 111 microversion: 2.1 time: 0.112320 Nov 02 13:47:53.999709 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2861/6107] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:53 2022] POST /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa/action => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:54.004171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:54.004773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:54.013933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:54.014687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:54.015310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:54.016066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:54.016539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:54.017425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:54.081514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:54.083438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:54.104276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:54.104785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:54.105233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:54.106120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:54.106402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:54.113602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:54.407165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:54.431357 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d5c08692-bf72-4542-a520-bdebd0908bb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.419524 Nov 02 13:47:54.432867 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3247/6108] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:53 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:54.460622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:54.461715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:54.466270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:54.469726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:54.470415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:54.471055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:54.471971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:54.472625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:54.473262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:54.480141 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e78910af-0d59-4fd5-bdb5-8733b7d9b23b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.403421 Nov 02 13:47:54.483847 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2862/6109] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:54 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:54.915799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:54.927305 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-72b4080f-fdfc-4029-a52d-cd7208c78a24 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.471178 Nov 02 13:47:54.927818 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3248/6110] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:54 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:54.959056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-573c5498-36e9-4543-9cd3-4c82a0802064 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:54.962319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-573c5498-36e9-4543-9cd3-4c82a0802064 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:54.968483 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-573c5498-36e9-4543-9cd3-4c82a0802064 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b could not be found. Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-573c5498-36e9-4543-9cd3-4c82a0802064 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b/action HTTP/1.1 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 65 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b could not be found. Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b', 'body': {'rebuild': {'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1'}}} Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b could not be found. Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 13:47:54.971271 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b could not be found. Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b could not be found. Nov 02 13:47:54.975817 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:54.978604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-573c5498-36e9-4543-9cd3-4c82a0802064 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:54.979569 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-573c5498-36e9-4543-9cd3-4c82a0802064 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b/action" status: 404 len: 111 microversion: 2.1 time: 0.024874 Nov 02 13:47:54.981275 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2863/6111] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:54 2022] POST /compute/v2.1/servers/257d8fa2-e41d-4d8e-8a39-af5cdbe08b1b/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:54.990020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:54.991444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:54.998900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.000113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.001050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.002158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.002841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.003588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.309614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:55.322349 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e19675be-1926-4b30-874b-5fddb5374ae7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.336107 Nov 02 13:47:55.323895 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3249/6112] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:54 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:55.347826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:55.349164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:55.358816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.359747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.360468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.361503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.362205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.362882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.508493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:55.509115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:55.517286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.517792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.518227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.518943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.519686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.520099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.560223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:55.574629 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-613380fc-df91-411b-8f9b-275c63acb976 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.230443 Nov 02 13:47:55.593686 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2864/6113] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:55 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:55.603460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b14287ab-668f-4728-ac69-4c48888f5136 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:55.605833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b14287ab-668f-4728-ac69-4c48888f5136 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 5b60719d-5e70-4123-8747-9fbe182d5701] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:55.613986 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b14287ab-668f-4728-ac69-4c48888f5136 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 5b60719d-5e70-4123-8747-9fbe182d5701 could not be found. Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b14287ab-668f-4728-ac69-4c48888f5136 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/5b60719d-5e70-4123-8747-9fbe182d5701/action HTTP/1.1 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 15 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: {"restore": {}} Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 5b60719d-5e70-4123-8747-9fbe182d5701 could not be found. Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '5b60719d-5e70-4123-8747-9fbe182d5701', 'body': {'restore': {}}} Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b60719d-5e70-4123-8747-9fbe182d5701 could not be found. Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b60719d-5e70-4123-8747-9fbe182d5701 could not be found. Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:55.615577 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:55.621284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:55.621284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:55.621284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b60719d-5e70-4123-8747-9fbe182d5701 could not be found. Nov 02 13:47:55.621284 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:55.621284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b14287ab-668f-4728-ac69-4c48888f5136 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 5b60719d-5e70-4123-8747-9fbe182d5701 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:55.621284 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b14287ab-668f-4728-ac69-4c48888f5136 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/5b60719d-5e70-4123-8747-9fbe182d5701/action" status: 404 len: 111 microversion: 2.1 time: 0.022138 Nov 02 13:47:55.621284 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2865/6114] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:55 2022] POST /compute/v2.1/servers/5b60719d-5e70-4123-8747-9fbe182d5701/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:55.631846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:55.632736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:55.640751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.641389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.641917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.642876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.643605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.644274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.900442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:55.908810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:55.908972 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-acefbaa1-f43b-4231-950d-35c2f9faef93 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.404745 Nov 02 13:47:55.923831 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3250/6115] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:55 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:55.923990 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-27f54204-2e44-4b5e-8bad-5e54a6ac488d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.294755 Nov 02 13:47:55.923990 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2866/6116] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:55 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:55.952183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:55.952818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:55.966668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.967809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.968253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:55.968979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:55.969442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:55.969879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.001522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:47:56.307745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:56.310738 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2bd2f9bd-2f91-46de-bc1f-47c873f7a108 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.362982 Nov 02 13:47:56.319201 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3251/6117] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:55 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:56.335939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:56.336708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:56.343443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.344275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.344776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.345709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.346225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.346740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.385878 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Cannot 'restore' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action HTTP/1.1 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 15 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: {"restore": {}} Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: exception: Cannot 'restore' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c', 'body': {'restore': {}}} Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7944ff2a-3114-464d-9ecf-c287973c180c in vm_state active. Cannot restore while the instance is in this state. Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:56.388128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:56.393527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:56.393527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:56.393527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:56.393527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:47:56.393527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:47:56.393527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 409 to user: Cannot 'restore' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:56.393527 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d86cafcb-d143-48c2-a655-883b305821fb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 409 len: 145 microversion: 2.1 time: 0.057767 Nov 02 13:47:56.393527 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2867/6118] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:56 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 145 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:47:56.400157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:56.400781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:56.410246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.410807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.412159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.412910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.413376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.414246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.714934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:56.723256 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-240974a2-c0ba-4d4b-a121-6bed6e3d605e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.327189 Nov 02 13:47:56.734786 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3252/6119] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:56 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:56.758938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:56.759930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:56.784429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.784934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.790822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.793625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.794130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.794570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.933170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:56.933795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:56.942580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.947824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.949834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:56.953446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:56.954127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:56.954631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:57.180435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:57.189755 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ab6208f-9237-48e9-8ae8-4f8c1ec34947 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.260572 Nov 02 13:47:57.193338 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3253/6120] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:56 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:57.633147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:57.644269 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f70d9b4d-752d-44d0-ac1f-f2c3e61f548d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.890528 Nov 02 13:47:57.645868 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2868/6121] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:56 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:57.676247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2c64f57-0997-4d1a-aef4-f71e162f2c80 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:57.677150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b2c64f57-0997-4d1a-aef4-f71e162f2c80 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 0be9a587-3413-445f-81a1-5d4628c9ba38] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:57.684602 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-b2c64f57-0997-4d1a-aef4-f71e162f2c80 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 0be9a587-3413-445f-81a1-5d4628c9ba38 could not be found. Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2c64f57-0997-4d1a-aef4-f71e162f2c80 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/0be9a587-3413-445f-81a1-5d4628c9ba38/action HTTP/1.1 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 14 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: {"resume": {}} Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0be9a587-3413-445f-81a1-5d4628c9ba38 could not be found. Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0be9a587-3413-445f-81a1-5d4628c9ba38', 'body': {'resume': {}}} Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be9a587-3413-445f-81a1-5d4628c9ba38 could not be found. Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be9a587-3413-445f-81a1-5d4628c9ba38 could not be found. Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:57.700174 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:57.706169 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:57.706169 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:57.706169 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be9a587-3413-445f-81a1-5d4628c9ba38 could not be found. Nov 02 13:47:57.706169 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:57.707790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2c64f57-0997-4d1a-aef4-f71e162f2c80 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 0be9a587-3413-445f-81a1-5d4628c9ba38 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:57.709380 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2c64f57-0997-4d1a-aef4-f71e162f2c80 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/0be9a587-3413-445f-81a1-5d4628c9ba38/action" status: 404 len: 111 microversion: 2.1 time: 0.039785 Nov 02 13:47:57.715261 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3254/6122] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:57 2022] POST /compute/v2.1/servers/0be9a587-3413-445f-81a1-5d4628c9ba38/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:47:57.722472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:57.723287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:57.730430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:57.731716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:57.731716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:57.735192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:57.735755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:57.736694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.000884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:58.014248 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e357bcba-d0b8-4106-87ed-a32bc2576c51 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.297621 Nov 02 13:47:58.014925 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2869/6123] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:57 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:58.042736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:58.043626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:58.051961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.052710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.053327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.054241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.054889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.055538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.214175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:58.214800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:58.221957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.222691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.223406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.224371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.225004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.226021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.439664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:58.450868 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7fd01ce4-b06d-4e03-b6b2-211cff005578 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.414671 Nov 02 13:47:58.452080 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3255/6124] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:58 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:58.477911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:58.479085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:58.489878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.490590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.491255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.492186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.492892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.493547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.530176 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Cannot 'resume' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action HTTP/1.1 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 14 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: {"resume": {}} Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot 'resume' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c', 'body': {'resume': {}}} Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7944ff2a-3114-464d-9ecf-c287973c180c in vm_state active. Cannot resume while the instance is in this state. Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:58.540811 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 409 to user: Cannot 'resume' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4288eb67-47cf-4c03-b5e2-07c3d26eedd9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 409 len: 144 microversion: 2.1 time: 0.070014 Nov 02 13:47:58.546475 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3256/6125] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:47:58 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 144 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:47:58.552541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:58.553161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:58.556215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:58.566156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.571258 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a6665db-2f6b-4cc4-8ede-900a302ff24b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.356345 Nov 02 13:47:58.571408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.571408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.571578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2870/6126] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:58 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:58.577243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.577981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.578610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.901542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:58.911027 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1df5ef7-bf32-4946-abe5-37c2c10702d8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.362688 Nov 02 13:47:58.913363 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3257/6127] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:58 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:47:58.940625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:58.942904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:58.962264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.964084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.964728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:58.966528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:58.968098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:58.970037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:59.283096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:59.292206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f996d281-6a58-4427-84f1-2d023e9f42be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.357466 Nov 02 13:47:59.301056 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2871/6128] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:58 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:59.486759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5da190f-cd3c-41da-a139-33a684ec6d3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5da190f-cd3c-41da-a139-33a684ec6d3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 160 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "0babba78-dc1c-4b58-944c-210f5092be54"}]}} Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c691e80e-3ff7-4224-8e34-80d276ecc1b1', 'flavorRef': '452', 'networks': [{'uuid': '0babba78-dc1c-4b58-944c-210f5092be54'}]}}} Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi '' Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:47:59.493246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5da190f-cd3c-41da-a139-33a684ec6d3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:47:59.500152 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b5da190f-cd3c-41da-a139-33a684ec6d3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.015260 Nov 02 13:47:59.501108 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3258/6129] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:47:59 2022] POST /compute/v2.1/servers => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:47:59.508073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:59.508931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:59.522316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:59.522910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:59.524735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:59.525536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:59.539336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:59.539899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:59.594519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:59.596062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:59.614641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:59.615391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:59.616357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:59.617275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:59.618546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:59.620029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:59.871984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:59.888206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bd8be66c-de26-47a0-a917-607e28321f7f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.383920 Nov 02 13:47:59.889378 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2872/6130] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:59 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:47:59.913913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:47:59.914667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:47:59.923085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:59.923743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:59.924280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:59.925113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:47:59.925818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:47:59.926473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:47:59.978447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:47:59.987660 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5f2b67cb-fe3e-4de9-acfc-417dd903e434 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.398487 Nov 02 13:47:59.990381 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3259/6131] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:59 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:00.109364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:00.119376 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6d4e5009-4955-4d19-b7ec-b5d9045f45c3 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.209411 Nov 02 13:48:00.136294 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2873/6132] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:47:59 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:00.145504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd998c6d-4bd2-4863-ab22-594ac68ca411 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:00.147247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd998c6d-4bd2-4863-ab22-594ac68ca411 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 9449d4f2-cd0b-469b-bc8c-47cea8951a86] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:00.153577 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-cd998c6d-4bd2-4863-ab22-594ac68ca411 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 9449d4f2-cd0b-469b-bc8c-47cea8951a86 could not be found. Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd998c6d-4bd2-4863-ab22-594ac68ca411 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/9449d4f2-cd0b-469b-bc8c-47cea8951a86/action HTTP/1.1 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 14 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: {"shelve": {}} Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 9449d4f2-cd0b-469b-bc8c-47cea8951a86 could not be found. Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '9449d4f2-cd0b-469b-bc8c-47cea8951a86', 'body': {'shelve': {}}} Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9449d4f2-cd0b-469b-bc8c-47cea8951a86 could not be found. Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9449d4f2-cd0b-469b-bc8c-47cea8951a86 could not be found. Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:00.156137 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:00.161068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:48:00.161068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:48:00.161068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9449d4f2-cd0b-469b-bc8c-47cea8951a86 could not be found. Nov 02 13:48:00.161068 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:00.161068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd998c6d-4bd2-4863-ab22-594ac68ca411 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 9449d4f2-cd0b-469b-bc8c-47cea8951a86 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:48:00.161068 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd998c6d-4bd2-4863-ab22-594ac68ca411 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/9449d4f2-cd0b-469b-bc8c-47cea8951a86/action" status: 404 len: 111 microversion: 2.1 time: 0.016477 Nov 02 13:48:00.166552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:00.167616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:00.168982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3260/6133] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:48:00 2022] POST /compute/v2.1/servers/9449d4f2-cd0b-469b-bc8c-47cea8951a86/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:48:00.175983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:00.176720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:00.177376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:00.178286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:00.178753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:00.179300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:00.354361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:00.363328 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8356677c-bcf8-485c-bf6d-2dc52a774761 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.200526 Nov 02 13:48:00.364114 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2874/6134] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:00 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:00.393345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:00.394394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:00.415436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:00.416742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:00.417413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:00.418401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:00.421630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:00.421630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:00.608584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:00.618231 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a8867b4-9f59-4bdc-a144-f18ace70c7f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.232215 Nov 02 13:48:00.619097 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3261/6135] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:00 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:00.643272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:00.644007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:00.652465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:00.653637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:00.654349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:00.655862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:00.656487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:00.657209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:00.707271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lazy-loading 'flavor' on Instance uuid 7944ff2a-3114-464d-9ecf-c287973c180c {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:00.791341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:01.004300 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bd98c5ab-63f0-4a1d-a4d4-ac3888950573 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 202 len: 0 microversion: 2.1 time: 0.364767 Nov 02 13:48:01.005262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2875/6136] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:48:00 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:48:01.015729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:01.017007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:01.022395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=90 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:01.023819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:01.026524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:01.026954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:01.028017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:01.029694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:01.031258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:01.032015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:01.032143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=98 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:01.034675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:01.063694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:01.067528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:01.068819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:01.071540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:01.072280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:01.073110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:01.262555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:01.277287 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0adf99a4-e91f-41e1-8d13-3fd398176667 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.266277 Nov 02 13:48:01.278107 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3262/6137] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:01 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:01.461411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:01.470901 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d11fd79-8e3f-435d-8a1e-2a8c879b260e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.458072 Nov 02 13:48:01.472834 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2876/6138] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:01 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:02.301723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:02.302931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:02.319676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:02.320179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:02.320622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:02.321348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:02.321796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:02.322306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:02.498482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:02.499767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:02.508145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:02.508877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:02.509316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:02.510228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:02.513111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:02.516783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:02.686257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:02.702041 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f2505c8c-aacb-4f51-abed-c3458e02e042 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.403578 Nov 02 13:48:02.703150 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3263/6139] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:02 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:02.817887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:02.825773 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-84efff3d-0eac-4117-bec2-1d0adef236bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.333112 Nov 02 13:48:02.830178 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2877/6140] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:02 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:03.727620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:03.728387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:03.743255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:03.746746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:03.747356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:03.749145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:03.750177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:03.751001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:03.856681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:03.859659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:03.874387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:03.876905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:03.877949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:03.880660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:03.881247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:03.882631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:03.957113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:03.968853 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e218dd48-8612-4039-9cba-3c98dcdf55e0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.244280 Nov 02 13:48:03.970110 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3264/6141] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:03 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:04.216891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:04.238854 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5d3600e2-4499-483b-9878-662cf77736ef tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.386419 Nov 02 13:48:04.239950 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2878/6142] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:03 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:05.001316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:05.002110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:05.011887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:05.024902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:05.025326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:05.026224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:05.026809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:05.027385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:05.265405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:05.274296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:05.292415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:05.294102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:05.295398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:05.296693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:05.297274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:05.298013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:05.355073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:05.365776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ac207951-6d1c-4a6d-9591-a1361665c26a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.369285 Nov 02 13:48:05.366307 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3265/6143] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:04 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:05.592204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:05.602462 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-28ae331d-0704-4856-9c80-1e332516f5de tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.341661 Nov 02 13:48:05.603059 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2879/6144] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:05 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:06.399433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:06.400203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:06.420361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:06.420771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:06.421224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:06.421948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:06.422409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:06.422841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:06.629788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:06.630416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:06.646774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:06.647277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:06.647724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:06.648446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:06.648893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:06.649316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:06.819973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:06.840905 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-676fac28-4e91-43b0-a64e-517f8173a2f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.455283 Nov 02 13:48:06.845725 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3266/6145] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:06 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:07.103526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:07.121818 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7629f228-5182-459e-bfd0-5631498df39a tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1489 microversion: 2.1 time: 0.487113 Nov 02 13:48:07.123379 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2880/6146] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:06 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1489 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:07.150470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39b3f047-4878-4dc0-8e57-ba9a3df30ef4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:07.152509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39b3f047-4878-4dc0-8e57-ba9a3df30ef4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:07.177158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39b3f047-4878-4dc0-8e57-ba9a3df30ef4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:07.177672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39b3f047-4878-4dc0-8e57-ba9a3df30ef4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:07.178123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39b3f047-4878-4dc0-8e57-ba9a3df30ef4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:07.178853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39b3f047-4878-4dc0-8e57-ba9a3df30ef4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:07.191270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39b3f047-4878-4dc0-8e57-ba9a3df30ef4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:07.193585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39b3f047-4878-4dc0-8e57-ba9a3df30ef4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:07.404580 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39b3f047-4878-4dc0-8e57-ba9a3df30ef4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "POST /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042/action" status: 202 len: 0 microversion: 2.1 time: 0.257012 Nov 02 13:48:07.406638 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3267/6147] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:48:07 2022] POST /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:48:07.414822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:07.415505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:07.427823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:07.432668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:07.433505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:07.437325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:07.438628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:07.439275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:07.875779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:07.876991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:07.888627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:07.901520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:07.902250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:07.903854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:07.904944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:07.905651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:08.222240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:08.233096 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09b35a0c-2454-4854-97d0-3e5dd82c9aa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.362554 Nov 02 13:48:08.237426 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3268/6148] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:07 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:08.787164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:08.795904 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1e71386a-3eff-4a92-a1f9-a5869e9dcc0d tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1497 microversion: 2.1 time: 1.385031 Nov 02 13:48:08.797642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2881/6149] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:07 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1497 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:09.262099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:09.264520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:09.282350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:09.284574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:09.285221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:09.288452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:09.289198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:09.290736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:09.829791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:09.830403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:09.842946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:09.843472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:09.843906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:09.864220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:09.864711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:09.865181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:10.058862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:10.068291 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a9ecdad3-4de7-4b51-860a-7b61891ec6c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.812237 Nov 02 13:48:10.068899 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3269/6150] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:09 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:10.145917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:10.156880 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-db595541-efdb-457b-b63e-ae3d47df35ad tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1497 microversion: 2.1 time: 0.332573 Nov 02 13:48:10.163724 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2882/6151] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:09 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1497 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:11.099617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:11.100191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:11.111325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:11.111831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:11.113690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:11.114486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:11.114962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:11.115438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:11.174642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:11.181243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:11.181940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:11.200771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:11.201266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:11.204021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:11.204792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:11.208528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:11.209010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:11.542688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:11.558309 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-198c8426-047f-4836-a034-6cf8ce0186bd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1497 microversion: 2.1 time: 0.381435 Nov 02 13:48:11.559038 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2883/6152] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:11 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:11.866950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:11.879567 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fe135490-6dfe-4765-a3cf-f0b0cb207541 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.785294 Nov 02 13:48:11.893419 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3270/6153] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:11 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:12.582795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:12.583364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:12.591830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:12.592505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:12.593023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:12.593960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:12.594422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:12.595403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:12.910363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:12.914107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:12.935706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:12.935706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:12.935706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:12.935706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:12.935706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:12.935706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.181742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:13.195753 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f1e393e-0237-4125-9806-72e9fa2829c3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1503 microversion: 2.1 time: 0.616835 Nov 02 13:48:13.196359 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2884/6154] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:12 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1503 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:13.226305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:13.226795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:13.244977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.245759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.246369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.247330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.248479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.249070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.275500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:48:13.367677 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49c9ff2a-4d32-4b23-864c-20c54a50f47e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "DELETE /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 204 len: 0 microversion: 2.1 time: 0.144331 Nov 02 13:48:13.369223 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2885/6155] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:48:13 2022] DELETE /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:48:13.380731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:13.381765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:13.390572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.391557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.392211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.393367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:13.393982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:13.394627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:13.486274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:13.509908 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ffbab68c-7f33-4562-abae-d160a5cf6ad6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.606895 Nov 02 13:48:13.517056 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3271/6156] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:12 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:13.579780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:13.591619 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a4d40094-2eab-414f-828b-4edc18c6404e tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.215196 Nov 02 13:48:13.592626 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2886/6157] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:13 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:14.552929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:14.554849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:14.574312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.578679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.579535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.582987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.583749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.584417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.617380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:14.618655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:14.637320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.641268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.643682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.644937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:14.646668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:14.647921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:14.944548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:14.962299 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f2773626-ec12-40cb-8716-ee8990e23bc4 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.349364 Nov 02 13:48:14.962907 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2887/6158] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:14 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:15.467891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:15.482672 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5e54fccc-6775-40a8-b691-15189c3bf265 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.939373 Nov 02 13:48:15.483856 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3272/6159] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:14 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:15.990671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:15.991397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:16.009241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.010035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.010473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.011253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.011707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.012128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.467928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:16.476997 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60e37013-9bb2-47b4-90b8-2b1272147fcd tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.490297 Nov 02 13:48:16.493464 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2888/6160] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:15 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:16.508026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:16.508647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:16.516099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.516677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.517119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.517830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:16.522373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:16.522839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:16.715326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:16.724713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9216feec-4835-4a6d-957f-e9695a8b446a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.220011 Nov 02 13:48:16.740858 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3273/6161] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:16 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:17.504680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:17.505979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:17.516498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.517724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.519053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.520257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.520797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.524635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.574125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:17.750542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:17.751203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:17.768806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.771070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.771730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:17.772643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:17.773365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:17.774020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:18.010360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:18.019171 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ed3f9bd-b6a0-4299-a027-f98272e12eb6 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1537 microversion: 2.1 time: 0.273102 Nov 02 13:48:18.039501 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3274/6162] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:17 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1537 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:18.080028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:18.102476 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0e7c69a6-63eb-47e1-87aa-66e0ef13d4b5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1509 microversion: 2.1 time: 0.602509 Nov 02 13:48:18.104332 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2889/6163] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:17 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:18.311546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-94a74c22-1ac5-4e59-acd5-afa9d4adf55c req-f65226ca-4dd2-4762-84ed-e5c79a21fcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11826045-d4be-4857-956d-0052871ce042", "name": "network-vif-deleted", "tag": "14ae07b7-6c3b-4cdb-88ca-9be0c308b765"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:18.346690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-94a74c22-1ac5-4e59-acd5-afa9d4adf55c req-f65226ca-4dd2-4762-84ed-e5c79a21fcda service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:18.351651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-94a74c22-1ac5-4e59-acd5-afa9d4adf55c req-f65226ca-4dd2-4762-84ed-e5c79a21fcda service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:18.352224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-94a74c22-1ac5-4e59-acd5-afa9d4adf55c req-f65226ca-4dd2-4762-84ed-e5c79a21fcda service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:18.390122 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-94a74c22-1ac5-4e59-acd5-afa9d4adf55c req-f65226ca-4dd2-4762-84ed-e5c79a21fcda service nova] Creating event network-vif-deleted:14ae07b7-6c3b-4cdb-88ca-9be0c308b765 for instance 11826045-d4be-4857-956d-0052871ce042 on n-h1-858384-19 Nov 02 13:48:18.408407 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-94a74c22-1ac5-4e59-acd5-afa9d4adf55c req-f65226ca-4dd2-4762-84ed-e5c79a21fcda service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099161 Nov 02 13:48:18.411040 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3275/6164] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:19.053435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:19.054634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:19.067011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.068030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.068765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.069654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.070481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.071141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.134417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:19.135134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:19.145025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.145767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.146216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.146930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.147414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.147839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.236893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:19.237930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:19.241134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:19.244037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lazy-loading 'fault' on Instance uuid 11826045-d4be-4857-956d-0052871ce042 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:19.343562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:19.353213 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f8d99a46-e14b-4c6b-ae3d-2e256b3cfba5 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 200 len: 1308 microversion: 2.1 time: 0.226555 Nov 02 13:48:19.354327 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3276/6165] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:19 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:19.355760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:19.366068 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dcb7af27-719c-4d7e-b1b2-35b8774351d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1537 microversion: 2.1 time: 0.318000 Nov 02 13:48:19.370503 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2890/6166] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:19 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1537 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:20.381134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:20.382528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 11826045-d4be-4857-956d-0052871ce042] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:20.396291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:20.396963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:20.398677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.399191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.399829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.400756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.401383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.401990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.411367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.411890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.415653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.416788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.417635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.418233 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] HTTP exception thrown: Instance 11826045-d4be-4857-956d-0052871ce042 could not be found. Nov 02 13:48:20.418372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Request method failure captured: Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 HTTP/1.1 Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS0setCpmyD9R4Nd5Cm2R_UEDcpDQZCeE7d33UIAzUka58MGfr_D6hnHvfIyUBhie469Yf9osqv9OdZVMJcpFD-6h7xa_3wtBzTXYav71K4egXQKVp13CvP8oIKXTclPPYB2VGlxuXd01yb_-b-pSAuLlqmhD-yLMj7GBoPEIJVTfI Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dce706ff2fb44a1bb9295245b85a8299 Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerRescueTestJSON-405111015 Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dce706ff2fb44a1bb9295245b85a8299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dce706ff2fb44a1bb9295245b85a8299"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dce706ff2fb44a1bb9295245b85a8299"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dce706ff2fb44a1bb9295245b85a8299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerRescueTestJSON-405111015 Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dce706ff2fb44a1bb9295245b85a8299 Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerRescueTestJSON-405111015 Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerRescueTestJSON-405111015-project Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: ca9dfb4b81524bceb10c14f3849ab09c Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerRescueTestJSON-405111015-project Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 11826045-d4be-4857-956d-0052871ce042 could not be found. Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '11826045-d4be-4857-956d-0052871ce042'} Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11826045-d4be-4857-956d-0052871ce042 could not be found. Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11826045-d4be-4857-956d-0052871ce042 could not be found. Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:20.420429 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:20.426031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:20.426031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:20.426031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:20.426031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:48:20.426031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:48:20.426031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11826045-d4be-4857-956d-0052871ce042 could not be found. Nov 02 13:48:20.426031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:20.427636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Returning 404 to user: Instance 11826045-d4be-4857-956d-0052871ce042 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:48:20.428686 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4364ae2-72ff-485c-94ee-30dfeccc1d4b tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042" status: 404 len: 111 microversion: 2.1 time: 0.051510 Nov 02 13:48:20.429453 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3277/6167] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:20 2022] GET /compute/v2.1/servers/11826045-d4be-4857-956d-0052871ce042 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:48:20.441310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:20.442433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:20.448861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.450055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.451737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.453300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.454309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.455419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.501033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:48:20.615713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2720987f-d779-4ea0-b0a8-6899bb848470 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "DELETE /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 204 len: 0 microversion: 2.1 time: 0.181189 Nov 02 13:48:20.616501 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3278/6168] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:48:20 2022] DELETE /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:48:20.627103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:20.628183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:20.634748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.635537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.636152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.637079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:20.638325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:20.639276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:20.805964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:20.818621 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f25d783f-7e91-4393-911f-e8a13281b38e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1537 microversion: 2.1 time: 0.426234 Nov 02 13:48:20.819907 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2891/6169] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:20 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1537 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:20.824933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:20.844164 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d88f0e8d-b412-4718-9667-f22457eaeee3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1495 microversion: 2.1 time: 0.222796 Nov 02 13:48:20.845742 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3279/6170] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:20 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1495 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:21.184132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3d9cc6f5-7a5b-43be-9512-76f2951fc341 req-06b7224e-5519-4afc-b5b3-c518abaf81af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7944ff2a-3114-464d-9ecf-c287973c180c", "name": "network-vif-plugged", "status": "completed", "tag": "2c92be66-37bc-431d-9fc4-1784271237fb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:21.203641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3d9cc6f5-7a5b-43be-9512-76f2951fc341 req-06b7224e-5519-4afc-b5b3-c518abaf81af service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.204131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3d9cc6f5-7a5b-43be-9512-76f2951fc341 req-06b7224e-5519-4afc-b5b3-c518abaf81af service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.205782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3d9cc6f5-7a5b-43be-9512-76f2951fc341 req-06b7224e-5519-4afc-b5b3-c518abaf81af service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.235599 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3d9cc6f5-7a5b-43be-9512-76f2951fc341 req-06b7224e-5519-4afc-b5b3-c518abaf81af service nova] Creating event network-vif-plugged:2c92be66-37bc-431d-9fc4-1784271237fb for instance 7944ff2a-3114-464d-9ecf-c287973c180c on n-h2-858384-19 Nov 02 13:48:21.241867 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3d9cc6f5-7a5b-43be-9512-76f2951fc341 req-06b7224e-5519-4afc-b5b3-c518abaf81af service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062736 Nov 02 13:48:21.242882 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2892/6171] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:21.845663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:21.846295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:21.870424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.877900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:21.880074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:21.883674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.884552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.906415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.909011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.913686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.925850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.929525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.931541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:21.936571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:21.941266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:21.948341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:22.165795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:22.184572 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba6f466b-e3ef-418d-b212-95ba6deb031c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1495 microversion: 2.1 time: 0.311807 Nov 02 13:48:22.185700 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2893/6172] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:21 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1495 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:22.302484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:22.315686 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1972ce21-9c85-462c-960a-d6f34f2f0deb tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1537 microversion: 2.1 time: 0.476300 Nov 02 13:48:22.316782 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3280/6173] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:21 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1537 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:23.223930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:23.229681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:23.251053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.252206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.252370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.253352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.254034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.254688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.345008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:23.345655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:23.364938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.366153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.366777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.368164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:23.368993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:23.369956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:23.717981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.741709 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe8b26ab-0a0f-4858-97b7-65c6a9f7785c tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1495 microversion: 2.1 time: 0.528442 Nov 02 13:48:23.745928 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2894/6174] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:23 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1495 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:23.821626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:23.831366 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b262e487-ce51-41f0-bf63-18ba216b2f42 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.495401 Nov 02 13:48:23.831965 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3281/6175] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:23 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:24.571515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-8d8124c2-9584-409b-9ce4-8f9aaf7bafde req-b195d1d6-4122-4516-910a-3a93339bf705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82211405-a402-49b1-a747-adada43272ed", "name": "network-vif-deleted", "tag": "21777df3-edac-4055-8209-f14265c77538"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:24.593140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8d8124c2-9584-409b-9ce4-8f9aaf7bafde req-b195d1d6-4122-4516-910a-3a93339bf705 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.593888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8d8124c2-9584-409b-9ce4-8f9aaf7bafde req-b195d1d6-4122-4516-910a-3a93339bf705 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.594621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8d8124c2-9584-409b-9ce4-8f9aaf7bafde req-b195d1d6-4122-4516-910a-3a93339bf705 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.617958 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-8d8124c2-9584-409b-9ce4-8f9aaf7bafde req-b195d1d6-4122-4516-910a-3a93339bf705 service nova] Creating event network-vif-deleted:21777df3-edac-4055-8209-f14265c77538 for instance 82211405-a402-49b1-a747-adada43272ed on n-h1-858384-19 Nov 02 13:48:24.643294 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-8d8124c2-9584-409b-9ce4-8f9aaf7bafde req-b195d1d6-4122-4516-910a-3a93339bf705 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077631 Nov 02 13:48:24.648643 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2895/6176] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:48:24.769569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:24.771012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:24.783958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.785044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.785830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.786906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.787629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.792636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.864302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:24.865252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:24.885932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.889404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.894309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.894309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.895176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.895176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.901764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:24.902458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:24.902914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:24.904259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lazy-loading 'fault' on Instance uuid 82211405-a402-49b1-a747-adada43272ed {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:25.103871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9dfb4b81524bceb10c14f3849ab09c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce706ff2fb44a1bb9295245b85a8299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:25.130893 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c65aedad-091f-4538-aa39-e1d7b36c06d3 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 200 len: 1307 microversion: 2.1 time: 0.366300 Nov 02 13:48:25.132427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:25.140686 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3282/6177] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:24 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:25.151143 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38506092-0171-43f0-b3c3-29a396aae438 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.295556 Nov 02 13:48:25.152701 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2896/6178] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:24 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:26.174684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:26.176517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] [instance: 82211405-a402-49b1-a747-adada43272ed] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:26.188140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:26.188768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:26.200186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.201062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.201852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.202813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.203352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.203799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.204521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.204973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.205401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.214049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:26.214556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:26.215006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:26.271751 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] HTTP exception thrown: Instance 82211405-a402-49b1-a747-adada43272ed could not be found. Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Request method failure captured: Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed HTTP/1.1 Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS0setCpmyD9R4Nd5Cm2R_UEDcpDQZCeE7d33UIAzUka58MGfr_D6hnHvfIyUBhie469Yf9osqv9OdZVMJcpFD-6h7xa_3wtBzTXYav71K4egXQKVp13CvP8oIKXTclPPYB2VGlxuXd01yb_-b-pSAuLlqmhD-yLMj7GBoPEIJVTfI Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: dce706ff2fb44a1bb9295245b85a8299 Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerRescueTestJSON-405111015 Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dce706ff2fb44a1bb9295245b85a8299"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/dce706ff2fb44a1bb9295245b85a8299"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_dce706ff2fb44a1bb9295245b85a8299"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/dce706ff2fb44a1bb9295245b85a8299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerRescueTestJSON-405111015 Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: dce706ff2fb44a1bb9295245b85a8299 Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerRescueTestJSON-405111015 Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerRescueTestJSON-405111015-project Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: ca9dfb4b81524bceb10c14f3849ab09c Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerRescueTestJSON-405111015-project Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 82211405-a402-49b1-a747-adada43272ed could not be found. Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '82211405-a402-49b1-a747-adada43272ed'} Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82211405-a402-49b1-a747-adada43272ed could not be found. Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82211405-a402-49b1-a747-adada43272ed could not be found. Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:26.274989 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.281637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:26.281637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:26.281637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:26.281637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:48:26.281637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:48:26.281637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82211405-a402-49b1-a747-adada43272ed could not be found. Nov 02 13:48:26.281637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:48:26.281637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] Returning 404 to user: Instance 82211405-a402-49b1-a747-adada43272ed could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:48:26.281637 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ffe422e-d3b1-4e20-be87-50999d6ca449 tempest-ServerRescueTestJSON-405111015 tempest-ServerRescueTestJSON-405111015-project] 10.222.0.113 "GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed" status: 404 len: 111 microversion: 2.1 time: 0.110900 Nov 02 13:48:26.291137 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3283/6179] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:26 2022] GET /compute/v2.1/servers/82211405-a402-49b1-a747-adada43272ed => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:48:26.635994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:26.650013 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec71c5ad-27df-4a5e-bd58-86f82f0fbdd5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.466607 Nov 02 13:48:26.674464 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2897/6180] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:26 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:27.681202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:27.681771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:27.697980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:27.698477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:27.698923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:27.711223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:27.713157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:27.717441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:28.360033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:28.372324 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a89dc78c-4fbb-4f60-8706-1fb55d3ad08d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.695512 Nov 02 13:48:28.377316 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3284/6181] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:27 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:29.403317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:29.404123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:29.417367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:29.418140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:29.418698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:29.420779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:29.422213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:29.423391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:29.844414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:29.867605 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a6dde3a-731a-4304-86ca-f5cdb6d82489 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.466388 Nov 02 13:48:29.868117 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2898/6182] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:29 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:30.896574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:30.897780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:30.913388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:30.914289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:30.915925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:30.917030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:30.920649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:30.921444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:31.197316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:31.216917 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f4fa98b1-5824-4a6b-8816-ecf90432e2d9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.322652 Nov 02 13:48:31.221405 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3285/6183] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:30 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:32.250479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:32.251857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:32.268281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:32.273473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:32.277535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:32.281066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:32.282649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:32.283945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:32.285296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:33.280593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:33.289154 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6fdbab40-eef5-48c3-a836-2c52f02a9396 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 1.046907 Nov 02 13:48:33.290639 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2899/6184] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:32 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:34.321019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:34.321565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:34.343091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:34.346317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.350653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.357619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:34.360444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:34.362231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:34.377719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:35.273028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:35.277410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:35.302128 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1ae07e4-89ff-4e0c-97b4-77277e83ab0f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.986300 Nov 02 13:48:35.305866 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3286/6185] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:34 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:36.337961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:36.339453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:36.353887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.356569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.357612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.364931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:36.365761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:36.366553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:36.699911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:36.709020 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dd510d10-0bc9-421c-8484-8a6f905f21e5 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.374935 Nov 02 13:48:36.716176 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2900/6186] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:36 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:37.741510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:37.742183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:37.763072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.766470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.768037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:37.774258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:37.775157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:37.776027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:38.125039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:38.137736 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd190512-ede2-41c0-a63f-be223c571ede tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.401407 Nov 02 13:48:38.141232 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3287/6187] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:37 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:39.166262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:39.168049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:39.186929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.187968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.188871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.190414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:39.191660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:39.191997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:39.952779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:39.969253 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-633f14d9-c564-477e-8193-1c1325a4d78c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.807340 Nov 02 13:48:39.972626 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2901/6188] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:39 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:41.002510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:41.004498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:41.023668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:41.025883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:41.026641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:41.031098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:41.031851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:41.047594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:41.431326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:41.456228 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-13344114-49ce-41a8-a40d-e040a8039331 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.459960 Nov 02 13:48:41.465591 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3288/6189] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:40 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:42.489988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:42.491277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:42.507025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.509549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.512250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:42.513468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:42.515068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:42.516528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:43.382501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:43.397511 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c8d301e1-975a-49d9-931f-0e32d1e52aec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.914033 Nov 02 13:48:43.398124 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2902/6190] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:42 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:44.427445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:44.431517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:44.475557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:44.487538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:44.487931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:44.488705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:44.492758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:44.493460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:44.752124 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:48:44.752682 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 13:48:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c (ip 10.222.0.113) !!! Nov 02 13:48:45.799892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:45.833292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6ad58c3a-a8b9-49ac-9f6e-3dd0043559be tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 1.408771 Nov 02 13:48:45.845461 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3289/6191] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:44 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:46.865259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:46.865991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:46.876887 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:48:46.877049 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 13:48:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c (ip 10.222.0.113) !!! Nov 02 13:48:46.915234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:46.918700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:46.920400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:46.929641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:46.930428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:46.935075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:47.837262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:47.856278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=77 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:48:47.867420 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9560a2b-5897-4d1b-9155-ec4389e97718 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 1.006759 Nov 02 13:48:47.887205 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2903/6192] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:46 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:48.897744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:48.899045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:48.921485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.922314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.923357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:48.924535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:48.925344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:48.928842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:49.837836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:49.851898 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9812a879-149e-47f5-88a3-43da2bff4156 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 0.958802 Nov 02 13:48:49.868988 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3290/6193] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:48 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:50.884274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:50.886311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:50.897730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.898475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.901275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:50.905121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:50.906381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:50.907092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:51.874494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:51.885595 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aac849d2-c06e-426c-903a-e858aa0a17cf tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1532 microversion: 2.1 time: 1.007812 Nov 02 13:48:51.897100 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2904/6194] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:50 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1532 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:52.914505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:52.915800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:52.947635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.948512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.949395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:52.954425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:52.955167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:52.958232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:53.157183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1532694675", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "3d17709f-6274-4548-a8d0-ea8d51d06e4f"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:53.243458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] validate_networks() for [('3d17709f-6274-4548-a8d0-ea8d51d06e4f', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:48:53.248320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:53.283523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22a2fcba-04a3-4e04-bfe4-6a7d0b7c6d9e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1514 microversion: 2.1 time: 0.366050 Nov 02 13:48:53.284570 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3291/6195] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:52 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1514 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:54.311084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:54.313624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:54.322447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:54.323363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:54.324266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.325378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:54.326186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:54.326862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.385451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:48:54.386074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:48:54.387091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:48:54.389283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:48:54.390000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:48:54.403483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:54.404343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:54.405037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.406877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:54.407603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:54.408653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:54.432691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Getting quotas for project 97526fb343de466c89355986251ce4e2. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:48:54.440739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Getting quotas for user a483c3085c554d3f91e9ce7a8e50e225 and project 97526fb343de466c89355986251ce4e2. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:48:54.462099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:48:54.465893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:48:54.566974 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d08a16ab-9670-4802-905b-f78ad1e1ad5a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.26 time: 1.580469 Nov 02 13:48:54.567941 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2905/6196] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:48:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 13:48:54.583518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6358b357-0391-4f03-b449-c9ece19c1026 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:54.584403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6358b357-0391-4f03-b449-c9ece19c1026 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:54.619851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:54.634558 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f7e8eb7-38c6-4305-aa5a-130024584659 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1514 microversion: 2.1 time: 0.329992 Nov 02 13:48:54.649039 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3292/6197] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:54 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:55.295347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6f65788c-2bc8-4e4a-8bd5-28b3b80125fe req-e3b1d446-290d-4fc5-b3f3-dad591b98043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7944ff2a-3114-464d-9ecf-c287973c180c", "name": "network-vif-unplugged", "status": "completed", "tag": "2c92be66-37bc-431d-9fc4-1784271237fb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:55.321305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6f65788c-2bc8-4e4a-8bd5-28b3b80125fe req-e3b1d446-290d-4fc5-b3f3-dad591b98043 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:55.325854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6f65788c-2bc8-4e4a-8bd5-28b3b80125fe req-e3b1d446-290d-4fc5-b3f3-dad591b98043 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:55.328492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6f65788c-2bc8-4e4a-8bd5-28b3b80125fe req-e3b1d446-290d-4fc5-b3f3-dad591b98043 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:55.363731 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6f65788c-2bc8-4e4a-8bd5-28b3b80125fe req-e3b1d446-290d-4fc5-b3f3-dad591b98043 service nova] Creating event network-vif-unplugged:2c92be66-37bc-431d-9fc4-1784271237fb for instance 7944ff2a-3114-464d-9ecf-c287973c180c on n-h2-858384-19 Nov 02 13:48:55.382223 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6f65788c-2bc8-4e4a-8bd5-28b3b80125fe req-e3b1d446-290d-4fc5-b3f3-dad591b98043 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090699 Nov 02 13:48:55.385013 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3293/6198] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:48:55.512784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6358b357-0391-4f03-b449-c9ece19c1026 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:55.530813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6358b357-0391-4f03-b449-c9ece19c1026 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:55.533417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6358b357-0391-4f03-b449-c9ece19c1026 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:55.534625 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6358b357-0391-4f03-b449-c9ece19c1026 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1266 microversion: 2.26 time: 0.957592 Nov 02 13:48:55.535225 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2906/6199] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:48:54 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1266 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:55.680861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:55.682796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:55.711634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:55.712144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:55.712595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:55.713321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:55.717752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:55.718206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:55.949662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:55.963479 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1fe31d8-4af3-4d29-9249-a15d743adea1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1517 microversion: 2.1 time: 0.288988 Nov 02 13:48:55.964129 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3294/6200] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:55 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1517 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:55.993456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:55.995084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:56.016957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.019282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.019852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.035501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.036125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.036582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.525051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:56.535546 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6f07f5f-8ea1-4f8a-8f4b-957afc86f8dc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1517 microversion: 2.1 time: 0.548190 Nov 02 13:48:56.540017 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2907/6201] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:55 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1517 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:48:56.566747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:56.568003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:56.584897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.590664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.593408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.598916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.609641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.610500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.660735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:56.661290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:56.670163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.671100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.671916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.673581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.674607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.675287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.715616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lazy-loading 'flavor' on Instance uuid 7944ff2a-3114-464d-9ecf-c287973c180c {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:48:56.735037 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Cannot 'shelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state shelved_offloaded Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action HTTP/1.1 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 14 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: {"shelve": {}} Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: exception: Cannot 'shelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state shelved_offloaded Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c', 'body': {'shelve': {}}} Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7944ff2a-3114-464d-9ecf-c287973c180c in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:48:56.738221 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state shelved_offloaded Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state shelved_offloaded Nov 02 13:48:56.744628 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:48:56.748133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 409 to user: Cannot 'shelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state shelved_offloaded {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:48:56.749338 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de8fa34f-affe-4879-a3aa-7f507d7c98ee tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 409 len: 155 microversion: 2.1 time: 0.092916 Nov 02 13:48:56.750566 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2908/6202] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:48:56 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 155 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 13:48:56.762673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:48:56.764168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:56.779550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.781339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.783057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.784923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:56.785413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:56.785971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:56.800691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:56.812797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:56.814667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:56.816070 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19bce4b8-ded4-4cee-8a6a-4ea1efc8a706 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1336 microversion: 2.26 time: 0.255380 Nov 02 13:48:56.817334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3295/6203] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:48:56 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1336 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:56.860684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120929) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Nov 02 13:48:57.019097 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ffb8e4e-377d-46c7-bdcd-bf0fc1a3f43b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 202 len: 0 microversion: 2.1 time: 0.264440 Nov 02 13:48:57.030274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:57.031213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:57.031824 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2909/6204] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:48:56 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:48:57.043986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:57.044823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:57.045444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:57.046995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:57.047935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:57.048555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:57.575933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:57.587805 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b8ff50ed-c53f-47f8-a40d-fae6cc4b8fa1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1465 microversion: 2.1 time: 0.562737 Nov 02 13:48:57.588948 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3296/6205] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:57 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1465 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:48:57.852210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:57.853595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:57.866445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:57.867224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:57.868164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:57.869369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:57.870149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:57.871582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.242411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:58.257276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:58.265326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:58.266888 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-662038e8-f194-46f5-9bbb-c308c82e0898 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1324 microversion: 2.26 time: 0.425621 Nov 02 13:48:58.271906 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2910/6206] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:48:57 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1324 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:48:58.615994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:58.617471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:58.640847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.641999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.642997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:58.645217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:58.646066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:58.653537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:59.311357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:48:59.312020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:48:59.357981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:59.358455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:59.358838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:59.359596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:48:59.360055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:48:59.368434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:48:59.451283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:48:59.465582 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-486479f7-d683-4346-8621-4c736d9138ac tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1465 microversion: 2.1 time: 0.853758 Nov 02 13:48:59.470410 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3297/6207] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:48:58 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1465 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:00.002694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:00.015579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:00.020195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:00.022430 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c4d34ef3-2426-4b0c-811e-60d66b3249b3 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1366 microversion: 2.26 time: 0.724218 Nov 02 13:49:00.024728 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2911/6208] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:48:59 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1366 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:00.494342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:00.496756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:00.513851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:00.516717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:00.517063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-69e8d8d9-975d-427c-a1fa-c499d1e80bb8 req-fec3128a-9d3b-4c9c-a24d-14400e918d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3931ab72-1e5a-4785-a144-a718e5939cd4", "tag": "b35deb00-70c1-4563-a8e5-db95e618234a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:00.518252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:00.521992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:00.522548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:00.523012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:00.580754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-69e8d8d9-975d-427c-a1fa-c499d1e80bb8 req-fec3128a-9d3b-4c9c-a24d-14400e918d69 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:00.585735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-69e8d8d9-975d-427c-a1fa-c499d1e80bb8 req-fec3128a-9d3b-4c9c-a24d-14400e918d69 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:00.587677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-69e8d8d9-975d-427c-a1fa-c499d1e80bb8 req-fec3128a-9d3b-4c9c-a24d-14400e918d69 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:00.618699 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-69e8d8d9-975d-427c-a1fa-c499d1e80bb8 req-fec3128a-9d3b-4c9c-a24d-14400e918d69 service nova] Creating event network-changed:b35deb00-70c1-4563-a8e5-db95e618234a for instance 3931ab72-1e5a-4785-a144-a718e5939cd4 on n-h1-858384-19 Nov 02 13:49:00.634665 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-69e8d8d9-975d-427c-a1fa-c499d1e80bb8 req-fec3128a-9d3b-4c9c-a24d-14400e918d69 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120351 Nov 02 13:49:00.639938 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2912/6209] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:49:00.919369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:00.932453 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-709fb5b7-1578-4ad8-9b77-928b31e43566 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.441145 Nov 02 13:49:00.938520 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3298/6210] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:00 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:01.053434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:01.054708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:01.064766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:01.065531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:01.066203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:01.068024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:01.068768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:01.069436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:01.410622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:01.436626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:01.439759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:01.441431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c72a43a9-0c7d-41c8-81bd-de851846f6d7 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1366 microversion: 2.26 time: 0.396221 Nov 02 13:49:01.442755 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2913/6211] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:01 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:01.963450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:01.965478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:02.004518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:02.005077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:02.005544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:02.010687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:02.012573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:02.013101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:02.294632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:02.304680 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ccea403e-16aa-43aa-9dd6-c099a289a8f7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.349949 Nov 02 13:49:02.306198 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3299/6212] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:01 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:02.467836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:02.468465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:02.495020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:02.497726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:02.498426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:02.499854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:02.519207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:02.520201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:02.521738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:02.942239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:02.957186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:02.960064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:02.965821 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f1c2019a-5fbb-4f50-8076-22efa7b51c46 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1366 microversion: 2.26 time: 0.502196 Nov 02 13:49:02.967799 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2914/6213] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:02 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:03.341421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:03.342878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:03.379631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:03.382313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:03.384666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:03.385995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:03.389947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:03.390668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:03.732563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:03.750404 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-caa7edbb-6b41-4673-aa8a-b0d9b5146f5f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.413825 Nov 02 13:49:03.752974 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3300/6214] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:03 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:03.999930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:04.000713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:04.025769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:04.027153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:04.027782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:04.028702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:04.032584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:04.033314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:04.420992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:04.784235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:04.785144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:04.798002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=30 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:04.840065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:04.842796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:04.844084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:04.848046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:04.848678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:04.850180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:05.220290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:05.255735 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff51ec5b-178b-4383-8801-64de7fcd26d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.476707 Nov 02 13:49:05.256960 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3301/6215] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:04 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:05.519434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:05.843926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:05.874839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:05.878055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:05.900407 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d2605f89-5679-4ae4-9e50-8abf20dc74b0 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1366 microversion: 2.26 time: 1.904823 Nov 02 13:49:05.946975 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2915/6216] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:03 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1366 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:49:06.301251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:06.302136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:06.314667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:06.316274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:06.316722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:06.317458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:06.337275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:06.337761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:06.880190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:06.906819 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0810ac75-f1b7-487e-be51-513e48dca833 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.612312 Nov 02 13:49:06.907810 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3302/6217] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:06 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:06.956789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:06.962786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:06.973737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:06.977353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:06.987287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:07.020081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:07.020958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:07.021742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:07.460168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:07.472020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:07.474834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:07.478635 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8d0ffd84-c303-4bc3-95d0-ab0a21eb3211 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1366 microversion: 2.26 time: 0.527076 Nov 02 13:49:07.482254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2916/6218] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:06 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1366 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:07.967912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:07.968638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:07.987848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:07.993258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:07.993907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.006684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.007955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.012904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.029223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=93 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:08.482985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:08.493245 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f6164ee5-d645-4b5f-bdf2-1cac70e4beec tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.534940 Nov 02 13:49:08.494389 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3303/6219] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:07 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:08.510220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:08.514265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:08.526097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.539809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.545689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:08.546705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:08.556639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:08.558248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.251146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:09.260661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:09.263932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:09.283993 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-babad1f1-629e-4546-a702-da47bc73293a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1366 microversion: 2.26 time: 0.777746 Nov 02 13:49:09.306493 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2917/6220] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:08 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1366 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:09.517498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:09.518112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:09.537977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.538809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.539589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.540828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.541614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.560261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.617370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4cc25ce2-9ce6-40bc-9911-a22c7e56b30f req-a7c6c7ba-2f0f-4119-a07e-2ce549bd56f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3931ab72-1e5a-4785-a144-a718e5939cd4", "name": "network-vif-plugged", "status": "completed", "tag": "b35deb00-70c1-4563-a8e5-db95e618234a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:09.684053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4cc25ce2-9ce6-40bc-9911-a22c7e56b30f req-a7c6c7ba-2f0f-4119-a07e-2ce549bd56f9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:09.685234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4cc25ce2-9ce6-40bc-9911-a22c7e56b30f req-a7c6c7ba-2f0f-4119-a07e-2ce549bd56f9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:09.690342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4cc25ce2-9ce6-40bc-9911-a22c7e56b30f req-a7c6c7ba-2f0f-4119-a07e-2ce549bd56f9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:09.746806 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4cc25ce2-9ce6-40bc-9911-a22c7e56b30f req-a7c6c7ba-2f0f-4119-a07e-2ce549bd56f9 service nova] Creating event network-vif-plugged:b35deb00-70c1-4563-a8e5-db95e618234a for instance 3931ab72-1e5a-4785-a144-a718e5939cd4 on n-h1-858384-19 Nov 02 13:49:09.759203 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4cc25ce2-9ce6-40bc-9911-a22c7e56b30f req-a7c6c7ba-2f0f-4119-a07e-2ce549bd56f9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149125 Nov 02 13:49:09.761984 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2918/6221] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:10.139756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:10.159802 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1991aed3-e74f-4d5d-9880-ca83666eeb4b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.645498 Nov 02 13:49:10.163662 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3304/6222] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:09 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:10.318290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:10.319155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:10.350863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.351709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.352412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:10.356299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:10.357317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:10.358195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.043307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:11.061417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:11.065362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:11.067237 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f43bd66b-4e32-4768-b451-2a48dbfb9cbb tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1366 microversion: 2.26 time: 0.755910 Nov 02 13:49:11.097643 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2919/6223] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:10 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1366 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:11.190329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:11.191640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:11.208743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.209761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.210757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.212845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:11.213559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:11.214611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:11.612335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:11.631898 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d003a262-d7c4-4eeb-a1f0-6c7f833e8f47 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.447193 Nov 02 13:49:11.632789 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3305/6224] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:11 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:12.107172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:12.107910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:12.128594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.129297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.129737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.130664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.131318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.132192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.661955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:12.663035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:12.686875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.691836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.692371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:12.698821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:12.699818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:12.700277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:13.083974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.094927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.097322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.112242 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-95519f43-31fb-470b-a35e-183b580f0e72 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1366 microversion: 2.26 time: 1.011005 Nov 02 13:49:13.113979 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2920/6225] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:12 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1366 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:13.184024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:13.203330 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-589e438f-610b-4134-b218-b2a3194a3c0d tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.546114 Nov 02 13:49:13.204723 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3306/6226] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:12 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:13.858826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9c7d8282-0ce9-487c-bca4-11d54eacf298 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'create', calling method: .version_select at 0x7fe7865b73a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1619075422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdLDceiOc5sQRBQNFRNTaUidgAh49zizeeRdWRtweTrERUGYNlKOcEOss4CAiOnLaPwjE74Ea3JMvp36WsJ+N+grIoZ2nF1YzKAceQ49gOe1G6/L37Y4fjrzTxJN+MFaw=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:13.915245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9c7d8282-0ce9-487c-bca4-11d54eacf298 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for project bc97329dcfb8453795347d9e818d9d92. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:13.929639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9c7d8282-0ce9-487c-bca4-11d54eacf298 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for user 41c7ca068dba4093880183ae9b2f0935 and project bc97329dcfb8453795347d9e818d9d92. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:14.056494 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9c7d8282-0ce9-487c-bca4-11d54eacf298 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.773441 Nov 02 13:49:14.058481 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2921/6227] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:49:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:14.147222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:14.148472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:14.170428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.173139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.174151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.185666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.186765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.187597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.252075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:14.253476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:14.269704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.270623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.271386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.272369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:14.273445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:14.280263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:14.814223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:14.857408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:14.859103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:14.861508 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e013d3d-7681-48d6-af57-004e3a7df3ee tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1549 microversion: 2.26 time: 0.722178 Nov 02 13:49:14.862647 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3307/6228] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:14 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1549 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:14.863030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:14.874650 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7d2636e-2dc1-4d57-ab4d-4339a96e368c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.626481 Nov 02 13:49:14.876592 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2922/6229] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:14 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:14.982086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe785f4b820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.014129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.030750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.041199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.050698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:15.078993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.084666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.085511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.086436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.093050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.098387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.153651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.155873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.156551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.213003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.214855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.216218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.336597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:15.377556 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1a0fc0e3-7e40-4729-b1a8-66dbbf3beded tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1443382403" status: 201 len: 0 microversion: 2.26 time: 0.474329 Nov 02 13:49:15.378600 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3308/6230] 10.222.0.113 () {62 vars in 1385 bytes} [Wed Nov 2 13:49:14 2022] PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1443382403 => generated 0 bytes in 476 msecs (HTTP/1.1 201) 10 headers in 487 bytes (1 switches on core 0) Nov 02 13:49:15.391941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66e824ab-9d75-4e3c-bc9f-acfc79c0ce25 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe7865b4a60>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.415717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66e824ab-9d75-4e3c-bc9f-acfc79c0ce25 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.416357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66e824ab-9d75-4e3c-bc9f-acfc79c0ce25 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.418515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66e824ab-9d75-4e3c-bc9f-acfc79c0ce25 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.451699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:15.455841 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66e824ab-9d75-4e3c-bc9f-acfc79c0ce25 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1443382403" status: 204 len: 0 microversion: 2.26 time: 0.067361 Nov 02 13:49:15.457627 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2923/6231] 10.222.0.113 () {60 vars in 1366 bytes} [Wed Nov 2 13:49:15 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1443382403 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 13:49:15.467069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe7861ef940>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.477454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.477936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.478596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.479148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:15.489424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.489887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.490517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.491442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.492210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.492879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.529219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.530199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.530647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.558325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:15.581066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b428fee4-9e80-42b9-a44d-39407ac94e98 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 204 len: 0 microversion: 2.26 time: 0.117954 Nov 02 13:49:15.581930 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3309/6232] 10.222.0.113 () {60 vars in 1300 bytes} [Wed Nov 2 13:49:15 2022] DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:49:15.591314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-48939bfc-7257-464a-bb81-bc48cce5f86c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe78fa92af0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.600803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48939bfc-7257-464a-bb81-bc48cce5f86c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.601650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48939bfc-7257-464a-bb81-bc48cce5f86c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.602314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48939bfc-7257-464a-bb81-bc48cce5f86c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.620745 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-48939bfc-7257-464a-bb81-bc48cce5f86c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 200 len: 12 microversion: 2.26 time: 0.031588 Nov 02 13:49:15.628062 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2924/6233] 10.222.0.113 () {60 vars in 1297 bytes} [Wed Nov 2 13:49:15 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:15.640115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe786bb2c10>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.663068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.663717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.663887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.664412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:15.675641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.676133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.676575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.677504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.678294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.679091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.730610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.732545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.734659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.753255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.763299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.763757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.809117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:15.827695 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19d91d75-2ec5-46a0-ada5-935fd53af509 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1389312082" status: 201 len: 0 microversion: 2.26 time: 0.194798 Nov 02 13:49:15.833038 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3310/6234] 10.222.0.113 () {62 vars in 1385 bytes} [Wed Nov 2 13:49:15 2022] PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1389312082 => generated 0 bytes in 204 msecs (HTTP/1.1 201) 10 headers in 487 bytes (2 switches on core 0) Nov 02 13:49:15.845848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81d16ed7-3f39-4e2e-a3ae-691bf6303ae9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe78655a5e0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.863064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d16ed7-3f39-4e2e-a3ae-691bf6303ae9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.864303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d16ed7-3f39-4e2e-a3ae-691bf6303ae9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.866529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d16ed7-3f39-4e2e-a3ae-691bf6303ae9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.882136 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-81d16ed7-3f39-4e2e-a3ae-691bf6303ae9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 200 len: 36 microversion: 2.26 time: 0.047189 Nov 02 13:49:15.883588 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2925/6235] 10.222.0.113 () {60 vars in 1297 bytes} [Wed Nov 2 13:49:15 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 36 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:15.905045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe7878869d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.912089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:15.913079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:15.922044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.922521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.922659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.922981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.923156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.923505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:15.923639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.924326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.924977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.925409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.937593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.938082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.938820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.939918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.940778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.941538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:15.982295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:15.982713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:15.983350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.034536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:16.061764 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1e1e2cbd-8d2f-4140-8faa-ccec96ca26b8 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1389312082" status: 204 len: 0 microversion: 2.26 time: 0.168769 Nov 02 13:49:16.066215 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3311/6236] 10.222.0.113 () {60 vars in 1369 bytes} [Wed Nov 2 13:49:15 2022] DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1389312082 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:49:16.080318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4dad71b6-79c3-434e-94f0-423ffd087a77 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe7862cb430>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.094734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dad71b6-79c3-434e-94f0-423ffd087a77 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.095431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dad71b6-79c3-434e-94f0-423ffd087a77 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.095980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4dad71b6-79c3-434e-94f0-423ffd087a77 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.113763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4dad71b6-79c3-434e-94f0-423ffd087a77 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 200 len: 12 microversion: 2.26 time: 0.043756 Nov 02 13:49:16.115095 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3312/6237] 10.222.0.113 () {60 vars in 1297 bytes} [Wed Nov 2 13:49:16 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 12 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:16.128166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe786a17b80>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.131184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:16.137908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.138699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.139257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.139702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:16.147773 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-33668cbe-230b-40b1-ac8f-d4e534a404cd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.241157 Nov 02 13:49:16.147773 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2926/6238] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:15 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:16.148608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.149060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.149517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.150231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.150692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.151780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.178093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.178764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.179261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.193830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:16.210299 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef63835e-c86a-4da9-99bc-62ab06cb7c0b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 204 len: 0 microversion: 2.26 time: 0.086583 Nov 02 13:49:16.212747 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3313/6239] 10.222.0.113 () {60 vars in 1300 bytes} [Wed Nov 2 13:49:16 2022] DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 13:49:16.224396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe786500040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.236250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.236804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.237355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.237940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:16.245719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.246459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.246969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.248061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.249001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.249620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.281026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.281740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.282363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.294889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.295618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.296226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.335054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:16.360591 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2b2064a7-0779-4d93-80bb-4dd1df834b3b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-106942944" status: 201 len: 0 microversion: 2.26 time: 0.140621 Nov 02 13:49:16.362002 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2927/6240] 10.222.0.113 () {62 vars in 1382 bytes} [Wed Nov 2 13:49:16 2022] PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-106942944 => generated 0 bytes in 143 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 13:49:16.372729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe78f93f160>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.388377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.392339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.392339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.392339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:16.397140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.397844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.398455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.400262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.401460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.402572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.422900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:16.437027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.437720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.438243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.455259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.455259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.455259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.504216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:16.526740 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-26d54050-e2db-4a01-8429-2d7dd87ede8f tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-865819917" status: 201 len: 0 microversion: 2.26 time: 0.157452 Nov 02 13:49:16.531491 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3314/6241] 10.222.0.113 () {62 vars in 1382 bytes} [Wed Nov 2 13:49:16 2022] PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-865819917 => generated 0 bytes in 160 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 13:49:16.542064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe7865068b0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.553285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.553854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.554582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.556772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:16.580575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.581520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.582480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.583593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.583910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.584426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.642574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.643106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.643609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.674556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:16.700867 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05a74a5a-f71f-46c9-b660-5c35700a7925 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 204 len: 0 microversion: 2.26 time: 0.166680 Nov 02 13:49:16.706482 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2928/6242] 10.222.0.113 () {60 vars in 1300 bytes} [Wed Nov 2 13:49:16 2022] DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 13:49:16.715477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c14acf8-c082-4268-afd9-d78228727f95 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe786a179d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.737563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c14acf8-c082-4268-afd9-d78228727f95 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.738912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c14acf8-c082-4268-afd9-d78228727f95 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.738912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c14acf8-c082-4268-afd9-d78228727f95 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.761117 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c14acf8-c082-4268-afd9-d78228727f95 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 200 len: 12 microversion: 2.26 time: 0.052670 Nov 02 13:49:16.762006 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3315/6243] 10.222.0.113 () {60 vars in 1297 bytes} [Wed Nov 2 13:49:16 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 12 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:16.772354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe7868fa310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.781967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.782462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.782903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.783423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:16.789976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.790753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.791606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.792536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.793254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.793909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.824105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.826403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.827841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.865700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:16.889980 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-efdabce8-0a33-4a04-aa7c-798d7f77a485 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 204 len: 0 microversion: 2.26 time: 0.121768 Nov 02 13:49:16.890620 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2929/6244] 10.222.0.113 () {60 vars in 1300 bytes} [Wed Nov 2 13:49:16 2022] DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:49:16.906919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe7863140d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:16.925829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.926315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.927077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.927581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:16.943932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.944667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.945203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.945976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.947187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.948799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:16.993898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:16.997372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:16.999167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.025329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.026107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.026687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.052638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:17.069921 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cce6d8e7-99b1-4630-86ec-9c7ed20d585a tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1965822465" status: 201 len: 0 microversion: 2.26 time: 0.171453 Nov 02 13:49:17.071431 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3316/6245] 10.222.0.113 () {62 vars in 1385 bytes} [Wed Nov 2 13:49:16 2022] PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-1965822465 => generated 0 bytes in 174 msecs (HTTP/1.1 201) 10 headers in 487 bytes (1 switches on core 0) Nov 02 13:49:17.082872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe7865b75e0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:17.094132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.095201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.095602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.096403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:17.103272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.104190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.105421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.106433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.107420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.108092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.141227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.142106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.142780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.155576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.156061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.156673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.173895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:17.175065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:17.183448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.187991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.188444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.189190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.189852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.190068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.195735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:17.220044 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5be0fc81-a946-4b7d-9cb4-b5a5f85e4418 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-117985931" status: 201 len: 0 microversion: 2.26 time: 0.141330 Nov 02 13:49:17.222063 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2930/6246] 10.222.0.113 () {62 vars in 1382 bytes} [Wed Nov 2 13:49:17 2022] PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags/tempest-tag-117985931 => generated 0 bytes in 144 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 02 13:49:17.235948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Action: 'update_all', calling method: .version_select at 0x7fe786543ee0>, body: {"tags": ["tempest-tag-1962979288", "tempest-tag-819102479"]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:17.247446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.248030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.248713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.249265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:17.257597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.259212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.259212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.260859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.260859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.262721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.291221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.292762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.293325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.319065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:17.341122 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f817367-e798-4159-bb84-eb26b0b598a9 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 200 len: 61 microversion: 2.26 time: 0.109268 Nov 02 13:49:17.348172 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2931/6247] 10.222.0.113 () {62 vars in 1317 bytes} [Wed Nov 2 13:49:17 2022] PUT /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 61 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:17.366147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce4e63af-14fd-4dc5-a734-9fcefb49dfd6 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe786888af0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:17.378313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce4e63af-14fd-4dc5-a734-9fcefb49dfd6 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.379230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce4e63af-14fd-4dc5-a734-9fcefb49dfd6 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.379230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce4e63af-14fd-4dc5-a734-9fcefb49dfd6 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.392707 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce4e63af-14fd-4dc5-a734-9fcefb49dfd6 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 200 len: 61 microversion: 2.26 time: 0.039611 Nov 02 13:49:17.393581 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2932/6248] 10.222.0.113 () {60 vars in 1297 bytes} [Wed Nov 2 13:49:17 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 61 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:17.404626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '.version_select at 0x7fe7865250d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:17.419169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.422976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.422976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.422976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:17.427828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.428312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.428748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.429445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.429896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.430319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.471259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.474874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.475528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.504763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'flavor' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:17.541391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7f0b313f-487f-4bac-a725-4a9ff4ce907c tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags" status: 204 len: 0 microversion: 2.26 time: 0.139250 Nov 02 13:49:17.543216 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2933/6249] 10.222.0.113 () {60 vars in 1300 bytes} [Wed Nov 2 13:49:17 2022] DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4/tags => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:49:17.564204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:17.564987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:17.572756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.573782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.574422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.575190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:17.575657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:17.576102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:17.609674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:49:17.765667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:17.785260 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-733b5ede-8f35-4628-8431-0fd7bdb1205a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.613599 Nov 02 13:49:17.791532 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3317/6250] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:17 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:17.970325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=4,nova_cell1:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:18.186407 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1ebd6e69-b5e8-4f07-b76d-0ddeaae33c60 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 204 len: 0 microversion: 2.26 time: 0.637343 Nov 02 13:49:18.187057 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2934/6251] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:49:17 2022] DELETE /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:49:18.203916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:18.207872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:18.218262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:18.219238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:18.220506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:18.221772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:18.232751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:18.240978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:18.697817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:18.709824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:18.711669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:18.715746 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae70f222-f2c3-4ee4-ad2e-b4d9c8c7c3d4 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1555 microversion: 2.26 time: 0.524176 Nov 02 13:49:18.718355 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3318/6252] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:18 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1555 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:18.821408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:18.823751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:18.833810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:18.834901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:18.835614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:18.836813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:18.837450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:18.838077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:19.102904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:19.114762 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c919d386-eb08-4d99-b761-65fecdb5bb8c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.298963 Nov 02 13:49:19.115401 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2935/6253] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:18 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:19.750545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:19.751749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:19.765769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.766334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.766783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:19.767655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:19.771680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:19.772314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.031894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:20.044502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:20.046583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:20.050880 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5602a57f-e215-45e9-955b-8d27c768db4b tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1555 microversion: 2.26 time: 0.304411 Nov 02 13:49:20.051508 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3319/6254] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:19 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1555 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:20.141484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:20.142106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:20.152342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.153423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.153869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.154781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:20.155443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:20.156041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:20.984853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:21.003033 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f178c2e1-8ae8-4aa0-ae11-c1983230291e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.863307 Nov 02 13:49:21.004514 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2936/6255] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:20 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:21.082404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:21.083121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:21.099780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:21.102498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:21.103063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:21.106544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:21.109061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:21.109539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:21.308196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:21.320549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:21.325429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:21.326750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05accb7d-33ea-4536-93fa-146a1b946894 tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1555 microversion: 2.26 time: 0.250956 Nov 02 13:49:21.330722 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3320/6256] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:21 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:21.797411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e350c78a-cbce-4613-b12f-d44a3740adf9 req-de4af58e-b8cd-419c-b3ac-281167a946e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3931ab72-1e5a-4785-a144-a718e5939cd4", "name": "network-vif-deleted", "tag": "b35deb00-70c1-4563-a8e5-db95e618234a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:21.829553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e350c78a-cbce-4613-b12f-d44a3740adf9 req-de4af58e-b8cd-419c-b3ac-281167a946e0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:21.830329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e350c78a-cbce-4613-b12f-d44a3740adf9 req-de4af58e-b8cd-419c-b3ac-281167a946e0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:21.830833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e350c78a-cbce-4613-b12f-d44a3740adf9 req-de4af58e-b8cd-419c-b3ac-281167a946e0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:21.858756 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e350c78a-cbce-4613-b12f-d44a3740adf9 req-de4af58e-b8cd-419c-b3ac-281167a946e0 service nova] Creating event network-vif-deleted:b35deb00-70c1-4563-a8e5-db95e618234a for instance 3931ab72-1e5a-4785-a144-a718e5939cd4 on n-h1-858384-19 Nov 02 13:49:21.864758 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e350c78a-cbce-4613-b12f-d44a3740adf9 req-de4af58e-b8cd-419c-b3ac-281167a946e0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071285 Nov 02 13:49:21.865653 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2937/6257] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:22.031330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:22.032198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:22.045717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.047440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.048086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.050366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.053997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.054692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.349360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.365979 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c75acaf0-30cc-4339-ab29-8b018a0df9c7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.340113 Nov 02 13:49:22.368022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:22.372505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:22.379583 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3321/6258] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:22 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:22.402657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.404969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.405673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.407966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.408680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.409406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.528237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:22.529680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:22.530918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:22.531587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lazy-loading 'fault' on Instance uuid 3931ab72-1e5a-4785-a144-a718e5939cd4 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:22.630917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.642035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.644553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a483c3085c554d3f91e9ce7a8e50e225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97526fb343de466c89355986251ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:22.646007 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-15e5b53e-4bad-443a-8781-6feb2c6ed6ab tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 200 len: 1356 microversion: 2.26 time: 0.289383 Nov 02 13:49:22.648036 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2938/6259] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:22 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 1356 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:23.396629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:23.398173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:23.407506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.408727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.409365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.410284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.410921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.411561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.585121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:23.593821 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f6609ed-452d-4558-b686-28938c3ace8f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.201615 Nov 02 13:49:23.611402 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3322/6260] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:23 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:23.678210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:23.680301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] [instance: 3931ab72-1e5a-4785-a144-a718e5939cd4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:23.690041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.690785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.692755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.693653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:23.694284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:23.694875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:23.715623 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] HTTP exception thrown: Instance 3931ab72-1e5a-4785-a144-a718e5939cd4 could not be found. Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Request method failure captured: Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 HTTP/1.1 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnVEbCkOy3459UhlkSYqOqDkgNFAlNNtYfJLXKuIyw-dU5idjZvDOtOgPbtFm20sVKeDzlNao4B4bq9OASsoesk0xJ-787Su6a0OEHdR0xqEdfQqK5ceOEZolPhF5OT6e4T3SPUnmIpiT-Ez-kri7wY8mfABGhFgyWjjTuuBsIYuS1A Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.26 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 97526fb343de466c89355986251ce4e2 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerTagsTestJSON-923899032 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/97526fb343de466c89355986251ce4e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/97526fb343de466c89355986251ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_97526fb343de466c89355986251ce4e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/97526fb343de466c89355986251ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerTagsTestJSON-923899032 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 97526fb343de466c89355986251ce4e2 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerTagsTestJSON-923899032 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerTagsTestJSON-923899032-project Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: a483c3085c554d3f91e9ce7a8e50e225 Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerTagsTestJSON-923899032-project Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 3931ab72-1e5a-4785-a144-a718e5939cd4 could not be found. Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '3931ab72-1e5a-4785-a144-a718e5939cd4'} Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3931ab72-1e5a-4785-a144-a718e5939cd4 could not be found. Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3931ab72-1e5a-4785-a144-a718e5939cd4 could not be found. Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:23.719352 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.725047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:23.725047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:23.725047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:23.725047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:23.725047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:23.725047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3931ab72-1e5a-4785-a144-a718e5939cd4 could not be found. Nov 02 13:49:23.725047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:23.725047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] Returning 404 to user: Instance 3931ab72-1e5a-4785-a144-a718e5939cd4 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:23.725047 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-be792595-0bfb-4a4d-8694-90f2f4c93d1d tempest-ServerTagsTestJSON-923899032 tempest-ServerTagsTestJSON-923899032-project] 10.222.0.113 "GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4" status: 404 len: 111 microversion: 2.26 time: 0.052858 Nov 02 13:49:23.731397 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2939/6261] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:23 2022] GET /compute/v2.1/servers/3931ab72-1e5a-4785-a144-a718e5939cd4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:24.624008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:24.625365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:24.636676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.641042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.641715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:24.652407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:24.653171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:24.653828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:25.615567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:25.629734 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-480e85d0-5eb8-465e-b164-b4b6d1351e38 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 1.014429 Nov 02 13:49:25.646526 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3323/6262] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:24 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:25.933258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b3589942-468b-4ad8-b9b1-0a8f866b7351 req-6d7f817d-6879-4d85-9da9-bbf7ca153af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7944ff2a-3114-464d-9ecf-c287973c180c", "name": "network-vif-plugged", "status": "completed", "tag": "2c92be66-37bc-431d-9fc4-1784271237fb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:25.952012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:25.986967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b3589942-468b-4ad8-b9b1-0a8f866b7351 req-6d7f817d-6879-4d85-9da9-bbf7ca153af6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:25.987616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b3589942-468b-4ad8-b9b1-0a8f866b7351 req-6d7f817d-6879-4d85-9da9-bbf7ca153af6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:25.988069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b3589942-468b-4ad8-b9b1-0a8f866b7351 req-6d7f817d-6879-4d85-9da9-bbf7ca153af6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.018693 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b3589942-468b-4ad8-b9b1-0a8f866b7351 req-6d7f817d-6879-4d85-9da9-bbf7ca153af6 service nova] Creating event network-vif-plugged:2c92be66-37bc-431d-9fc4-1784271237fb for instance 7944ff2a-3114-464d-9ecf-c287973c180c on n-h2-858384-19 Nov 02 13:49:26.024860 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b3589942-468b-4ad8-b9b1-0a8f866b7351 req-6d7f817d-6879-4d85-9da9-bbf7ca153af6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102993 Nov 02 13:49:26.034738 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2940/6263] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:26.661722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:26.662336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:26.684421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.686007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.688279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:26.689848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:26.696377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:26.697100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:27.139489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:27.149173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-32e8ea2c-cd40-4824-8786-ad65c5aaf6b1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.491260 Nov 02 13:49:27.154378 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3324/6264] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:26 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:28.178054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:28.178779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:28.246779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.247324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.247764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.260326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:28.261326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:28.261968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:28.331904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1715733178", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "3ee32124-59d1-4dc2-8b60-60663526c01e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1619075422", "security_groups": [{"name": "tempest-secgroup-smoke-1767979898"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:28.718452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:28.728751 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d316ca20-99f0-4636-b59c-549b60c4e958 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1523 microversion: 2.1 time: 0.554022 Nov 02 13:49:28.735027 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2941/6265] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:28 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1523 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:28.782379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] validate_networks() for [('3ee32124-59d1-4dc2-8b60-60663526c01e', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:49:29.761552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:29.762170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:29.773905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.774399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.774826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:29.776298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:29.779773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:29.780496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.291800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:30.302274 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7f086767-d3af-411c-bccc-c592da3629ea tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.544870 Nov 02 13:49:30.315998 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2942/6266] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:29 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:30.347736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:30.349894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:30.382736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.383264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.383700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.384735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.384926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.390556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.774175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:30.798705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:30.799734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:30.800396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:30.802656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:30.803610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:30.807831 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a4c07f70-552c-45ed-9855-0001d4fead9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.471557 Nov 02 13:49:30.830242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.835207 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2943/6267] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:30 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:30.837829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.839097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.840881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.841542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.845548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.872389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:30.881391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for project bc97329dcfb8453795347d9e818d9d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:30.884533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:30.891482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for user 41c7ca068dba4093880183ae9b2f0935 and project bc97329dcfb8453795347d9e818d9d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:30.909154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:49:30.912670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:49:30.933903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.934817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.943994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.946192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:30.948367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:30.958852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:30.982857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4c3ef2f6-45bc-43c4-b9d4-9d935daff594 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.655745 Nov 02 13:49:30.983926 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3325/6268] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:49:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 2658 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 13:49:30.996609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f27c6408-3e39-413a-9fda-39ac7623ddbf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:30.997492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f27c6408-3e39-413a-9fda-39ac7623ddbf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:31.130118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f27c6408-3e39-413a-9fda-39ac7623ddbf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.140699 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f27c6408-3e39-413a-9fda-39ac7623ddbf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1271 microversion: 2.1 time: 0.148481 Nov 02 13:49:31.142996 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3326/6269] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:30 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:31.842966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:31.873117 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-67a17b58-be89-4052-8632-1b6cdb122531 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 1.015391 Nov 02 13:49:31.875313 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2944/6270] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:30 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:31.910117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29d202cb-bf04-419a-909b-8013f53395cc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:31.929009 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-29d202cb-bf04-419a-909b-8013f53395cc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20 has no mapping to a cell. Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29d202cb-bf04-419a-909b-8013f53395cc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20/action HTTP/1.1 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 15 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: {"os-stop": {}} Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20 has no mapping to a cell. Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20', 'body': {'os-stop': {}}} Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20 has no mapping to a cell. Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Nov 02 13:49:31.946450 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20 has no mapping to a cell. Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20 has no mapping to a cell. Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29d202cb-bf04-419a-909b-8013f53395cc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20 has no mapping to a cell. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:31.954394 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29d202cb-bf04-419a-909b-8013f53395cc tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20/action" status: 404 len: 117 microversion: 2.1 time: 0.049873 Nov 02 13:49:31.958026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:31.958656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:31.959497 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3327/6271] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:49:31 2022] POST /compute/v2.1/servers/0360d7ae-8fb3-41e1-bec7-1bb9e86d0f20/action => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:31.970043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.970600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.971152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:31.972553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:31.974469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:31.974949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:32.170054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-937e22e4-03d6-4df2-b5d9-8e5eeb5fb7c1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:32.170915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-937e22e4-03d6-4df2-b5d9-8e5eeb5fb7c1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:32.296283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-937e22e4-03d6-4df2-b5d9-8e5eeb5fb7c1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:32.305523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-937e22e4-03d6-4df2-b5d9-8e5eeb5fb7c1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1271 microversion: 2.1 time: 0.139529 Nov 02 13:49:32.308917 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3328/6272] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:32 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:33.167609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.197813 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eed26bff-5777-4c53-9a51-60c18fe5d8d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 1.242931 Nov 02 13:49:33.201574 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2945/6273] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:31 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:33.248295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.249390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.268513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.269200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.269668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.270419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.270899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.271386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.339397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.340068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.347788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:33.356838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.357348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.364196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.366037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.366037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.371993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.583948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.602201 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-47dc6123-af2c-4213-9498-eada78606d72 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1323 microversion: 2.1 time: 0.268334 Nov 02 13:49:33.605676 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2946/6274] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1323 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:33.661556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:33.685292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed35a35f-8a85-4dce-8ce7-4dbc093df97c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.441592 Nov 02 13:49:33.687848 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3329/6275] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:33.727017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2d310f0-ea68-4036-bc14-35f49e036d97 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:33.727017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b2d310f0-ea68-4036-bc14-35f49e036d97 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 71951348-4b81-45d8-b231-96e93e0ac951] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.736782 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b2d310f0-ea68-4036-bc14-35f49e036d97 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 71951348-4b81-45d8-b231-96e93e0ac951 could not be found. Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2d310f0-ea68-4036-bc14-35f49e036d97 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/71951348-4b81-45d8-b231-96e93e0ac951/action HTTP/1.1 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 15 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: {"suspend": {}} Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 71951348-4b81-45d8-b231-96e93e0ac951 could not be found. Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '71951348-4b81-45d8-b231-96e93e0ac951', 'body': {'suspend': {}}} Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71951348-4b81-45d8-b231-96e93e0ac951 could not be found. Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71951348-4b81-45d8-b231-96e93e0ac951 could not be found. Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:33.758481 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:33.764502 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:33.764502 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:33.764502 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71951348-4b81-45d8-b231-96e93e0ac951 could not be found. Nov 02 13:49:33.764502 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:33.764502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2d310f0-ea68-4036-bc14-35f49e036d97 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 71951348-4b81-45d8-b231-96e93e0ac951 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:33.764502 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2d310f0-ea68-4036-bc14-35f49e036d97 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/71951348-4b81-45d8-b231-96e93e0ac951/action" status: 404 len: 111 microversion: 2.1 time: 0.056684 Nov 02 13:49:33.777122 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2947/6276] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:49:33 2022] POST /compute/v2.1/servers/71951348-4b81-45d8-b231-96e93e0ac951/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:33.799519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:33.800825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:33.811423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.813091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.813977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:33.815295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:33.816106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:33.816800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.176146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.193085 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f663c1a-5836-4830-ad63-9cecfb9c57c0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.410708 Nov 02 13:49:34.194014 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3330/6277] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:33 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:34.224663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:34.225902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:34.244329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.244329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.244708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.250951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.252105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.253544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.636713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:34.638166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:34.656463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.665386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.666600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.668528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:34.671986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:34.672632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:34.811849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:34.814160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:34.827944 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-202e7c57-c811-4fef-b5eb-851ffdc412d9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1329 microversion: 2.1 time: 0.195970 Nov 02 13:49:34.828570 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3331/6278] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:34 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1329 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:35.392679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:35.409659 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2b3a18b2-10a4-4ef3-a360-37bbb8a9cdbd tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 1.187437 Nov 02 13:49:35.410303 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2948/6279] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:34 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:35.436157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:35.436615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:35.443791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:35.445426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.446714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.447910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.448825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.450315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.451036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.519718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lazy-loading 'flavor' on Instance uuid 7944ff2a-3114-464d-9ecf-c287973c180c {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:35.698499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-220510812", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": "none"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:35.725076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d4060d07-0746-4674-aa9a-4d46ffdf411b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 202 len: 0 microversion: 2.1 time: 0.293049 Nov 02 13:49:35.726829 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3332/6280] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:49:35 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:49:35.739642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:35.740363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:35.754981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.756427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.757054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.758095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.758996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.759788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.870603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:35.871557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:35.872263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:35.872909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:35.873540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:35.891889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.892766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.893513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:35.894609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:35.906703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:35.907477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.003263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Getting quotas for project 9747de9b23cc4e23b4b543bfbb9f6d02. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:36.003780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.018500 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88dc4b52-40a1-4be5-9fcb-dc3b3725192e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1518 microversion: 2.1 time: 0.284929 Nov 02 13:49:36.022052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Getting quotas for user 6eab176fd36f4471a3d59d07c1b7c94d and project 9747de9b23cc4e23b4b543bfbb9f6d02. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:36.022902 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3333/6281] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:35 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1518 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:36.037281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:36.038575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:36.054847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.056990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:49:36.058772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.060705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:49:36.061562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.062489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.065590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.069059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.181177 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f31b95a6-9cf8-4a6e-ab7c-017fc016401a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.47 time: 0.717184 Nov 02 13:49:36.183578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2949/6282] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:49:35 2022] POST /compute/v2.1/servers => generated 382 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:49:36.207164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2cd04773-7c20-4c89-a923-d67babf98a58 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:36.217814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2cd04773-7c20-4c89-a923-d67babf98a58 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:36.237207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.253455 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ff2b29c4-e3ca-4a79-ab34-ecb0c91f56d3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1329 microversion: 2.1 time: 0.225285 Nov 02 13:49:36.254208 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3334/6283] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:36 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1329 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:36.411317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2cd04773-7c20-4c89-a923-d67babf98a58 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.435037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2cd04773-7c20-4c89-a923-d67babf98a58 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.449965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2cd04773-7c20-4c89-a923-d67babf98a58 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:36.455440 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2cd04773-7c20-4c89-a923-d67babf98a58 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f" status: 200 len: 1280 microversion: 2.47 time: 0.260564 Nov 02 13:49:36.456087 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2950/6284] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:36 2022] GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f => generated 1280 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:36.575140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-996218608", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": "none"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:36.743073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:36.745310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:36.746149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:36.746842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:36.747577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:36.779426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.779944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.780646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.781563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:36.782201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:36.796273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:36.860996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Getting quotas for project 9747de9b23cc4e23b4b543bfbb9f6d02. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:49:36.876636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Getting quotas for user 6eab176fd36f4471a3d59d07c1b7c94d and project 9747de9b23cc4e23b4b543bfbb9f6d02. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:49:36.898882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:49:36.902392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:49:36.985862 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c9de7cf3-3349-45b9-8bf4-30dbf59b4b39 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.47 time: 0.414428 Nov 02 13:49:36.987327 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3335/6285] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:49:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:49:37.006503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-680129b7-1123-443a-a56a-8fc2f9a50681 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:37.013332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-680129b7-1123-443a-a56a-8fc2f9a50681 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.069116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:37.069756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.147983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.150810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.156811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.158045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.158688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.159347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.166477 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-680129b7-1123-443a-a56a-8fc2f9a50681 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "PUT /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 994 microversion: 2.47 time: 0.162400 Nov 02 13:49:37.170227 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2951/6286] 10.222.0.113 () {62 vars in 1302 bytes} [Wed Nov 2 13:49:36 2022] PUT /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 994 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:49:37.201224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7f070f6e-3714-4e3e-809b-a3a8bcd99e8e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:37.202269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7f070f6e-3714-4e3e-809b-a3a8bcd99e8e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.356088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7f070f6e-3714-4e3e-809b-a3a8bcd99e8e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.373279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7f070f6e-3714-4e3e-809b-a3a8bcd99e8e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.378172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7f070f6e-3714-4e3e-809b-a3a8bcd99e8e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.381690 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7f070f6e-3714-4e3e-809b-a3a8bcd99e8e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1280 microversion: 2.47 time: 0.182858 Nov 02 13:49:37.407201 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2952/6287] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:37 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:49:37.415261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:37.460894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.473674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.474552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.475282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.476984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.477684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.493402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.756435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:37.764818 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf57ce22-ce99-43fd-9362-ac20dc7c5fc2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1501 microversion: 2.1 time: 0.716215 Nov 02 13:49:37.771733 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3336/6288] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:37 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1501 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:37.812686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:37.813590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.825200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.827596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.828295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.829726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.831596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.833137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.891871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lazy-loading 'flavor' on Instance uuid 7944ff2a-3114-464d-9ecf-c287973c180c {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:49:37.918090 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Cannot 'suspend' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state suspended Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action HTTP/1.1 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 15 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: {"suspend": {}} Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot 'suspend' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state suspended Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c', 'body': {'suspend': {}}} Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7944ff2a-3114-464d-9ecf-c287973c180c in vm_state suspended. Cannot suspend while the instance is in this state. Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Nov 02 13:49:37.924893 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state suspended Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state suspended Nov 02 13:49:37.930700 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:37.933432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 409 to user: Cannot 'suspend' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state suspended {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:37.934708 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6030c72f-f85e-43f7-b710-854653578bb4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 409 len: 148 microversion: 2.1 time: 0.147321 Nov 02 13:49:37.940115 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3337/6289] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:49:37 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 148 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:49:37.945936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1e931bf-f744-4aa5-9848-1ccd479cef9a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:37.946785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1e931bf-f744-4aa5-9848-1ccd479cef9a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:37.954897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1e931bf-f744-4aa5-9848-1ccd479cef9a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.955895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1e931bf-f744-4aa5-9848-1ccd479cef9a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.956742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1e931bf-f744-4aa5-9848-1ccd479cef9a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:37.958201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1e931bf-f744-4aa5-9848-1ccd479cef9a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:37.958956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1e931bf-f744-4aa5-9848-1ccd479cef9a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:37.959593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1e931bf-f744-4aa5-9848-1ccd479cef9a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.174070 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1e931bf-f744-4aa5-9848-1ccd479cef9a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 202 len: 0 microversion: 2.1 time: 0.232343 Nov 02 13:49:38.175009 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3338/6290] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:49:37 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:49:38.186594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:38.191505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:38.211395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.213862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.216358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.218684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.219403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.221935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.627391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.639197 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd488dba-3312-4023-9591-3ad799bc7344 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1507 microversion: 2.1 time: 0.457526 Nov 02 13:49:38.640975 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3339/6291] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:38 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:38.646448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:38.647949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:38.656113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.656603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.657125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.658352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:38.658352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:38.658768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:38.786801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.810229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.821477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.822654 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dd50f4d6-410f-4b46-93f3-77f15e8ec70e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1284 microversion: 2.47 time: 0.180522 Nov 02 13:49:38.823266 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3340/6292] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:38 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:38.906246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:38.920235 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a9da59d9-ded9-4417-a552-25f33b32a9b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 1.508856 Nov 02 13:49:38.922442 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2953/6293] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:37 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:39.673549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.674488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.691848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.692376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.692795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.693493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.694001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.695039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.883325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:39.883944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:39.902257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.910105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.910803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.911396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:39.912271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:39.912271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:39.999909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.020903 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3d6d0dd3-7017-4574-a789-56152f6b3fd8 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1507 microversion: 2.1 time: 0.351215 Nov 02 13:49:40.021815 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3341/6294] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:39 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:40.034319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:40.035700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:40.046350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.048476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.049235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.050252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.050890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.051618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.081630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.096267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.098016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.099203 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2d4d70f6-678b-4ad3-98b7-0ae65ae47c67 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1340 microversion: 2.47 time: 0.219922 Nov 02 13:49:40.099767 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2954/6295] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:39 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1340 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:40.273052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:40.286981 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c48f0078-5e95-4f08-9727-b98b289f0d1b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.260172 Nov 02 13:49:40.288414 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3342/6296] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:40 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:40.911021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1fddd043-fe28-4b6d-b9fc-9959d9cd362a req-756e210f-608f-46f0-a3c7-fb59c816dcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283dce09-eb44-4fb0-be95-77eb073849fb", "tag": "13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:40.939878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1fddd043-fe28-4b6d-b9fc-9959d9cd362a req-756e210f-608f-46f0-a3c7-fb59c816dcb9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:40.940713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1fddd043-fe28-4b6d-b9fc-9959d9cd362a req-756e210f-608f-46f0-a3c7-fb59c816dcb9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:40.942252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1fddd043-fe28-4b6d-b9fc-9959d9cd362a req-756e210f-608f-46f0-a3c7-fb59c816dcb9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:40.973510 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1fddd043-fe28-4b6d-b9fc-9959d9cd362a req-756e210f-608f-46f0-a3c7-fb59c816dcb9 service nova] Creating event network-changed:13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3 for instance 283dce09-eb44-4fb0-be95-77eb073849fb on n-h1-858384-19 Nov 02 13:49:40.989116 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1fddd043-fe28-4b6d-b9fc-9959d9cd362a req-756e210f-608f-46f0-a3c7-fb59c816dcb9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233238 Nov 02 13:49:40.993148 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2955/6297] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:41.059576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:41.060358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.066882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.067655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.068273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.069331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.069660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.070385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.144551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:41.146794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.169652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.170390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.171033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.172052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.172677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.173318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.284427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.296176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.299414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.301369 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-39e1baca-51dc-4801-99ed-c617adcb6231 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1340 microversion: 2.47 time: 0.171476 Nov 02 13:49:41.302136 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2956/6298] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:41 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1340 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:41.311333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:41.312247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:41.331811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.337025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.339051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.344936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:41.345443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:41.350745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:41.376591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.388739 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e2002004-389b-4bf2-bff8-00716ecc7966 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1507 microversion: 2.1 time: 0.342968 Nov 02 13:49:41.392154 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3343/6299] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:41 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:41.652137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:41.657422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:41.668165 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d5ca86b-45af-4ee1-b8f4-b7d875f26e8b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.362155 Nov 02 13:49:41.672110 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2957/6300] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:41 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:42.364782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.380094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:42.407895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.424450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.440280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:42.443747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.445006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.446695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.460445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.465759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.481802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.482657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.491533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.492464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.492965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.493415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.681698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.725718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.735333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.741894 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3868c7d-8d96-4f27-8357-e2fd75bafdf8 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1350 microversion: 2.47 time: 0.410618 Nov 02 13:49:42.763566 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3344/6301] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:42 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1350 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:42.778024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:42.779862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:42.800503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.801434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.802262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.807242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:42.808194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:42.808822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:42.894343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:42.918288 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b733424-2507-46ef-8079-9a917febd8e2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1507 microversion: 2.1 time: 0.501137 Nov 02 13:49:42.921338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2958/6302] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:42 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:43.144189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.154768 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-02cc1f3c-ee9b-4959-bcea-aed913d1ae7e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.389754 Nov 02 13:49:43.157116 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3345/6303] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:42 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:43.783803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:43.784425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:43.797566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.798322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.798957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.806941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.807781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.808435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.930405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.945896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:43.946542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:43.960694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.963729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:43.966654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.968408 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8aa9e63f-845f-4b00-8424-344a0e607d56 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1338 microversion: 2.47 time: 0.188664 Nov 02 13:49:43.969613 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2959/6304] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:43 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1338 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:43.983739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.984352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:43.985139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:43.985619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:43.986056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.033263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:44.191753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:44.192815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:44.200023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.207077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.207838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.209324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:44.218524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:44.219095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:44.641258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:44.655388 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c4044e50-e7bd-4db5-8ee9-1541c6912ca6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.467366 Nov 02 13:49:44.657153 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2960/6305] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:44 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:44.687980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:44.706662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e232448-e887-409f-b783-c328a5f8187b tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1507 microversion: 2.1 time: 0.764613 Nov 02 13:49:44.727179 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3346/6306] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:43 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1507 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:45.002068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:45.003512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:45.019405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.020171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.020795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.023614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.031483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.032373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.256067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:45.300616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:45.302242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:45.305797 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d25d264d-f092-4539-84a8-21c80002d5dd tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1338 microversion: 2.47 time: 0.307046 Nov 02 13:49:45.307101 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2961/6307] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:44 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1338 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:49:45.685054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:45.685676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:45.700870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.702801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.703340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.707595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.708270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.708782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.747020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:45.747999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:45.761685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.766155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.766882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.767862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:45.771491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:45.773915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:45.939933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:45.998521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.025076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eebc2e5b-f558-4db9-a5f6-9523eac8c95e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.344480 Nov 02 13:49:46.026425 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3347/6308] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:45 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:46.305191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.317567 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-59e89b72-f65b-4d0c-9fa0-08e9d6297c3e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1507 microversion: 2.1 time: 0.575262 Nov 02 13:49:46.320281 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2962/6309] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:45 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1507 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:46.332805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:46.333431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:46.350890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.351685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.354261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.360125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:46.361391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:46.362596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:46.569265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.585999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.589157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:46.591282 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44899294-7146-463b-b901-4d00fdc3302a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1338 microversion: 2.47 time: 0.262320 Nov 02 13:49:46.592626 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3348/6310] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:46 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1338 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:47.058347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:47.059503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:47.083775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.085782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.091794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.094172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.095290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.096653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.342850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:47.344370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:47.354441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:47.359722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=16 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:47.361605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.366824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.367513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.369240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.370011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.370761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.372086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:47.541133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.563172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf3b9769-34a5-4513-9a3c-ebbb73f1c241 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.517690 Nov 02 13:49:47.563782 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2963/6311] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:47 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:47.623405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:47.625954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:47.639535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.642313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.642313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.642313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.642313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.642313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.843013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.857197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.859163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.862625 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-653368f4-5c8c-49be-9476-321682736f09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1359 microversion: 2.47 time: 0.241150 Nov 02 13:49:47.867297 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2964/6312] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:47 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:49:47.894668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:47.898204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:47.912551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.916893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.917684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.921935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:47.922673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:47.923361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:47.953060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:47.963561 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e972c8ea-fd31-489d-b2d7-bd8f01b86b9f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.624528 Nov 02 13:49:47.979141 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3349/6313] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:47 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:47.994173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:47.995595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.003704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.019639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.023326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.025729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.031278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.034920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.103304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:49:48.103839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:49:48.104330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:49:48.104742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:49:48.105467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:49:48.263187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.277132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.277741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.278387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.279256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.280034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.280721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.351836 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5177b967-f688-4893-bb97-e0236494d08a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "POST /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd/action" status: 202 len: 1081 microversion: 2.47 time: 0.461293 Nov 02 13:49:48.354170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.355169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2965/6314] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:49:47 2022] POST /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd/action => generated 1081 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Nov 02 13:49:48.387732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:48.389149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.393874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1f5149c-da57-47f5-a7fd-d325ac28f094 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.405097 Nov 02 13:49:48.398858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.400467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.401700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.402692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.403468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.404286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.432297 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3350/6315] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:47 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:48.445368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d090a187-5151-44e2-aa0a-98d3cdbd3ec1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:48.445931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d090a187-5151-44e2-aa0a-98d3cdbd3ec1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: d9247560-9b15-4d4c-b025-628e28b6d2de] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.464590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-d090a187-5151-44e2-aa0a-98d3cdbd3ec1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance d9247560-9b15-4d4c-b025-628e28b6d2de could not be found. Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d090a187-5151-44e2-aa0a-98d3cdbd3ec1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/d9247560-9b15-4d4c-b025-628e28b6d2de/action HTTP/1.1 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 15 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: {"unpause": {}} Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance d9247560-9b15-4d4c-b025-628e28b6d2de could not be found. Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'd9247560-9b15-4d4c-b025-628e28b6d2de', 'body': {'unpause': {}}} Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9247560-9b15-4d4c-b025-628e28b6d2de could not be found. Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9247560-9b15-4d4c-b025-628e28b6d2de could not be found. Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:48.466546 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:48.472246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:48.472246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:48.472246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9247560-9b15-4d4c-b025-628e28b6d2de could not be found. Nov 02 13:49:48.472246 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:48.474495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d090a187-5151-44e2-aa0a-98d3cdbd3ec1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance d9247560-9b15-4d4c-b025-628e28b6d2de could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:48.475720 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d090a187-5151-44e2-aa0a-98d3cdbd3ec1 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/d9247560-9b15-4d4c-b025-628e28b6d2de/action" status: 404 len: 111 microversion: 2.1 time: 0.041959 Nov 02 13:49:48.476617 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3351/6316] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:49:48 2022] POST /compute/v2.1/servers/d9247560-9b15-4d4c-b025-628e28b6d2de/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:48.496798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:48.497734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.515965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.516632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.519798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.520977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.521743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.522455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.572819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.586229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.601265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:48.604518 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eebe4422-65da-4c9b-ad98-be58a03490b9 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.221703 Nov 02 13:49:48.605136 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2966/6317] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:48 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:48.614977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:48.620496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:48.634939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.636457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.642120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.646255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:48.646968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:48.647655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:48.988820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.019564 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3aecf0e-639c-4b42-9552-5b23a94b6310 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.409581 Nov 02 13:49:49.021089 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2967/6318] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:48 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:49.033951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.046688 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34d9178b-ee6e-4e01-9436-3d5b65fae090 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.561923 Nov 02 13:49:49.050467 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3352/6319] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:48 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:49.076612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.077803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.086249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.087640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.088264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.089313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.089987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.090643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.297299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.307007 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-71dad6f8-3613-4eb1-90ac-be3654437595 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.234034 Nov 02 13:49:49.312471 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2968/6320] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:49 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:49.336328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:49.337176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.345024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.345773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.346202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.346918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.347421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.348125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.386754 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Cannot 'unpause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action HTTP/1.1 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 15 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: {"unpause": {}} Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: exception: Cannot 'unpause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c', 'body': {'unpause': {}}} Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7944ff2a-3114-464d-9ecf-c287973c180c in vm_state active. Cannot unpause while the instance is in this state. Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:49.388272 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:49.396984 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:49.396984 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:49.396984 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:49.396984 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:49:49.396984 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:49.396984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 409 to user: Cannot 'unpause' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:49.396984 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0fc624d-cd0f-45b3-a644-cc03aebcadb2 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 409 len: 145 microversion: 2.1 time: 0.060045 Nov 02 13:49:49.396984 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3353/6321] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:49:49 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 145 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:49:49.402551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.403225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.420245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.420745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.421194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.421915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.422590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.422812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.645387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.646155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.654123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.658462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.660227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.661199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.662758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.663542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.664232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.664391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-10a923e5-9235-4177-8aec-72c5823c2d58 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.265785 Nov 02 13:49:49.665945 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2969/6322] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:49 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:49.699905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:49.700742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.716013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.716757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.717424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.718833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:49.720172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:49.721358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:49.867725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.884609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.886367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.887738 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-28ed1be0-ed6c-4a17-b5d9-c2c358084cca tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.253776 Nov 02 13:49:49.888340 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3354/6323] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:49 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:49.956637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:49.965954 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee0869b6-fa91-4c1f-a9e4-20d421d1b8ff tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.271115 Nov 02 13:49:49.967547 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2970/6324] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:49 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:49.990368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8405ef2-2717-499c-ab46-3032dc0f865c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:49.991292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a8405ef2-2717-499c-ab46-3032dc0f865c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: e9ae28da-7c1e-4539-9bcb-a4c8653c0fef] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:49.998062 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-a8405ef2-2717-499c-ab46-3032dc0f865c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance e9ae28da-7c1e-4539-9bcb-a4c8653c0fef could not be found. Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8405ef2-2717-499c-ab46-3032dc0f865c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/e9ae28da-7c1e-4539-9bcb-a4c8653c0fef/action HTTP/1.1 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 18 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: {"unshelve": null} Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e9ae28da-7c1e-4539-9bcb-a4c8653c0fef could not be found. Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e9ae28da-7c1e-4539-9bcb-a4c8653c0fef', 'body': {'unshelve': None}} Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ae28da-7c1e-4539-9bcb-a4c8653c0fef could not be found. Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ae28da-7c1e-4539-9bcb-a4c8653c0fef could not be found. Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.000136 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ae28da-7c1e-4539-9bcb-a4c8653c0fef could not be found. Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8405ef2-2717-499c-ab46-3032dc0f865c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance e9ae28da-7c1e-4539-9bcb-a4c8653c0fef could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8405ef2-2717-499c-ab46-3032dc0f865c tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/e9ae28da-7c1e-4539-9bcb-a4c8653c0fef/action" status: 404 len: 111 microversion: 2.1 time: 0.016387 Nov 02 13:49:50.006983 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3355/6325] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:49:49 2022] POST /compute/v2.1/servers/e9ae28da-7c1e-4539-9bcb-a4c8653c0fef/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:50.013562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:50.014260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:50.025571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.026603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.026976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.030558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.031214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.031782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.052289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:50.052907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:50.060440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.060937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.061380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.062411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.062881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.063380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.335254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.355697 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dfb432c0-bd62-4be6-9dab-a8fb0c0b58ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.303127 Nov 02 13:49:50.379871 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3356/6326] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:50 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:50.407600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:50.417853 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17eb3234-9918-448f-b878-0612029525f9 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.408924 Nov 02 13:49:50.422087 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2971/6327] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:50 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:50.447431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:50.448070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:50.460883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.461388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.461840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.463191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.463663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.464105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.920759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:50.921395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:50.931417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.931932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.932384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.933118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:50.933582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:50.934019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:50.984301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:51.065473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.086709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.088576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.090748 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0a2acb9-9364-4498-8c64-69fe996f2f76 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.174126 Nov 02 13:49:51.091352 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2972/6328] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:50 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:49:51.309505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.322173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97ad32b6-893a-4ade-a42f-15a038b8dd3a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.879173 Nov 02 13:49:51.325173 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3357/6329] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:50 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:51.354534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:51.355825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:51.363267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.364256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.364968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.366206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.366890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.367562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.385560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:51.386691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:51.399001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.401264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.401969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.403425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.405261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.405957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.433594 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Cannot 'unshelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action HTTP/1.1 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 18 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: {"unshelve": null} Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: exception: Cannot 'unshelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c', 'body': {'unshelve': None}} Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7944ff2a-3114-464d-9ecf-c287973c180c in vm_state active. Cannot unshelve while the instance is in this state. Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 13:49:51.436423 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 409 to user: Cannot 'unshelve' instance 7944ff2a-3114-464d-9ecf-c287973c180c while it is in vm_state active {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:51.441636 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f235fd19-6065-4b8f-98de-6ee74c1464aa tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action" status: 409 len: 146 microversion: 2.1 time: 0.089973 Nov 02 13:49:51.445314 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2973/6330] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:49:51 2022] POST /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c/action => generated 146 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 13:49:51.457056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:51.457838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:51.474230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.474889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.477186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.483053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.483585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.484141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.691024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.702685 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7dd8d8c4-d8c5-4be8-b894-594049e74cf7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.258532 Nov 02 13:49:51.705258 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2974/6331] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:51 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:51.732731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:51.733355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:51.739749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.740480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.741092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.742205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.742855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.744646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.800682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:51.813473 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-974ace1c-6005-4f08-ac56-d3f50bdd3ec5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.433624 Nov 02 13:49:51.814176 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3358/6332] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:51 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:51.823719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a7fae9dc-4dcb-4f7b-b175-09d44a2d89ab req-7656903c-9872-4ebf-8b3a-5f7d21623e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283dce09-eb44-4fb0-be95-77eb073849fb", "name": "network-vif-plugged", "status": "completed", "tag": "13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:51.834621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a7fae9dc-4dcb-4f7b-b175-09d44a2d89ab req-7656903c-9872-4ebf-8b3a-5f7d21623e85 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:51.835103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a7fae9dc-4dcb-4f7b-b175-09d44a2d89ab req-7656903c-9872-4ebf-8b3a-5f7d21623e85 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:51.835560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a7fae9dc-4dcb-4f7b-b175-09d44a2d89ab req-7656903c-9872-4ebf-8b3a-5f7d21623e85 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:51.855694 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a7fae9dc-4dcb-4f7b-b175-09d44a2d89ab req-7656903c-9872-4ebf-8b3a-5f7d21623e85 service nova] Creating event network-vif-plugged:13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3 for instance 283dce09-eb44-4fb0-be95-77eb073849fb on n-h1-858384-19 Nov 02 13:49:51.865290 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a7fae9dc-4dcb-4f7b-b175-09d44a2d89ab req-7656903c-9872-4ebf-8b3a-5f7d21623e85 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049212 Nov 02 13:49:51.865912 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3359/6333] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:49:52.042616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.050968 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57cd69ad-40f1-4152-82cd-8bea51991c35 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.323472 Nov 02 13:49:52.068163 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2975/6334] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:51 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:52.079543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01ac6180-e5d8-4512-abec-04c4f3f1190e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-272658178_updated"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:52.082525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01ac6180-e5d8-4512-abec-04c4f3f1190e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 59b67eb7-b3d4-497a-a255-242fd876595a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.098549 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-01ac6180-e5d8-4512-abec-04c4f3f1190e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 59b67eb7-b3d4-497a-a255-242fd876595a could not be found. Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01ac6180-e5d8-4512-abec-04c4f3f1190e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/servers/59b67eb7-b3d4-497a-a255-242fd876595a HTTP/1.1 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 80 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-272658178_updated"}} Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 59b67eb7-b3d4-497a-a255-242fd876595a could not be found. Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '59b67eb7-b3d4-497a-a255-242fd876595a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-272658178_updated'}}} Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59b67eb7-b3d4-497a-a255-242fd876595a could not be found. Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 13:49:52.100755 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59b67eb7-b3d4-497a-a255-242fd876595a could not be found. Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59b67eb7-b3d4-497a-a255-242fd876595a could not be found. Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01ac6180-e5d8-4512-abec-04c4f3f1190e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 59b67eb7-b3d4-497a-a255-242fd876595a could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:52.108204 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01ac6180-e5d8-4512-abec-04c4f3f1190e tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "PUT /compute/v2.1/servers/59b67eb7-b3d4-497a-a255-242fd876595a" status: 404 len: 111 microversion: 2.1 time: 0.029126 Nov 02 13:49:52.113185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.113805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.122131 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3360/6335] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:49:52 2022] PUT /compute/v2.1/servers/59b67eb7-b3d4-497a-a255-242fd876595a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:49:52.130057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.130551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.130988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.131734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.132187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.137248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.137870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.146531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.167169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.179763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.181621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.183168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.184273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.185851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.390689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.405651 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d026d90-0a56-4c42-817b-4b3f9e75b788 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.295338 Nov 02 13:49:52.407718 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2976/6336] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:52 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:52.429547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.442263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.445244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.452484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.454618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.456692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.459306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.459854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.461400 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-056cc8f1-112c-4854-8cea-fdc82d7b5433 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.338155 Nov 02 13:49:52.462318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.463447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.463989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.466925 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3361/6337] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:52 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:52.645733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:52.654133 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7bbfff1d-f59f-4a9f-b06e-112aa20b5468 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.220273 Nov 02 13:49:52.675183 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2977/6338] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:52 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:52.682207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7638fde6-41df-470e-8242-c6687459124a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7638fde6-41df-470e-8242-c6687459124a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c HTTP/1.1 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 280 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.686162 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:52.690764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7638fde6-41df-470e-8242-c6687459124a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:52.699173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7638fde6-41df-470e-8242-c6687459124a tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "PUT /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 400 len: 619 microversion: 2.1 time: 0.016228 Nov 02 13:49:52.699173 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3362/6339] 10.222.0.113 () {60 vars in 1262 bytes} [Wed Nov 2 13:49:52 2022] PUT /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:52.702432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.703402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.721568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.722276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.722895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.724014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.725145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.725750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.841022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:52.841646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:52.886748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.887726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.888377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.889340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:52.889980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:52.890621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:52.995542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:53.011828 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3a36ee8-e9a6-4977-8f21-6de95a5a8c90 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.313116 Nov 02 13:49:53.013020 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2978/6340] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:52 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:53.037903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:53.038607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:53.045226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.045952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.046587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.047487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.048107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.048698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.215510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:53.231164 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9946a4e5-e9da-42b2-9f5c-a48ffa8ea5c5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1397 microversion: 2.1 time: 0.396591 Nov 02 13:49:53.232755 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3363/6341] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:52 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1397 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:53.276126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:53.285083 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-58f07409-140e-4dc7-8256-421bb0a50264 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.250980 Nov 02 13:49:53.285679 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2979/6342] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:53 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:49:53.316986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7cffb658-2737-43bb-beee-e4ccb2b61cab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7cffb658-2737-43bb-beee-e4ccb2b61cab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c HTTP/1.1 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 24 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": ""}} Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c', 'body': {'server': {'name': ''}}} Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise error Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi '' Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 13:49:53.321902 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7cffb658-2737-43bb-beee-e4ccb2b61cab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:49:53.327605 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7cffb658-2737-43bb-beee-e4ccb2b61cab tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "PUT /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 400 len: 108 microversion: 2.1 time: 0.017843 Nov 02 13:49:53.331904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3364/6343] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:49:53 2022] PUT /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:49:53.337276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:53.338356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:53.345673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.346581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.347434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.348509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.349154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.349898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.500505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:53.501462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:53.542765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.546042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.546585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.559983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:53.560513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:53.561597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:53.652082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:53.661596 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2bc7eb81-72fd-4b92-a734-c8445c722c3f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1510 microversion: 2.1 time: 0.328234 Nov 02 13:49:53.668991 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2980/6344] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:53 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:53.755332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:53.777689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:53.783034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:53.789691 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f14be037-e5fd-4cac-9851-c3c1ea09ab6d tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.294779 Nov 02 13:49:53.792341 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3365/6345] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:53 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:54.257462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:54.258329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:54.276014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.279785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.280258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.281132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.281467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.281899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.633679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:54.647849 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b9278327-70f6-4dab-90d8-d149fe521815 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1570 microversion: 2.1 time: 0.394351 Nov 02 13:49:54.648461 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2981/6346] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:54 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1570 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:54.675775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:54.677011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:54.687497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.688285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.693281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.694697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.695370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.695980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.822326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:54.823827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:54.837637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:49:54.843911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.848232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.849053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:54.850015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:54.853270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:54.854181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:55.094006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.130043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.139276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.144981 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-659572a6-8b1a-4253-81f8-cd1f05a4eac3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.324255 Nov 02 13:49:55.148423 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2982/6347] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:54 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:55.493913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:55.515798 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca8fd6de-da9f-4e17-9507-22b2a5eddd42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1570 microversion: 2.1 time: 0.844184 Nov 02 13:49:55.518333 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3366/6348] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:54 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1570 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:49:56.184826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:56.186975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:56.213497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.214362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.215095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.216140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:56.216917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:56.217637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:56.429585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.447057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.449354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:56.452909 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dbb17e4a-c305-4783-bb58-649188dca76b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.281380 Nov 02 13:49:56.461188 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2983/6349] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:56 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:57.486533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:57.487405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:57.503672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.505815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.507052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.509252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:57.510490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:57.511234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:57.747693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.766760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.773828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:57.776067 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8dcac07-4da4-4665-9ad5-43c91722b112 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.293701 Nov 02 13:49:57.806000 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3367/6350] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:57 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:58.813958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:58.814582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:58.841404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.842489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.843471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:58.846444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:58.849486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:58.852039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.124025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.178266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.185921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:49:59.195795 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-55de1270-7d09-4ab2-b362-dc8d3a93ab09 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.386998 Nov 02 13:49:59.199559 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2984/6351] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:49:58 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:49:59.439473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:49:59.440196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:49:59.464539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6b166b69-e12e-423d-b8ee-f949afb53c5f req-7b2b57b1-dbdd-4144-a8b2-42c96f9ac7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283dce09-eb44-4fb0-be95-77eb073849fb", "tag": "13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:49:59.477902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.489301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.491357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.502594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.504765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.512067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.522871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6b166b69-e12e-423d-b8ee-f949afb53c5f req-7b2b57b1-dbdd-4144-a8b2-42c96f9ac7f0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:49:59.523595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6b166b69-e12e-423d-b8ee-f949afb53c5f req-7b2b57b1-dbdd-4144-a8b2-42c96f9ac7f0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:49:59.525209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6b166b69-e12e-423d-b8ee-f949afb53c5f req-7b2b57b1-dbdd-4144-a8b2-42c96f9ac7f0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:49:59.614486 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6b166b69-e12e-423d-b8ee-f949afb53c5f req-7b2b57b1-dbdd-4144-a8b2-42c96f9ac7f0 service nova] Creating event network-changed:13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3 for instance 283dce09-eb44-4fb0-be95-77eb073849fb on n-h1-858384-19 Nov 02 13:49:59.632041 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6b166b69-e12e-423d-b8ee-f949afb53c5f req-7b2b57b1-dbdd-4144-a8b2-42c96f9ac7f0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172348 Nov 02 13:49:59.640055 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2985/6352] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:00.143420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.152370 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87d8d889-58e7-4942-9329-3d8e8b97d03c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1570 microversion: 2.1 time: 0.717253 Nov 02 13:50:00.152968 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3368/6353] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:49:59 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1570 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:00.229372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:00.230060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:00.256506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.257012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.257463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.265510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:00.266147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:00.266611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:00.853694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.866347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.876841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:00.879336 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5aec7729-2127-40d7-8f4f-d739b2fb0d02 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.656145 Nov 02 13:50:00.897430 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2986/6354] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:00 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:01.915310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:01.916206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:01.931402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:01.932014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:01.932464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:01.933662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:01.935487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:01.935968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:01.975372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:02.061799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:02.079505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:02.087429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:02.089433 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-03c6e06d-c704-4c67-bfd9-224f61bc9ba5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.178674 Nov 02 13:50:02.091190 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3369/6355] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:01 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:02.880363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:02.881475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:02.893967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.894776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.895458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.896401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.897054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.897675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.915786 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa HTTP/1.1 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'a534ecf4-5854-48e1-895c-118db7e315fa'} Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:02.917819 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:02.923293 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.925843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:02.926900 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90548bb5-d541-40dc-9322-861d95a4476f tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 404 len: 111 microversion: 2.1 time: 0.050831 Nov 02 13:50:02.928051 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2987/6356] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:50:02 2022] DELETE /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:50:02.937334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:02.937962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: a534ecf4-5854-48e1-895c-118db7e315fa] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:02.947282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.947790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.948243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.949042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:02.949507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:02.950003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:02.989667 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa HTTP/1.1 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a534ecf4-5854-48e1-895c-118db7e315fa'} Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:02.996323 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance a534ecf4-5854-48e1-895c-118db7e315fa could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ae1e036-4304-4e0a-b2b3-bdd5db583f65 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa" status: 404 len: 111 microversion: 2.1 time: 0.065428 Nov 02 13:50:03.002532 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3370/6357] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:50:02 2022] GET /compute/v2.1/servers/a534ecf4-5854-48e1-895c-118db7e315fa => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:50:03.009524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:03.010313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:03.018794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.019543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.020160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.021327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.022094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.022892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.060455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:03.120485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:03.121133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:03.142384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.144943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.145618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.161275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.162322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.165285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.273359 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-68d67f3b-2885-4f8d-bdd9-af02fb5157d0 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 204 len: 0 microversion: 2.1 time: 0.268068 Nov 02 13:50:03.275181 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2988/6358] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:50:03 2022] DELETE /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:50:03.285877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:03.286583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:03.313604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.314563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.315459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.317047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:03.318400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:03.320269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:03.375816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:03.431235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.444611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.455669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.456927 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c052495b-dd68-4314-b999-7717cedab6f3 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.343609 Nov 02 13:50:03.464786 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3371/6359] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:03 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:50:03.623479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:03.633234 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-496a433b-51cc-4661-bcef-9fd0f3939f12 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.352384 Nov 02 13:50:03.637710 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2989/6360] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:50:03 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:04.493458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:04.494818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:04.504682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.505234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.505611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.506400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.506774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.507740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.660740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:04.661967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:04.670572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.671328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.671950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.673139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:04.673781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:04.674207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:04.674577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:04.691772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:04.693335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:04.694678 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ba937ed5-1f74-4492-9edf-ef6286f0d15e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.205726 Nov 02 13:50:04.695293 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3372/6361] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:04 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:04.915521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:04.924664 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2760c98a-a67f-4e26-9e0f-465e5aac40d7 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.267808 Nov 02 13:50:04.926060 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2990/6362] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:50:04 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:50:05.725952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:05.726566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:05.730184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:05.740026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.740558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.741036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:05.741748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.742201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.742808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:05.817000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.827552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.829119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:05.830528 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12ebebcb-179c-44a0-8eea-b8fb695dffe2 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.108521 Nov 02 13:50:05.831337 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3373/6363] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:05 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:05.950622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:05.951522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:05.958736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.959359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.959882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:05.960788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:05.961861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:05.962607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.556260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:06.566152 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4f9e2e39-8dbc-4641-b08f-9359f3a65544 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1516 microversion: 2.1 time: 0.619419 Nov 02 13:50:06.567096 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2991/6364] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:50:05 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1516 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:06.869122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:06.870467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:06.887423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.887423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.887423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.887423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.887423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.887423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.942253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3ab31b36-db9a-4ebb-84e6-3320a8123a02 req-a139f62b-ebfd-4954-894a-43f415f32cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7944ff2a-3114-464d-9ecf-c287973c180c", "name": "network-vif-deleted", "tag": "2c92be66-37bc-431d-9fc4-1784271237fb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:06.958603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ab31b36-db9a-4ebb-84e6-3320a8123a02 req-a139f62b-ebfd-4954-894a-43f415f32cc6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:06.959925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ab31b36-db9a-4ebb-84e6-3320a8123a02 req-a139f62b-ebfd-4954-894a-43f415f32cc6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:06.960625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3ab31b36-db9a-4ebb-84e6-3320a8123a02 req-a139f62b-ebfd-4954-894a-43f415f32cc6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:06.980685 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3ab31b36-db9a-4ebb-84e6-3320a8123a02 req-a139f62b-ebfd-4954-894a-43f415f32cc6 service nova] Creating event network-vif-deleted:2c92be66-37bc-431d-9fc4-1784271237fb for instance 7944ff2a-3114-464d-9ecf-c287973c180c on n-h2-858384-19 Nov 02 13:50:06.986421 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3ab31b36-db9a-4ebb-84e6-3320a8123a02 req-a139f62b-ebfd-4954-894a-43f415f32cc6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047958 Nov 02 13:50:06.987693 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2992/6365] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:50:07.028169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:07.039790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:07.041751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:07.043262 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aa810926-707b-40e3-9d96-66d911a64fa5 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.180343 Nov 02 13:50:07.044448 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3374/6366] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:06 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:07.598506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:07.600851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:07.620546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.621103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.621545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.622269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.622725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.628420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.692399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:07.693258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:07.693889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:07.694533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lazy-loading 'fault' on Instance uuid 7944ff2a-3114-464d-9ecf-c287973c180c {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:07.764711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24fb86a07244f4fb510617de48d98b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e484ea0314dd483d81c4e81be668cf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:07.779641 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c817336-dbd4-4840-a28d-5f664678caf4 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 200 len: 1311 microversion: 2.1 time: 0.188873 Nov 02 13:50:07.782650 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2993/6367] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:50:07 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:50:08.074145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:08.075677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:08.084457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.085020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.085818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.086841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.087595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.088288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.207491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.234532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.237154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:08.239659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ca140e5-10b4-4e2d-b53e-6db58ab830ab tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.170516 Nov 02 13:50:08.241011 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3375/6368] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:08 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:08.811594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:08.812996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] [instance: 7944ff2a-3114-464d-9ecf-c287973c180c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:08.824756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.833268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.833751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.834699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:08.836874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:08.838029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:08.860903 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] HTTP exception thrown: Instance 7944ff2a-3114-464d-9ecf-c287973c180c could not be found. Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Request method failure captured: Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c HTTP/1.1 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnS1ccAeH0CUYWCCm0mkYfJXaNtNGGOmtQG0a-viocy14EQWjEuyUpArnj4adIn5X2cEsSCzk4W9ob65kELUUoJo3dnxUz6FHrV77pvO4hCU_wzifqiHplQ5x8OVIVKGqcfQ1SBvrf7UME-rMsbgE4SedkqQsw3NqEFST8IScYxUi7o Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/e484ea0314dd483d81c4e81be668cf49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: e484ea0314dd483d81c4e81be668cf49 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-652850379 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e24fb86a07244f4fb510617de48d98b5 Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-652850379-project Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 7944ff2a-3114-464d-9ecf-c287973c180c could not be found. Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7944ff2a-3114-464d-9ecf-c287973c180c'} Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7944ff2a-3114-464d-9ecf-c287973c180c could not be found. Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7944ff2a-3114-464d-9ecf-c287973c180c could not be found. Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:08.862747 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:08.869520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:08.869520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:08.869520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:08.869520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:08.869520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:08.869520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7944ff2a-3114-464d-9ecf-c287973c180c could not be found. Nov 02 13:50:08.869520 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:08.869520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] Returning 404 to user: Instance 7944ff2a-3114-464d-9ecf-c287973c180c could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:08.869520 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-36786ae1-5b2f-41a6-b4ec-41a324698982 tempest-ServersNegativeTestJSON-652850379 tempest-ServersNegativeTestJSON-652850379-project] 10.222.0.113 "GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c" status: 404 len: 111 microversion: 2.1 time: 0.066752 Nov 02 13:50:08.870697 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2994/6369] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:50:08 2022] GET /compute/v2.1/servers/7944ff2a-3114-464d-9ecf-c287973c180c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:50:09.271349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:09.272643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:09.281167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:09.281661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:09.282105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:09.282853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:09.283353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:09.283977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:09.395644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:09.405141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:09.406679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:09.408415 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-825de81f-5cea-4789-ae55-23dc794089d0 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.141336 Nov 02 13:50:09.408934 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3376/6370] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:09 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:10.434299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:10.435551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:10.442787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:10.452676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:10.453308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:10.462263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:10.462923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:10.463498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:10.619412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:10.646934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:10.652817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:10.654267 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7b6e33b-a89a-4d09-8f8c-fc7d28c2493b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.224325 Nov 02 13:50:10.665760 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2995/6371] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:10 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:11.686168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:11.686769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:11.705877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:11.706385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:11.706837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:11.707589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:11.708052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:11.708901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:11.917722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:11.940646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:11.942272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:11.943672 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-303c1868-490e-40a1-b0f7-352cfaac8a3f tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.261516 Nov 02 13:50:11.944936 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3377/6372] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:11 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:12.970940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:12.972407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:12.989580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:12.991355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:12.991891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:12.994209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:12.997109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:12.999744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:13.197013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:13.206222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:13.211907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:13.216817 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7be7a313-d625-4ebd-bf93-5b5d4c06f406 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.250327 Nov 02 13:50:13.220000 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2996/6373] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:12 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:14.249933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:14.250689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:14.260061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:14.261410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:14.262083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:14.263207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:14.263887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:14.264758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:14.455890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:14.484494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:14.488553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:14.493347 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-57d1785d-96f6-4691-b324-a39f040a4624 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.247401 Nov 02 13:50:14.499236 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3378/6374] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:14 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:15.542869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:15.543529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:15.554234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:15.555527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:15.556637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:15.557570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:15.558415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:15.559052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:15.647076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:15.662615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:15.671366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:15.672655 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c9d39a46-a135-4921-a037-a11cc327c73b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.139807 Nov 02 13:50:15.694367 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2997/6375] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:15 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:16.708685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:16.710131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:16.737003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:16.739879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:16.741481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:16.744359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:16.745973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:16.746482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:16.911785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:16.926548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:16.928654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:16.935755 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4512fefb-e0a7-419f-8999-31d458e34f74 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.231515 Nov 02 13:50:16.936708 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3379/6376] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:16 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:17.964568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:17.967630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:17.989916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:17.990649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:17.999806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:18.000786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:18.001868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:18.004922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:18.164767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:18.178852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:18.182765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:18.187005 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d46aaa56-3180-43c2-aa32-b98c8a103f47 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.228616 Nov 02 13:50:18.188989 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2998/6377] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:17 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:19.219186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:19.220922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:19.233661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:19.234883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:19.235622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:19.237165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:19.237905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:19.238484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:19.373560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:19.390407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:19.392003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:19.393222 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0eb121ea-9923-43e0-97e3-3eafc7a27b80 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.178881 Nov 02 13:50:19.394679 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3380/6378] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:19 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:20.423311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:20.424106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:20.440531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:20.441542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:20.442223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:20.443256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:20.447212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:20.448445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:20.636222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:20.654216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:20.657033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:20.662164 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b95b173-7c5d-4164-8991-dfc2f7fe2b06 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1368 microversion: 2.47 time: 0.242828 Nov 02 13:50:20.662955 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 2999/6379] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:20 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:21.692045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:21.703990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:21.722620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:21.724276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:21.725589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:21.728048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:21.730699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:21.732993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:22.410684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:22.457413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:22.480216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:22.481671 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1374 microversion: 2.47 time: 0.794402 Nov 02 13:50:22.491180 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3381/6380] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:21 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1374 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:23.512757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:23.513389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:23.536004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:23.545173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:23.550063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:23.551072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:23.556725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:23.556725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:23.820758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:23.833072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:23.837725 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:23.842880 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ab24d694-7576-4386-b6ff-51c9e25e9bec tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1374 microversion: 2.47 time: 0.333304 Nov 02 13:50:23.843581 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3000/6381] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:23 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1374 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:24.154813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:24.157983 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59948a6a-1ef2-46e4-89b9-4c2c721ac48b tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute//" status: 200 len: 379 microversion: - time: 0.003160 Nov 02 13:50:24.164499 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3382/6382] 10.222.0.113 () {56 vars in 891 bytes} [Wed Nov 2 13:50:24 2022] GET /compute/ => generated 379 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 13:50:24.873926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:24.874546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:24.888540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:24.895761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:24.897450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:24.897971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:24.899370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:24.899845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:24.900282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:25.645556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:25.657926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:25.671807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:25.673093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c6bf524e-9d06-4873-893f-bf6dd9426a4e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1374 microversion: 2.47 time: 0.803680 Nov 02 13:50:25.673834 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3001/6383] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:24 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1374 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:26.705591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:26.706992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:26.740199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:26.745159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:26.747138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:26.749492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:26.751454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:26.753369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:26.894023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:26.909847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:26.911465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:26.912688 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8746d37a-9293-4841-82ad-82a282f57976 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1359 microversion: 2.47 time: 0.212466 Nov 02 13:50:26.926222 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3383/6384] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:26 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:26.954355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:26.961310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:26.986976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Searching by: {'deleted': False, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02'} {{(pid=120929) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 13:50:27.005485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:27.005981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:27.010110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:27.011001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:27.015979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:27.016658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:27.258314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.multi_cell_list [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120929) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 13:50:27.484364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:27.508838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:27.509626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:27.512573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:27.574969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:27.577296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:27.796341 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5368ebf7-4ec8-4380-9f87-ebf7b5fc61e4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/detail" status: 200 len: 2711 microversion: 2.47 time: 0.848144 Nov 02 13:50:27.809097 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3002/6385] 10.222.0.113 () {60 vars in 1192 bytes} [Wed Nov 2 13:50:26 2022] GET /compute/v2.1/servers/detail => generated 2711 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:27.849091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:27.850106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:27.876515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:27.877854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:27.878953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:27.882413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:27.884436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:27.886473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:27.937913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:28.116460 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-37c8c771-4d67-44c4-884f-98f07f70b3f1 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 204 len: 0 microversion: 2.47 time: 0.276304 Nov 02 13:50:28.130325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:28.131830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:28.135486 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3384/6386] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:50:27 2022] DELETE /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:50:28.142773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:28.145061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:28.145632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:28.153501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:28.154374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:28.155085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:28.908761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:28.923074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:28.924946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:28.929594 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5471969a-d115-4881-a572-d022f200964e tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1365 microversion: 2.47 time: 0.801855 Nov 02 13:50:28.930693 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3003/6387] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:28 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1365 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:29.975521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:29.978480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:30.005790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:30.017689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:30.022594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:30.024311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:30.024817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:30.025271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:30.216737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:30.248918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:30.269075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:30.273503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:30.275725 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b7f73e44-26bf-464a-bbba-a957359002c4 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1365 microversion: 2.47 time: 0.313881 Nov 02 13:50:30.293373 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3385/6388] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:29 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:31.323079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:31.324982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:31.336943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:31.337482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:31.337948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.338733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:31.339231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:31.342700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.424921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:31.426067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:31.427227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:31.428149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lazy-loading 'fault' on Instance uuid 0a141495-2982-4385-9141-b3d9e3a1facd {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:31.494637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:31.511724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:31.515891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:31.522125 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a7cafc10-8b8e-42c5-9567-a283554a4e05 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 200 len: 1370 microversion: 2.47 time: 0.204456 Nov 02 13:50:31.532682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3004/6389] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:31 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:32.564547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:32.565180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 0a141495-2982-4385-9141-b3d9e3a1facd] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:32.582774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:32.583993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:32.589835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:32.590610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:32.592015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:32.592692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:32.627023 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] HTTP exception thrown: Instance 0a141495-2982-4385-9141-b3d9e3a1facd could not be found. Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Request method failure captured: Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd HTTP/1.1 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnVvklQMDsT91ZF7kuQmCcDN6xJsd82_MQcEyeigUA70pDx1ksU4pORiupK4Me_EbkuVzCHpWzR9riz_qflamwTFffkfzamOJEIpcztKhMKlkh7BNVxmrQ5tGd5tIw0mpmCYPzg-sTRdRWfdSG15CFSh32TY0WhNwt-e5H9miCB4SRs Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 9747de9b23cc4e23b4b543bfbb9f6d02 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerShowV247Test-2103463941 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9747de9b23cc4e23b4b543bfbb9f6d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9747de9b23cc4e23b4b543bfbb9f6d02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9747de9b23cc4e23b4b543bfbb9f6d02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9747de9b23cc4e23b4b543bfbb9f6d02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerShowV247Test-2103463941 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 9747de9b23cc4e23b4b543bfbb9f6d02 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerShowV247Test-2103463941 Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerShowV247Test-2103463941-project Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 6eab176fd36f4471a3d59d07c1b7c94d Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerShowV247Test-2103463941-project Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0a141495-2982-4385-9141-b3d9e3a1facd could not be found. Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0a141495-2982-4385-9141-b3d9e3a1facd'} Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a141495-2982-4385-9141-b3d9e3a1facd could not be found. Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a141495-2982-4385-9141-b3d9e3a1facd could not be found. Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:32.629540 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a141495-2982-4385-9141-b3d9e3a1facd could not be found. Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Returning 404 to user: Instance 0a141495-2982-4385-9141-b3d9e3a1facd could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-207f852d-eb2e-42e9-a664-2658e33952f7 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd" status: 404 len: 111 microversion: 2.47 time: 0.070849 Nov 02 13:50:32.638560 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3386/6390] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:32 2022] GET /compute/v2.1/servers/0a141495-2982-4385-9141-b3d9e3a1facd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:50:32.649989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:32.651024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:32.671977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:32.672481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:32.672928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:32.677892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:32.678510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:32.680918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:32.743908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:50:32.757623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:32.940926 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b4e4eaca-50c2-4d58-b484-56c07262d56a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "DELETE /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f" status: 204 len: 0 microversion: 2.47 time: 0.301660 Nov 02 13:50:32.942046 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3005/6391] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:50:32 2022] DELETE /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:50:32.951360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:32.952499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:32.977566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:32.978362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:32.979025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:32.981527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:32.983543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:32.984306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:33.259523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:33.305005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:33.309411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:33.310717 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f" status: 200 len: 1365 microversion: 2.47 time: 0.364110 Nov 02 13:50:33.319316 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3387/6392] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:32 2022] GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:50:33.376412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c42b1aeb-fae9-44d4-8253-1e7dbd38f59b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:33.378907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c42b1aeb-fae9-44d4-8253-1e7dbd38f59b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:33.393288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42b1aeb-fae9-44d4-8253-1e7dbd38f59b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:33.397261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42b1aeb-fae9-44d4-8253-1e7dbd38f59b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:33.401515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42b1aeb-fae9-44d4-8253-1e7dbd38f59b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:33.404768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42b1aeb-fae9-44d4-8253-1e7dbd38f59b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:33.406604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42b1aeb-fae9-44d4-8253-1e7dbd38f59b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:33.407011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42b1aeb-fae9-44d4-8253-1e7dbd38f59b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:33.517287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c42b1aeb-fae9-44d4-8253-1e7dbd38f59b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action" status: 200 len: 24564 microversion: 2.1 time: 0.145167 Nov 02 13:50:33.518621 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3006/6393] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:50:33 2022] POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action => generated 24564 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:50:33.863224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:33.864934 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-187c513b-8da2-48a8-8853-ec0e91a97c1c tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute//" status: 200 len: 379 microversion: - time: 0.002120 Nov 02 13:50:33.865513 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3388/6394] 10.222.0.113 () {56 vars in 891 bytes} [Wed Nov 2 13:50:33 2022] GET /compute/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 13:50:34.348461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:34.349408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:34.358533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:34.359021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:34.359914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:34.360853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:34.361475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:34.362196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:34.462829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:34.473371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:34.474856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:34.482905 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1ddb6c6-a1ec-4dbe-b65b-bf2e181257ac tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f" status: 200 len: 1365 microversion: 2.47 time: 0.132971 Nov 02 13:50:34.483551 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3007/6395] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:34 2022] GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:50:35.512436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:35.514003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:35.520876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:35.521665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:35.523142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:35.524545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:35.526205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:35.526913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:35.566168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:35.566765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:35.567371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:35.567902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lazy-loading 'fault' on Instance uuid 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:50:35.650261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:35.659643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:35.661425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6eab176fd36f4471a3d59d07c1b7c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747de9b23cc4e23b4b543bfbb9f6d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:35.664052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a90dcb7b-349f-4be4-81d1-d7eb17c99300 tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f" status: 200 len: 1370 microversion: 2.47 time: 0.157155 Nov 02 13:50:35.680161 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3389/6396] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:35 2022] GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:50:35.914769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2db48e29-0c37-446f-86e2-566c05a5418f tempest-ExtensionsTest-1351413477 tempest-ExtensionsTest-1351413477-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:35.916496 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2db48e29-0c37-446f-86e2-566c05a5418f tempest-ExtensionsTest-1351413477 tempest-ExtensionsTest-1351413477-project] 10.222.0.113 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.142677 Nov 02 13:50:35.917408 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3008/6397] 10.222.0.113 () {58 vars in 1175 bytes} [Wed Nov 2 13:50:35 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:35.927822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9244a7ca-afe3-414f-83f3-1991caa1eed1 tempest-ExtensionsTest-1351413477 tempest-ExtensionsTest-1351413477-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:35.930612 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9244a7ca-afe3-414f-83f3-1991caa1eed1 tempest-ExtensionsTest-1351413477 tempest-ExtensionsTest-1351413477-project] 10.222.0.113 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006963 Nov 02 13:50:35.931139 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3390/6398] 10.222.0.113 () {58 vars in 1139 bytes} [Wed Nov 2 13:50:35 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:50:36.693016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:36.693552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] [instance: 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:36.704254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:36.704835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:36.705492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:36.706935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:36.707075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:36.708045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:36.729923 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] HTTP exception thrown: Instance 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f could not be found. Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Request method failure captured: Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f HTTP/1.1 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnVvklQMDsT91ZF7kuQmCcDN6xJsd82_MQcEyeigUA70pDx1ksU4pORiupK4Me_EbkuVzCHpWzR9riz_qflamwTFffkfzamOJEIpcztKhMKlkh7BNVxmrQ5tGd5tIw0mpmCYPzg-sTRdRWfdSG15CFSh32TY0WhNwt-e5H9miCB4SRs Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 9747de9b23cc4e23b4b543bfbb9f6d02 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerShowV247Test-2103463941 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9747de9b23cc4e23b4b543bfbb9f6d02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/9747de9b23cc4e23b4b543bfbb9f6d02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_9747de9b23cc4e23b4b543bfbb9f6d02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/9747de9b23cc4e23b4b543bfbb9f6d02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerShowV247Test-2103463941 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 9747de9b23cc4e23b4b543bfbb9f6d02 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerShowV247Test-2103463941 Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerShowV247Test-2103463941-project Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 6eab176fd36f4471a3d59d07c1b7c94d Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerShowV247Test-2103463941-project Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f could not be found. Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '03f10992-9e58-4ec2-ac4a-bc0481ed5b3f'} Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f could not be found. Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f could not be found. Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:50:36.732417 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:36.739294 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:50:36.739294 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:50:36.739294 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:50:36.739294 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:50:36.739294 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:50:36.739294 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f could not be found. Nov 02 13:50:36.739294 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:50:36.739294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] Returning 404 to user: Instance 03f10992-9e58-4ec2-ac4a-bc0481ed5b3f could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:50:36.739294 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a1daa0c5-fc42-4cd0-9b69-2f51f43d5e5a tempest-ServerShowV247Test-2103463941 tempest-ServerShowV247Test-2103463941-project] 10.222.0.113 "GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f" status: 404 len: 111 microversion: 2.47 time: 0.047696 Nov 02 13:50:36.744691 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3009/6399] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:36 2022] GET /compute/v2.1/servers/03f10992-9e58-4ec2-ac4a-bc0481ed5b3f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:50:38.673461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b169738c-27ca-40df-8a82-bb6ca3486c8d tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] Calling method '.version_select at 0x7fe78602f820>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:38.763615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:38.771971 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b169738c-27ca-40df-8a82-bb6ca3486c8d tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae/defaults" status: 200 len: 371 microversion: 2.1 time: 0.413710 Nov 02 13:50:38.776496 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3391/6400] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:50:38 2022] GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae/defaults => generated 371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:50:38.789744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a8840123-9e47-4d9a-b373-9c5430f8d980 tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] Calling method '.version_select at 0x7fe786950670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:38.800907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:38.802131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:39.079259 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a8840123-9e47-4d9a-b373-9c5430f8d980 tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae" status: 200 len: 371 microversion: 2.1 time: 0.294128 Nov 02 13:50:39.090416 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3010/6401] 10.222.0.113 () {58 vars in 1247 bytes} [Wed Nov 2 13:50:38 2022] GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae => generated 371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:39.102955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-669abdb8-235b-48b7-9f8a-f0c41ec1e15e tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] Calling method '.version_select at 0x7fe78602f790>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:39.198590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-669abdb8-235b-48b7-9f8a-f0c41ec1e15e tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae/defaults" status: 200 len: 371 microversion: 2.1 time: 0.105325 Nov 02 13:50:39.199691 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3392/6402] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:50:39 2022] GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae/defaults => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:39.225287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e4c522d8-a4cc-4e5e-898e-fb4663194ea7 tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] Calling method '.version_select at 0x7fe786954670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:39.364277 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e4c522d8-a4cc-4e5e-898e-fb4663194ea7 tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae" status: 200 len: 371 microversion: 2.1 time: 0.150389 Nov 02 13:50:39.371265 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3011/6403] 10.222.0.113 () {58 vars in 1247 bytes} [Wed Nov 2 13:50:39 2022] GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae => generated 371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:39.378312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8bb730ba-0375-4d9d-a2f0-ba729cb11387 tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] Calling method '.version_select at 0x7fe785ff7040>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:39.537598 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8bb730ba-0375-4d9d-a2f0-ba729cb11387 tempest-QuotasTestJSON-4579310 tempest-QuotasTestJSON-4579310-project] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae?user_id=e28efcf397d941638f77eb4589442a55" status: 200 len: 371 microversion: 2.1 time: 0.163170 Nov 02 13:50:39.576292 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3393/6404] 10.222.0.113 () {58 vars in 1328 bytes} [Wed Nov 2 13:50:39 2022] GET /compute/v2.1/os-quota-sets/4e87981ac84d4333961c38f87910dcae?user_id=e28efcf397d941638f77eb4589442a55 => generated 371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:50:53.791977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:53.793273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:53.793992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:54.091235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3174b01b-01c3-416a-9a9a-6fc590931d18 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'create', calling method: .version_select at 0x7fe78656d8b0>, body: {"keypair": {"name": "tempest-keypair-92361212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE6Rg1BWk0XIkcwPf5QtLMUO7cMeqOk9oQI9iaZT0fbZD/8uSWE0qbWq7Qodd7wCkUIC+KjSBGj32Lg6sULPSaYFtMe8frZ+RqORMfXX++c7aaONTeLyu2NwiYsXQjx6Q=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:54.160752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-3174b01b-01c3-416a-9a9a-6fc590931d18 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Getting quotas for project cd20cf58421e4143937dc67313b226f8. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:54.199209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-3174b01b-01c3-416a-9a9a-6fc590931d18 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Getting quotas for user f93c7bf631b045809ba606910497a3b5 and project cd20cf58421e4143937dc67313b226f8. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:54.290612 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3174b01b-01c3-416a-9a9a-6fc590931d18 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.504993 Nov 02 13:50:54.291910 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3012/6405] 10.222.0.113 () {62 vars in 1205 bytes} [Wed Nov 2 13:50:53 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 507 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 13:50:57.409369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1158521649", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7500adb-3941-48b7-871e-1b8735c0d0cb"}], "security_groups": [{"name": "tempest-securitygroup--1380371968"}], "key_name": "tempest-keypair-92361212", "user_data": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:57.454183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=17 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:57.456853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:57.457907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=9 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:50:57.675941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] validate_networks() for [('d7500adb-3941-48b7-871e-1b8735c0d0cb', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:50:59.044400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:50:59.047361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:50:59.048326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:50:59.048968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:50:59.049587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:50:59.063421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:59.064320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:59.065312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:59.072817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:50:59.073611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:50:59.075615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:50:59.110034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-685128428", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "47f734fa-5fc0-4681-8129-917f7de92936"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:50:59.143230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Getting quotas for project cd20cf58421e4143937dc67313b226f8. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:50:59.157992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Getting quotas for user f93c7bf631b045809ba606910497a3b5 and project cd20cf58421e4143937dc67313b226f8. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:50:59.215346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] validate_networks() for [('47f734fa-5fc0-4681-8129-917f7de92936', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:50:59.231128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:50:59.234554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:50:59.319631 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2daf9ac1-22a9-4fa6-8eb1-466ade958f26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.913615 Nov 02 13:50:59.327282 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3394/6406] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:50:57 2022] POST /compute/v2.1/servers => generated 404 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:50:59.339806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49de3b6d-c904-4a2d-8c99-f36c697631d0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:50:59.341174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-49de3b6d-c904-4a2d-8c99-f36c697631d0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:50:59.614569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49de3b6d-c904-4a2d-8c99-f36c697631d0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:59.653493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49de3b6d-c904-4a2d-8c99-f36c697631d0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:59.661913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-49de3b6d-c904-4a2d-8c99-f36c697631d0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:50:59.664005 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-49de3b6d-c904-4a2d-8c99-f36c697631d0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1284 microversion: 2.20 time: 0.335239 Nov 02 13:50:59.673872 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3395/6407] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:50:59 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:00.200491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:00.201194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:00.201673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:00.202091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:00.202507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:00.218268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:00.218766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:00.219365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:00.219986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:00.220448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:00.226621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:00.272372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Getting quotas for project 27a5f4480b6a4b6f9e35ba39727ba0b0. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:00.278383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Getting quotas for user 208c157de8484b0e9f9b89bc504b9f58 and project 27a5f4480b6a4b6f9e35ba39727ba0b0. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:00.311616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:51:00.313975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:51:00.426068 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f08f1f14-4640-440e-8b9b-d135865d2199 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.434531 Nov 02 13:51:00.427267 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3013/6408] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:50:58 2022] POST /compute/v2.1/servers => generated 382 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:51:00.440529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7cb259f6-c436-4f5d-910c-b82a8098cf8f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:00.441161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7cb259f6-c436-4f5d-910c-b82a8098cf8f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:00.528171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7cb259f6-c436-4f5d-910c-b82a8098cf8f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:00.543792 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7cb259f6-c436-4f5d-910c-b82a8098cf8f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1231 microversion: 2.1 time: 0.108324 Nov 02 13:51:00.544766 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3396/6409] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:00 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:00.701973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:00.702637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:00.716415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:00.716916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:00.717356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:00.718075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:00.718531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:00.722509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:00.861274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:00.872316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:00.874127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:00.880344 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-86774948-f35c-4360-824d-df8c5ef31b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1288 microversion: 2.20 time: 0.183854 Nov 02 13:51:00.888325 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3014/6410] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:00 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1288 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:01.571608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:01.572445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:01.589577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.590675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.591397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.595634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.598464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.602485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.776573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:01.796977 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8f112f02-bd94-467c-9d81-de0ff189fd23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1235 microversion: 2.1 time: 0.229406 Nov 02 13:51:01.797841 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3397/6411] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:01 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1235 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:01.918308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:01.919917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:01.942726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.944947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.945720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:01.946700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:01.949319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:01.950926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:02.235411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:02.256440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:02.258244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:02.259438 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bac2e5e9-062b-4316-9c3d-f8f40adb0849 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1354 microversion: 2.20 time: 0.347150 Nov 02 13:51:02.260012 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3015/6412] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:01 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1354 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:02.827499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:02.828585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:02.863762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:02.866111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:02.868042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:02.869086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:02.871028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:02.871878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:03.003141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:03.016398 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5f2802b1-e815-49fe-91b3-6f949fd53a0c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1289 microversion: 2.1 time: 0.196128 Nov 02 13:51:03.019673 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3398/6413] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:02 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1289 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:03.286268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:03.288274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:03.307683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:03.308170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:03.308615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:03.309330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:03.309781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:03.310207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:03.654706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:03.668878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:03.670863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:03.673114 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c775112f-82fa-49cb-9f26-c6150fb20edb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1410 microversion: 2.20 time: 0.391027 Nov 02 13:51:03.698961 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3016/6414] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:03 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1410 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:04.045158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:04.046502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:04.061129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.065223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.065963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.067058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.067707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.069844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.346276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6575b118-cff8-49cc-9174-214ad981da40 req-3683fa01-49b1-40c7-8dba-001102a079fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2faf26b2-214b-40c4-b5c2-81cf8524b8e7", "tag": "62875f3c-3f2e-4138-869d-d53e38408179"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:04.385009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6575b118-cff8-49cc-9174-214ad981da40 req-3683fa01-49b1-40c7-8dba-001102a079fd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.386229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6575b118-cff8-49cc-9174-214ad981da40 req-3683fa01-49b1-40c7-8dba-001102a079fd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.388030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6575b118-cff8-49cc-9174-214ad981da40 req-3683fa01-49b1-40c7-8dba-001102a079fd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.428817 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6575b118-cff8-49cc-9174-214ad981da40 req-3683fa01-49b1-40c7-8dba-001102a079fd service nova] Creating event network-changed:62875f3c-3f2e-4138-869d-d53e38408179 for instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 on n-h2-858384-19 Nov 02 13:51:04.445597 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6575b118-cff8-49cc-9174-214ad981da40 req-3683fa01-49b1-40c7-8dba-001102a079fd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102465 Nov 02 13:51:04.447616 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3017/6415] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:04.566818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:04.580888 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d626e67-d5a2-40cf-bb32-dc97bd30a41c tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.542153 Nov 02 13:51:04.581645 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3399/6416] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:04 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:04.702929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:04.704096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:04.719662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.721232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.724105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:04.726239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:04.727840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:04.733020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:05.086597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:05.096757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:05.098893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:05.103224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a11137c1-8acd-4ac3-a1e2-ccac18a49024 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1410 microversion: 2.20 time: 0.404937 Nov 02 13:51:05.103833 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3018/6417] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:04 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1410 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:05.609806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:05.610442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:05.623272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:05.623766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:05.624550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:05.625060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:05.625683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:05.626257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:05.915394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:05.924829 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-947bd92c-9c9c-4f47-b56d-db54c271a9bf tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.320769 Nov 02 13:51:05.929449 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3400/6418] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:05 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:51:06.027667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f139972f-ee4f-4e6d-8dba-7ca4880736a2 req-b332f0f6-d7d7-4836-98f0-44b1cf054cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d811ec6a-012d-4065-993c-d299fef76c6c", "tag": "b6784d71-53d0-4f1f-acb2-03d155bb78ed"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:06.039981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f139972f-ee4f-4e6d-8dba-7ca4880736a2 req-b332f0f6-d7d7-4836-98f0-44b1cf054cc4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.040749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f139972f-ee4f-4e6d-8dba-7ca4880736a2 req-b332f0f6-d7d7-4836-98f0-44b1cf054cc4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.041340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f139972f-ee4f-4e6d-8dba-7ca4880736a2 req-b332f0f6-d7d7-4836-98f0-44b1cf054cc4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.058784 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f139972f-ee4f-4e6d-8dba-7ca4880736a2 req-b332f0f6-d7d7-4836-98f0-44b1cf054cc4 service nova] Creating event network-changed:b6784d71-53d0-4f1f-acb2-03d155bb78ed for instance d811ec6a-012d-4065-993c-d299fef76c6c on n-h2-858384-19 Nov 02 13:51:06.068321 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f139972f-ee4f-4e6d-8dba-7ca4880736a2 req-b332f0f6-d7d7-4836-98f0-44b1cf054cc4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152450 Nov 02 13:51:06.072327 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3019/6419] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:06.131094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:06.131746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:06.153958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.154899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.155397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.156141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.156611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.157052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.322998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:06.335447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:06.336942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:06.338258 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed63938a-37c8-4fb3-8956-38fce15e5512 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1410 microversion: 2.20 time: 0.211669 Nov 02 13:51:06.339311 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3401/6420] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:06 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1410 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:06.951868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:06.953147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:06.965789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.966728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.968064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:06.969016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:06.970581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:06.971371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:07.241241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:07.272166 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-265953a5-45ee-41c8-8696-fa24b9af9be2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.324362 Nov 02 13:51:07.273552 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3020/6421] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:06 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:07.366253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:07.367532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:07.386930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:07.387779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:07.388650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:07.392049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:07.393909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:07.420172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:07.955239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:07.966762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:07.975631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:07.979822 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16f3d069-3899-486d-9be7-d51bf1956606 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1410 microversion: 2.20 time: 0.616735 Nov 02 13:51:08.003192 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3402/6422] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:07 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1410 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:08.299571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:08.301142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:08.313075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:08.313591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:08.314229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:08.315188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:08.315949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:08.316538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:08.729094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:08.740555 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ccbc4e1b-354e-41e5-9c30-2d239597b671 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.445246 Nov 02 13:51:08.741655 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3021/6423] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:08 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:09.011744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:09.012370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:09.021649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:09.023028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:09.024372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:09.025134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:09.025665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:09.026115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:09.101709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:09.274770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:09.286259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:09.289399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:09.290757 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69357f2f-3e87-4d89-8214-0fe75e0daebd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1410 microversion: 2.20 time: 0.283469 Nov 02 13:51:09.291765 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3403/6424] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:09 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1410 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:09.770343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:09.772896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:09.781650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:09.782183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:09.782627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:09.783553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:09.784467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:09.785258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:09.952296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:09.967393 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-666bacf5-3f83-4dcf-865e-e37e8b5dee23 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.201380 Nov 02 13:51:09.968348 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3022/6425] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:09 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:10.319689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:10.320926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:10.328102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.328808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.329415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:10.330273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:10.330880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:10.331491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:10.489097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:10.501086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:10.503017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:10.504406 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c53df281-0743-43ec-92b8-de2d23b74550 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1410 microversion: 2.20 time: 0.189520 Nov 02 13:51:10.505487 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3404/6426] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:10 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1410 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:10.992029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:10.992655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:10.994823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:10.995518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=10 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:11.002763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:11.003197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:11.003637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:11.007630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:11.008107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:11.008548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:11.173968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:11.183065 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a20e1dc4-718b-4257-bac0-be16b4614b7f tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.195407 Nov 02 13:51:11.183996 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3023/6427] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:10 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:11.529738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:11.530314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:11.533774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:11.539731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:11.540226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:11.540678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:11.541409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:11.541872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:11.542307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:11.701433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:11.711799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:11.713573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:11.714716 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c94aa1f2-9f61-4603-9e53-69f72af67ac7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1410 microversion: 2.20 time: 0.189048 Nov 02 13:51:11.715331 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3405/6428] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:11 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1410 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:12.206098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:12.206519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:12.219463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.220270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.220974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.221888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.222528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.223379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.384047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:12.393269 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94064292-f852-43ba-90cf-0b48a9fd3a9a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.191270 Nov 02 13:51:12.407247 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3024/6429] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:12 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:12.544403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fbdf57c-ba2f-43c1-95f8-99e395023a7e tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:12.545285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0fbdf57c-ba2f-43c1-95f8-99e395023a7e tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:12.569434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbdf57c-ba2f-43c1-95f8-99e395023a7e tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.569915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbdf57c-ba2f-43c1-95f8-99e395023a7e tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.570515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbdf57c-ba2f-43c1-95f8-99e395023a7e tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.571312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbdf57c-ba2f-43c1-95f8-99e395023a7e tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.571777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbdf57c-ba2f-43c1-95f8-99e395023a7e tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.572224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbdf57c-ba2f-43c1-95f8-99e395023a7e tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.657096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-cff061ab-5468-4b65-94cd-69a133fbc18c req-48d71bd0-7a47-4360-a000-c77a9911f64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf26b2-214b-40c4-b5c2-81cf8524b8e7", "name": "network-vif-plugged", "status": "completed", "tag": "62875f3c-3f2e-4138-869d-d53e38408179"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:12.671430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cff061ab-5468-4b65-94cd-69a133fbc18c req-48d71bd0-7a47-4360-a000-c77a9911f64d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.675265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cff061ab-5468-4b65-94cd-69a133fbc18c req-48d71bd0-7a47-4360-a000-c77a9911f64d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.681980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cff061ab-5468-4b65-94cd-69a133fbc18c req-48d71bd0-7a47-4360-a000-c77a9911f64d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.696175 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-cff061ab-5468-4b65-94cd-69a133fbc18c req-48d71bd0-7a47-4360-a000-c77a9911f64d service nova] Creating event network-vif-plugged:62875f3c-3f2e-4138-869d-d53e38408179 for instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 on n-h2-858384-19 Nov 02 13:51:12.702749 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-cff061ab-5468-4b65-94cd-69a133fbc18c req-48d71bd0-7a47-4360-a000-c77a9911f64d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177410 Nov 02 13:51:12.705259 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3406/6430] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:12.743231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:12.744062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:12.753765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.754675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.756315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.757250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.776390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.777981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.963336 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0fbdf57c-ba2f-43c1-95f8-99e395023a7e tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1842 microversion: 2.1 time: 0.422729 Nov 02 13:51:12.967701 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3025/6431] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:12 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1842 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:12.989410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:12.990196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:12.996450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.997035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.997545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:12.998331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:12.998858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:12.999384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.045959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:13.059493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:13.061399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:13.062827 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84f21e7c-deee-4a24-954b-8db1549308b2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1410 microversion: 2.20 time: 0.325064 Nov 02 13:51:13.063816 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3407/6432] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:12 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1410 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:13.180713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:13.190644 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e8059ae-5ae8-48ef-bb2b-8844416ffdec tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1689 microversion: 2.1 time: 0.205442 Nov 02 13:51:13.191811 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3026/6433] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:12 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:51:13.311352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d2eac857-6354-4c65-ad24-a311649dd86b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:13.313795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d2eac857-6354-4c65-ad24-a311649dd86b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:13.320617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2eac857-6354-4c65-ad24-a311649dd86b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.321238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2eac857-6354-4c65-ad24-a311649dd86b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.321787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2eac857-6354-4c65-ad24-a311649dd86b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.323328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2eac857-6354-4c65-ad24-a311649dd86b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.324108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2eac857-6354-4c65-ad24-a311649dd86b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.324650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2eac857-6354-4c65-ad24-a311649dd86b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.409942 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d2eac857-6354-4c65-ad24-a311649dd86b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action" status: 200 len: 32630 microversion: 2.1 time: 0.102335 Nov 02 13:51:13.418248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:13.419747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:13.423360 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3408/6434] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:51:13 2022] POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action => generated 32630 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:51:13.427521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.428009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.428449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.429548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.429675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.430326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.600713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:13.601777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:13.605860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:13.611474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.612410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.613782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.615543 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6a394f1-0834-43de-bbf4-c2b91026fa69 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.200382 Nov 02 13:51:13.615704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.616346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.616950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.617684 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3027/6435] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:13 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:13.676194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a687aba2bcef4e2b9f55e67b5e11a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e2f7f2e1714dc89cd4d2acbc0c540b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:13.676828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] flavor_id is None. Assuming migration. {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4197}} Nov 02 13:51:13.678655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 13:51:13.864431 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0da146cb-0a4b-48c5-ae1a-c060168e7ba8 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action" status: 202 len: 0 microversion: 2.1 time: 0.270216 Nov 02 13:51:13.868981 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3409/6436] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:51:13 2022] POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:51:13.879235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:13.879880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:13.892615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.893111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.893559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:13.899434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:13.899950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:13.900407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.094940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:14.095845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:14.110903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:14.111722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:14.112390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.113807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:14.115074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:14.118690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.140622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:14.152688 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7f3144ab-4170-42fe-b522-37b2543e0f88 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1698 microversion: 2.1 time: 0.282433 Nov 02 13:51:14.157203 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3028/6437] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:13 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1698 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:14.436998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:14.460176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:14.461700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:14.462846 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ace464c5-b4b5-4cdf-a16d-4043cd611f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1410 microversion: 2.20 time: 0.373062 Nov 02 13:51:14.463448 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3410/6438] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:14 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1410 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:14.640889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:14.641732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:14.653963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:14.656118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:14.656761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.658357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:14.660147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:14.661563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.734140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c6c96bef-a62f-4343-9e8a-370997c52b3e req-a6f26048-5b63-4097-a2f0-2cf8fe6ae4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d811ec6a-012d-4065-993c-d299fef76c6c", "name": "network-vif-plugged", "status": "completed", "tag": "b6784d71-53d0-4f1f-acb2-03d155bb78ed"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:14.760492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c6c96bef-a62f-4343-9e8a-370997c52b3e req-a6f26048-5b63-4097-a2f0-2cf8fe6ae4a3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:14.760987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c6c96bef-a62f-4343-9e8a-370997c52b3e req-a6f26048-5b63-4097-a2f0-2cf8fe6ae4a3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:14.761422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c6c96bef-a62f-4343-9e8a-370997c52b3e req-a6f26048-5b63-4097-a2f0-2cf8fe6ae4a3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:14.782649 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c6c96bef-a62f-4343-9e8a-370997c52b3e req-a6f26048-5b63-4097-a2f0-2cf8fe6ae4a3 service nova] Creating event network-vif-plugged:b6784d71-53d0-4f1f-acb2-03d155bb78ed for instance d811ec6a-012d-4065-993c-d299fef76c6c on n-h2-858384-19 Nov 02 13:51:14.796236 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c6c96bef-a62f-4343-9e8a-370997c52b3e req-a6f26048-5b63-4097-a2f0-2cf8fe6ae4a3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069346 Nov 02 13:51:14.796861 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3411/6439] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:14.924862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:14.933760 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3ce114c2-f63e-486d-af1f-3d0ad8daafa0 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.297691 Nov 02 13:51:14.937538 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3029/6440] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:14 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:15.185241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:15.185963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:15.193531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.194331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.194778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.195708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.196302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.196897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.371656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:15.383104 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-528f8251-2928-4530-be9a-31eaf2391d84 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1698 microversion: 2.1 time: 0.202096 Nov 02 13:51:15.400125 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3412/6441] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:15 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1698 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:15.491806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:15.493082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:15.501796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.502295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.502742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.503580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.504047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.504479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.823130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:15.855176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:15.862987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:15.865443 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da88498b-fe89-4fdb-8421-f5b9f6feb856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1601 microversion: 2.20 time: 0.378240 Nov 02 13:51:15.866197 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3030/6442] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:51:15 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1601 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:51:15.897911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0cc70b9-17ae-4ee5-a094-2597917a2b82 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:15.898639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0cc70b9-17ae-4ee5-a094-2597917a2b82 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:15.911985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cc70b9-17ae-4ee5-a094-2597917a2b82 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.915597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cc70b9-17ae-4ee5-a094-2597917a2b82 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.916138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cc70b9-17ae-4ee5-a094-2597917a2b82 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.919775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cc70b9-17ae-4ee5-a094-2597917a2b82 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.922631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cc70b9-17ae-4ee5-a094-2597917a2b82 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.923201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0cc70b9-17ae-4ee5-a094-2597917a2b82 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.940310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:15.964528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:15.965411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:15.974475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.978287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.978942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:15.980052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:15.982967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:15.983611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:16.027904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:16.043147 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0cc70b9-17ae-4ee5-a094-2597917a2b82 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.149662 Nov 02 13:51:16.051660 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3413/6443] 10.222.0.113 () {60 vars in 1321 bytes} [Wed Nov 2 13:51:15 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:51:16.382639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:16.393646 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7904b8ee-7fb6-4123-ad1c-e16ec70a5fce tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1331 microversion: 2.1 time: 0.433414 Nov 02 13:51:16.413329 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3031/6444] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:15 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1331 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:51:16.414271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:16.415005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:16.449503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:16.449503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:16.449503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:16.450314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:16.450772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:16.451228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:17.091691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:17.105857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0bc4df4e-542a-40a2-9a4a-848e992dc7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1698 microversion: 2.1 time: 0.695992 Nov 02 13:51:17.106406 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3414/6445] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:16 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1698 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:17.418988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:17.420234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:17.429134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:17.429893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:17.430513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:17.431454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:17.432061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:17.432640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:17.784229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:17.798937 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8ed244f5-b237-4ba6-90f3-ff607b130b8b tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1530 microversion: 2.1 time: 0.383546 Nov 02 13:51:17.800450 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3032/6446] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:17 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1530 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:17.823869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:17.824706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:17.832118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:17.832886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:17.834174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:17.835099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:17.835720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:17.836318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.001808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:18.044111 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0de390f1-5bcb-4007-9bcb-8b81fb0c7123 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1530 microversion: 2.1 time: 0.217796 Nov 02 13:51:18.045160 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3415/6447] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:17 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1530 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:18.144945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:18.145588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:18.172614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:18.173140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:18.174509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.175019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.177925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.181233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.183411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.185958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.190989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.191802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.192408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.194014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.194669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.195325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.226167 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] HTTP exception thrown: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Request method failure captured: Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c HTTP/1.1 Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnXCGVuHL_3rsPTKg74YyXisfS3HCpuhJLuz1MzmTdOczBlzeYOXFOFfoJ-u0WSmYJWLnyWZJ6yyC37HS13pKjWZPRpGL5M4P4zmh9TXMMTz44EZaVel95Z_G_KNN11xdQfT3AqNxOJ6jN7nIvPrM6YwzD8lDsebUsc39iW82lVRNM0 Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 62f30c28c05e431cb945c779f710a99a Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1627509417 Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/62f30c28c05e431cb945c779f710a99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/62f30c28c05e431cb945c779f710a99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_62f30c28c05e431cb945c779f710a99a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/62f30c28c05e431cb945c779f710a99a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1627509417 Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 62f30c28c05e431cb945c779f710a99a Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1627509417 Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1627509417-project Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 8f1f3ba14179411d82fa2e8d3f0c5f78 Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1627509417-project Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd811ec6a-012d-4065-993c-d299fef76c6c'} Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:51:18.229128 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.232753 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.237448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Returning 404 to user: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:18.238549 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c5b973af-e732-4e39-9641-12a150946cc9 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 404 len: 111 microversion: 2.1 time: 0.174265 Nov 02 13:51:18.241621 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3033/6448] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:51:18 2022] DELETE /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:18.253973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:18.254641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:18.269858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.272051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.273580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.276842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.277416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.277948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.394382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:18.403380 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e476b0d6-b6e0-435d-b960-e9ef889863c2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1698 microversion: 2.1 time: 0.273142 Nov 02 13:51:18.415833 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3416/6449] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:18 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1698 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:51:18.563481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5fbb3865-ae95-4f6b-89b9-c8ab2659103f req-a65a35ae-a3a9-40af-9dc8-149f38fb1e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2faf26b2-214b-40c4-b5c2-81cf8524b8e7", "tag": "62875f3c-3f2e-4138-869d-d53e38408179"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:18.576673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5fbb3865-ae95-4f6b-89b9-c8ab2659103f req-a65a35ae-a3a9-40af-9dc8-149f38fb1e04 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.577244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5fbb3865-ae95-4f6b-89b9-c8ab2659103f req-a65a35ae-a3a9-40af-9dc8-149f38fb1e04 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.577752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5fbb3865-ae95-4f6b-89b9-c8ab2659103f req-a65a35ae-a3a9-40af-9dc8-149f38fb1e04 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.593597 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5fbb3865-ae95-4f6b-89b9-c8ab2659103f req-a65a35ae-a3a9-40af-9dc8-149f38fb1e04 service nova] Creating event network-changed:62875f3c-3f2e-4138-869d-d53e38408179 for instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 on n-h2-858384-19 Nov 02 13:51:18.600933 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5fbb3865-ae95-4f6b-89b9-c8ab2659103f req-a65a35ae-a3a9-40af-9dc8-149f38fb1e04 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043174 Nov 02 13:51:18.602877 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3417/6450] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:18.704959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:18.718313 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bd8ad024-a34a-4187-8af3-58bd52ad388a tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1530 microversion: 2.1 time: 0.471585 Nov 02 13:51:18.719014 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3034/6451] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:18 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1530 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:51:18.750111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Action: 'update', calling method: >, body: {"server": {"name": "d811ec6a-012d-4065-993c-d299fef76c6c_new"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:18.758857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:18.776436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.777539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.778919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.780176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.780865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.781742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.800153 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] HTTP exception thrown: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Request method failure captured: Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: request: PUT /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c HTTP/1.1 Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 64 Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnXCGVuHL_3rsPTKg74YyXisfS3HCpuhJLuz1MzmTdOczBlzeYOXFOFfoJ-u0WSmYJWLnyWZJ6yyC37HS13pKjWZPRpGL5M4P4zmh9TXMMTz44EZaVel95Z_G_KNN11xdQfT3AqNxOJ6jN7nIvPrM6YwzD8lDsebUsc39iW82lVRNM0 Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 62f30c28c05e431cb945c779f710a99a Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1627509417 Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/62f30c28c05e431cb945c779f710a99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/62f30c28c05e431cb945c779f710a99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_62f30c28c05e431cb945c779f710a99a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/62f30c28c05e431cb945c779f710a99a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1627509417 Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 62f30c28c05e431cb945c779f710a99a Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1627509417 Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1627509417-project Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 8f1f3ba14179411d82fa2e8d3f0c5f78 Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1627509417-project Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: {"server": {"name": "d811ec6a-012d-4065-993c-d299fef76c6c_new"}} Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'd811ec6a-012d-4065-993c-d299fef76c6c', 'body': {'server': {'name': 'd811ec6a-012d-4065-993c-d299fef76c6c_new'}}} Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:51:18.802652 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:18.805757 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:18.808454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] Returning 404 to user: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:18.809652 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-688533fa-df58-4958-af46-2b7736a87806 tempest-ServersNegativeTestMultiTenantJSON-1627509417 tempest-ServersNegativeTestMultiTenantJSON-1627509417-project] 10.222.0.113 "PUT /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 404 len: 111 microversion: 2.1 time: 0.070163 Nov 02 13:51:18.810776 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3418/6452] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:51:18 2022] PUT /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:18.821729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:18.823490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:18.843343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.844197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.844962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.848195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:18.850034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:18.852697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:18.912505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:51:19.069007 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-721b6c47-245b-4de4-8da5-2f99c1efd87e tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 204 len: 0 microversion: 2.1 time: 0.253030 Nov 02 13:51:19.072667 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3035/6453] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:51:18 2022] DELETE /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:51:19.077951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:19.078585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:19.088310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.088428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.088870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.089580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.090130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.090462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.307411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:19.318612 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b5b1f6a7-082d-4b64-8c99-33e98e79ebf2 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1536 microversion: 2.1 time: 0.244516 Nov 02 13:51:19.319883 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3419/6454] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:19 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1536 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:19.430095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:19.430967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:19.438824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.439693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.440273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.441355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:19.441894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:19.443605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:19.673475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:19.685035 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66433a9d-ab03-4324-b5af-a64d85c50f03 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1703 microversion: 2.1 time: 0.260154 Nov 02 13:51:19.686188 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3036/6455] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:19 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1703 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:20.345073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:20.346861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:20.365253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.369096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.370499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.372067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.373965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.374483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.628995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:20.645217 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5664ff68-852c-4523-9619-a5e4adce99ef tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1536 microversion: 2.1 time: 0.306414 Nov 02 13:51:20.651106 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3420/6456] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:20 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1536 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:20.714259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:20.715221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:20.725901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.726841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.727683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.730005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:20.731228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:20.734680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:20.956330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:20.965389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a8fb250-04bb-47d8-929b-a7fad145904c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1703 microversion: 2.1 time: 0.259823 Nov 02 13:51:20.965977 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3037/6457] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:20 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1703 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:21.523141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8615196c-e402-4651-bcd3-a407a368a666 req-23643a51-3f88-4401-bacb-e15990180d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d811ec6a-012d-4065-993c-d299fef76c6c", "name": "network-vif-deleted", "tag": "b6784d71-53d0-4f1f-acb2-03d155bb78ed"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:21.554880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8615196c-e402-4651-bcd3-a407a368a666 req-23643a51-3f88-4401-bacb-e15990180d83 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.556337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8615196c-e402-4651-bcd3-a407a368a666 req-23643a51-3f88-4401-bacb-e15990180d83 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.556794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8615196c-e402-4651-bcd3-a407a368a666 req-23643a51-3f88-4401-bacb-e15990180d83 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.574376 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8615196c-e402-4651-bcd3-a407a368a666 req-23643a51-3f88-4401-bacb-e15990180d83 service nova] Creating event network-vif-deleted:b6784d71-53d0-4f1f-acb2-03d155bb78ed for instance d811ec6a-012d-4065-993c-d299fef76c6c on n-h2-858384-19 Nov 02 13:51:21.579982 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8615196c-e402-4651-bcd3-a407a368a666 req-23643a51-3f88-4401-bacb-e15990180d83 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063760 Nov 02 13:51:21.581223 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3421/6458] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:21.675721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:21.676350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:21.687730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.688407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.689433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.690313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.691258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.691847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.733667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:21.734255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:21.734520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:21.734971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lazy-loading 'fault' on Instance uuid d811ec6a-012d-4065-993c-d299fef76c6c {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:51:21.788507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '208c157de8484b0e9f9b89bc504b9f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a5f4480b6a4b6f9e35ba39727ba0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:21.798888 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b8ec2772-a5e2-4891-a9bc-f90a3a7056f1 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 200 len: 1321 microversion: 2.1 time: 0.127857 Nov 02 13:51:21.811013 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3038/6459] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:21 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 1321 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:21.991967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:21.992798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:21.999505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:22.000121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:22.000551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:22.001261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:22.001884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:22.002321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:22.254319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:22.276389 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9cd6a213-e358-4673-82fe-77a805fd6983 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1703 microversion: 2.1 time: 0.289065 Nov 02 13:51:22.277172 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3422/6460] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:21 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1703 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:22.827701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:22.828337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] [instance: d811ec6a-012d-4065-993c-d299fef76c6c] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:22.844424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:22.844926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:22.845373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:22.846093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:22.846675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:22.847147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:22.863539 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] HTTP exception thrown: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Request method failure captured: Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c HTTP/1.1 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnW2qyOe0vRIEV0hp9inRSkTw4jGTVxRc2YS_oca_ZuhPlk08xV958CaausX4uGV4_5R3GA7e6MLXpUdemQtJLVa-qXYNFjHPLg1s07EKgh_P4wCos1V9CLu6n6uZbibcWRUx6FfR3Q41ANmo8kggM5JnxQW8UVpRdR2PYxN_ujMK10 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 27a5f4480b6a4b6f9e35ba39727ba0b0 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1705805643 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/27a5f4480b6a4b6f9e35ba39727ba0b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/27a5f4480b6a4b6f9e35ba39727ba0b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_27a5f4480b6a4b6f9e35ba39727ba0b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/27a5f4480b6a4b6f9e35ba39727ba0b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1705805643 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 27a5f4480b6a4b6f9e35ba39727ba0b0 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1705805643 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1705805643-project Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 208c157de8484b0e9f9b89bc504b9f58 Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1705805643-project Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd811ec6a-012d-4065-993c-d299fef76c6c'} Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:22.865786 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] Returning 404 to user: Instance d811ec6a-012d-4065-993c-d299fef76c6c could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce557a01-5f08-4fa4-a898-e9ddc49675a9 tempest-ServersNegativeTestMultiTenantJSON-1705805643 tempest-ServersNegativeTestMultiTenantJSON-1705805643-project] 10.222.0.113 "GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c" status: 404 len: 111 microversion: 2.1 time: 0.043796 Nov 02 13:51:22.868923 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3039/6461] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:22 2022] GET /compute/v2.1/servers/d811ec6a-012d-4065-993c-d299fef76c6c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:23.300720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:23.301401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:23.318459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:23.318953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:23.319427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:23.320153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:23.320612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:23.321039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:23.660957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:23.674422 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d86437d3-eb68-4b11-ae6a-2bc4694d7f58 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1703 microversion: 2.1 time: 0.376185 Nov 02 13:51:23.695732 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3423/6462] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:23 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1703 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:24.703445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:24.704075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:24.716239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:24.717786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:24.722762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:24.725849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:24.726915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:24.727573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:24.728163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:25.244484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:25.256399 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2a3c4666-6e03-48c9-b756-0765f66684b4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1703 microversion: 2.1 time: 0.556924 Nov 02 13:51:25.260649 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3040/6463] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:24 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1703 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:26.281352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:26.282087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:26.297457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:26.297964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:26.298446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:26.300590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:26.301090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:26.304013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:26.617614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:26.625543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bf51b861-5657-40c5-b381-b626de641453 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1703 microversion: 2.1 time: 0.349030 Nov 02 13:51:26.643617 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3424/6464] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:26 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1703 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:27.654441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:27.655993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:27.670568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:27.671291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:27.671818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:27.672638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:27.673114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:27.673556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:27.967019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:27.980767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e4f05c2e-7882-4ec0-9a35-8ddf457b2525 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1703 microversion: 2.1 time: 0.330270 Nov 02 13:51:27.996240 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3041/6465] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:27 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1703 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:29.015592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:29.016810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:29.026517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:29.027983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:29.032076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:29.037479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:29.038429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:29.039056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:29.039696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:29.481378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:29.492910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-630bad43-a0c6-4245-88c7-b47191a023df tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1703 microversion: 2.1 time: 0.481166 Nov 02 13:51:29.503963 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3425/6466] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:29 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1703 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:30.519334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:30.519874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:30.538126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:30.538619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:30.539750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:30.540520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:30.541439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:30.541879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:30.872253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:30.883493 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5ebd474f-f66f-40a1-92d8-eabe09b3c60f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1703 microversion: 2.1 time: 0.367041 Nov 02 13:51:30.905862 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3042/6467] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:30 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1703 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:31.916512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:31.917940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:31.928670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:31.929504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:31.930194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:31.930988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:31.931628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:31.933175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:32.227936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:32.239442 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8e54b71a-2efb-4607-a27e-24642ca5ac01 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1702 microversion: 2.1 time: 0.328771 Nov 02 13:51:32.258785 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3426/6468] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:31 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1702 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:32.320632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-25742c04-2f42-4507-af2b-41fbf0edaa6f req-6f5d270e-6a37-4272-8887-b9b6ffe105a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283dce09-eb44-4fb0-be95-77eb073849fb", "name": "network-vif-unplugged", "status": "completed", "tag": "13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:32.343557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-25742c04-2f42-4507-af2b-41fbf0edaa6f req-6f5d270e-6a37-4272-8887-b9b6ffe105a1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:32.344227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-25742c04-2f42-4507-af2b-41fbf0edaa6f req-6f5d270e-6a37-4272-8887-b9b6ffe105a1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:32.344837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-25742c04-2f42-4507-af2b-41fbf0edaa6f req-6f5d270e-6a37-4272-8887-b9b6ffe105a1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:32.361513 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-25742c04-2f42-4507-af2b-41fbf0edaa6f req-6f5d270e-6a37-4272-8887-b9b6ffe105a1 service nova] Creating event network-vif-unplugged:13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3 for instance 283dce09-eb44-4fb0-be95-77eb073849fb on n-h2-858384-19 Nov 02 13:51:32.369444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-25742c04-2f42-4507-af2b-41fbf0edaa6f req-6f5d270e-6a37-4272-8887-b9b6ffe105a1 service nova] Instance 283dce09-eb44-4fb0-be95-77eb073849fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:51:32.401633 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-25742c04-2f42-4507-af2b-41fbf0edaa6f req-6f5d270e-6a37-4272-8887-b9b6ffe105a1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085874 Nov 02 13:51:32.402578 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3043/6469] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:33.275099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:33.275726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:33.288937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:33.290448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:33.293203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:33.294877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:33.295623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:33.301877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:33.782090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:33.790980 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0112827-527b-4382-9031-ddc45ba285b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1702 microversion: 2.1 time: 0.519937 Nov 02 13:51:33.807766 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3427/6470] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:33 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1702 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:34.430567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6dddac38-f79f-4990-a72b-4c2603fac649 req-bf3a28cb-d081-4791-b473-344c003d4daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283dce09-eb44-4fb0-be95-77eb073849fb", "tag": "13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:34.446089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6dddac38-f79f-4990-a72b-4c2603fac649 req-bf3a28cb-d081-4791-b473-344c003d4daa service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:34.446754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6dddac38-f79f-4990-a72b-4c2603fac649 req-bf3a28cb-d081-4791-b473-344c003d4daa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:34.447451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6dddac38-f79f-4990-a72b-4c2603fac649 req-bf3a28cb-d081-4791-b473-344c003d4daa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:34.464862 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6dddac38-f79f-4990-a72b-4c2603fac649 req-bf3a28cb-d081-4791-b473-344c003d4daa service nova] Creating event network-changed:13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3 for instance 283dce09-eb44-4fb0-be95-77eb073849fb on n-h2-858384-19 Nov 02 13:51:34.472507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-6dddac38-f79f-4990-a72b-4c2603fac649 req-bf3a28cb-d081-4791-b473-344c003d4daa service nova] Instance 283dce09-eb44-4fb0-be95-77eb073849fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:51:34.486528 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6dddac38-f79f-4990-a72b-4c2603fac649 req-bf3a28cb-d081-4791-b473-344c003d4daa service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064408 Nov 02 13:51:34.487557 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3044/6471] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:34.821467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:34.822097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:34.833914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:34.834764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:34.836804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:34.837980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:34.840844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:34.842560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:35.082913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:35.096178 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-034639e2-7c23-4f86-bdbf-6e589ece8935 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1700 microversion: 2.1 time: 0.281823 Nov 02 13:51:35.096862 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3428/6472] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:34 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1700 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:36.121417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:36.122135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:36.134770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:36.135752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:36.141137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:36.142990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:36.144398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:36.144986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:36.412844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:36.424255 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cd239d31-5440-40c8-988d-8efe40528782 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1700 microversion: 2.1 time: 0.305705 Nov 02 13:51:36.424707 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3045/6473] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:36 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1700 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:36.506172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-18e05a1b-f8da-4782-88be-9bc05eda4a50 tempest-ComputeTenantNetworksTest-1643123726 tempest-ComputeTenantNetworksTest-1643123726-project] Calling method '.version_select at 0x7fe785f961f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:36.789392 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-18e05a1b-f8da-4782-88be-9bc05eda4a50 tempest-ComputeTenantNetworksTest-1643123726 tempest-ComputeTenantNetworksTest-1643123726-project] 10.222.0.113 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.441480 Nov 02 13:51:36.789994 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3429/6474] 10.222.0.113 () {58 vars in 1163 bytes} [Wed Nov 2 13:51:36 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:51:36.800738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0f5cb6df-b126-4163-8665-b42cb41983e3 tempest-ComputeTenantNetworksTest-1643123726 tempest-ComputeTenantNetworksTest-1643123726-project] Calling method '.version_select at 0x7fe787d87f70>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:36.939040 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0f5cb6df-b126-4163-8665-b42cb41983e3 tempest-ComputeTenantNetworksTest-1643123726 tempest-ComputeTenantNetworksTest-1643123726-project] 10.222.0.113 "GET /compute/v2.1/os-tenant-networks/8d448a6f-367b-487c-9176-3da154dfeee9" status: 200 len: 139 microversion: 2.1 time: 0.142208 Nov 02 13:51:36.939760 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3046/6475] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 13:51:36 2022] GET /compute/v2.1/os-tenant-networks/8d448a6f-367b-487c-9176-3da154dfeee9 => generated 139 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:37.454045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:37.454673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:37.485267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:37.485484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:37.486251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:37.487317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:37.487951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:37.488589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:37.774480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:37.782704 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f3effa68-d41a-4071-8ac6-4ab07ec6c6a5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1700 microversion: 2.1 time: 0.338138 Nov 02 13:51:37.783919 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3430/6476] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:37 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1700 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:38.811459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:38.812087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:38.822017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:38.822941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:38.823919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:38.825707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:38.826285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:38.827209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:39.023028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:39.033286 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d387008b-65a8-48ca-a4cc-21139773cd6e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1697 microversion: 2.1 time: 0.228206 Nov 02 13:51:39.043718 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3047/6477] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:38 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1697 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:39.069801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a49f2fd2-b226-4702-8d2a-58c40c48197e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:39.071380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a49f2fd2-b226-4702-8d2a-58c40c48197e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:39.087047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a49f2fd2-b226-4702-8d2a-58c40c48197e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:39.088391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a49f2fd2-b226-4702-8d2a-58c40c48197e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:39.089341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a49f2fd2-b226-4702-8d2a-58c40c48197e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:39.090250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a49f2fd2-b226-4702-8d2a-58c40c48197e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:39.092142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a49f2fd2-b226-4702-8d2a-58c40c48197e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:39.092864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a49f2fd2-b226-4702-8d2a-58c40c48197e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:39.307164 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a49f2fd2-b226-4702-8d2a-58c40c48197e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action" status: 204 len: 0 microversion: 2.1 time: 0.241647 Nov 02 13:51:39.310403 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3431/6478] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:51:39 2022] POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:51:39.323721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:39.334903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:39.348780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:39.349512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:39.351454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:39.352325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:39.352944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:39.353449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:39.384810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:39.606050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:39.620912 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-057bc95e-65d2-4b1d-b60f-56efd2d9a383 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1697 microversion: 2.1 time: 0.304659 Nov 02 13:51:39.621526 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3432/6479] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:39 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1697 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:39.675034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-30bcd5d8-c7f6-4bcd-8c84-074659016f22 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Action: 'create', calling method: .version_select at 0x7fe787d87d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-212151228"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:40.118844 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-30bcd5d8-c7f6-4bcd-8c84-074659016f22 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.032348 Nov 02 13:51:40.119595 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3048/6480] 10.222.0.113 () {60 vars in 1160 bytes} [Wed Nov 2 13:51:39 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1034 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Nov 02 13:51:40.133835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a362580c-49c0-44c5-82c8-2a12b722716c tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe78600f550>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:40.205490 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a362580c-49c0-44c5-82c8-2a12b722716c tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6" status: 200 len: 344 microversion: 2.1 time: 0.075565 Nov 02 13:51:40.208177 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3433/6481] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:40 2022] GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:40.562937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-2bfc21e3-b1c4-4d23-bc03-bab42e88c907 req-e0e7a02e-7e76-4126-9863-5b96098adc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283dce09-eb44-4fb0-be95-77eb073849fb", "name": "network-vif-plugged", "status": "completed", "tag": "13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:40.592123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2bfc21e3-b1c4-4d23-bc03-bab42e88c907 req-e0e7a02e-7e76-4126-9863-5b96098adc51 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:40.593125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2bfc21e3-b1c4-4d23-bc03-bab42e88c907 req-e0e7a02e-7e76-4126-9863-5b96098adc51 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:40.595185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2bfc21e3-b1c4-4d23-bc03-bab42e88c907 req-e0e7a02e-7e76-4126-9863-5b96098adc51 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:40.620422 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-2bfc21e3-b1c4-4d23-bc03-bab42e88c907 req-e0e7a02e-7e76-4126-9863-5b96098adc51 service nova] Creating event network-vif-plugged:13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3 for instance 283dce09-eb44-4fb0-be95-77eb073849fb on n-h2-858384-19 Nov 02 13:51:40.633635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-2bfc21e3-b1c4-4d23-bc03-bab42e88c907 req-e0e7a02e-7e76-4126-9863-5b96098adc51 service nova] Instance 283dce09-eb44-4fb0-be95-77eb073849fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:51:40.646050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:40.646673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:40.662617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:40.673155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:40.673716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:40.674627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:40.675140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:40.675597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:40.682717 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-2bfc21e3-b1c4-4d23-bc03-bab42e88c907 req-e0e7a02e-7e76-4126-9863-5b96098adc51 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125672 Nov 02 13:51:40.683366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3049/6482] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:40.907641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:40.919504 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-395d0032-d37e-4592-80c6-f335b6ce9710 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1697 microversion: 2.1 time: 0.277812 Nov 02 13:51:40.920607 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3434/6483] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:40 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1697 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:51:41.224836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49e3bc36-810e-4073-a81c-ad00d32f86c9 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe786d6dd30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:41.312033 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49e3bc36-810e-4073-a81c-ad00d32f86c9 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6" status: 200 len: 344 microversion: 2.1 time: 0.093476 Nov 02 13:51:41.312594 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3050/6484] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:41 2022] GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:41.946739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:41.948301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:41.957007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:41.958242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:41.958690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:41.959470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:41.959940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:41.960354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:42.131990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:42.144789 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4cd5cd2e-c620-47f8-af20-11f35e225dcf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1689 microversion: 2.1 time: 0.203310 Nov 02 13:51:42.146170 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3435/6485] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:41 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1689 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:42.328304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-18a723ee-58b6-4ced-a15b-dfdfa555cf6a tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe7865b79d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:42.386163 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-18a723ee-58b6-4ced-a15b-dfdfa555cf6a tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6" status: 200 len: 345 microversion: 2.1 time: 0.062024 Nov 02 13:51:42.386949 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3051/6486] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:42 2022] GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:42.404464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2aa3c8e-0794-48bb-9655-fd5e8725538c tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Action: 'create', calling method: .version_select at 0x7fe7860d5940>, body: {"snapshot": {"volume_id": "f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2130174148"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:42.635479 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2aa3c8e-0794-48bb-9655-fd5e8725538c tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.236866 Nov 02 13:51:42.636086 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3436/6487] 10.222.0.113 () {60 vars in 1167 bytes} [Wed Nov 2 13:51:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:42.649762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-128e2304-1a10-4d95-833c-4d883d06adcb tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe786d6dd30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:42.693281 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-128e2304-1a10-4d95-833c-4d883d06adcb tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533" status: 200 len: 287 microversion: 2.1 time: 0.049454 Nov 02 13:51:42.693869 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3052/6488] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:51:42 2022] GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:42.707833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-250dbaa3-6733-4cfd-8490-29299dd475c1 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe78600f550>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:42.752113 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-250dbaa3-6733-4cfd-8490-29299dd475c1 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.050439 Nov 02 13:51:42.752698 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3437/6489] 10.222.0.113 () {58 vars in 1145 bytes} [Wed Nov 2 13:51:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:51:42.764814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8eed0064-3962-4c34-943d-5168285c993d tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe78686f310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:42.804834 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8eed0064-3962-4c34-943d-5168285c993d tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533" status: 200 len: 287 microversion: 2.1 time: 0.043923 Nov 02 13:51:42.805617 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3053/6490] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:51:42 2022] GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:43.820283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-77f5edaf-da6f-41d5-bbaa-da0436097b26 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe78602f280>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:43.855232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-77f5edaf-da6f-41d5-bbaa-da0436097b26 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533" status: 200 len: 287 microversion: 2.1 time: 0.040513 Nov 02 13:51:43.855824 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3438/6491] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:51:43 2022] GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:44.869029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b193b0e5-019d-423f-8971-5c9605d9e7c2 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe78686f0d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:44.903363 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b193b0e5-019d-423f-8971-5c9605d9e7c2 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533" status: 200 len: 288 microversion: 2.1 time: 0.038110 Nov 02 13:51:44.903948 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3054/6492] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:51:44 2022] GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:44.917537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8aafc6e9-f4c8-4748-956f-e423f19b7132 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe7860d5dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:44.990261 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8aafc6e9-f4c8-4748-956f-e423f19b7132 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "DELETE /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533" status: 202 len: 0 microversion: 2.1 time: 0.078050 Nov 02 13:51:44.990854 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3439/6493] 10.222.0.113 () {58 vars in 1259 bytes} [Wed Nov 2 13:51:44 2022] DELETE /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:44.999386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ae5bf423-802f-42e8-aaf3-1ab6dee192f9 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe786d6d670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:45.032163 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ae5bf423-802f-42e8-aaf3-1ab6dee192f9 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533" status: 200 len: 287 microversion: 2.1 time: 0.036861 Nov 02 13:51:45.033522 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3055/6494] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:51:44 2022] GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:46.064471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d4915d5a-cb46-464e-b422-5dd5b621cff8 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe785f96ee0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:46.127365 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d4915d5a-cb46-464e-b422-5dd5b621cff8 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533" status: 200 len: 287 microversion: 2.1 time: 0.082681 Nov 02 13:51:46.131567 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3440/6495] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:51:46 2022] GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:47.142541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65f0d83c-2a35-4d03-a8bc-3227c7071cc5 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe787037310>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:47.172780 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-65f0d83c-2a35-4d03-a8bc-3227c7071cc5 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] HTTP exception thrown: Snapshot fd39c52b-48c5-439f-80fc-c636a4e3f533 could not be found. Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65f0d83c-2a35-4d03-a8bc-3227c7071cc5 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Request method failure captured: Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533 HTTP/1.1 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnXqZUdk06rFmm5eVpW6mhkX8vGmh23u05LIQ6_AwVHm3Yfl5Kmw1WGj8AYxQ-Np4zih0Ik0wcz5ZwF6tC5lqZ6jAcaY8q0xQ6doPVJ2VWYKeqvIL_Ck7QznRmN4zsxYt2VEmf383OCj5DBk48KVr7GUP5AGsV1x3MuwuvsULxn37a8 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 59bfa37036224f3c87e92e23957955d0 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_59bfa37036224f3c87e92e23957955d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 59bfa37036224f3c87e92e23957955d0 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesSnapshotsTestJSON-2040997312-project Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 697a783dd3924345acc5bb45ba1765c7 Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040997312-project Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: exception: Snapshot fd39c52b-48c5-439f-80fc-c636a4e3f533 could not be found. Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fd39c52b-48c5-439f-80fc-c636a4e3f533'} Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fd39c52b-48c5-439f-80fc-c636a4e3f533 could not be found. (HTTP 404) (Request-ID: req-98b9582b-26b7-4d26-a161-3f1f91da8af4) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:51:47.186640 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fd39c52b-48c5-439f-80fc-c636a4e3f533 could not be found. Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fd39c52b-48c5-439f-80fc-c636a4e3f533 could not be found. Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fd39c52b-48c5-439f-80fc-c636a4e3f533 could not be found. Nov 02 13:51:47.190110 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:47.196174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65f0d83c-2a35-4d03-a8bc-3227c7071cc5 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Returning 404 to user: Snapshot fd39c52b-48c5-439f-80fc-c636a4e3f533 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:47.197308 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-65f0d83c-2a35-4d03-a8bc-3227c7071cc5 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533" status: 404 len: 111 microversion: 2.1 time: 0.059979 Nov 02 13:51:47.198401 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3056/6496] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 13:51:47 2022] GET /compute/v2.1/os-snapshots/fd39c52b-48c5-439f-80fc-c636a4e3f533 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:47.208711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8672be58-113b-4bbb-8ba0-82f2203b871b tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe786bc5f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:47.304333 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8672be58-113b-4bbb-8ba0-82f2203b871b tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6" status: 202 len: 0 microversion: 2.1 time: 0.101072 Nov 02 13:51:47.305149 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3441/6497] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:51:47 2022] DELETE /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:51:47.314304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-54557f38-170d-4b67-9730-abb82d228e0f tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe7866b29d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:47.401076 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-54557f38-170d-4b67-9730-abb82d228e0f tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6" status: 200 len: 344 microversion: 2.1 time: 0.090631 Nov 02 13:51:47.402211 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3057/6498] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:47 2022] GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:51:48.418513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f7fe4716-9dd3-4498-8780-6bd2b07a69da tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe785fb60d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:48.485791 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f7fe4716-9dd3-4498-8780-6bd2b07a69da tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6" status: 200 len: 344 microversion: 2.1 time: 0.071831 Nov 02 13:51:48.486626 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3442/6499] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:48 2022] GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:49.500346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-85571d3c-5adb-47bb-8144-11053456febf tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe78686fd30>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:49.577620 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-85571d3c-5adb-47bb-8144-11053456febf tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] HTTP exception thrown: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-85571d3c-5adb-47bb-8144-11053456febf tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Request method failure captured: Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 HTTP/1.1 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnXqZUdk06rFmm5eVpW6mhkX8vGmh23u05LIQ6_AwVHm3Yfl5Kmw1WGj8AYxQ-Np4zih0Ik0wcz5ZwF6tC5lqZ6jAcaY8q0xQ6doPVJ2VWYKeqvIL_Ck7QznRmN4zsxYt2VEmf383OCj5DBk48KVr7GUP5AGsV1x3MuwuvsULxn37a8 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 59bfa37036224f3c87e92e23957955d0 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_59bfa37036224f3c87e92e23957955d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 59bfa37036224f3c87e92e23957955d0 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesSnapshotsTestJSON-2040997312-project Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 697a783dd3924345acc5bb45ba1765c7 Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040997312-project Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: exception: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6'} Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. (HTTP 404) (Request-ID: req-9518a8f9-7f89-4c83-9663-c4eb65ce14c7) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:51:49.580453 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-85571d3c-5adb-47bb-8144-11053456febf tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Returning 404 to user: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:49.585000 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-85571d3c-5adb-47bb-8144-11053456febf tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6" status: 404 len: 109 microversion: 2.1 time: 0.085979 Nov 02 13:51:49.599449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36b68cd7-b96e-4989-9412-8e79614d2ef6 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe7875473a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:49.600852 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3058/6500] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:49 2022] GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:49.635692 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-36b68cd7-b96e-4989-9412-8e79614d2ef6 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] HTTP exception thrown: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36b68cd7-b96e-4989-9412-8e79614d2ef6 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Request method failure captured: Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 HTTP/1.1 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnXqZUdk06rFmm5eVpW6mhkX8vGmh23u05LIQ6_AwVHm3Yfl5Kmw1WGj8AYxQ-Np4zih0Ik0wcz5ZwF6tC5lqZ6jAcaY8q0xQ6doPVJ2VWYKeqvIL_Ck7QznRmN4zsxYt2VEmf383OCj5DBk48KVr7GUP5AGsV1x3MuwuvsULxn37a8 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 59bfa37036224f3c87e92e23957955d0 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_59bfa37036224f3c87e92e23957955d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 59bfa37036224f3c87e92e23957955d0 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesSnapshotsTestJSON-2040997312-project Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 697a783dd3924345acc5bb45ba1765c7 Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040997312-project Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: method: Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: exception: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6'} Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. (HTTP 404) (Request-ID: req-21a5f1d2-6ca3-41eb-a2ce-0493d3d5db4f) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:51:49.638204 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36b68cd7-b96e-4989-9412-8e79614d2ef6 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Returning 404 to user: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:49.642497 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-36b68cd7-b96e-4989-9412-8e79614d2ef6 tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "DELETE /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6" status: 404 len: 109 microversion: 2.1 time: 0.045483 Nov 02 13:51:49.648936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba969e40-176d-4967-8768-eaf36729dfac tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Calling method '.version_select at 0x7fe786950700>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:49.653532 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3443/6501] 10.222.0.113 () {58 vars in 1253 bytes} [Wed Nov 2 13:51:49 2022] DELETE /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:49.696450 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-ba969e40-176d-4967-8768-eaf36729dfac tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] HTTP exception thrown: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba969e40-176d-4967-8768-eaf36729dfac tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Request method failure captured: Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 HTTP/1.1 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnXqZUdk06rFmm5eVpW6mhkX8vGmh23u05LIQ6_AwVHm3Yfl5Kmw1WGj8AYxQ-Np4zih0Ik0wcz5ZwF6tC5lqZ6jAcaY8q0xQ6doPVJ2VWYKeqvIL_Ck7QznRmN4zsxYt2VEmf383OCj5DBk48KVr7GUP5AGsV1x3MuwuvsULxn37a8 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 59bfa37036224f3c87e92e23957955d0 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_59bfa37036224f3c87e92e23957955d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/59bfa37036224f3c87e92e23957955d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 59bfa37036224f3c87e92e23957955d0 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040997312 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesSnapshotsTestJSON-2040997312-project Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 697a783dd3924345acc5bb45ba1765c7 Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040997312-project Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: method: Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: exception: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6'} Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. (HTTP 404) (Request-ID: req-dab243fb-75ff-4f72-87c2-28ff28f6d0ec) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 13:51:49.699527 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. Nov 02 13:51:49.703652 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:51:49.708778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba969e40-176d-4967-8768-eaf36729dfac tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] Returning 404 to user: Volume f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:51:49.709850 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba969e40-176d-4967-8768-eaf36729dfac tempest-VolumesSnapshotsTestJSON-2040997312 tempest-VolumesSnapshotsTestJSON-2040997312-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6" status: 404 len: 109 microversion: 2.1 time: 0.065184 Nov 02 13:51:49.710579 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3059/6502] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:49 2022] GET /compute/v2.1/os-volumes/f23ec0c7-dee0-4c07-9c2a-4d1d0d6764b6 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:51:52.203744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1683320343", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:52.225996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=17 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:52.227579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=17 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:52.268108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] validate_networks() for None {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:51:52.970445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:51:52.971080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:51:52.971868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:51:52.973167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:51:52.974089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:51:52.978161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b5f3cf0e-1d6d-4182-a89c-26ca222f4796 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe78682de50>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:52.985045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.985540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.985988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.986839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:52.987335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:52.987777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:52.988708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=15 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:52.990170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:51:53.021924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Getting quotas for project 372859e169f145bb852b05e5ee0426aa. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:51:53.028533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Getting quotas for user 6a4a35b995e5490f93a50e3e142fa1f6 and project 372859e169f145bb852b05e5ee0426aa. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:51:53.040212 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b5f3cf0e-1d6d-4182-a89c-26ca222f4796 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/df4b2952-8426-4d2f-84e5-f8dea782a380" status: 200 len: 351 microversion: 2.1 time: 0.065957 Nov 02 13:51:53.045894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:51:53.049262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3060/6503] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:52 2022] GET /compute/v2.1/os-volumes/df4b2952-8426-4d2f-84e5-f8dea782a380 => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:51:53.051268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:51:53.143339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1239b229-e38a-4c17-bc65-66aab9c31606 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.944435 Nov 02 13:51:53.145183 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3444/6504] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:51:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:51:53.163909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab4d8e97-22c0-49f0-a0e3-097d2756c6d4 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:53.164843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ab4d8e97-22c0-49f0-a0e3-097d2756c6d4 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:53.233734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab4d8e97-22c0-49f0-a0e3-097d2756c6d4 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:53.244928 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ab4d8e97-22c0-49f0-a0e3-097d2756c6d4 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1218 microversion: 2.1 time: 0.092265 Nov 02 13:51:53.245588 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3061/6505] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:53 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:54.277995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:54.278618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:54.291929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:54.292434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:54.293058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:54.293784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:54.294250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:54.294720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:54.380089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:54.388400 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c181de40-6767-459c-a847-6a4d5a365bc3 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1270 microversion: 2.1 time: 0.123025 Nov 02 13:51:54.389935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3445/6506] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:54 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:55.411929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:55.412482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:55.420274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:55.420766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:55.421211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:55.421957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:55.422425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:55.422859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:55.493336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:55.500966 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-12091a09-8611-4c95-90bc-6401b5a4f2ce tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1276 microversion: 2.1 time: 0.093596 Nov 02 13:51:55.501543 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3062/6507] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:55 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:55.590167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-245c3b25-bacd-4d23-aa51-3beac96d22c4 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe785fbe1f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:55.652121 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-245c3b25-bacd-4d23-aa51-3beac96d22c4 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/e99b719b-e0d5-485d-befd-d2f1a3c95f81" status: 200 len: 350 microversion: 2.1 time: 0.065804 Nov 02 13:51:55.652856 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3446/6508] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:55 2022] GET /compute/v2.1/os-volumes/e99b719b-e0d5-485d-befd-d2f1a3c95f81 => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:56.485619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-35b9ed4b-bb98-4fce-9607-5c2857366d44 req-cf84da00-3bb7-494f-8e28-12ae53b0b4bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d68b5fc-42c5-428e-831d-588f05af8c4a", "tag": "10dcb4db-6341-4581-8f9e-072735b4dbb9"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:51:56.500878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-35b9ed4b-bb98-4fce-9607-5c2857366d44 req-cf84da00-3bb7-494f-8e28-12ae53b0b4bd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:56.501689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-35b9ed4b-bb98-4fce-9607-5c2857366d44 req-cf84da00-3bb7-494f-8e28-12ae53b0b4bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:56.502322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-35b9ed4b-bb98-4fce-9607-5c2857366d44 req-cf84da00-3bb7-494f-8e28-12ae53b0b4bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:56.516685 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-35b9ed4b-bb98-4fce-9607-5c2857366d44 req-cf84da00-3bb7-494f-8e28-12ae53b0b4bd service nova] Creating event network-changed:10dcb4db-6341-4581-8f9e-072735b4dbb9 for instance 4d68b5fc-42c5-428e-831d-588f05af8c4a on n-h1-858384-19 Nov 02 13:51:56.526669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:56.528518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:56.540866 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-35b9ed4b-bb98-4fce-9607-5c2857366d44 req-cf84da00-3bb7-494f-8e28-12ae53b0b4bd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059199 Nov 02 13:51:56.542349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:56.543008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:56.544956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:56.545414 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3063/6509] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:56.546336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:56.546956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:56.547744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:56.728530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:56.739588 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d9afd20-db88-4d8b-8886-a858edc2d19d tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1318 microversion: 2.1 time: 0.216773 Nov 02 13:51:56.741151 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3447/6510] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:56 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:57.095138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3365be2f-2460-4cf4-ab4f-115ce20e0d16 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe78686fee0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.153191 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3365be2f-2460-4cf4-ab4f-115ce20e0d16 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/7a5e0a0e-6add-4445-a36d-19584f035b6d" status: 200 len: 350 microversion: 2.1 time: 0.062105 Nov 02 13:51:57.153726 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3064/6511] 10.222.0.113 () {58 vars in 1250 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-volumes/7a5e0a0e-6add-4445-a36d-19584f035b6d => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:57.169072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ad7b3a52-a495-4d22-9f90-b7859fdf3113 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe786058d30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.254345 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ad7b3a52-a495-4d22-9f90-b7859fdf3113 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089103 Nov 02 13:51:57.254932 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3448/6512] 10.222.0.113 () {58 vars in 1139 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:57.272753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b7abe58-08d0-4401-8dea-e6d5283d82ca tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe78703e670>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.373729 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b7abe58-08d0-4401-8dea-e6d5283d82ca tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.104985 Nov 02 13:51:57.374400 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3065/6513] 10.222.0.113 () {58 vars in 1154 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:57.388512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-033cc932-9603-45ff-89cc-cd267423d132 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe785f99670>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.476145 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-033cc932-9603-45ff-89cc-cd267423d132 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091348 Nov 02 13:51:57.477660 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3449/6514] 10.222.0.113 () {58 vars in 1139 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:57.491859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b1c7240-91de-4b8e-adb0-17d66f4d866c tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe78656d8b0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.584180 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b1c7240-91de-4b8e-adb0-17d66f4d866c tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096699 Nov 02 13:51:57.584781 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3066/6515] 10.222.0.113 () {58 vars in 1172 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:57.600208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efbefceb-9ed5-4432-b3f9-650be72afec9 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe78602f310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.701445 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efbefceb-9ed5-4432-b3f9-650be72afec9 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.106658 Nov 02 13:51:57.702122 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3450/6516] 10.222.0.113 () {58 vars in 1175 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:51:57.716907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dae2ffa8-f2a3-418d-8dcf-6f3c34922a3c tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe78703e820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.764271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.765052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:57.773478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.774357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.774925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.775773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:57.776324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:57.776987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:57.825767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dae2ffa8-f2a3-418d-8dcf-6f3c34922a3c tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.112757 Nov 02 13:51:57.826585 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3067/6517] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:51:57.841305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bda33a54-96eb-4a94-a204-4f328f843f2a tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe78f90c820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:57.936232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:57.940358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bda33a54-96eb-4a94-a204-4f328f843f2a tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.102904 Nov 02 13:51:57.946294 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79dd9c8a-9741-42e4-9b68-f601315dc53e tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1318 microversion: 2.1 time: 0.185931 Nov 02 13:51:57.946753 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3068/6518] 10.222.0.113 () {58 vars in 1193 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:51:57.947472 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3451/6519] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:51:57.955137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31ccfd04-079f-4cb2-a8bf-37ac1552b0f7 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] Calling method '.version_select at 0x7fe78f90c4c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:58.041176 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-31ccfd04-079f-4cb2-a8bf-37ac1552b0f7 tempest-VolumesTestJSON-1135633255 tempest-VolumesTestJSON-1135633255-project] 10.222.0.113 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089741 Nov 02 13:51:58.041770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3069/6520] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 13:51:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:51:58.971101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:51:58.972474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:51:58.980339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:58.980824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:58.981274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:58.981991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:51:58.982453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:51:58.982891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:51:59.141583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:51:59.153572 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5e2302bb-6318-46f1-ac0f-0cd8a4b0d133 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1318 microversion: 2.1 time: 0.186353 Nov 02 13:51:59.155156 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3452/6521] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:51:58 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:00.179331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:00.180339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:00.187502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:00.187989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:00.188428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:00.189138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:00.189589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:00.190201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:00.345898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:00.359580 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-437fd635-685b-4fda-a508-aa6ea188bae8 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1318 microversion: 2.1 time: 0.185212 Nov 02 13:52:00.360956 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3070/6522] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:00 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:01.385973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:01.386703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:01.394034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:01.394600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:01.395103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:01.395973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:01.396492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:01.396986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:01.601108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:01.610632 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0383f872-ea09-490d-a6fd-45d081d03b06 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1318 microversion: 2.1 time: 0.228950 Nov 02 13:52:01.611707 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3453/6523] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:01 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:02.634749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:02.635578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:02.646760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:02.648545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:02.651740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:02.653213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:02.653213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:02.653930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:02.869443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:02.882627 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a06dfce-ee08-4ddf-977a-4b58d8f246f5 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1318 microversion: 2.1 time: 0.251806 Nov 02 13:52:02.898648 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3071/6524] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:02 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:03.908321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c42391fe-fbf8-4e98-91e7-609afabe1038 req-586b17a1-ed66-4066-a60b-d9dd87b3e64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d68b5fc-42c5-428e-831d-588f05af8c4a", "name": "network-vif-plugged", "status": "completed", "tag": "10dcb4db-6341-4581-8f9e-072735b4dbb9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:03.919982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:03.921467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:03.926338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:03.928306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:03.930588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c42391fe-fbf8-4e98-91e7-609afabe1038 req-586b17a1-ed66-4066-a60b-d9dd87b3e64f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:03.931362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c42391fe-fbf8-4e98-91e7-609afabe1038 req-586b17a1-ed66-4066-a60b-d9dd87b3e64f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:03.931905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c42391fe-fbf8-4e98-91e7-609afabe1038 req-586b17a1-ed66-4066-a60b-d9dd87b3e64f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:03.942420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:03.946575 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c42391fe-fbf8-4e98-91e7-609afabe1038 req-586b17a1-ed66-4066-a60b-d9dd87b3e64f service nova] Creating event network-vif-plugged:10dcb4db-6341-4581-8f9e-072735b4dbb9 for instance 4d68b5fc-42c5-428e-831d-588f05af8c4a on n-h1-858384-19 Nov 02 13:52:03.952169 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c42391fe-fbf8-4e98-91e7-609afabe1038 req-586b17a1-ed66-4066-a60b-d9dd87b3e64f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047682 Nov 02 13:52:03.952383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:03.952989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:03.953446 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3454/6525] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:03.954520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:03.955681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:03.956172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:03.956900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:04.185752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:04.195700 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2ca4bf0a-a09a-42cd-b0bd-37c729e55499 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1318 microversion: 2.1 time: 0.282147 Nov 02 13:52:04.196586 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3072/6526] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:03 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:52:05.222347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:05.224794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:05.231481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.232191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.232783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.233648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:05.234255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:05.234841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:05.426709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:05.445264 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-13da16bf-2df9-42df-92e2-6851e971df7f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1318 microversion: 2.1 time: 0.228399 Nov 02 13:52:05.446256 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3455/6527] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:05 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:06.469825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:06.470506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:06.478761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:06.479281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:06.480144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:06.481686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:06.482157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:06.482762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:06.661806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:06.670839 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2a416f64-eb75-49b4-915c-5d10757bf878 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1468 microversion: 2.1 time: 0.206052 Nov 02 13:52:06.671446 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3073/6528] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:06 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1468 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:06.695550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6a6997c2-28e4-4b34-9ceb-e8be86841362 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aae7ebc0-dfe3-48b1-90f2-876654de4e93", "device": "/dev/sdb"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:06.698053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a6997c2-28e4-4b34-9ceb-e8be86841362 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:06.707590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6997c2-28e4-4b34-9ceb-e8be86841362 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:06.708159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6997c2-28e4-4b34-9ceb-e8be86841362 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:06.708759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6997c2-28e4-4b34-9ceb-e8be86841362 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:06.709521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6997c2-28e4-4b34-9ceb-e8be86841362 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:06.710046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6997c2-28e4-4b34-9ceb-e8be86841362 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:06.711142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6997c2-28e4-4b34-9ceb-e8be86841362 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:06.741494 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:52:06.741648 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 13:52:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a/os-volume_attachments (ip 10.222.0.113) !!! Nov 02 13:52:07.043354 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6a6997c2-28e4-4b34-9ceb-e8be86841362 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "POST /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352720 Nov 02 13:52:07.049300 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3456/6529] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:52:06 2022] POST /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:16.430965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1643d0a3-fd58-46d6-bd8a-5f615b4d8129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:16.433433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1643d0a3-fd58-46d6-bd8a-5f615b4d8129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:16.442162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1643d0a3-fd58-46d6-bd8a-5f615b4d8129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.442478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1643d0a3-fd58-46d6-bd8a-5f615b4d8129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.443214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1643d0a3-fd58-46d6-bd8a-5f615b4d8129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.444276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1643d0a3-fd58-46d6-bd8a-5f615b4d8129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:16.444737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1643d0a3-fd58-46d6-bd8a-5f615b4d8129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:16.445249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1643d0a3-fd58-46d6-bd8a-5f615b4d8129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:16.506203 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1643d0a3-fd58-46d6-bd8a-5f615b4d8129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action" status: 200 len: 24579 microversion: 2.1 time: 0.079470 Nov 02 13:52:16.507403 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3074/6530] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:52:16 2022] POST /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb/action => generated 24579 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:52:34.046861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c00a010-4704-4bba-b96d-24e58f57eca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:34.047622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0c00a010-4704-4bba-b96d-24e58f57eca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:34.051161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:34.052142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:34.058621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c00a010-4704-4bba-b96d-24e58f57eca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:34.059129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c00a010-4704-4bba-b96d-24e58f57eca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:34.059587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c00a010-4704-4bba-b96d-24e58f57eca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:34.060326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c00a010-4704-4bba-b96d-24e58f57eca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:34.060778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c00a010-4704-4bba-b96d-24e58f57eca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:34.061372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c00a010-4704-4bba-b96d-24e58f57eca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:34.090783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c00a010-4704-4bba-b96d-24e58f57eca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/ips" status: 200 len: 151 microversion: 2.20 time: 0.048454 Nov 02 13:52:34.091414 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3457/6531] 10.222.0.113 () {60 vars in 1294 bytes} [Wed Nov 2 13:52:34 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:52:37.258836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:37.261127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:37.269845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=18 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:37.270734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=36 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:37.272901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.273734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.274460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.275358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.275974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.276544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.318067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lazy-loading 'flavor' on Instance uuid 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:52:37.624811 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a40e6a2a-6efe-470f-b5af-c57ab0e1b66f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/action" status: 202 len: 0 microversion: 2.20 time: 0.370822 Nov 02 13:52:37.628988 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3075/6532] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:52:37 2022] POST /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:52:37.637728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:37.640380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:37.652997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.653597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.654753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.659510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:37.660685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:37.661378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:37.911489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:37.948015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:37.950094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:37.951406 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0267e585-a361-4bd8-8630-25983954d44b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.317972 Nov 02 13:52:37.952304 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3458/6533] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:37 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:52:38.995016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:38.997184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:39.018519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:39.019378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:39.026738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:39.027721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:39.028357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:39.028865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:39.205056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-140e2da4-582e-480e-a307-4815162a19aa tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:39.206518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-140e2da4-582e-480e-a307-4815162a19aa tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:39.224174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140e2da4-582e-480e-a307-4815162a19aa tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:39.224943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140e2da4-582e-480e-a307-4815162a19aa tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:39.225746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140e2da4-582e-480e-a307-4815162a19aa tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:39.228094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140e2da4-582e-480e-a307-4815162a19aa tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:39.228827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140e2da4-582e-480e-a307-4815162a19aa tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:39.229878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-140e2da4-582e-480e-a307-4815162a19aa tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:39.296806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:39.319791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:39.321280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:39.322472 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c5ac837-17a4-43b7-a80b-3c7e3be6818e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.340435 Nov 02 13:52:39.323041 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3076/6534] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:38 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:52:39.328888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1173411320", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "946c8dd4-659f-4209-8b7c-672b7d5e1378"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:39.424632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] validate_networks() for [('946c8dd4-659f-4209-8b7c-672b7d5e1378', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:52:39.427925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-140e2da4-582e-480e-a307-4815162a19aa tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1842 microversion: 2.1 time: 0.227958 Nov 02 13:52:39.430245 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3459/6535] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:39 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1842 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:52:40.296768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:52:40.297325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:52:40.297805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:52:40.298243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:52:40.298651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:52:40.308600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.309085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.309526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.310264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.310716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.311259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.331814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Getting quotas for project 91576e0d40cb423692d205519af2bb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:52:40.337802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Getting quotas for user 989216ae9bb6405a8f0d352299f49f77 and project 91576e0d40cb423692d205519af2bb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:52:40.351822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:40.352994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:40.360073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.360801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.361391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.361953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:52:40.362457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.363080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.363695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.364867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:52:40.427409 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a3a21d64-7603-4058-b8ac-5e5a5a15b378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.103050 Nov 02 13:52:40.435207 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3077/6536] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:52:39 2022] POST /compute/v2.1/servers => generated 382 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:52:40.442500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a2a65ae1-60f1-4e03-8e0d-24d4afd4fbff tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:40.443200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a2a65ae1-60f1-4e03-8e0d-24d4afd4fbff tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:40.556073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a2a65ae1-60f1-4e03-8e0d-24d4afd4fbff tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:40.575391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a2a65ae1-60f1-4e03-8e0d-24d4afd4fbff tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1223 microversion: 2.1 time: 0.138841 Nov 02 13:52:40.577344 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3078/6537] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:40 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:40.616989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:40.628170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:40.630104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:40.631565 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a39727c1-817d-4393-8b01-7eb04d716c3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.285213 Nov 02 13:52:40.632660 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3460/6538] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:40 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:52:40.918668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:40.919362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:40.931715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.932174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.932623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.933384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.936920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.937603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.946344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-d39b530e-2da5-4a87-802c-15a405f2e398 req-7f35daea-d1e9-4015-ac3d-238cd3279b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283dce09-eb44-4fb0-be95-77eb073849fb", "tag": "13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:40.969876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d39b530e-2da5-4a87-802c-15a405f2e398 req-7f35daea-d1e9-4015-ac3d-238cd3279b2d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:40.971506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d39b530e-2da5-4a87-802c-15a405f2e398 req-7f35daea-d1e9-4015-ac3d-238cd3279b2d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:40.972203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-d39b530e-2da5-4a87-802c-15a405f2e398 req-7f35daea-d1e9-4015-ac3d-238cd3279b2d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:40.980354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:52:41.000145 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-d39b530e-2da5-4a87-802c-15a405f2e398 req-7f35daea-d1e9-4015-ac3d-238cd3279b2d service nova] Creating event network-changed:13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3 for instance 283dce09-eb44-4fb0-be95-77eb073849fb on n-h2-858384-19 Nov 02 13:52:41.013108 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-d39b530e-2da5-4a87-802c-15a405f2e398 req-7f35daea-d1e9-4015-ac3d-238cd3279b2d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066729 Nov 02 13:52:41.014486 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3461/6539] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:52:41.162258 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-477219d4-9151-4f09-a0ca-884794a61a13 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "DELETE /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 204 len: 0 microversion: 2.1 time: 0.247245 Nov 02 13:52:41.163675 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3079/6540] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:52:40 2022] DELETE /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:52:41.175048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:41.176393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:41.198724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.199710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.200336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.202434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.203678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.206435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.568668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:41.578323 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f8d7af88-5ed3-4ad9-9743-a3d70cc5628e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1695 microversion: 2.1 time: 0.409532 Nov 02 13:52:41.584204 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3462/6541] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:41 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1695 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:41.603265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:41.604608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:41.614186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.614949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.615568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.616464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.617085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.617847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.662153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:41.663298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:41.672718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.674854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.675742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.676707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:41.677569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:41.678292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:41.818550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:41.827960 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c3cc6031-b047-4a15-9346-10c11cad483b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1275 microversion: 2.1 time: 0.230403 Nov 02 13:52:41.829204 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3080/6542] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:41 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:41.856109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:41.867915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:41.869527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:41.870910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fbb8daa7-771d-422e-9dfc-411afaf65b3b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.217795 Nov 02 13:52:41.876241 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3463/6543] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:41 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:52:42.604867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:42.606444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:42.614807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.615643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.616313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:42.617256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.617938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.619050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:42.860410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:42.861934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:42.870554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:42.875678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.876612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.877927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:42.878889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.879422 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2cca8477-5454-42d7-932c-963e3e4daf34 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1695 microversion: 2.1 time: 0.278541 Nov 02 13:52:42.879701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.880041 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3081/6544] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:42 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1695 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:42.881299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:42.899172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:42.899863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:42.918709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.919329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.919998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:42.920899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:42.921541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:42.922159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:43.020692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:43.032193 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1f51c442-f048-4d3d-914d-947953b5c145 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1281 microversion: 2.1 time: 0.180917 Nov 02 13:52:43.047986 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3464/6545] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:42 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1281 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:52:43.275314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:43.289724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:43.297150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:43.305322 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-289bccd2-e10f-452c-a966-c5ab1ce8f8be tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.410499 Nov 02 13:52:43.306962 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3082/6546] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:42 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:52:43.913799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:43.915975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:43.946591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:43.959728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:43.961318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:43.962103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:43.962586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:43.963020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:44.082295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:44.086451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:44.106205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:44.113478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:44.114216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:44.115917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:44.116840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:44.118300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:44.119594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:44.126361 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-582c7382-b75c-4c62-808c-82a4994e05ca tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 200 len: 1508 microversion: 2.1 time: 0.222179 Nov 02 13:52:44.128714 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3465/6547] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:43 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:44.139871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-27633fad-10f7-4179-b743-3614e33ab562 req-1cd98897-7a4a-4e0b-91e3-6efa990d1597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283dce09-eb44-4fb0-be95-77eb073849fb", "name": "network-vif-deleted", "tag": "13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:44.159470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-27633fad-10f7-4179-b743-3614e33ab562 req-1cd98897-7a4a-4e0b-91e3-6efa990d1597 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:44.164461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-27633fad-10f7-4179-b743-3614e33ab562 req-1cd98897-7a4a-4e0b-91e3-6efa990d1597 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:44.165154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-27633fad-10f7-4179-b743-3614e33ab562 req-1cd98897-7a4a-4e0b-91e3-6efa990d1597 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:44.192976 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-27633fad-10f7-4179-b743-3614e33ab562 req-1cd98897-7a4a-4e0b-91e3-6efa990d1597 service nova] Creating event network-vif-deleted:13ebc1e0-62f3-4ac0-9803-3a9fa9280ec3 for instance 283dce09-eb44-4fb0-be95-77eb073849fb on n-h2-858384-19 Nov 02 13:52:44.212129 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-27633fad-10f7-4179-b743-3614e33ab562 req-1cd98897-7a4a-4e0b-91e3-6efa990d1597 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081807 Nov 02 13:52:44.213508 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3466/6548] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:44.338459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:44.339323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:44.367068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:44.368854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:44.384582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:44.387244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:44.387751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:44.390535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:44.454656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:44.470170 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff075005-64cf-454a-acfe-54774cbd2e7e tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1323 microversion: 2.1 time: 0.416054 Nov 02 13:52:44.477944 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3083/6549] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:44 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1323 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:52:44.805639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:44.811752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:44.813560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:44.815314 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cf8ef823-0259-4b6f-bfd1-b372c947d5b3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.482659 Nov 02 13:52:44.816421 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3467/6550] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:44 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:52:45.153079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:45.156253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 283dce09-eb44-4fb0-be95-77eb073849fb] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:45.169890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.172239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.172239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.172239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.172920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.173517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.196954 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] HTTP exception thrown: Instance 283dce09-eb44-4fb0-be95-77eb073849fb could not be found. Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Request method failure captured: Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb HTTP/1.1 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnVXBJjYVYKia0vxbjWHpLhZPUXqy9qzXWuRFgQYAN7DfSZl64uS6JBaetuwYeaWGbSLwXk357QnJPGHHhI5ySkNmd7QeR6UkGdWVUkROaqFFPeO96O11eREIt2L19I24aIfpQUjmqwFvMmflCc2eMLpoTDom0x1gkoXw5KYIpfQ2wc Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: bc97329dcfb8453795347d9e818d9d92 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: bc97329dcfb8453795347d9e818d9d92 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestNetworkAdvancedServerOps-423495247-project Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 41c7ca068dba4093880183ae9b2f0935 Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestNetworkAdvancedServerOps-423495247-project Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 283dce09-eb44-4fb0-be95-77eb073849fb could not be found. Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '283dce09-eb44-4fb0-be95-77eb073849fb'} Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283dce09-eb44-4fb0-be95-77eb073849fb could not be found. Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283dce09-eb44-4fb0-be95-77eb073849fb could not be found. Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:52:45.199788 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:52:45.204354 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:52:45.204354 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:52:45.204354 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:52:45.204354 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:52:45.204354 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:52:45.204354 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:52:45.204354 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283dce09-eb44-4fb0-be95-77eb073849fb could not be found. Nov 02 13:52:45.204354 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:52:45.207039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Returning 404 to user: Instance 283dce09-eb44-4fb0-be95-77eb073849fb could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:52:45.208173 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cec3a00b-4d95-41c4-9686-6435a7fe2df0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb" status: 404 len: 111 microversion: 2.1 time: 0.059471 Nov 02 13:52:45.212622 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3084/6551] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:45 2022] GET /compute/v2.1/servers/283dce09-eb44-4fb0-be95-77eb073849fb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:52:45.506054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:45.507442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:45.529871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.530715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.534333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.535355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.536024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.536530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.785622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:45.794788 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a26ef4e5-c376-40dd-891e-976f8df02d5f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1323 microversion: 2.1 time: 0.296755 Nov 02 13:52:45.796041 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3468/6552] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:45 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:45.841896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:45.842674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:45.855994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.856491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.856935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:45.857647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:45.858106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:45.858638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:46.125121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:46.136124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:46.138695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:46.140648 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-499aaaaf-d88e-45fd-9a74-6bd0511a85c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.302805 Nov 02 13:52:46.142381 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3085/6553] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:45 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:52:46.259327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-48eb11cb-c9bd-4398-b665-a5fa983a41e4 req-d52b06f8-7e2e-4b83-9519-904981de479a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97df1cd3-29d4-4407-bdde-397e21a8e579", "tag": "1cf6c6c4-8b96-478d-8bbf-4bb2bf2ceed8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:46.272314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-48eb11cb-c9bd-4398-b665-a5fa983a41e4 req-d52b06f8-7e2e-4b83-9519-904981de479a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:46.272984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-48eb11cb-c9bd-4398-b665-a5fa983a41e4 req-d52b06f8-7e2e-4b83-9519-904981de479a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:46.273979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-48eb11cb-c9bd-4398-b665-a5fa983a41e4 req-d52b06f8-7e2e-4b83-9519-904981de479a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:46.304170 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-48eb11cb-c9bd-4398-b665-a5fa983a41e4 req-d52b06f8-7e2e-4b83-9519-904981de479a service nova] Creating event network-changed:1cf6c6c4-8b96-478d-8bbf-4bb2bf2ceed8 for instance 97df1cd3-29d4-4407-bdde-397e21a8e579 on n-h1-858384-19 Nov 02 13:52:46.309968 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-48eb11cb-c9bd-4398-b665-a5fa983a41e4 req-d52b06f8-7e2e-4b83-9519-904981de479a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054405 Nov 02 13:52:46.311076 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3469/6554] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:52:46.819106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:46.823450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:46.836912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:46.837707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:46.838348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:46.839085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:46.842203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:46.842860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.108370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:47.121192 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d8e7eb1-aa13-4c06-82c5-74152d1d0cf6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1323 microversion: 2.1 time: 0.305994 Nov 02 13:52:47.144412 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3086/6555] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:46 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1323 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:47.169595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:47.170320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:47.179522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.180491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.181647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.182674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:47.183895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:47.184309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:47.687136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:47.707424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:47.713760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:47.715861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15981964-4c96-47a5-99b6-beee17553e01 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.551187 Nov 02 13:52:47.720528 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3470/6556] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:47 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:52:48.152101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:48.153278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:48.160181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.171498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.172217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.173047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.173671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.174285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.748481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:48.749091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:48.767520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.768918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.769362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.770090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:48.770551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:48.775642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:48.915580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:48.932501 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-00be6439-0599-4793-905d-4ccaeb7a8a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1323 microversion: 2.1 time: 0.784833 Nov 02 13:52:48.933107 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3087/6557] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:48 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1323 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:49.261001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:49.287906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:49.291427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:49.293534 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05271b72-0705-4221-9d69-a2830c930a62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.549297 Nov 02 13:52:49.300426 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3471/6558] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:48 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:52:49.961445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:49.963458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:49.976165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:49.977051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:49.977681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:49.982896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:49.983550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:49.984127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:50.188244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:50.197735 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-13bcf7af-2b3d-4eff-9fb0-1806de85a274 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1323 microversion: 2.1 time: 0.240151 Nov 02 13:52:50.198361 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3088/6559] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:49 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1323 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:50.331996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:50.333370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:50.342648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:50.343376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:50.344703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:50.346574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:50.347246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:50.348101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:50.756881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:50.768377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:50.771643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:50.773433 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-781f4e7e-d840-4e52-a221-13c1e48d2f77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.446727 Nov 02 13:52:50.774613 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3472/6560] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:50 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:52:51.223179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:51.223179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:51.224989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:51.225878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:51.242089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:51.242586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:51.243033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:51.250366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:51.252417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:51.255350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:51.341177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-62a40093-4a4c-48be-bdd4-aaeea0675e5c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '.version_select at 0x7fe7860e93a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:51.395874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-62a40093-4a4c-48be-bdd4-aaeea0675e5c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1619075422" status: 202 len: 0 microversion: 2.1 time: 0.058485 Nov 02 13:52:51.403776 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3473/6561] 10.222.0.113 () {58 vars in 1289 bytes} [Wed Nov 2 13:52:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1619075422 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:52:51.429171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2115592f-e23b-4871-9617-ff5fe2911a97 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'create', calling method: .version_select at 0x7fe785f99b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2015604873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzAlMdmwfOTha0YMAsQqshuRfWBoshBcYHErFslYHs/JBjJp1QhNT5WxT5Zbh+f79GOpti8OyORG2xiuMQJXZpbqmSZSQwRYFq+jQMmaubTV6i2xsnXJaHkMVnHuwm7EQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:51.451060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2115592f-e23b-4871-9617-ff5fe2911a97 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for project bc97329dcfb8453795347d9e818d9d92. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:52:51.458463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2115592f-e23b-4871-9617-ff5fe2911a97 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for user 41c7ca068dba4093880183ae9b2f0935 and project bc97329dcfb8453795347d9e818d9d92. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:52:51.478758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:51.489086 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6afcdb79-1d7e-44eb-b907-29cee397f67b tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1323 microversion: 2.1 time: 0.271873 Nov 02 13:52:51.492244 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2115592f-e23b-4871-9617-ff5fe2911a97 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.067002 Nov 02 13:52:51.492910 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3474/6562] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:52:51 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:52:51.495865 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3089/6563] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:51 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:51.800407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:51.801032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:51.807811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:51.808827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:51.809507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:51.810471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:51.811174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:51.811830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:52.105775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7f3f02e8-2d36-4893-8d73-61336e492f0c req-b5b44173-dda3-4531-adfe-a2398d89c591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97df1cd3-29d4-4407-bdde-397e21a8e579", "name": "network-vif-plugged", "status": "completed", "tag": "1cf6c6c4-8b96-478d-8bbf-4bb2bf2ceed8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:52.129114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7f3f02e8-2d36-4893-8d73-61336e492f0c req-b5b44173-dda3-4531-adfe-a2398d89c591 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:52.131974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7f3f02e8-2d36-4893-8d73-61336e492f0c req-b5b44173-dda3-4531-adfe-a2398d89c591 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:52.133110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7f3f02e8-2d36-4893-8d73-61336e492f0c req-b5b44173-dda3-4531-adfe-a2398d89c591 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:52.164937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:52.182533 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7f3f02e8-2d36-4893-8d73-61336e492f0c req-b5b44173-dda3-4531-adfe-a2398d89c591 service nova] Creating event network-vif-plugged:1cf6c6c4-8b96-478d-8bbf-4bb2bf2ceed8 for instance 97df1cd3-29d4-4407-bdde-397e21a8e579 on n-h1-858384-19 Nov 02 13:52:52.206598 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7f3f02e8-2d36-4893-8d73-61336e492f0c req-b5b44173-dda3-4531-adfe-a2398d89c591 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105042 Nov 02 13:52:52.208296 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3090/6564] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:52:52.255315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:52.301261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:52.302785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:52.314288 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c4f9ea7b-e252-4bdd-8a0a-fb367475f753 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.507824 Nov 02 13:52:52.315746 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3475/6565] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:51 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:52:52.523889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:52.525884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:52.547272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:52.548924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:52.549986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:52.551071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:52.551704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:52.552284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:52.770770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:52.782310 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b4845a4e-e4c7-4eaf-9c7c-0b011b23086a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1323 microversion: 2.1 time: 0.263869 Nov 02 13:52:52.785997 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3091/6566] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:52 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:53.344552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:53.346527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:53.353950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:53.354706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:53.355491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:53.356379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:53.357008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:53.357757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:53.591440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:53.604221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:53.606478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:53.607996 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-61392746-53a9-44e6-b239-de234747cc7c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.267494 Nov 02 13:52:53.608719 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3476/6567] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:53 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:52:53.812161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:53.813284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:53.821384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:53.822044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:53.822736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:53.823666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:53.827446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:53.828608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:54.287368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:54.298224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c37e0ba2-49c5-4b34-911d-94dba4ee61dc tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1323 microversion: 2.1 time: 0.491701 Nov 02 13:52:54.298860 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3092/6568] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:53 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1323 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:52:54.634144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:54.635024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:54.643445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:54.644242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:54.644800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:54.660131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:54.663245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:54.663795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:54.982135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:54.987953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:52:55.003157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:55.008655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:55.009884 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f5b2680e-a0d6-435e-bbc3-bb14b0eac47d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1747 microversion: 2.20 time: 0.379867 Nov 02 13:52:55.016427 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3477/6569] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:54 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1747 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:52:55.326271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:55.327252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:55.344002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:55.347224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:55.347914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:55.349748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:55.351567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:55.352204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:55.659973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:55.671039 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-58b8ab87-fe3a-4366-8ed0-b2f9a7b053a5 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1511 microversion: 2.1 time: 0.352670 Nov 02 13:52:55.671877 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3093/6570] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:52:55 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:52:56.037976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:56.038577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:56.055007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:56.056210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:56.056659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:56.059290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:56.066670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:56.066997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:56.392279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:56.402726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:56.407170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:56.408728 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d4a4894-cfc0-41eb-88cb-c5a249c34aa5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1747 microversion: 2.20 time: 0.375661 Nov 02 13:52:56.409330 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3478/6571] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:56 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1747 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:52:57.401883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-77245896-7ec0-4a2e-9704-bc41cecebc98 req-1017ffd9-2ecf-4945-bb0d-869329ad0f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf26b2-214b-40c4-b5c2-81cf8524b8e7", "name": "network-vif-plugged", "status": "completed", "tag": "62875f3c-3f2e-4138-869d-d53e38408179"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:52:57.423407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-77245896-7ec0-4a2e-9704-bc41cecebc98 req-1017ffd9-2ecf-4945-bb0d-869329ad0f70 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:57.437988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:57.439270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:57.450209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-77245896-7ec0-4a2e-9704-bc41cecebc98 req-1017ffd9-2ecf-4945-bb0d-869329ad0f70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:57.451181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-77245896-7ec0-4a2e-9704-bc41cecebc98 req-1017ffd9-2ecf-4945-bb0d-869329ad0f70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:57.480249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:57.484803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:57.487753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:57.496264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:57.497705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:57.499303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:57.522822 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-77245896-7ec0-4a2e-9704-bc41cecebc98 req-1017ffd9-2ecf-4945-bb0d-869329ad0f70 service nova] Creating event network-vif-plugged:62875f3c-3f2e-4138-869d-d53e38408179 for instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 on n-h2-858384-19 Nov 02 13:52:57.567695 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-77245896-7ec0-4a2e-9704-bc41cecebc98 req-1017ffd9-2ecf-4945-bb0d-869329ad0f70 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169654 Nov 02 13:52:57.573850 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3094/6572] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:52:57.977618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:58.008395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:58.013754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:58.020109 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6067be72-4280-44be-9758-acb41329a1e6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1747 microversion: 2.20 time: 0.584025 Nov 02 13:52:58.028338 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3479/6573] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:57 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1747 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:52:59.062202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:52:59.065437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:52:59.089759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:59.090267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:59.097066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:59.102980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:52:59.104152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:52:59.105629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:52:59.751206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:59.771157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:59.772983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:52:59.775626 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0715cca1-91c1-4af1-9bcb-8ca94625fd43 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.720858 Nov 02 13:52:59.782479 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3095/6574] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:52:59 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:00.806693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:00.808271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:00.844878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:00.847017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:00.847904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:00.858010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:00.859693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:00.860389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:01.466921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:01.624968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:01.647309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:01.650207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:01.652217 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f4976e76-929e-46d7-9497-bcc462b41981 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.853002 Nov 02 13:53:01.652981 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3480/6575] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:00 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:02.683183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:02.685014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:02.711683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.712763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.713669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:02.717333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:02.718051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:02.719064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:03.002961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:03.044054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:03.045628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:03.052734 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe38549c-abf3-40f8-b2a2-f4140d4a24c2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.375558 Nov 02 13:53:03.057725 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3096/6576] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:02 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:03.357855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1130808515", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "4f67346a-f4f0-4299-a8ae-15281b1b0ce4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2015604873", "security_groups": [{"name": "tempest-secgroup-smoke-374115896"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:04.083814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:04.084433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:04.105044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:04.105831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:04.106277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:04.115011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:04.115519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:04.115977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:04.620716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:04.635360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:04.637200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:04.641421 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-255e6074-5c50-4069-a2ac-748d132da193 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.563431 Nov 02 13:53:04.645204 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3097/6577] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:04 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:05.706435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:05.720200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:05.740028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.740626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.741051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:05.741910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:05.746726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:05.747226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:06.064984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:06.075064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:06.077092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:06.078465 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-278bf3e3-4e0f-441e-96ae-a13fdb58abeb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.400206 Nov 02 13:53:06.079743 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3098/6578] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:05 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:07.109073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:07.110423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:07.126025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:07.127948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:07.128527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:07.135141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:07.135841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:07.136679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:07.500066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:07.516364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:07.545056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:07.547360 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c170919-e699-4f97-869a-b9792f7ae773 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.445012 Nov 02 13:53:07.550534 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3099/6579] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:07 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:53:08.576897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:08.577486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:08.580808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:08.600018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:08.600518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:08.600962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:08.601677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:08.602131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:08.602553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:09.009825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:09.037201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:09.048422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:09.054524 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed073009-8b45-4c5a-ab16-42e2fa592c0c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.481302 Nov 02 13:53:09.056762 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3100/6580] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:08 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:53:10.091011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:10.092059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:10.117609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:10.119635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:10.120247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:10.136843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:10.140880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:10.144702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:10.609807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:10.624368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:10.625878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:10.627348 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2b1d756b-91e6-430a-bc64-45b357ca5348 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.540337 Nov 02 13:53:10.628057 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3101/6581] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:10 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:11.630666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=18 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:11.658866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:11.659500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:11.683424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:11.683939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:11.684395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:11.685144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:11.695713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:11.698039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:11.985991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:11.999691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:12.012117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:12.013944 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-46ec08d2-9579-4af5-ae61-dc4502dcf1c7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.359488 Nov 02 13:53:12.028773 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3102/6582] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:11 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:13.047854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:13.051316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:13.060152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:13.060917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:13.061558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:13.063734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:13.065765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:13.066628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:13.390978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:13.417116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:13.428673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:13.434698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:13.435634 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a02825f6-8177-4637-bd01-555e76f9b28c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.390004 Nov 02 13:53:13.438480 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3103/6583] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:13 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:53:14.476005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:14.476660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:14.490904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:14.496815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:14.497478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:14.498386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:14.499003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:14.500371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:14.707052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:14.723407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:14.729685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:14.731766 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03508252-9990-41cc-a1fe-53d616cdb367 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.259900 Nov 02 13:53:14.732958 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3104/6584] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:14 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:53:15.764234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:15.765442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:15.793341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:15.794101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:15.794867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:15.796562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:15.797201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:15.797913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:16.055196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:16.069253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:16.071554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:16.074857 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-69e1df1c-f05b-4219-9eff-d80b5b467263 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.312969 Nov 02 13:53:16.076058 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3105/6585] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:15 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:53:17.104039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:17.104768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:17.115607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:17.125866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:17.126329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:17.131866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:17.132353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:17.136273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:17.488416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:17.502985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:17.510206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:17.511815 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-50e23087-be7b-47b6-a27f-75ec9eb1fbc0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.413053 Nov 02 13:53:17.520830 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3106/6586] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:17 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:18.307047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] validate_networks() for [('4f67346a-f4f0-4299-a8ae-15281b1b0ce4', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:53:18.549304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:18.551099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:18.566193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:18.569576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:18.570352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:18.574452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:18.575584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:18.576269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:18.853401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:18.868054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:18.871579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:18.873138 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ef5c9752-b6b1-476a-b0df-38a87bca5048 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.328870 Nov 02 13:53:18.874964 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3107/6587] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:18 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:19.607453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:53:19.608436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:53:19.609723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:53:19.610435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:53:19.611022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:53:19.637513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:19.637513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:19.645869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:19.650276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:19.651301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:19.651918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:19.703146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for project bc97329dcfb8453795347d9e818d9d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:53:19.716008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for user 41c7ca068dba4093880183ae9b2f0935 and project bc97329dcfb8453795347d9e818d9d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:53:19.737773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:53:19.741042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:53:19.835282 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-98d585a7-4831-4e22-abab-eaed6cbb4a0d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 16.482244 Nov 02 13:53:19.836269 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3481/6588] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:53:03 2022] POST /compute/v2.1/servers => generated 407 bytes in 16484 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:53:19.849635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-25420e04-cf23-4a18-9716-3bd5ea70831c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:19.850234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-25420e04-cf23-4a18-9716-3bd5ea70831c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:19.901438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:19.903361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:19.918965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:19.919912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:19.931461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:19.932770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:19.933250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:19.933691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:20.050273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-25420e04-cf23-4a18-9716-3bd5ea70831c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:20.059431 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-25420e04-cf23-4a18-9716-3bd5ea70831c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1271 microversion: 2.1 time: 0.214428 Nov 02 13:53:20.060035 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3108/6589] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:19 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1271 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:20.356190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:20.379039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:20.384907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:20.388137 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7e497295-3bff-4096-b642-64a833e25911 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.490820 Nov 02 13:53:20.391005 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3482/6590] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:19 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:21.085531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:21.086149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:21.103322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:21.104105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:21.104940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:21.106197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:21.106816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:21.107591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:21.113577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:21.239231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:21.254510 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7dcfeb9-d0a2-4bbd-8b0c-fac0667c4faf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1267 microversion: 2.1 time: 0.170192 Nov 02 13:53:21.256354 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3109/6591] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:21 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:21.418597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:21.419573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:21.484772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:21.485168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:21.485808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:21.487261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:21.487720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:21.488161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:21.787434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:21.798215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:21.800078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:21.802244 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a3d11140-0446-40af-aaf3-c98038b3a299 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1742 microversion: 2.20 time: 0.388212 Nov 02 13:53:21.803177 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3483/6592] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:21 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1742 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:22.295445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:22.296218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:22.310254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:22.310873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:22.311451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:22.312277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:22.312910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:22.313451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:22.505027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:22.515408 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2258c1a7-2bd9-4b8e-aeef-781b755e441e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1329 microversion: 2.1 time: 0.223829 Nov 02 13:53:22.516277 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3110/6593] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:22 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1329 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:22.835616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:22.836889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:22.858190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:22.860435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:22.864445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:22.869446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:22.870438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:22.871910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.143773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:23.153174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:23.155095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:23.156556 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1a23ecd-4d1b-48ab-90d1-a06fbea87757 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1724 microversion: 2.20 time: 0.327385 Nov 02 13:53:23.157700 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3484/6594] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:22 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:23.540745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:23.541365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:23.553917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:23.558891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:23.560442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.563323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:23.564023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:23.565791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:23.741430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:23.750682 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f0d45227-b9f8-488c-8409-0f2b3c9fa9f3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1329 microversion: 2.1 time: 0.213839 Nov 02 13:53:23.774688 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3111/6595] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:23 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1329 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:24.188467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:24.190690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:24.205829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.210888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.211631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.212686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.213236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.213749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.524758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:24.537952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:24.539875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:24.549474 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ace1922a-2eae-412a-bb1c-265870014028 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1724 microversion: 2.20 time: 0.365771 Nov 02 13:53:24.563511 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3485/6596] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:24 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:24.782574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:24.783996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:24.803780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.804636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.805292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.806266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:24.807146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:24.807839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:24.990929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-16555e4d-8413-438b-9696-3c553485324e req-21ca4dd4-fa63-4842-b6af-4162a7ca1852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf26b2-214b-40c4-b5c2-81cf8524b8e7", "name": "network-vif-unplugged", "status": "completed", "tag": "62875f3c-3f2e-4138-869d-d53e38408179"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:25.004867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-16555e4d-8413-438b-9696-3c553485324e req-21ca4dd4-fa63-4842-b6af-4162a7ca1852 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:25.005609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-16555e4d-8413-438b-9696-3c553485324e req-21ca4dd4-fa63-4842-b6af-4162a7ca1852 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:25.006171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-16555e4d-8413-438b-9696-3c553485324e req-21ca4dd4-fa63-4842-b6af-4162a7ca1852 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:25.019430 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-16555e4d-8413-438b-9696-3c553485324e req-21ca4dd4-fa63-4842-b6af-4162a7ca1852 service nova] Creating event network-vif-unplugged:62875f3c-3f2e-4138-869d-d53e38408179 for instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 on n-h2-858384-19 Nov 02 13:53:25.026920 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-16555e4d-8413-438b-9696-3c553485324e req-21ca4dd4-fa63-4842-b6af-4162a7ca1852 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041320 Nov 02 13:53:25.027732 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3486/6597] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:25.141549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:25.153143 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-decd311e-d151-4842-9bf1-94435be5d2f4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1396 microversion: 2.1 time: 0.374437 Nov 02 13:53:25.153761 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3112/6598] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:24 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1396 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:25.581015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:25.581745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:25.599619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:25.600122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:25.600569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:25.601298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:25.608238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:25.612544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:26.132489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:26.159820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:26.161793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:26.163890 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1fd96ef-6cfe-419a-acd5-f8ba493229c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1724 microversion: 2.20 time: 0.590247 Nov 02 13:53:26.166429 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3487/6599] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:25 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1724 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:26.195094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:26.198995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:26.211788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:26.212626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:26.213469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:26.214818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:26.215828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:26.216491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:26.623510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:26.632394 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7e02ab2a-4d10-4fd0-b55d-0b82306876f6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1396 microversion: 2.1 time: 0.444526 Nov 02 13:53:26.641116 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3113/6600] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:26 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1396 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:26.991313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ac54e09c-6723-4ea5-9d7d-f443dba20cad req-10afa4e3-c1cb-4031-bf63-bfba928b92e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:27.010515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ac54e09c-6723-4ea5-9d7d-f443dba20cad req-10afa4e3-c1cb-4031-bf63-bfba928b92e1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.011263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ac54e09c-6723-4ea5-9d7d-f443dba20cad req-10afa4e3-c1cb-4031-bf63-bfba928b92e1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.011858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ac54e09c-6723-4ea5-9d7d-f443dba20cad req-10afa4e3-c1cb-4031-bf63-bfba928b92e1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.026006 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ac54e09c-6723-4ea5-9d7d-f443dba20cad req-10afa4e3-c1cb-4031-bf63-bfba928b92e1 service nova] Creating event network-changed:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h2-858384-19 Nov 02 13:53:27.034177 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ac54e09c-6723-4ea5-9d7d-f443dba20cad req-10afa4e3-c1cb-4031-bf63-bfba928b92e1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046011 Nov 02 13:53:27.036182 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3488/6601] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:27.196542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:27.198380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:27.232607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.233464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.234121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.235527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.237135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.248824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.549744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:27.561581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:27.563885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:27.569667 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-07961d10-ba71-47e1-914b-a829870173fb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1667 microversion: 2.20 time: 0.378261 Nov 02 13:53:27.571614 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3114/6602] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:27 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1667 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:27.601075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2a67d12-b002-425f-b6cb-50b170f18122 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0f9e7e0-1558-4ba8-9601-d6857d203ed6"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:27.603683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c2a67d12-b002-425f-b6cb-50b170f18122 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:27.620903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2a67d12-b002-425f-b6cb-50b170f18122 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.622990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2a67d12-b002-425f-b6cb-50b170f18122 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.624773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2a67d12-b002-425f-b6cb-50b170f18122 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.626474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2a67d12-b002-425f-b6cb-50b170f18122 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.627036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2a67d12-b002-425f-b6cb-50b170f18122 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.627731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2a67d12-b002-425f-b6cb-50b170f18122 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.675179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:27.675602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:27.686661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.687390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.693836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:27.694691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:27.695221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:27.696749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:28.177955 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c2a67d12-b002-425f-b6cb-50b170f18122 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.582097 Nov 02 13:53:28.183757 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3489/6603] 10.222.0.113 () {62 vars in 1369 bytes} [Wed Nov 2 13:53:27 2022] POST /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments => generated 188 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:53:28.349362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:28.349970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:28.357802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:28.359665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:28.360176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:28.360841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:28.361684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:28.362451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:28.377145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:28.396360 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3bb35f59-c5d6-467b-8b59-411a8f76b45d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1396 microversion: 2.1 time: 0.727874 Nov 02 13:53:28.397487 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3115/6604] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:27 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1396 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:28.425830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120928) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Nov 02 13:53:28.519709 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6505ecfd-e268-44cc-9c89-250fc1996b67 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/action" status: 202 len: 0 microversion: 2.20 time: 0.176532 Nov 02 13:53:28.521111 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3490/6605] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:53:28 2022] POST /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:28.537343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:28.538324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:28.562680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:28.565042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:28.567755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:28.569043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:28.577242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:28.577763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:28.933795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:28.952247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:28.954312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:28.956429 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7c6a9e49-eddb-4342-ab2b-1c7162014a3c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1753 microversion: 2.20 time: 0.431474 Nov 02 13:53:28.957378 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3116/6606] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:28 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1753 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:53:28.990667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-67f245eb-9da2-46fc-a881-951b9c508761 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a59a2d2b-ae5b-41b1-a2a3-71d98e141497", "device": "/dev/sdb"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:28.998355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67f245eb-9da2-46fc-a881-951b9c508761 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:29.016941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67f245eb-9da2-46fc-a881-951b9c508761 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:29.017722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67f245eb-9da2-46fc-a881-951b9c508761 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:29.019023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67f245eb-9da2-46fc-a881-951b9c508761 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:29.020074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67f245eb-9da2-46fc-a881-951b9c508761 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:29.020768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67f245eb-9da2-46fc-a881-951b9c508761 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:29.021411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67f245eb-9da2-46fc-a881-951b9c508761 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:29.422980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:29.425651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:29.432595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:29.433100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-67f245eb-9da2-46fc-a881-951b9c508761 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "POST /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450254 Nov 02 13:53:29.434067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:29.434732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:29.435057 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3491/6607] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:53:28 2022] POST /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:29.435913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:29.436593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:29.437273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:29.703196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:29.715064 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b7d7735-935a-496d-ad88-c2a42fa1090c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1396 microversion: 2.1 time: 0.297296 Nov 02 13:53:29.726713 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3117/6608] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:29 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1396 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:53:29.983789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:29.984647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:29.993629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:29.996521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:29.999486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:30.003211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:30.003872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:30.006180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:30.007594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:30.009325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:30.223505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:30.237582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:30.240666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:30.242715 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1f43de2-cb27-4862-b265-fc95a144cd10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.263484 Nov 02 13:53:30.244287 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3492/6609] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:29 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:30.740587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:30.741312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:30.743299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:30.757588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:30.759672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:30.760439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:30.761321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:30.761798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:30.762299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:31.090175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:31.099428 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-838aba2d-12e7-4334-9d46-71d3004656b3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1396 microversion: 2.1 time: 0.362906 Nov 02 13:53:31.115857 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3118/6610] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:30 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1396 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:31.274916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:31.276329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:31.284142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:31.284634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:31.285287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:31.286145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:31.286763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:31.287228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:31.435257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:31.454135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:31.456086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:31.457322 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e4666071-03be-4d13-b00f-6a0d32b17446 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.186566 Nov 02 13:53:31.458275 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3493/6611] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:31 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:32.125856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:32.126574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:32.133906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:32.134370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:32.134818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:32.135603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:32.136238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:32.136680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:32.369051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:32.380331 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-613776d0-ce8d-4f9f-ae3e-6dae596212d1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1396 microversion: 2.1 time: 0.258500 Nov 02 13:53:32.381207 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3119/6612] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:32 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:32.488684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:32.489916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:32.496666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:32.497164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:32.497620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:32.498350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:32.498813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:32.499273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:32.521361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:32.687151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:32.698929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:32.700851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:32.702077 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10c04aa3-c2e9-41d1-99e4-e355c9e631a0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.220951 Nov 02 13:53:32.702667 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3494/6613] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:32 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:33.011291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-600d5b22-4fdf-4067-b955-4e2e1e2666e3 req-9039bfbf-33d1-49a3-8584-84dd2595d5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "name": "network-vif-plugged", "status": "completed", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:33.022402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-600d5b22-4fdf-4067-b955-4e2e1e2666e3 req-9039bfbf-33d1-49a3-8584-84dd2595d5d7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:33.023353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-600d5b22-4fdf-4067-b955-4e2e1e2666e3 req-9039bfbf-33d1-49a3-8584-84dd2595d5d7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:33.023789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-600d5b22-4fdf-4067-b955-4e2e1e2666e3 req-9039bfbf-33d1-49a3-8584-84dd2595d5d7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:33.039539 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-600d5b22-4fdf-4067-b955-4e2e1e2666e3 req-9039bfbf-33d1-49a3-8584-84dd2595d5d7 service nova] Creating event network-vif-plugged:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h2-858384-19 Nov 02 13:53:33.047417 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-600d5b22-4fdf-4067-b955-4e2e1e2666e3 req-9039bfbf-33d1-49a3-8584-84dd2595d5d7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038434 Nov 02 13:53:33.051636 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3120/6614] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:33.405633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:33.406351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:33.416173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:33.416751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:33.417256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:33.418041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:33.418769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:33.419060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:33.648375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:33.662155 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-52306bb7-dceb-4c3c-981d-99fc2835731b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1396 microversion: 2.1 time: 0.260470 Nov 02 13:53:33.662965 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3495/6615] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:33 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1396 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:33.733931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:33.734842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:33.742394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:33.743090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:33.743676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:33.744471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:33.745026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:33.745534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:33.916395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:33.933137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:33.934797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:33.936499 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-439e5b59-2210-4b41-b7c8-ed59b4ffab20 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.210057 Nov 02 13:53:33.937261 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3121/6616] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:33 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:34.687784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:34.690520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:34.700783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.701497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.702444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.703349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.703980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.704698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.965351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:34.967318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:34.974676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.975640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.976265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:34.977143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:34.977860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:34.978486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:35.004305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:35.012802 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9159b0a7-c616-4133-81a0-64b70b6f80b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1569 microversion: 2.1 time: 0.330684 Nov 02 13:53:35.015479 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3496/6617] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:34 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1569 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:35.039413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:35.040999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:35.049602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:35.050193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:35.050944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:35.051992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:35.052690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:35.053438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:35.166550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:35.178397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:35.179938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:35.181162 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e503d289-f163-4131-9cac-e06a3fcd2eb8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.220614 Nov 02 13:53:35.195266 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3122/6618] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:34 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:53:35.264727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:35.274421 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-13e02910-e04b-4921-b942-237b2ba3dc43 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1569 microversion: 2.1 time: 0.239219 Nov 02 13:53:35.275324 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3497/6619] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:35 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:53:36.208136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:36.208762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:36.221790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:36.222295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:36.222738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:36.223486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:36.224174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:36.224801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:36.532161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:36.552606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:36.554362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:36.559385 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a647e2df-0d1f-40d9-bea1-c6bcc27cdc0d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.355539 Nov 02 13:53:36.560292 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3123/6620] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:36 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:37.588245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:37.589773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:37.597679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:37.598524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:37.599486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:37.600455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:37.601052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:37.601597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:37.660667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:37.661392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:37.678700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:37.679233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:37.679684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:37.680421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:37.681010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:37.681510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:37.771751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:37.782341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:37.784707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:37.786076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-428fbb44-c944-4f0b-bd1a-266f6d5c293d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.201729 Nov 02 13:53:37.787078 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3498/6621] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:37 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:37.797145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a810f415-8d14-42d9-adce-6edddcc4314d req-12f2a011-f5e5-48d5-a490-507078fa7ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:37.811161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a810f415-8d14-42d9-adce-6edddcc4314d req-12f2a011-f5e5-48d5-a490-507078fa7ef6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:37.811706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a810f415-8d14-42d9-adce-6edddcc4314d req-12f2a011-f5e5-48d5-a490-507078fa7ef6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:37.812160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a810f415-8d14-42d9-adce-6edddcc4314d req-12f2a011-f5e5-48d5-a490-507078fa7ef6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:37.825144 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a810f415-8d14-42d9-adce-6edddcc4314d req-12f2a011-f5e5-48d5-a490-507078fa7ef6 service nova] Creating event network-changed:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h2-858384-19 Nov 02 13:53:37.832155 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a810f415-8d14-42d9-adce-6edddcc4314d req-12f2a011-f5e5-48d5-a490-507078fa7ef6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043011 Nov 02 13:53:37.833123 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3499/6622] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:37.963132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:37.974929 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff43c445-258b-4a42-adf2-335bd6829849 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1569 microversion: 2.1 time: 0.320709 Nov 02 13:53:37.978160 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3124/6623] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:37 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1569 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:53:38.815579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:38.816881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:38.823809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:38.824302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:38.824752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:38.825535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:38.826177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:38.826787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:39.010637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:39.022780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:39.024620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:39.026102 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5c504797-1e38-4272-987d-e8d5c9942450 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.216187 Nov 02 13:53:39.026789 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3500/6624] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:38 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:40.056379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:40.057688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:40.062119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=52 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:40.066706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:40.067453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:40.067959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:40.068762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:40.069282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:40.069824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:40.413351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:40.426325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:40.427918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:40.429251 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-478c8c3d-11a8-436a-bdd4-0969a1b2bec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.378610 Nov 02 13:53:40.429819 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3125/6625] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:40 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:41.456373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:41.457011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:41.465503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:41.466001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:41.466486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:41.467192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:41.467662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:41.468101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:41.650556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:41.661247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:41.662775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:41.664017 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-abf8abc9-a712-4d04-b8b8-8f09f62824b4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.212526 Nov 02 13:53:41.664617 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3501/6626] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:41 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:42.693847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:42.694464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:42.701941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:42.702564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:42.702955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:42.703828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:42.704233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:42.705298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:42.742631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:42.924715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:42.944472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:42.946477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:42.947884 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b49531b2-a22d-4456-8fb7-971d24d930cb tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1755 microversion: 2.20 time: 0.259201 Nov 02 13:53:42.964116 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3126/6627] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:42 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1755 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:53:43.979137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:43.980050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:43.983421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:43.989906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:43.990804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:43.991616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:43.992590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:43.993785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:43.994451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:44.184957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:44.197122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:44.198612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:44.209822 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a8e765e-3e95-4abe-a880-16e36def7e7a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.234459 Nov 02 13:53:44.210460 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3502/6628] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:43 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:45.018803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-cde9a9fc-9066-47bd-99b0-7289d34cbbf2 req-9abb5695-ca91-4808-8f67-e8a4b747d39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2faf26b2-214b-40c4-b5c2-81cf8524b8e7", "tag": "62875f3c-3f2e-4138-869d-d53e38408179"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:53:45.043156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cde9a9fc-9066-47bd-99b0-7289d34cbbf2 req-9abb5695-ca91-4808-8f67-e8a4b747d39f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:45.043794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cde9a9fc-9066-47bd-99b0-7289d34cbbf2 req-9abb5695-ca91-4808-8f67-e8a4b747d39f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:45.044261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cde9a9fc-9066-47bd-99b0-7289d34cbbf2 req-9abb5695-ca91-4808-8f67-e8a4b747d39f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:45.058696 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-cde9a9fc-9066-47bd-99b0-7289d34cbbf2 req-9abb5695-ca91-4808-8f67-e8a4b747d39f service nova] Creating event network-changed:62875f3c-3f2e-4138-869d-d53e38408179 for instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 on n-h1-858384-19 Nov 02 13:53:45.076093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-cde9a9fc-9066-47bd-99b0-7289d34cbbf2 req-9abb5695-ca91-4808-8f67-e8a4b747d39f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061948 Nov 02 13:53:45.076990 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3127/6629] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:53:45.245557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:45.255623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:45.279413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:45.284849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:45.285384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:45.286072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:45.291996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:45.292472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:45.416883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:45.417534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:45.432658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:45.433233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:45.433802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:45.435039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:45.435722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:45.436639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:45.523444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:45.535319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:45.537256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:45.538854 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8b2df6ca-cfa9-44bd-9088-256b1c0c946a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.300204 Nov 02 13:53:45.540086 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3503/6630] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:45 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:45.604463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lazy-loading 'services' on Instance uuid 4d68b5fc-42c5-428e-831d-588f05af8c4a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:53:45.701004 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5b69dc79-f5f0-4249-ab2a-8a42e33edfdd tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "DELETE /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a/os-volume_attachments/aae7ebc0-dfe3-48b1-90f2-876654de4e93" status: 202 len: 0 microversion: 2.1 time: 0.288117 Nov 02 13:53:45.704424 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3128/6631] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:53:45 2022] DELETE /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a/os-volume_attachments/aae7ebc0-dfe3-48b1-90f2-876654de4e93 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:53:46.566276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:46.566924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:46.574108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:46.574595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:46.575038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:46.575812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:46.576272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:46.577962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:46.740088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:46.749801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:46.752048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:46.753348 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15777276-db1e-4692-b4cd-97c0a4268f52 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.191858 Nov 02 13:53:46.755486 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3504/6632] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:46 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:47.787302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:47.788054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:47.802767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:47.803579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:47.804189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:47.805225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:47.805582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:47.806147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:48.244873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:48.257506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:48.268266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:48.277654 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9c3b17a9-92bb-4f28-bc36-35490a96822a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.496548 Nov 02 13:53:48.280449 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3129/6633] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:47 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:49.315728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:49.316541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:49.344705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:49.346895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:49.350237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:49.353036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:49.353786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:49.357306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:49.817734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:49.841975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:49.843960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:49.849834 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efa34fca-a431-4d7d-86f1-c2b7f4448275 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.542438 Nov 02 13:53:49.855638 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3505/6634] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:49 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:50.900030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:50.909333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:50.935127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:50.944766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:50.945386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:50.946263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:50.946852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:50.947416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:51.327504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:51.342473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:51.344557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:51.346801 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5aad4c9d-7dfe-492d-9c48-253eb598e764 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.452968 Nov 02 13:53:51.348553 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3130/6635] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:50 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:52.382646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:52.384239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:52.402031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:52.404185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:52.404933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:52.409553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:52.410282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:52.410950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:52.700064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:52.713863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:52.715742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:52.717291 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75ab6625-fafd-4c2f-ab43-49f3a14de74c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.340496 Nov 02 13:53:52.727955 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3506/6636] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:52 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:53.747409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:53.747872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:53.782098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:53.788323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:53.789422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:53.798071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:53.801418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:53.802252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:54.223959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:54.271087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:54.276799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:54.281269 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-01b867cb-1ed1-42d5-a93c-172d8e67dfbd tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.539157 Nov 02 13:53:54.319094 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3131/6637] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:53 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:54.866273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:54.867701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:54.881639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:54.883298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:54.884139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:54.885326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:54.886345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:54.887365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:54.948195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:53:55.102417 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ee38b3a-daec-42c3-abe0-a776d0bb852f tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "DELETE /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 204 len: 0 microversion: 2.1 time: 0.241544 Nov 02 13:53:55.109972 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3507/6638] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:53:54 2022] DELETE /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:53:55.114547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:55.115197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:55.127278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:55.128102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:55.128550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:55.129269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:55.129727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:55.130157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:55.317808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:55.319521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:55.347082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:55.347668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:55.348281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:55.350485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:55.351920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:55.353951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:55.418340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:55.432513 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3d6b1938-d315-4085-8d3d-55fc9b3e54eb tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1474 microversion: 2.1 time: 0.321498 Nov 02 13:53:55.434030 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3132/6639] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:55 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1474 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:53:55.670733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:55.680983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:55.692568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:55.693825 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7717f628-d1e2-4963-86bf-ad66123d778d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.382638 Nov 02 13:53:55.694748 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3508/6640] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:55 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:53:56.463372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:56.464838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:56.472537 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:53:56.472779 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 13:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a (ip 10.222.0.113) !!! Nov 02 13:53:56.477863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:56.478427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:56.478956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:56.479823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:56.480355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:56.481455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:56.665207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:56.675253 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cc1bc773-239d-480d-bfde-c1480bf194fc tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1474 microversion: 2.1 time: 0.216743 Nov 02 13:53:56.676172 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3133/6641] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:56 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1474 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:56.724844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:56.725479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:56.733776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:56.734263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:56.734707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:56.735573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:56.736734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:56.737175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:56.884168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:56.893700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:56.895358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:56.896797 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0025b06a-44d3-49c0-af65-12bc960132e9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.176991 Nov 02 13:53:56.897387 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3509/6642] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:56 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:57.700422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:57.701618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:57.709479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:57.710119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:57.710635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:57.711459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:57.711991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:57.712511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:57.869657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:57.883512 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d92967ff-f616-4838-bec5-1efcd69ce771 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1474 microversion: 2.1 time: 0.186968 Nov 02 13:53:57.887047 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3134/6643] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:57 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1474 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:57.925409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:57.926129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:57.935916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:57.936726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:57.937166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:57.938246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:57.939726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:57.940163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:57.945505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:53:58.111982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:58.122598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:58.124127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:58.125652 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84934393-d1c8-46be-92de-bf18c8293e48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.206315 Nov 02 13:53:58.126180 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3510/6644] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:57 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:53:58.916772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:58.920454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:58.929289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:58.929688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:58.930297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:58.931023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:58.931512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:58.931942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:59.122178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:59.131613 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-159f8806-6953-490c-9971-18b908f18a02 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1474 microversion: 2.1 time: 0.220417 Nov 02 13:53:59.132355 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3135/6645] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:53:58 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1474 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:53:59.155627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:53:59.156923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:53:59.166447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:59.167047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:59.167622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:59.168607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:53:59.169157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:53:59.170189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:53:59.318628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:59.327798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:59.329294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:53:59.330857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-700dddd2-e466-46cb-9424-f599137e3632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.181251 Nov 02 13:53:59.331468 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3511/6646] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:53:59 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:54:00.157110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:00.158244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:00.165493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:00.165971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:00.166407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:00.167164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:00.167626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:00.168051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:00.315220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:00.323438 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-287cbee5-ac4f-413f-9f90-7eba2a9e78c0 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1474 microversion: 2.1 time: 0.170720 Nov 02 13:54:00.324028 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3136/6647] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:00 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1474 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:00.359134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:00.359864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:00.367567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:00.368710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:00.369161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:00.369889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:00.370345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:00.370944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:00.518642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:00.528351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:00.530106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:00.531483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3821fad5-a143-476b-806e-2a19fa9778a7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.177882 Nov 02 13:54:00.532728 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3512/6648] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:00 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:54:01.349341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:01.350735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:01.360425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:01.361697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:01.362460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:01.363763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:01.364395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:01.365574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:01.571671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:01.573907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:01.585334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:01.602479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:01.604486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:01.605429 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f23905e7-d588-4620-9374-1c5e6e96b249 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1474 microversion: 2.1 time: 0.261618 Nov 02 13:54:01.614444 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3137/6649] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:01 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1474 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:01.614827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:01.620347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:01.621102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:01.621703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:01.785119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:01.795180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:01.796667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:01.797851 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dad76839-b95c-4959-ab0b-5565ad7ad365 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.239017 Nov 02 13:54:01.798990 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3513/6650] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:01 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:54:02.633597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:02.634855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:02.644139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:02.645150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:02.646282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:02.647039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:02.654384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:02.655073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:02.810109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:02.822473 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e84421de-8ffb-4e54-89b9-1849cbc93423 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1474 microversion: 2.1 time: 0.193283 Nov 02 13:54:02.823911 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3138/6651] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:02 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1474 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:02.825807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:02.826503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:02.844576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:02.845105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:02.846313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:02.847828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:02.848351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:02.848836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:03.011977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:03.024413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:03.027207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:03.028635 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91fdb96e-6cd3-46a0-9764-9173813640ad tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.207791 Nov 02 13:54:03.029436 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3514/6652] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:02 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:54:03.846500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:03.847137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:03.854158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:03.854652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:03.855088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:03.855815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:03.856271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:03.856698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:03.997688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:04.006655 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9a67350-c686-4fa4-aa6e-2211ccd06108 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1474 microversion: 2.1 time: 0.164646 Nov 02 13:54:04.007259 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3139/6653] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:03 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1474 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:04.031442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:04.031942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:04.039691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.040187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.040640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.041363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.041808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.042241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.055587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:04.056233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:04.062642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.063253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.063702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.064451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.064913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.065355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.134983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lazy-loading 'services' on Instance uuid 97df1cd3-29d4-4407-bdde-397e21a8e579 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:54:04.223135 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed0f0875-9e30-4b83-863b-ed2a929c0ce6 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "DELETE /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579/os-volume_attachments/a59a2d2b-ae5b-41b1-a2a3-71d98e141497" status: 202 len: 0 microversion: 2.1 time: 0.195510 Nov 02 13:54:04.223788 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3515/6654] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:54:04 2022] DELETE /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579/os-volume_attachments/a59a2d2b-ae5b-41b1-a2a3-71d98e141497 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:54:04.305180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:04.316780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:04.318421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:04.321023 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-389d889c-6d6b-4474-a9e7-91930e243ba2 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.268236 Nov 02 13:54:04.322073 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3140/6655] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:04 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:54:04.789084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7495c7bb-5b9c-42cf-8204-d2e4cd2d0ddc req-6c8581c4-2e5a-4590-bdf0-40fa4efef770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d68b5fc-42c5-428e-831d-588f05af8c4a", "name": "network-vif-deleted", "tag": "10dcb4db-6341-4581-8f9e-072735b4dbb9"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:04.801043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7495c7bb-5b9c-42cf-8204-d2e4cd2d0ddc req-6c8581c4-2e5a-4590-bdf0-40fa4efef770 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:04.801616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7495c7bb-5b9c-42cf-8204-d2e4cd2d0ddc req-6c8581c4-2e5a-4590-bdf0-40fa4efef770 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:04.802139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7495c7bb-5b9c-42cf-8204-d2e4cd2d0ddc req-6c8581c4-2e5a-4590-bdf0-40fa4efef770 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:04.814985 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7495c7bb-5b9c-42cf-8204-d2e4cd2d0ddc req-6c8581c4-2e5a-4590-bdf0-40fa4efef770 service nova] Creating event network-vif-deleted:10dcb4db-6341-4581-8f9e-072735b4dbb9 for instance 4d68b5fc-42c5-428e-831d-588f05af8c4a on n-h1-858384-19 Nov 02 13:54:04.820344 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7495c7bb-5b9c-42cf-8204-d2e4cd2d0ddc req-6c8581c4-2e5a-4590-bdf0-40fa4efef770 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035619 Nov 02 13:54:04.821354 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3516/6656] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:05.030098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:05.030748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:05.046216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:05.047732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:05.049796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:05.051448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:05.052268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:05.052988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:05.105967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:05.107323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:05.108064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:05.108627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lazy-loading 'fault' on Instance uuid 4d68b5fc-42c5-428e-831d-588f05af8c4a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:54:05.174304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4a35b995e5490f93a50e3e142fa1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372859e169f145bb852b05e5ee0426aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:05.185689 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dab4f850-3421-4c42-92e6-243d13c01b04 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 200 len: 1308 microversion: 2.1 time: 0.158961 Nov 02 13:54:05.187434 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3141/6657] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:05 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:05.355467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:05.368066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:05.382575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:05.383066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:05.383541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:05.384241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:05.384691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:05.385125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:05.552120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:05.566259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:05.568354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:05.569877 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-95ae4e52-9c89-48c5-980f-c024bac9a3a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.220609 Nov 02 13:54:05.570448 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3517/6658] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:05 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:06.210826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:06.211548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] [instance: 4d68b5fc-42c5-428e-831d-588f05af8c4a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:06.218973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:06.219721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:06.220267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:06.221081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:06.221693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:06.222281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:06.237196 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] HTTP exception thrown: Instance 4d68b5fc-42c5-428e-831d-588f05af8c4a could not be found. Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Request method failure captured: Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a HTTP/1.1 Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnX10F63UzBr2lPdWcfJgmIVbBbG3Z2W3qwPH4eNkB6nfigClz6JLWk_c-ETBAsLGLOU23qSmxIIHcmkiBv3M6j-a8lwa6nK1k7BKcNkSFWfpjJi3zukQ6NZUVnPxzmBQuyv5dQYTTzzkR2Pb-nYcEY4BsnJSMIZiNanwuOka66z78o Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 372859e169f145bb852b05e5ee0426aa Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesBackupsTest-342906729 Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/372859e169f145bb852b05e5ee0426aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/372859e169f145bb852b05e5ee0426aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_372859e169f145bb852b05e5ee0426aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/372859e169f145bb852b05e5ee0426aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesBackupsTest-342906729 Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 372859e169f145bb852b05e5ee0426aa Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesBackupsTest-342906729 Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesBackupsTest-342906729-project Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 6a4a35b995e5490f93a50e3e142fa1f6 Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesBackupsTest-342906729-project Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 4d68b5fc-42c5-428e-831d-588f05af8c4a could not be found. Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '4d68b5fc-42c5-428e-831d-588f05af8c4a'} Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d68b5fc-42c5-428e-831d-588f05af8c4a could not be found. Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d68b5fc-42c5-428e-831d-588f05af8c4a could not be found. Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:06.239063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:06.243861 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:06.243861 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:06.243861 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:06.243861 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:54:06.243861 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:54:06.243861 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d68b5fc-42c5-428e-831d-588f05af8c4a could not be found. Nov 02 13:54:06.243861 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:06.243861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] Returning 404 to user: Instance 4d68b5fc-42c5-428e-831d-588f05af8c4a could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:06.245062 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d8218819-2e7d-4cce-bd03-57e331436930 tempest-VolumesBackupsTest-342906729 tempest-VolumesBackupsTest-342906729-project] 10.222.0.113 "GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a" status: 404 len: 111 microversion: 2.1 time: 0.038318 Nov 02 13:54:06.245932 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3142/6659] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:06 2022] GET /compute/v2.1/servers/4d68b5fc-42c5-428e-831d-588f05af8c4a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:54:06.596590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:06.597997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:06.608692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:06.610125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:06.611690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:06.612730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:06.613288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:06.613732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:06.774899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:06.785073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:06.786624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:06.787863 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-564a035e-5106-461d-98e4-701eb530e3d7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.196656 Nov 02 13:54:06.788649 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3518/6660] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:06 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:07.813138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:07.814134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:07.821926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:07.822493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:07.823034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:07.823866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:07.824425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:07.824954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:07.847645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:07.966067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:07.976314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:07.978129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:07.979748 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-969a0efd-5fa8-479a-804b-8650e6a6110b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.170538 Nov 02 13:54:07.983317 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3143/6661] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:07 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:09.008548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:09.009382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:09.015722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:09.016311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:09.016848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:09.018505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:09.019030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:09.019592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:09.175406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:09.186682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:09.188726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:09.191330 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9efe2dc3-22d4-42a7-b340-de6fae048ac3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.188601 Nov 02 13:54:09.207156 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3519/6662] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:09 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:09.644457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:09.645088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:09.652608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:09.653230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:09.653885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:09.654958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:09.655561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:09.656062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:09.688069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:54:09.785550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-31bedbf6-e2fe-46bb-9a63-2eb330f68216 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "DELETE /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 204 len: 0 microversion: 2.1 time: 0.145871 Nov 02 13:54:09.789760 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3144/6663] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:54:09 2022] DELETE /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:54:09.796164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:09.797229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:09.805038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:09.805697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:09.806266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:09.807331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:09.808078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:09.808751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:09.965508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:09.976191 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2923758b-e674-47b7-b3c4-fc2459081046 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1563 microversion: 2.1 time: 0.184310 Nov 02 13:54:09.977126 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3520/6664] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:09 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:10.219305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:10.221058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:10.224664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:10.229263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:10.229923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:10.230237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:10.230988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:10.231460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:10.232159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:10.452369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:10.463486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:10.465326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:10.466532 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-430f3eed-61e5-4e6d-8df4-d799c3d8debe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.252313 Nov 02 13:54:10.467103 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3145/6665] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:10 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:11.000224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:11.001126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:11.008456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:11.009007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:11.009689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:11.010473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:11.011105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:11.011626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:11.165187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:11.175180 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a80c8e74-faa1-4164-a738-2e247d0481f3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1517 microversion: 2.1 time: 0.178857 Nov 02 13:54:11.176051 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3521/6666] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:10 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:11.494010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:11.494864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:11.503162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:11.503817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:11.504493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:11.505514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:11.506200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:11.506756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:11.670041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:11.681670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:11.683591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:11.685170 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e2fb329e-00c1-44c5-9062-8f6a26ed79f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.195755 Nov 02 13:54:11.699087 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3146/6667] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:11 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:12.202532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:12.203375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:12.211411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:12.212262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:12.212933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:12.213942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:12.216094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:12.219825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:12.389504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:12.400032 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a0e4ffaa-0753-4ff4-bb00-b58f6f955d46 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1517 microversion: 2.1 time: 0.201148 Nov 02 13:54:12.400972 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3522/6668] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:12 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:12.715301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:12.716105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:12.738714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:12.739659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:12.740222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:12.741063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:12.741756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:12.742690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:12.977933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:12.989880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:13.011358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:13.011358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2d6500ab-1294-4dc9-8722-b8a496b0aa17 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.283641 Nov 02 13:54:13.011358 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3147/6669] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:12 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:13.232396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-2cf8cc46-d1d6-44b7-bc38-74b6e82f4f62 req-6a19ff14-6a6e-42cb-89ff-790a9a590c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97df1cd3-29d4-4407-bdde-397e21a8e579", "name": "network-vif-deleted", "tag": "1cf6c6c4-8b96-478d-8bbf-4bb2bf2ceed8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:13.245877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2cf8cc46-d1d6-44b7-bc38-74b6e82f4f62 req-6a19ff14-6a6e-42cb-89ff-790a9a590c09 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:13.246275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2cf8cc46-d1d6-44b7-bc38-74b6e82f4f62 req-6a19ff14-6a6e-42cb-89ff-790a9a590c09 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:13.246738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2cf8cc46-d1d6-44b7-bc38-74b6e82f4f62 req-6a19ff14-6a6e-42cb-89ff-790a9a590c09 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:13.264234 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-2cf8cc46-d1d6-44b7-bc38-74b6e82f4f62 req-6a19ff14-6a6e-42cb-89ff-790a9a590c09 service nova] Creating event network-vif-deleted:1cf6c6c4-8b96-478d-8bbf-4bb2bf2ceed8 for instance 97df1cd3-29d4-4407-bdde-397e21a8e579 on n-h1-858384-19 Nov 02 13:54:13.270843 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-2cf8cc46-d1d6-44b7-bc38-74b6e82f4f62 req-6a19ff14-6a6e-42cb-89ff-790a9a590c09 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043527 Nov 02 13:54:13.274873 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3523/6670] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:13.391511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5cba16cf-e482-42b6-9a9d-950d84d591fb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:13.395177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5cba16cf-e482-42b6-9a9d-950d84d591fb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:13.413595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cba16cf-e482-42b6-9a9d-950d84d591fb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:13.414102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cba16cf-e482-42b6-9a9d-950d84d591fb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:13.414557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cba16cf-e482-42b6-9a9d-950d84d591fb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:13.415314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cba16cf-e482-42b6-9a9d-950d84d591fb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:13.420699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cba16cf-e482-42b6-9a9d-950d84d591fb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:13.420935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cba16cf-e482-42b6-9a9d-950d84d591fb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:13.428341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:13.429119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:13.444230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:13.445142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:13.445598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:13.446696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:13.447205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:13.447644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:13.529303 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5cba16cf-e482-42b6-9a9d-950d84d591fb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action" status: 200 len: 24570 microversion: 2.1 time: 0.142133 Nov 02 13:54:13.530229 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3148/6671] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:54:13 2022] POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action => generated 24570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:54:13.577944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:13.592232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8410334a-8d2a-4a27-a5fa-7ebdc71b2a4f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 200 len: 1308 microversion: 2.1 time: 0.170942 Nov 02 13:54:13.598797 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3524/6672] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:13 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:14.023720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:14.025080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:14.036172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:14.037339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:14.037857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:14.040063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:14.041243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:14.042634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:14.210957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:14.221190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:14.222716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:14.223933 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5364f94-8cea-4105-a411-54b3d1dde845 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.205046 Nov 02 13:54:14.224538 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3149/6673] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:14 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:14.445716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-83e25931-e357-4f5b-9d21-999a3fb60d76 req-98080603-217d-4a82-9364-2a8461529f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf26b2-214b-40c4-b5c2-81cf8524b8e7", "name": "network-vif-plugged", "status": "completed", "tag": "62875f3c-3f2e-4138-869d-d53e38408179"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:14.458052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:14.463888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-83e25931-e357-4f5b-9d21-999a3fb60d76 req-98080603-217d-4a82-9364-2a8461529f79 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:14.464442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-83e25931-e357-4f5b-9d21-999a3fb60d76 req-98080603-217d-4a82-9364-2a8461529f79 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:14.464940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-83e25931-e357-4f5b-9d21-999a3fb60d76 req-98080603-217d-4a82-9364-2a8461529f79 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:14.480433 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-83e25931-e357-4f5b-9d21-999a3fb60d76 req-98080603-217d-4a82-9364-2a8461529f79 service nova] Creating event network-vif-plugged:62875f3c-3f2e-4138-869d-d53e38408179 for instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 on n-h1-858384-19 Nov 02 13:54:14.488133 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-83e25931-e357-4f5b-9d21-999a3fb60d76 req-98080603-217d-4a82-9364-2a8461529f79 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046532 Nov 02 13:54:14.491644 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3525/6674] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:14.617457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:14.618189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 97df1cd3-29d4-4407-bdde-397e21a8e579] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:14.625738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:14.626794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:14.627559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:14.628474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:14.629207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:14.629794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:14.652303 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] HTTP exception thrown: Instance 97df1cd3-29d4-4407-bdde-397e21a8e579 could not be found. Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Request method failure captured: Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 HTTP/1.1 Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnXmtx_JbAYQIlQZYp5iKtSXGjwH3K1wv_wIg1MoLL5g6QdwSvoS_FfL0SfIp-5hfwPxReciogSOykxj_dHUXR_SNgWbA4FDNJa1YNokEXA96HPmkNlYQxP4rcYvl6MxWNnkwxCloPiLOdVTKaMfUBeDy1P9H08jLypC0DQrg0VgljE Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 91576e0d40cb423692d205519af2bb2e Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1136278750 Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/91576e0d40cb423692d205519af2bb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/91576e0d40cb423692d205519af2bb2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_91576e0d40cb423692d205519af2bb2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/91576e0d40cb423692d205519af2bb2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesSnapshotTestJSON-1136278750 Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 91576e0d40cb423692d205519af2bb2e Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1136278750 Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesSnapshotTestJSON-1136278750-project Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 989216ae9bb6405a8f0d352299f49f77 Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesSnapshotTestJSON-1136278750-project Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 97df1cd3-29d4-4407-bdde-397e21a8e579 could not be found. Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '97df1cd3-29d4-4407-bdde-397e21a8e579'} Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97df1cd3-29d4-4407-bdde-397e21a8e579 could not be found. Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97df1cd3-29d4-4407-bdde-397e21a8e579 could not be found. Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:54:14.654019 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:14.659624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:54:14.659624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:54:14.659624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:54:14.659624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:54:14.659624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:54:14.659624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97df1cd3-29d4-4407-bdde-397e21a8e579 could not be found. Nov 02 13:54:14.659624 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:54:14.659624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Returning 404 to user: Instance 97df1cd3-29d4-4407-bdde-397e21a8e579 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:54:14.659624 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c4275187-4d26-423f-a58a-1926287af99a tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579" status: 404 len: 111 microversion: 2.1 time: 0.042857 Nov 02 13:54:14.667511 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3150/6675] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:14 2022] GET /compute/v2.1/servers/97df1cd3-29d4-4407-bdde-397e21a8e579 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:54:15.257096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:15.259095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:15.274671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:15.275651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:15.276830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:15.278010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:15.278817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:15.279488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:15.462833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:15.474663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:15.477045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:15.479080 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05e3ddbc-76d6-4c10-bbed-d5ce905a1b77 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.231041 Nov 02 13:54:15.479923 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3526/6676] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:15 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:16.514602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:16.516989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:16.533177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:16.533495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:16.533904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:16.534724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:16.535330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:16.535918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:16.808616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:16.826874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:16.831644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:16.833576 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3c94f736-b9a8-40ee-bf15-0a87938eaea1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1811 microversion: 2.20 time: 0.331244 Nov 02 13:54:16.851601 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3151/6677] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:16 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1811 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:17.868912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:17.870127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:17.878031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:17.878797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:17.879280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:17.880165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:17.880884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:17.881737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:18.094123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:18.106813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:18.108981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:18.110467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8bf6e7fb-eb6b-4591-8624-d20af3727734 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1798 microversion: 2.20 time: 0.245593 Nov 02 13:54:18.132978 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3527/6678] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:54:17 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1798 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:54:21.774369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1191541704", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "946c8dd4-659f-4209-8b7c-672b7d5e1378"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:21.845246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] validate_networks() for [('946c8dd4-659f-4209-8b7c-672b7d5e1378', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:54:22.258273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:54:22.258707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:54:22.259258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:54:22.259680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:54:22.260284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:54:22.271299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:22.272063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:22.272607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:22.273543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:22.274118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:22.274642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:22.293544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Getting quotas for project 91576e0d40cb423692d205519af2bb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:54:22.299566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Getting quotas for user 989216ae9bb6405a8f0d352299f49f77 and project 91576e0d40cb423692d205519af2bb2e. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:54:22.312599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:54:22.315260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:54:22.366558 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b8033fb7-4ae6-4622-9653-5f07f37a5f3c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.596025 Nov 02 13:54:22.368338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3152/6679] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:54:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:54:22.381002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2aa70ea2-9447-4315-ba13-9d1f004228ee tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:22.381734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2aa70ea2-9447-4315-ba13-9d1f004228ee tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:22.445515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2aa70ea2-9447-4315-ba13-9d1f004228ee tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:22.453654 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2aa70ea2-9447-4315-ba13-9d1f004228ee tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1223 microversion: 2.1 time: 0.078238 Nov 02 13:54:22.465958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3528/6680] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:22 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:23.481747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:23.483409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:23.494805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:23.495831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:23.496453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:23.497966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:23.498592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:23.499226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:23.689428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:23.707369 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d345d640-dfa2-4ea2-bb44-47ea9462a08c tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1275 microversion: 2.1 time: 0.230981 Nov 02 13:54:23.708332 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3153/6681] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:23 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1275 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:24.733382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:24.734193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:24.751045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:24.752119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:24.753341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:24.755924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:24.757200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:24.758866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:24.780008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:25.013176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:25.022412 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3224e459-4a0a-4e93-86a5-bdd041ffe378 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1323 microversion: 2.1 time: 0.293482 Nov 02 13:54:25.024186 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3529/6682] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:24 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1323 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:25.528720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3946f3a4-c7c9-40cc-91d6-5e201b0ff2d9 req-97419926-eaea-4d63-89b8-34f00ab2cf68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354669a0-44c5-48e8-bf2a-64dc851c6471", "tag": "8dfb5242-db2d-40c9-bc07-8fde5695244a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:25.554335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3946f3a4-c7c9-40cc-91d6-5e201b0ff2d9 req-97419926-eaea-4d63-89b8-34f00ab2cf68 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:25.556104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3946f3a4-c7c9-40cc-91d6-5e201b0ff2d9 req-97419926-eaea-4d63-89b8-34f00ab2cf68 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:25.557147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3946f3a4-c7c9-40cc-91d6-5e201b0ff2d9 req-97419926-eaea-4d63-89b8-34f00ab2cf68 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:25.572313 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3946f3a4-c7c9-40cc-91d6-5e201b0ff2d9 req-97419926-eaea-4d63-89b8-34f00ab2cf68 service nova] Creating event network-changed:8dfb5242-db2d-40c9-bc07-8fde5695244a for instance 354669a0-44c5-48e8-bf2a-64dc851c6471 on n-h2-858384-19 Nov 02 13:54:25.577907 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3946f3a4-c7c9-40cc-91d6-5e201b0ff2d9 req-97419926-eaea-4d63-89b8-34f00ab2cf68 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054410 Nov 02 13:54:25.580292 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3154/6683] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:26.052338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:26.053329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:26.061183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:26.061668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:26.062107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:26.063067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:26.064446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:26.064985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:26.214778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:26.223808 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7076357-29e4-440a-b5c7-5f11f3c242b3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1323 microversion: 2.1 time: 0.176040 Nov 02 13:54:26.224417 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3530/6684] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:26 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1323 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:27.248536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:27.249933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:27.259029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:27.259999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:27.260517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:27.261314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:27.261840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:27.262337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:27.419616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:27.430496 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d19cb4d0-e51b-456a-b042-92db1cbb68bd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1323 microversion: 2.1 time: 0.186317 Nov 02 13:54:27.432478 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3155/6685] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:27 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:28.466987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:28.467650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:28.487776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:28.488530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:28.489152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:28.489889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:28.491041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:28.491755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:28.682434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:28.691735 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f406ca28-97d9-4346-8245-e9ae3399e0dd tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1323 microversion: 2.1 time: 0.240505 Nov 02 13:54:28.692340 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3531/6686] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:28 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1323 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:29.719697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:29.721159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:29.728853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:29.729451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:29.729959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:29.730849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:29.731461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:29.731955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:29.882409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:29.890477 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-850fcbbd-9ae3-455f-8374-5d1998b4acb4 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1323 microversion: 2.1 time: 0.178529 Nov 02 13:54:29.891062 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3156/6687] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:29 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:30.913505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:30.914050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:30.921692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:30.923032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:30.923711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:30.924338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:30.924803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:30.925232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:31.097804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:31.108930 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3c5410ed-4d18-4a15-b6c6-ffb6a5614f42 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1323 microversion: 2.1 time: 0.199393 Nov 02 13:54:31.110097 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3532/6688] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:30 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:31.244076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d97dfce7-5506-4015-a6a6-d349eae488d3 req-29905b1f-f44e-44f4-84ce-a81c5cf8ba8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354669a0-44c5-48e8-bf2a-64dc851c6471", "name": "network-vif-plugged", "status": "completed", "tag": "8dfb5242-db2d-40c9-bc07-8fde5695244a"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:31.257737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d97dfce7-5506-4015-a6a6-d349eae488d3 req-29905b1f-f44e-44f4-84ce-a81c5cf8ba8c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:31.258248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d97dfce7-5506-4015-a6a6-d349eae488d3 req-29905b1f-f44e-44f4-84ce-a81c5cf8ba8c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:31.258683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d97dfce7-5506-4015-a6a6-d349eae488d3 req-29905b1f-f44e-44f4-84ce-a81c5cf8ba8c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:31.270964 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d97dfce7-5506-4015-a6a6-d349eae488d3 req-29905b1f-f44e-44f4-84ce-a81c5cf8ba8c service nova] Creating event network-vif-plugged:8dfb5242-db2d-40c9-bc07-8fde5695244a for instance 354669a0-44c5-48e8-bf2a-64dc851c6471 on n-h2-858384-19 Nov 02 13:54:31.281785 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d97dfce7-5506-4015-a6a6-d349eae488d3 req-29905b1f-f44e-44f4-84ce-a81c5cf8ba8c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041410 Nov 02 13:54:31.282799 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3157/6689] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:32.138972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:32.140464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:32.148192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:32.148826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:32.149279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:32.150001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:32.150464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:32.150899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:32.338494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:32.349976 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6ad3d7a-817b-46f5-a603-d159ecdf44f1 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1323 microversion: 2.1 time: 0.217883 Nov 02 13:54:32.350635 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3533/6690] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:32 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:33.373802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:33.374578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:33.380267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:33.380998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:33.388262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:33.388742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:33.389178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:33.389880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:33.390328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:33.390754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:33.525200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:33.540284 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c347a9ef-d014-4e8e-a9e0-616af5502681 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1511 microversion: 2.1 time: 0.168168 Nov 02 13:54:33.540926 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3158/6691] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:33 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:33.565190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0e0b246-902b-46d8-8cd5-ff0d49516af3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1d7eafb-1dd1-40ef-a67a-76d360179754", "device": "/dev/sdb"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:33.567835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0e0b246-902b-46d8-8cd5-ff0d49516af3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:33.569713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:33.575853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e0b246-902b-46d8-8cd5-ff0d49516af3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:33.576339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e0b246-902b-46d8-8cd5-ff0d49516af3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:33.576832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e0b246-902b-46d8-8cd5-ff0d49516af3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:33.577490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e0b246-902b-46d8-8cd5-ff0d49516af3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:33.577946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e0b246-902b-46d8-8cd5-ff0d49516af3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:33.578377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0e0b246-902b-46d8-8cd5-ff0d49516af3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:33.823300 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0e0b246-902b-46d8-8cd5-ff0d49516af3 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "POST /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262641 Nov 02 13:54:33.823935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3534/6692] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 13:54:33 2022] POST /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:54:52.509554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:52.511852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:52.763828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b4a7624b-6dc4-4241-8f97-ea42d7b92417 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:52.764459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4a7624b-6dc4-4241-8f97-ea42d7b92417 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:52.774635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4a7624b-6dc4-4241-8f97-ea42d7b92417 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:52.775316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4a7624b-6dc4-4241-8f97-ea42d7b92417 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:52.776064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4a7624b-6dc4-4241-8f97-ea42d7b92417 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:52.776948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4a7624b-6dc4-4241-8f97-ea42d7b92417 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:52.777909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4a7624b-6dc4-4241-8f97-ea42d7b92417 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:52.778783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4a7624b-6dc4-4241-8f97-ea42d7b92417 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:52.981984 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b4a7624b-6dc4-4241-8f97-ea42d7b92417 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1839 microversion: 2.1 time: 0.477324 Nov 02 13:54:52.983489 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3159/6693] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:52 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1839 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:53.012380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=21 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:53.013981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:54:53.161740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:53.162732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:53.170368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:53.171141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:53.171767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:53.173347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:53.174293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:53.174941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:53.338010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:53.354567 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-847ed901-874f-419b-a9f7-103e1a766619 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1686 microversion: 2.1 time: 0.350582 Nov 02 13:54:53.355599 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3535/6694] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:53 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1686 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:53.500088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-091baf7b-b61a-4e2e-8439-65437e78cd1e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:53.502614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-091baf7b-b61a-4e2e-8439-65437e78cd1e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:53.510592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-091baf7b-b61a-4e2e-8439-65437e78cd1e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:53.511279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-091baf7b-b61a-4e2e-8439-65437e78cd1e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:53.511560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-091baf7b-b61a-4e2e-8439-65437e78cd1e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:53.512494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-091baf7b-b61a-4e2e-8439-65437e78cd1e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:53.513121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-091baf7b-b61a-4e2e-8439-65437e78cd1e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:53.513718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-091baf7b-b61a-4e2e-8439-65437e78cd1e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:53.633506 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-091baf7b-b61a-4e2e-8439-65437e78cd1e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action" status: 200 len: 32639 microversion: 2.1 time: 0.137557 Nov 02 13:54:53.640988 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3160/6695] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:54:53 2022] POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action => generated 32639 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:54:53.792466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:54:53.793330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:53.828456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:53.831262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:53.831943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:53.832899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:53.833639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:53.834322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:53.867370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a687aba2bcef4e2b9f55e67b5e11a7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e2f7f2e1714dc89cd4d2acbc0c540b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:53.868286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 72135482-2437-484d-b767-fb9994a78e59] flavor_id is None. Assuming migration. {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4197}} Nov 02 13:54:53.868971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 72135482-2437-484d-b767-fb9994a78e59] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 13:54:54.156671 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef0bf63f-b852-4f61-8651-41d98de0b494 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action" status: 202 len: 0 microversion: 2.1 time: 0.367845 Nov 02 13:54:54.162221 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3536/6696] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:54:53 2022] POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:54:54.173151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:54.174402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:54.185016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:54.185876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:54.186474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:54.188217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:54.189126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:54.189731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:54.624467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:54.641201 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c2648bcf-9f39-44dd-ae69-668e7834aefd tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1695 microversion: 2.1 time: 0.474605 Nov 02 13:54:54.644304 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3161/6697] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:54 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1695 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:55.668803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:55.669558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:55.682499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:55.683402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:55.684074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:55.684989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:55.685659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:55.686285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:55.851841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:55.861100 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d25a103-1795-41a7-bf8c-e10444ce1129 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1695 microversion: 2.1 time: 0.197686 Nov 02 13:54:55.865725 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3537/6698] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:55 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:56.895069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:56.897242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:56.910114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:56.912122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:56.912781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:56.913706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:56.914332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:56.914931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:57.238636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:57.252056 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc2ae74b-c894-4159-acd0-ffedb350cdbc tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1695 microversion: 2.1 time: 0.362320 Nov 02 13:54:57.252656 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3162/6699] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:56 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1695 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:58.276903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:58.280725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:58.288603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:58.289900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:58.290769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:58.291682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:58.292291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:58.292877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:58.481399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:58.491202 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2829cb2a-5a36-4f08-8f15-738114c86073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.218374 Nov 02 13:54:58.498932 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3538/6700] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:58 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:59.518425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:59.519046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:59.525180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:59.525664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:59.526104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:59.526805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:59.527290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:59.528207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:59.698011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:54:59.709264 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7a6d423-1470-430e-aac2-670eef326ed8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.195614 Nov 02 13:54:59.719038 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3163/6701] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:54:59 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:54:59.902283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:54:59.902786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:54:59.910511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:59.910996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:59.911653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:54:59.912360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:54:59.912836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:54:59.913261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:00.007603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lazy-loading 'services' on Instance uuid 354669a0-44c5-48e8-bf2a-64dc851c6471 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:55:00.098412 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90d773ba-e20d-47b6-88cd-12e79d31e1df tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "DELETE /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471/os-volume_attachments/b1d7eafb-1dd1-40ef-a67a-76d360179754" status: 202 len: 0 microversion: 2.1 time: 0.199457 Nov 02 13:55:00.099612 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3539/6702] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 13:54:59 2022] DELETE /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471/os-volume_attachments/b1d7eafb-1dd1-40ef-a67a-76d360179754 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:00.736674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:00.738159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:00.746268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:00.747053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:00.748499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:00.750105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:00.751064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:00.751545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:00.940053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:00.948918 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-24b99b16-db59-41c4-940e-e8aa3d155baa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.216993 Nov 02 13:55:00.959534 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3164/6703] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:00 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:01.977307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:01.978968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:01.989716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.990530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.991994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:01.993192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:01.993826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:01.994434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:02.161998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:02.171678 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfed49ef-e57e-4d20-8f5f-4221a451d734 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.199002 Nov 02 13:55:02.197118 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3540/6704] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:01 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:03.200945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:03.202091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:03.209896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:03.210414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:03.210857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:03.211603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:03.212057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:03.212486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:03.407138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:03.423778 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2edcbd22-ae78-4341-b0b6-e2b5cdb70a55 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.221507 Nov 02 13:55:03.423778 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3165/6705] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:03 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:04.444266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:04.445159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:04.458119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.458612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.459053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.462586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:04.463275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:04.464221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:04.649637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:04.658754 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1a633e12-3bf3-48d6-8602-abe9e378deae tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.218749 Nov 02 13:55:04.663221 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3541/6706] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:04 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:05.586684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.588307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:05.602121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.602889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.603516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.604746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.605375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.605990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.640472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:55:05.692154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.693905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:05.704503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.705904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.706616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.708583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.709279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.709939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.760670 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6497329c-8196-47d5-ace3-9ab17f4d6a28 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "DELETE /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 204 len: 0 microversion: 2.1 time: 0.187569 Nov 02 13:55:05.761465 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3166/6707] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:55:05 2022] DELETE /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:55:05.771618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:05.772363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:05.779970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.780473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.780911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.782395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:05.783259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:05.783699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:05.918108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:05.927667 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1ff534aa-26d1-4715-98d8-10da71cb7083 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.243255 Nov 02 13:55:05.929199 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3542/6708] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:05 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:05.959062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:05.970315 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f666a8da-fd2f-429a-af90-f67b6361605d tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1517 microversion: 2.1 time: 0.201794 Nov 02 13:55:05.970315 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3167/6709] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:05 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:06.952043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:06.952656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:06.960430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:06.961450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:06.962167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:06.963213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:06.963826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:06.964300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:06.991612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:06.992333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:07.001908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:07.010963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:07.011506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:07.012302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:07.012828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:07.013334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:07.130675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:07.140876 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-23321e45-07e3-4758-8f2a-be2fd27abe1a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.192293 Nov 02 13:55:07.144562 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3543/6710] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:06 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:07.162807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:07.170747 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fa7c5755-b655-490c-b44d-d7f416d85779 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1517 microversion: 2.1 time: 0.183014 Nov 02 13:55:07.171572 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3168/6711] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:06 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:08.105263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-70e4416b-a9e0-476d-ac8d-42502c64fcd0 req-a7def56d-ca12-4562-96ed-f21c9e1f9474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354669a0-44c5-48e8-bf2a-64dc851c6471", "name": "network-vif-deleted", "tag": "8dfb5242-db2d-40c9-bc07-8fde5695244a"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:08.116995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-70e4416b-a9e0-476d-ac8d-42502c64fcd0 req-a7def56d-ca12-4562-96ed-f21c9e1f9474 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:08.117766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-70e4416b-a9e0-476d-ac8d-42502c64fcd0 req-a7def56d-ca12-4562-96ed-f21c9e1f9474 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:08.118351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-70e4416b-a9e0-476d-ac8d-42502c64fcd0 req-a7def56d-ca12-4562-96ed-f21c9e1f9474 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:08.130925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-70e4416b-a9e0-476d-ac8d-42502c64fcd0 req-a7def56d-ca12-4562-96ed-f21c9e1f9474 service nova] Creating event network-vif-deleted:8dfb5242-db2d-40c9-bc07-8fde5695244a for instance 354669a0-44c5-48e8-bf2a-64dc851c6471 on n-h2-858384-19 Nov 02 13:55:08.136836 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-70e4416b-a9e0-476d-ac8d-42502c64fcd0 req-a7def56d-ca12-4562-96ed-f21c9e1f9474 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109201 Nov 02 13:55:08.142517 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3544/6712] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:08.165727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:08.166595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:08.174942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:08.175808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:08.176631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:08.177509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:08.178124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:08.178711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:08.198673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:08.200089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:08.212332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:08.213175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:08.213877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:08.214845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:08.215518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:08.216393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:08.264182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:08.264994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:08.265593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:08.267517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lazy-loading 'fault' on Instance uuid 354669a0-44c5-48e8-bf2a-64dc851c6471 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:55:08.320435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '989216ae9bb6405a8f0d352299f49f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91576e0d40cb423692d205519af2bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:08.328326 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f8e4b4da-e043-4ac2-bc55-f77d765e2a14 tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 200 len: 1313 microversion: 2.1 time: 0.136499 Nov 02 13:55:08.329810 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3545/6713] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:08 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:08.401678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:08.410482 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6bcbbd81-d91f-473e-acc6-bb47bb696c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.249114 Nov 02 13:55:08.411076 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3169/6714] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:08 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:09.355987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:09.357317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] [instance: 354669a0-44c5-48e8-bf2a-64dc851c6471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:09.365219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.365714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.366160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.366884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.367381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.367815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.387459 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] HTTP exception thrown: Instance 354669a0-44c5-48e8-bf2a-64dc851c6471 could not be found. Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Request method failure captured: Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 HTTP/1.1 Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnXmtx_JbAYQIlQZYp5iKtSXGjwH3K1wv_wIg1MoLL5g6QdwSvoS_FfL0SfIp-5hfwPxReciogSOykxj_dHUXR_SNgWbA4FDNJa1YNokEXA96HPmkNlYQxP4rcYvl6MxWNnkwxCloPiLOdVTKaMfUBeDy1P9H08jLypC0DQrg0VgljE Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 91576e0d40cb423692d205519af2bb2e Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1136278750 Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/91576e0d40cb423692d205519af2bb2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/91576e0d40cb423692d205519af2bb2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_91576e0d40cb423692d205519af2bb2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/91576e0d40cb423692d205519af2bb2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesSnapshotTestJSON-1136278750 Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 91576e0d40cb423692d205519af2bb2e Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1136278750 Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesSnapshotTestJSON-1136278750-project Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 989216ae9bb6405a8f0d352299f49f77 Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesSnapshotTestJSON-1136278750-project Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 354669a0-44c5-48e8-bf2a-64dc851c6471 could not be found. Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '354669a0-44c5-48e8-bf2a-64dc851c6471'} Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354669a0-44c5-48e8-bf2a-64dc851c6471 could not be found. Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354669a0-44c5-48e8-bf2a-64dc851c6471 could not be found. Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:09.389445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354669a0-44c5-48e8-bf2a-64dc851c6471 could not be found. Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] Returning 404 to user: Instance 354669a0-44c5-48e8-bf2a-64dc851c6471 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19026a79-8537-44bd-887c-c42c9703420f tempest-VolumesSnapshotTestJSON-1136278750 tempest-VolumesSnapshotTestJSON-1136278750-project] 10.222.0.113 "GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471" status: 404 len: 111 microversion: 2.1 time: 0.040053 Nov 02 13:55:09.400944 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3546/6715] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:09 2022] GET /compute/v2.1/servers/354669a0-44c5-48e8-bf2a-64dc851c6471 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:55:09.433865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:09.434495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:09.443890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.444520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.444812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.445588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:09.445966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:09.446401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:09.655689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:09.668269 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3876d40d-603b-4a6b-96fa-16175352b0c3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.237283 Nov 02 13:55:09.669074 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3170/6716] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:09 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:10.693025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:10.694325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:10.714976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.716809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.717549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.720945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:10.721690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:10.722374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:10.914455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:10.924657 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-14c34662-71d3-4628-baa5-5d0f3957114e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.235123 Nov 02 13:55:10.925707 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3547/6717] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:10 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:11.949060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:11.949776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:11.957011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.957515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.957955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:11.958655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:11.959138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:11.959562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:12.180584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:12.192814 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dedc313a-5b30-4aba-8a63-2f7b241c6ba4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.246639 Nov 02 13:55:12.195483 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3171/6718] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:11 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:13.221068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:13.222432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:13.230092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:13.230672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:13.231207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:13.232025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:13.232570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:13.233332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:13.380993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:13.392525 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d92c84d7-6f0a-4499-b405-329f3b25e7d6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.178190 Nov 02 13:55:13.393239 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3548/6719] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:13 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:14.431762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:14.433952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:14.442971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.443886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.444522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.445437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:14.446241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:14.446860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:14.714601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:14.726300 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee55545a-6a12-421a-8bb0-e17feec9fd7a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1700 microversion: 2.1 time: 0.313227 Nov 02 13:55:14.727333 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3172/6720] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:14 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1700 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:15.114397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f631705b-ea03-4033-a62e-5b6790c3a49d req-6e932a99-9731-4c0a-8858-0eb19d3e8ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "name": "network-vif-unplugged", "status": "completed", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:15.142668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f631705b-ea03-4033-a62e-5b6790c3a49d req-6e932a99-9731-4c0a-8858-0eb19d3e8ac9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:15.143190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f631705b-ea03-4033-a62e-5b6790c3a49d req-6e932a99-9731-4c0a-8858-0eb19d3e8ac9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:15.147576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f631705b-ea03-4033-a62e-5b6790c3a49d req-6e932a99-9731-4c0a-8858-0eb19d3e8ac9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:15.175880 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f631705b-ea03-4033-a62e-5b6790c3a49d req-6e932a99-9731-4c0a-8858-0eb19d3e8ac9 service nova] Creating event network-vif-unplugged:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h1-858384-19 Nov 02 13:55:15.189099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-f631705b-ea03-4033-a62e-5b6790c3a49d req-6e932a99-9731-4c0a-8858-0eb19d3e8ac9 service nova] Instance 72135482-2437-484d-b767-fb9994a78e59 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:55:15.229251 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f631705b-ea03-4033-a62e-5b6790c3a49d req-6e932a99-9731-4c0a-8858-0eb19d3e8ac9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117317 Nov 02 13:55:15.233528 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3549/6721] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:15.750205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:15.756132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:15.780551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:15.781428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:15.782609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:15.784571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:15.785361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:15.786854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:16.084590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:16.100910 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83889ade-aef8-42e4-a386-b5b6b8b25341 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1699 microversion: 2.1 time: 0.353804 Nov 02 13:55:16.102205 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3173/6722] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:15 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1699 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:17.126551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:17.127839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:17.135269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:17.136014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:17.136655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:17.137545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:17.138005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:17.138441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:17.158976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:17.261139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ce93758f-3749-4ec2-8f1c-88bfe90cfb0b req-14e39c1f-483d-4fcc-8f07-4bcad8a54453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:17.273796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ce93758f-3749-4ec2-8f1c-88bfe90cfb0b req-14e39c1f-483d-4fcc-8f07-4bcad8a54453 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:17.274597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ce93758f-3749-4ec2-8f1c-88bfe90cfb0b req-14e39c1f-483d-4fcc-8f07-4bcad8a54453 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:17.275386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ce93758f-3749-4ec2-8f1c-88bfe90cfb0b req-14e39c1f-483d-4fcc-8f07-4bcad8a54453 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:17.282145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:17.293387 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ce93758f-3749-4ec2-8f1c-88bfe90cfb0b req-14e39c1f-483d-4fcc-8f07-4bcad8a54453 service nova] Creating event network-changed:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h1-858384-19 Nov 02 13:55:17.302176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-ce93758f-3749-4ec2-8f1c-88bfe90cfb0b req-14e39c1f-483d-4fcc-8f07-4bcad8a54453 service nova] Instance 72135482-2437-484d-b767-fb9994a78e59 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:55:17.316221 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ce93758f-3749-4ec2-8f1c-88bfe90cfb0b req-14e39c1f-483d-4fcc-8f07-4bcad8a54453 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059690 Nov 02 13:55:17.317662 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3174/6723] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:17.337394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:17.356945 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-96b2b78a-ccd0-4af9-9e85-99a0c755092b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1697 microversion: 2.1 time: 0.235310 Nov 02 13:55:17.357565 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3550/6724] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:17 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1697 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:18.385514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:18.387806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:18.413240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:18.415803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:18.419932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:18.420786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:18.421418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:18.422352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:18.729200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:18.767893 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-849d87a6-5c24-46ef-8448-f59caed65269 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1697 microversion: 2.1 time: 0.389128 Nov 02 13:55:18.768670 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3175/6725] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:18 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1697 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:19.796204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:19.798185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:19.811067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.811813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.812461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:19.819156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:19.820557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:19.821177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:20.140617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:20.149089 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-596667ca-1594-496f-81ae-8d9059615d40 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1697 microversion: 2.1 time: 0.356685 Nov 02 13:55:20.164691 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3551/6726] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:19 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1697 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:21.176796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:21.186516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:21.216555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:21.217375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:21.218050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:21.219568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:21.220248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:21.220895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:21.523823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:21.546810 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90489ab1-4194-4a83-a11f-0b7ab4934cfb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1694 microversion: 2.1 time: 0.376378 Nov 02 13:55:21.579096 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3176/6727] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:21 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1694 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:21.603989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-021f5ef4-e043-4b8f-bbbd-cf118cbad45f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:21.605531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-021f5ef4-e043-4b8f-bbbd-cf118cbad45f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:21.613271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-021f5ef4-e043-4b8f-bbbd-cf118cbad45f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:21.613873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-021f5ef4-e043-4b8f-bbbd-cf118cbad45f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:21.614398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-021f5ef4-e043-4b8f-bbbd-cf118cbad45f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:21.615239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-021f5ef4-e043-4b8f-bbbd-cf118cbad45f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:21.616196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-021f5ef4-e043-4b8f-bbbd-cf118cbad45f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:21.616857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-021f5ef4-e043-4b8f-bbbd-cf118cbad45f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:21.782526 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-021f5ef4-e043-4b8f-bbbd-cf118cbad45f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action" status: 202 len: 0 microversion: 2.1 time: 0.181042 Nov 02 13:55:21.786904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3552/6728] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:55:21 2022] POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:55:21.797791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:21.798563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:21.812165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:21.814770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:21.814924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:21.815734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:21.816208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:21.816643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:22.099374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:22.112280 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4e0094c1-65b8-4903-ac58-8726480de71f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1693 microversion: 2.1 time: 0.320816 Nov 02 13:55:22.113118 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3177/6729] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:21 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1693 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:22.955014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-29de91e4-07a8-4b1b-a0a3-8620a2248e18 req-70dafdab-1878-46c7-80b5-a7426ba786f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "name": "network-vif-plugged", "status": "completed", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:22.993336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-29de91e4-07a8-4b1b-a0a3-8620a2248e18 req-70dafdab-1878-46c7-80b5-a7426ba786f1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:22.997499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-29de91e4-07a8-4b1b-a0a3-8620a2248e18 req-70dafdab-1878-46c7-80b5-a7426ba786f1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:22.998111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-29de91e4-07a8-4b1b-a0a3-8620a2248e18 req-70dafdab-1878-46c7-80b5-a7426ba786f1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.027681 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-29de91e4-07a8-4b1b-a0a3-8620a2248e18 req-70dafdab-1878-46c7-80b5-a7426ba786f1 service nova] Creating event network-vif-plugged:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h1-858384-19 Nov 02 13:55:23.043083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-29de91e4-07a8-4b1b-a0a3-8620a2248e18 req-70dafdab-1878-46c7-80b5-a7426ba786f1 service nova] Instance 72135482-2437-484d-b767-fb9994a78e59 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:55:23.091982 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-29de91e4-07a8-4b1b-a0a3-8620a2248e18 req-70dafdab-1878-46c7-80b5-a7426ba786f1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133737 Nov 02 13:55:23.096569 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3553/6730] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:23.154528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:23.156854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:23.164469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:23.166019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.166666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.167315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.168536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:23.169155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:23.169747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:23.331859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:23.340046 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b493e1c7-61f8-4461-b04c-5ce5c14308e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1693 microversion: 2.1 time: 0.190618 Nov 02 13:55:23.340628 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3178/6731] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:23 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1693 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:24.366322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:24.367292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:24.369382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=47 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:24.374869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.375669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.376378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.377250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:24.377782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:24.378301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:24.543229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:24.552086 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8dab9051-43e4-4c8e-84c5-a0bb9c8b2a61 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1693 microversion: 2.1 time: 0.191022 Nov 02 13:55:24.564898 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3554/6732] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:24 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1693 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:25.123915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8bb77cfd-e718-4836-94b6-fb18f6e8f458 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:25.131061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8bb77cfd-e718-4836-94b6-fb18f6e8f458 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:25.147495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bb77cfd-e718-4836-94b6-fb18f6e8f458 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.148363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bb77cfd-e718-4836-94b6-fb18f6e8f458 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.148956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bb77cfd-e718-4836-94b6-fb18f6e8f458 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.154413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bb77cfd-e718-4836-94b6-fb18f6e8f458 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.155011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bb77cfd-e718-4836-94b6-fb18f6e8f458 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.156227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bb77cfd-e718-4836-94b6-fb18f6e8f458 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.195339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8bb77cfd-e718-4836-94b6-fb18f6e8f458 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments/d0f9e7e0-1558-4ba8-9601-d6857d203ed6" status: 200 len: 194 microversion: 2.20 time: 0.076293 Nov 02 13:55:25.196547 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3179/6733] 10.222.0.113 () {60 vars in 1459 bytes} [Wed Nov 2 13:55:25 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments/d0f9e7e0-1558-4ba8-9601-d6857d203ed6 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:25.295522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:25.296258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:25.312241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.319601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.320146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.323071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.323578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.324017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.459210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lazy-loading 'services' on Instance uuid 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:55:25.576303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:25.576986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:25.586646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.587438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.588375 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-074b9a18-6b3b-4016-a2c6-ceceeeaf6ea7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments/d0f9e7e0-1558-4ba8-9601-d6857d203ed6" status: 202 len: 0 microversion: 2.20 time: 0.298087 Nov 02 13:55:25.588630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.589254 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3555/6734] 10.222.0.113 () {60 vars in 1462 bytes} [Wed Nov 2 13:55:25 2022] DELETE /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments/d0f9e7e0-1558-4ba8-9601-d6857d203ed6 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:55:25.594380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.595069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.595712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.599381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9a7f9af0-c721-4a87-adcc-73055f4d21d8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:25.607444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9a7f9af0-c721-4a87-adcc-73055f4d21d8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:25.619091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a7f9af0-c721-4a87-adcc-73055f4d21d8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.621693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a7f9af0-c721-4a87-adcc-73055f4d21d8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.623703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a7f9af0-c721-4a87-adcc-73055f4d21d8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.624632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a7f9af0-c721-4a87-adcc-73055f4d21d8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:25.625883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a7f9af0-c721-4a87-adcc-73055f4d21d8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:25.633815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9a7f9af0-c721-4a87-adcc-73055f4d21d8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:25.721937 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9a7f9af0-c721-4a87-adcc-73055f4d21d8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.127338 Nov 02 13:55:25.722891 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3556/6735] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:55:25 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:26.266188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:26.276648 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3c09837b-ce58-42df-8842-69ca551c75e6 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1693 microversion: 2.1 time: 0.703017 Nov 02 13:55:26.277266 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3180/6736] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:25 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1693 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:55:26.737192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c87eb0ef-2b5e-46a3-8028-c7ed2a8f560b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:26.739585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c87eb0ef-2b5e-46a3-8028-c7ed2a8f560b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:26.751636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c87eb0ef-2b5e-46a3-8028-c7ed2a8f560b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:26.752244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c87eb0ef-2b5e-46a3-8028-c7ed2a8f560b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:26.752550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c87eb0ef-2b5e-46a3-8028-c7ed2a8f560b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:26.761604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c87eb0ef-2b5e-46a3-8028-c7ed2a8f560b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:26.763671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c87eb0ef-2b5e-46a3-8028-c7ed2a8f560b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:26.766640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c87eb0ef-2b5e-46a3-8028-c7ed2a8f560b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:26.848121 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c87eb0ef-2b5e-46a3-8028-c7ed2a8f560b tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111032 Nov 02 13:55:26.849851 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3557/6737] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:55:26 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:26.874471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9929c169-dd58-4388-a34e-cdcc26e1c47e req-4928aec8-b7fe-42d2-aa3d-cc6d4bd7f580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "name": "network-vif-unplugged", "status": "completed", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:26.910126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9929c169-dd58-4388-a34e-cdcc26e1c47e req-4928aec8-b7fe-42d2-aa3d-cc6d4bd7f580 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:26.914285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9929c169-dd58-4388-a34e-cdcc26e1c47e req-4928aec8-b7fe-42d2-aa3d-cc6d4bd7f580 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:26.914808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9929c169-dd58-4388-a34e-cdcc26e1c47e req-4928aec8-b7fe-42d2-aa3d-cc6d4bd7f580 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:26.935259 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9929c169-dd58-4388-a34e-cdcc26e1c47e req-4928aec8-b7fe-42d2-aa3d-cc6d4bd7f580 service nova] Creating event network-vif-unplugged:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h2-858384-19 Nov 02 13:55:26.987509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-9929c169-dd58-4388-a34e-cdcc26e1c47e req-4928aec8-b7fe-42d2-aa3d-cc6d4bd7f580 service nova] Instance 72135482-2437-484d-b767-fb9994a78e59 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:55:27.009370 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9929c169-dd58-4388-a34e-cdcc26e1c47e req-4928aec8-b7fe-42d2-aa3d-cc6d4bd7f580 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138561 Nov 02 13:55:27.018254 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3181/6738] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:27.311940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:27.311940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:27.326232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.326624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.327463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:27.331542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.332118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.333366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:27.696413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:27.708034 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31596b60-2d72-4aae-8150-3c863c1d2645 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1693 microversion: 2.1 time: 0.406777 Nov 02 13:55:27.709467 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3558/6739] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:27 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1693 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:27.865096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b7c014c-627b-4195-814f-5e47be481af4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:27.868637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6b7c014c-627b-4195-814f-5e47be481af4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:27.888058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b7c014c-627b-4195-814f-5e47be481af4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.890152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b7c014c-627b-4195-814f-5e47be481af4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.900102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b7c014c-627b-4195-814f-5e47be481af4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:27.901433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b7c014c-627b-4195-814f-5e47be481af4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:27.902208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b7c014c-627b-4195-814f-5e47be481af4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:27.902827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b7c014c-627b-4195-814f-5e47be481af4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:28.014487 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b7c014c-627b-4195-814f-5e47be481af4 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.156506 Nov 02 13:55:28.018276 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3182/6740] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:55:27 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:28.735579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:28.736398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:28.751716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:28.752655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:28.753308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:28.754232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:28.754851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:28.755494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.010673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:29.021822 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f71071e-48ea-4f3c-9632-dc76f34ac75f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1693 microversion: 2.1 time: 0.291549 Nov 02 13:55:29.023535 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3559/6741] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:28 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1693 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:29.030379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cc59414d-1218-4d3b-b9f6-ac247abdf774 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:29.033952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cc59414d-1218-4d3b-b9f6-ac247abdf774 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:29.041256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc59414d-1218-4d3b-b9f6-ac247abdf774 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.042138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc59414d-1218-4d3b-b9f6-ac247abdf774 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.042829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc59414d-1218-4d3b-b9f6-ac247abdf774 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.043904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc59414d-1218-4d3b-b9f6-ac247abdf774 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.044592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc59414d-1218-4d3b-b9f6-ac247abdf774 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.045323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cc59414d-1218-4d3b-b9f6-ac247abdf774 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.092391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cc59414d-1218-4d3b-b9f6-ac247abdf774 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065134 Nov 02 13:55:29.093226 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3183/6742] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:55:29 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:29.135853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9648ffff-b1e8-470c-a780-4d1b35265817 req-1ce98a3b-589e-464c-928e-54a135893326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:29.166530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9648ffff-b1e8-470c-a780-4d1b35265817 req-1ce98a3b-589e-464c-928e-54a135893326 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:29.167537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9648ffff-b1e8-470c-a780-4d1b35265817 req-1ce98a3b-589e-464c-928e-54a135893326 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:29.168247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9648ffff-b1e8-470c-a780-4d1b35265817 req-1ce98a3b-589e-464c-928e-54a135893326 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:29.193198 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9648ffff-b1e8-470c-a780-4d1b35265817 req-1ce98a3b-589e-464c-928e-54a135893326 service nova] Creating event network-changed:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h2-858384-19 Nov 02 13:55:29.200345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-9648ffff-b1e8-470c-a780-4d1b35265817 req-1ce98a3b-589e-464c-928e-54a135893326 service nova] Instance 72135482-2437-484d-b767-fb9994a78e59 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 13:55:29.216242 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9648ffff-b1e8-470c-a780-4d1b35265817 req-1ce98a3b-589e-464c-928e-54a135893326 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085529 Nov 02 13:55:29.222917 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3560/6743] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:30.058057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:30.058682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:30.084837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:30.085332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:30.094818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:30.096342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:30.096842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:30.097382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:30.110827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-895f3e1a-675e-49d3-a823-f6f178abbc41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:30.113631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-895f3e1a-675e-49d3-a823-f6f178abbc41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:30.118618 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:55:30.118791 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 13:55:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments (ip 10.222.0.113) !!! Nov 02 13:55:30.174942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-895f3e1a-675e-49d3-a823-f6f178abbc41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:30.175457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-895f3e1a-675e-49d3-a823-f6f178abbc41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:30.175899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-895f3e1a-675e-49d3-a823-f6f178abbc41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:30.176615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-895f3e1a-675e-49d3-a823-f6f178abbc41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:30.177064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-895f3e1a-675e-49d3-a823-f6f178abbc41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:30.177485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-895f3e1a-675e-49d3-a823-f6f178abbc41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:30.227493 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-895f3e1a-675e-49d3-a823-f6f178abbc41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125593 Nov 02 13:55:30.228645 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3561/6744] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:55:30 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:30.426399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:30.435545 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0064a28c-bb8e-4725-b2d6-6c059c2a8551 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1693 microversion: 2.1 time: 0.386534 Nov 02 13:55:30.437098 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3184/6745] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:30 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1693 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:31.241335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6fc4b4ea-6344-4939-915a-124a234b6416 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:31.244723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6fc4b4ea-6344-4939-915a-124a234b6416 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:31.253413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc4b4ea-6344-4939-915a-124a234b6416 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:31.254264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc4b4ea-6344-4939-915a-124a234b6416 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:31.255696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc4b4ea-6344-4939-915a-124a234b6416 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:31.257791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc4b4ea-6344-4939-915a-124a234b6416 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:31.269692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc4b4ea-6344-4939-915a-124a234b6416 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:31.272315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc4b4ea-6344-4939-915a-124a234b6416 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:31.403341 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6fc4b4ea-6344-4939-915a-124a234b6416 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.165860 Nov 02 13:55:31.409432 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3562/6746] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:55:31 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:31.464794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:31.466177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:31.517360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:31.517874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:31.518326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:31.519075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:31.555615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:31.559899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:32.129425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:32.146685 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-47057c5b-18e7-49e7-9945-54d9d0f41c56 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1693 microversion: 2.1 time: 0.686827 Nov 02 13:55:32.148669 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3185/6747] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:31 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1693 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:32.417347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-70c63764-1c4a-4ff1-b440-488ef91ac72c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:32.419723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-70c63764-1c4a-4ff1-b440-488ef91ac72c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:32.435134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70c63764-1c4a-4ff1-b440-488ef91ac72c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:32.435850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70c63764-1c4a-4ff1-b440-488ef91ac72c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:32.436476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70c63764-1c4a-4ff1-b440-488ef91ac72c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:32.437407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70c63764-1c4a-4ff1-b440-488ef91ac72c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:32.438836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70c63764-1c4a-4ff1-b440-488ef91ac72c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:32.439573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-70c63764-1c4a-4ff1-b440-488ef91ac72c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:32.473548 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-70c63764-1c4a-4ff1-b440-488ef91ac72c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060660 Nov 02 13:55:32.474939 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3563/6748] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:55:32 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:33.172569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:33.173446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:33.180160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.187304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.187996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.188871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.189420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.199665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.450812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:33.464788 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1065216c-aa85-4ee1-9947-1cdb50d32518 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1686 microversion: 2.1 time: 0.296601 Nov 02 13:55:33.472066 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3186/6749] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:55:33 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1686 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:33.489275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11c3eec9-f80e-476f-be9c-867379f67ce6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:33.501049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11c3eec9-f80e-476f-be9c-867379f67ce6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:33.521534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11c3eec9-f80e-476f-be9c-867379f67ce6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.522122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11c3eec9-f80e-476f-be9c-867379f67ce6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.522647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11c3eec9-f80e-476f-be9c-867379f67ce6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.523508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11c3eec9-f80e-476f-be9c-867379f67ce6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.523931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11c3eec9-f80e-476f-be9c-867379f67ce6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.524359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11c3eec9-f80e-476f-be9c-867379f67ce6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.611660 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11c3eec9-f80e-476f-be9c-867379f67ce6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.128715 Nov 02 13:55:33.612702 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3564/6750] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:55:33 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:55:33.699987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5e349ca9-1b2c-4092-a7ab-dbec195ab675 req-dfa06527-050a-4cbe-bf59-855145d788e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "name": "network-vif-plugged", "status": "completed", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:33.713149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5e349ca9-1b2c-4092-a7ab-dbec195ab675 req-dfa06527-050a-4cbe-bf59-855145d788e4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.713890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5e349ca9-1b2c-4092-a7ab-dbec195ab675 req-dfa06527-050a-4cbe-bf59-855145d788e4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.714426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5e349ca9-1b2c-4092-a7ab-dbec195ab675 req-dfa06527-050a-4cbe-bf59-855145d788e4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.728045 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5e349ca9-1b2c-4092-a7ab-dbec195ab675 req-dfa06527-050a-4cbe-bf59-855145d788e4 service nova] Creating event network-vif-plugged:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h2-858384-19 Nov 02 13:55:33.737896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:33.738506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:33.753217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.755503 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5e349ca9-1b2c-4092-a7ab-dbec195ab675 req-dfa06527-050a-4cbe-bf59-855145d788e4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060741 Nov 02 13:55:33.756093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.757551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.757726 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3187/6751] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:33.758527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.759090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.759653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.786908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:33.792710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:55:33.901782 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e3b8265-316a-4eda-8285-ebd1884c187d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 204 len: 0 microversion: 2.20 time: 0.167577 Nov 02 13:55:33.902783 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3565/6752] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:55:33 2022] DELETE /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:55:33.913587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:33.914552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:33.922722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.923734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.924475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:33.925291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:33.925890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:33.926413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:34.108257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:34.117909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:34.119596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:34.120768 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bab5bbcb-336f-478d-98f1-56eaa587c056 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.212954 Nov 02 13:55:34.121613 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3188/6753] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:33 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:35.149003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:35.149696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:35.157755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:35.158455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:35.159049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:35.159999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:35.160631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:35.161212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:35.328934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:35.339235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:35.345062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:35.346137 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-33c66d39-690e-4ca7-8a09-8c1eda37e371 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.201120 Nov 02 13:55:35.359162 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3566/6754] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:35 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:36.374717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:36.377033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:36.390880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:36.390880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:36.390880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:36.394756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:36.395322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:36.395761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:36.753659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:36.766421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:36.770998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:36.772358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4783983e-16ab-47eb-8243-6f5266857868 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1726 microversion: 2.20 time: 0.402230 Nov 02 13:55:36.774306 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3189/6755] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:36 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1726 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:37.289760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c628d4f8-8e9b-4d74-bed1-683ba1f373de req-a7457021-9435-4f8c-bb79-67c6e0788918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faf26b2-214b-40c4-b5c2-81cf8524b8e7", "name": "network-vif-deleted", "tag": "62875f3c-3f2e-4138-869d-d53e38408179"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:37.334507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c628d4f8-8e9b-4d74-bed1-683ba1f373de req-a7457021-9435-4f8c-bb79-67c6e0788918 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:37.335821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c628d4f8-8e9b-4d74-bed1-683ba1f373de req-a7457021-9435-4f8c-bb79-67c6e0788918 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:37.336948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c628d4f8-8e9b-4d74-bed1-683ba1f373de req-a7457021-9435-4f8c-bb79-67c6e0788918 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:37.361014 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c628d4f8-8e9b-4d74-bed1-683ba1f373de req-a7457021-9435-4f8c-bb79-67c6e0788918 service nova] Creating event network-vif-deleted:62875f3c-3f2e-4138-869d-d53e38408179 for instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 on n-h1-858384-19 Nov 02 13:55:37.376783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c628d4f8-8e9b-4d74-bed1-683ba1f373de req-a7457021-9435-4f8c-bb79-67c6e0788918 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093600 Nov 02 13:55:37.382903 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3567/6756] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:37.819525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:37.820148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:37.840321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:37.848258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:37.850142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:37.853691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:37.856980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:37.858810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:37.950694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:37.951659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:37.952943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:37.954402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lazy-loading 'fault' on Instance uuid 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:55:38.108682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:38.123881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:38.126324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:38.127709 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e78716e9-7d31-4ea0-8454-6ce72c17c6a6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 200 len: 1374 microversion: 2.20 time: 0.315349 Nov 02 13:55:38.150601 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3190/6757] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:37 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 1374 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:39.171364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:39.172449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:39.184712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:39.185630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:39.186537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:39.188574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:39.189209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:39.189830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:39.220973 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] HTTP exception thrown: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Request method failure captured: Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 HTTP/1.1 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnW9L6a0Mso0_swLwiXid2NZ5pW2Ib2jpdbUNxgScoEl2cQYqZouBDUoZd6ll8wKwad3DSyPsjUpSlebeTxLveUDVW6dJmIaTiH-tVEZVHlnsImITWDme3aWp_8qUq3yuxkjexiHFFyP97WqpiTAsOUg-e--fpwFtW40XK1_0-8yX_I Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd20cf58421e4143937dc67313b226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f93c7bf631b045809ba606910497a3b5 Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '2faf26b2-214b-40c4-b5c2-81cf8524b8e7'} Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:55:39.222805 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Returning 404 to user: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-84f681e2-22a4-43b6-8fee-e9afcb6ef3c6 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 404 len: 111 microversion: 2.20 time: 0.062004 Nov 02 13:55:39.227733 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3568/6758] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:39 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:55:39.236998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-221a4d21-d1a4-44ce-bfff-970d6f37743c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '.version_select at 0x7fe78fa304c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:39.291447 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-221a4d21-d1a4-44ce-bfff-970d6f37743c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92361212" status: 204 len: 0 microversion: 2.20 time: 0.059001 Nov 02 13:55:39.292457 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3191/6759] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 13:55:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92361212 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:55:40.473705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d6487e43-f943-4726-adb9-9a425ee9608c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'create', calling method: .version_select at 0x7fe785f69040>, body: {"keypair": {"name": "tempest-keypair-408581039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXDJwhOodZkk3is7VSd9fIOkwd89fWmkuoHBzCVLdacQTkQ6JbsQ+QuRfQ3HCvptlyom5sRpES8HDVYvUbWUdljcMtZw3wjrGkn4nsZVzXQzWywyrhUNzmUUSvljWy+xQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:40.493777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d6487e43-f943-4726-adb9-9a425ee9608c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Getting quotas for project cd20cf58421e4143937dc67313b226f8. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:40.519555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d6487e43-f943-4726-adb9-9a425ee9608c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Getting quotas for user f93c7bf631b045809ba606910497a3b5 and project cd20cf58421e4143937dc67313b226f8. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:40.571154 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d6487e43-f943-4726-adb9-9a425ee9608c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.105006 Nov 02 13:55:40.571852 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3569/6760] 10.222.0.113 () {62 vars in 1205 bytes} [Wed Nov 2 13:55:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 02 13:55:42.814011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-586487213", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7500adb-3941-48b7-871e-1b8735c0d0cb"}], "security_groups": [{"name": "tempest-securitygroup--1163429784"}], "key_name": "tempest-keypair-408581039", "user_data": "}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:42.969243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] validate_networks() for [('d7500adb-3941-48b7-871e-1b8735c0d0cb', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:55:43.604572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:55:43.605299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:55:43.605775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:55:43.606452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:55:43.607073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:55:43.618413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:43.618947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:43.619767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:43.620998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:43.621728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:43.622231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:43.662935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Getting quotas for project cd20cf58421e4143937dc67313b226f8. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:55:43.670201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Getting quotas for user f93c7bf631b045809ba606910497a3b5 and project cd20cf58421e4143937dc67313b226f8. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:55:43.697046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:55:43.700944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:55:43.767543 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1572f576-4be6-41f7-ad05-c3a48c6a4b14 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.958282 Nov 02 13:55:43.769208 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3192/6761] 10.222.0.113 () {62 vars in 1193 bytes} [Wed Nov 2 13:55:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 13:55:43.782140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dd572437-a59c-486c-80b3-1a791cffc9e7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:43.783481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dd572437-a59c-486c-80b3-1a791cffc9e7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:43.851391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd572437-a59c-486c-80b3-1a791cffc9e7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:43.862323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd572437-a59c-486c-80b3-1a791cffc9e7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:43.864549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dd572437-a59c-486c-80b3-1a791cffc9e7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:43.865901 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dd572437-a59c-486c-80b3-1a791cffc9e7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1284 microversion: 2.20 time: 0.089492 Nov 02 13:55:43.872120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3570/6762] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:43 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:44.897688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:44.898297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:44.908408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:44.909203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:44.909834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:44.910760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:44.911451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:44.912070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:44.936495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:45.029803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:45.039490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:45.046041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:45.050368 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f8b30be2-acd0-464d-b9a2-301392558762 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1336 microversion: 2.20 time: 0.157960 Nov 02 13:55:45.053909 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3193/6763] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:44 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1336 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:55:46.080025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:46.080637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:46.094031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:46.095031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:46.095672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:46.099451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:46.100156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:46.100779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:46.224054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:46.248130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:46.250864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:46.252450 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ad04388-10c8-4ad5-b1d6-372056fb41e3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1342 microversion: 2.20 time: 0.176930 Nov 02 13:55:46.253597 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3571/6764] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:46 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:47.287779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:47.288524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:47.301539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:47.304456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:47.305140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:47.306301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:47.306952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:47.307480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:47.601974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:47.610835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:47.612365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:47.613496 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4935ee9c-a224-4b97-88a7-c68826fcb431 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1410 microversion: 2.20 time: 0.331815 Nov 02 13:55:47.651285 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3194/6765] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:47 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1410 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:47.769882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-74fbb1b6-2887-4ed2-91d0-951af1e64cd4 req-86356fa4-3d5b-4863-90c6-99eb7997592f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e8f9b9-7973-4381-8851-1b919f953487", "tag": "339d808c-dd60-4ec3-9279-d5c8b8c51695"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:47.783930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-74fbb1b6-2887-4ed2-91d0-951af1e64cd4 req-86356fa4-3d5b-4863-90c6-99eb7997592f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:47.785178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-74fbb1b6-2887-4ed2-91d0-951af1e64cd4 req-86356fa4-3d5b-4863-90c6-99eb7997592f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:47.785895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-74fbb1b6-2887-4ed2-91d0-951af1e64cd4 req-86356fa4-3d5b-4863-90c6-99eb7997592f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:47.817749 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-74fbb1b6-2887-4ed2-91d0-951af1e64cd4 req-86356fa4-3d5b-4863-90c6-99eb7997592f service nova] Creating event network-changed:339d808c-dd60-4ec3-9279-d5c8b8c51695 for instance 71e8f9b9-7973-4381-8851-1b919f953487 on n-h1-858384-19 Nov 02 13:55:47.823547 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-74fbb1b6-2887-4ed2-91d0-951af1e64cd4 req-86356fa4-3d5b-4863-90c6-99eb7997592f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060570 Nov 02 13:55:47.824739 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3572/6766] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:48.643568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:48.644372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:48.663335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.664686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.665399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:48.666404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:48.667161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:48.667770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:48.832016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:48.842113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:48.844844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:48.846264 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-13f49f27-a4e3-49b7-8e2c-bc08705dfe48 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1410 microversion: 2.20 time: 0.208324 Nov 02 13:55:48.861218 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3195/6767] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:48 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1410 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:49.878318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:49.879741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:49.891130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:49.892122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:49.892799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:49.893929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:49.895144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:49.896289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:50.042051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:50.053045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:50.055581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:50.057144 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4d93ffd3-af2d-46ba-b161-6dfceded8fea tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1410 microversion: 2.20 time: 0.186477 Nov 02 13:55:50.057828 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3573/6768] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:49 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1410 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:51.083754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:51.085221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:51.105920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.106442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.120486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.121244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:51.125101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:51.125550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:51.566332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:51.579512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:51.581414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:51.582825 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8920e650-17f9-4eda-b00f-31a40991ed04 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1410 microversion: 2.20 time: 0.503965 Nov 02 13:55:51.583950 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3196/6769] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:51 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1410 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:52.616748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:52.617535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:52.629906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:52.631007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:52.632399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:52.633626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:52.634490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:52.635082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:52.921442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:52.939742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:52.941471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:52.942907 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3a62cb5e-b83a-4099-95be-484f8699412a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1410 microversion: 2.20 time: 0.330941 Nov 02 13:55:52.943542 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3574/6770] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:52 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1410 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:53.974344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:53.974854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:53.980116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:53.981010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:53.985978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:54.000723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:54.002327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:54.004232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:54.005277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:54.005895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:54.006480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:54.356235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:54.370000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:54.372329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:54.374426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1abeb844-f74f-46a1-ad82-d339c19826c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1410 microversion: 2.20 time: 0.406554 Nov 02 13:55:54.376849 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3197/6771] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:53 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1410 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:55.145768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f7ad5064-0dd6-448c-8732-bc4b2e30e4ed req-c93c2c4b-c35e-490b-9dd1-6f3a0fc3039a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e8f9b9-7973-4381-8851-1b919f953487", "name": "network-vif-plugged", "status": "completed", "tag": "339d808c-dd60-4ec3-9279-d5c8b8c51695"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:55.154145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:55.156693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:55:55.164301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f7ad5064-0dd6-448c-8732-bc4b2e30e4ed req-c93c2c4b-c35e-490b-9dd1-6f3a0fc3039a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.165096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f7ad5064-0dd6-448c-8732-bc4b2e30e4ed req-c93c2c4b-c35e-490b-9dd1-6f3a0fc3039a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.166221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f7ad5064-0dd6-448c-8732-bc4b2e30e4ed req-c93c2c4b-c35e-490b-9dd1-6f3a0fc3039a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.412069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:55.413492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:55.466247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.467135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.467773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.469488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:55.470122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:55.471457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:55.701750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f7ad5064-0dd6-448c-8732-bc4b2e30e4ed req-c93c2c4b-c35e-490b-9dd1-6f3a0fc3039a service nova] Creating event network-vif-plugged:339d808c-dd60-4ec3-9279-d5c8b8c51695 for instance 71e8f9b9-7973-4381-8851-1b919f953487 on n-h1-858384-19 Nov 02 13:55:55.708045 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f7ad5064-0dd6-448c-8732-bc4b2e30e4ed req-c93c2c4b-c35e-490b-9dd1-6f3a0fc3039a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.570379 Nov 02 13:55:55.712714 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3575/6772] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:55:55.751632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:55.768814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:55.770305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:55.784372 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cdd7d3a0-bb9b-45f4-919f-968fb068626c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1410 microversion: 2.20 time: 0.372774 Nov 02 13:55:55.803249 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3198/6773] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:55 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1410 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:56.822996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:56.823839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:56.836720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:56.837239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:56.837674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:56.838399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:56.838870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:56.839475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:57.076437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:57.085889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:57.087682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:57.089023 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ec8f346a-4bff-4a2c-b255-388590a70ed5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1410 microversion: 2.20 time: 0.271587 Nov 02 13:55:57.103537 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3576/6774] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:56 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1410 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:58.116599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:58.118113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:58.127606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:58.128572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:58.129221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.130140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:58.131059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:58.131718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.290035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:58.300133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:58.301898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:55:58.303090 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c91e0660-1ac8-4702-b422-2844ac18ccf7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1602 microversion: 2.20 time: 0.191169 Nov 02 13:55:58.303681 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3199/6775] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:55:58 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1602 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:55:58.329576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4c9e7e91-f5ad-4f1d-9b15-ae091a36343a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:55:58.330149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4c9e7e91-f5ad-4f1d-9b15-ae091a36343a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:55:58.337889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e91-f5ad-4f1d-9b15-ae091a36343a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:58.338389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e91-f5ad-4f1d-9b15-ae091a36343a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:58.338834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e91-f5ad-4f1d-9b15-ae091a36343a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.339622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e91-f5ad-4f1d-9b15-ae091a36343a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:58.340253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e91-f5ad-4f1d-9b15-ae091a36343a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:58.340704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e91-f5ad-4f1d-9b15-ae091a36343a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:58.432502 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4c9e7e91-f5ad-4f1d-9b15-ae091a36343a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107578 Nov 02 13:55:58.433558 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3577/6776] 10.222.0.113 () {60 vars in 1321 bytes} [Wed Nov 2 13:55:58 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:55:59.869346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-67c0105e-815d-463c-aea0-4aa0ce7f063e req-bc3c5642-5921-4099-9536-332147a6f398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71e8f9b9-7973-4381-8851-1b919f953487", "tag": "339d808c-dd60-4ec3-9279-d5c8b8c51695"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:55:59.891002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-67c0105e-815d-463c-aea0-4aa0ce7f063e req-bc3c5642-5921-4099-9536-332147a6f398 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:55:59.892242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-67c0105e-815d-463c-aea0-4aa0ce7f063e req-bc3c5642-5921-4099-9536-332147a6f398 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:55:59.893925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-67c0105e-815d-463c-aea0-4aa0ce7f063e req-bc3c5642-5921-4099-9536-332147a6f398 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:55:59.907828 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-67c0105e-815d-463c-aea0-4aa0ce7f063e req-bc3c5642-5921-4099-9536-332147a6f398 service nova] Creating event network-changed:339d808c-dd60-4ec3-9279-d5c8b8c51695 for instance 71e8f9b9-7973-4381-8851-1b919f953487 on n-h1-858384-19 Nov 02 13:55:59.915220 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-67c0105e-815d-463c-aea0-4aa0ce7f063e req-bc3c5642-5921-4099-9536-332147a6f398 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049957 Nov 02 13:55:59.916341 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3200/6777] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:05.792762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e418a94-c9c2-46ad-aabc-bdc2f02b34f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:05.795622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1e418a94-c9c2-46ad-aabc-bdc2f02b34f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:05.803491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e418a94-c9c2-46ad-aabc-bdc2f02b34f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:05.804189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e418a94-c9c2-46ad-aabc-bdc2f02b34f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:05.804826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e418a94-c9c2-46ad-aabc-bdc2f02b34f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:05.805702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e418a94-c9c2-46ad-aabc-bdc2f02b34f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:05.806321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e418a94-c9c2-46ad-aabc-bdc2f02b34f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:05.806916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e418a94-c9c2-46ad-aabc-bdc2f02b34f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:05.829631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:05.873938 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1e418a94-c9c2-46ad-aabc-bdc2f02b34f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action" status: 200 len: 62953 microversion: 2.1 time: 0.085635 Nov 02 13:56:05.874639 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3578/6778] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:56:05 2022] POST /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59/action => generated 62953 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:56:28.928554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=7 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:28.929689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=40 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:28.935908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-89d648f0-14a5-4668-8b54-634aafc6a118 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:28.939983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-89d648f0-14a5-4668-8b54-634aafc6a118 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:28.959990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89d648f0-14a5-4668-8b54-634aafc6a118 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:28.960489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89d648f0-14a5-4668-8b54-634aafc6a118 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:28.960936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89d648f0-14a5-4668-8b54-634aafc6a118 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:28.970110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89d648f0-14a5-4668-8b54-634aafc6a118 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:28.970455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89d648f0-14a5-4668-8b54-634aafc6a118 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:28.970912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-89d648f0-14a5-4668-8b54-634aafc6a118 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:29.254292 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-89d648f0-14a5-4668-8b54-634aafc6a118 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1839 microversion: 2.1 time: 0.328358 Nov 02 13:56:29.255944 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3201/6779] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:28 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1839 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:32.239619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:32.240269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:32.269233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:32.269977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:32.280983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.281521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.281981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.282714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.283203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.283643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.399672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:56:32.596975 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93b0d0bf-bcb5-4b9d-82bb-cd5e6e5cc97a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "DELETE /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 204 len: 0 microversion: 2.1 time: 0.363300 Nov 02 13:56:32.602327 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3579/6780] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:56:32 2022] DELETE /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:56:32.616045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:32.617200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:32.644129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.653073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1564599e-bb83-4b70-8257-08990b3eb6fc req-7f546dc6-9cc8-42fa-8000-aa4354f3bbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:32.658796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.659466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.660230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.660710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.661148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.672027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1564599e-bb83-4b70-8257-08990b3eb6fc req-7f546dc6-9cc8-42fa-8000-aa4354f3bbf6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:32.672518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1564599e-bb83-4b70-8257-08990b3eb6fc req-7f546dc6-9cc8-42fa-8000-aa4354f3bbf6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:32.676802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1564599e-bb83-4b70-8257-08990b3eb6fc req-7f546dc6-9cc8-42fa-8000-aa4354f3bbf6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:32.701402 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1564599e-bb83-4b70-8257-08990b3eb6fc req-7f546dc6-9cc8-42fa-8000-aa4354f3bbf6 service nova] Creating event network-changed:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h2-858384-19 Nov 02 13:56:32.719396 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1564599e-bb83-4b70-8257-08990b3eb6fc req-7f546dc6-9cc8-42fa-8000-aa4354f3bbf6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.412354 Nov 02 13:56:32.720217 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3202/6781] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:33.005499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:33.019698 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c095746-972b-4faa-a3c2-d4427ba58fdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1692 microversion: 2.1 time: 0.415703 Nov 02 13:56:33.020304 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3580/6782] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:32 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1692 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:34.049239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:34.050818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:34.065294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:34.065794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:34.066236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:34.070309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:34.071055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:34.071696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:34.512690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:34.526315 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d82e215b-ad48-4c9b-88f4-92b0d9e9d34e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1692 microversion: 2.1 time: 0.482353 Nov 02 13:56:34.539787 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3203/6783] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:34 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1692 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:34.673945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-26a7a755-3571-47e8-b711-37dbca681060 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Action: 'create', calling method: .version_select at 0x7fe78626c4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-111645433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9KUqSVebfLLdVXkS/sijb8vRuG9BzOigyvmTtHRoA5b2ReuUp+9C8zJte4619XRdwJmfGpYg3E2K9R75p4r6dku18JTeQm2Z4bwsaMJ6nM/lJaTLe588rnrDJGkImSuQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:34.705196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-26a7a755-3571-47e8-b711-37dbca681060 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:34.713227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-26a7a755-3571-47e8-b711-37dbca681060 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for user 38735cc248a746789a1f357eab74620b and project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:34.747194 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-26a7a755-3571-47e8-b711-37dbca681060 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.078479 Nov 02 13:56:34.748440 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3581/6784] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:56:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:35.512281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-153938df-cae7-418a-a655-3db5feddadd1 req-768f4a49-a451-4a7b-a010-197c65c0251f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72135482-2437-484d-b767-fb9994a78e59", "name": "network-vif-deleted", "tag": "6f8dfbe8-f540-47f3-9221-230dc60f9d80"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:35.546952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-153938df-cae7-418a-a655-3db5feddadd1 req-768f4a49-a451-4a7b-a010-197c65c0251f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.547745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-153938df-cae7-418a-a655-3db5feddadd1 req-768f4a49-a451-4a7b-a010-197c65c0251f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.549744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-153938df-cae7-418a-a655-3db5feddadd1 req-768f4a49-a451-4a7b-a010-197c65c0251f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:35.556261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:35.557280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:35.579464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.581644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.582281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:35.589970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:35.591162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:35.594568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:35.661602 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-153938df-cae7-418a-a655-3db5feddadd1 req-768f4a49-a451-4a7b-a010-197c65c0251f service nova] Creating event network-vif-deleted:6f8dfbe8-f540-47f3-9221-230dc60f9d80 for instance 72135482-2437-484d-b767-fb9994a78e59 on n-h2-858384-19 Nov 02 13:56:35.690908 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-153938df-cae7-418a-a655-3db5feddadd1 req-768f4a49-a451-4a7b-a010-197c65c0251f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185315 Nov 02 13:56:35.694752 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3204/6785] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:35.763873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:35.776422 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c407fb2f-9ff9-47e3-a784-41a2f79e4bdb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 200 len: 1356 microversion: 2.1 time: 0.224785 Nov 02 13:56:35.804164 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3582/6786] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:35 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 1356 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:36.816424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:36.817090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 72135482-2437-484d-b767-fb9994a78e59] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:36.845230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:36.846056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:36.846694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:36.848403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:36.849047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:36.849653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:36.909447 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] HTTP exception thrown: Instance 72135482-2437-484d-b767-fb9994a78e59 could not be found. Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Request method failure captured: Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 HTTP/1.1 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnVXBJjYVYKia0vxbjWHpLhZPUXqy9qzXWuRFgQYAN7DfSZl64uS6JBaetuwYeaWGbSLwXk357QnJPGHHhI5ySkNmd7QeR6UkGdWVUkROaqFFPeO96O11eREIt2L19I24aIfpQUjmqwFvMmflCc2eMLpoTDom0x1gkoXw5KYIpfQ2wc Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: bc97329dcfb8453795347d9e818d9d92 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: bc97329dcfb8453795347d9e818d9d92 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestNetworkAdvancedServerOps-423495247-project Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 41c7ca068dba4093880183ae9b2f0935 Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestNetworkAdvancedServerOps-423495247-project Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 72135482-2437-484d-b767-fb9994a78e59 could not be found. Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '72135482-2437-484d-b767-fb9994a78e59'} Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72135482-2437-484d-b767-fb9994a78e59 could not be found. Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72135482-2437-484d-b767-fb9994a78e59 could not be found. Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:56:36.913462 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:56:36.917647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:56:36.917647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:56:36.917647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:56:36.917647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:56:36.917647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:56:36.917647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:56:36.917647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72135482-2437-484d-b767-fb9994a78e59 could not be found. Nov 02 13:56:36.917647 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:56:36.918923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Returning 404 to user: Instance 72135482-2437-484d-b767-fb9994a78e59 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:56:36.922951 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-91c528e2-8571-44a7-8016-605dc53ffaf7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59" status: 404 len: 111 microversion: 2.1 time: 0.112598 Nov 02 13:56:36.923866 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3205/6787] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:36 2022] GET /compute/v2.1/servers/72135482-2437-484d-b767-fb9994a78e59 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:56:36.963225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1360044941", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "7f6169eb-1340-4fea-9876-9589232a3d0c"}], "key_name": "tempest-TestNetworkBasicOps-111645433", "security_groups": [{"name": "tempest-secgroup-smoke-1817056928"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:37.242136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] validate_networks() for [('7f6169eb-1340-4fea-9876-9589232a3d0c', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:56:38.468994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:56:38.469605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:56:38.469898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:56:38.470315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:56:38.470736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:56:38.501299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:38.502044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:38.506197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:38.506939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:38.507450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:38.507880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:38.576804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:38.583252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for user 38735cc248a746789a1f357eab74620b and project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:38.620617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:56:38.626154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:56:38.688582 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89225960-a616-432e-b7d6-3ccd867301d7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.729558 Nov 02 13:56:38.695222 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3583/6788] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:56:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:56:38.701855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dfc931ae-181f-49b9-9f87-efe7f70c4c06 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:38.703850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dfc931ae-181f-49b9-9f87-efe7f70c4c06 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:38.810898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dfc931ae-181f-49b9-9f87-efe7f70c4c06 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:38.822774 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dfc931ae-181f-49b9-9f87-efe7f70c4c06 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1252 microversion: 2.1 time: 0.125538 Nov 02 13:56:38.825055 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3206/6789] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:38 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1252 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:39.850107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:39.850742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:39.871533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:39.872045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:39.873049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:39.875068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:39.875755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:39.876368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:40.012124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:40.021834 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7cb951ef-5e9b-4988-8055-949900689caa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1256 microversion: 2.1 time: 0.176489 Nov 02 13:56:40.029002 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3584/6790] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:39 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1256 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:41.056025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:41.056964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:41.073624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:41.074373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:41.074946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:41.076128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:41.076704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:41.078647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:41.213843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:41.238461 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d6ffa1d1-172a-4b9e-9895-902d68244b56 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1310 microversion: 2.1 time: 0.172758 Nov 02 13:56:41.250583 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3207/6791] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:41 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1310 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:42.264133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:42.266280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:42.284469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:42.285189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:42.285717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:42.287259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:42.291848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:42.292565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:42.715550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:42.741959 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f48814d9-f599-43c5-b5e3-28348530b446 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.482610 Nov 02 13:56:42.759083 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3585/6792] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:42 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:43.042679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-672defa4-192a-4e3b-b6b2-650d6481f958 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '.version_select at 0x7fe786d20430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:43.081857 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-672defa4-192a-4e3b-b6b2-650d6481f958 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2015604873" status: 202 len: 0 microversion: 2.1 time: 0.043083 Nov 02 13:56:43.082815 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3208/6793] 10.222.0.113 () {58 vars in 1289 bytes} [Wed Nov 2 13:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2015604873 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:56:43.124511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f69b0d93-7416-4cbb-9510-fa70887ce8e2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'create', calling method: .version_select at 0x7fe785f08280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-26574084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4XxYLhDrlSFKsm/shneVXeelA81xnt6MEqa63sA9+VFv+b3Q+wFy9jbkNDIovFRfNBnyNHA6P7LHCMrdK8J7eoVOsUN7CtOsYzEVW/gR00NIa3MLYW5aGlxXA2XPLI4Q=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:43.145899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-f69b0d93-7416-4cbb-9510-fa70887ce8e2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for project bc97329dcfb8453795347d9e818d9d92. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:43.152081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-f69b0d93-7416-4cbb-9510-fa70887ce8e2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for user 41c7ca068dba4093880183ae9b2f0935 and project bc97329dcfb8453795347d9e818d9d92. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:43.181587 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f69b0d93-7416-4cbb-9510-fa70887ce8e2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.061306 Nov 02 13:56:43.189465 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3586/6794] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:56:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:43.796489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:43.797182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:43.808334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b8eef833-b8ca-4c24-8ac0-80779fb24acb req-8802aab5-7ca7-4c1d-a46f-d1bd8f13fdef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a5e774-72de-448e-b2b7-153f201ff5c2", "tag": "41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:43.848097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:43.849909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:43.851750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:43.858064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:43.862033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:43.862744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:43.864576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b8eef833-b8ca-4c24-8ac0-80779fb24acb req-8802aab5-7ca7-4c1d-a46f-d1bd8f13fdef service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:43.865463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b8eef833-b8ca-4c24-8ac0-80779fb24acb req-8802aab5-7ca7-4c1d-a46f-d1bd8f13fdef service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:43.866077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b8eef833-b8ca-4c24-8ac0-80779fb24acb req-8802aab5-7ca7-4c1d-a46f-d1bd8f13fdef service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:43.894743 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b8eef833-b8ca-4c24-8ac0-80779fb24acb req-8802aab5-7ca7-4c1d-a46f-d1bd8f13fdef service nova] Creating event network-changed:41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae for instance a1a5e774-72de-448e-b2b7-153f201ff5c2 on n-h2-858384-19 Nov 02 13:56:43.926391 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b8eef833-b8ca-4c24-8ac0-80779fb24acb req-8802aab5-7ca7-4c1d-a46f-d1bd8f13fdef service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115631 Nov 02 13:56:43.927463 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3587/6795] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:44.282697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:44.295279 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d75a4e49-58cc-439b-b2dc-d3fd8a76b081 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.512275 Nov 02 13:56:44.300810 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3209/6796] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:43 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:45.323707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:45.324297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:45.334412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:45.334911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:45.335457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:45.336180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:45.336642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:45.337159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:45.610255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:45.620464 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e843a652-83af-4a71-9b50-bd4ef1ee10cf tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.301495 Nov 02 13:56:45.621178 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3588/6797] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:45 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:46.646052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:46.647646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:46.656421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:46.657469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:46.658751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:46.659623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:46.659985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:46.660965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:46.922950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:46.935832 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f705aa2b-1309-4879-88ad-187b13661b38 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.293395 Nov 02 13:56:46.937442 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3210/6798] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:46 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:47.961034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:47.961586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:47.982709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:47.984829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:47.985913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:47.988218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:47.989652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:47.991059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:48.542251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:48.833535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:48.853059 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f08a14e1-fd7b-475c-a145-7ae85cf88415 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.892998 Nov 02 13:56:48.855581 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3589/6799] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:47 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:49.886497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:49.889712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:49.899613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:49.906906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:49.911754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:49.912448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:49.914520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:49.917218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:49.917741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:50.304773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:50.313830 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-188ff3cc-a86d-4bd3-a7ef-b9de70952271 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.433397 Nov 02 13:56:50.329164 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3211/6800] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:49 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:51.341969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:51.344617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:51.367924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:51.368390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:51.368848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:51.372650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:51.374943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:51.376912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:51.934693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:51.946043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1ea18185-7970-41c0-8888-41559e0466e0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.608394 Nov 02 13:56:51.947835 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3590/6801] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:51 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:52.975284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:52.976688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:52.991581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:52.995842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:52.996518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:52.997611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:52.999569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:53.006010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:53.215402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2080375188", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "c194c850-58d9-46bd-8fdd-7ff6f44c6815"}], "key_name": "tempest-TestNetworkAdvancedServerOps-26574084", "security_groups": [{"name": "tempest-secgroup-smoke-2060227483"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:53.245384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=14 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:53.297402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:53.309161 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8aae2ec5-d327-47a0-a825-8c690daf6511 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.335877 Nov 02 13:56:53.327444 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3212/6802] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:52 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:53.391659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] validate_networks() for [('c194c850-58d9-46bd-8fdd-7ff6f44c6815', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:56:53.917506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:56:53.918601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:56:53.919334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:56:53.919918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:56:53.920664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:56:53.936289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:53.937762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:53.938857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:53.939924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:53.940611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:53.942225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:53.970480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for project bc97329dcfb8453795347d9e818d9d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:56:53.986444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for user 41c7ca068dba4093880183ae9b2f0935 and project bc97329dcfb8453795347d9e818d9d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:56:54.032594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:56:54.035209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:56:54.116296 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ef58a1a-6c15-414b-bc82-7bc0750dc68c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.904736 Nov 02 13:56:54.119621 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3591/6803] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:56:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:56:54.133752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d2db002-0da1-430c-b44c-1205226e52b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:54.135340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1d2db002-0da1-430c-b44c-1205226e52b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:54.266549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1d2db002-0da1-430c-b44c-1205226e52b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:54.276235 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d2db002-0da1-430c-b44c-1205226e52b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1269 microversion: 2.1 time: 0.147663 Nov 02 13:56:54.277287 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3213/6804] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:54 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1269 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:54.336093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:54.336910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:54.361190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:54.361810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:54.368475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:54.369499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:54.370109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:54.370682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:54.622923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:54.632854 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c01fc80e-1889-4a7b-9183-3798c8b7d70b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.302606 Nov 02 13:56:54.633966 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3592/6805] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:54 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:54.846044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-db5f7a0e-f838-47e0-bcd6-0d6768c72f04 req-64392fa6-fae3-4232-bfff-1a4f26bd48a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a5e774-72de-448e-b2b7-153f201ff5c2", "name": "network-vif-plugged", "status": "completed", "tag": "41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:54.869028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-db5f7a0e-f838-47e0-bcd6-0d6768c72f04 req-64392fa6-fae3-4232-bfff-1a4f26bd48a4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:54.869525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-db5f7a0e-f838-47e0-bcd6-0d6768c72f04 req-64392fa6-fae3-4232-bfff-1a4f26bd48a4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:54.869972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-db5f7a0e-f838-47e0-bcd6-0d6768c72f04 req-64392fa6-fae3-4232-bfff-1a4f26bd48a4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:54.887288 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-db5f7a0e-f838-47e0-bcd6-0d6768c72f04 req-64392fa6-fae3-4232-bfff-1a4f26bd48a4 service nova] Creating event network-vif-plugged:41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae for instance a1a5e774-72de-448e-b2b7-153f201ff5c2 on n-h2-858384-19 Nov 02 13:56:54.905401 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-db5f7a0e-f838-47e0-bcd6-0d6768c72f04 req-64392fa6-fae3-4232-bfff-1a4f26bd48a4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161840 Nov 02 13:56:54.906610 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3214/6806] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:55.304163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:55.305315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:55.313030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:55.314044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:55.314778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:55.315977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:55.316707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:55.317383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:55.395871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:55.408612 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-682a1924-e385-4f23-b53b-79b98375c6b0 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1321 microversion: 2.1 time: 0.109585 Nov 02 13:56:55.409509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3593/6807] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:55 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1321 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:55.665902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:55.671649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:55.684594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:55.686014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:55.686901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:55.690381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:55.691398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:55.692211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:56.010156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:56.022479 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-91d9de28-2d3d-4c73-816d-cad35a9132a0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1378 microversion: 2.1 time: 0.365761 Nov 02 13:56:56.023293 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3215/6808] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:55 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1378 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:56.439698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:56.440537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:56.460680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:56.461460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:56.462123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:56.463291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:56.463990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:56.464641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:56.634082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:56.647603 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d9e0182-425b-4263-b57c-673b2d6e86d8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1327 microversion: 2.1 time: 0.213998 Nov 02 13:56:56.648576 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3594/6809] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:56 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1327 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:57.050931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:57.052680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:57.068630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.069463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.070145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.071211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.071889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.072531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.403734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:57.417467 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b9064b2-6471-4f1a-a4cf-8eb18cff0ac4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1550 microversion: 2.1 time: 0.371999 Nov 02 13:56:57.418086 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3216/6810] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:57 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1550 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:57.443539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:57.449610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:57.458152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.458575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.459028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.466786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.467445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.468603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.677291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:57.678333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:57.694821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.695257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.695708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.696630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:57.699753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:57.700529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:57.737007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:57.752518 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f43891a3-9e6f-43dd-b8e3-386e7e83b438 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1550 microversion: 2.1 time: 0.314297 Nov 02 13:56:57.762602 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3595/6811] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:57 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1550 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:58.165637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:58.182363 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3fcf3b7f-031e-412d-af1d-eadfa62d7b42 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1395 microversion: 2.1 time: 0.508902 Nov 02 13:56:58.201324 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3217/6812] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:57 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1395 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:56:59.090505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0905aa5a-5eb0-4383-b42a-8fb21ccac442 req-93a0467b-65ed-4f94-b35c-aa1867bef521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d042a9-9116-4d33-911f-b706a0bbe78e", "tag": "91c736ea-37fa-4d02-8ae9-ae6a2878ad78"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:56:59.116251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0905aa5a-5eb0-4383-b42a-8fb21ccac442 req-93a0467b-65ed-4f94-b35c-aa1867bef521 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:59.126154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0905aa5a-5eb0-4383-b42a-8fb21ccac442 req-93a0467b-65ed-4f94-b35c-aa1867bef521 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:59.126654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0905aa5a-5eb0-4383-b42a-8fb21ccac442 req-93a0467b-65ed-4f94-b35c-aa1867bef521 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:59.154541 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0905aa5a-5eb0-4383-b42a-8fb21ccac442 req-93a0467b-65ed-4f94-b35c-aa1867bef521 service nova] Creating event network-changed:91c736ea-37fa-4d02-8ae9-ae6a2878ad78 for instance 26d042a9-9116-4d33-911f-b706a0bbe78e on n-h1-858384-19 Nov 02 13:56:59.167467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0905aa5a-5eb0-4383-b42a-8fb21ccac442 req-93a0467b-65ed-4f94-b35c-aa1867bef521 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081172 Nov 02 13:56:59.179491 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3596/6813] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:56:59.216698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:56:59.217885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:56:59.220808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:59.241665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:59.243095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:59.243095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:59.248242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:56:59.248837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:56:59.249335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:56:59.257548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=69 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:56:59.586727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:56:59.606089 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3cd2684c-8665-4c7c-8ad7-900f39e41110 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1395 microversion: 2.1 time: 0.395074 Nov 02 13:56:59.623618 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3218/6814] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:56:59 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1395 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:00.634392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:00.636033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:00.644005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:00.644509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:00.644965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:00.645992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:00.646645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:00.647686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:00.870525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:00.888186 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0258a456-96e1-4863-ac7d-89513b1d4fa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1395 microversion: 2.1 time: 0.258783 Nov 02 13:57:00.906304 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3597/6815] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:00 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1395 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:00.930446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3c749f20-094a-4142-8b5d-0a45008051a3 req-4efebe17-eec4-4478-9735-ca0a0d082f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a5e774-72de-448e-b2b7-153f201ff5c2", "tag": "41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:00.942284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3c749f20-094a-4142-8b5d-0a45008051a3 req-4efebe17-eec4-4478-9735-ca0a0d082f92 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:00.943286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3c749f20-094a-4142-8b5d-0a45008051a3 req-4efebe17-eec4-4478-9735-ca0a0d082f92 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:00.944106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3c749f20-094a-4142-8b5d-0a45008051a3 req-4efebe17-eec4-4478-9735-ca0a0d082f92 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:00.959073 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3c749f20-094a-4142-8b5d-0a45008051a3 req-4efebe17-eec4-4478-9735-ca0a0d082f92 service nova] Creating event network-changed:41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae for instance a1a5e774-72de-448e-b2b7-153f201ff5c2 on n-h2-858384-19 Nov 02 13:57:00.968514 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3c749f20-094a-4142-8b5d-0a45008051a3 req-4efebe17-eec4-4478-9735-ca0a0d082f92 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041714 Nov 02 13:57:00.973562 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3219/6816] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:01.913235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:01.914833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:01.924334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:01.925430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:01.925915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:01.926669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:01.927407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:01.927850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:01.959173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:02.331465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:02.347842 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fe0a270d-eb34-4818-996b-17847545c0fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1395 microversion: 2.1 time: 0.435955 Nov 02 13:57:02.350436 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3598/6817] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:01 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1395 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:03.379336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:03.380271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:03.393595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:03.395807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:03.396937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:03.398262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:03.399453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:03.400519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:03.588311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:03.597471 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-978eb114-8a33-4d6b-ae6d-db8a9db67aa3 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1395 microversion: 2.1 time: 0.225176 Nov 02 13:57:03.598069 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3220/6818] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:03 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1395 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:04.621969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:04.622835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:04.626593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:04.627416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:04.628299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:04.634695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:04.635493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:04.636142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:04.637099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:04.637716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:04.638312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:04.810134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:04.848228 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1d5c89d0-c688-4090-9a2f-356518a8961f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1395 microversion: 2.1 time: 0.230083 Nov 02 13:57:04.851199 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3599/6819] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:04 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1395 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:05.289806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-54fcaedb-7d9b-4c8e-8b5b-33c44f8d2cf1 req-e78b0fca-cace-4cb3-ad1d-694077d2d654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d042a9-9116-4d33-911f-b706a0bbe78e", "name": "network-vif-plugged", "status": "completed", "tag": "91c736ea-37fa-4d02-8ae9-ae6a2878ad78"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:05.295334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:05.318776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-54fcaedb-7d9b-4c8e-8b5b-33c44f8d2cf1 req-e78b0fca-cace-4cb3-ad1d-694077d2d654 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:05.319819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-54fcaedb-7d9b-4c8e-8b5b-33c44f8d2cf1 req-e78b0fca-cace-4cb3-ad1d-694077d2d654 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:05.320019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-54fcaedb-7d9b-4c8e-8b5b-33c44f8d2cf1 req-e78b0fca-cace-4cb3-ad1d-694077d2d654 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:05.343098 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-54fcaedb-7d9b-4c8e-8b5b-33c44f8d2cf1 req-e78b0fca-cace-4cb3-ad1d-694077d2d654 service nova] Creating event network-vif-plugged:91c736ea-37fa-4d02-8ae9-ae6a2878ad78 for instance 26d042a9-9116-4d33-911f-b706a0bbe78e on n-h1-858384-19 Nov 02 13:57:05.350856 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-54fcaedb-7d9b-4c8e-8b5b-33c44f8d2cf1 req-e78b0fca-cace-4cb3-ad1d-694077d2d654 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064779 Nov 02 13:57:05.352194 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3221/6820] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:05.877871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:05.878659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:05.886813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:05.887526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:05.888108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:05.889646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:05.890355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:05.890805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:06.057786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:06.066151 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6b3ec383-59ea-491e-b4fc-1c820077d6d4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1395 microversion: 2.1 time: 0.192410 Nov 02 13:57:06.066793 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3600/6821] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:05 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1395 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:57:07.113904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:07.114599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:07.128995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:07.130128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:07.130642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:07.131491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:07.132042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:07.132582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:07.297449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:07.310893 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d28b2518-7f5c-4707-8a9a-ba875055c73f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1567 microversion: 2.1 time: 0.223580 Nov 02 13:57:07.315519 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3222/6822] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:07 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:07.340942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:07.342808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:07.351417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:07.352572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:07.353090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:07.360481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:07.361189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:07.361664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:07.521760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:07.531350 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c7a2c40b-8234-400a-a5e8-b24b9b218f22 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1567 microversion: 2.1 time: 0.199761 Nov 02 13:57:07.532528 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3601/6823] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:07 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:10.150712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:10.152731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:10.161311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:10.161990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:10.162433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:10.163572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:10.164228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:10.164855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:10.167869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3220574c-a599-4138-bd3d-25acdd6e4a54 req-7a07b947-c893-45e5-8906-8c521008d0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d042a9-9116-4d33-911f-b706a0bbe78e", "tag": "91c736ea-37fa-4d02-8ae9-ae6a2878ad78"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:10.191309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3220574c-a599-4138-bd3d-25acdd6e4a54 req-7a07b947-c893-45e5-8906-8c521008d0e3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:10.192193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3220574c-a599-4138-bd3d-25acdd6e4a54 req-7a07b947-c893-45e5-8906-8c521008d0e3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:10.192805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3220574c-a599-4138-bd3d-25acdd6e4a54 req-7a07b947-c893-45e5-8906-8c521008d0e3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:10.229523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3220574c-a599-4138-bd3d-25acdd6e4a54 req-7a07b947-c893-45e5-8906-8c521008d0e3 service nova] Creating event network-changed:91c736ea-37fa-4d02-8ae9-ae6a2878ad78 for instance 26d042a9-9116-4d33-911f-b706a0bbe78e on n-h1-858384-19 Nov 02 13:57:10.240445 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3220574c-a599-4138-bd3d-25acdd6e4a54 req-7a07b947-c893-45e5-8906-8c521008d0e3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087251 Nov 02 13:57:10.242090 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3602/6824] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:57:10.332512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:10.344326 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7204deb-de81-49e4-b00b-3f421aa56e28 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1567 microversion: 2.1 time: 0.197406 Nov 02 13:57:10.359143 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3223/6825] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:10 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:57:14.865911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17fd59b3-28e6-4d9e-be96-3f1f04526476 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:14.866551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17fd59b3-28e6-4d9e-be96-3f1f04526476 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:14.874190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17fd59b3-28e6-4d9e-be96-3f1f04526476 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:14.874726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17fd59b3-28e6-4d9e-be96-3f1f04526476 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:14.875280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17fd59b3-28e6-4d9e-be96-3f1f04526476 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:14.876168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17fd59b3-28e6-4d9e-be96-3f1f04526476 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:14.876677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17fd59b3-28e6-4d9e-be96-3f1f04526476 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:14.877115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17fd59b3-28e6-4d9e-be96-3f1f04526476 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:14.903496 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17fd59b3-28e6-4d9e-be96-3f1f04526476 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/ips" status: 200 len: 151 microversion: 2.20 time: 0.043393 Nov 02 13:57:14.911872 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3603/6826] 10.222.0.113 () {60 vars in 1294 bytes} [Wed Nov 2 13:57:14 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:57:16.790233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:16.792766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:16.802476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:16.803084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:16.803618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:16.804410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:16.805078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:16.805574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:16.835044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lazy-loading 'flavor' on Instance uuid 71e8f9b9-7973-4381-8851-1b919f953487 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:57:17.086291 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03f8c939-87ba-4c62-9804-9f8c307ffbe5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/action" status: 202 len: 0 microversion: 2.20 time: 0.300501 Nov 02 13:57:17.087037 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3224/6827] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:57:16 2022] POST /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 13:57:17.096510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:17.097882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:17.105273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:17.106411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:17.107066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:17.109206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:17.110610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:17.111492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:17.299564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:17.310465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:17.312185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:17.313403 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0a8ad38c-7d78-4dbf-8040-d3481d2af24c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.222240 Nov 02 13:57:17.314341 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3604/6828] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:17 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:18.345946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:18.348298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:18.360139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:18.361270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:18.362743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:18.363712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:18.364352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:18.365042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:18.557734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:18.567327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:18.569245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:18.570790 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22c955a0-5bf0-4c7a-bfad-aa0629fa4b74 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.233843 Nov 02 13:57:18.576116 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3225/6829] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:18 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:19.600898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:19.602312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:19.612269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:19.612821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:19.613263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:19.614296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:19.614757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:19.615523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:19.924719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:19.936212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:19.938459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:19.940302 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-38439099-6fe2-45c0-aab5-111cc7d50921 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.346712 Nov 02 13:57:19.941217 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3605/6830] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:19 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:20.973692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:20.974220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:20.982378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:20.983945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:20.984494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:20.985572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:20.986140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:20.987077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:21.153279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:21.162934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:21.164460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:21.165661 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4cbcbe95-18a7-411b-98b9-919bc2e6108c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.196799 Nov 02 13:57:21.166233 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3226/6831] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:20 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:22.191751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:22.192381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:22.199897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:22.200463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:22.201129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:22.202160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:22.202821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:22.204012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:22.366954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:22.378937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:22.381100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:22.383485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8694faec-4a8f-4893-b246-02bc5a97b68f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.195749 Nov 02 13:57:22.384484 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3606/6832] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:22 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:23.411840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:23.412462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:23.421155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:23.421688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:23.422180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:23.423009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:23.423533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:23.424008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:23.627426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:23.637492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:23.639736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:23.641180 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a3137417-44f0-437f-9229-eb295a4a5d58 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.233891 Nov 02 13:57:23.655765 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3227/6833] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:23 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:24.668044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:24.668662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:24.676860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:24.677358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:24.678333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:24.678970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:24.679602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:24.680046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:24.834747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:24.843491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:24.844981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:24.846165 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d877f397-b6dc-4038-b7a4-2123140444aa tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.182229 Nov 02 13:57:24.846727 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3607/6834] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:24 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:25.880979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:25.881691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:25.899349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.899878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.900396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:25.901187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:25.901827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:25.902422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:26.050045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:26.059243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:26.061140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:26.062358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f3ac611-3699-4157-83af-738eee82480c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.193748 Nov 02 13:57:26.063497 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3228/6835] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:25 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:27.088864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:27.089480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:27.101484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:27.101981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:27.102433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:27.118794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:27.119439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:27.119903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:27.314910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:27.324362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:27.326081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:27.328076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74405e20-4597-4fdf-8b82-d49e11c00d29 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.243318 Nov 02 13:57:27.328819 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3608/6836] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:27 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:28.354003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:28.354825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:28.363607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:28.364093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:28.364526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:28.365447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:28.365966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:28.366527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:28.527958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:28.538169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:28.539794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:28.541112 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e8fa8250-baf2-43ba-837a-6a46c6ca89c8 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.191142 Nov 02 13:57:28.545403 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3229/6837] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:28 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:57:29.566978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:29.568290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:29.581066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:29.582019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:29.582920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:29.583874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:29.584506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:29.585290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:29.788797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:29.798383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:29.800182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:29.802198 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0fd3ba0-2e06-4ea2-9a09-62741ced228a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1747 microversion: 2.20 time: 0.239321 Nov 02 13:57:29.802972 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3609/6838] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:29 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1747 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:30.832065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:30.833736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:30.839397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=24 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:30.841357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:30.841838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:30.842286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:30.843049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:30.844278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:30.845119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:30.848526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:31.055419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:31.069029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:31.073340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:31.075435 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a0eb277-1eee-44e6-b62f-05712de9f143 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1747 microversion: 2.20 time: 0.249341 Nov 02 13:57:31.076860 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3230/6839] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:30 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1747 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:31.445769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5b663f74-8c1b-49eb-8498-5cec99c6515f req-21e4afca-66ca-4245-90c8-034a44578275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e8f9b9-7973-4381-8851-1b919f953487", "name": "network-vif-plugged", "status": "completed", "tag": "339d808c-dd60-4ec3-9279-d5c8b8c51695"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:31.456965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5b663f74-8c1b-49eb-8498-5cec99c6515f req-21e4afca-66ca-4245-90c8-034a44578275 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:31.457796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5b663f74-8c1b-49eb-8498-5cec99c6515f req-21e4afca-66ca-4245-90c8-034a44578275 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:31.458442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5b663f74-8c1b-49eb-8498-5cec99c6515f req-21e4afca-66ca-4245-90c8-034a44578275 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:31.473725 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5b663f74-8c1b-49eb-8498-5cec99c6515f req-21e4afca-66ca-4245-90c8-034a44578275 service nova] Creating event network-vif-plugged:339d808c-dd60-4ec3-9279-d5c8b8c51695 for instance 71e8f9b9-7973-4381-8851-1b919f953487 on n-h1-858384-19 Nov 02 13:57:31.480401 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5b663f74-8c1b-49eb-8498-5cec99c6515f req-21e4afca-66ca-4245-90c8-034a44578275 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038274 Nov 02 13:57:31.481242 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3610/6840] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:32.104917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:32.105612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:32.117285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:32.118036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:32.118632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:32.119666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:32.120280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:32.120710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:32.297012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:32.306535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:32.308513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:32.310046 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16bf6426-c72e-445a-ae23-53aaf892fdf0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1747 microversion: 2.20 time: 0.209424 Nov 02 13:57:32.311088 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3231/6841] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:32 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1747 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:57:33.278223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1005231629", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "5c34a994-835a-4317-abfc-0d8e1bec709a"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:33.336155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] validate_networks() for [('5c34a994-835a-4317-abfc-0d8e1bec709a', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:57:33.338452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:33.339235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:33.347269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.347762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.348466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.349205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.349661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.350092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.510315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:33.520597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:33.522296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:33.523594 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-932affca-203c-4a5a-bbc8-1e4aaed538d1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1747 microversion: 2.20 time: 0.189815 Nov 02 13:57:33.524253 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3232/6842] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:33 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1747 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:33.581470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75c6b403-431b-4d97-9e46-37c2eec4b8d8 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:33.586313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-75c6b403-431b-4d97-9e46-37c2eec4b8d8 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:33.593141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c6b403-431b-4d97-9e46-37c2eec4b8d8 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.593956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c6b403-431b-4d97-9e46-37c2eec4b8d8 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.594693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c6b403-431b-4d97-9e46-37c2eec4b8d8 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.595434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c6b403-431b-4d97-9e46-37c2eec4b8d8 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.595890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c6b403-431b-4d97-9e46-37c2eec4b8d8 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.596628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75c6b403-431b-4d97-9e46-37c2eec4b8d8 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.659024 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75c6b403-431b-4d97-9e46-37c2eec4b8d8 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "POST /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2/action" status: 200 len: 24564 microversion: 2.1 time: 0.081632 Nov 02 13:57:33.660026 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3233/6843] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:57:33 2022] POST /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2/action => generated 24564 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:57:33.727491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:57:33.727930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:57:33.728576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:57:33.729000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:57:33.729525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:57:33.740741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.741236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.741725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.742468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:33.742934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:33.743639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:33.750663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=65 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:33.764674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Getting quotas for project 57a43d9436ca4b99ac978d174d9ee5ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:57:33.770397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Getting quotas for user f8f38218889a4b478024d9b4a32affe1 and project 57a43d9436ca4b99ac978d174d9ee5ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:57:33.783938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:57:33.786345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:57:33.834087 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7a6fd1ad-57d0-4714-9447-3905458ca741 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.681202 Nov 02 13:57:33.834755 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3611/6844] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:57:33 2022] POST /compute/v2.1/servers => generated 382 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:57:33.848514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c497f69-55c9-4cee-9e5e-0cbe1aecfcfa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:33.849233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c497f69-55c9-4cee-9e5e-0cbe1aecfcfa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:33.915141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c497f69-55c9-4cee-9e5e-0cbe1aecfcfa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:33.923711 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c497f69-55c9-4cee-9e5e-0cbe1aecfcfa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1219 microversion: 2.1 time: 0.078607 Nov 02 13:57:33.924504 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3234/6845] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:33 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:34.563050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:34.563798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:34.573212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:34.573635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:34.574080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:34.574947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:34.575680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:34.576141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:34.718406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:34.726989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:34.728538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:34.729737 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-60af08b3-c58c-4dc2-853c-eb3ea93a434f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1747 microversion: 2.20 time: 0.173327 Nov 02 13:57:34.730319 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3612/6846] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:34 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1747 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:34.949979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:34.953884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:34.961872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:34.962600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:34.963264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:34.964317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:34.965189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:34.965812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:35.054169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:35.064774 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-93d8ba2c-6391-4e10-973c-d42231de9f3b tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1279 microversion: 2.1 time: 0.119296 Nov 02 13:57:35.073965 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3235/6847] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:34 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1279 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:35.755050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:35.755718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:35.758871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:35.790468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:35.790917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:35.791426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:35.792165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:35.792643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:35.793268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:36.090058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:36.090622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:36.103403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:36.106837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:36.107906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:36.108559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:36.110384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:36.111038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:36.111666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:36.114442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:36.120733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:36.121988 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4cb99ee2-5b0a-4fed-a6f5-7675711e0a3f tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1742 microversion: 2.20 time: 0.370930 Nov 02 13:57:36.122571 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3613/6848] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:35 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1742 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:36.296260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:36.305706 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-14a805fa-f132-4bbb-8b2d-54a343f08337 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1319 microversion: 2.1 time: 0.219672 Nov 02 13:57:36.307081 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3236/6849] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:36 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:57:36.790826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-95a4ba35-0001-47a4-8c71-de3854f1a2d0 req-06900b33-4711-4a31-a241-602cfbe61728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb7d6b01-a208-498f-a941-5e6ceb31e469", "tag": "76df95c3-620d-4a76-bcee-2f6bd8014dba"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:36.836334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-95a4ba35-0001-47a4-8c71-de3854f1a2d0 req-06900b33-4711-4a31-a241-602cfbe61728 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:36.837013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-95a4ba35-0001-47a4-8c71-de3854f1a2d0 req-06900b33-4711-4a31-a241-602cfbe61728 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:36.837625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-95a4ba35-0001-47a4-8c71-de3854f1a2d0 req-06900b33-4711-4a31-a241-602cfbe61728 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:36.862191 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-95a4ba35-0001-47a4-8c71-de3854f1a2d0 req-06900b33-4711-4a31-a241-602cfbe61728 service nova] Creating event network-changed:76df95c3-620d-4a76-bcee-2f6bd8014dba for instance bb7d6b01-a208-498f-a941-5e6ceb31e469 on n-h2-858384-19 Nov 02 13:57:36.875196 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-95a4ba35-0001-47a4-8c71-de3854f1a2d0 req-06900b33-4711-4a31-a241-602cfbe61728 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094166 Nov 02 13:57:36.878143 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3614/6850] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:57:37.148830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:37.149377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:37.164227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:37.164992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:37.165637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:37.166551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:37.167201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:37.167805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:37.333798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:37.334859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:37.353307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:37.354068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:37.354726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:37.360564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:37.361389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:37.362380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:37.448879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:37.462480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:37.465118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:37.466794 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-494c449e-f3f1-4e27-bf36-b7648f5b4351 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1742 microversion: 2.20 time: 0.321881 Nov 02 13:57:37.484527 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3237/6851] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:37 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1742 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:37.795465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:37.827847 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a73afac-b7f4-42d1-bc3d-e9b47903101f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1319 microversion: 2.1 time: 0.498910 Nov 02 13:57:37.829053 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3615/6852] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:37 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:38.503940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:38.505155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:38.521656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:38.523666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:38.525262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:38.525262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:38.525685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:38.526825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:38.715982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:38.726279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:38.729672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:38.731089 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf7eac91-04a2-498b-a87f-ff614f5f8647 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1742 microversion: 2.20 time: 0.238534 Nov 02 13:57:38.731846 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3238/6853] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:38 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1742 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:38.853026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:38.854242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:38.866226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:38.867649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:38.868224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:38.869255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:38.869806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:38.870485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:39.037832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:39.046549 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4729fae6-c23b-4015-92dd-dee52b7c41f8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1319 microversion: 2.1 time: 0.197581 Nov 02 13:57:39.047185 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3616/6854] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:38 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:39.789226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:39.790485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:39.799219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:39.799972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:39.800772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:39.801759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:39.802439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:39.803856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:39.976246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:39.997418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:40.000055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:40.001553 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0352e007-375a-465e-9c51-5a8e181501b9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1742 microversion: 2.20 time: 0.218342 Nov 02 13:57:40.002604 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3239/6855] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:39 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:40.072532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:40.074866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:40.095468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:40.095978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:40.096607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:40.097353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:40.097979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:40.098580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:40.354644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:40.364251 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a9a5edf2-d31c-4664-9bec-50911dbcee12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1319 microversion: 2.1 time: 0.297957 Nov 02 13:57:40.369210 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3617/6856] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:40 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:41.037379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:41.038645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:41.045370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.046108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.046745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.047687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.048323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.048932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.215367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:41.225082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:41.226562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:41.227777 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de2d6e93-f50c-44b0-8688-95b5e53295f5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1742 microversion: 2.20 time: 0.198994 Nov 02 13:57:41.228532 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3240/6857] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:41 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1742 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:57:41.396434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:41.397004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:41.405220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.405925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.406370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.407419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:41.408341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:41.409101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:41.572048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:41.580602 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b1339317-4f86-40c6-b10d-b48886f40640 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1319 microversion: 2.1 time: 0.189285 Nov 02 13:57:41.585800 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3618/6858] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:41 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:57:42.262156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:42.264280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:42.272911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:42.273596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:42.274172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.275169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:42.275827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:42.276475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.482770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:42.493210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:42.494875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:42.496192 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c9fe618a-3110-479b-9684-3d92505bfb97 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1742 microversion: 2.20 time: 0.238653 Nov 02 13:57:42.496779 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3241/6859] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:42 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:42.609360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:42.610333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:42.625112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:42.625618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:42.626077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.631710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:42.632147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:42.633380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:42.823814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:42.833713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3cdc5145-93c5-4ce9-9a16-263db85d65b8 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1319 microversion: 2.1 time: 0.229958 Nov 02 13:57:42.834967 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3619/6860] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:42 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:43.522853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:43.524390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:43.534592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.535469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.538756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:43.539984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.540705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.541363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:43.712885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:43.724180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:43.726885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:43.728550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-43b59084-9ad4-4d64-9bbc-c4fda7a5ad2d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1742 microversion: 2.20 time: 0.210157 Nov 02 13:57:43.747754 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3242/6861] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:43 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1742 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:57:43.869026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:43.870414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:43.875500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:43.876940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:43.883836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.884852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.885791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:43.886679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:43.887344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:43.887887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:44.116117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:44.132621 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-02007472-8997-44db-a2cb-b9de68a7e238 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1319 microversion: 2.1 time: 0.267746 Nov 02 13:57:44.133700 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3620/6862] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:43 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:44.197199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-fd6d4e50-4567-4362-87a7-8b040b317fbf req-f9fcd8bc-0a80-4a78-a9d5-50e110959e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7d6b01-a208-498f-a941-5e6ceb31e469", "name": "network-vif-plugged", "status": "completed", "tag": "76df95c3-620d-4a76-bcee-2f6bd8014dba"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:44.220878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:44.230054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fd6d4e50-4567-4362-87a7-8b040b317fbf req-f9fcd8bc-0a80-4a78-a9d5-50e110959e06 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:44.235460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fd6d4e50-4567-4362-87a7-8b040b317fbf req-f9fcd8bc-0a80-4a78-a9d5-50e110959e06 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:44.236796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fd6d4e50-4567-4362-87a7-8b040b317fbf req-f9fcd8bc-0a80-4a78-a9d5-50e110959e06 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:44.260540 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-fd6d4e50-4567-4362-87a7-8b040b317fbf req-f9fcd8bc-0a80-4a78-a9d5-50e110959e06 service nova] Creating event network-vif-plugged:76df95c3-620d-4a76-bcee-2f6bd8014dba for instance bb7d6b01-a208-498f-a941-5e6ceb31e469 on n-h2-858384-19 Nov 02 13:57:44.301217 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-fd6d4e50-4567-4362-87a7-8b040b317fbf req-f9fcd8bc-0a80-4a78-a9d5-50e110959e06 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108595 Nov 02 13:57:44.302915 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3243/6863] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:44.755160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:44.755702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:44.762495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:44.762999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:44.766101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:44.766101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:44.766101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:44.766101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:44.960814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:44.970431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:44.972417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:44.973907 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c64edf71-1085-4c9a-9654-717ea9ce07c9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1742 microversion: 2.20 time: 0.223374 Nov 02 13:57:44.974729 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3621/6864] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:44 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:45.157077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:45.157784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:45.165193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:45.165925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:45.166532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:45.167427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:45.168046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:45.168656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:45.328821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:45.337904 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74944157-e67e-474e-a686-af19d5363bba tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1319 microversion: 2.1 time: 0.184989 Nov 02 13:57:45.339007 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3244/6865] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:45 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:46.001949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:46.003357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:46.016530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.017445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.018056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.019356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.020307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.020914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.181147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:46.191419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:46.193973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:46.195480 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ca2ae39-a951-4b71-9fd4-480aebe86a3d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1742 microversion: 2.20 time: 0.198765 Nov 02 13:57:46.196660 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3622/6866] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:45 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1742 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:46.366762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:46.367407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:46.376367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.377226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.377841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.379526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.380156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.380756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.525082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:46.533675 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-177e18f8-de86-40ff-a8e2-0f283014f167 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1506 microversion: 2.1 time: 0.171388 Nov 02 13:57:46.542511 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3245/6867] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:46 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:46.556834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:46.557452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:46.564257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.564755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.565201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.565911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.566372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.566814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.709834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:46.718931 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e83ee3c-b623-416b-9f56-ad8b9e81a6f3 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1506 microversion: 2.1 time: 0.165966 Nov 02 13:57:46.719664 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3623/6868] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:46 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:46.742087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:46.742629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:46.748851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.749333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.749770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.750464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.750916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.751363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.775204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lazy-loading 'flavor' on Instance uuid bb7d6b01-a208-498f-a941-5e6ceb31e469 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:57:46.846243 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a16a16b-65ee-4177-be2d-2dc876ef9a68 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "POST /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469/action" status: 202 len: 0 microversion: 2.1 time: 0.107817 Nov 02 13:57:46.850103 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3246/6869] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:57:46 2022] POST /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:57:46.855664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:46.856521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:46.864132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.864636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.865078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:46.865842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:46.866331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:46.866750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.006901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:47.017370 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-241afaa7-0794-4cb2-a031-f42551465fda tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1514 microversion: 2.1 time: 0.165845 Nov 02 13:57:47.018063 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3624/6870] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:46 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:47.222739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:47.223431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:47.229702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:47.230191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:47.230634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.231366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:47.232557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:47.232864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:47.235930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:47.479796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:47.489936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:47.491636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:47.492876 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7937ad4e-f359-4877-846e-ba8931799c5a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1724 microversion: 2.20 time: 0.274768 Nov 02 13:57:47.493783 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3247/6871] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:47 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:48.042033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:48.042576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:48.049688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.050191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.050623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.051380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.051837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.052272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.190856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:48.198671 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc395025-3e2a-44d6-b86c-e60c76fbdb6f tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1497 microversion: 2.1 time: 0.160756 Nov 02 13:57:48.199321 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3625/6872] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:48 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:48.222522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fb6523ec-0221-44fb-a9b1-9e48a09b20be tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:48.223062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fb6523ec-0221-44fb-a9b1-9e48a09b20be tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:48.229034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb6523ec-0221-44fb-a9b1-9e48a09b20be tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.229526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb6523ec-0221-44fb-a9b1-9e48a09b20be tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.229973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb6523ec-0221-44fb-a9b1-9e48a09b20be tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.230672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb6523ec-0221-44fb-a9b1-9e48a09b20be tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.231152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb6523ec-0221-44fb-a9b1-9e48a09b20be tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.231596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb6523ec-0221-44fb-a9b1-9e48a09b20be tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.299093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fb6523ec-0221-44fb-a9b1-9e48a09b20be tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "POST /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469/action" status: 202 len: 0 microversion: 2.1 time: 0.080218 Nov 02 13:57:48.299740 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3248/6873] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:57:48 2022] POST /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:57:48.307767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:48.308451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:48.314498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.315133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.315575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.316440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.316874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.317421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.521549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:48.522247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:48.529244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.529989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.530615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.531559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.532019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.532449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.546449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:48.555146 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d4bb7227-6071-4fa4-a8dc-0d0601bcb559 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1503 microversion: 2.1 time: 0.251125 Nov 02 13:57:48.557570 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3626/6874] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:48 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:48.676110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:48.685504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:48.687237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:48.688486 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05a74c34-50a6-4820-855d-763ecb8e45fe tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1724 microversion: 2.20 time: 0.172360 Nov 02 13:57:48.689132 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3249/6875] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:48 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:57:48.906251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1906e1d-d55f-4e90-9d6e-21c26c4ad995 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:48.908901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1906e1d-d55f-4e90-9d6e-21c26c4ad995 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:48.915065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1906e1d-d55f-4e90-9d6e-21c26c4ad995 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.915785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1906e1d-d55f-4e90-9d6e-21c26c4ad995 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.916560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1906e1d-d55f-4e90-9d6e-21c26c4ad995 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:48.917423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1906e1d-d55f-4e90-9d6e-21c26c4ad995 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:48.917966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1906e1d-d55f-4e90-9d6e-21c26c4ad995 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:48.918490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1906e1d-d55f-4e90-9d6e-21c26c4ad995 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.370268 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1906e1d-d55f-4e90-9d6e-21c26c4ad995 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e/action" status: 200 len: 24560 microversion: 2.1 time: 0.468743 Nov 02 13:57:49.371792 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3627/6876] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:57:48 2022] POST /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e/action => generated 24560 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:57:49.428698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-add636f8-91c2-4377-820c-87e459918039 req-29aa6889-4db9-48ba-adf5-a4d3da1f8afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e8f9b9-7973-4381-8851-1b919f953487", "name": "network-vif-unplugged", "status": "completed", "tag": "339d808c-dd60-4ec3-9279-d5c8b8c51695"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:49.442006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-add636f8-91c2-4377-820c-87e459918039 req-29aa6889-4db9-48ba-adf5-a4d3da1f8afe service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.442502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-add636f8-91c2-4377-820c-87e459918039 req-29aa6889-4db9-48ba-adf5-a4d3da1f8afe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.443285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-add636f8-91c2-4377-820c-87e459918039 req-29aa6889-4db9-48ba-adf5-a4d3da1f8afe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.460321 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-add636f8-91c2-4377-820c-87e459918039 req-29aa6889-4db9-48ba-adf5-a4d3da1f8afe service nova] Creating event network-vif-unplugged:339d808c-dd60-4ec3-9279-d5c8b8c51695 for instance 71e8f9b9-7973-4381-8851-1b919f953487 on n-h1-858384-19 Nov 02 13:57:49.465953 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-add636f8-91c2-4377-820c-87e459918039 req-29aa6889-4db9-48ba-adf5-a4d3da1f8afe service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041488 Nov 02 13:57:49.467999 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3250/6877] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:49.588032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:49.588032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:49.703615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.703615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.703615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.703615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.703615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.703615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.715527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:49.716960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:49.723731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.724218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.724663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.725377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.725825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.726262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.783521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:49.794200 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e474ad0e-fa1b-4787-a838-00bc7d7864d4 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1503 microversion: 2.1 time: 0.212911 Nov 02 13:57:49.797395 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3628/6878] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:49 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:49.891968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:49.905059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:49.906212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:49.907429 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-caae8c4f-1b64-4168-ad55-94b45bcb4b26 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1727 microversion: 2.20 time: 0.197296 Nov 02 13:57:49.908001 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3251/6879] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:49 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:49.932645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc17f493-7b14-4710-8fd8-6709574bf1c3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afc29936-a3cc-440d-9ca3-5e42dc707e7f"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:49.935669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dc17f493-7b14-4710-8fd8-6709574bf1c3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:49.942292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17f493-7b14-4710-8fd8-6709574bf1c3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.942781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17f493-7b14-4710-8fd8-6709574bf1c3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.943258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17f493-7b14-4710-8fd8-6709574bf1c3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.944004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17f493-7b14-4710-8fd8-6709574bf1c3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:49.944468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17f493-7b14-4710-8fd8-6709574bf1c3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:49.944905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc17f493-7b14-4710-8fd8-6709574bf1c3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:49.962066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=100 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:50.286315 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc17f493-7b14-4710-8fd8-6709574bf1c3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.356887 Nov 02 13:57:50.287050 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3629/6880] 10.222.0.113 () {62 vars in 1369 bytes} [Wed Nov 2 13:57:49 2022] POST /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/os-volume_attachments => generated 188 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:57:50.429733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bd782068-b308-4e09-b93d-d4d8347eb31a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:50.430231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bd782068-b308-4e09-b93d-d4d8347eb31a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:50.436442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd782068-b308-4e09-b93d-d4d8347eb31a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.436932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd782068-b308-4e09-b93d-d4d8347eb31a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.437373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd782068-b308-4e09-b93d-d4d8347eb31a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.438082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd782068-b308-4e09-b93d-d4d8347eb31a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.438537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd782068-b308-4e09-b93d-d4d8347eb31a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.438966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd782068-b308-4e09-b93d-d4d8347eb31a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.694401 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bd782068-b308-4e09-b93d-d4d8347eb31a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "DELETE /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/os-volume_attachments/afc29936-a3cc-440d-9ca3-5e42dc707e7f" status: 202 len: 0 microversion: 2.20 time: 0.268641 Nov 02 13:57:50.695036 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3252/6881] 10.222.0.113 () {60 vars in 1462 bytes} [Wed Nov 2 13:57:50 2022] DELETE /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/os-volume_attachments/afc29936-a3cc-440d-9ca3-5e42dc707e7f => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:50.761395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:50.762114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:50.772641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.773223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.773751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.774462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.774915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.775494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.807741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120928) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Nov 02 13:57:50.824149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:50.825521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:50.833079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.833563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.833994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.834748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.835157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.835683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.886347 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-67160f0c-8e56-47bd-bd63-41ddb8e18a64 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "POST /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/action" status: 202 len: 0 microversion: 2.20 time: 0.129003 Nov 02 13:57:50.890560 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3630/6882] 10.222.0.113 () {62 vars in 1324 bytes} [Wed Nov 2 13:57:50 2022] POST /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:50.896002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:50.896564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:50.903058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.904832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.906225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:50.907007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:50.907685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:50.908138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:51.005776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:51.017112 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-740af770-be92-4750-bbaf-fb7bdec6f2fa tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1506 microversion: 2.1 time: 0.196999 Nov 02 13:57:51.017704 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3253/6883] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:50 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:57:51.041028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:51.041860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:51.049656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:51.050462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:51.051080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:51.052001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:51.052621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:51.053529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:51.081422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lazy-loading 'flavor' on Instance uuid bb7d6b01-a208-498f-a941-5e6ceb31e469 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:57:51.084409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:51.096426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:51.114054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:51.115550 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-645ddf05-dc73-42c7-8fa2-2b36b9f32af5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1675 microversion: 2.20 time: 0.223874 Nov 02 13:57:51.116331 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3631/6884] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:50 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:51.158356 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66a8d969-210c-4dbc-9b2a-03ae9d1e1e4d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "POST /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469/action" status: 202 len: 0 microversion: 2.1 time: 0.120906 Nov 02 13:57:51.161995 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3254/6885] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:57:51 2022] POST /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:57:51.183581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:51.184385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:51.192588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:51.193096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:51.193554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:51.195259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:51.195900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:51.196528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:51.353246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:51.362325 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0448d54f-6a4b-42c1-8a8e-c0df06190d12 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1514 microversion: 2.1 time: 0.198779 Nov 02 13:57:51.370535 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3632/6886] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:51 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:57:52.144551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:52.146245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:52.156726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:52.157446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:52.157895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.158783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:52.159633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:52.160228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.359690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:52.369149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:52.370717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:52.371990 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94283f65-7908-4cf2-99bf-16293c84a091 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.232969 Nov 02 13:57:52.374083 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3255/6887] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:52 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:52.389778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:52.391032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:52.398320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:52.398819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:52.399449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.400015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:52.400493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:52.400905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.555345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:52.564947 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb42b390-a72d-4867-b0d5-321e56cd5ee9 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1497 microversion: 2.1 time: 0.180033 Nov 02 13:57:52.566813 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3633/6888] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:52 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:52.591187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7dd88361-ae9e-466d-8772-a3439a69a5ee tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:52.592510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7dd88361-ae9e-466d-8772-a3439a69a5ee tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:52.602082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd88361-ae9e-466d-8772-a3439a69a5ee tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:52.602509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd88361-ae9e-466d-8772-a3439a69a5ee tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:52.602958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd88361-ae9e-466d-8772-a3439a69a5ee tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.603715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd88361-ae9e-466d-8772-a3439a69a5ee tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:52.604136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd88361-ae9e-466d-8772-a3439a69a5ee tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:52.604759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7dd88361-ae9e-466d-8772-a3439a69a5ee tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.698204 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7dd88361-ae9e-466d-8772-a3439a69a5ee tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "POST /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469/action" status: 202 len: 0 microversion: 2.1 time: 0.108713 Nov 02 13:57:52.701360 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3256/6889] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:57:52 2022] POST /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:57:52.709046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:52.709703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:52.726943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:52.727564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:52.728146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.728762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:52.729231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:52.729833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:52.986859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:53.002155 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-467cf6de-568e-4611-a8b2-aadc5585b251 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1503 microversion: 2.1 time: 0.296930 Nov 02 13:57:53.003512 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3634/6890] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:52 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:53.411698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:53.412371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:53.424856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:53.425517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:53.426123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:53.426997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:53.427849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:53.428434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:53.651015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:53.664364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:53.666411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:53.667721 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0414245a-94ac-4a1f-b3a9-b9d2d8b74aa3 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.261605 Nov 02 13:57:53.668505 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3257/6891] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:53 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:54.030411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:54.031364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:54.046594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.050494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.051052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.052257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.052948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.053596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.271420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:54.282357 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-44464ccb-d247-4d58-9636-afda9de039e7 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1503 microversion: 2.1 time: 0.257449 Nov 02 13:57:54.305891 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3635/6892] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:54 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:54.696878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:54.698144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:54.705924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.706681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.707314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.708282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:54.709093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:54.709695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:54.715273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:57:54.914187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:54.925913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:54.927817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:54.929149 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94a3c190-9827-4a8a-9e8d-e83a2305d856 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.236415 Nov 02 13:57:54.944179 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3258/6893] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:54 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:57:55.311239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:55.312050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:55.323020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.323551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.324006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.325201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.326161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.326846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.548065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:55.572740 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7869037c-4a21-4afd-b788-2e2aafa9c90d tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1506 microversion: 2.1 time: 0.266501 Nov 02 13:57:55.573345 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3636/6894] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:55 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:57:55.595961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:55.596472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:55.602840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.603365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.603815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.604532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.605004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.605439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.673722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:57:55.792401 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-41dd1c05-8be5-4c21-8811-fd0f2a2f5170 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "DELETE /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 204 len: 0 microversion: 2.1 time: 0.200251 Nov 02 13:57:55.793153 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3259/6895] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:57:55 2022] DELETE /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:57:55.808896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:55.810086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:55.823026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.827295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.828217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.831403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.832140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.835632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.958640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:55.959550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:55.978528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.979023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.979496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:55.980235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:55.984430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:55.984898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:56.032920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:56.045890 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4ce0571-b991-406c-93d1-7c3b6e13b2cf tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1512 microversion: 2.1 time: 0.247828 Nov 02 13:57:56.047287 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3637/6896] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:55 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:56.205882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:56.217248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:56.219371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:56.220823 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a960f23-4bb1-4a53-aac6-39ac7eac0ec1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.266529 Nov 02 13:57:56.222966 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3260/6897] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:55 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:57.072613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:57.073434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:57.083462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:57.084077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:57.084599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:57.085553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:57.086300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:57.086823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:57.250956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:57.251607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:57.261861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:57.267867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:57.268596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:57.269528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:57.270153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:57.270765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:57.317276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:57.328357 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1115308c-adb8-4079-8165-825d34a4a681 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1512 microversion: 2.1 time: 0.259990 Nov 02 13:57:57.329612 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3638/6898] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:57 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:57.471469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:57.483507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:57.485586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:57.486984 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6c6ac333-dbae-4046-b7b0-73362f5934c5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.241331 Nov 02 13:57:57.503928 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3261/6899] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:57 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:57:58.354661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:58.355540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:58.364643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:58.365567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:58.366634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:58.368547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:58.369219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:58.369869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:58.515257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:58.515901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:58.547089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:58.555760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:58.556961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:58.557917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:58.558567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:58.559214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:58.694063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f38218889a4b478024d9b4a32affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57a43d9436ca4b99ac978d174d9ee5ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:58.713272 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-96fc6d13-04a8-4a21-86ec-96c35d1b9097 tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 200 len: 1512 microversion: 2.1 time: 0.357817 Nov 02 13:57:58.714317 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3639/6900] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:58 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:57:58.810641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:58.838107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:58.838107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:57:58.838107 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-73102790-9673-4482-9e6a-9891393a9137 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.315912 Nov 02 13:57:58.864377 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3262/6901] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:58 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:57:58.976413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b7ad6b9c-ec75-4a7c-b774-6a5cdaf890c7 req-ed7e948e-e8d9-481b-b427-598c2fcf44ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb7d6b01-a208-498f-a941-5e6ceb31e469", "name": "network-vif-deleted", "tag": "76df95c3-620d-4a76-bcee-2f6bd8014dba"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:57:58.987621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b7ad6b9c-ec75-4a7c-b774-6a5cdaf890c7 req-ed7e948e-e8d9-481b-b427-598c2fcf44ba service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:58.988409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b7ad6b9c-ec75-4a7c-b774-6a5cdaf890c7 req-ed7e948e-e8d9-481b-b427-598c2fcf44ba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:58.989011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b7ad6b9c-ec75-4a7c-b774-6a5cdaf890c7 req-ed7e948e-e8d9-481b-b427-598c2fcf44ba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:59.003093 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b7ad6b9c-ec75-4a7c-b774-6a5cdaf890c7 req-ed7e948e-e8d9-481b-b427-598c2fcf44ba service nova] Creating event network-vif-deleted:76df95c3-620d-4a76-bcee-2f6bd8014dba for instance bb7d6b01-a208-498f-a941-5e6ceb31e469 on n-h2-858384-19 Nov 02 13:57:59.009389 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b7ad6b9c-ec75-4a7c-b774-6a5cdaf890c7 req-ed7e948e-e8d9-481b-b427-598c2fcf44ba service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036342 Nov 02 13:57:59.016746 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3640/6902] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:57:59.742416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:59.743052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] [instance: bb7d6b01-a208-498f-a941-5e6ceb31e469] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:59.759998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:59.760590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:59.761149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:59.762026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:59.762531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:59.766798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:59.814404 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] HTTP exception thrown: Instance bb7d6b01-a208-498f-a941-5e6ceb31e469 could not be found. Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Request method failure captured: Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 HTTP/1.1 Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYndLOE7Z4-C_uzngUCfAORNh3MbhijMwoz-uhgZaJThTUZce2RI7didrscQVWbRF0r920XAJ0EuI-FNUNRxMwOGj6ZUsORB95Ain9u8NX9ntmV8bte9NNoKEGe7x8VPAWA7KIjnDozRq3_zLMuQEkiF7Je0IJ0sGH-M9Fy5wEUVRVTo Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 57a43d9436ca4b99ac978d174d9ee5ad Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestServerAdvancedOps-440469776 Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/57a43d9436ca4b99ac978d174d9ee5ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/57a43d9436ca4b99ac978d174d9ee5ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_57a43d9436ca4b99ac978d174d9ee5ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/57a43d9436ca4b99ac978d174d9ee5ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestServerAdvancedOps-440469776 Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 57a43d9436ca4b99ac978d174d9ee5ad Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestServerAdvancedOps-440469776 Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestServerAdvancedOps-440469776-project Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f8f38218889a4b478024d9b4a32affe1 Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestServerAdvancedOps-440469776-project Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance bb7d6b01-a208-498f-a941-5e6ceb31e469 could not be found. Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'bb7d6b01-a208-498f-a941-5e6ceb31e469'} Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb7d6b01-a208-498f-a941-5e6ceb31e469 could not be found. Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb7d6b01-a208-498f-a941-5e6ceb31e469 could not be found. Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:57:59.816986 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:57:59.821818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:57:59.821818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:57:59.821818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:57:59.821818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:57:59.821818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:57:59.821818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb7d6b01-a208-498f-a941-5e6ceb31e469 could not be found. Nov 02 13:57:59.821818 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:57:59.823637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] Returning 404 to user: Instance bb7d6b01-a208-498f-a941-5e6ceb31e469 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:57:59.826181 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b664e36e-1330-4574-8396-b91f3681557e tempest-TestServerAdvancedOps-440469776 tempest-TestServerAdvancedOps-440469776-project] 10.222.0.113 "GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469" status: 404 len: 111 microversion: 2.1 time: 0.087274 Nov 02 13:57:59.827101 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3263/6903] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:57:59 2022] GET /compute/v2.1/servers/bb7d6b01-a208-498f-a941-5e6ceb31e469 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:57:59.871467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:57:59.878453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:57:59.886362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:59.887137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:59.887926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:57:59.890010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:57:59.890643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:57:59.891324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:00.321367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:00.332059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:00.333577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:00.335052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8797a2ab-cc40-4433-8991-1c6d84e85aa0 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.469209 Nov 02 13:58:00.336109 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3641/6904] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:57:59 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:01.365598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:01.367012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:01.377804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:01.379897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:01.381022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:01.381811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:01.382759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:01.383458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:01.384428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:01.680080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:01.693102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:01.694587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:01.701639 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-568e8eec-8bf4-4e69-8dec-6130ca0e6632 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.338985 Nov 02 13:58:01.703335 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3264/6905] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:01 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:02.727436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:02.728740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:02.738206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:02.739148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:02.739408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:02.739958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:02.740428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:02.740937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:02.894900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:02.904313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:02.905758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:02.907285 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39d44165-7ae8-4848-9533-8d81adbcfb62 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.183934 Nov 02 13:58:02.907864 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3642/6906] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:02 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:03.934262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:03.935591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:03.942829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:03.943498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:03.944008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:03.944785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:03.945314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:03.945828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:04.086959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:04.097067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:04.098581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:04.099790 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b4b1567-b4f8-4e06-9f1b-0d4d56ffac92 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.169569 Nov 02 13:58:04.100385 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3265/6907] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:03 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:05.130222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:05.130222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:05.136032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:05.136523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:05.136969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:05.137680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:05.139020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:05.139498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:05.142408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:05.285588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:05.293819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:05.296876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:05.298373 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e6a6ef61-50e4-43e3-b1c0-6b5cf9cf42ed tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.174931 Nov 02 13:58:05.299160 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3643/6908] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:05 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:06.326368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:06.327174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:06.334356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:06.334837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:06.335297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:06.335998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:06.336445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:06.336868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:06.481199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:06.490484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:06.492043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:06.493220 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0a7c282a-afab-44b2-8fbc-e549e86a0ca9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.171541 Nov 02 13:58:06.493799 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3266/6909] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:06 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:07.520200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:07.520982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:07.523833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:07.530790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:07.531625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:07.532294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:07.533209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:07.533664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:07.534105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:07.673140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:07.681689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:07.683227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:07.684426 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9925ffe3-b9e5-4ede-a2a1-e553bd5ede15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.168414 Nov 02 13:58:07.685689 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3644/6910] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:07 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:08.711875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:08.712394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:08.722172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:08.722667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:08.723139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:08.723845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:08.724308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:08.724741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:08.861433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:08.869770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:08.871286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:08.873104 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d7fbbdb-d3af-4b0d-bed1-35e44ad874f1 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.165697 Nov 02 13:58:08.873806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3267/6911] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:08 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:09.899134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:09.899761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:09.907575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:09.908068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:09.908515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:09.909228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:09.909685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:09.910141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:10.047938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:10.056367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:10.058097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:10.060159 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd85bf70-68d9-456b-a592-823e6380db8e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.164532 Nov 02 13:58:10.060762 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3645/6912] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:09 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:11.085724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:11.086397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:11.093875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:11.094381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:11.094830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:11.095795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:11.096351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:11.096848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:11.239291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:11.247724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:11.251589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:11.252784 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1ec6ff22-267e-4b6f-ac9d-d1e6c936007a tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.171091 Nov 02 13:58:11.253366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3268/6913] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:11 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:11.558941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-cb300096-18f3-4750-8433-39382f07cc30 req-11322fb0-88bf-4995-8e79-222484a91c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e8f9b9-7973-4381-8851-1b919f953487", "name": "network-vif-plugged", "status": "completed", "tag": "339d808c-dd60-4ec3-9279-d5c8b8c51695"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:11.570139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cb300096-18f3-4750-8433-39382f07cc30 req-11322fb0-88bf-4995-8e79-222484a91c7b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:11.570908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cb300096-18f3-4750-8433-39382f07cc30 req-11322fb0-88bf-4995-8e79-222484a91c7b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:11.571586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-cb300096-18f3-4750-8433-39382f07cc30 req-11322fb0-88bf-4995-8e79-222484a91c7b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:11.584262 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-cb300096-18f3-4750-8433-39382f07cc30 req-11322fb0-88bf-4995-8e79-222484a91c7b service nova] Creating event network-vif-plugged:339d808c-dd60-4ec3-9279-d5c8b8c51695 for instance 71e8f9b9-7973-4381-8851-1b919f953487 on n-h1-858384-19 Nov 02 13:58:11.589994 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-cb300096-18f3-4750-8433-39382f07cc30 req-11322fb0-88bf-4995-8e79-222484a91c7b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034731 Nov 02 13:58:11.591933 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3646/6914] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:12.280842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:12.281613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:12.290286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:12.290812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:12.291283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:12.292362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:12.293063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:12.293240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:12.468119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:12.483372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:12.490969 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:12.495490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5100169d-b6b8-489a-ba9d-e395dbe63023 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.216852 Nov 02 13:58:12.496735 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3269/6915] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:12 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:13.523721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:13.524311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:13.531910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:13.532374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:13.532817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:13.533534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:13.534095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:13.534531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:13.690289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:13.699667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:13.702254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:13.703384 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e5366b4-4224-45df-be87-d4f60fd1fd15 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1733 microversion: 2.20 time: 0.185342 Nov 02 13:58:13.703978 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3647/6916] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:13 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:14.729360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:14.730041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:14.737835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:14.738324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:14.738769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:14.739509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:14.739970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:14.740534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:14.894407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:14.904675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:14.906475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:14.907691 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ce027843-fa0f-41b7-9063-7ff5c8261c41 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1720 microversion: 2.20 time: 0.182399 Nov 02 13:58:14.908942 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3270/6917] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:58:14 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:58:16.061020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5fb2cb4d-8e3d-44d0-b4b3-955613375391 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Action: 'create', calling method: .version_select at 0x7fe7861efe50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1445997677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9KKOEy/RO6QC87p6J7EpzCUz+u6dRbWDN/gE+D7+NGUIi06kMporbmV7Ax/LF1tey6cC0+G+PNWFl67sJXuaCwM/gQnR2qei4oLOcYrFz+dEDpBOF+dtAggmP2XE3QFw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:16.080141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5fb2cb4d-8e3d-44d0-b4b3-955613375391 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:58:16.086444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5fb2cb4d-8e3d-44d0-b4b3-955613375391 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for user 38735cc248a746789a1f357eab74620b and project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:58:16.116859 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5fb2cb4d-8e3d-44d0-b4b3-955613375391 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.060345 Nov 02 13:58:16.117698 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3648/6918] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:58:16 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:17.355713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1665809577", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "a92bf493-2343-49e6-8ffe-9f2e05c5297c"}], "key_name": "tempest-TestNetworkBasicOps-1445997677", "security_groups": [{"name": "tempest-secgroup-smoke-1140671934"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:17.476263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] validate_networks() for [('a92bf493-2343-49e6-8ffe-9f2e05c5297c', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:58:18.521610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:58:18.523124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:58:18.524158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:58:18.524906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:58:18.526587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:58:18.560240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:18.560851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:18.561576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:18.562637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:18.563364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:18.564044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:18.588387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:58:18.596710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for user 38735cc248a746789a1f357eab74620b and project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:58:18.615187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:58:18.618740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:58:18.706571 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4358772-92e0-461c-9ba9-cee41ce8540c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.354697 Nov 02 13:58:18.708086 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3271/6919] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:58:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:58:18.721197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df959d5c-469c-4f0c-9fde-a7a2004e54b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:18.723013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df959d5c-469c-4f0c-9fde-a7a2004e54b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:18.788384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-df959d5c-469c-4f0c-9fde-a7a2004e54b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:18.797415 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df959d5c-469c-4f0c-9fde-a7a2004e54b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1253 microversion: 2.1 time: 0.081829 Nov 02 13:58:18.798557 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3649/6920] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:18 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1253 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:19.822288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:19.823008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:19.831475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:19.832078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:19.832629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:19.833422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:19.834193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:19.834686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:19.901220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:19.910010 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-93b166b4-d36c-46b4-a01b-ed224230926e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1313 microversion: 2.1 time: 0.091726 Nov 02 13:58:19.923377 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3272/6921] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:19 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1313 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:20.933990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:20.935499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:20.943756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:20.944641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:20.945321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:20.946578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:20.947542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:20.948217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:21.172863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:21.186066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ab0b14f0-4ee8-4427-ae78-03f02fd61598 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1379 microversion: 2.1 time: 0.255909 Nov 02 13:58:21.192830 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3650/6922] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:20 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1379 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:21.926938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c29a9010-7456-468d-9e04-2169859c0aec req-4968157a-6656-40e5-bbff-958fd4d2e488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0efe851-fbfd-4b1e-a30c-a63b88473bdc", "tag": "6e9d0e41-981b-4989-9e5d-3d9155e3620f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:21.948155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c29a9010-7456-468d-9e04-2169859c0aec req-4968157a-6656-40e5-bbff-958fd4d2e488 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:21.952697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c29a9010-7456-468d-9e04-2169859c0aec req-4968157a-6656-40e5-bbff-958fd4d2e488 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:21.953381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c29a9010-7456-468d-9e04-2169859c0aec req-4968157a-6656-40e5-bbff-958fd4d2e488 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:21.977231 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c29a9010-7456-468d-9e04-2169859c0aec req-4968157a-6656-40e5-bbff-958fd4d2e488 service nova] Creating event network-changed:6e9d0e41-981b-4989-9e5d-3d9155e3620f for instance d0efe851-fbfd-4b1e-a30c-a63b88473bdc on n-h2-858384-19 Nov 02 13:58:21.984879 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c29a9010-7456-468d-9e04-2169859c0aec req-4968157a-6656-40e5-bbff-958fd4d2e488 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062273 Nov 02 13:58:21.986081 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3273/6923] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:22.224573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:22.225826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:22.243214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:22.244060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:22.245595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:22.246635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:22.249273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:22.250219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:22.506988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:22.521310 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c6565099-3668-406d-b8b8-67816b894bdc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1379 microversion: 2.1 time: 0.308894 Nov 02 13:58:22.522236 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3651/6924] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:22 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1379 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:23.551304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:23.552137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:23.560101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:23.560757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:23.561293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:23.562084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:23.562621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:23.563139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:23.703581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:23.711325 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-662436e6-4a06-4237-b37e-1af6377ad5ac tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1379 microversion: 2.1 time: 0.165468 Nov 02 13:58:23.711908 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3274/6925] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:23 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1379 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:24.373648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47a9d808-01c2-403a-a1ea-179245545ac8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Action: 'create', calling method: .version_select at 0x7fe786a981f0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1575436582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSVW5HlQmpfUJtNhojaEtDROySobYu+5oUhWXL7f3yQ9On4OqgXaLhg7ZFE7hh0yR1R/FU9lx5xoO3rrVU36OdAQjZXp7V4Nb0yXD0CK1gRBIczy+arN7XWf9lT4eVWwQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:24.389638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-47a9d808-01c2-403a-a1ea-179245545ac8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Getting quotas for project 5f2a9251561845d0992c29bd528fadcc. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:58:24.395414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-47a9d808-01c2-403a-a1ea-179245545ac8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Getting quotas for user 603d648711a643e7adf027c3a4e3f1c0 and project 5f2a9251561845d0992c29bd528fadcc. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:58:24.419974 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47a9d808-01c2-403a-a1ea-179245545ac8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.215531 Nov 02 13:58:24.420870 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3652/6926] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:58:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:24.736738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:24.737451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:24.745130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.745791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.746416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.747498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:24.748165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:24.749187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:24.754921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:24.906148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:24.914287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5949d218-b4ef-4a31-a765-75fab94eb592 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1379 microversion: 2.1 time: 0.181974 Nov 02 13:58:24.915006 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3275/6927] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:24 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1379 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:25.938786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:25.939475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:25.946652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:25.947167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:25.947609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:25.948312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:25.948783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:25.949221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:26.193833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:26.203485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fd948d30-d27c-431e-95c2-fdb42067189c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1379 microversion: 2.1 time: 0.270280 Nov 02 13:58:26.219767 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3653/6928] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:25 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1379 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:27.228901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:27.229791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:27.237543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:27.238109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:27.239099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:27.239903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:27.240406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:27.241061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:27.552635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:27.564612 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8d86b2bb-1279-473b-929f-dfd865e31372 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1379 microversion: 2.1 time: 0.339844 Nov 02 13:58:27.575572 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3276/6929] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:27 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1379 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:28.133272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:28.134830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:28.146803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.147621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.148228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.149108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.149738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.150168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.354961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5385fcd3-bdb6-422c-b694-d54ca1d5304c req-5515be7a-d8e1-458d-ac9e-e1b3a55259a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0efe851-fbfd-4b1e-a30c-a63b88473bdc", "name": "network-vif-plugged", "status": "completed", "tag": "6e9d0e41-981b-4989-9e5d-3d9155e3620f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:28.385072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5385fcd3-bdb6-422c-b694-d54ca1d5304c req-5515be7a-d8e1-458d-ac9e-e1b3a55259a4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.385561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5385fcd3-bdb6-422c-b694-d54ca1d5304c req-5515be7a-d8e1-458d-ac9e-e1b3a55259a4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.402024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:28.411266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5385fcd3-bdb6-422c-b694-d54ca1d5304c req-5515be7a-d8e1-458d-ac9e-e1b3a55259a4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.417159 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22816d81-a5e2-46a8-9dea-ce7d1ddc38ac tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1686 microversion: 2.1 time: 0.288793 Nov 02 13:58:28.417778 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3654/6930] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:28 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1686 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:28.470996 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5385fcd3-bdb6-422c-b694-d54ca1d5304c req-5515be7a-d8e1-458d-ac9e-e1b3a55259a4 service nova] Creating event network-vif-plugged:6e9d0e41-981b-4989-9e5d-3d9155e3620f for instance d0efe851-fbfd-4b1e-a30c-a63b88473bdc on n-h2-858384-19 Nov 02 13:58:28.485205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5385fcd3-bdb6-422c-b694-d54ca1d5304c req-5515be7a-d8e1-458d-ac9e-e1b3a55259a4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133023 Nov 02 13:58:28.493014 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3277/6931] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:58:28.592494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:28.593195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:28.601483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b07a6a7-3ee4-4846-a70d-5fd5149ca1de tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:28.604026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b07a6a7-3ee4-4846-a70d-5fd5149ca1de tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:28.607459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:28.608391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:28.611501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.612023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.614440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.615344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.615835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.616402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.619046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b07a6a7-3ee4-4846-a70d-5fd5149ca1de tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.626436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b07a6a7-3ee4-4846-a70d-5fd5149ca1de tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.627309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b07a6a7-3ee4-4846-a70d-5fd5149ca1de tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.628522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b07a6a7-3ee4-4846-a70d-5fd5149ca1de tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.629216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b07a6a7-3ee4-4846-a70d-5fd5149ca1de tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.632280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b07a6a7-3ee4-4846-a70d-5fd5149ca1de tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.728223 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b07a6a7-3ee4-4846-a70d-5fd5149ca1de tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e/action" status: 200 len: 32628 microversion: 2.1 time: 0.129808 Nov 02 13:58:28.733289 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3278/6932] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:58:28 2022] POST /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e/action => generated 32628 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 13:58:28.884111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:28.894238 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-92e65bc4-c9a6-4ff1-952b-e06ac87c279a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1379 microversion: 2.1 time: 0.308364 Nov 02 13:58:28.896197 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3655/6933] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:28 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1379 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:28.921242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af6cf4cb-a7f4-453e-b9e6-1a7e30a22980 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:28.921967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af6cf4cb-a7f4-453e-b9e6-1a7e30a22980 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:28.929574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af6cf4cb-a7f4-453e-b9e6-1a7e30a22980 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.930320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af6cf4cb-a7f4-453e-b9e6-1a7e30a22980 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.930765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af6cf4cb-a7f4-453e-b9e6-1a7e30a22980 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:28.931516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af6cf4cb-a7f4-453e-b9e6-1a7e30a22980 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:28.931978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af6cf4cb-a7f4-453e-b9e6-1a7e30a22980 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:28.932517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af6cf4cb-a7f4-453e-b9e6-1a7e30a22980 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:29.188869 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af6cf4cb-a7f4-453e-b9e6-1a7e30a22980 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1839 microversion: 2.1 time: 0.272992 Nov 02 13:58:29.195524 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3279/6934] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:28 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1839 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:29.228877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:29.233098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:29.240910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:29.242651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:29.243538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:29.244484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:29.245127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:29.245559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:29.276717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lazy-loading 'flavor' on Instance uuid 26d042a9-9116-4d33-911f-b706a0bbe78e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:58:29.293489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Going to try to live migrate instance to another host {{(pid=120928) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Nov 02 13:58:29.922313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:29.923392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:29.944741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:29.945238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:29.945892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:29.946658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:29.947185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:29.947565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:30.408779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:30.418958 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dfa8c4ef-1137-45f7-a548-c4f9e7b5abcb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1379 microversion: 2.1 time: 0.501318 Nov 02 13:58:30.433794 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3280/6935] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:29 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1379 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:31.136736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1565999643-access_point-1731248050", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "5276a5cc-0344-4737-af9c-8738cba33db8"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1575436582", "security_groups": [{"name": "tempest-secgroup_access--1764437132"}, {"name": "tempest-secgroup_general--1842888325"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:31.620614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] validate_networks() for [('5276a5cc-0344-4737-af9c-8738cba33db8', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:58:31.928570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:31.988703 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1502d5e2-5c06-4bef-88ba-53f3e6d7ba86 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e/action" status: 202 len: 0 microversion: 2.1 time: 2.763670 Nov 02 13:58:31.990437 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3656/6936] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:58:29 2022] POST /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e/action => generated 0 bytes in 2766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:58:32.001246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:32.001944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:32.011174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.012224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.013600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.015202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.015886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.016485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.192921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:58:32.194016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:58:32.194760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:58:32.195473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:58:32.196141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:58:32.206566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.207458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.209182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:32.210787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.211101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.211695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.212343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.237426 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-85f0a1dc-b54a-4a4d-bc41-8ae6ad7e882c tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1552 microversion: 2.1 time: 0.245593 Nov 02 13:58:32.238249 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3657/6937] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:31 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1552 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:32.239357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Getting quotas for project 5f2a9251561845d0992c29bd528fadcc. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:58:32.245808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Getting quotas for user 603d648711a643e7adf027c3a4e3f1c0 and project 5f2a9251561845d0992c29bd528fadcc. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:58:32.246340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:32.247248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:32.260777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.261386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.261839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.262750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:58:32.263237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.263925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.264631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.265210 n-d-858384-19 devstack@n-api.service[120929]: WARNING nova.utils [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1565999643-access_point-1731248050 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1565999643-ac Nov 02 13:58:32.266139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:58:32.332291 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bb088ed9-5e7d-4c39-8f85-f063eb336b0f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 460 microversion: 2.1 time: 1.199643 Nov 02 13:58:32.333630 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3281/6938] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:58:31 2022] POST /compute/v2.1/servers => generated 460 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:58:32.338771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:32.339710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:32.353883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.354426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.355174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.356765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:32.357400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:32.358099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:32.567903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:32.581649 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2e9db3d0-a8bb-4df6-aaa0-4f4e8fdb2207 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1552 microversion: 2.1 time: 0.246554 Nov 02 13:58:32.582831 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3282/6939] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:32 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1552 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:32.592162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3b71cf8c-d4ad-45cf-bdb5-0dcf265792a5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:32.596896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3b71cf8c-d4ad-45cf-bdb5-0dcf265792a5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:32.690983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3b71cf8c-d4ad-45cf-bdb5-0dcf265792a5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:32.704989 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3b71cf8c-d4ad-45cf-bdb5-0dcf265792a5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1299 microversion: 2.1 time: 0.120524 Nov 02 13:58:32.706434 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3283/6940] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:32 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:32.965978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:32.975778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c56a7ff-6490-465d-a785-3f34754e8ede tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.736248 Nov 02 13:58:32.976378 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3658/6941] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:32 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:33.730059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:33.731663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:33.744831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:33.745671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:33.746329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:33.748126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:33.749316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:33.750044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:33.774768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-65032398-e336-4082-be97-e517968882a5 req-9ccd67da-1c46-4d73-9038-f20581940cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d042a9-9116-4d33-911f-b706a0bbe78e", "name": "network-vif-unplugged", "status": "completed", "tag": "91c736ea-37fa-4d02-8ae9-ae6a2878ad78"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:33.797938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-65032398-e336-4082-be97-e517968882a5 req-9ccd67da-1c46-4d73-9038-f20581940cf2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:33.798551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-65032398-e336-4082-be97-e517968882a5 req-9ccd67da-1c46-4d73-9038-f20581940cf2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:33.799876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-65032398-e336-4082-be97-e517968882a5 req-9ccd67da-1c46-4d73-9038-f20581940cf2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:33.821181 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-65032398-e336-4082-be97-e517968882a5 req-9ccd67da-1c46-4d73-9038-f20581940cf2 service nova] Creating event network-vif-unplugged:91c736ea-37fa-4d02-8ae9-ae6a2878ad78 for instance 26d042a9-9116-4d33-911f-b706a0bbe78e on n-h1-858384-19 Nov 02 13:58:33.844358 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-65032398-e336-4082-be97-e517968882a5 req-9ccd67da-1c46-4d73-9038-f20581940cf2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071939 Nov 02 13:58:33.844358 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3659/6942] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:58:33.851823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:33.864402 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d7663f4-d403-42d2-ae8b-3c271aa3a550 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1359 microversion: 2.1 time: 0.138578 Nov 02 13:58:33.881040 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3284/6943] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:33 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:34.001833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:34.002745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:34.009387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:34.009881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:34.010343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:34.011674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:34.011807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:34.013069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:34.230758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:34.254812 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ee57b03-8351-4c2f-b5b1-7653c345224b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.248156 Nov 02 13:58:34.256120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3660/6944] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:33 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:34.892396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:34.893051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:34.900243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:34.900730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:34.901175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:34.901877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:34.902331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:34.902813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:35.272661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:35.278450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:35.279239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:35.281241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:35.290130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:35.290628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:35.290806 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b69c76ef-1db7-443c-a865-055334c290a4 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1477 microversion: 2.1 time: 0.402107 Nov 02 13:58:35.291342 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3285/6945] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:34 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:35.303702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:35.305176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:35.305899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:35.306407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:35.311342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:35.516669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:35.524924 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-110490f2-6a2c-4079-8dc5-cc4cc0a84325 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.250931 Nov 02 13:58:35.526233 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3661/6946] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:35 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:35.881020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-bbf73e51-a085-469a-882a-177d0040da44 req-9c5326aa-294f-433b-b038-c774e642487b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d042a9-9116-4d33-911f-b706a0bbe78e", "tag": "91c736ea-37fa-4d02-8ae9-ae6a2878ad78"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:35.894618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bbf73e51-a085-469a-882a-177d0040da44 req-9c5326aa-294f-433b-b038-c774e642487b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:35.895533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bbf73e51-a085-469a-882a-177d0040da44 req-9c5326aa-294f-433b-b038-c774e642487b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:35.895709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bbf73e51-a085-469a-882a-177d0040da44 req-9c5326aa-294f-433b-b038-c774e642487b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:35.911033 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-bbf73e51-a085-469a-882a-177d0040da44 req-9c5326aa-294f-433b-b038-c774e642487b service nova] Creating event network-changed:91c736ea-37fa-4d02-8ae9-ae6a2878ad78 for instance 26d042a9-9116-4d33-911f-b706a0bbe78e on n-h1-858384-19 Nov 02 13:58:35.917900 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-bbf73e51-a085-469a-882a-177d0040da44 req-9c5326aa-294f-433b-b038-c774e642487b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041719 Nov 02 13:58:35.923768 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3286/6947] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:58:36.313934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:36.315357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:36.325093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.325956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.326473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.327461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.328140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.329153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.498496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:36.506896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d3baf5d0-2725-43e8-81c4-056e4e440d16 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1477 microversion: 2.1 time: 0.197842 Nov 02 13:58:36.507632 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3662/6948] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:36 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:36.551630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:36.552348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:36.559826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.560345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.560801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:36.561538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:36.562005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:36.562446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.040001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-67196816-8964-4544-8f80-1dce6875324a req-432da846-e525-47a9-8f82-d121c5cdebb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ac29f6-c90f-491f-aa93-d216cef0bc2d", "tag": "941ede6c-6fb4-4f7d-b124-6d65d590619f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:37.054531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-67196816-8964-4544-8f80-1dce6875324a req-432da846-e525-47a9-8f82-d121c5cdebb8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:37.055013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-67196816-8964-4544-8f80-1dce6875324a req-432da846-e525-47a9-8f82-d121c5cdebb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:37.055473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-67196816-8964-4544-8f80-1dce6875324a req-432da846-e525-47a9-8f82-d121c5cdebb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.066977 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-67196816-8964-4544-8f80-1dce6875324a req-432da846-e525-47a9-8f82-d121c5cdebb8 service nova] Creating event network-changed:941ede6c-6fb4-4f7d-b124-6d65d590619f for instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d on n-h1-858384-19 Nov 02 13:58:37.076001 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-67196816-8964-4544-8f80-1dce6875324a req-432da846-e525-47a9-8f82-d121c5cdebb8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038338 Nov 02 13:58:37.076884 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3663/6949] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:58:37.226223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:37.234586 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d2ec4965-4c25-49a7-8aa3-dadbba50305f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.687365 Nov 02 13:58:37.235345 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3287/6950] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:36 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:37.539530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:37.540270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:37.547770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:37.548535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:37.548991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.549713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:37.550171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:37.550608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:37.702390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:37.710686 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b4c1f13a-c0a4-460b-bd94-14ec477b3bab tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1477 microversion: 2.1 time: 0.182735 Nov 02 13:58:37.711306 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3664/6951] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:37 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1477 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:38.260352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:38.260962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:38.268592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.269368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.269975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.270885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.271381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.271812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.496853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:38.506678 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-93d24ba5-4670-4e7e-bcc4-c14a509c9c5e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.250101 Nov 02 13:58:38.507615 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3288/6952] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:38 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:38.734752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:38.735382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:38.738488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:38.744190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.744682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.745129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.745927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:38.747043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:38.747641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:38.894095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:38.901950 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cb933fef-1670-46e4-a676-1c2ea46a3b81 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1477 microversion: 2.1 time: 0.171931 Nov 02 13:58:38.903038 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3665/6953] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:38 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1477 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:39.532611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:39.533230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:39.540079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:39.540563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:39.541210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:39.541914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:39.542366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:39.542793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:39.686839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:39.694933 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5dc5ee1b-92d8-4c76-a069-50dcac7f605c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.167342 Nov 02 13:58:39.695632 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3289/6954] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:39 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:39.925939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:39.926567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:39.937039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:39.937587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:39.938159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:39.938951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:39.939548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:39.940213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:40.099159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:40.108217 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-52040d50-ed64-48ad-9e07-e77f273cd3fc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1477 microversion: 2.1 time: 0.186202 Nov 02 13:58:40.108830 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3666/6955] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:39 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1477 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:40.720797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:40.721660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:40.728393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:40.728874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:40.729314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:40.730064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:40.730548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:40.730997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.024930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:41.034083 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-163aabfd-f712-436e-893d-8d5ce747c49d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.317289 Nov 02 13:58:41.034677 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3290/6956] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:40 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:41.132831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:41.133455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:41.140930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.142067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.142067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.142635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:41.143101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:41.143567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:41.288194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:41.296192 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a357f5cf-946a-4e26-9d0e-fefc7a007252 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1477 microversion: 2.1 time: 0.167312 Nov 02 13:58:41.296781 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3667/6957] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:41 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1477 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:42.060172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:42.060928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:42.068338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.068818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.069253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:42.069948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.070402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.070825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:42.210963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:42.219407 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-43d0daa2-adcf-494a-b686-cc524b63caef tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.164196 Nov 02 13:58:42.220000 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3291/6958] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:42 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:42.319383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:42.319926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:42.328756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.329253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.329692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:42.330432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:42.330889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:42.331363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:42.484149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:42.492666 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f9403d89-d527-4899-9f70-fed83e354a3a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1477 microversion: 2.1 time: 0.177414 Nov 02 13:58:42.493274 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3668/6959] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:42 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1477 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:43.244139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:43.244772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:43.247330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:43.248068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:43.254984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.255492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.255983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.256700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.257161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.257591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.460002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:43.468759 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4f23755d-a938-43f2-a418-7ba07e67cb83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.228517 Nov 02 13:58:43.469370 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3292/6960] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:43 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:43.516726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:43.517361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:43.524389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.526159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.526635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.527418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.534292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.534292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.697063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:43.706057 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d1dd559e-bbce-46f9-a9ef-96030b3ba045 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1477 microversion: 2.1 time: 0.193907 Nov 02 13:58:43.706669 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3669/6961] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:43 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1477 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:43.755512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-855d5d26-fbc8-420e-9376-186d1a60a202 req-5ba29008-b2d9-403a-a014-04ccd5661860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ac29f6-c90f-491f-aa93-d216cef0bc2d", "name": "network-vif-plugged", "status": "completed", "tag": "941ede6c-6fb4-4f7d-b124-6d65d590619f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:43.765708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-855d5d26-fbc8-420e-9376-186d1a60a202 req-5ba29008-b2d9-403a-a014-04ccd5661860 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:43.766701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-855d5d26-fbc8-420e-9376-186d1a60a202 req-5ba29008-b2d9-403a-a014-04ccd5661860 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:43.767195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-855d5d26-fbc8-420e-9376-186d1a60a202 req-5ba29008-b2d9-403a-a014-04ccd5661860 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:43.779305 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-855d5d26-fbc8-420e-9376-186d1a60a202 req-5ba29008-b2d9-403a-a014-04ccd5661860 service nova] Creating event network-vif-plugged:941ede6c-6fb4-4f7d-b124-6d65d590619f for instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d on n-h1-858384-19 Nov 02 13:58:43.784781 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-855d5d26-fbc8-420e-9376-186d1a60a202 req-5ba29008-b2d9-403a-a014-04ccd5661860 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033038 Nov 02 13:58:43.785539 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3293/6962] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:44.494015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:44.494711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:44.501498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:44.501998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:44.502449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:44.503190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:44.503763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:44.504206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:44.663406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:44.672644 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3b78303e-c862-43cf-b62f-93bf0531efe5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1696 microversion: 2.1 time: 0.182616 Nov 02 13:58:44.673441 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3670/6963] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:44 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:44.732276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:44.733022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:44.739852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:44.740374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:44.740819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:44.741525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:44.742036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:44.742414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:44.888886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:44.897003 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-700730cc-7a58-47b9-addc-2d52cdef9ead tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1477 microversion: 2.1 time: 0.170782 Nov 02 13:58:44.897714 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3294/6964] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:44 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1477 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:45.698565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:45.699283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:45.707417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:45.708181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:45.708595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:45.709308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:45.709784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:45.710218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:45.851443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:45.860019 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9bebc761-c162-4359-8d91-70fd1941949d tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1686 microversion: 2.1 time: 0.166228 Nov 02 13:58:45.860865 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3671/6965] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:45 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:45.883069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c830ccd-2fb8-4334-901a-5689b33a4208 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:45.883697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c830ccd-2fb8-4334-901a-5689b33a4208 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:45.890852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c830ccd-2fb8-4334-901a-5689b33a4208 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:45.891365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c830ccd-2fb8-4334-901a-5689b33a4208 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:45.891798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c830ccd-2fb8-4334-901a-5689b33a4208 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:45.892523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c830ccd-2fb8-4334-901a-5689b33a4208 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:45.892972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c830ccd-2fb8-4334-901a-5689b33a4208 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:45.893392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c830ccd-2fb8-4334-901a-5689b33a4208 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:45.922996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:45.923668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:45.931815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:45.932313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:45.932768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:45.933485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:45.934536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:45.934977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.020437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=100 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:58:46.030390 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c830ccd-2fb8-4334-901a-5689b33a4208 tempest-TestNetworkAdvancedServerOps-217652447 tempest-TestNetworkAdvancedServerOps-217652447-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1839 microversion: 2.1 time: 0.150772 Nov 02 13:58:46.031152 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3295/6966] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:45 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1839 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:46.058069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:46.058763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:46.065591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.066085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.066529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.067270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.068045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.068485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.091270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:46.099105 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1897c02f-738a-4af6-86c6-71a98797910f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1650 microversion: 2.1 time: 0.180946 Nov 02 13:58:46.099723 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3672/6967] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:45 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1650 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:46.122713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:46.123645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:46.130340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.130836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.131319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.132045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.132510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.132956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.234415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:46.242639 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-913c471d-88e7-4f93-9835-6a6cc3d7da91 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1686 microversion: 2.1 time: 0.188480 Nov 02 13:58:46.243279 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3296/6968] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:46 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1686 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:46.282061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:46.290017 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b2dd6b22-f59e-4160-b30a-306261032a46 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1650 microversion: 2.1 time: 0.171436 Nov 02 13:58:46.290600 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3673/6969] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:46 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1650 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:58:46.312785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a6c4ce7-207e-42fe-904b-b0df5f9d17cb tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:46.313405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a6c4ce7-207e-42fe-904b-b0df5f9d17cb tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:46.319419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a6c4ce7-207e-42fe-904b-b0df5f9d17cb tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.319911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a6c4ce7-207e-42fe-904b-b0df5f9d17cb tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.320353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a6c4ce7-207e-42fe-904b-b0df5f9d17cb tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.321060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a6c4ce7-207e-42fe-904b-b0df5f9d17cb tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.321522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a6c4ce7-207e-42fe-904b-b0df5f9d17cb tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.321980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a6c4ce7-207e-42fe-904b-b0df5f9d17cb tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.342429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97ebeab3-cd02-4898-baab-dfa22e81e563 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:46.344720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-97ebeab3-cd02-4898-baab-dfa22e81e563 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:46.350776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ebeab3-cd02-4898-baab-dfa22e81e563 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.351304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ebeab3-cd02-4898-baab-dfa22e81e563 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.351752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ebeab3-cd02-4898-baab-dfa22e81e563 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.352458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ebeab3-cd02-4898-baab-dfa22e81e563 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:46.352923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ebeab3-cd02-4898-baab-dfa22e81e563 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:46.353460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97ebeab3-cd02-4898-baab-dfa22e81e563 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:46.409212 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97ebeab3-cd02-4898-baab-dfa22e81e563 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e/action" status: 200 len: 38375 microversion: 2.1 time: 0.071409 Nov 02 13:58:46.410149 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3674/6970] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:58:46 2022] POST /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e/action => generated 38375 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:58:46.579239 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a6c4ce7-207e-42fe-904b-b0df5f9d17cb tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1803 microversion: 2.1 time: 0.269961 Nov 02 13:58:46.580432 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3297/6971] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:46 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1803 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:47.442098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:47.443010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:47.447685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f10569c5-c81e-4e3f-84bd-718b04b68dfc req-86f6ebb7-d6af-46c1-9a22-e2c0a8526c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d042a9-9116-4d33-911f-b706a0bbe78e", "tag": "91c736ea-37fa-4d02-8ae9-ae6a2878ad78"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:47.456320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:47.459935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:47.460836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:47.461904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:47.462781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:47.463937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:47.465905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f10569c5-c81e-4e3f-84bd-718b04b68dfc req-86f6ebb7-d6af-46c1-9a22-e2c0a8526c04 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:47.467159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f10569c5-c81e-4e3f-84bd-718b04b68dfc req-86f6ebb7-d6af-46c1-9a22-e2c0a8526c04 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:47.468771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f10569c5-c81e-4e3f-84bd-718b04b68dfc req-86f6ebb7-d6af-46c1-9a22-e2c0a8526c04 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:47.484079 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f10569c5-c81e-4e3f-84bd-718b04b68dfc req-86f6ebb7-d6af-46c1-9a22-e2c0a8526c04 service nova] Creating event network-changed:91c736ea-37fa-4d02-8ae9-ae6a2878ad78 for instance 26d042a9-9116-4d33-911f-b706a0bbe78e on n-h2-858384-19 Nov 02 13:58:47.490059 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f10569c5-c81e-4e3f-84bd-718b04b68dfc req-86f6ebb7-d6af-46c1-9a22-e2c0a8526c04 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046074 Nov 02 13:58:47.491345 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3298/6972] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:47.506381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:58:47.630501 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-046dc3da-e4cc-4d3a-b261-ee5a2817ee8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "DELETE /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 204 len: 0 microversion: 2.1 time: 0.191547 Nov 02 13:58:47.634708 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3675/6973] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:58:47 2022] DELETE /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:58:47.644085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:47.644890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:47.658289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:47.659068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:47.660211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:47.661019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:47.661576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:47.662075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:47.909832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:47.918093 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-81d1cec9-b937-4835-b701-12ac69045539 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1692 microversion: 2.1 time: 0.280604 Nov 02 13:58:47.919707 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3299/6974] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:47 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1692 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:48.806985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6f40df9d-7790-4fb4-8cc5-7f4bf0ab8f3e req-3843796c-3cb2-42c4-a352-39c45ad6cb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ac29f6-c90f-491f-aa93-d216cef0bc2d", "tag": "941ede6c-6fb4-4f7d-b124-6d65d590619f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:48.819049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6f40df9d-7790-4fb4-8cc5-7f4bf0ab8f3e req-3843796c-3cb2-42c4-a352-39c45ad6cb02 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.819563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6f40df9d-7790-4fb4-8cc5-7f4bf0ab8f3e req-3843796c-3cb2-42c4-a352-39c45ad6cb02 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.820220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6f40df9d-7790-4fb4-8cc5-7f4bf0ab8f3e req-3843796c-3cb2-42c4-a352-39c45ad6cb02 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:48.833466 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6f40df9d-7790-4fb4-8cc5-7f4bf0ab8f3e req-3843796c-3cb2-42c4-a352-39c45ad6cb02 service nova] Creating event network-changed:941ede6c-6fb4-4f7d-b124-6d65d590619f for instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d on n-h1-858384-19 Nov 02 13:58:48.839579 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6f40df9d-7790-4fb4-8cc5-7f4bf0ab8f3e req-3843796c-3cb2-42c4-a352-39c45ad6cb02 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039419 Nov 02 13:58:48.841552 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3676/6975] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:48.941910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:48.943857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:48.956181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.956917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.957642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:48.959024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:48.966578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:48.967322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:49.005343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:49.006241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:49.006852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:49.007504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lazy-loading 'fault' on Instance uuid 26d042a9-9116-4d33-911f-b706a0bbe78e {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:58:49.097850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:58:49.109157 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e41806b2-c1a8-4250-87a7-69f3f49b2c99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 200 len: 1359 microversion: 2.1 time: 0.171038 Nov 02 13:58:49.127704 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3300/6976] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:48 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:58:49.507687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-35d07450-7bfa-4438-bdfe-5c812140ea7f req-272e87d7-470f-4f32-9089-407d4c871b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d042a9-9116-4d33-911f-b706a0bbe78e", "name": "network-vif-deleted", "tag": "91c736ea-37fa-4d02-8ae9-ae6a2878ad78"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:49.518222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-35d07450-7bfa-4438-bdfe-5c812140ea7f req-272e87d7-470f-4f32-9089-407d4c871b61 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:49.518804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-35d07450-7bfa-4438-bdfe-5c812140ea7f req-272e87d7-470f-4f32-9089-407d4c871b61 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:49.519527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-35d07450-7bfa-4438-bdfe-5c812140ea7f req-272e87d7-470f-4f32-9089-407d4c871b61 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:49.532629 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-35d07450-7bfa-4438-bdfe-5c812140ea7f req-272e87d7-470f-4f32-9089-407d4c871b61 service nova] Creating event network-vif-deleted:91c736ea-37fa-4d02-8ae9-ae6a2878ad78 for instance 26d042a9-9116-4d33-911f-b706a0bbe78e on n-h2-858384-19 Nov 02 13:58:49.538248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-35d07450-7bfa-4438-bdfe-5c812140ea7f req-272e87d7-470f-4f32-9089-407d4c871b61 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035285 Nov 02 13:58:49.539476 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3677/6977] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:58:50.137696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:50.138312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 26d042a9-9116-4d33-911f-b706a0bbe78e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:58:50.145194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.145684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.146130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.146861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:58:50.147358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:58:50.147799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:58:50.161930 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] HTTP exception thrown: Instance 26d042a9-9116-4d33-911f-b706a0bbe78e could not be found. Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Request method failure captured: Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e HTTP/1.1 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnVXBJjYVYKia0vxbjWHpLhZPUXqy9qzXWuRFgQYAN7DfSZl64uS6JBaetuwYeaWGbSLwXk357QnJPGHHhI5ySkNmd7QeR6UkGdWVUkROaqFFPeO96O11eREIt2L19I24aIfpQUjmqwFvMmflCc2eMLpoTDom0x1gkoXw5KYIpfQ2wc Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: bc97329dcfb8453795347d9e818d9d92 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: bc97329dcfb8453795347d9e818d9d92 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestNetworkAdvancedServerOps-423495247-project Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 41c7ca068dba4093880183ae9b2f0935 Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestNetworkAdvancedServerOps-423495247-project Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 26d042a9-9116-4d33-911f-b706a0bbe78e could not be found. Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '26d042a9-9116-4d33-911f-b706a0bbe78e'} Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d042a9-9116-4d33-911f-b706a0bbe78e could not be found. Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d042a9-9116-4d33-911f-b706a0bbe78e could not be found. Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.163610 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d042a9-9116-4d33-911f-b706a0bbe78e could not be found. Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Returning 404 to user: Instance 26d042a9-9116-4d33-911f-b706a0bbe78e could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bafcace8-f2bd-40c5-b392-b23c222ef1a1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e" status: 404 len: 111 microversion: 2.1 time: 0.032320 Nov 02 13:58:50.168767 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3301/6978] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:58:50 2022] GET /compute/v2.1/servers/26d042a9-9116-4d33-911f-b706a0bbe78e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:58:53.864404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-40553cf5-de0c-4510-b80c-b0770574881e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '.version_select at 0x7fe7862cb8b0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:58:53.889317 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-40553cf5-de0c-4510-b80c-b0770574881e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-26574084" status: 202 len: 0 microversion: 2.1 time: 0.030508 Nov 02 13:58:53.889942 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3678/6979] 10.222.0.113 () {58 vars in 1283 bytes} [Wed Nov 2 13:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-26574084 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:58:53.923734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1bdc429f-8372-4604-b69f-35deecf22693 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'create', calling method: .version_select at 0x7fe787cc0430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1054902477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkkwt8F99eEeB4XQOFof8v0DADSSZo7o6zjRQSssy/6h0yktdWMIxM8n6nVbooktDrcKccTxYZHCuy2By4TiqaANus87RVh+1cyuKMwwCHC2AluQM6z9cZJNoJG9t7wgw=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:58:53.941976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1bdc429f-8372-4604-b69f-35deecf22693 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for project bc97329dcfb8453795347d9e818d9d92. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:58:53.948521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1bdc429f-8372-4604-b69f-35deecf22693 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for user 41c7ca068dba4093880183ae9b2f0935 and project bc97329dcfb8453795347d9e818d9d92. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:58:53.974273 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1bdc429f-8372-4604-b69f-35deecf22693 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055412 Nov 02 13:58:53.974879 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3302/6980] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:58:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:00.317692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:00.325302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-286248327", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "5800bb16-c83f-4178-aa7f-2e1e42dae981"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1054902477", "security_groups": [{"name": "tempest-secgroup-smoke-1858905242"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:00.453559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] validate_networks() for [('5800bb16-c83f-4178-aa7f-2e1e42dae981', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:59:00.910702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:59:00.911160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:59:00.911653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:59:00.912070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:59:00.912484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:59:00.922205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:00.922629 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:00.923104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:00.923878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:00.924340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:00.924782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:00.944170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for project bc97329dcfb8453795347d9e818d9d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:59:00.950945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Getting quotas for user 41c7ca068dba4093880183ae9b2f0935 and project bc97329dcfb8453795347d9e818d9d92. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:59:00.964427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:59:00.967515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:59:01.017077 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edacc9ad-95a9-4632-a0c6-581ce5241fdf tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.707498 Nov 02 13:59:01.018299 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3679/6981] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:59:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:59:01.029161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=31 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:01.032750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-26bbfc82-2772-4a5e-b742-e07e694d37b9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:01.033377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-26bbfc82-2772-4a5e-b742-e07e694d37b9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:01.109834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26bbfc82-2772-4a5e-b742-e07e694d37b9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:01.120345 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-26bbfc82-2772-4a5e-b742-e07e694d37b9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1270 microversion: 2.1 time: 0.094343 Nov 02 13:59:01.130613 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3303/6982] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:01 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:02.147653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:02.148283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:02.156567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:02.157054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:02.157496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:02.158430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:02.159068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:02.159398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:02.244691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:02.256603 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a324c6f2-c5bc-4492-ac07-c3b3548a6607 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1322 microversion: 2.1 time: 0.115018 Nov 02 13:59:02.282666 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3680/6983] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:02 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:03.283441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:03.284644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:03.290913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:03.297208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:03.297706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:03.298145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:03.298883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:03.299365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:03.299794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:03.454143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:03.462331 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a5305d1c-ca42-48ed-b85c-d6c11575aa3c tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1396 microversion: 2.1 time: 0.182871 Nov 02 13:59:03.463318 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3304/6984] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:03 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1396 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:03.813441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-33d64e96-b542-4074-b008-b1db6cb65061 req-bf90847f-6530-4155-b153-9da172d2c97c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8da643-c250-4099-ad6f-d04e80aaf985", "tag": "ab6b496b-ecfa-42e7-9ca7-a746a47ef081"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:03.825016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-33d64e96-b542-4074-b008-b1db6cb65061 req-bf90847f-6530-4155-b153-9da172d2c97c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:03.825646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-33d64e96-b542-4074-b008-b1db6cb65061 req-bf90847f-6530-4155-b153-9da172d2c97c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:03.826209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-33d64e96-b542-4074-b008-b1db6cb65061 req-bf90847f-6530-4155-b153-9da172d2c97c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:03.838616 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-33d64e96-b542-4074-b008-b1db6cb65061 req-bf90847f-6530-4155-b153-9da172d2c97c service nova] Creating event network-changed:ab6b496b-ecfa-42e7-9ca7-a746a47ef081 for instance 9a8da643-c250-4099-ad6f-d04e80aaf985 on n-h2-858384-19 Nov 02 13:59:03.843734 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-33d64e96-b542-4074-b008-b1db6cb65061 req-bf90847f-6530-4155-b153-9da172d2c97c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036056 Nov 02 13:59:03.844452 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3681/6985] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:59:04.486714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:04.487352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:04.494255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:04.494737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:04.495243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:04.496099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:04.496582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:04.497019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:04.642079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:04.649775 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-336f69ff-fc42-4894-af89-16fecce7328e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1396 microversion: 2.1 time: 0.167275 Nov 02 13:59:04.650366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3305/6986] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:04 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:05.678893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:05.679638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:05.686681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:05.687273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:05.687728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:05.688455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:05.688920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:05.689361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:05.829978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:05.837801 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b1e06412-c520-4ed3-aacf-30132725a0f8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1396 microversion: 2.1 time: 0.166595 Nov 02 13:59:05.838384 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3682/6987] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:05 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1396 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:06.862994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:06.863628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:06.870384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:06.871523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:06.872211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:06.872920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:06.873378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:06.873809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:07.012160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:07.020325 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ac63b5e-cec6-4f16-9e89-d6869b4e1800 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1396 microversion: 2.1 time: 0.161543 Nov 02 13:59:07.020905 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3306/6988] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:06 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:08.044073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:08.045358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:08.052349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:08.052842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:08.053293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:08.054003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:08.054475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:08.054917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:08.194422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:08.202882 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-271c2376-8055-4567-aafb-b33566223c0e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1396 microversion: 2.1 time: 0.162795 Nov 02 13:59:08.203488 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3683/6989] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:08 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:09.225911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:09.226528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:09.233513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:09.233991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:09.234432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:09.235146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:09.235608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:09.236295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:09.371671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:09.380102 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b74361e1-56ad-46aa-9c76-ef772b8d8cd1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1396 microversion: 2.1 time: 0.158192 Nov 02 13:59:09.380683 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3307/6990] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:09 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:10.328232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ae02f43b-06b0-4fec-a6e7-c78d86e125c5 req-9c022b4d-e62a-4241-b0a4-059be4de9937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8da643-c250-4099-ad6f-d04e80aaf985", "name": "network-vif-plugged", "status": "completed", "tag": "ab6b496b-ecfa-42e7-9ca7-a746a47ef081"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:10.335429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:10.342896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ae02f43b-06b0-4fec-a6e7-c78d86e125c5 req-9c022b4d-e62a-4241-b0a4-059be4de9937 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:10.344009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ae02f43b-06b0-4fec-a6e7-c78d86e125c5 req-9c022b4d-e62a-4241-b0a4-059be4de9937 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:10.344491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ae02f43b-06b0-4fec-a6e7-c78d86e125c5 req-9c022b4d-e62a-4241-b0a4-059be4de9937 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:10.358888 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ae02f43b-06b0-4fec-a6e7-c78d86e125c5 req-9c022b4d-e62a-4241-b0a4-059be4de9937 service nova] Creating event network-vif-plugged:ab6b496b-ecfa-42e7-9ca7-a746a47ef081 for instance 9a8da643-c250-4099-ad6f-d04e80aaf985 on n-h2-858384-19 Nov 02 13:59:10.364684 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ae02f43b-06b0-4fec-a6e7-c78d86e125c5 req-9c022b4d-e62a-4241-b0a4-059be4de9937 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040350 Nov 02 13:59:10.365922 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3684/6991] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:59:10.407968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:10.408545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:10.421578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:10.422083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:10.422849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:10.426850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:10.427406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:10.427864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:10.597986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:10.606233 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-88245eaf-93e3-4d23-8c1c-209ca8b2e217 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1396 microversion: 2.1 time: 0.206520 Nov 02 13:59:10.606826 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3308/6992] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:10 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1396 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:11.621548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:11.622813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:11.628583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:11.629525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:11.630204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:11.630843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:11.632861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:11.633565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.634170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.634670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.635488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.635980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.636400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.646413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.646833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.647309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.648023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.648480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.648907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.668218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:59:11.787566 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-319c712f-214b-448c-9ac5-95d74a3121b7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 204 len: 0 microversion: 2.1 time: 0.170473 Nov 02 13:59:11.789660 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3685/6993] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:59:11 2022] DELETE /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:59:11.803404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:11.804686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:11.818284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.818945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.819533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.820369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:11.821883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:11.822504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:11.839285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:11.850913 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7c6f635-c89b-49bd-a82b-0d6cc68ae89a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1396 microversion: 2.1 time: 0.224860 Nov 02 13:59:11.852457 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3309/6994] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:11 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1396 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:59:11.990522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:12.002545 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a3d5c83d-90bf-47ee-982f-e39e0a03072d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1558 microversion: 2.1 time: 0.206632 Nov 02 13:59:12.003534 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3686/6995] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:11 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1558 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:12.879838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:12.880563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:12.887607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:12.888437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:12.889093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:12.890011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:12.890646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:12.891076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:13.027206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:13.027840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:13.036038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:13.044914 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-11743e6a-344d-4e8f-a89a-bdf9f557c7f9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1396 microversion: 2.1 time: 0.168469 Nov 02 13:59:13.045965 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3310/6996] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:12 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1396 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:13.049316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:13.049818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:13.050268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:13.051023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:13.051514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:13.051954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:13.191165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:13.198961 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6bcb103f-df3e-4f09-b90d-a63bc44b3478 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1558 microversion: 2.1 time: 0.176636 Nov 02 13:59:13.199561 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3687/6997] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:13 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:14.069686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.070506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:14.077877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.078367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.078810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.079764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.080225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.080665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.161345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5aae82ec-a72a-4686-971b-8071afbbd663 req-acccef67-d62f-44bc-baa9-5cada45cc4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0efe851-fbfd-4b1e-a30c-a63b88473bdc", "name": "network-vif-deleted", "tag": "6e9d0e41-981b-4989-9e5d-3d9155e3620f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:14.172949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5aae82ec-a72a-4686-971b-8071afbbd663 req-acccef67-d62f-44bc-baa9-5cada45cc4d7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.173439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5aae82ec-a72a-4686-971b-8071afbbd663 req-acccef67-d62f-44bc-baa9-5cada45cc4d7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.173876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5aae82ec-a72a-4686-971b-8071afbbd663 req-acccef67-d62f-44bc-baa9-5cada45cc4d7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.186736 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5aae82ec-a72a-4686-971b-8071afbbd663 req-acccef67-d62f-44bc-baa9-5cada45cc4d7 service nova] Creating event network-vif-deleted:6e9d0e41-981b-4989-9e5d-3d9155e3620f for instance d0efe851-fbfd-4b1e-a30c-a63b88473bdc on n-h2-858384-19 Nov 02 13:59:14.191947 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5aae82ec-a72a-4686-971b-8071afbbd663 req-acccef67-d62f-44bc-baa9-5cada45cc4d7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034384 Nov 02 13:59:14.192924 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3688/6998] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:59:14.224374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.225092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:14.234235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:14.234511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.234858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.235458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.236736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.238035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.238739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.243376 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f93f8828-591c-4811-b175-20661de2ef06 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1569 microversion: 2.1 time: 0.177587 Nov 02 13:59:14.259348 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3311/6999] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:14 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:14.275184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:14.275810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:14.282505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.282992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.283479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.284045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.284199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:14.284623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.284760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:14.285054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.285190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:14.285527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lazy-loading 'fault' on Instance uuid d0efe851-fbfd-4b1e-a30c-a63b88473bdc {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:59:14.336890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:14.345998 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1c1b4bb-4d37-421f-aebd-ff875dd7f2aa tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 200 len: 1343 microversion: 2.1 time: 0.125942 Nov 02 13:59:14.346613 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3689/7000] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:14 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 1343 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:14.434763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:14.449476 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad8ce302-30dd-48dd-b7b4-014ab6bf40d2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1569 microversion: 2.1 time: 0.184168 Nov 02 13:59:14.450076 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3312/7001] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:14 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:59:15.369958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:15.370587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: d0efe851-fbfd-4b1e-a30c-a63b88473bdc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:15.378210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.378705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.379230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.379915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:15.380382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:15.380824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:15.395543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] HTTP exception thrown: Instance d0efe851-fbfd-4b1e-a30c-a63b88473bdc could not be found. Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Request method failure captured: Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc HTTP/1.1 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYncHFCtwhNQPULlNVn22EYZRvFAg9WAEhFHAbDljX3RfGlejoL3jwUwUbsqwuTb3h72sA3vTZ08qbfp6yGkxvp7tECHViWsPfsinn3Xp9AiamNJDX9W_zJSH2Q8dwTGlWhWm3Tw1u5lLjtOe3Y-5RDKaKEUy7EC9XotC3_DwoBrpmi8 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2d6338ff20b64e7d93b047f5d9b080d5 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestNetworkBasicOps-581340483 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestNetworkBasicOps-581340483 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2d6338ff20b64e7d93b047f5d9b080d5 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestNetworkBasicOps-581340483 Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestNetworkBasicOps-581340483-project Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 38735cc248a746789a1f357eab74620b Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestNetworkBasicOps-581340483-project Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance d0efe851-fbfd-4b1e-a30c-a63b88473bdc could not be found. Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'd0efe851-fbfd-4b1e-a30c-a63b88473bdc'} Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0efe851-fbfd-4b1e-a30c-a63b88473bdc could not be found. Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0efe851-fbfd-4b1e-a30c-a63b88473bdc could not be found. Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:15.397240 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0efe851-fbfd-4b1e-a30c-a63b88473bdc could not be found. Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Returning 404 to user: Instance d0efe851-fbfd-4b1e-a30c-a63b88473bdc could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce89cecf-1ba1-45e7-b029-2d5d7c1c9990 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc" status: 404 len: 111 microversion: 2.1 time: 0.032722 Nov 02 13:59:15.402104 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3690/7002] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:15 2022] GET /compute/v2.1/servers/d0efe851-fbfd-4b1e-a30c-a63b88473bdc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:59:15.576682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2cf971d1-3dd1-4814-912f-d707b412be70 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '.version_select at 0x7fe787c131f0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:15.601205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2cf971d1-3dd1-4814-912f-d707b412be70 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1445997677" status: 202 len: 0 microversion: 2.1 time: 0.029585 Nov 02 13:59:15.602175 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3313/7003] 10.222.0.113 () {58 vars in 1262 bytes} [Wed Nov 2 13:59:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1445997677 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:59:16.132912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:16.133789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:16.140984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.141473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.142113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.142834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.143325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.143771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.240534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-98788339-85c0-41f3-bcb2-4c0c6858e1be req-32542b21-3b5f-4b1e-aaee-7144636fd9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8da643-c250-4099-ad6f-d04e80aaf985", "tag": "ab6b496b-ecfa-42e7-9ca7-a746a47ef081"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:16.259871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-98788339-85c0-41f3-bcb2-4c0c6858e1be req-32542b21-3b5f-4b1e-aaee-7144636fd9bc service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:16.260658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-98788339-85c0-41f3-bcb2-4c0c6858e1be req-32542b21-3b5f-4b1e-aaee-7144636fd9bc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:16.261420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-98788339-85c0-41f3-bcb2-4c0c6858e1be req-32542b21-3b5f-4b1e-aaee-7144636fd9bc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:16.279726 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-98788339-85c0-41f3-bcb2-4c0c6858e1be req-32542b21-3b5f-4b1e-aaee-7144636fd9bc service nova] Creating event network-changed:ab6b496b-ecfa-42e7-9ca7-a746a47ef081 for instance 9a8da643-c250-4099-ad6f-d04e80aaf985 on n-h2-858384-19 Nov 02 13:59:16.295244 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-98788339-85c0-41f3-bcb2-4c0c6858e1be req-32542b21-3b5f-4b1e-aaee-7144636fd9bc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067050 Nov 02 13:59:16.296427 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3314/7004] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:16.403195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:16.421912 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69e44871-0d63-47fd-ab02-efa4d1acd74f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1569 microversion: 2.1 time: 0.292613 Nov 02 13:59:16.422924 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3691/7005] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:16 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1569 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:17.582957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:17.583659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:17.588763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0813174c-ed67-4669-8021-cf89ef516727 req-14244d2a-6401-4757-9ea8-ed19bd212975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a5e774-72de-448e-b2b7-153f201ff5c2", "tag": "41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:17.592487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.593267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.593940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.594945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.595708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.596401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.612465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0813174c-ed67-4669-8021-cf89ef516727 req-14244d2a-6401-4757-9ea8-ed19bd212975 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.613310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0813174c-ed67-4669-8021-cf89ef516727 req-14244d2a-6401-4757-9ea8-ed19bd212975 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.615815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0813174c-ed67-4669-8021-cf89ef516727 req-14244d2a-6401-4757-9ea8-ed19bd212975 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.627831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:59:17.643809 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0813174c-ed67-4669-8021-cf89ef516727 req-14244d2a-6401-4757-9ea8-ed19bd212975 service nova] Creating event network-changed:41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae for instance a1a5e774-72de-448e-b2b7-153f201ff5c2 on n-h2-858384-19 Nov 02 13:59:17.654066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0813174c-ed67-4669-8021-cf89ef516727 req-14244d2a-6401-4757-9ea8-ed19bd212975 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068703 Nov 02 13:59:17.657669 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3692/7006] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:17.737594 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9c2fcd4d-a39e-42a0-9bf8-8533790484fe tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 204 len: 0 microversion: 2.1 time: 0.160436 Nov 02 13:59:17.738877 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3315/7007] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 13:59:17 2022] DELETE /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:59:17.748685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:17.752277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:17.759857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.760529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.760831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.761551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:17.762004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:17.762431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:17.902750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:17.912214 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c672cee-754d-414e-8869-f2f90262494b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1675 microversion: 2.1 time: 0.167986 Nov 02 13:59:17.912720 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3693/7008] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:17 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:18.938900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:18.939642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:18.946514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:18.946999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:18.947469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:18.948174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:18.949125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:18.949565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:19.089328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:19.097391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed0bb43e-9da2-4de6-8fd6-3c96cb74036b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1675 microversion: 2.1 time: 0.163968 Nov 02 13:59:19.098463 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3316/7009] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:18 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:19.804062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e8d7a660-3301-4492-bf0f-b63a252bc1b6 req-609d0616-50ac-4610-84f6-bedc2cbb5124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a5e774-72de-448e-b2b7-153f201ff5c2", "name": "network-vif-deleted", "tag": "41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:19.815625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e8d7a660-3301-4492-bf0f-b63a252bc1b6 req-609d0616-50ac-4610-84f6-bedc2cbb5124 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:19.816104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e8d7a660-3301-4492-bf0f-b63a252bc1b6 req-609d0616-50ac-4610-84f6-bedc2cbb5124 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:19.816534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e8d7a660-3301-4492-bf0f-b63a252bc1b6 req-609d0616-50ac-4610-84f6-bedc2cbb5124 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:19.829439 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e8d7a660-3301-4492-bf0f-b63a252bc1b6 req-609d0616-50ac-4610-84f6-bedc2cbb5124 service nova] Creating event network-vif-deleted:41e0cd58-eb71-4a8c-a5d0-d4e4a08368ae for instance a1a5e774-72de-448e-b2b7-153f201ff5c2 on n-h2-858384-19 Nov 02 13:59:19.834490 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e8d7a660-3301-4492-bf0f-b63a252bc1b6 req-609d0616-50ac-4610-84f6-bedc2cbb5124 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 Nov 02 13:59:19.835269 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3694/7010] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:20.122175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:20.123509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:20.130494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:20.130979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:20.131477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:20.132185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:20.132638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:20.133066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:20.168886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:20.169870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:20.170314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:20.170764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lazy-loading 'fault' on Instance uuid a1a5e774-72de-448e-b2b7-153f201ff5c2 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:59:20.217256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:20.225489 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c2031c2c-d47b-43db-ba6f-c2238d092806 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 200 len: 1342 microversion: 2.1 time: 0.107384 Nov 02 13:59:20.226085 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3317/7011] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:20 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 1342 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:21.252033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:21.252777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: a1a5e774-72de-448e-b2b7-153f201ff5c2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:21.259076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:21.259602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:21.260065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:21.260769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:21.261226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:21.261662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:21.277939 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] HTTP exception thrown: Instance a1a5e774-72de-448e-b2b7-153f201ff5c2 could not be found. Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Request method failure captured: Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 HTTP/1.1 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYncHFCtwhNQPULlNVn22EYZRvFAg9WAEhFHAbDljX3RfGlejoL3jwUwUbsqwuTb3h72sA3vTZ08qbfp6yGkxvp7tECHViWsPfsinn3Xp9AiamNJDX9W_zJSH2Q8dwTGlWhWm3Tw1u5lLjtOe3Y-5RDKaKEUy7EC9XotC3_DwoBrpmi8 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2d6338ff20b64e7d93b047f5d9b080d5 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestNetworkBasicOps-581340483 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestNetworkBasicOps-581340483 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2d6338ff20b64e7d93b047f5d9b080d5 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestNetworkBasicOps-581340483 Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestNetworkBasicOps-581340483-project Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 38735cc248a746789a1f357eab74620b Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestNetworkBasicOps-581340483-project Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance a1a5e774-72de-448e-b2b7-153f201ff5c2 could not be found. Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a1a5e774-72de-448e-b2b7-153f201ff5c2'} Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1a5e774-72de-448e-b2b7-153f201ff5c2 could not be found. Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1a5e774-72de-448e-b2b7-153f201ff5c2 could not be found. Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:21.280365 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1a5e774-72de-448e-b2b7-153f201ff5c2 could not be found. Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Returning 404 to user: Instance a1a5e774-72de-448e-b2b7-153f201ff5c2 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e4447ec4-2d4e-4e1d-8f6e-242cb0385679 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2" status: 404 len: 111 microversion: 2.1 time: 0.035665 Nov 02 13:59:21.285656 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3695/7012] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:21 2022] GET /compute/v2.1/servers/a1a5e774-72de-448e-b2b7-153f201ff5c2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:59:21.453226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5dc072b7-8237-4dff-b4ce-90568113bc2f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '.version_select at 0x7fe787cc0430>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:21.481237 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5dc072b7-8237-4dff-b4ce-90568113bc2f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-111645433" status: 202 len: 0 microversion: 2.1 time: 0.037127 Nov 02 13:59:21.482642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3318/7013] 10.222.0.113 () {58 vars in 1259 bytes} [Wed Nov 2 13:59:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-111645433 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:59:21.876466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-161b1773-6688-40d3-8ee7-b001f6f25972 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:21.878759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-161b1773-6688-40d3-8ee7-b001f6f25972 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:21.885116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-161b1773-6688-40d3-8ee7-b001f6f25972 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:21.885607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-161b1773-6688-40d3-8ee7-b001f6f25972 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:21.886054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-161b1773-6688-40d3-8ee7-b001f6f25972 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:21.886759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-161b1773-6688-40d3-8ee7-b001f6f25972 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:21.887241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-161b1773-6688-40d3-8ee7-b001f6f25972 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:21.887678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-161b1773-6688-40d3-8ee7-b001f6f25972 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:21.919737 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-161b1773-6688-40d3-8ee7-b001f6f25972 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047657 Nov 02 13:59:21.920566 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3696/7014] 10.222.0.113 () {60 vars in 1348 bytes} [Wed Nov 2 13:59:21 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:21.992877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:21.993380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:22.000787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:22.001284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:22.001726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:22.002497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:22.002957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:22.003414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:22.029830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:59:22.080481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:22.118065 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-60f4a14f-fad0-4d60-b1d3-ca04ff806c10 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "DELETE /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 204 len: 0 microversion: 2.20 time: 0.129256 Nov 02 13:59:22.120169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3319/7015] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:59:21 2022] DELETE /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:59:22.130950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:22.131611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:22.138826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:22.139398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:22.139895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:22.140612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:22.141066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:22.141496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:22.280897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:22.289274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:22.290783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:22.292005 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a3c31f9b-3df3-4c17-86c9-be47a459fd49 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.165823 Nov 02 13:59:22.292578 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3697/7016] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:59:22 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:59:23.321151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:23.323277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:23.331517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:23.332302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:23.332923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:23.333801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:23.334415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:23.335224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:23.618569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:23.630037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:23.631149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:23.632529 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-11b5c246-9c88-4ef1-89ff-3e370a97edb9 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.315711 Nov 02 13:59:23.647813 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3320/7017] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:59:23 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:59:24.660087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:24.661326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:24.677273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:24.677774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:24.678226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:24.678952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:24.679446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:24.679879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:25.010916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:25.024400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:25.037436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:25.039183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:25.040626 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-352ea650-f679-4dbe-97e5-5aa41460907e tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1726 microversion: 2.20 time: 0.384585 Nov 02 13:59:25.042710 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3698/7018] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:59:24 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1726 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 13:59:26.067044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:26.067674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:26.076907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-70dc77c3-9877-43d2-81dc-8225d77b51ca req-c38f5661-eccc-477c-bc11-107f18ed2659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71e8f9b9-7973-4381-8851-1b919f953487", "name": "network-vif-deleted", "tag": "339d808c-dd60-4ec3-9279-d5c8b8c51695"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:26.084671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:26.085717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:26.086315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:26.087582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:26.088497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:26.089187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:26.101301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-70dc77c3-9877-43d2-81dc-8225d77b51ca req-c38f5661-eccc-477c-bc11-107f18ed2659 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:26.102127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-70dc77c3-9877-43d2-81dc-8225d77b51ca req-c38f5661-eccc-477c-bc11-107f18ed2659 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:26.103447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-70dc77c3-9877-43d2-81dc-8225d77b51ca req-c38f5661-eccc-477c-bc11-107f18ed2659 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:26.124965 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-70dc77c3-9877-43d2-81dc-8225d77b51ca req-c38f5661-eccc-477c-bc11-107f18ed2659 service nova] Creating event network-vif-deleted:339d808c-dd60-4ec3-9279-d5c8b8c51695 for instance 71e8f9b9-7973-4381-8851-1b919f953487 on n-h1-858384-19 Nov 02 13:59:26.131475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-70dc77c3-9877-43d2-81dc-8225d77b51ca req-c38f5661-eccc-477c-bc11-107f18ed2659 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059177 Nov 02 13:59:26.132915 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3699/7019] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:26.194175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:26.205364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:26.206968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f93c7bf631b045809ba606910497a3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd20cf58421e4143937dc67313b226f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:26.208312 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-08ac0385-67c6-4478-b392-e12a7338197c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 200 len: 1658 microversion: 2.20 time: 0.145233 Nov 02 13:59:26.209022 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3321/7020] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:59:26 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 1658 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 13:59:27.236717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:27.237443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:27.245776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:27.245776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:27.246106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:27.246769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:27.248247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:27.249052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:27.267227 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] HTTP exception thrown: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Request method failure captured: Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 HTTP/1.1 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnW9L6a0Mso0_swLwiXid2NZ5pW2Ib2jpdbUNxgScoEl2cQYqZouBDUoZd6ll8wKwad3DSyPsjUpSlebeTxLveUDVW6dJmIaTiH-tVEZVHlnsImITWDme3aWp_8qUq3yuxkjexiHFFyP97WqpiTAsOUg-e--fpwFtW40XK1_0-8yX_I Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd20cf58421e4143937dc67313b226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f93c7bf631b045809ba606910497a3b5 Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '71e8f9b9-7973-4381-8851-1b919f953487'} Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:27.269099 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Returning 404 to user: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-81c31e7b-1a83-47af-a0de-c9cce04c18a5 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 404 len: 111 microversion: 2.20 time: 0.039328 Nov 02 13:59:27.273518 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3700/7021] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:59:27 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:59:27.279623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff43bcb8-2b6a-4522-aeb4-e9ee571b91f7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '.version_select at 0x7fe78675c820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:27.301678 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff43bcb8-2b6a-4522-aeb4-e9ee571b91f7 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-408581039" status: 204 len: 0 microversion: 2.20 time: 0.025947 Nov 02 13:59:27.302398 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3322/7022] 10.222.0.113 () {60 vars in 1264 bytes} [Wed Nov 2 13:59:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-408581039 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 13:59:31.324608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:31.325120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:31.339323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:31.339817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:31.340261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:31.341545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:31.342042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:31.342553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:31.365729 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] HTTP exception thrown: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Request method failure captured: Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 HTTP/1.1 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnW9L6a0Mso0_swLwiXid2NZ5pW2Ib2jpdbUNxgScoEl2cQYqZouBDUoZd6ll8wKwad3DSyPsjUpSlebeTxLveUDVW6dJmIaTiH-tVEZVHlnsImITWDme3aWp_8qUq3yuxkjexiHFFyP97WqpiTAsOUg-e--fpwFtW40XK1_0-8yX_I Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd20cf58421e4143937dc67313b226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f93c7bf631b045809ba606910497a3b5 Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '71e8f9b9-7973-4381-8851-1b919f953487'} Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:31.367646 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.372031 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.378136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Returning 404 to user: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:31.379717 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f48ffe1-ea7e-4742-a840-c2d6521376ce tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "DELETE /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 404 len: 111 microversion: 2.20 time: 0.059782 Nov 02 13:59:31.380897 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3701/7023] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:59:31 2022] DELETE /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:59:31.390769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:31.391740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 71e8f9b9-7973-4381-8851-1b919f953487] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:31.399614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:31.400218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:31.400972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:31.403327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:31.404324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:31.404774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:31.429999 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] HTTP exception thrown: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Request method failure captured: Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 HTTP/1.1 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnW9L6a0Mso0_swLwiXid2NZ5pW2Ib2jpdbUNxgScoEl2cQYqZouBDUoZd6ll8wKwad3DSyPsjUpSlebeTxLveUDVW6dJmIaTiH-tVEZVHlnsImITWDme3aWp_8qUq3yuxkjexiHFFyP97WqpiTAsOUg-e--fpwFtW40XK1_0-8yX_I Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd20cf58421e4143937dc67313b226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f93c7bf631b045809ba606910497a3b5 Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '71e8f9b9-7973-4381-8851-1b919f953487'} Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.431745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Returning 404 to user: Instance 71e8f9b9-7973-4381-8851-1b919f953487 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1052d42b-c131-4ea5-8e94-74d17235ac9d tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487" status: 404 len: 111 microversion: 2.20 time: 0.048757 Nov 02 13:59:31.436655 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3323/7024] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:59:31 2022] GET /compute/v2.1/servers/71e8f9b9-7973-4381-8851-1b919f953487 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:59:31.517439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8eff76e2-4cbb-49cb-8cd1-156a1079e851 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Action: 'create', calling method: .version_select at 0x7fe78f89a0d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-963173949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmVD99TqXVHaFD6jKUMTTlYZuwmWOIWEV87p7N3VM8rTHHeHLIGjvpL2JaKSee58D5Cc1B8xtBVcUqA8S0/RfQEHcSPMSYR/3Et2OWucGuejlU7V4PBTIRCUY6ILh5dmQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:31.547228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8eff76e2-4cbb-49cb-8cd1-156a1079e851 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:59:31.571591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-8eff76e2-4cbb-49cb-8cd1-156a1079e851 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for user 38735cc248a746789a1f357eab74620b and project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:59:31.630838 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8eff76e2-4cbb-49cb-8cd1-156a1079e851 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.121802 Nov 02 13:59:31.631501 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3702/7025] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 13:59:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:33.032844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-832690508", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "e7415eb3-4d2b-496e-9c5a-cad9bae470d3"}], "key_name": "tempest-TestNetworkBasicOps-963173949", "security_groups": [{"name": "tempest-secgroup-smoke-2025095199"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:33.164353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] validate_networks() for [('e7415eb3-4d2b-496e-9c5a-cad9bae470d3', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:59:33.488701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:33.744981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:59:33.745496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:59:33.746070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:59:33.746543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:59:33.747038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:59:33.757203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:33.757684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:33.758119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:33.758841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:33.759403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:33.759744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:33.784105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:59:33.793158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Getting quotas for user 38735cc248a746789a1f357eab74620b and project 2d6338ff20b64e7d93b047f5d9b080d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:59:33.811625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:59:33.814096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:59:33.868289 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bf705bc2-f5e7-4434-b77b-cfc60327c597 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.840037 Nov 02 13:59:33.869715 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3324/7026] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 13:59:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 13:59:33.882999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-60a60e98-07db-4ce2-9288-49fccd934fbb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:33.883773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-60a60e98-07db-4ce2-9288-49fccd934fbb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:33.948800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-60a60e98-07db-4ce2-9288-49fccd934fbb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:33.956410 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-60a60e98-07db-4ce2-9288-49fccd934fbb tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1251 microversion: 2.1 time: 0.079422 Nov 02 13:59:33.957816 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3703/7027] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:33 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1251 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:34.820181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:34.820666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:34.830162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.830659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.831379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:34.832776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.833415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.834643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:34.864901 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] HTTP exception thrown: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Request method failure captured: Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 HTTP/1.1 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnW9L6a0Mso0_swLwiXid2NZ5pW2Ib2jpdbUNxgScoEl2cQYqZouBDUoZd6ll8wKwad3DSyPsjUpSlebeTxLveUDVW6dJmIaTiH-tVEZVHlnsImITWDme3aWp_8qUq3yuxkjexiHFFyP97WqpiTAsOUg-e--fpwFtW40XK1_0-8yX_I Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd20cf58421e4143937dc67313b226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f93c7bf631b045809ba606910497a3b5 Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '2faf26b2-214b-40c4-b5c2-81cf8524b8e7'} Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:34.866870 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Returning 404 to user: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-388985f7-4f0a-410b-8d45-b333400db426 tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 404 len: 111 microversion: 2.20 time: 0.052345 Nov 02 13:59:34.877745 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3325/7028] 10.222.0.113 () {60 vars in 1285 bytes} [Wed Nov 2 13:59:34 2022] DELETE /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 13:59:34.881240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:34.881240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] [instance: 2faf26b2-214b-40c4-b5c2-81cf8524b8e7] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:34.888497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.889571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.889977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:34.890710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.891516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.893289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:34.907602 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] HTTP exception thrown: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Request method failure captured: Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 HTTP/1.1 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnW9L6a0Mso0_swLwiXid2NZ5pW2Ib2jpdbUNxgScoEl2cQYqZouBDUoZd6ll8wKwad3DSyPsjUpSlebeTxLveUDVW6dJmIaTiH-tVEZVHlnsImITWDme3aWp_8qUq3yuxkjexiHFFyP97WqpiTAsOUg-e--fpwFtW40XK1_0-8yX_I Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cd20cf58421e4143937dc67313b226f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cd20cf58421e4143937dc67313b226f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cd20cf58421e4143937dc67313b226f8 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1958836041 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f93c7bf631b045809ba606910497a3b5 Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1958836041-project Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '2faf26b2-214b-40c4-b5c2-81cf8524b8e7'} Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.909517 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] Returning 404 to user: Instance 2faf26b2-214b-40c4-b5c2-81cf8524b8e7 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:59:34.914886 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10e47936-4ead-41cd-9fa5-fcf50118ab2c tempest-AttachVolumeShelveTestJSON-1958836041 tempest-AttachVolumeShelveTestJSON-1958836041-project] 10.222.0.113 "GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7" status: 404 len: 111 microversion: 2.20 time: 0.037178 Nov 02 13:59:34.919394 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3704/7029] 10.222.0.113 () {60 vars in 1282 bytes} [Wed Nov 2 13:59:34 2022] GET /compute/v2.1/servers/2faf26b2-214b-40c4-b5c2-81cf8524b8e7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 13:59:34.983540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:34.984459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:34.991982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.992819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.993440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:34.994402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:34.994863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:34.995323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:35.087105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:35.097913 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8a72e4ed-2611-469c-abc0-f5a42ca004b4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1303 microversion: 2.1 time: 0.118365 Nov 02 13:59:35.098792 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3326/7030] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:34 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:36.127099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:36.127801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:36.134602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:36.135089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:36.135577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:36.136292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:36.136748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:36.137178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:36.207491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:36.215309 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b563c762-2a7d-40bc-8505-1614b77a1225 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1309 microversion: 2.1 time: 0.093237 Nov 02 13:59:36.216471 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3705/7031] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:36 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:37.241165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:37.242229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:37.253410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:37.253777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:37.254344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:37.255244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:37.257595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:37.258041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:37.656430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:37.666335 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-661e7be3-1af2-419f-96d2-516cf8c1320b tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1377 microversion: 2.1 time: 0.430965 Nov 02 13:59:37.667666 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3327/7032] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:37 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1377 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:38.393784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-808bd37b-b3f4-4f86-93c4-a2263c0dd1dc req-c292be3a-d009-4119-8764-417e597e352b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f901bcf-cd7c-4592-b7da-3ec2379236c9", "tag": "b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:38.412595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-808bd37b-b3f4-4f86-93c4-a2263c0dd1dc req-c292be3a-d009-4119-8764-417e597e352b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:38.413477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-808bd37b-b3f4-4f86-93c4-a2263c0dd1dc req-c292be3a-d009-4119-8764-417e597e352b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:38.414143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-808bd37b-b3f4-4f86-93c4-a2263c0dd1dc req-c292be3a-d009-4119-8764-417e597e352b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:38.430827 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-808bd37b-b3f4-4f86-93c4-a2263c0dd1dc req-c292be3a-d009-4119-8764-417e597e352b service nova] Creating event network-changed:b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2 for instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 on n-h1-858384-19 Nov 02 13:59:38.438692 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-808bd37b-b3f4-4f86-93c4-a2263c0dd1dc req-c292be3a-d009-4119-8764-417e597e352b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049570 Nov 02 13:59:38.442677 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3706/7033] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:38.694900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:38.696231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:38.709480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:38.710358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:38.710988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:38.711894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:38.712516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:38.713162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:38.957043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:38.966923 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-91af335c-15b5-4c72-97c3-f112e9d48617 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1377 microversion: 2.1 time: 0.277447 Nov 02 13:59:38.974542 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3328/7034] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:38 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1377 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:39.994933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:39.995679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:40.003363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:40.003857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:40.004305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:40.005027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:40.005486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:40.005924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:40.226138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:40.239585 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9ede94ef-a441-4883-8736-2df6dd67adcd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1377 microversion: 2.1 time: 0.252854 Nov 02 13:59:40.240383 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3707/7035] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:39 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1377 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:41.263468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:41.264720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:41.271534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:41.272017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:41.272460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:41.273165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:41.273614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:41.274108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:41.759724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:41.769997 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7f55b7c-384a-47da-8be6-68ed9552c731 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1377 microversion: 2.1 time: 0.510644 Nov 02 13:59:41.771074 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3329/7036] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:41 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1377 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:42.793916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:42.794604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:42.798526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:42.803976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:42.804501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:42.804962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:42.805661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:42.806154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:42.806587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:42.953201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:42.961183 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-99421fc7-255c-4d95-b929-12778a3a1021 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1377 microversion: 2.1 time: 0.171238 Nov 02 13:59:42.961771 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3708/7037] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:42 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1377 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:43.987703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:43.988473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:43.992743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:43.993516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:44.004911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:44.005748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:44.006441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:44.007693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:44.008221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:44.008692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:44.161663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:44.169791 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9882c6d0-880e-4eb1-8501-86514ac379c5 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1377 microversion: 2.1 time: 0.189033 Nov 02 13:59:44.171245 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3330/7038] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:43 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1377 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:45.194089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:45.194589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:45.198744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:59:45.204147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:45.204640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:45.205092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:45.205812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:45.206302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:45.206740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:45.348286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:45.357254 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e245da13-02a5-44ec-a40c-c87ba4f9ad7d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1377 microversion: 2.1 time: 0.167279 Nov 02 13:59:45.359251 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3709/7039] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:45 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1377 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:45.984077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d8e2efef-d983-41df-9aa6-a10322705235 req-d53568ec-3941-4a7a-b69a-3857c35b8c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f901bcf-cd7c-4592-b7da-3ec2379236c9", "name": "network-vif-plugged", "status": "completed", "tag": "b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:45.996865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d8e2efef-d983-41df-9aa6-a10322705235 req-d53568ec-3941-4a7a-b69a-3857c35b8c05 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:45.997442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d8e2efef-d983-41df-9aa6-a10322705235 req-d53568ec-3941-4a7a-b69a-3857c35b8c05 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:45.997942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d8e2efef-d983-41df-9aa6-a10322705235 req-d53568ec-3941-4a7a-b69a-3857c35b8c05 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:46.011909 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d8e2efef-d983-41df-9aa6-a10322705235 req-d53568ec-3941-4a7a-b69a-3857c35b8c05 service nova] Creating event network-vif-plugged:b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2 for instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 on n-h1-858384-19 Nov 02 13:59:46.017780 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d8e2efef-d983-41df-9aa6-a10322705235 req-d53568ec-3941-4a7a-b69a-3857c35b8c05 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038235 Nov 02 13:59:46.018707 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3331/7040] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:59:46.397400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:46.398555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:46.409773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:46.410753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:46.411591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:46.412859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:46.413646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:46.414348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:46.585214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:46.594803 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31117a0e-da96-4363-b675-91179751cc4f tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1377 microversion: 2.1 time: 0.204225 Nov 02 13:59:46.595457 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3710/7041] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:46 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1377 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:47.625520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:47.627558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:47.634584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:47.635089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:47.635742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:47.636821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:47.637352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:47.637852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:47.782458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:47.790686 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-00155ae6-7274-4630-bd4b-c197abb86789 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1377 microversion: 2.1 time: 0.174748 Nov 02 13:59:47.791354 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3332/7042] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:47 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1377 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:48.814753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:48.815410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:48.822424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:48.822913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:48.823460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:48.824186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:48.824630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:48.825071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:48.913715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66f0ef3f-326c-4847-8804-11ab7476c073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:48.916156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66f0ef3f-326c-4847-8804-11ab7476c073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:48.924033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f0ef3f-326c-4847-8804-11ab7476c073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:48.924534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f0ef3f-326c-4847-8804-11ab7476c073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:48.925628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f0ef3f-326c-4847-8804-11ab7476c073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:48.926356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f0ef3f-326c-4847-8804-11ab7476c073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:48.927019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f0ef3f-326c-4847-8804-11ab7476c073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:48.927649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66f0ef3f-326c-4847-8804-11ab7476c073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:48.994555 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66f0ef3f-326c-4847-8804-11ab7476c073 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985/action" status: 200 len: 24576 microversion: 2.1 time: 0.084586 Nov 02 13:59:48.995290 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3333/7043] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 13:59:48 2022] POST /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985/action => generated 24576 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 13:59:49.004896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:49.012735 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de707e96-797d-46f0-8dd9-f0bc1f9a17f4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1549 microversion: 2.1 time: 0.202415 Nov 02 13:59:49.013328 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3711/7044] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:48 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1549 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:49.037718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:49.038426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:59:49.045553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:49.045946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:49.046390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:49.047146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:49.047610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:49.048032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:49.191688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:59:49.199528 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bafc1a6e-0136-4415-9795-60d98733435d tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1549 microversion: 2.1 time: 0.166018 Nov 02 13:59:49.200114 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3334/7045] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 13:59:49 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:59:51.105607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-0be2ed81-ce09-4207-9fb7-e460cbaf8038 req-393a0ec5-e9df-46b9-b1f4-b9bc606390b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f901bcf-cd7c-4592-b7da-3ec2379236c9", "tag": "b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:59:51.124897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0be2ed81-ce09-4207-9fb7-e460cbaf8038 req-393a0ec5-e9df-46b9-b1f4-b9bc606390b4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.127130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0be2ed81-ce09-4207-9fb7-e460cbaf8038 req-393a0ec5-e9df-46b9-b1f4-b9bc606390b4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.127652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0be2ed81-ce09-4207-9fb7-e460cbaf8038 req-393a0ec5-e9df-46b9-b1f4-b9bc606390b4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.141215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Calling method '.version_select at 0x7fe78781c3a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:59:51.143209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.143806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.144371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.152317 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-0be2ed81-ce09-4207-9fb7-e460cbaf8038 req-393a0ec5-e9df-46b9-b1f4-b9bc606390b4 service nova] Creating event network-changed:b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2 for instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 on n-h1-858384-19 Nov 02 13:59:51.158629 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-0be2ed81-ce09-4207-9fb7-e460cbaf8038 req-393a0ec5-e9df-46b9-b1f4-b9bc606390b4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056932 Nov 02 13:59:51.159946 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3335/7046] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 13:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:59:51.173604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.174426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.174974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.188353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:59:51.188864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:59:51.189296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:59:51.195592 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-56226afd-7706-4efe-8922-c8040f9c9f7e tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2000698195-project-admin] 10.222.0.113 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.220030 Nov 02 13:59:51.196187 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3712/7047] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 13:59:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:03.271125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:03.272348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:03.279084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1900648825", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "b1b81b46-048f-4ba5-baaa-1041bc1f3a7e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1575436582", "security_groups": []}, "os:scheduler_hints": {"different_host": ["07ac29f6-c90f-491f-aa93-d216cef0bc2d"]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:03.398154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] validate_networks() for [('b1b81b46-048f-4ba5-baaa-1041bc1f3a7e', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:00:03.981796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:00:03.984228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:00:03.986360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:00:03.987021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:00:03.988137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:00:04.007544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:04.008913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:04.009548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:04.010493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:04.011159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:04.011905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:04.052015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Getting quotas for project 5f2a9251561845d0992c29bd528fadcc. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:00:04.063237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Getting quotas for user 603d648711a643e7adf027c3a4e3f1c0 and project 5f2a9251561845d0992c29bd528fadcc. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:00:04.092174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:00:04.095692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:00:04.187351 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d4ede5de-069b-42d6-9359-e10bea2909aa tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 363 microversion: 2.1 time: 0.917787 Nov 02 14:00:04.188600 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3336/7048] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:00:03 2022] POST /compute/v2.1/servers => generated 363 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 14:00:04.200054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-67e5ef54-a559-4c14-a45f-e3a18eefd53a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:04.202256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67e5ef54-a559-4c14-a45f-e3a18eefd53a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:04.209205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=11 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:04.210304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=52 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:04.271355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-67e5ef54-a559-4c14-a45f-e3a18eefd53a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:04.288579 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-67e5ef54-a559-4c14-a45f-e3a18eefd53a tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1246 microversion: 2.1 time: 0.092637 Nov 02 14:00:04.289764 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3713/7049] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:04 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:05.316389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:05.318840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:05.328160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:05.329231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:05.329905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:05.330978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:05.331555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:05.332216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:05.428432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:05.441107 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3780591c-f1e7-4c46-a4b0-9c870f527d9e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1242 microversion: 2.1 time: 0.130253 Nov 02 14:00:05.442678 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3337/7050] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:05 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:06.472668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:06.473306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:06.490365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:06.490874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:06.492590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:06.493296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:06.493978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:06.494606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:06.626726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:06.637072 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ff9b13d-cd2a-48ab-9bca-c795b2a08a04 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1304 microversion: 2.1 time: 0.172285 Nov 02 14:00:06.637690 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3714/7051] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:06 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:07.662129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:07.662743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:07.672078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:07.673533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:07.679441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:07.680273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:07.680869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:07.681507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:07.826922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:07.835045 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-488fceef-34c5-402a-b521-b52188a5aa82 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1304 microversion: 2.1 time: 0.177573 Nov 02 14:00:07.836185 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3338/7052] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:07 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1304 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:08.023478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b2244e27-8490-4300-b7d0-0d50d209975e req-fc2a83ed-14f8-4daa-85d3-857ab3b2e47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa4d102-eb51-494a-9541-fd4aa8822fa9", "tag": "02f0c4bf-0174-4486-b638-a177875e6aac"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:08.035541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b2244e27-8490-4300-b7d0-0d50d209975e req-fc2a83ed-14f8-4daa-85d3-857ab3b2e47a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:08.036043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b2244e27-8490-4300-b7d0-0d50d209975e req-fc2a83ed-14f8-4daa-85d3-857ab3b2e47a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:08.036485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b2244e27-8490-4300-b7d0-0d50d209975e req-fc2a83ed-14f8-4daa-85d3-857ab3b2e47a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:08.049500 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b2244e27-8490-4300-b7d0-0d50d209975e req-fc2a83ed-14f8-4daa-85d3-857ab3b2e47a service nova] Creating event network-changed:02f0c4bf-0174-4486-b638-a177875e6aac for instance 0fa4d102-eb51-494a-9541-fd4aa8822fa9 on n-h2-858384-19 Nov 02 14:00:08.055158 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b2244e27-8490-4300-b7d0-0d50d209975e req-fc2a83ed-14f8-4daa-85d3-857ab3b2e47a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036582 Nov 02 14:00:08.056062 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3715/7053] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:08.859745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:08.861609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:08.868657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:08.869142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:08.869578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:08.870333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:08.870875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:08.871587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:08.974627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:08.985027 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7c87befe-f182-4d1b-88f7-260d0f0f40ad tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1304 microversion: 2.1 time: 0.129716 Nov 02 14:00:08.985626 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3339/7054] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:08 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:10.016570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:10.017293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:10.023917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:10.024407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:10.024860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:10.025572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:10.026072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:10.026521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:10.137730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:10.148009 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f708badd-3fff-4120-b8e8-df790b847686 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1304 microversion: 2.1 time: 0.137910 Nov 02 14:00:10.158646 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3716/7055] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:10 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:11.172054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:11.172572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:11.180135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:11.180631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:11.181481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:11.181998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:11.182445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:11.183400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:11.336665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:11.350471 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bfccf8e2-15e0-4187-92a2-78a0cb8b778b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1304 microversion: 2.1 time: 0.182959 Nov 02 14:00:11.365713 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3340/7056] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:11 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:12.380578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:12.381856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:12.390902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:12.391439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:12.391882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:12.392963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:12.393431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:12.393873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:12.879695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:12.889145 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef06d52e-07fe-4ddc-9994-84a500266aa8 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1304 microversion: 2.1 time: 0.517607 Nov 02 14:00:12.889743 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3717/7057] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:12 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1304 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:13.914001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:13.914619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:13.922667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.923544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.923991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:13.924702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:13.925159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:13.925587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:14.017500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:14.026248 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8575fce9-4854-409a-b620-40c237010844 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1304 microversion: 2.1 time: 0.116297 Nov 02 14:00:14.026905 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3341/7058] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:13 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:14.589833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:14.596592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6cb7af39-7f0e-40b2-b757-948e610e4a7e req-84f3eb02-c691-44ad-a223-59720a020288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa4d102-eb51-494a-9541-fd4aa8822fa9", "name": "network-vif-plugged", "status": "completed", "tag": "02f0c4bf-0174-4486-b638-a177875e6aac"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:14.609228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6cb7af39-7f0e-40b2-b757-948e610e4a7e req-84f3eb02-c691-44ad-a223-59720a020288 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:14.609727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6cb7af39-7f0e-40b2-b757-948e610e4a7e req-84f3eb02-c691-44ad-a223-59720a020288 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:14.610382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6cb7af39-7f0e-40b2-b757-948e610e4a7e req-84f3eb02-c691-44ad-a223-59720a020288 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:14.623867 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6cb7af39-7f0e-40b2-b757-948e610e4a7e req-84f3eb02-c691-44ad-a223-59720a020288 service nova] Creating event network-vif-plugged:02f0c4bf-0174-4486-b638-a177875e6aac for instance 0fa4d102-eb51-494a-9541-fd4aa8822fa9 on n-h2-858384-19 Nov 02 14:00:14.633925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6cb7af39-7f0e-40b2-b757-948e610e4a7e req-84f3eb02-c691-44ad-a223-59720a020288 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046220 Nov 02 14:00:14.634723 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3718/7059] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:15.050449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:15.050926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:15.052754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:15.053813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:15.062836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.063489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.063878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.064602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:15.065058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:15.065492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:15.183249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:15.192517 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d286a874-0c12-4b2f-8275-f35487ef8e4c tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1304 microversion: 2.1 time: 0.146106 Nov 02 14:00:15.193291 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3342/7060] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:15 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:16.219925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:16.221351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:16.228573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.229074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.229830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.230746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.231450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.233370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.342526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:16.351471 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f8aefd7e-ec59-4bc5-b220-c421bbe9d692 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1476 microversion: 2.1 time: 0.138377 Nov 02 14:00:16.352233 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3719/7061] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:16 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1476 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:16.389095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:16.389971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:16.399961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.400718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.406049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.408314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.409133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.410939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.503401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:16.512703 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2f7f52e6-4efa-49e8-b5de-12fa22e75b65 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1476 microversion: 2.1 time: 0.138217 Nov 02 14:00:16.514139 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3343/7062] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:16 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1476 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:16.556845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d662ed6-290d-47c1-b0bb-3133d80eb864 tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:16.558042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d662ed6-290d-47c1-b0bb-3133d80eb864 tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:16.570007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d662ed6-290d-47c1-b0bb-3133d80eb864 tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.570887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d662ed6-290d-47c1-b0bb-3133d80eb864 tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.571783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d662ed6-290d-47c1-b0bb-3133d80eb864 tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.573052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d662ed6-290d-47c1-b0bb-3133d80eb864 tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.573883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d662ed6-290d-47c1-b0bb-3133d80eb864 tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.574690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d662ed6-290d-47c1-b0bb-3133d80eb864 tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.716854 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d662ed6-290d-47c1-b0bb-3133d80eb864 tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1629 microversion: 2.1 time: 0.167407 Nov 02 14:00:16.717816 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3720/7063] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:16 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1629 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:16.742040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-492a4e05-12c4-436b-8440-f35c441d431a tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:16.743163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-492a4e05-12c4-436b-8440-f35c441d431a tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:16.750487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-492a4e05-12c4-436b-8440-f35c441d431a tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.751174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-492a4e05-12c4-436b-8440-f35c441d431a tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.751750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-492a4e05-12c4-436b-8440-f35c441d431a tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.752595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-492a4e05-12c4-436b-8440-f35c441d431a tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:16.753196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-492a4e05-12c4-436b-8440-f35c441d431a tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:16.753889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-492a4e05-12c4-436b-8440-f35c441d431a tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:16.938902 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-492a4e05-12c4-436b-8440-f35c441d431a tempest-TestSecurityGroupsBasicOps-914949250 tempest-TestSecurityGroupsBasicOps-914949250-project-admin] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1921 microversion: 2.1 time: 0.200007 Nov 02 14:00:16.939312 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3344/7064] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:16 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1921 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:17.025615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:17.027010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:17.037420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.037921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.038373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.039157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.039600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.040032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.080922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:00:17.174706 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-54a419da-904d-47c8-96b3-83199d508933 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 204 len: 0 microversion: 2.1 time: 0.154509 Nov 02 14:00:17.175586 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3721/7065] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:00:17 2022] DELETE /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:17.184281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:17.185898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:17.192140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.192629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.193094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.193799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:17.194249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:17.194675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:17.289582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:17.299024 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dfc7b25e-3b5a-469f-9a20-0bdcff237d6f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1482 microversion: 2.1 time: 0.119012 Nov 02 14:00:17.299643 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3345/7066] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:17 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1482 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:18.323573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:18.324406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:18.333767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.334555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.335217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.336832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:18.337483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:18.338121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:18.477406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:18.511850 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b79e282c-85e7-4fe1-9c09-82300a96532b tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1482 microversion: 2.1 time: 0.187940 Nov 02 14:00:18.512084 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3722/7067] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:18 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1482 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:19.540926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:19.541544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:19.549707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.550228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.550675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:19.551425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:19.551886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:19.552316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:19.708342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:19.717579 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5c0de8ce-232b-4aa2-b0b8-ba5ff9771f5f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 200 len: 1482 microversion: 2.1 time: 0.180533 Nov 02 14:00:19.718172 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3346/7068] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:19 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 1482 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:20.064392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b1f482f0-517e-42ae-ab8c-a3cd5e22b334 req-16d4ed39-5fc5-446c-aca9-2c92671dde9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa4d102-eb51-494a-9541-fd4aa8822fa9", "name": "network-vif-deleted", "tag": "02f0c4bf-0174-4486-b638-a177875e6aac"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:20.074933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b1f482f0-517e-42ae-ab8c-a3cd5e22b334 req-16d4ed39-5fc5-446c-aca9-2c92671dde9a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:20.075664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b1f482f0-517e-42ae-ab8c-a3cd5e22b334 req-16d4ed39-5fc5-446c-aca9-2c92671dde9a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:20.076407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b1f482f0-517e-42ae-ab8c-a3cd5e22b334 req-16d4ed39-5fc5-446c-aca9-2c92671dde9a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:20.088935 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b1f482f0-517e-42ae-ab8c-a3cd5e22b334 req-16d4ed39-5fc5-446c-aca9-2c92671dde9a service nova] Creating event network-vif-deleted:02f0c4bf-0174-4486-b638-a177875e6aac for instance 0fa4d102-eb51-494a-9541-fd4aa8822fa9 on n-h2-858384-19 Nov 02 14:00:20.094775 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b1f482f0-517e-42ae-ab8c-a3cd5e22b334 req-16d4ed39-5fc5-446c-aca9-2c92671dde9a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201940 Nov 02 14:00:20.095635 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3723/7069] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:00:20.742525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:20.743236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 0fa4d102-eb51-494a-9541-fd4aa8822fa9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:20.750853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:20.751387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:20.751831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:20.752551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:20.753012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:20.753443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:20.768283 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] HTTP exception thrown: Instance 0fa4d102-eb51-494a-9541-fd4aa8822fa9 could not be found. Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Request method failure captured: Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 HTTP/1.1 Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnd_-YElGWwSiJP3Z-uPvtBhxMO5jsm73roHbtpiGOmagVTl530U5RmFK720VWIj9g0A8cY4qqM_F_aNyhcCv6sahJ5QozUgeuln7xrreMeVyDP8WjIstEVDlAMqM9LuhIOJHT9JwnLo3YGLzjpwAW46Q-ptTaM7D5Axa2tQFwpTjec Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5f2a9251561845d0992c29bd528fadcc Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1565999643 Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5f2a9251561845d0992c29bd528fadcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5f2a9251561845d0992c29bd528fadcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5f2a9251561845d0992c29bd528fadcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5f2a9251561845d0992c29bd528fadcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1565999643 Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5f2a9251561845d0992c29bd528fadcc Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1565999643 Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestSecurityGroupsBasicOps-1565999643-project Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 603d648711a643e7adf027c3a4e3f1c0 Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1565999643-project Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 0fa4d102-eb51-494a-9541-fd4aa8822fa9 could not be found. Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '0fa4d102-eb51-494a-9541-fd4aa8822fa9'} Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa4d102-eb51-494a-9541-fd4aa8822fa9 could not be found. Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa4d102-eb51-494a-9541-fd4aa8822fa9 could not be found. Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:20.770598 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa4d102-eb51-494a-9541-fd4aa8822fa9 could not be found. Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Returning 404 to user: Instance 0fa4d102-eb51-494a-9541-fd4aa8822fa9 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-58233bef-2704-4a00-af38-f39ea9effebd tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9" status: 404 len: 111 microversion: 2.1 time: 0.032816 Nov 02 14:00:20.776987 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3347/7070] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:20 2022] GET /compute/v2.1/servers/0fa4d102-eb51-494a-9541-fd4aa8822fa9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:25.860564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dcddb46c-d32a-40dc-a719-c901f62ba8bd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:25.864178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dcddb46c-d32a-40dc-a719-c901f62ba8bd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:25.885654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcddb46c-d32a-40dc-a719-c901f62ba8bd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:25.886153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcddb46c-d32a-40dc-a719-c901f62ba8bd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:25.886603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcddb46c-d32a-40dc-a719-c901f62ba8bd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:25.887366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcddb46c-d32a-40dc-a719-c901f62ba8bd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:25.888456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcddb46c-d32a-40dc-a719-c901f62ba8bd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:25.888901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dcddb46c-d32a-40dc-a719-c901f62ba8bd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:25.968563 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dcddb46c-d32a-40dc-a719-c901f62ba8bd tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "POST /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9/action" status: 200 len: 24571 microversion: 2.1 time: 0.112429 Nov 02 14:00:25.975951 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3724/7071] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:00:25 2022] POST /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9/action => generated 24571 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:00:27.130665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:27.131983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:27.134517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-997d40f5-884a-4d65-9432-d22f956d3077 req-1743739b-ce25-4ebe-b64b-8f5f5bfb51ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ac29f6-c90f-491f-aa93-d216cef0bc2d", "tag": "941ede6c-6fb4-4f7d-b124-6d65d590619f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:27.140706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:27.141857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:27.142569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:27.143554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:27.144238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:27.144896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:27.156291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-997d40f5-884a-4d65-9432-d22f956d3077 req-1743739b-ce25-4ebe-b64b-8f5f5bfb51ca service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:27.156773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-997d40f5-884a-4d65-9432-d22f956d3077 req-1743739b-ce25-4ebe-b64b-8f5f5bfb51ca service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:27.157206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-997d40f5-884a-4d65-9432-d22f956d3077 req-1743739b-ce25-4ebe-b64b-8f5f5bfb51ca service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:27.170906 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-997d40f5-884a-4d65-9432-d22f956d3077 req-1743739b-ce25-4ebe-b64b-8f5f5bfb51ca service nova] Creating event network-changed:941ede6c-6fb4-4f7d-b124-6d65d590619f for instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d on n-h1-858384-19 Nov 02 14:00:27.176193 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-997d40f5-884a-4d65-9432-d22f956d3077 req-1743739b-ce25-4ebe-b64b-8f5f5bfb51ca service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046713 Nov 02 14:00:27.177334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3725/7072] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:00:27.179492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:00:27.277946 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b52a0120-e6ad-47e2-97e2-34995fbaaf9f tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "DELETE /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 204 len: 0 microversion: 2.1 time: 0.151273 Nov 02 14:00:27.279661 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3348/7073] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:00:27 2022] DELETE /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:27.289764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:27.290549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:27.302548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:27.303533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:27.304216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:27.305252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:27.306349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:27.307371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:27.466748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:27.475390 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-02d44ab8-b966-4c04-8f3a-af5a6b5607dc tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1774 microversion: 2.1 time: 0.190848 Nov 02 14:00:27.476181 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3726/7074] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:27 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1774 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:28.039241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:28.042517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:28.049106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.053962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.054419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.055227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.055890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.056326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.140345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:00:28.140902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:00:28.141274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:00:28.141684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:00:28.142138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:00:28.206877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:28.213538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.214179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.214728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.215652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.216770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.218328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.253030 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7df66095-df2b-456b-aa6a-6152183f94f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985/action" status: 202 len: 1141 microversion: 2.1 time: 0.529042 Nov 02 14:00:28.254656 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3349/7075] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:00:27 2022] POST /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985/action => generated 1141 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 14:00:28.285074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:28.286536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:28.312901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.313517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.316950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.318201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.318870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.319554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.501079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:28.501701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:28.508632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.509385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.510116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.510836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:28.511666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:28.512093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:28.517289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:28.557409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:28.576195 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75dbc81b-5473-4ecf-866a-c35773622e2f tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.296660 Nov 02 14:00:28.581567 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3727/7076] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:28 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:28.763912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:28.772676 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-475d3325-a6dc-4d20-a312-d4916194276d tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1774 microversion: 2.1 time: 0.276695 Nov 02 14:00:28.773346 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3350/7077] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:28 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1774 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:29.607396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:29.608110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:29.615400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.616008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.616460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.617328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.617782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.618222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.676722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9f475d2d-f05c-43ce-9d0b-b7e7fc1f493f req-27fee1b1-7d75-482c-9298-8cf5c02e8e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ac29f6-c90f-491f-aa93-d216cef0bc2d", "name": "network-vif-deleted", "tag": "941ede6c-6fb4-4f7d-b124-6d65d590619f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:29.705163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9f475d2d-f05c-43ce-9d0b-b7e7fc1f493f req-27fee1b1-7d75-482c-9298-8cf5c02e8e26 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.706055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9f475d2d-f05c-43ce-9d0b-b7e7fc1f493f req-27fee1b1-7d75-482c-9298-8cf5c02e8e26 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.706677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9f475d2d-f05c-43ce-9d0b-b7e7fc1f493f req-27fee1b1-7d75-482c-9298-8cf5c02e8e26 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.723753 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9f475d2d-f05c-43ce-9d0b-b7e7fc1f493f req-27fee1b1-7d75-482c-9298-8cf5c02e8e26 service nova] Creating event network-vif-deleted:941ede6c-6fb4-4f7d-b124-6d65d590619f for instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d on n-h1-858384-19 Nov 02 14:00:29.728685 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9f475d2d-f05c-43ce-9d0b-b7e7fc1f493f req-27fee1b1-7d75-482c-9298-8cf5c02e8e26 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056266 Nov 02 14:00:29.729367 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3351/7078] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:29.798441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:29.799467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:29.806058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.806555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.806999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.807761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.808223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.808664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.813602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:29.823281 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15a8d045-9fb0-43a2-9a0a-d874277481b8 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.222638 Nov 02 14:00:29.836189 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3728/7079] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:29 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:29.859539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:29.860399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:29.860903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:29.862344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lazy-loading 'fault' on Instance uuid 07ac29f6-c90f-491f-aa93-d216cef0bc2d {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:00:29.913973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '603d648711a643e7adf027c3a4e3f1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2a9251561845d0992c29bd528fadcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:29.923090 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5c9fd637-b755-4966-b4dc-ee8eba7fbbdf tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 200 len: 1389 microversion: 2.1 time: 0.129374 Nov 02 14:00:29.923903 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3352/7080] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:29 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 1389 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:30.849915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:30.850610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:30.858059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:30.859411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:30.859935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:30.860763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:30.861571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:30.862078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:30.948312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:30.948924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] [instance: 07ac29f6-c90f-491f-aa93-d216cef0bc2d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:30.957495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:30.958012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:30.958413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:30.959203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:30.959617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:30.960066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:30.975297 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] HTTP exception thrown: Instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d could not be found. Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Request method failure captured: Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d HTTP/1.1 Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnd_-YElGWwSiJP3Z-uPvtBhxMO5jsm73roHbtpiGOmagVTl530U5RmFK720VWIj9g0A8cY4qqM_F_aNyhcCv6sahJ5QozUgeuln7xrreMeVyDP8WjIstEVDlAMqM9LuhIOJHT9JwnLo3YGLzjpwAW46Q-ptTaM7D5Axa2tQFwpTjec Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 5f2a9251561845d0992c29bd528fadcc Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1565999643 Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5f2a9251561845d0992c29bd528fadcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/5f2a9251561845d0992c29bd528fadcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_5f2a9251561845d0992c29bd528fadcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/5f2a9251561845d0992c29bd528fadcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1565999643 Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 5f2a9251561845d0992c29bd528fadcc Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1565999643 Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestSecurityGroupsBasicOps-1565999643-project Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 603d648711a643e7adf027c3a4e3f1c0 Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1565999643-project Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d could not be found. Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '07ac29f6-c90f-491f-aa93-d216cef0bc2d'} Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d could not be found. Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d could not be found. Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.976964 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d could not be found. Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Returning 404 to user: Instance 07ac29f6-c90f-491f-aa93-d216cef0bc2d could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e854cbfd-b8ab-4a10-b549-878642d1a4b5 tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d" status: 404 len: 111 microversion: 2.1 time: 0.034116 Nov 02 14:00:30.983677 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3353/7081] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:30 2022] GET /compute/v2.1/servers/07ac29f6-c90f-491f-aa93-d216cef0bc2d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:00:31.017209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:31.025192 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7551252c-311f-464d-902e-500a2fee6c9a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.179908 Nov 02 14:00:31.025787 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3729/7082] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:30 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:32.050382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:32.051614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:32.061051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:32.061051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:32.061531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:32.062274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:32.062738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:32.063191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:32.349664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:32.352015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-472dff68-c836-4d63-9d11-1271b0a13da7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.305775 Nov 02 14:00:32.352701 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3354/7083] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:32 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:33.382173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:33.383506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:33.391937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:33.392797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:33.393364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:33.394820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:33.397405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:33.397957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:33.679807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:33.719014 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-95baed2d-fd0a-4ce4-899d-7951e64c51b1 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.339098 Nov 02 14:00:33.745293 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3730/7084] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:33 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:34.772091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:34.773215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:34.782466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:34.785134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:34.786042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:34.786727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:34.787746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:34.788414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:34.789054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:35.034681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:35.048959 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4faaf2c3-c106-4c6c-bc5e-4c4f93eb16fa tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.281934 Nov 02 14:00:35.050072 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3355/7085] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:34 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:35.288488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46549516-0151-4416-b5a6-80545256087e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] Calling method '.version_select at 0x7fe78f93f1f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:35.299589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:35.314223 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-46549516-0151-4416-b5a6-80545256087e tempest-TestSecurityGroupsBasicOps-1565999643 tempest-TestSecurityGroupsBasicOps-1565999643-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1575436582" status: 202 len: 0 microversion: 2.1 time: 0.031365 Nov 02 14:00:35.314836 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3731/7086] 10.222.0.113 () {58 vars in 1283 bytes} [Wed Nov 2 14:00:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1575436582 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:00:36.075950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:36.076799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:36.084155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:36.084782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:36.085398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:36.086152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:36.086652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:36.087230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:36.245590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:36.255387 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5662b5aa-ad67-4219-b143-7a60e70313eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.184610 Nov 02 14:00:36.271141 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3356/7087] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:36 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:37.282441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:37.283886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:37.292412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:37.292911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:37.293357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:37.294870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:37.295771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:37.296215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:37.300954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:37.477864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:37.492712 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10d9c135-a19c-4ceb-a804-797a974361b2 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.216197 Nov 02 14:00:37.493338 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3732/7088] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:37 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:38.519784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:38.520402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:38.531982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.532488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.533403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.534210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:38.534684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:38.535142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:38.682320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:38.690923 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e5c80982-abf9-4b49-b972-c59161d2367a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.175121 Nov 02 14:00:38.691540 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3357/7089] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:38 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:39.714521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:39.715156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:39.722875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:39.723396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:39.723835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:39.725289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:39.726060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:39.726658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:39.879949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:39.889080 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1650c51-da0a-4411-ba68-bf5070e4353a tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1696 microversion: 2.1 time: 0.178443 Nov 02 14:00:39.889691 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3733/7090] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:39 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:40.916433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:40.916998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:40.923303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:40.923784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:40.924220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:40.924922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:40.925377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:40.925797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:41.071677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:41.085985 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2b332781-cbb6-471b-b9e9-4716bd337f8e tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1702 microversion: 2.1 time: 0.174205 Nov 02 14:00:41.086705 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3358/7091] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:40 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1702 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:42.113788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:42.114406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:42.121280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:42.121847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:42.124012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:42.124012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:42.124012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:42.129788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:42.277000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:42.286681 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01d8b12e-f735-43e5-b255-b71f2b340ad9 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1702 microversion: 2.1 time: 0.177074 Nov 02 14:00:42.287311 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3734/7092] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:42 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1702 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:43.311712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:43.312333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:43.319436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:43.319864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:43.320330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:43.321045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:43.321504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:43.321948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:43.468481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:43.476928 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f20ea8b4-29db-4434-b8e2-97bbef5b75b5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1702 microversion: 2.1 time: 0.168940 Nov 02 14:00:43.477542 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3359/7093] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:43 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1702 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:44.501953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:44.502662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:44.510254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:44.511271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:44.511992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:44.512975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:44.513767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:44.514663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:44.705763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:44.715212 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-227a04bd-40be-4240-b8e1-b65a5e77d8eb tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1687 microversion: 2.1 time: 0.217796 Nov 02 14:00:44.717330 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3735/7094] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:44 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1687 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:44.759942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a29387ab-cb7d-4678-9f3e-27aff33a5474 req-76075eb7-675b-47f3-a411-0a98255d6c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8da643-c250-4099-ad6f-d04e80aaf985", "name": "network-vif-unplugged", "status": "completed", "tag": "ab6b496b-ecfa-42e7-9ca7-a746a47ef081"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:44.777125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a29387ab-cb7d-4678-9f3e-27aff33a5474 req-76075eb7-675b-47f3-a411-0a98255d6c2d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:44.777626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a29387ab-cb7d-4678-9f3e-27aff33a5474 req-76075eb7-675b-47f3-a411-0a98255d6c2d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:44.778784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a29387ab-cb7d-4678-9f3e-27aff33a5474 req-76075eb7-675b-47f3-a411-0a98255d6c2d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:44.792930 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a29387ab-cb7d-4678-9f3e-27aff33a5474 req-76075eb7-675b-47f3-a411-0a98255d6c2d service nova] Creating event network-vif-unplugged:ab6b496b-ecfa-42e7-9ca7-a746a47ef081 for instance 9a8da643-c250-4099-ad6f-d04e80aaf985 on n-h2-858384-19 Nov 02 14:00:44.799600 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a29387ab-cb7d-4678-9f3e-27aff33a5474 req-76075eb7-675b-47f3-a411-0a98255d6c2d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044540 Nov 02 14:00:44.801443 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3360/7095] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:45.830306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-625009856", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "8d9283fa-4858-4ed8-b25c-a2bf71c969cd"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:45.884502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] validate_networks() for [('8d9283fa-4858-4ed8-b25c-a2bf71c969cd', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:00:46.233894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:00:46.234317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:00:46.234822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:00:46.235287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:00:46.235700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:00:46.244902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:46.245438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:46.245822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:46.246551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:46.248041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:46.248478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:46.265979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Getting quotas for project 762f80ff6c4b4c0ba44b41429fdba8b6. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:00:46.271348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Getting quotas for user ec06746236ab4589bdf728f668206369 and project 762f80ff6c4b4c0ba44b41429fdba8b6. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:00:46.284732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:00:46.287028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:00:46.335010 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da9a51e1-0d43-476f-862c-e776ca031f1a tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.623770 Nov 02 14:00:46.335736 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3736/7096] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:00:45 2022] POST /compute/v2.1/servers => generated 382 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:00:46.347971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c7e664a-6cb3-4231-810e-3301beb3eb57 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:46.348690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c7e664a-6cb3-4231-810e-3301beb3eb57 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:46.408851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c7e664a-6cb3-4231-810e-3301beb3eb57 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:46.416592 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c7e664a-6cb3-4231-810e-3301beb3eb57 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1217 microversion: 2.1 time: 0.072878 Nov 02 14:00:46.417315 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3361/7097] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:46 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:46.839219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e7f028be-46ea-45eb-8e88-55cdb217da42 req-0b63d6a3-9f6e-440d-8e80-c68d7744249f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8da643-c250-4099-ad6f-d04e80aaf985", "name": "network-vif-plugged", "status": "completed", "tag": "ab6b496b-ecfa-42e7-9ca7-a746a47ef081"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:46.853124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e7f028be-46ea-45eb-8e88-55cdb217da42 req-0b63d6a3-9f6e-440d-8e80-c68d7744249f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:46.853756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e7f028be-46ea-45eb-8e88-55cdb217da42 req-0b63d6a3-9f6e-440d-8e80-c68d7744249f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:46.854633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e7f028be-46ea-45eb-8e88-55cdb217da42 req-0b63d6a3-9f6e-440d-8e80-c68d7744249f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:46.868369 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e7f028be-46ea-45eb-8e88-55cdb217da42 req-0b63d6a3-9f6e-440d-8e80-c68d7744249f service nova] Creating event network-vif-plugged:ab6b496b-ecfa-42e7-9ca7-a746a47ef081 for instance 9a8da643-c250-4099-ad6f-d04e80aaf985 on n-h2-858384-19 Nov 02 14:00:46.874375 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e7f028be-46ea-45eb-8e88-55cdb217da42 req-0b63d6a3-9f6e-440d-8e80-c68d7744249f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040858 Nov 02 14:00:46.875434 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3737/7098] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:47.441514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:47.442145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:47.452097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:47.452863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:47.453444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:47.454381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:47.454902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:47.455370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:47.537250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:47.545922 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-185183e4-48a9-4b25-be26-5a3a1521ced5 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1287 microversion: 2.1 time: 0.108681 Nov 02 14:00:47.547259 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3362/7099] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:47 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:48.570748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:48.571510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:48.579346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:48.579839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:48.580276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:48.580989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:48.581469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:48.581896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:48.732691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:48.741083 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-43a043c9-19a6-49ad-9660-da75af8c9715 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1317 microversion: 2.1 time: 0.174692 Nov 02 14:00:48.741727 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3738/7100] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:48 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:49.027239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-07239d2a-b7e3-464a-a48b-02acee43c6f8 req-7c7fdac2-abb4-48dd-ae4b-6e5700f9dff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57dfbaf-f3c9-48da-b62e-09d9ce753734", "tag": "5b79a22e-552e-4b95-9751-468cdf191cd2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:49.039048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-07239d2a-b7e3-464a-a48b-02acee43c6f8 req-7c7fdac2-abb4-48dd-ae4b-6e5700f9dff5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:49.039849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-07239d2a-b7e3-464a-a48b-02acee43c6f8 req-7c7fdac2-abb4-48dd-ae4b-6e5700f9dff5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:49.040282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-07239d2a-b7e3-464a-a48b-02acee43c6f8 req-7c7fdac2-abb4-48dd-ae4b-6e5700f9dff5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:49.052561 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-07239d2a-b7e3-464a-a48b-02acee43c6f8 req-7c7fdac2-abb4-48dd-ae4b-6e5700f9dff5 service nova] Creating event network-changed:5b79a22e-552e-4b95-9751-468cdf191cd2 for instance d57dfbaf-f3c9-48da-b62e-09d9ce753734 on n-h2-858384-19 Nov 02 14:00:49.057477 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-07239d2a-b7e3-464a-a48b-02acee43c6f8 req-7c7fdac2-abb4-48dd-ae4b-6e5700f9dff5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034484 Nov 02 14:00:49.058104 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3363/7101] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:00:49.765026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:49.765589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:49.772724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:49.773201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:49.773680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:49.774387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:49.774877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:49.775341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:49.905939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:49.913783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0cf4c4c7-6d8a-4e10-8477-0db5b423b706 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1317 microversion: 2.1 time: 0.153405 Nov 02 14:00:49.914362 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3739/7102] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:49 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:50.938739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:50.939528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:50.945772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:50.946258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:50.946704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:50.947441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:50.947904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:50.948342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:51.080631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:51.088720 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-872784f9-4b80-42d1-94ea-74e18f7b9edb tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1317 microversion: 2.1 time: 0.155614 Nov 02 14:00:51.089303 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3364/7103] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:50 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:52.112815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:52.113436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:52.120709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:52.121199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:52.122226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:52.123027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:52.123524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:52.123957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:52.255714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:52.264816 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-352a9e06-e952-4d7b-9ad6-5406c8442464 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1317 microversion: 2.1 time: 0.156141 Nov 02 14:00:52.265421 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3740/7104] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:52 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:53.288147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:53.288825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:53.295924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:53.296405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:53.296843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:53.297553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:53.298005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:53.298427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:53.442203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:53.451316 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1691b90a-c419-4595-8948-0ef1c704dead tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1317 microversion: 2.1 time: 0.166893 Nov 02 14:00:53.451924 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3365/7105] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:53 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:54.475447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:54.476058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:54.483878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:54.484363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:54.484800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:54.485509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:54.485963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:54.486802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:54.636945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:54.645442 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd82ca4b-3696-452a-aede-ad18d1de6f45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1317 microversion: 2.1 time: 0.174684 Nov 02 14:00:54.646028 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3741/7106] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:54 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:54.849590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-770d7c31-49ef-4b7c-b481-a82b92b720d9 req-b548be58-c0b2-4276-bcfa-29493fd61f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57dfbaf-f3c9-48da-b62e-09d9ce753734", "name": "network-vif-plugged", "status": "completed", "tag": "5b79a22e-552e-4b95-9751-468cdf191cd2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:54.861518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-770d7c31-49ef-4b7c-b481-a82b92b720d9 req-b548be58-c0b2-4276-bcfa-29493fd61f5e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:54.862032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-770d7c31-49ef-4b7c-b481-a82b92b720d9 req-b548be58-c0b2-4276-bcfa-29493fd61f5e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:54.862691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-770d7c31-49ef-4b7c-b481-a82b92b720d9 req-b548be58-c0b2-4276-bcfa-29493fd61f5e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:54.875015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-770d7c31-49ef-4b7c-b481-a82b92b720d9 req-b548be58-c0b2-4276-bcfa-29493fd61f5e service nova] Creating event network-vif-plugged:5b79a22e-552e-4b95-9751-468cdf191cd2 for instance d57dfbaf-f3c9-48da-b62e-09d9ce753734 on n-h2-858384-19 Nov 02 14:00:54.880082 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-770d7c31-49ef-4b7c-b481-a82b92b720d9 req-b548be58-c0b2-4276-bcfa-29493fd61f5e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034356 Nov 02 14:00:54.880884 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3366/7107] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:55.668482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:55.669106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:55.676112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:55.676669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:55.677109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:55.677801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:55.678252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:55.678840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:55.812829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:55.820632 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59562420-f121-463e-a364-c93044b2a60b tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1317 microversion: 2.1 time: 0.156133 Nov 02 14:00:55.821347 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3742/7108] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:55 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:56.485927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:56.490614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b6dda55-8ff0-4254-b99a-403e40e177fc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:56.493059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2b6dda55-8ff0-4254-b99a-403e40e177fc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:56.501529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b6dda55-8ff0-4254-b99a-403e40e177fc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:56.501988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b6dda55-8ff0-4254-b99a-403e40e177fc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:56.502436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b6dda55-8ff0-4254-b99a-403e40e177fc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:56.503171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b6dda55-8ff0-4254-b99a-403e40e177fc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:56.503629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b6dda55-8ff0-4254-b99a-403e40e177fc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:56.504084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b6dda55-8ff0-4254-b99a-403e40e177fc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:56.575218 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2b6dda55-8ff0-4254-b99a-403e40e177fc tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "POST /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9/action" status: 200 len: 32641 microversion: 2.1 time: 0.090704 Nov 02 14:00:56.575982 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3367/7109] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:00:56 2022] POST /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9/action => generated 32641 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:00:56.845010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:56.845554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:56.847700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:56.848529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:56.856057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:56.857266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:56.857863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:56.858713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:56.859201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:56.859630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:57.002487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:57.011845 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-15897bb2-50a3-4702-803b-0f49eabedb45 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1501 microversion: 2.1 time: 0.171407 Nov 02 14:00:57.012574 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3743/7110] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:56 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:00:57.704400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5db64233-7465-4b6a-9eb3-4a2a00448506 req-9081b206-7839-463d-a0cc-1588a5588e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f901bcf-cd7c-4592-b7da-3ec2379236c9", "tag": "b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:00:57.709764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:57.711048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:57.717346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5db64233-7465-4b6a-9eb3-4a2a00448506 req-9081b206-7839-463d-a0cc-1588a5588e0f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:57.718120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5db64233-7465-4b6a-9eb3-4a2a00448506 req-9081b206-7839-463d-a0cc-1588a5588e0f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:57.719399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5db64233-7465-4b6a-9eb3-4a2a00448506 req-9081b206-7839-463d-a0cc-1588a5588e0f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:57.723577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:57.724081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:57.725006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:57.725836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:57.726477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:57.726920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:57.733588 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5db64233-7465-4b6a-9eb3-4a2a00448506 req-9081b206-7839-463d-a0cc-1588a5588e0f service nova] Creating event network-changed:b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2 for instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 on n-h1-858384-19 Nov 02 14:00:57.739699 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5db64233-7465-4b6a-9eb3-4a2a00448506 req-9081b206-7839-463d-a0cc-1588a5588e0f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044338 Nov 02 14:00:57.740906 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3744/7111] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:00:57.759500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:00:57.876772 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f11cdd46-d8ef-4b10-9a03-02b8f4c7c5d4 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "DELETE /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 204 len: 0 microversion: 2.1 time: 0.182717 Nov 02 14:00:57.877588 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3368/7112] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:00:57 2022] DELETE /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:00:57.887544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:57.889566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:57.896387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:57.897136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:57.897947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:57.898850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:57.899332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:57.899937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:58.051811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:58.059839 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-355eb514-f331-4f97-adfa-ff90f7a838b0 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1674 microversion: 2.1 time: 0.177427 Nov 02 14:00:58.060865 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3745/7113] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:57 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:00:59.085189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:00:59.085891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:00:59.094124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:59.094605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:59.095034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:59.095753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:00:59.096205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:00:59.096628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:00:59.099385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:00:59.328394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:00:59.338397 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-26320c06-d562-4028-a2cc-745e1c5d558a tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1674 microversion: 2.1 time: 0.257500 Nov 02 14:00:59.339073 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3369/7114] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:00:59 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1674 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:00.141391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-24ad3fc1-6fdf-47cb-86d9-ba80b320de62 req-d2b64327-143a-4d0f-8a8e-c7ac08390351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f901bcf-cd7c-4592-b7da-3ec2379236c9", "name": "network-vif-deleted", "tag": "b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:00.154667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-24ad3fc1-6fdf-47cb-86d9-ba80b320de62 req-d2b64327-143a-4d0f-8a8e-c7ac08390351 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:00.155254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-24ad3fc1-6fdf-47cb-86d9-ba80b320de62 req-d2b64327-143a-4d0f-8a8e-c7ac08390351 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:00.156452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-24ad3fc1-6fdf-47cb-86d9-ba80b320de62 req-d2b64327-143a-4d0f-8a8e-c7ac08390351 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:00.176135 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-24ad3fc1-6fdf-47cb-86d9-ba80b320de62 req-d2b64327-143a-4d0f-8a8e-c7ac08390351 service nova] Creating event network-vif-deleted:b3421bdf-22bc-4f1e-a9f0-0c348bfd48b2 for instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 on n-h1-858384-19 Nov 02 14:01:00.183404 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-24ad3fc1-6fdf-47cb-86d9-ba80b320de62 req-d2b64327-143a-4d0f-8a8e-c7ac08390351 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044510 Nov 02 14:01:00.184124 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3746/7115] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:00.363161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:00.363786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:00.371469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:00.372613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:00.373058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:00.373910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:00.374579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:00.374784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:00.409782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:00.410345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:00.410858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:00.411384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lazy-loading 'fault' on Instance uuid 8f901bcf-cd7c-4592-b7da-3ec2379236c9 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:01:00.418268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:00.418865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:00.426248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:00.426758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:00.427233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:00.427954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:00.428412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:00.428862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:00.458486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:01:00.461536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38735cc248a746789a1f357eab74620b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6338ff20b64e7d93b047f5d9b080d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:00.471529 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3ee1f3a-3b25-41c9-acc9-d9e3b507f48e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 200 len: 1341 microversion: 2.1 time: 0.112762 Nov 02 14:01:00.472399 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3370/7116] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:01:00 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 1341 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:00.543894 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-24ef7db1-d7fa-4fec-9f72-7746b95d6b4d tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 204 len: 0 microversion: 2.1 time: 0.130733 Nov 02 14:01:00.545753 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3747/7117] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:01:00 2022] DELETE /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:01:00.557769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:00.558391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:00.564749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:00.565233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:00.565667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:00.566362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:00.566995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:00.567638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:00.705883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:00.714310 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2e5c9b17-61e9-43f6-bd76-1431e12558e4 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1507 microversion: 2.1 time: 0.161896 Nov 02 14:01:00.714999 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3371/7118] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:01:00 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:01.496566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:01.497291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] [instance: 8f901bcf-cd7c-4592-b7da-3ec2379236c9] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:01.504949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:01.505429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:01.505865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:01.506561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:01.507012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:01.507466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:01.521277 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] HTTP exception thrown: Instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 could not be found. Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Request method failure captured: Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 HTTP/1.1 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYncHFCtwhNQPULlNVn22EYZRvFAg9WAEhFHAbDljX3RfGlejoL3jwUwUbsqwuTb3h72sA3vTZ08qbfp6yGkxvp7tECHViWsPfsinn3Xp9AiamNJDX9W_zJSH2Q8dwTGlWhWm3Tw1u5lLjtOe3Y-5RDKaKEUy7EC9XotC3_DwoBrpmi8 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2d6338ff20b64e7d93b047f5d9b080d5 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestNetworkBasicOps-581340483 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2d6338ff20b64e7d93b047f5d9b080d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestNetworkBasicOps-581340483 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2d6338ff20b64e7d93b047f5d9b080d5 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestNetworkBasicOps-581340483 Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestNetworkBasicOps-581340483-project Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 38735cc248a746789a1f357eab74620b Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestNetworkBasicOps-581340483-project Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 could not be found. Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '8f901bcf-cd7c-4592-b7da-3ec2379236c9'} Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 could not be found. Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 could not be found. Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:01.522939 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 could not be found. Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Returning 404 to user: Instance 8f901bcf-cd7c-4592-b7da-3ec2379236c9 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-daeb5ea8-cbb3-4485-a3c7-1e025441b0e7 tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9" status: 404 len: 111 microversion: 2.1 time: 0.032151 Nov 02 14:01:01.528610 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3748/7119] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:01:01 2022] GET /compute/v2.1/servers/8f901bcf-cd7c-4592-b7da-3ec2379236c9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:01:01.690111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-58e72b60-5a04-4eda-8ac6-23677dad870e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] Calling method '.version_select at 0x7fe7864b6040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:01.712391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-58e72b60-5a04-4eda-8ac6-23677dad870e tempest-TestNetworkBasicOps-581340483 tempest-TestNetworkBasicOps-581340483-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-963173949" status: 202 len: 0 microversion: 2.1 time: 0.026008 Nov 02 14:01:01.713109 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3372/7120] 10.222.0.113 () {58 vars in 1259 bytes} [Wed Nov 2 14:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-963173949 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:01:01.741368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:01.742050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:01.749573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:01.750103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:01.750577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:01.751336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:01.751802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:01.752241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:02.334061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec06746236ab4589bdf728f668206369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '762f80ff6c4b4c0ba44b41429fdba8b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:02.343984 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-02900b26-0c7f-4c46-8c04-aa8d25668202 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 200 len: 1507 microversion: 2.1 time: 0.607764 Nov 02 14:01:02.344918 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3749/7121] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:01:01 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 1507 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:01:02.661610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a5191f7c-b490-4aea-bbca-6ee269553fbc req-f7d13acd-75c0-490e-9493-05c991dc5c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57dfbaf-f3c9-48da-b62e-09d9ce753734", "name": "network-vif-deleted", "tag": "5b79a22e-552e-4b95-9751-468cdf191cd2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:02.674972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a5191f7c-b490-4aea-bbca-6ee269553fbc req-f7d13acd-75c0-490e-9493-05c991dc5c5f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:02.675504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a5191f7c-b490-4aea-bbca-6ee269553fbc req-f7d13acd-75c0-490e-9493-05c991dc5c5f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:02.676370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a5191f7c-b490-4aea-bbca-6ee269553fbc req-f7d13acd-75c0-490e-9493-05c991dc5c5f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:02.689746 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a5191f7c-b490-4aea-bbca-6ee269553fbc req-f7d13acd-75c0-490e-9493-05c991dc5c5f service nova] Creating event network-vif-deleted:5b79a22e-552e-4b95-9751-468cdf191cd2 for instance d57dfbaf-f3c9-48da-b62e-09d9ce753734 on n-h2-858384-19 Nov 02 14:01:02.695156 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a5191f7c-b490-4aea-bbca-6ee269553fbc req-f7d13acd-75c0-490e-9493-05c991dc5c5f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037271 Nov 02 14:01:02.695788 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3373/7122] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:03.368357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:03.369205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] [instance: d57dfbaf-f3c9-48da-b62e-09d9ce753734] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:03.377335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:03.377933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:03.378443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:03.379456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:03.380161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:03.380805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:03.395662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] HTTP exception thrown: Instance d57dfbaf-f3c9-48da-b62e-09d9ce753734 could not be found. Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Request method failure captured: Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 HTTP/1.1 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYngMExwtILXS_Iip-QnQoyNxM2tzhDm9bDWzz62ztXbG2UFNKz9yYBDmSQ4-N7xlEvATDU-ih2edWH4AjQk5-5DoPXST92OvKoXAF19BRo6_6P43mF3ADdNN-Qphp7fAGAVZYWV6sJf1Y5e7pxS7USEwfNtRNPa23NMz3SECZvDUOsc Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 762f80ff6c4b4c0ba44b41429fdba8b6 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesActionsTest-1546625093 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/762f80ff6c4b4c0ba44b41429fdba8b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/762f80ff6c4b4c0ba44b41429fdba8b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_762f80ff6c4b4c0ba44b41429fdba8b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/762f80ff6c4b4c0ba44b41429fdba8b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesActionsTest-1546625093 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 762f80ff6c4b4c0ba44b41429fdba8b6 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesActionsTest-1546625093 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesActionsTest-1546625093-project Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: ec06746236ab4589bdf728f668206369 Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesActionsTest-1546625093-project Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance d57dfbaf-f3c9-48da-b62e-09d9ce753734 could not be found. Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'd57dfbaf-f3c9-48da-b62e-09d9ce753734'} Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d57dfbaf-f3c9-48da-b62e-09d9ce753734 could not be found. Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d57dfbaf-f3c9-48da-b62e-09d9ce753734 could not be found. Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:03.397244 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:03.402745 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:03.402745 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:03.402745 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:03.402745 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:03.402745 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:03.402745 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d57dfbaf-f3c9-48da-b62e-09d9ce753734 could not be found. Nov 02 14:01:03.402745 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:01:03.402745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] Returning 404 to user: Instance d57dfbaf-f3c9-48da-b62e-09d9ce753734 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:03.402745 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e0a5417-501e-4111-9eb2-af5f1e70a458 tempest-VolumesActionsTest-1546625093 tempest-VolumesActionsTest-1546625093-project] 10.222.0.113 "GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734" status: 404 len: 111 microversion: 2.1 time: 0.034441 Nov 02 14:01:03.407162 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3750/7123] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:01:03 2022] GET /compute/v2.1/servers/d57dfbaf-f3c9-48da-b62e-09d9ce753734 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:01:21.015494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e388c47a-f5d5-44bf-8b16-8c8337e51690 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:21.017757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e388c47a-f5d5-44bf-8b16-8c8337e51690 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:21.020784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:21.021440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=21 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:21.028703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e388c47a-f5d5-44bf-8b16-8c8337e51690 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:21.029277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e388c47a-f5d5-44bf-8b16-8c8337e51690 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:21.029691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e388c47a-f5d5-44bf-8b16-8c8337e51690 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:21.030408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e388c47a-f5d5-44bf-8b16-8c8337e51690 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:21.030864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e388c47a-f5d5-44bf-8b16-8c8337e51690 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:21.031410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e388c47a-f5d5-44bf-8b16-8c8337e51690 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:21.083072 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e388c47a-f5d5-44bf-8b16-8c8337e51690 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "POST /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985/action" status: 200 len: 24562 microversion: 2.1 time: 0.072446 Nov 02 14:01:21.083967 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3374/7124] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:01:21 2022] POST /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985/action => generated 24562 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:01:52.452484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:52.453734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:52.459302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f38d91e2-dcaa-4c9d-8d81-c452eff18c17 req-cf9166d1-0ce6-4da6-8fef-a90f6cebdf3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8da643-c250-4099-ad6f-d04e80aaf985", "tag": "ab6b496b-ecfa-42e7-9ca7-a746a47ef081"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:52.462534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:52.463750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:52.465567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.466500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.467263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:52.468731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.469212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.469696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:52.497337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:52.498431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:01:52.508658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f38d91e2-dcaa-4c9d-8d81-c452eff18c17 req-cf9166d1-0ce6-4da6-8fef-a90f6cebdf3a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.509579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f38d91e2-dcaa-4c9d-8d81-c452eff18c17 req-cf9166d1-0ce6-4da6-8fef-a90f6cebdf3a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.513456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f38d91e2-dcaa-4c9d-8d81-c452eff18c17 req-cf9166d1-0ce6-4da6-8fef-a90f6cebdf3a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:52.519995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:01:52.546916 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f38d91e2-dcaa-4c9d-8d81-c452eff18c17 req-cf9166d1-0ce6-4da6-8fef-a90f6cebdf3a service nova] Creating event network-changed:ab6b496b-ecfa-42e7-9ca7-a746a47ef081 for instance 9a8da643-c250-4099-ad6f-d04e80aaf985 on n-h2-858384-19 Nov 02 14:01:52.559163 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f38d91e2-dcaa-4c9d-8d81-c452eff18c17 req-cf9166d1-0ce6-4da6-8fef-a90f6cebdf3a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107161 Nov 02 14:01:52.560807 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3375/7125] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:52.666175 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1dffbd71-f66e-46e2-87eb-7a95712b3d83 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "DELETE /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 204 len: 0 microversion: 2.1 time: 0.217155 Nov 02 14:01:52.672302 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3751/7126] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:01:52 2022] DELETE /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 14:01:52.683310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:52.684019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:52.700136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.700957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.705567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:52.706825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:52.707832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:52.708552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:52.938686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:52.953514 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-018f82c3-875e-4637-b750-9eb495019db4 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1693 microversion: 2.1 time: 0.275042 Nov 02 14:01:52.967710 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3376/7127] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:01:52 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1693 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:53.981013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:53.981815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:53.991618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:53.992479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:53.993181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:53.994141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:53.994816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:53.995491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:54.207894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:54.219914 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06dc60d8-9ec6-464a-b234-b491469fa9d5 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1693 microversion: 2.1 time: 0.244368 Nov 02 14:01:54.220566 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3752/7128] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:01:53 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1693 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:55.051766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-0684e19b-0218-49d9-8ec8-f993bc6ee927 req-0baaf4eb-e4c8-4f01-ab35-466be49f5ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8da643-c250-4099-ad6f-d04e80aaf985", "name": "network-vif-deleted", "tag": "ab6b496b-ecfa-42e7-9ca7-a746a47ef081"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:01:55.062738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0684e19b-0218-49d9-8ec8-f993bc6ee927 req-0baaf4eb-e4c8-4f01-ab35-466be49f5ade service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:55.063203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0684e19b-0218-49d9-8ec8-f993bc6ee927 req-0baaf4eb-e4c8-4f01-ab35-466be49f5ade service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:55.063660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0684e19b-0218-49d9-8ec8-f993bc6ee927 req-0baaf4eb-e4c8-4f01-ab35-466be49f5ade service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:55.076193 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-0684e19b-0218-49d9-8ec8-f993bc6ee927 req-0baaf4eb-e4c8-4f01-ab35-466be49f5ade service nova] Creating event network-vif-deleted:ab6b496b-ecfa-42e7-9ca7-a746a47ef081 for instance 9a8da643-c250-4099-ad6f-d04e80aaf985 on n-h2-858384-19 Nov 02 14:01:55.081593 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-0684e19b-0218-49d9-8ec8-f993bc6ee927 req-0baaf4eb-e4c8-4f01-ab35-466be49f5ade service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262496 Nov 02 14:01:55.082293 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3377/7129] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:01:55.258706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:55.260159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:55.269734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:55.270862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:55.271490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:55.272836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:55.273652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:55.274327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:55.310320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:55.310804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:55.311904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:55.312368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lazy-loading 'fault' on Instance uuid 9a8da643-c250-4099-ad6f-d04e80aaf985 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:01:55.357675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c7ca068dba4093880183ae9b2f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97329dcfb8453795347d9e818d9d92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:01:55.366613 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f41e4ec6-e238-4177-ba4e-122a8ef182f7 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 200 len: 1360 microversion: 2.1 time: 0.112524 Nov 02 14:01:55.367529 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3753/7130] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:01:55 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 1360 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:01:56.401127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:01:56.401875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] [instance: 9a8da643-c250-4099-ad6f-d04e80aaf985] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:01:56.410318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:56.410803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:56.411414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:56.412128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:01:56.412581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:01:56.413017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:01:56.428131 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] HTTP exception thrown: Instance 9a8da643-c250-4099-ad6f-d04e80aaf985 could not be found. Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Request method failure captured: Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 HTTP/1.1 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnVXBJjYVYKia0vxbjWHpLhZPUXqy9qzXWuRFgQYAN7DfSZl64uS6JBaetuwYeaWGbSLwXk357QnJPGHHhI5ySkNmd7QeR6UkGdWVUkROaqFFPeO96O11eREIt2L19I24aIfpQUjmqwFvMmflCc2eMLpoTDom0x1gkoXw5KYIpfQ2wc Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: bc97329dcfb8453795347d9e818d9d92 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/bc97329dcfb8453795347d9e818d9d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: bc97329dcfb8453795347d9e818d9d92 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-423495247 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestNetworkAdvancedServerOps-423495247-project Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 41c7ca068dba4093880183ae9b2f0935 Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestNetworkAdvancedServerOps-423495247-project Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 9a8da643-c250-4099-ad6f-d04e80aaf985 could not be found. Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '9a8da643-c250-4099-ad6f-d04e80aaf985'} Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a8da643-c250-4099-ad6f-d04e80aaf985 could not be found. Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a8da643-c250-4099-ad6f-d04e80aaf985 could not be found. Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:01:56.429832 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a8da643-c250-4099-ad6f-d04e80aaf985 could not be found. Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Returning 404 to user: Instance 9a8da643-c250-4099-ad6f-d04e80aaf985 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b7f4c9d-fd7f-418c-86ba-3b90fa778f6b tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985" status: 404 len: 111 microversion: 2.1 time: 0.042721 Nov 02 14:01:56.435063 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3378/7131] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:01:56 2022] GET /compute/v2.1/servers/9a8da643-c250-4099-ad6f-d04e80aaf985 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:02:00.557728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f95f7ae7-d066-4edc-b6c4-b94f8f48af99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] Calling method '.version_select at 0x7fe787cd4f70>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:00.614543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f95f7ae7-d066-4edc-b6c4-b94f8f48af99 tempest-TestNetworkAdvancedServerOps-423495247 tempest-TestNetworkAdvancedServerOps-423495247-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1054902477" status: 202 len: 0 microversion: 2.1 time: 0.058775 Nov 02 14:02:00.616582 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3754/7132] 10.222.0.113 () {58 vars in 1289 bytes} [Wed Nov 2 14:02:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1054902477 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:02:14.278443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:14.280412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:14.625411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4dcf803e-e719-456c-8803-8c247ebb35be tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Action: 'create', calling method: .version_select at 0x7fe7864b74c0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-651042462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsifI1KwGCGeFv8m0QWSq9nomaEKaPYPTMsygxzf7RUwNGsj8ibJusdAuuOk/9KISrSSnNyZbeM0QjK7osvEHcbg48BseS8xp2r4ld0vw+KUiILjLjacw59J6BjWaLbOg=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:14.662430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4dcf803e-e719-456c-8803-8c247ebb35be tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Getting quotas for project b894356f14004ae1b15a35da13667a3b. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:14.674687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4dcf803e-e719-456c-8803-8c247ebb35be tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Getting quotas for user f5c12ea052c24d73b754c4ece09f7a1c and project b894356f14004ae1b15a35da13667a3b. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:14.727418 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4dcf803e-e719-456c-8803-8c247ebb35be tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.453918 Nov 02 14:02:14.728039 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3379/7133] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:02:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:16.331926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1890718953", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-651042462", "security_groups": [{"name": "tempest-secgroup-smoke-1600429559"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f5c967de-690a-4e07-929b-6c058b6a2ea3"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:16.344432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:16.345241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:16.478830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] validate_networks() for [('f5c967de-690a-4e07-929b-6c058b6a2ea3', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:02:17.409614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Getting quotas for project b894356f14004ae1b15a35da13667a3b. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:17.424516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Getting quotas for user f5c12ea052c24d73b754c4ece09f7a1c and project b894356f14004ae1b15a35da13667a3b. Resources: dict_keys(['metadata_items']) {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:17.441223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:02:17.442481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:02:17.442966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:02:17.443413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:02:17.443836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:02:17.455045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:17.455594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:17.456031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:17.457090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:17.457520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:17.458013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:17.478527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Getting quotas for project b894356f14004ae1b15a35da13667a3b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:17.485719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Getting quotas for user f5c12ea052c24d73b754c4ece09f7a1c and project b894356f14004ae1b15a35da13667a3b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:17.502966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:02:17.506405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:02:17.561528 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71b8b790-17cd-49db-b635-3612bc579258 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.236153 Nov 02 14:02:17.571451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3755/7134] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:02:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:02:17.585203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-947795a2-5fe6-420c-8fb0-9c68fb5d6d1e tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:17.586381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-947795a2-5fe6-420c-8fb0-9c68fb5d6d1e tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:17.657845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-947795a2-5fe6-420c-8fb0-9c68fb5d6d1e tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:17.667955 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-947795a2-5fe6-420c-8fb0-9c68fb5d6d1e tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1306 microversion: 2.1 time: 0.088928 Nov 02 14:02:17.670662 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3380/7135] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:17 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:18.707351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:18.709370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:18.747985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:18.749369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:18.750044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:18.751532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:18.752222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:18.753604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:18.867456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:18.879087 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-85c8e045-f939-4cbd-a58c-037bd8972c9c tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1358 microversion: 2.1 time: 0.189615 Nov 02 14:02:18.881210 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3756/7136] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:18 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:19.906097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:19.907426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:19.916080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:19.916737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:19.917201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:19.917925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:19.918391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:19.918821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:19.996325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:20.005605 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66002968-8a19-4452-9095-b75f5c024795 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1364 microversion: 2.1 time: 0.104921 Nov 02 14:02:20.006375 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3381/7137] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:19 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1364 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:20.924603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-380916977", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "2e32762c-0886-4650-831f-f2df3649b6b6"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:20.931483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-792978b8-a9af-409c-ae47-e20ee32d6537 req-5a1a0631-8321-4c23-8136-cf46aab3845c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c7ad13-5db7-4b03-b038-f768182e2700", "tag": "e8aeddd2-e869-4c37-bdb0-6eb4280b4aa5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:20.951162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-792978b8-a9af-409c-ae47-e20ee32d6537 req-5a1a0631-8321-4c23-8136-cf46aab3845c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:20.956436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-792978b8-a9af-409c-ae47-e20ee32d6537 req-5a1a0631-8321-4c23-8136-cf46aab3845c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:20.958445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-792978b8-a9af-409c-ae47-e20ee32d6537 req-5a1a0631-8321-4c23-8136-cf46aab3845c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:20.973083 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-792978b8-a9af-409c-ae47-e20ee32d6537 req-5a1a0631-8321-4c23-8136-cf46aab3845c service nova] Creating event network-changed:e8aeddd2-e869-4c37-bdb0-6eb4280b4aa5 for instance 30c7ad13-5db7-4b03-b038-f768182e2700 on n-h2-858384-19 Nov 02 14:02:20.979106 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-792978b8-a9af-409c-ae47-e20ee32d6537 req-5a1a0631-8321-4c23-8136-cf46aab3845c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059046 Nov 02 14:02:20.980229 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3382/7138] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:21.007097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] validate_networks() for [('2e32762c-0886-4650-831f-f2df3649b6b6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:02:21.034460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:21.035201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:21.041861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:21.042562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:21.043075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:21.043737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:21.044230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:21.044858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:21.204039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:21.212190 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5d27f5e1-2a77-45fb-856e-49386166805f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1432 microversion: 2.1 time: 0.183237 Nov 02 14:02:21.212773 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3383/7139] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:21 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1432 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:21.661187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:02:21.661617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:02:21.662098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:02:21.662513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:02:21.662957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:02:21.673633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:21.674162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:21.674594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:21.675415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:21.675912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:21.676386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:21.694428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Getting quotas for project 2c522d09a5184c368864752a3478a3b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:21.700049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Getting quotas for user f894b3a48de34792b9717868197d9e6e and project 2c522d09a5184c368864752a3478a3b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:21.714460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:02:21.716785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:02:21.765645 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c30dd77-b45f-42a8-9a9e-a6fec098cc0c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.847633 Nov 02 14:02:21.766296 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3757/7140] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:02:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:02:21.781236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-78fbf7b2-9a59-4e53-9c9d-a47275d68b02 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:21.781836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-78fbf7b2-9a59-4e53-9c9d-a47275d68b02 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:21.844523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-78fbf7b2-9a59-4e53-9c9d-a47275d68b02 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:21.851881 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-78fbf7b2-9a59-4e53-9c9d-a47275d68b02 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1217 microversion: 2.1 time: 0.075028 Nov 02 14:02:21.852456 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3384/7141] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:21 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:22.237836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:22.238513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:22.247356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:22.248712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:22.249320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:22.250297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:22.250775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:22.251289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:22.408700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:22.417792 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-201071b6-3c65-489b-8eed-fa0aeadb87c6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1432 microversion: 2.1 time: 0.184215 Nov 02 14:02:22.418400 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3758/7142] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:22 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1432 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:22.876351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:22.877105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:22.886974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:22.887651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:22.888146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:22.889589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:22.890080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:22.890567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:22.961528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:22.970966 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7b524aac-4663-4436-865a-97f2a4cb9aa7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1269 microversion: 2.1 time: 0.098896 Nov 02 14:02:22.971580 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3385/7143] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:22 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:23.443163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:23.443940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:23.452348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:23.452517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:23.452931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:23.454789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:23.455346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:23.455781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:23.609735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:23.624522 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef37fcd3-3622-49ef-82c8-34d769f9a350 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1432 microversion: 2.1 time: 0.185396 Nov 02 14:02:23.625131 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3759/7144] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:23 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1432 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:23.994103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:23.994697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:24.002838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:24.003378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:24.003814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:24.004535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:24.004977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:24.005600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:24.243256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:24.251989 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4de2b86f-2d2d-4e53-8f40-08c34c002f8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1317 microversion: 2.1 time: 0.261863 Nov 02 14:02:24.252592 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3386/7145] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:23 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:24.648612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:24.649811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:24.657485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:24.657974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:24.658429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:24.659172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:24.659637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:24.660080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:24.733653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e6e8cb66-0985-455b-8d4c-b6cf4af6ea5d req-fc19e998-32e3-43f1-9591-b7f430bc8968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41e9ecbd-80a5-4eb8-adb5-46c2d670c950", "tag": "e30733cc-bbc7-4d01-b0e5-57b3fa54cc83"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:24.752666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e6e8cb66-0985-455b-8d4c-b6cf4af6ea5d req-fc19e998-32e3-43f1-9591-b7f430bc8968 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:24.753323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e6e8cb66-0985-455b-8d4c-b6cf4af6ea5d req-fc19e998-32e3-43f1-9591-b7f430bc8968 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:24.753813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e6e8cb66-0985-455b-8d4c-b6cf4af6ea5d req-fc19e998-32e3-43f1-9591-b7f430bc8968 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:24.780807 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e6e8cb66-0985-455b-8d4c-b6cf4af6ea5d req-fc19e998-32e3-43f1-9591-b7f430bc8968 service nova] Creating event network-changed:e30733cc-bbc7-4d01-b0e5-57b3fa54cc83 for instance 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 on n-h1-858384-19 Nov 02 14:02:24.787334 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e6e8cb66-0985-455b-8d4c-b6cf4af6ea5d req-fc19e998-32e3-43f1-9591-b7f430bc8968 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063352 Nov 02 14:02:24.788501 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3387/7146] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:02:24.814334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:24.823283 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cfc98f3b-eb13-4f99-b464-f0e6ed2cee31 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1432 microversion: 2.1 time: 0.178582 Nov 02 14:02:24.823986 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3760/7147] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:24 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1432 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:25.277768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:25.278589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:25.286288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:25.286782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:25.287260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:25.287976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:25.288428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:25.288927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:25.433550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:25.442901 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d2ddfbf5-7824-4d83-851e-c6ecd993c793 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1317 microversion: 2.1 time: 0.170450 Nov 02 14:02:25.443551 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3388/7148] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:25 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:25.848797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:25.849559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:25.856130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:25.856620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:25.857058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:25.858307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:25.858768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:25.859213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:26.001668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:26.008859 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d17ee47-0640-46ec-9d22-60eda2d052e6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1432 microversion: 2.1 time: 0.164418 Nov 02 14:02:26.009451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3761/7149] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:25 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1432 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:26.467139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:26.467951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:26.474682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:26.475188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:26.475631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:26.476327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:26.476782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:26.477216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:26.614229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:26.622519 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d5817ceb-1097-4e58-8f59-505f9306f140 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1317 microversion: 2.1 time: 0.159456 Nov 02 14:02:26.623945 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3389/7150] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:26 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:27.033603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:27.034229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:27.041471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:27.041960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:27.042405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:27.043129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:27.043593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:27.044030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:27.185371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:27.193160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df9c74fc-ce6f-4c00-a336-471b13827b49 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1432 microversion: 2.1 time: 0.164451 Nov 02 14:02:27.193758 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3762/7151] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:27 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1432 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:27.567386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7b716683-70f1-4568-824f-ef5d5babfc97 req-c35ad599-e732-440a-a1bd-641c1ca2b71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7ad13-5db7-4b03-b038-f768182e2700", "name": "network-vif-plugged", "status": "completed", "tag": "e8aeddd2-e869-4c37-bdb0-6eb4280b4aa5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:27.579415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7b716683-70f1-4568-824f-ef5d5babfc97 req-c35ad599-e732-440a-a1bd-641c1ca2b71f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:27.579904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7b716683-70f1-4568-824f-ef5d5babfc97 req-c35ad599-e732-440a-a1bd-641c1ca2b71f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:27.580341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7b716683-70f1-4568-824f-ef5d5babfc97 req-c35ad599-e732-440a-a1bd-641c1ca2b71f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:27.593059 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7b716683-70f1-4568-824f-ef5d5babfc97 req-c35ad599-e732-440a-a1bd-641c1ca2b71f service nova] Creating event network-vif-plugged:e8aeddd2-e869-4c37-bdb0-6eb4280b4aa5 for instance 30c7ad13-5db7-4b03-b038-f768182e2700 on n-h2-858384-19 Nov 02 14:02:27.602317 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7b716683-70f1-4568-824f-ef5d5babfc97 req-c35ad599-e732-440a-a1bd-641c1ca2b71f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202426 Nov 02 14:02:27.603105 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3390/7152] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:27.647499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:27.648894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:27.656424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:27.657034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:27.657568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:27.658366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:27.658916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:27.659452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:27.856278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:27.864920 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-537cad2b-9631-41f5-a30c-ddb370bf7b48 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1317 microversion: 2.1 time: 0.222154 Nov 02 14:02:27.865235 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3763/7153] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:27 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:28.217429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:28.218116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:28.224530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:28.225009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:28.225443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:28.226132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:28.226582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:28.227008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:28.371887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:28.380985 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c0797399-ae83-4e8a-af1e-e90604556228 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1432 microversion: 2.1 time: 0.167955 Nov 02 14:02:28.381582 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3391/7154] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:28 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1432 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:28.887882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:28.888998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:28.896146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:28.896634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:28.897081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:28.897778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:28.898245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:28.898678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.036002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:29.043941 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c912c78c-37ef-4d8f-9cbc-7271afd79d19 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1317 microversion: 2.1 time: 0.160059 Nov 02 14:02:29.045091 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3764/7155] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:28 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:29.406591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:29.407103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:29.413870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:29.414353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:29.414785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.415504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:29.415952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:29.416372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.559288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:29.567605 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-48fa70ef-3e0a-4f93-90da-b10850a15e8b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1613 microversion: 2.1 time: 0.165886 Nov 02 14:02:29.568188 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3392/7156] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:29 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1613 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:29.592863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:29.593212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:29.599964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:29.600603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:29.601228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.602229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:29.602694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:29.603718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.745704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:29.753889 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b6c5e07a-7d15-4560-a6bc-13e751ea9df8 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1613 microversion: 2.1 time: 0.165826 Nov 02 14:02:29.754471 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3765/7157] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:29 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1613 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:29.780947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:29.781565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:29.787537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:29.788024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:29.788463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.789162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:29.789621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:29.790044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:29.929450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:29.938157 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4057b9da-e8b8-4c79-b860-e52abcc41665 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1613 microversion: 2.1 time: 0.161947 Nov 02 14:02:29.938732 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3393/7158] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:29 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1613 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:30.069953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:30.070595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:30.078312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:30.078796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:30.079263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:30.080001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:30.080455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:30.080878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:30.239566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:30.247280 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3004b00-a92d-44fb-8c42-c721236e6d72 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1317 microversion: 2.1 time: 0.181272 Nov 02 14:02:30.248365 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3766/7159] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:30 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:30.652557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9d2288a5-981d-446c-83ae-eef43d92344e req-3808cc03-96c1-4867-9c6b-9635cca153e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e9ecbd-80a5-4eb8-adb5-46c2d670c950", "name": "network-vif-plugged", "status": "completed", "tag": "e30733cc-bbc7-4d01-b0e5-57b3fa54cc83"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:30.666239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9d2288a5-981d-446c-83ae-eef43d92344e req-3808cc03-96c1-4867-9c6b-9635cca153e5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:30.666981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9d2288a5-981d-446c-83ae-eef43d92344e req-3808cc03-96c1-4867-9c6b-9635cca153e5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:30.667449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9d2288a5-981d-446c-83ae-eef43d92344e req-3808cc03-96c1-4867-9c6b-9635cca153e5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:30.682864 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9d2288a5-981d-446c-83ae-eef43d92344e req-3808cc03-96c1-4867-9c6b-9635cca153e5 service nova] Creating event network-vif-plugged:e30733cc-bbc7-4d01-b0e5-57b3fa54cc83 for instance 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 on n-h1-858384-19 Nov 02 14:02:30.690007 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9d2288a5-981d-446c-83ae-eef43d92344e req-3808cc03-96c1-4867-9c6b-9635cca153e5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048190 Nov 02 14:02:30.691799 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3394/7160] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:31.270515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:31.271319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:31.278660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:31.280540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:31.281052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:31.281817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:31.282354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:31.282865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:31.428431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:31.437508 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-23215552-2b57-4f9a-90b6-b633e5d3c45d tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1317 microversion: 2.1 time: 0.170932 Nov 02 14:02:31.438353 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3767/7161] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:31 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:32.121629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:32.126923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-177f249e-b7cd-4df0-b192-483745af1c6d req-a25c9a8c-1193-4277-b518-ba9c3464089b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c7ad13-5db7-4b03-b038-f768182e2700", "tag": "e8aeddd2-e869-4c37-bdb0-6eb4280b4aa5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:32.137684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-177f249e-b7cd-4df0-b192-483745af1c6d req-a25c9a8c-1193-4277-b518-ba9c3464089b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:32.138172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-177f249e-b7cd-4df0-b192-483745af1c6d req-a25c9a8c-1193-4277-b518-ba9c3464089b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:32.138663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-177f249e-b7cd-4df0-b192-483745af1c6d req-a25c9a8c-1193-4277-b518-ba9c3464089b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:32.150584 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-177f249e-b7cd-4df0-b192-483745af1c6d req-a25c9a8c-1193-4277-b518-ba9c3464089b service nova] Creating event network-changed:e8aeddd2-e869-4c37-bdb0-6eb4280b4aa5 for instance 30c7ad13-5db7-4b03-b038-f768182e2700 on n-h2-858384-19 Nov 02 14:02:32.156503 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-177f249e-b7cd-4df0-b192-483745af1c6d req-a25c9a8c-1193-4277-b518-ba9c3464089b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036400 Nov 02 14:02:32.160409 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3395/7162] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:32.464945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:32.468122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:32.474532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:32.475325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=16 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:32.479480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:32.480130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:32.480805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:32.481520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:32.481978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:32.483059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:32.693411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:32.703097 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2fb6c0e4-310a-49a6-a108-906f72d0f90e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1317 microversion: 2.1 time: 0.245497 Nov 02 14:02:32.712806 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3768/7163] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:32 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:33.727794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:33.728476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:33.734795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:33.735316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:33.735743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:33.736440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:33.737163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:33.737589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:33.875591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:33.883442 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ab6e8ff3-298c-4bd6-a047-2eb4228f84c3 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1500 microversion: 2.1 time: 0.161263 Nov 02 14:02:33.884022 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3396/7164] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:33 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:34.253601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:34.254092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:34.261296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:34.261781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:34.262227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:34.262933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:34.264000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:34.264396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:34.293432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:02:34.374440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91e32607-7b29-4992-8670-17f26c109ec5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "DELETE /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 204 len: 0 microversion: 2.1 time: 0.124399 Nov 02 14:02:34.375203 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3769/7165] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:02:34 2022] DELETE /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:02:34.383628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:34.384244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:34.390828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:34.391373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:34.391812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:34.392506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:34.392959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:34.393383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:34.525194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:34.534047 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed0f20a9-e16b-4ed0-871d-e47ff00101e6 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1506 microversion: 2.1 time: 0.154267 Nov 02 14:02:34.534649 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3397/7166] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:34 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:35.559131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:35.560043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:35.567322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:35.567821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:35.568266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:35.568991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:35.569449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:35.569884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:35.725251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:35.734161 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-db27a280-4ede-4b0e-93f4-5cd45032fea1 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1506 microversion: 2.1 time: 0.180384 Nov 02 14:02:35.734758 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3770/7167] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:35 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:36.487313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d3fb6fe9-4359-4800-acfa-9e2f630999fe req-37580017-84d4-4cfe-ba6d-504d14a939f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41e9ecbd-80a5-4eb8-adb5-46c2d670c950", "name": "network-vif-deleted", "tag": "e30733cc-bbc7-4d01-b0e5-57b3fa54cc83"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:36.498168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3fb6fe9-4359-4800-acfa-9e2f630999fe req-37580017-84d4-4cfe-ba6d-504d14a939f8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:36.498652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3fb6fe9-4359-4800-acfa-9e2f630999fe req-37580017-84d4-4cfe-ba6d-504d14a939f8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:36.499088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3fb6fe9-4359-4800-acfa-9e2f630999fe req-37580017-84d4-4cfe-ba6d-504d14a939f8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:36.510650 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d3fb6fe9-4359-4800-acfa-9e2f630999fe req-37580017-84d4-4cfe-ba6d-504d14a939f8 service nova] Creating event network-vif-deleted:e30733cc-bbc7-4d01-b0e5-57b3fa54cc83 for instance 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 on n-h1-858384-19 Nov 02 14:02:36.516952 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d3fb6fe9-4359-4800-acfa-9e2f630999fe req-37580017-84d4-4cfe-ba6d-504d14a939f8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033757 Nov 02 14:02:36.517570 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3398/7168] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:36.758558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:36.759209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:36.766835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:36.767361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:36.767810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:36.768513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:36.768970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:36.769402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:36.773774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:36.802926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:36.803439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:36.803882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:36.804326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lazy-loading 'fault' on Instance uuid 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:02:36.845566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:36.853261 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-355c7b4d-9201-47b2-90ea-0bb9d672919a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 200 len: 1307 microversion: 2.1 time: 0.098720 Nov 02 14:02:36.853841 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3771/7169] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:36 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:37.878221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:37.878834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: 41e9ecbd-80a5-4eb8-adb5-46c2d670c950] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:37.885246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:37.885723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:37.886153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:37.886839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:37.887324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:37.887746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:37.901763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] HTTP exception thrown: Instance 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 could not be found. Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Request method failure captured: Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 HTTP/1.1 Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnhrWpyoxeL7uvRjP7OIhXBGz8ya0ZeQHacjavmjUOaPHW48BhXZMNd3uugjzz9psdfhahNbo2Au0u4vl4wxv_18YFp7ld2c-rAi4vqi7DMpJDJ5pfI1VWd9fL1IH1eh0wcvJjYaLbDeRuhCjR14Wy3H4sqogpz7NEKES-gVnwfcT0s Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 2c522d09a5184c368864752a3478a3b2 Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesActionsTest-1946239054 Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c522d09a5184c368864752a3478a3b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c522d09a5184c368864752a3478a3b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c522d09a5184c368864752a3478a3b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c522d09a5184c368864752a3478a3b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesActionsTest-1946239054 Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 2c522d09a5184c368864752a3478a3b2 Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesActionsTest-1946239054 Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesActionsTest-1946239054-project Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f894b3a48de34792b9717868197d9e6e Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesActionsTest-1946239054-project Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 could not be found. Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '41e9ecbd-80a5-4eb8-adb5-46c2d670c950'} Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 could not be found. Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 could not be found. Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:37.903425 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 could not be found. Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Returning 404 to user: Instance 41e9ecbd-80a5-4eb8-adb5-46c2d670c950 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bc2970a4-329b-4d87-8135-113e1053dec7 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950" status: 404 len: 111 microversion: 2.1 time: 0.032756 Nov 02 14:02:37.909361 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3399/7170] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:37 2022] GET /compute/v2.1/servers/41e9ecbd-80a5-4eb8-adb5-46c2d670c950 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:02:37.960904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1501940259", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "2e32762c-0886-4650-831f-f2df3649b6b6"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:38.015786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] validate_networks() for [('2e32762c-0886-4650-831f-f2df3649b6b6', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:02:38.369652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:02:38.370115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:02:38.370642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:02:38.371024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:02:38.371385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:02:38.381197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:38.381684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:38.382131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:38.382921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:38.383405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:38.383842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:38.402235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Getting quotas for project 2c522d09a5184c368864752a3478a3b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:02:38.407484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Getting quotas for user f894b3a48de34792b9717868197d9e6e and project 2c522d09a5184c368864752a3478a3b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:02:38.420360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:02:38.422798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:02:38.471393 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3fda710f-2238-4e77-b715-b145eae61d53 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.513994 Nov 02 14:02:38.472647 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3772/7171] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:02:37 2022] POST /compute/v2.1/servers => generated 382 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:02:38.489426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a3104341-ee82-45e6-8946-b670d7b13211 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:38.490530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a3104341-ee82-45e6-8946-b670d7b13211 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:38.558960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a3104341-ee82-45e6-8946-b670d7b13211 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:38.567739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a3104341-ee82-45e6-8946-b670d7b13211 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1218 microversion: 2.1 time: 0.087163 Nov 02 14:02:38.568342 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3400/7172] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:38 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:39.592791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:39.594081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:39.602058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:39.602768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:39.603426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:39.604317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:39.604784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:39.605220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:39.678902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:39.689427 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f7637315-cdad-4945-8680-800dee70c0f2 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1278 microversion: 2.1 time: 0.101494 Nov 02 14:02:39.690134 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3773/7173] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:39 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1278 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:40.715417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:40.716300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:40.724278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:40.724764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:40.725203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:40.725901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:40.726356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:40.726779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:40.928508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:40.937100 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99232b6b-403e-4dce-990f-8f3fcfd57e79 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1318 microversion: 2.1 time: 0.226040 Nov 02 14:02:40.937678 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3401/7174] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:40 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:41.024888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e85412d5-5d1e-4bfb-9d62-f9724a769b8f req-aea31274-46c0-4969-b628-cde3f122c4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d61a7b-0d2c-4a31-b423-23bfb59a929a", "tag": "fb1b9326-77ce-4cdf-8c47-4e7db8a9baf0"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:41.032410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:41.037152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e85412d5-5d1e-4bfb-9d62-f9724a769b8f req-aea31274-46c0-4969-b628-cde3f122c4f3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:41.037715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e85412d5-5d1e-4bfb-9d62-f9724a769b8f req-aea31274-46c0-4969-b628-cde3f122c4f3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:41.038163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e85412d5-5d1e-4bfb-9d62-f9724a769b8f req-aea31274-46c0-4969-b628-cde3f122c4f3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:41.051724 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e85412d5-5d1e-4bfb-9d62-f9724a769b8f req-aea31274-46c0-4969-b628-cde3f122c4f3 service nova] Creating event network-changed:fb1b9326-77ce-4cdf-8c47-4e7db8a9baf0 for instance f2d61a7b-0d2c-4a31-b423-23bfb59a929a on n-h1-858384-19 Nov 02 14:02:41.057267 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e85412d5-5d1e-4bfb-9d62-f9724a769b8f req-aea31274-46c0-4969-b628-cde3f122c4f3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036502 Nov 02 14:02:41.057892 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3774/7175] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:41.960954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:41.961563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:41.968427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:41.968905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:41.969335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:41.970059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:41.970505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:41.970926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:42.110148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:42.118058 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cd0063f0-c809-4690-a020-ee690bc9af40 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1318 microversion: 2.1 time: 0.161082 Nov 02 14:02:42.118633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3402/7176] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:41 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:43.143732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:43.144438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:43.150789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:43.151307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:43.151753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:43.152457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:43.152914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:43.153345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:43.286805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:43.295052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87092650-e6ee-44a8-a207-93a2a5a3beb9 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1318 microversion: 2.1 time: 0.156818 Nov 02 14:02:43.295655 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3775/7177] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:43 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:44.319247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:44.319869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:44.322646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:44.330036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:44.330570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:44.331015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:44.331747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:44.332208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:44.332640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:44.335819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=93 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:44.470958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:44.478738 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-97cbf653-77e6-4760-8912-9ad3d4b91423 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1318 microversion: 2.1 time: 0.163563 Nov 02 14:02:44.479359 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3403/7178] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:44 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:45.503592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:45.504199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:45.511893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:45.512384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:45.512831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:45.513540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:45.514000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:45.514435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:45.649156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:45.657462 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc55cee3-b5e5-4fc0-9035-f52d7b35403a tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1318 microversion: 2.1 time: 0.158601 Nov 02 14:02:45.658067 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3776/7179] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:45 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:46.680212 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-82b15aaa-4bb1-4a3b-bfc2-2d690c30ae9a req-7bc7d805-185c-4ee9-88b0-f87906c4b519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d61a7b-0d2c-4a31-b423-23bfb59a929a", "name": "network-vif-plugged", "status": "completed", "tag": "fb1b9326-77ce-4cdf-8c47-4e7db8a9baf0"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:46.680738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:46.681335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:46.689529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:46.690317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:46.690735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:46.691497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:46.691971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:46.692395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:46.692639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82b15aaa-4bb1-4a3b-bfc2-2d690c30ae9a req-7bc7d805-185c-4ee9-88b0-f87906c4b519 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:46.693140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82b15aaa-4bb1-4a3b-bfc2-2d690c30ae9a req-7bc7d805-185c-4ee9-88b0-f87906c4b519 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:46.693775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82b15aaa-4bb1-4a3b-bfc2-2d690c30ae9a req-7bc7d805-185c-4ee9-88b0-f87906c4b519 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:46.715207 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-82b15aaa-4bb1-4a3b-bfc2-2d690c30ae9a req-7bc7d805-185c-4ee9-88b0-f87906c4b519 service nova] Creating event network-vif-plugged:fb1b9326-77ce-4cdf-8c47-4e7db8a9baf0 for instance f2d61a7b-0d2c-4a31-b423-23bfb59a929a on n-h1-858384-19 Nov 02 14:02:46.721216 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-82b15aaa-4bb1-4a3b-bfc2-2d690c30ae9a req-7bc7d805-185c-4ee9-88b0-f87906c4b519 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045258 Nov 02 14:02:46.722118 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3404/7180] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:46.835950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:46.844569 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-482fa31c-d413-463c-8a29-84233aa9b637 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1318 microversion: 2.1 time: 0.167737 Nov 02 14:02:46.845380 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3777/7181] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:46 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:02:47.869053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:47.869715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:47.876480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:47.876965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:47.877406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:47.878104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:47.878591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:47.879060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:48.011415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:48.019105 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6c907490-a7ca-4a5c-a74e-d95f00fad64e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1318 microversion: 2.1 time: 0.155370 Nov 02 14:02:48.019713 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3405/7182] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:47 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:49.043872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:49.044491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:49.047322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:49.047997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:49.053681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:49.054169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:49.054611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:49.055361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:49.055816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:49.056251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:49.189384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:49.197244 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8e93d0b2-97cf-4c58-8085-07058d2ba09c tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1501 microversion: 2.1 time: 0.157326 Nov 02 14:02:49.197841 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3778/7183] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:49 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:49.622594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:49.623088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:49.626088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:02:49.632268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:49.632759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:49.633202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:49.633915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:49.634374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:49.634809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:49.661624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:02:49.738579 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c6499f5e-1c57-42ec-820d-f4523ed17cd5 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 204 len: 0 microversion: 2.1 time: 0.119615 Nov 02 14:02:49.739421 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3406/7184] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:02:49 2022] DELETE /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:02:49.747546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:49.748158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:49.755369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:49.755851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:49.756291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:49.756985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:49.757436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:49.757862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:49.892201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:49.900036 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b54edb8b-e0e6-43e8-84ce-7b31ebc60d8e tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1507 microversion: 2.1 time: 0.156547 Nov 02 14:02:49.900995 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3779/7185] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:49 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:50.924730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:50.925482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:50.932683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:50.933171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:50.933613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:50.934349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:50.934807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:50.935407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:51.077161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:51.085441 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-922e92fd-1aca-4a40-b047-9c2b72563661 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1507 microversion: 2.1 time: 0.165263 Nov 02 14:02:51.086032 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3407/7186] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:50 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:51.796352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c51d01ba-9645-410d-aeb2-197a230b1dbb req-19fb993d-0262-4de9-81c3-ffaa4828a34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d61a7b-0d2c-4a31-b423-23bfb59a929a", "name": "network-vif-deleted", "tag": "fb1b9326-77ce-4cdf-8c47-4e7db8a9baf0"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:02:51.808637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c51d01ba-9645-410d-aeb2-197a230b1dbb req-19fb993d-0262-4de9-81c3-ffaa4828a34f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:51.809674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c51d01ba-9645-410d-aeb2-197a230b1dbb req-19fb993d-0262-4de9-81c3-ffaa4828a34f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:51.810137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c51d01ba-9645-410d-aeb2-197a230b1dbb req-19fb993d-0262-4de9-81c3-ffaa4828a34f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:51.824130 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c51d01ba-9645-410d-aeb2-197a230b1dbb req-19fb993d-0262-4de9-81c3-ffaa4828a34f service nova] Creating event network-vif-deleted:fb1b9326-77ce-4cdf-8c47-4e7db8a9baf0 for instance f2d61a7b-0d2c-4a31-b423-23bfb59a929a on n-h1-858384-19 Nov 02 14:02:51.831309 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c51d01ba-9645-410d-aeb2-197a230b1dbb req-19fb993d-0262-4de9-81c3-ffaa4828a34f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038969 Nov 02 14:02:51.831933 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3780/7187] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:02:52.110073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:52.110691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:52.117823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:52.118311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:52.118757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:52.119488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:52.119949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:52.120381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:52.151977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:52.152425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:52.152870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:52.153313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lazy-loading 'fault' on Instance uuid f2d61a7b-0d2c-4a31-b423-23bfb59a929a {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:02:52.199645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f894b3a48de34792b9717868197d9e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c522d09a5184c368864752a3478a3b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:02:52.208246 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2e300bb7-2e21-49d0-a339-9a6bd5763f57 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 200 len: 1308 microversion: 2.1 time: 0.102642 Nov 02 14:02:52.208831 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3408/7188] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:52 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:02:53.231824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:02:53.232454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] [instance: f2d61a7b-0d2c-4a31-b423-23bfb59a929a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:02:53.240314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:53.240803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:53.241247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:53.241957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:02:53.242442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:02:53.242873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:02:53.257636 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] HTTP exception thrown: Instance f2d61a7b-0d2c-4a31-b423-23bfb59a929a could not be found. Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Request method failure captured: Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a HTTP/1.1 Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnhrWpyoxeL7uvRjP7OIhXBGz8ya0ZeQHacjavmjUOaPHW48BhXZMNd3uugjzz9psdfhahNbo2Au0u4vl4wxv_18YFp7ld2c-rAi4vqi7DMpJDJ5pfI1VWd9fL1IH1eh0wcvJjYaLbDeRuhCjR14Wy3H4sqogpz7NEKES-gVnwfcT0s Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 2c522d09a5184c368864752a3478a3b2 Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-VolumesActionsTest-1946239054 Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c522d09a5184c368864752a3478a3b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/2c522d09a5184c368864752a3478a3b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_2c522d09a5184c368864752a3478a3b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/2c522d09a5184c368864752a3478a3b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-VolumesActionsTest-1946239054 Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 2c522d09a5184c368864752a3478a3b2 Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-VolumesActionsTest-1946239054 Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-VolumesActionsTest-1946239054-project Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f894b3a48de34792b9717868197d9e6e Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-VolumesActionsTest-1946239054-project Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f2d61a7b-0d2c-4a31-b423-23bfb59a929a could not be found. Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f2d61a7b-0d2c-4a31-b423-23bfb59a929a'} Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d61a7b-0d2c-4a31-b423-23bfb59a929a could not be found. Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d61a7b-0d2c-4a31-b423-23bfb59a929a could not be found. Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:02:53.259487 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d61a7b-0d2c-4a31-b423-23bfb59a929a could not be found. Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] Returning 404 to user: Instance f2d61a7b-0d2c-4a31-b423-23bfb59a929a could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-da2be364-8950-4c9b-b2c1-a94488361414 tempest-VolumesActionsTest-1946239054 tempest-VolumesActionsTest-1946239054-project] 10.222.0.113 "GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a" status: 404 len: 111 microversion: 2.1 time: 0.033426 Nov 02 14:02:53.263637 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3781/7189] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:02:53 2022] GET /compute/v2.1/servers/f2d61a7b-0d2c-4a31-b423-23bfb59a929a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:03:17.585201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-115680334", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:17.595422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:17.596311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:17.651543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] validate_networks() for None {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:03:17.935010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:03:17.935470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:03:17.936606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:03:17.937044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:03:17.937451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:03:17.946322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:17.946795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:17.947267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:17.947983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:17.948438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:17.948857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:17.966279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Getting quotas for project 13c7c33d2a6d44b4a329b6a61065f97b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:03:17.971715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Getting quotas for user a79ccb8e3c144ee79f4f9ca48520f941 and project 13c7c33d2a6d44b4a329b6a61065f97b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:03:17.984104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:03:17.986358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:03:18.032562 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b08e49c3-2fff-4da4-9c20-6fac5a8fd0b2 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.452881 Nov 02 14:03:18.033235 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3409/7190] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:03:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:03:18.044434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e6c99f9-e744-471e-a83f-b1613877dec1 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:18.045767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2e6c99f9-e744-471e-a83f-b1613877dec1 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:18.048321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=14 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:18.049122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=50 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:18.107432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2e6c99f9-e744-471e-a83f-b1613877dec1 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:18.115620 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e6c99f9-e744-471e-a83f-b1613877dec1 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1218 microversion: 2.1 time: 0.075042 Nov 02 14:03:18.116214 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3782/7191] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:18 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:19.142317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:19.142934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:19.150825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:19.151445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:19.151887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:19.152593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:19.153079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:19.153471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:19.256584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:19.265063 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-11cc8cd0-0a3a-4db4-9f2c-d83b43dab67f tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1278 microversion: 2.1 time: 0.129330 Nov 02 14:03:19.265754 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3410/7192] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:19 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1278 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:20.289507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:20.290130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:20.299025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:20.299585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:20.300242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:20.300931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:20.301571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:20.302141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:20.451245 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:20.458984 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be380a92-77da-4e6d-86f7-60252693eb14 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1318 microversion: 2.1 time: 0.173436 Nov 02 14:03:20.459602 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3783/7193] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:20 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:21.027139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1081c1f0-eec2-4802-9f9a-6c770879df8f req-fdcc7a37-2fd1-4de1-8f88-6df5f78288d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0aa7f9a-83ee-479d-98ac-98aa205dd49a", "tag": "8ba300d9-da24-4a7c-9dea-d57167bd33ae"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:21.040338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1081c1f0-eec2-4802-9f9a-6c770879df8f req-fdcc7a37-2fd1-4de1-8f88-6df5f78288d0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:21.040833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1081c1f0-eec2-4802-9f9a-6c770879df8f req-fdcc7a37-2fd1-4de1-8f88-6df5f78288d0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:21.041273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1081c1f0-eec2-4802-9f9a-6c770879df8f req-fdcc7a37-2fd1-4de1-8f88-6df5f78288d0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:21.054373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1081c1f0-eec2-4802-9f9a-6c770879df8f req-fdcc7a37-2fd1-4de1-8f88-6df5f78288d0 service nova] Creating event network-changed:8ba300d9-da24-4a7c-9dea-d57167bd33ae for instance a0aa7f9a-83ee-479d-98ac-98aa205dd49a on n-h1-858384-19 Nov 02 14:03:21.059947 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1081c1f0-eec2-4802-9f9a-6c770879df8f req-fdcc7a37-2fd1-4de1-8f88-6df5f78288d0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039089 Nov 02 14:03:21.060485 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3411/7194] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:21.482169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:21.483456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:21.493554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:21.494078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:21.494525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:21.495275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:21.496032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:21.496310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:21.640209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:21.649461 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-159f4609-81b0-49fe-9854-b50ead24f073 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1318 microversion: 2.1 time: 0.171292 Nov 02 14:03:21.650307 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3784/7195] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:21 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:22.676710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:22.677328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:22.683537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:22.684015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:22.684512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:22.685197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:22.686021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:22.686588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:22.821112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:22.829720 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c98bc186-b5cb-41a0-a241-5383fc8c2e7d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1318 microversion: 2.1 time: 0.159557 Nov 02 14:03:22.830328 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3412/7196] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:22 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:23.853624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:23.854240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:23.862364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:23.862860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:23.863419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:23.864160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:23.864617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:23.865050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:24.000524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:24.008513 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ff8dab9-6b0c-469e-b9af-c51a4100e60e tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1318 microversion: 2.1 time: 0.158808 Nov 02 14:03:24.009120 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3785/7197] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:23 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:25.032288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:25.032937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:25.040046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:25.040534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:25.040980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:25.041680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:25.042139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:25.042568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:25.178612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:25.186254 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0816ff9-2c07-45a8-95a2-38bda511242d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1318 microversion: 2.1 time: 0.158770 Nov 02 14:03:25.186947 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3413/7198] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:25 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:26.210092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:26.210737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:26.218530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:26.219016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:26.219482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:26.220183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:26.220641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:26.221072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:26.353761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:26.362526 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e5a7e4f-aab2-455a-a8bc-7c0e182a65b3 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1318 microversion: 2.1 time: 0.156587 Nov 02 14:03:26.363129 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3786/7199] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:26 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:26.862256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c3288247-6eb0-4c7a-9e0b-1b1f4cb3033c req-a228807f-8085-40af-8e67-65df37c1be72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0aa7f9a-83ee-479d-98ac-98aa205dd49a", "name": "network-vif-plugged", "status": "completed", "tag": "8ba300d9-da24-4a7c-9dea-d57167bd33ae"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:26.873267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c3288247-6eb0-4c7a-9e0b-1b1f4cb3033c req-a228807f-8085-40af-8e67-65df37c1be72 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:26.873750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c3288247-6eb0-4c7a-9e0b-1b1f4cb3033c req-a228807f-8085-40af-8e67-65df37c1be72 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:26.874672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c3288247-6eb0-4c7a-9e0b-1b1f4cb3033c req-a228807f-8085-40af-8e67-65df37c1be72 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:26.886303 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c3288247-6eb0-4c7a-9e0b-1b1f4cb3033c req-a228807f-8085-40af-8e67-65df37c1be72 service nova] Creating event network-vif-plugged:8ba300d9-da24-4a7c-9dea-d57167bd33ae for instance a0aa7f9a-83ee-479d-98ac-98aa205dd49a on n-h1-858384-19 Nov 02 14:03:26.892870 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c3288247-6eb0-4c7a-9e0b-1b1f4cb3033c req-a228807f-8085-40af-8e67-65df37c1be72 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034689 Nov 02 14:03:26.893475 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3414/7200] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:03:27.385957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:27.386491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:27.394400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.394881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.395351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:27.396053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:27.396508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:27.396935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:27.567547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:27.575680 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d9055784-9b4d-41f0-a1f8-34e027cdf136 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1318 microversion: 2.1 time: 0.193756 Nov 02 14:03:27.576280 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3787/7201] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:27 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:28.598433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:28.599260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:28.603465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:28.604163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:28.612029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.612508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.612939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:28.613624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.614072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.614496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:28.748932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:28.757843 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a5f1ec42-6908-49a7-ba91-e76e9bcfca2d tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1467 microversion: 2.1 time: 0.160563 Nov 02 14:03:28.759146 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3415/7202] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:28 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1467 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:28.814749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:28.815296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:28.817228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:28.823508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.823993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.824434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:28.825144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.825605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.826041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:28.853793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:03:28.933828 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1cc50c92-236a-49fb-8e37-46ddb38973aa tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 204 len: 0 microversion: 2.1 time: 0.122733 Nov 02 14:03:28.934437 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3788/7203] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:03:28 2022] DELETE /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:03:28.943775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:28.944328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:28.950368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.950848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.951343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:28.952027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:28.952482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:28.952909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:29.087951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:29.096090 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec83d474-d048-4f60-a48f-beeb821f92a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1473 microversion: 2.1 time: 0.156540 Nov 02 14:03:29.096680 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3416/7204] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:28 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1473 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:30.120564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:30.121255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:30.128285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:30.128769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:30.129213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:30.129913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:30.130367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:30.130799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:30.262367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:30.271013 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bb10db07-669e-41f1-9c67-778645aab9a0 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1473 microversion: 2.1 time: 0.154828 Nov 02 14:03:30.271626 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3789/7205] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:30 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1473 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:31.074170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5d0b0810-97d0-478c-a5d5-c3a8019a6067 req-494d8816-5d4c-4ed8-a2e6-40141a9aabb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0aa7f9a-83ee-479d-98ac-98aa205dd49a", "name": "network-vif-deleted", "tag": "8ba300d9-da24-4a7c-9dea-d57167bd33ae"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:03:31.086118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5d0b0810-97d0-478c-a5d5-c3a8019a6067 req-494d8816-5d4c-4ed8-a2e6-40141a9aabb8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:31.086604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5d0b0810-97d0-478c-a5d5-c3a8019a6067 req-494d8816-5d4c-4ed8-a2e6-40141a9aabb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:31.087039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5d0b0810-97d0-478c-a5d5-c3a8019a6067 req-494d8816-5d4c-4ed8-a2e6-40141a9aabb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:31.106036 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5d0b0810-97d0-478c-a5d5-c3a8019a6067 req-494d8816-5d4c-4ed8-a2e6-40141a9aabb8 service nova] Creating event network-vif-deleted:8ba300d9-da24-4a7c-9dea-d57167bd33ae for instance a0aa7f9a-83ee-479d-98ac-98aa205dd49a on n-h1-858384-19 Nov 02 14:03:31.110990 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5d0b0810-97d0-478c-a5d5-c3a8019a6067 req-494d8816-5d4c-4ed8-a2e6-40141a9aabb8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040676 Nov 02 14:03:31.111914 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3417/7206] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:03:31.293851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:31.294506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:31.302023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:31.302519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:31.302963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:31.303741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:31.304204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:31.304644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:31.340903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:31.341391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:31.341838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:31.342292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lazy-loading 'fault' on Instance uuid a0aa7f9a-83ee-479d-98ac-98aa205dd49a {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:03:31.389306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a79ccb8e3c144ee79f4f9ca48520f941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13c7c33d2a6d44b4a329b6a61065f97b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:03:31.397952 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83aed9eb-cef8-45f5-bab9-dc8aefc02b29 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 200 len: 1308 microversion: 2.1 time: 0.108053 Nov 02 14:03:31.398547 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3790/7207] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:31 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:03:32.423586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:32.424093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] [instance: a0aa7f9a-83ee-479d-98ac-98aa205dd49a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:32.430068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:32.430554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:32.430994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:32.431723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:32.432185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:32.432613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:32.446274 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] HTTP exception thrown: Instance a0aa7f9a-83ee-479d-98ac-98aa205dd49a could not be found. Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Request method failure captured: Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a HTTP/1.1 Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnijJ-QKsq-800ODwnWBwSs9Ls63rXZlpWZupmDEL4jEvqvv0s6jlraiuYLEwxd5BlAw8QF2Zxg0jMsCKQES3LnUqcmJTLN-Nm4kBpyN2HKE_aS904sh2W3T9bLECXrYw2OnYPoDuINTM9TvjunbsCaEgRP334-THIq7ryDqM3ObKsI Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 13c7c33d2a6d44b4a329b6a61065f97b Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-VolumesNegativeTest-836302459 Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/13c7c33d2a6d44b4a329b6a61065f97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/13c7c33d2a6d44b4a329b6a61065f97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_13c7c33d2a6d44b4a329b6a61065f97b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/13c7c33d2a6d44b4a329b6a61065f97b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-VolumesNegativeTest-836302459 Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 13c7c33d2a6d44b4a329b6a61065f97b Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-VolumesNegativeTest-836302459 Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-VolumesNegativeTest-836302459-project Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: a79ccb8e3c144ee79f4f9ca48520f941 Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-VolumesNegativeTest-836302459-project Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance a0aa7f9a-83ee-479d-98ac-98aa205dd49a could not be found. Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'a0aa7f9a-83ee-479d-98ac-98aa205dd49a'} Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0aa7f9a-83ee-479d-98ac-98aa205dd49a could not be found. Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0aa7f9a-83ee-479d-98ac-98aa205dd49a could not be found. Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:03:32.448023 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0aa7f9a-83ee-479d-98ac-98aa205dd49a could not be found. Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] Returning 404 to user: Instance a0aa7f9a-83ee-479d-98ac-98aa205dd49a could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2c481de7-f774-42fd-a755-2d7f187cceb5 tempest-VolumesNegativeTest-836302459 tempest-VolumesNegativeTest-836302459-project] 10.222.0.113 "GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a" status: 404 len: 111 microversion: 2.1 time: 0.031793 Nov 02 14:03:32.452345 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3418/7208] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:03:32 2022] GET /compute/v2.1/servers/a0aa7f9a-83ee-479d-98ac-98aa205dd49a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:03:49.530740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6407f4ab-e5d4-4720-bf6c-9350b6f4d5e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:03:49.531260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6407f4ab-e5d4-4720-bf6c-9350b6f4d5e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:03:49.535866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:49.536630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:03:49.545393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6407f4ab-e5d4-4720-bf6c-9350b6f4d5e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:49.546112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6407f4ab-e5d4-4720-bf6c-9350b6f4d5e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:49.546736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6407f4ab-e5d4-4720-bf6c-9350b6f4d5e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:49.547831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6407f4ab-e5d4-4720-bf6c-9350b6f4d5e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:03:49.549865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6407f4ab-e5d4-4720-bf6c-9350b6f4d5e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:03:49.550479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6407f4ab-e5d4-4720-bf6c-9350b6f4d5e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:03:49.584436 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6407f4ab-e5d4-4720-bf6c-9350b6f4d5e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.057922 Nov 02 14:03:49.585041 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3791/7209] 10.222.0.113 () {58 vars in 1298 bytes} [Wed Nov 2 14:03:49 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700/os-server-password => generated 116 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:04:07.325507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:07.326528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=40 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:07.464208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ff10e488-9f38-4940-b4c8-12c4a34580a0 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-772867033", "availability_zone": "foo_zone"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:07.485421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.aggregate [None req-ff10e488-9f38-4940-b4c8-12c4a34580a0 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Generated uuid baa1c3f4-fac8-454f-8c1d-03d540c436ad for aggregate {{(pid=120929) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 14:04:07.514147 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ff10e488-9f38-4940-b4c8-12c4a34580a0 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.194994 Nov 02 14:04:07.514959 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3419/7210] 10.222.0.113 () {60 vars in 1169 bytes} [Wed Nov 2 14:04:07 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:07.526552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cec99378-adb8-4fa4-8faa-5dca8a45d816 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:07.535202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:07.535897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:07.564269 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cec99378-adb8-4fa4-8faa-5dca8a45d816 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.041300 Nov 02 14:04:07.567543 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3792/7211] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 14:04:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:07.576692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e3e26872-f718-4892-9ee1-bcb48d657c41 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:07.580899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3e26872-f718-4892-9ee1-bcb48d657c41 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.581392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3e26872-f718-4892-9ee1-bcb48d657c41 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.581843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3e26872-f718-4892-9ee1-bcb48d657c41 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.582588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3e26872-f718-4892-9ee1-bcb48d657c41 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.583052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3e26872-f718-4892-9ee1-bcb48d657c41 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.583513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e3e26872-f718-4892-9ee1-bcb48d657c41 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.609609 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e3e26872-f718-4892-9ee1-bcb48d657c41 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.036788 Nov 02 14:04:07.610241 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3420/7212] 10.222.0.113 () {58 vars in 1181 bytes} [Wed Nov 2 14:04:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:07.622354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3bdca2a2-dddd-44ab-afb0-4b73f7702ce2 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:07.629976 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3bdca2a2-dddd-44ab-afb0-4b73f7702ce2 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.011314 Nov 02 14:04:07.630551 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3793/7213] 10.222.0.113 () {58 vars in 1148 bytes} [Wed Nov 2 14:04:07 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:07.643044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-132226d9-cb7f-4851-9081-9a879f78689d tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-858384-19"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:07.654398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-132226d9-cb7f-4851-9081-9a879f78689d tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:07.654894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-132226d9-cb7f-4851-9081-9a879f78689d tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:07.655368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-132226d9-cb7f-4851-9081-9a879f78689d tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:07.901870 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-132226d9-cb7f-4851-9081-9a879f78689d tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.263373 Nov 02 14:04:07.902479 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3421/7214] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 14:04:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:07.914222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e9b7192f-a5df-4a70-97ae-163280822c5e tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:07.922420 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e9b7192f-a5df-4a70-97ae-163280822c5e tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.011977 Nov 02 14:04:07.922957 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3794/7215] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 14:04:07 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:07.934542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9e79d82-9bfd-481e-bdd9-6c62fb8f6c28 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-447832582", "availability_zone": "foo_zone"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:08.056147 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9e79d82-9bfd-481e-bdd9-6c62fb8f6c28 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.125229 Nov 02 14:04:08.062071 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3422/7216] 10.222.0.113 () {60 vars in 1178 bytes} [Wed Nov 2 14:04:07 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:08.069302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7189c0c7-86ab-4375-97b0-79588ae44dd1 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:08.094614 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7189c0c7-86ab-4375-97b0-79588ae44dd1 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.030435 Nov 02 14:04:08.098598 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3795/7217] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 14:04:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:08.106732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40008bb6-b937-43e2-8a49-e2f3b774de76 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:08.116222 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40008bb6-b937-43e2-8a49-e2f3b774de76 tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.013225 Nov 02 14:04:08.116806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3423/7218] 10.222.0.113 () {58 vars in 1157 bytes} [Wed Nov 2 14:04:08 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:08.128621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-42503233-7dbc-4a43-b30c-41ee2fcf5dde tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-858384-19"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:08.140063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42503233-7dbc-4a43-b30c-41ee2fcf5dde tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:08.140602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42503233-7dbc-4a43-b30c-41ee2fcf5dde tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:08.141072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-42503233-7dbc-4a43-b30c-41ee2fcf5dde tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:08.332020 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-42503233-7dbc-4a43-b30c-41ee2fcf5dde tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.207753 Nov 02 14:04:08.332635 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3796/7219] 10.222.0.113 () {60 vars in 1199 bytes} [Wed Nov 2 14:04:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:04:08.344000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-44e78313-c21f-418c-bcbe-8636c7ebd68c tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:08.367312 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-44e78313-c21f-418c-bcbe-8636c7ebd68c tempest-TestAggregatesBasicOps-815325829 tempest-TestAggregatesBasicOps-815325829-project-admin] 10.222.0.113 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.026988 Nov 02 14:04:08.368298 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3424/7220] 10.222.0.113 () {58 vars in 1160 bytes} [Wed Nov 2 14:04:08 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 14:04:28.811584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:28.814117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:28.819025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2124025513", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "37a55844-6649-42fc-bda2-4b0dec14c260", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a091e626-fbaf-4376-b09d-38c161b3ee11"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:29.058344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] validate_networks() for [('a091e626-fbaf-4376-b09d-38c161b3ee11', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:04:29.687021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:04:29.687558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:04:29.688118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:04:29.689295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:04:29.689715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:04:29.698869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:29.699386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:29.699829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:29.700563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:29.701019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:29.701452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:29.718979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:04:29.725360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for user 5b2bb8e9b22043ca88ee5a68f23358d1 and project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:04:29.784577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:04:29.785720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='37a55844-6649-42fc-bda2-4b0dec14c260',volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:04:29.926505 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39cdc36d-f6a3-4ead-a1cd-8c79d59ee846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.117292 Nov 02 14:04:29.933489 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3797/7221] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:04:28 2022] POST /compute/v2.1/servers => generated 382 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:04:29.937124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:29.938323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:29.940063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:29.945352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a63b062a-3239-4bfa-b542-57c7b6d58e5d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:29.947351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a63b062a-3239-4bfa-b542-57c7b6d58e5d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:30.090870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a63b062a-3239-4bfa-b542-57c7b6d58e5d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:30.099427 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a63b062a-3239-4bfa-b542-57c7b6d58e5d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1060 microversion: 2.1 time: 0.164414 Nov 02 14:04:30.100477 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3425/7222] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:29 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1060 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:31.123252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:31.124456 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:31.133535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:31.134024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:31.134461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:31.135204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:31.135661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:31.136092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:31.220257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:31.229008 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2210ec6f-552c-43c7-9af5-39c7c3312e93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1166 microversion: 2.1 time: 0.110471 Nov 02 14:04:31.229595 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3798/7223] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:31 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1166 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:32.254545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:32.255095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:32.269080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:32.269815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:32.270442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:32.271352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:32.271964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:32.272543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:32.624136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:32.640266 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-325b7b30-ff34-4acf-9833-9d7bdf1c68ad tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1218 microversion: 2.1 time: 0.387943 Nov 02 14:04:32.642410 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3426/7224] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:32 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1218 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:32.751201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-bd3c5de0-1750-48a0-bf8c-90fe15901334 req-c81e0f94-1e79-4116-acb7-ec7a8ac807a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df", "tag": "9418f06f-810a-4eef-9f26-07ef87d2f183"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:32.781024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bd3c5de0-1750-48a0-bf8c-90fe15901334 req-c81e0f94-1e79-4116-acb7-ec7a8ac807a0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:32.782436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bd3c5de0-1750-48a0-bf8c-90fe15901334 req-c81e0f94-1e79-4116-acb7-ec7a8ac807a0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:32.784070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bd3c5de0-1750-48a0-bf8c-90fe15901334 req-c81e0f94-1e79-4116-acb7-ec7a8ac807a0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:32.802866 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-bd3c5de0-1750-48a0-bf8c-90fe15901334 req-c81e0f94-1e79-4116-acb7-ec7a8ac807a0 service nova] Creating event network-changed:9418f06f-810a-4eef-9f26-07ef87d2f183 for instance b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df on n-h1-858384-19 Nov 02 14:04:32.810296 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-bd3c5de0-1750-48a0-bf8c-90fe15901334 req-c81e0f94-1e79-4116-acb7-ec7a8ac807a0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065259 Nov 02 14:04:32.811836 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3799/7225] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:33.667410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:33.668019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:33.675316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.675835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.676461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:33.677286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:33.677720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:33.678407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:34.169690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:34.178265 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e506632a-d58d-4345-91dd-416833942b7f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1218 microversion: 2.1 time: 0.514928 Nov 02 14:04:34.179082 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3427/7226] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:33 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1218 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:35.202570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:35.203323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:35.211510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:35.211993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:35.212435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:35.213144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:35.213603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:35.214036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:35.361180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:35.369690 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d89d73cc-27b5-421f-b8a4-0c67c2c8b21c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1218 microversion: 2.1 time: 0.171549 Nov 02 14:04:35.370289 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3800/7227] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:35 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:36.393540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:36.394244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:36.401046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:36.401600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:36.402104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:36.402807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:36.403287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:36.403736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:36.548602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:36.556611 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e920af5-cdaa-440c-bd4b-b61a6f8c859b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1218 microversion: 2.1 time: 0.167318 Nov 02 14:04:36.557191 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3428/7228] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:36 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:37.580066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:37.580680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:37.587511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:37.587988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:37.588428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:37.589117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:37.589567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:37.589993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:37.728248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:37.737060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fe1de577-33e8-4ea0-acd6-5a5e72376b97 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.160803 Nov 02 14:04:37.737860 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3801/7229] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:37 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:38.761982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:38.762578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:38.770032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:38.770514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:38.770953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:38.771674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:38.772133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:38.772558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:38.902864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:38.911349 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-733a18a5-be18-4bf4-b2eb-5c3b7252c035 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.153369 Nov 02 14:04:38.911926 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3429/7230] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:38 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:39.935377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:39.935924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:39.939986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:39.940683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:39.946996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:39.947515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:39.947965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:39.948672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:39.949137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:39.949578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:40.084779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:40.092639 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06b9897e-8f49-4ded-9c6a-baefea9fe1fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.161360 Nov 02 14:04:40.093225 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3802/7231] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:39 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:41.116282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:41.116896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:41.119269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:41.124726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.125245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.126470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:41.127241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:41.127706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:41.128140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:41.264229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:41.272200 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4835bf32-657d-4814-ac99-e3434171a64e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.160299 Nov 02 14:04:41.272775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3430/7232] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:41 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:42.295162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:42.295784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:42.303553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:42.304038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:42.304478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:42.305175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:42.305628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:42.306051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:42.433842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:42.442189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ead4b9cc-0928-4fbe-a160-74d0d98b39ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.151761 Nov 02 14:04:42.442772 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3803/7233] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:42 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:43.465864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:43.466485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:43.474044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:43.474536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:43.474983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:43.475711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:43.476171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:43.476607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:43.608573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:43.617706 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-380ab0fa-e076-4a07-ad2b-21ed586e08bb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.155843 Nov 02 14:04:43.618289 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3431/7234] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:43 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:44.639768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:44.640391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:44.647342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:44.647830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:44.648278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:44.649006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:44.649467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:44.649901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:44.783769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:44.791609 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fe6a4276-4db1-4128-96b0-f78ff800f7b1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.155771 Nov 02 14:04:44.792121 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3804/7235] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:44 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:45.815339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:45.815961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:45.822822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:45.823344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:45.823789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:45.824527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:45.825015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:45.825447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:45.964694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:45.972571 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-77bbe950-d0c2-4242-aa72-17b1821eead0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.161325 Nov 02 14:04:45.973382 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3432/7236] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:45 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:46.995534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:46.996197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:47.004519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.005012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.005466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.006172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.006632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.007068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.138852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:47.147011 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09e189f2-a498-4e40-b961-aea5cbf3531c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.155774 Nov 02 14:04:47.147628 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3805/7237] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:46 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:47.279917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-88014150-ecb1-4701-a303-c25d355965e7 req-2621d793-e043-49bb-9a50-25d28bbdcb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df", "name": "network-vif-plugged", "status": "completed", "tag": "9418f06f-810a-4eef-9f26-07ef87d2f183"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:47.291364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-88014150-ecb1-4701-a303-c25d355965e7 req-2621d793-e043-49bb-9a50-25d28bbdcb8b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:47.291858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-88014150-ecb1-4701-a303-c25d355965e7 req-2621d793-e043-49bb-9a50-25d28bbdcb8b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:47.292297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-88014150-ecb1-4701-a303-c25d355965e7 req-2621d793-e043-49bb-9a50-25d28bbdcb8b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:47.304916 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-88014150-ecb1-4701-a303-c25d355965e7 req-2621d793-e043-49bb-9a50-25d28bbdcb8b service nova] Creating event network-vif-plugged:9418f06f-810a-4eef-9f26-07ef87d2f183 for instance b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df on n-h1-858384-19 Nov 02 14:04:47.310213 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-88014150-ecb1-4701-a303-c25d355965e7 req-2621d793-e043-49bb-9a50-25d28bbdcb8b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034218 Nov 02 14:04:47.310825 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3433/7238] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:48.170082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:48.170709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:48.177708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:48.178193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:48.178638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:48.179369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:48.179828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:48.180256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:48.317193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:48.324966 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1906af12-0045-4c05-a947-94d25a6f2a19 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1206 microversion: 2.1 time: 0.158880 Nov 02 14:04:48.325543 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3806/7239] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:48 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1206 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:49.350028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:49.350795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:49.357868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.358345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.358786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.359665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.360179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.360616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.492249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.500872 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c2803f4b-1fd8-49bc-8af9-efe9fca5c61e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1394 microversion: 2.1 time: 0.154631 Nov 02 14:04:49.501483 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3434/7240] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:49 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1394 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:49.523945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:49.524562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:49.532411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.532939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.533381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.534290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.534755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.535219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.666314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.674354 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-76d2e8e7-cce5-4734-89d7-536288e7f224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1394 microversion: 2.1 time: 0.154336 Nov 02 14:04:49.674943 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3807/7241] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:49 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1394 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:49.697026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:49.697572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:49.704290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.704775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.705218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.705915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.706374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.706807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.838462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:49.846594 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e2b5d021-b888-4ac9-becc-c547e3511450 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1394 microversion: 2.1 time: 0.153531 Nov 02 14:04:49.847262 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3435/7242] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:49 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1394 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:49.869253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:49.869762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:49.876779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.877273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.877725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.878428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.878891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.879357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:49.904713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:04:49.981839 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1dceeefa-8a25-4dd5-9356-96e67f712bfe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 204 len: 0 microversion: 2.1 time: 0.116094 Nov 02 14:04:49.982453 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3808/7243] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:04:49 2022] DELETE /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:04:49.991833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:49.992520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:49.998548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:49.999028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:49.999494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:50.001005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:50.001678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:50.002114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:50.133253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:50.141373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bb33cab4-1e0a-4bec-a9d5-1c9df5fc2e14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1400 microversion: 2.1 time: 0.153269 Nov 02 14:04:50.141863 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3436/7244] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:49 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1400 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:51.164746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:51.165464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:51.173583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:51.174094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:51.174542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:51.175281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:51.175744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:51.176183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:51.312146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:51.320179 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8abb974-892b-4769-b9d6-581c4f17755c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1400 microversion: 2.1 time: 0.159744 Nov 02 14:04:51.320763 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3809/7245] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:51 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1400 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:52.278676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4d0a039c-e8d9-46d3-99fc-02800384db16 req-44d52cff-9856-4762-a665-7b2d9da8886c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df", "name": "network-vif-deleted", "tag": "9418f06f-810a-4eef-9f26-07ef87d2f183"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:04:52.302009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4d0a039c-e8d9-46d3-99fc-02800384db16 req-44d52cff-9856-4762-a665-7b2d9da8886c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.302780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4d0a039c-e8d9-46d3-99fc-02800384db16 req-44d52cff-9856-4762-a665-7b2d9da8886c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.303251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4d0a039c-e8d9-46d3-99fc-02800384db16 req-44d52cff-9856-4762-a665-7b2d9da8886c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.317023 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4d0a039c-e8d9-46d3-99fc-02800384db16 req-44d52cff-9856-4762-a665-7b2d9da8886c service nova] Creating event network-vif-deleted:9418f06f-810a-4eef-9f26-07ef87d2f183 for instance b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df on n-h1-858384-19 Nov 02 14:04:52.324731 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4d0a039c-e8d9-46d3-99fc-02800384db16 req-44d52cff-9856-4762-a665-7b2d9da8886c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050155 Nov 02 14:04:52.325364 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3437/7246] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:04:52.343515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:52.344896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:52.352998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.353501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.353954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.354712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:52.355250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:52.355700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:52.425691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:52.434103 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-482dd575-718d-4466-b021-ba5e9b2452b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1191 microversion: 2.1 time: 0.094620 Nov 02 14:04:52.434702 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3810/7247] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:52 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:53.460491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:53.461854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:53.468297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.469182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.469947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.470669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:53.471149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:53.471587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:53.538847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:53.547308 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9604d7e-fc07-4943-966f-6a3406228449 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1191 microversion: 2.1 time: 0.091806 Nov 02 14:04:53.553636 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3438/7248] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:53 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:54.571821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:54.572446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:54.579998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.580508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.580967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.581694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:54.582162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:54.582602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:54.651306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:54.659633 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-977f38d2-3081-4fb4-8195-c03d62dd15a7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1191 microversion: 2.1 time: 0.091710 Nov 02 14:04:54.660233 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3811/7249] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:54 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:55.684822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:55.685440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:55.693255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:55.693753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:55.694197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:55.694912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:55.695394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:55.695863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:55.758731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:55.769123 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aaf3fa7c-c64d-4016-a48a-efd07e836159 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1191 microversion: 2.1 time: 0.088318 Nov 02 14:04:55.783135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3439/7250] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:55 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:56.792669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:56.793292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:56.801799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.802287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.802734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.803483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.803943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.804374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.839970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:56.840452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:56.840894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:56.841341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lazy-loading 'fault' on Instance uuid b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:04:56.886574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:04:56.890116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:04:56.895650 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af1dc49f-c071-4d6a-a01e-efda93c891ca tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 200 len: 1196 microversion: 2.1 time: 0.107002 Nov 02 14:04:56.896251 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3812/7251] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:56 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 1196 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:04:57.918336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:04:57.918852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:04:57.925907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:57.926397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:57.926849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:57.927596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:04:57.928054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:04:57.928487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:04:57.942413 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df could not be found. Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df HTTP/1.1 Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df could not be found. Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df'} Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df could not be found. Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df could not be found. Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:04:57.944112 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df could not be found. Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-102f7e9f-1269-4d45-aaa7-7e8da72c4ed3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df" status: 404 len: 111 microversion: 2.1 time: 0.031313 Nov 02 14:04:57.948253 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3440/7252] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:04:57 2022] GET /compute/v2.1/servers/b1b7e7f1-f6b9-4c8e-a62d-abffc072a1df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:05:02.918078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-85229980", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "eb60ed5b-0929-4190-984d-cd801dbc7efa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a091e626-fbaf-4376-b09d-38c161b3ee11"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:02.929568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:02.980933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] validate_networks() for [('a091e626-fbaf-4376-b09d-38c161b3ee11', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:05:03.351060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:05:03.351515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:05:03.351991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:05:03.352404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:05:03.352811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:05:03.363678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:03.364157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:03.364596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:03.365319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:03.365804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:03.366230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:03.383642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:05:03.388868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for user 5b2bb8e9b22043ca88ee5a68f23358d1 and project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:05:03.445409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:05:03.447454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb60ed5b-0929-4190-984d-cd801dbc7efa',volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:05:03.591372 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d2ac7f7e-e65e-4b72-bc45-3cfaa46f238c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.677777 Nov 02 14:05:03.592037 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3813/7253] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:05:02 2022] POST /compute/v2.1/servers => generated 382 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:05:03.603481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a4d432c-13dc-4ea4-a182-95572e605f8c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:03.604029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7a4d432c-13dc-4ea4-a182-95572e605f8c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:03.607096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=35 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:03.667715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7a4d432c-13dc-4ea4-a182-95572e605f8c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:03.675654 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a4d432c-13dc-4ea4-a182-95572e605f8c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1058 microversion: 2.1 time: 0.076090 Nov 02 14:05:03.676366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3441/7254] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:03 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1058 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:04.700199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:04.700793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:04.708777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.709383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.709827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.710534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:04.710997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:04.711454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:04.784291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:04.792448 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-58684e09-397d-40d9-8bf9-b3e669ee137b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1164 microversion: 2.1 time: 0.097048 Nov 02 14:05:04.793191 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3814/7255] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:04 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1164 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:05.818596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:05.819284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:05.830985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.831639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.832269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.833333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:05.834207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:05.834746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:05.839102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=79 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:06.067945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:06.077079 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c42fb326-4d5e-462b-b282-9f1b5393b71a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1216 microversion: 2.1 time: 0.262749 Nov 02 14:05:06.079586 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3442/7256] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:05 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1216 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:06.222080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7a889989-a6c9-4162-9c07-9cd133a53a08 req-48f75721-8ef6-4aa3-8085-2ad4bd78151d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d800dabf-cae2-4590-9218-25e95b0de508", "tag": "0e37c961-cce5-4803-bd54-8298329b4959"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:06.236937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7a889989-a6c9-4162-9c07-9cd133a53a08 req-48f75721-8ef6-4aa3-8085-2ad4bd78151d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:06.237614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7a889989-a6c9-4162-9c07-9cd133a53a08 req-48f75721-8ef6-4aa3-8085-2ad4bd78151d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:06.238413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7a889989-a6c9-4162-9c07-9cd133a53a08 req-48f75721-8ef6-4aa3-8085-2ad4bd78151d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:06.256258 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7a889989-a6c9-4162-9c07-9cd133a53a08 req-48f75721-8ef6-4aa3-8085-2ad4bd78151d service nova] Creating event network-changed:0e37c961-cce5-4803-bd54-8298329b4959 for instance d800dabf-cae2-4590-9218-25e95b0de508 on n-h1-858384-19 Nov 02 14:05:06.263408 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7a889989-a6c9-4162-9c07-9cd133a53a08 req-48f75721-8ef6-4aa3-8085-2ad4bd78151d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045800 Nov 02 14:05:06.264378 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3815/7257] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:07.102071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:07.102882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:07.113466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:07.114117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:07.114677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:07.115565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:07.116147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:07.116688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:07.363817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:07.375377 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9a74ee2-47c6-4b70-ab71-801f28eaaa88 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1216 microversion: 2.1 time: 0.276743 Nov 02 14:05:07.376135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3443/7258] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:07 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1216 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:08.401464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:08.402168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:08.409368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:08.409860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:08.410369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:08.411021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:08.411507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:08.411970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:08.547191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:08.555485 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d80db1b1-bbd9-4a82-ad56-f64d939d75bf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1216 microversion: 2.1 time: 0.159244 Nov 02 14:05:08.556193 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3816/7259] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:08 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:09.579090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:09.579942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:09.587244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:09.587743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:09.588183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:09.588902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:09.589353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:09.589778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:09.739627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:09.748088 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-927ba32d-5777-4585-b9d1-05af50220e70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1216 microversion: 2.1 time: 0.173286 Nov 02 14:05:09.748902 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3444/7260] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:09 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:10.771509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:10.772130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:10.778588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:10.779060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:10.779534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:10.780223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:10.781468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:10.781468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:10.911916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:10.919910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0325a2c1-eb56-4a20-a17f-e048e547bcaf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.152712 Nov 02 14:05:10.920494 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3817/7261] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:10 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:11.944082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:11.944624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:11.951239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:11.951715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:11.952150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:11.952908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:11.953365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:11.953784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:12.095916 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:12.104055 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4306298a-8eee-4311-85a3-72f7ed96acd8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.163966 Nov 02 14:05:12.104650 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3445/7262] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:11 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:13.128486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:13.129125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:13.135600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:13.136078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:13.136516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:13.137201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:13.137655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:13.138082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:13.272796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:13.280703 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09ac39c0-fc8f-46ac-851f-61047c68b753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.156389 Nov 02 14:05:13.281373 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3818/7263] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:13 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:14.303569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:14.304190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:14.306921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:14.313045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:14.313532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:14.313978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:14.314691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:14.315178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:14.315612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:14.757486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:14.765933 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b3af648-2def-4281-b9d6-a6f80a17d312 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.466309 Nov 02 14:05:14.766528 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3446/7264] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:14 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:15.789865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:15.790478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:15.792500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:15.793437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:15.801462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:15.801942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:15.802387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:15.803096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:15.803578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:15.804062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:15.937231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:15.945099 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b691338-9c67-4948-b4e6-7bcfc988cc0e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.159174 Nov 02 14:05:15.945727 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3819/7265] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:15 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:16.969543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:16.970236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:16.977366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:16.977847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:16.978283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:16.979091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:16.979570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:16.979998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:17.111917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:17.119690 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e33742ce-d3d3-4e51-b1a4-f46471ef366a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.155099 Nov 02 14:05:17.120318 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3447/7266] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:16 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:18.143316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:18.143929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:18.150727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:18.151252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:18.151784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:18.152480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:18.152928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:18.153355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:18.286706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:18.294598 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-726f1173-4b93-4632-91ca-92f199b15b70 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.155883 Nov 02 14:05:18.295197 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3820/7267] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:18 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:19.318622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:19.319270 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:19.326232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:19.326719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:19.327826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:19.328551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:19.329039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:19.329469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:19.480675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:19.489005 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22808d75-8e56-4b23-a1c5-0e3e7c8c4198 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.174291 Nov 02 14:05:19.489626 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3448/7268] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:19 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:20.512140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:20.512757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:20.520059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:20.520516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:20.520966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:20.521695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:20.522155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:20.522605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:20.660309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:20.668197 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0bf0ffb1-55ed-4d46-8059-8e39efe37340 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.160113 Nov 02 14:05:20.668772 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3821/7269] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:20 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:21.534109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-2eccaa93-382a-443a-bdbc-f6c953267134 req-2aa0ec37-f682-490a-89d4-72eaad400ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d800dabf-cae2-4590-9218-25e95b0de508", "name": "network-vif-plugged", "status": "completed", "tag": "0e37c961-cce5-4803-bd54-8298329b4959"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:21.545735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2eccaa93-382a-443a-bdbc-f6c953267134 req-2aa0ec37-f682-490a-89d4-72eaad400ab1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:21.546744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2eccaa93-382a-443a-bdbc-f6c953267134 req-2aa0ec37-f682-490a-89d4-72eaad400ab1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:21.546744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-2eccaa93-382a-443a-bdbc-f6c953267134 req-2aa0ec37-f682-490a-89d4-72eaad400ab1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:21.558634 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-2eccaa93-382a-443a-bdbc-f6c953267134 req-2aa0ec37-f682-490a-89d4-72eaad400ab1 service nova] Creating event network-vif-plugged:0e37c961-cce5-4803-bd54-8298329b4959 for instance d800dabf-cae2-4590-9218-25e95b0de508 on n-h1-858384-19 Nov 02 14:05:21.564910 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-2eccaa93-382a-443a-bdbc-f6c953267134 req-2aa0ec37-f682-490a-89d4-72eaad400ab1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035405 Nov 02 14:05:21.565507 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3449/7270] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:21.692330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:21.692908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:21.700016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:21.700514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:21.700967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:21.701689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:21.702709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:21.703191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:21.840169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:21.848785 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b76a8020-cf7d-4701-a91a-f371ffdfa549 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.160585 Nov 02 14:05:21.849387 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3822/7271] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:21 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:22.874876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:22.875622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:22.882392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:22.882874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:22.883337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:22.884031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:22.884480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:22.884913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:23.021800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:23.029832 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-10bdc5c0-0bbd-4530-bb15-0fee23ec3333 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1204 microversion: 2.1 time: 0.160847 Nov 02 14:05:23.030990 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3450/7272] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:22 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1204 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:24.053402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:24.054024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:24.061033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.062065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.062512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.063242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.063704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.064136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.198517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:24.207394 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4be80b5f-7cb9-4805-a673-db1865a38b22 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1391 microversion: 2.1 time: 0.157948 Nov 02 14:05:24.207983 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3823/7273] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:24 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:24.230159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:24.230771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:24.238006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.238489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.238929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.239655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.240113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.240541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.369878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:24.378339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5728aaf-378f-4675-a667-ed95e09c2b2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1391 microversion: 2.1 time: 0.152090 Nov 02 14:05:24.378927 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3451/7274] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:24 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:24.401271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:24.401893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:24.408693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.409184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.409639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.410339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.410801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.411277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.545041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:24.553985 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be4c88dd-a578-4fe4-b610-375847963f11 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1391 microversion: 2.1 time: 0.156506 Nov 02 14:05:24.554833 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3824/7275] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:24 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:24.576137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:24.576579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:24.583296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.583786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.584226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.584945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.585418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.585854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.612575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:05:24.686608 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d5dffc5a-172e-45a1-9008-6f6082b01115 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 204 len: 0 microversion: 2.1 time: 0.114280 Nov 02 14:05:24.687246 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3452/7276] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:05:24 2022] DELETE /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:05:24.697422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:24.698067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:24.704302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.704790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.705235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.705939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:24.706402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:24.706833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:24.846868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:24.854843 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79a79293-8957-4ddf-b8a3-437cdcbe1d5e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1397 microversion: 2.1 time: 0.163031 Nov 02 14:05:24.855465 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3825/7277] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:24 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1397 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:25.880877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:25.881504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:25.889161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:25.889694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:25.890240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:25.891027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:25.891505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:25.891937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:26.021726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:26.029728 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4621455d-57b0-4e84-8085-328d6cfcf6a4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1397 microversion: 2.1 time: 0.153295 Nov 02 14:05:26.030908 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3453/7278] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:25 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1397 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:26.954896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f26f3b2e-476d-4efa-83e8-bfc69b0d4ff8 req-aa9816b4-c0cc-48f5-90fc-cb8cd7581a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d800dabf-cae2-4590-9218-25e95b0de508", "name": "network-vif-deleted", "tag": "0e37c961-cce5-4803-bd54-8298329b4959"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:26.965337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f26f3b2e-476d-4efa-83e8-bfc69b0d4ff8 req-aa9816b4-c0cc-48f5-90fc-cb8cd7581a0d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:26.966014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f26f3b2e-476d-4efa-83e8-bfc69b0d4ff8 req-aa9816b4-c0cc-48f5-90fc-cb8cd7581a0d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:26.966241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f26f3b2e-476d-4efa-83e8-bfc69b0d4ff8 req-aa9816b4-c0cc-48f5-90fc-cb8cd7581a0d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:26.979179 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f26f3b2e-476d-4efa-83e8-bfc69b0d4ff8 req-aa9816b4-c0cc-48f5-90fc-cb8cd7581a0d service nova] Creating event network-vif-deleted:0e37c961-cce5-4803-bd54-8298329b4959 for instance d800dabf-cae2-4590-9218-25e95b0de508 on n-h1-858384-19 Nov 02 14:05:26.986168 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f26f3b2e-476d-4efa-83e8-bfc69b0d4ff8 req-aa9816b4-c0cc-48f5-90fc-cb8cd7581a0d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125723 Nov 02 14:05:26.987903 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3826/7279] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:05:27.055813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:27.056435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:27.064330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:27.064821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:27.065261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:27.065974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:27.066424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:27.066860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:27.131876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:27.142062 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2863e80c-8303-41ce-9b2c-c8f70ce21571 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1189 microversion: 2.1 time: 0.088846 Nov 02 14:05:27.142687 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3454/7280] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:27 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1189 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:28.167613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:28.168318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:28.175318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:28.175808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:28.176294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:28.177077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:28.177529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:28.177958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:28.243737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:28.252502 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c169bd91-4bbc-45d6-9d4c-e2a79a4944f0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1189 microversion: 2.1 time: 0.090110 Nov 02 14:05:28.253092 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3827/7281] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:28 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1189 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:29.277788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:29.278537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:29.286457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:29.286953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:29.287426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:29.288150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:29.288606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:29.289035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:29.364077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:29.372467 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-532eed66-1081-434c-b803-6610fdc7c28a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1189 microversion: 2.1 time: 0.098649 Nov 02 14:05:29.373075 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3455/7282] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:29 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1189 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:05:30.396953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:30.397707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:30.405967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.406461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.406908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.407662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:30.408120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:30.408552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:30.473418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:30.481853 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f27476c1-4599-4187-93e5-584927b649d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1189 microversion: 2.1 time: 0.088881 Nov 02 14:05:30.482692 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3828/7283] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:30 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1189 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:31.508181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:31.508790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:31.516855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:31.517347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:31.517792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:31.518533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:31.518987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:31.519449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:31.554231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:31.554747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:31.555284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:31.556001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lazy-loading 'fault' on Instance uuid d800dabf-cae2-4590-9218-25e95b0de508 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:05:31.604149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:31.613095 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-117e9a96-a178-4353-8625-5c1995f1fd51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 200 len: 1194 microversion: 2.1 time: 0.108828 Nov 02 14:05:31.614299 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3456/7284] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:31 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 1194 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:32.641317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:32.641929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d800dabf-cae2-4590-9218-25e95b0de508] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:32.649165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:32.649657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:32.650100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:32.650814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:32.651312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:32.651754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:32.667084 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance d800dabf-cae2-4590-9218-25e95b0de508 could not be found. Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 HTTP/1.1 Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance d800dabf-cae2-4590-9218-25e95b0de508 could not be found. Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'd800dabf-cae2-4590-9218-25e95b0de508'} Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d800dabf-cae2-4590-9218-25e95b0de508 could not be found. Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d800dabf-cae2-4590-9218-25e95b0de508 could not be found. Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:05:32.668973 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d800dabf-cae2-4590-9218-25e95b0de508 could not be found. Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance d800dabf-cae2-4590-9218-25e95b0de508 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5e7cc479-e43e-4415-9700-04880b5b2116 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508" status: 404 len: 111 microversion: 2.1 time: 0.033895 Nov 02 14:05:32.673413 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3829/7285] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:32 2022] GET /compute/v2.1/servers/d800dabf-cae2-4590-9218-25e95b0de508 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:05:54.843414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-726737108", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "53ace94a-d7b8-42f8-93bc-5270593a21d0", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a091e626-fbaf-4376-b09d-38c161b3ee11"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:54.854883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:54.855730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:54.937425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] validate_networks() for [('a091e626-fbaf-4376-b09d-38c161b3ee11', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:05:55.357597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:05:55.358028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:05:55.358512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:05:55.358931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:05:55.359400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:05:55.369057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:55.369579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:55.370051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:55.370858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:55.371366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:55.371803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:55.390016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:05:55.396652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for user 5b2bb8e9b22043ca88ee5a68f23358d1 and project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:05:55.409790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:05:55.411871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='53ace94a-d7b8-42f8-93bc-5270593a21d0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:05:55.485471 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e6679d00-31ec-4837-bc3b-64e2700c86dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.646218 Nov 02 14:05:55.486184 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3457/7286] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:05:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:05:55.498158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f52632a-4e6f-4d59-9793-f00fb01a99f4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:55.498920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2f52632a-4e6f-4d59-9793-f00fb01a99f4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:55.501128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:55.502557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=86 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:05:55.904759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2f52632a-4e6f-4d59-9793-f00fb01a99f4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:55.912463 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f52632a-4e6f-4d59-9793-f00fb01a99f4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1059 microversion: 2.1 time: 0.418392 Nov 02 14:05:55.913049 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3830/7287] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:55 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1059 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:56.938534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:56.939707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:56.947844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:56.948473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:56.949035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:56.949860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:56.950423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:56.951401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:57.044206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:57.060227 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4acfd7ec-54e0-4116-a7b9-5ba9f14c8cd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1129 microversion: 2.1 time: 0.128260 Nov 02 14:05:57.062307 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3458/7288] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:56 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1129 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:58.103403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:58.104025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:58.113257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:58.113751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:58.114194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:58.114926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:58.115394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:58.115832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:58.208243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d74ecccb-cc72-4b23-882a-c07aeaefb5b7 req-7447f402-0299-4dc4-bf70-566888cf9d9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d1124f-6f9b-4e55-8a3f-445bf305b712", "tag": "89d8cf7b-da8c-4d36-8b2c-c0bee34d75f3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:05:58.222879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d74ecccb-cc72-4b23-882a-c07aeaefb5b7 req-7447f402-0299-4dc4-bf70-566888cf9d9c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:58.223750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d74ecccb-cc72-4b23-882a-c07aeaefb5b7 req-7447f402-0299-4dc4-bf70-566888cf9d9c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:58.224745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d74ecccb-cc72-4b23-882a-c07aeaefb5b7 req-7447f402-0299-4dc4-bf70-566888cf9d9c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:58.239198 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d74ecccb-cc72-4b23-882a-c07aeaefb5b7 req-7447f402-0299-4dc4-bf70-566888cf9d9c service nova] Creating event network-changed:89d8cf7b-da8c-4d36-8b2c-c0bee34d75f3 for instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 on n-h1-858384-19 Nov 02 14:05:58.246180 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d74ecccb-cc72-4b23-882a-c07aeaefb5b7 req-7447f402-0299-4dc4-bf70-566888cf9d9c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041698 Nov 02 14:05:58.247586 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3459/7289] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:05:58.275378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:58.284787 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3f294e86-a9d1-4efc-928a-5f5fbb41adce tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.185641 Nov 02 14:05:58.285967 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3831/7290] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:58 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:05:59.309421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:05:59.310139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:05:59.317346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:59.317841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:59.318289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:59.319002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:05:59.319563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:05:59.319997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:05:59.456727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:05:59.465017 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cb5c4957-72c5-41d4-9248-71350596b59b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.160853 Nov 02 14:05:59.465600 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3460/7291] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:05:59 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:00.490362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:00.491425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:00.499096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:00.499606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:00.500233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:00.500949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:00.501548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:00.502168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:00.685951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:00.697339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aa9f7412-d585-4dcc-a417-82b2b9283673 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.212915 Nov 02 14:06:00.697911 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3832/7292] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:00 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:01.724458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:01.725812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:01.737003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:01.737586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:01.737679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:01.738395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:01.739509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:01.739509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:01.941466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:01.951029 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-487268f1-0b3c-4a25-bb58-ea5677f20587 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.232055 Nov 02 14:06:01.952577 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3461/7293] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:01 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:02.987828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:02.989173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:02.997040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:02.997861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:02.998952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:02.999221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:02.999689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:03.002828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:03.153536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:03.162395 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fcc76650-961d-463e-a305-71a69fc32cb6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.179304 Nov 02 14:06:03.163006 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3833/7294] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:02 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:04.186183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:04.186766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:04.194757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:04.195296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:04.195742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:04.196455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:04.196920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:04.197353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:04.338558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:04.347605 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-57842fb5-b616-44cd-84fa-dbea51b352cb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.165619 Nov 02 14:06:04.348198 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3462/7295] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:04 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:05.371614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:05.372378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:05.380027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:05.380521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:05.380967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:05.381685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:05.382174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:05.382616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:05.513502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:05.521317 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0dccbf69-49cc-4081-8415-ad28bb5e0d37 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.153668 Nov 02 14:06:05.521899 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3834/7296] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:05 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:06.544280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:06.544899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:06.547749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:06.548646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:06.556540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:06.556929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:06.557381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:06.558098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:06.558556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:06.558988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:06.700585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:06.709222 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-be06ebea-da11-4598-bd3a-b501ae46f308 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.168926 Nov 02 14:06:06.709749 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3463/7297] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:06 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:07.732248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:07.732865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:07.734722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:07.741706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:07.742202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:07.742647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:07.743390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:07.743853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:07.744290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:07.884451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:07.892816 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b69c65ef-f8df-4838-9e93-debda1326aba tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.164502 Nov 02 14:06:07.893654 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3835/7298] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:07 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:08.916930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:08.917579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:08.924593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:08.925244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:08.925691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:08.926400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:08.926861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:08.927326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:09.058669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:09.067848 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a4eb8d57-c16b-4038-988d-1fe3f847b91c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.154634 Nov 02 14:06:09.068442 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3464/7299] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:08 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:10.098589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:10.099267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:10.106206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.106696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.107159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:10.107867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:10.108327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:10.108756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:10.245902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:10.254826 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ba017628-3513-4198-9cd9-8c2504cbaf6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1171 microversion: 2.1 time: 0.160923 Nov 02 14:06:10.255797 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3836/7300] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:10 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1171 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:11.278208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:11.278878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:11.287687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:11.288062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:11.288500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:11.289389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:11.290045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:11.290516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:11.422982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:11.430961 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20d1dcf1-a4a4-4350-886e-6dd4f39ebea9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.156827 Nov 02 14:06:11.431576 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3465/7301] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:11 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:12.454820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:12.455466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:12.463306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.463806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.464255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.464981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:12.465442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:12.466001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:12.605608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:12.614466 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2551d461-40e0-4a83-80fc-705043cd0a62 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.163666 Nov 02 14:06:12.615059 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3837/7302] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:12 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:13.637424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:13.638035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:13.645577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.646052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.646485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:13.647202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:13.647660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:13.648085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:13.783823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:13.792342 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f811548d-c885-4f56-ba30-2c1a499ed5ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.158849 Nov 02 14:06:13.792917 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3466/7303] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:13 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:14.815839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:14.816500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:14.823100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:14.823615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:14.824063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:14.824774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:14.825234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:14.825673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:14.959692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:14.967523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-173aee88-7fb2-4c60-b549-85690900e5d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.155956 Nov 02 14:06:14.968104 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3838/7304] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:14 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:15.992197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:15.992806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:15.999617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:16.000102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:16.000542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:16.001236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:16.001720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:16.002153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:16.132127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:16.139876 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-34025d06-10dc-443c-846c-d2ae29154d45 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.152608 Nov 02 14:06:16.140451 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3467/7305] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:15 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:17.163841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:17.164454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:17.171617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.172110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.172560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.173273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:17.173734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:17.174169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:17.306645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:17.314483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-094ce5a8-b7a9-41de-beba-626e22cf20fe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.155185 Nov 02 14:06:17.315058 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3839/7306] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:17 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:18.338239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:18.338891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:18.345941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.346430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.346875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.347606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:18.348992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:18.349923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:18.489344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:18.497538 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eb573dc9-0419-4e7d-85e7-69a15f52e6d5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.163343 Nov 02 14:06:18.498127 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3468/7307] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:18 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:19.523304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:19.523867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:19.530902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:19.531421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:19.531868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:19.532584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:19.533042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:19.533474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:19.674540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:19.683386 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f696e471-f428-4292-aa68-04861050b270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.165501 Nov 02 14:06:19.683992 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3840/7308] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:19 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:20.706197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:20.706812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:20.713832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.714318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.714761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.715491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:20.716009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:20.716444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:20.848881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:20.856721 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-10af7f61-5f3d-4c7e-ade3-90d5015bb7c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.154463 Nov 02 14:06:20.857301 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3469/7309] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:20 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:21.793512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-239cf875-3afd-43bd-a754-e464d0700659 req-4289d234-7242-481e-961b-70949e802d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d1124f-6f9b-4e55-8a3f-445bf305b712", "name": "network-vif-plugged", "status": "completed", "tag": "89d8cf7b-da8c-4d36-8b2c-c0bee34d75f3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:21.806428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-239cf875-3afd-43bd-a754-e464d0700659 req-4289d234-7242-481e-961b-70949e802d5b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.806856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-239cf875-3afd-43bd-a754-e464d0700659 req-4289d234-7242-481e-961b-70949e802d5b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.807493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-239cf875-3afd-43bd-a754-e464d0700659 req-4289d234-7242-481e-961b-70949e802d5b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.820232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-239cf875-3afd-43bd-a754-e464d0700659 req-4289d234-7242-481e-961b-70949e802d5b service nova] Creating event network-vif-plugged:89d8cf7b-da8c-4d36-8b2c-c0bee34d75f3 for instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 on n-h1-858384-19 Nov 02 14:06:21.825409 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-239cf875-3afd-43bd-a754-e464d0700659 req-4289d234-7242-481e-961b-70949e802d5b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035752 Nov 02 14:06:21.826690 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3841/7310] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:21.881103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:21.881713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:21.888634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.889117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.889586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:21.890291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:21.890743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:21.891271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:22.085755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:22.093585 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b921a5c-c4e8-446f-a839-d808e4040493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.217354 Nov 02 14:06:22.094157 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3470/7311] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:21 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:23.117726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:23.118468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:23.126284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.126777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.127251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.127976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:23.128441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:23.129053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:23.260303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:23.268287 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1e13ca17-30f8-421c-8309-f8fd7f916264 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1205 microversion: 2.1 time: 0.155600 Nov 02 14:06:23.268867 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3842/7312] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:23 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1205 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:24.292881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:24.293502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:24.300408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.300893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.301461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.302168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.302634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.303067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.432682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:24.440736 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-43f36b6a-2c76-423f-84b9-eccc59dcdfee tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1392 microversion: 2.1 time: 0.151919 Nov 02 14:06:24.441320 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3471/7313] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:24 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:24.464508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:24.465149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:24.472036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.472620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.473070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.473794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.474246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.474670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.610462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:24.618755 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f8959174-2b82-4d33-8dc0-e84edfd4a540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1392 microversion: 2.1 time: 0.158233 Nov 02 14:06:24.619366 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3843/7314] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:24 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:24.641034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:24.641640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:24.648185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.648666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.649100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.649788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.650237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.650659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.785798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:24.793844 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7d064a67-5914-440b-a6fc-c3e60fa7683c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1392 microversion: 2.1 time: 0.156689 Nov 02 14:06:24.794422 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3472/7315] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:24 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:24.874608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:24.875134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:24.882847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.883351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.883793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.884488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:24.884941 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:24.885369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:24.911557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:06:24.989311 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f8375ac-478c-426f-a140-a75ce80f4f36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 204 len: 0 microversion: 2.1 time: 0.117576 Nov 02 14:06:24.990050 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3844/7316] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:06:24 2022] DELETE /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:06:24.998782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:24.999436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:25.001289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:25.007246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:25.007740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:25.008187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:25.008899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:25.009393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:25.009826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:25.014743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=89 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:25.144256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:25.152984 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4f8239e8-450e-4a0c-b938-ca923ba2e99a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1398 microversion: 2.1 time: 0.158221 Nov 02 14:06:25.153569 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3473/7317] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:24 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1398 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:26.178040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:26.178748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:26.181510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:26.188253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:26.188741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:26.189185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:26.189908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:26.190362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:26.190796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:26.195353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:26.325320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:26.333718 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bd40e5a6-2bfd-4aa3-85b2-504183a18357 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1398 microversion: 2.1 time: 0.160659 Nov 02 14:06:26.334297 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3845/7318] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:26 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1398 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:27.221172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-bd1f475a-0115-4b5b-b030-54a65c5f0e3e req-5238e088-0e13-4fc4-a58a-bfa618798000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d1124f-6f9b-4e55-8a3f-445bf305b712", "name": "network-vif-deleted", "tag": "89d8cf7b-da8c-4d36-8b2c-c0bee34d75f3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:27.233320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bd1f475a-0115-4b5b-b030-54a65c5f0e3e req-5238e088-0e13-4fc4-a58a-bfa618798000 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.233808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bd1f475a-0115-4b5b-b030-54a65c5f0e3e req-5238e088-0e13-4fc4-a58a-bfa618798000 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.234254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bd1f475a-0115-4b5b-b030-54a65c5f0e3e req-5238e088-0e13-4fc4-a58a-bfa618798000 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.247452 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-bd1f475a-0115-4b5b-b030-54a65c5f0e3e req-5238e088-0e13-4fc4-a58a-bfa618798000 service nova] Creating event network-vif-deleted:89d8cf7b-da8c-4d36-8b2c-c0bee34d75f3 for instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 on n-h1-858384-19 Nov 02 14:06:27.253171 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-bd1f475a-0115-4b5b-b030-54a65c5f0e3e req-5238e088-0e13-4fc4-a58a-bfa618798000 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035620 Nov 02 14:06:27.253795 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3474/7319] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:27.357165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:27.357804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:27.365503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.365996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.366702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.367382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:27.367838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:27.368260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:27.435611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:27.444077 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a853cd3-051d-41c2-9726-c6d639464b0f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1190 microversion: 2.1 time: 0.091032 Nov 02 14:06:27.444760 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3846/7320] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:27 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1190 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:28.470504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:28.471087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:28.479059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:28.479606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:28.480199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:28.480901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:28.481351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:28.481873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:28.553456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:28.561297 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c3abc25-4caa-4a42-b999-c342f3bade48 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1190 microversion: 2.1 time: 0.096236 Nov 02 14:06:28.561879 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3475/7321] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:28 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1190 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:29.584888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:29.586360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:29.594196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:29.594864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:29.595433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:29.596285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:29.596835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:29.597631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:29.673103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:29.682275 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a389a3bb-63ae-4d2a-b817-07dad85fce9b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1190 microversion: 2.1 time: 0.101632 Nov 02 14:06:29.682877 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3847/7322] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:29 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1190 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:30.706149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:30.706663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:30.714269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:30.714764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:30.715239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:30.715954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:30.716408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:30.716884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:30.781498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:30.789722 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3ac70335-9b3b-4f47-83fe-0032e1e68e2d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1190 microversion: 2.1 time: 0.087642 Nov 02 14:06:30.790359 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3476/7323] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:30 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:31.813780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:31.814998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:31.822311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.822816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.823305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.824051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.824733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.825173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.861802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:31.862308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:31.862756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:31.863308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lazy-loading 'fault' on Instance uuid 18d1124f-6f9b-4e55-8a3f-445bf305b712 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:06:31.926739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:31.935301 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a877245e-cd6f-4b65-9e17-32bf3b4b153e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 200 len: 1195 microversion: 2.1 time: 0.125691 Nov 02 14:06:31.935827 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3848/7324] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:31 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 1195 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:32.961591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:32.962205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:32.969094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:32.969577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:32.970019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:32.970718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:32.971204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:32.971636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:32.985714 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 HTTP/1.1 Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '18d1124f-6f9b-4e55-8a3f-445bf305b712'} Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:32.987674 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:32.992692 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:32.992692 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:32.992692 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:32.992692 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:32.992692 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:32.992692 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:32.992692 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:32.992692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:32.992692 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-444bbb70-4960-49db-94a1-3c75b821f23c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 404 len: 111 microversion: 2.1 time: 0.032560 Nov 02 14:06:32.993323 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3477/7325] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:32 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:35.136423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:35.136953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:35.144277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.145889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.146345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.147066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.147563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.148007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.163068 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 HTTP/1.1 Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '18d1124f-6f9b-4e55-8a3f-445bf305b712'} Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:06:35.164796 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-746b2ffa-19df-4aed-85ac-30addc0bde91 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 404 len: 111 microversion: 2.1 time: 0.033888 Nov 02 14:06:35.168247 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3849/7326] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:06:35 2022] DELETE /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:35.175505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:35.176830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 18d1124f-6f9b-4e55-8a3f-445bf305b712] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:35.185221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.185724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.186172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.186890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:35.187384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:35.187823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:35.202569 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 HTTP/1.1 Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '18d1124f-6f9b-4e55-8a3f-445bf305b712'} Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:06:35.204188 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance 18d1124f-6f9b-4e55-8a3f-445bf305b712 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-72f71aec-9069-4900-9a8b-c6eee4f86c4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712" status: 404 len: 111 microversion: 2.1 time: 0.034091 Nov 02 14:06:35.209241 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3478/7327] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:35 2022] GET /compute/v2.1/servers/18d1124f-6f9b-4e55-8a3f-445bf305b712 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:06:54.911525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-839733721", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5a653d83-1dd4-429b-8b65-964978d597e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a091e626-fbaf-4376-b09d-38c161b3ee11"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:54.922291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=11 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:54.923187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=27 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:54.975817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] validate_networks() for [('a091e626-fbaf-4376-b09d-38c161b3ee11', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:06:55.366604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:06:55.367030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:06:55.367544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:06:55.367956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:06:55.368368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:06:55.377372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.377856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.378345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.379084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:55.379566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:55.379995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:55.397742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:06:55.403081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for user 5b2bb8e9b22043ca88ee5a68f23358d1 and project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:06:55.464173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:06:55.466276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a653d83-1dd4-429b-8b65-964978d597e0',volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:06:55.596958 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-98d3c470-cb81-4b67-9ebb-850171ff2cae tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.689373 Nov 02 14:06:55.597624 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3850/7328] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:06:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:06:55.609058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f03bccc-63cc-4292-9374-61bf6783c6c7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:55.609679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6f03bccc-63cc-4292-9374-61bf6783c6c7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:55.612728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=11 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:55.613405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=23 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:06:55.669331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6f03bccc-63cc-4292-9374-61bf6783c6c7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:55.676942 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f03bccc-63cc-4292-9374-61bf6783c6c7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1073 microversion: 2.1 time: 0.071886 Nov 02 14:06:55.677530 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3479/7329] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:55 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1073 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:56.701400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:56.702938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:56.710572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:56.711403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:56.712690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:56.713840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:56.714502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:56.714936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:56.782558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:56.791440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a17b62c5-5f54-4e6b-988d-2dcc1231a4a3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1189 microversion: 2.1 time: 0.094854 Nov 02 14:06:56.792039 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3851/7330] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:56 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1189 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:06:57.815862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:57.816396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:57.828548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:57.829351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:57.829799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:57.830534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:57.830994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:57.831695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.090591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:58.100712 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc654b99-97e7-428a-b210-4ce347ee3b24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1231 microversion: 2.1 time: 0.288191 Nov 02 14:06:58.105103 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3480/7331] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:57 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1231 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:06:58.603278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9c1bd553-317b-4cc3-83f1-d38c97c5d58a req-0bea63a3-9e1e-4a4a-bf86-1d488bc0eea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d92672bc-135e-48cb-bdfa-c05f7346db35", "tag": "51088917-eb61-4282-ae9f-545da2b0b5ef"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:06:58.623993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c1bd553-317b-4cc3-83f1-d38c97c5d58a req-0bea63a3-9e1e-4a4a-bf86-1d488bc0eea1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:58.624582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c1bd553-317b-4cc3-83f1-d38c97c5d58a req-0bea63a3-9e1e-4a4a-bf86-1d488bc0eea1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:58.625357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9c1bd553-317b-4cc3-83f1-d38c97c5d58a req-0bea63a3-9e1e-4a4a-bf86-1d488bc0eea1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:58.654009 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9c1bd553-317b-4cc3-83f1-d38c97c5d58a req-0bea63a3-9e1e-4a4a-bf86-1d488bc0eea1 service nova] Creating event network-changed:51088917-eb61-4282-ae9f-545da2b0b5ef for instance d92672bc-135e-48cb-bdfa-c05f7346db35 on n-h1-858384-19 Nov 02 14:06:58.664084 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9c1bd553-317b-4cc3-83f1-d38c97c5d58a req-0bea63a3-9e1e-4a4a-bf86-1d488bc0eea1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071651 Nov 02 14:06:58.664719 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3852/7332] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:06:59.126484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:06:59.127132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:06:59.136146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:59.136870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:59.137665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:59.138777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:06:59.139292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:06:59.139728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:06:59.401870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:06:59.413582 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-db12b1c5-c51b-45b0-ab91-be3ee33ace6d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1231 microversion: 2.1 time: 0.291602 Nov 02 14:06:59.414180 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3481/7333] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:06:59 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1231 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:00.438317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:00.438918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:00.446582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:00.447073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:00.447542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:00.448256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:00.448743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:00.449521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:00.590680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:00.599784 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-988fbcb3-1644-4ad6-9595-be9e6a51839d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1231 microversion: 2.1 time: 0.165808 Nov 02 14:07:00.600477 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3853/7334] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:00 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1231 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:01.622252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:01.622991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:01.630985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:01.631453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:01.631901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:01.632617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:01.633082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:01.633510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:01.774636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:01.783318 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-344dd1db-7d51-45b2-acea-9ca7b1c5eb4c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1231 microversion: 2.1 time: 0.165046 Nov 02 14:07:01.783914 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3482/7335] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:01 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1231 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:02.806803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:02.807394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:02.814322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:02.814805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:02.815282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:02.816673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:02.817132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:02.817570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:02.948593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:02.956744 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9fb43acc-81e7-4096-be55-1a75a671e9d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.153944 Nov 02 14:07:02.957339 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3854/7336] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:02 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:03.981011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:03.981685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:03.989042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:03.989527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:03.989968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:03.990665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:03.991139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:03.991596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:04.129572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:04.137557 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9cca9eb3-dcf3-4625-936e-a2b1adfefa4f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.160756 Nov 02 14:07:04.138164 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3483/7337] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:03 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:05.160229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:05.160770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:05.168957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:05.169463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:05.169914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:05.170637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:05.171157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:05.171601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:05.307484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:05.315600 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cef28bfb-b465-4872-8df3-9eb08600c507 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.159275 Nov 02 14:07:05.316156 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3855/7338] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:05 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:06.338910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:06.339547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:06.342217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:06.348259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:06.348747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:06.349186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:06.349887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:06.350342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:06.350770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:06.479936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:06.488073 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eccd5ad3-486f-4ac3-91ea-2cebee0cdab5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.153121 Nov 02 14:07:06.488643 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3484/7339] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:06 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:07.511771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:07.512389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:07.514387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:07.515182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:07.522302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:07.522786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:07.523312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:07.523967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:07.524423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:07.524851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:07.660967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:07.668671 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75bf241b-6725-483f-ae09-daaf4032ef14 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.160949 Nov 02 14:07:07.669271 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3856/7340] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:07 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:08.692889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:08.693505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:08.700693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:08.701176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:08.701613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:08.702311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:08.702763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:08.703219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:08.835840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:08.843797 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7039234b-a9cc-44cd-aaba-cd375a5f7947 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.155589 Nov 02 14:07:08.844377 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3485/7341] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:08 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:09.870227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:09.870978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:09.878037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:09.878528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:09.879701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:09.880419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:09.880881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:09.881318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:10.017304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:10.025944 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b517055e-88d2-4247-8dfe-80d2547afb15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.161258 Nov 02 14:07:10.026556 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3857/7342] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:09 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:11.051107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:11.051742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:11.058225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:11.058709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:11.059176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:11.059878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:11.060335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:11.060765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:11.195729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:11.203664 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d3f00bac-55a5-41e4-875c-67f3668413e4 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.157274 Nov 02 14:07:11.204243 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3486/7343] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:11 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:11.986841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f85b533c-69b5-4d2a-a778-1ef69b571f2a req-c180dca9-94cf-4158-99ed-dec986a24652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92672bc-135e-48cb-bdfa-c05f7346db35", "name": "network-vif-plugged", "status": "completed", "tag": "51088917-eb61-4282-ae9f-545da2b0b5ef"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:12.000339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f85b533c-69b5-4d2a-a778-1ef69b571f2a req-c180dca9-94cf-4158-99ed-dec986a24652 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:12.000914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f85b533c-69b5-4d2a-a778-1ef69b571f2a req-c180dca9-94cf-4158-99ed-dec986a24652 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:12.001401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f85b533c-69b5-4d2a-a778-1ef69b571f2a req-c180dca9-94cf-4158-99ed-dec986a24652 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:12.015089 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f85b533c-69b5-4d2a-a778-1ef69b571f2a req-c180dca9-94cf-4158-99ed-dec986a24652 service nova] Creating event network-vif-plugged:51088917-eb61-4282-ae9f-545da2b0b5ef for instance d92672bc-135e-48cb-bdfa-c05f7346db35 on n-h1-858384-19 Nov 02 14:07:12.022017 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f85b533c-69b5-4d2a-a778-1ef69b571f2a req-c180dca9-94cf-4158-99ed-dec986a24652 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039352 Nov 02 14:07:12.022848 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3858/7344] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:12.227536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:12.228149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:12.235403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:12.235884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:12.236324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:12.237278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:12.237728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:12.238282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:12.375995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:12.384445 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-314834a3-b261-4aac-9a7c-d4024493eec9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.160849 Nov 02 14:07:12.385048 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3487/7345] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:12 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:13.407773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:13.408479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:13.418838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:13.419380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:13.419832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:13.420548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:13.421009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:13.421442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:13.564210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:13.573469 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1129f039-fd88-45f3-9e27-f7096036bc4d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1219 microversion: 2.1 time: 0.170069 Nov 02 14:07:13.574268 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3859/7346] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:13 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1219 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:14.597163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:14.598457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:14.605420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.606044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.606539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:14.607197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.607665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.608106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:14.745529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:14.753881 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-faf1896b-77f8-4097-8a9e-4510ad5e3c36 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1407 microversion: 2.1 time: 0.160477 Nov 02 14:07:14.754546 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3488/7347] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:14 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:14.777165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:14.777785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:14.785596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.786214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.786661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:14.787420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.787887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.788328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:14.924420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:14.932552 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-abe7d039-6e2a-4cb7-ad11-043d008bf52b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1407 microversion: 2.1 time: 0.159311 Nov 02 14:07:14.933141 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3860/7348] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:14 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:14.955954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2109964317"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:14.958887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:14.965061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.965544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.965976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:14.966696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:14.967176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:14.967604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:15.063560 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.api [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Attempting to quiesce instance before volume snapshot. Nov 02 14:07:15.135448 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.api [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 02 14:07:15.204170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Creating snapshot from volume 5a653d83-1dd4-429b-8b65-964978d597e0. {{(pid=120929) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Nov 02 14:07:16.019985 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-48e3fa6a-19a9-43b4-859e-dd2d0533b067 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35/action" status: 202 len: 0 microversion: 2.1 time: 1.068190 Nov 02 14:07:16.020636 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3489/7349] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:07:14 2022] POST /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35/action => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 14:07:17.188661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-86041924", "imageRef": "640f27da-80d2-4412-9c2a-4c3c71e045ec", "flavorRef": "452", "networks": [{"uuid": "a091e626-fbaf-4376-b09d-38c161b3ee11"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:17.245788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] validate_networks() for [('a091e626-fbaf-4376-b09d-38c161b3ee11', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:07:17.623992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:07:17.624422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:07:17.624930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:07:17.625347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:07:17.625766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:07:17.635902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:17.636331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:17.636778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:17.637520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:17.637982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:17.638420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:17.656401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:07:17.662121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for user 5b2bb8e9b22043ca88ee5a68f23358d1 and project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:07:17.674413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:07:17.677616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7d7b754e-a03d-4f7d-b59a-1ecc2628630c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:07:17.752467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-48571ab4-2ade-4980-96fa-6d5618f16481 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.567633 Nov 02 14:07:17.753127 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3861/7350] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:07:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:07:17.766532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a21a7eb2-ac14-4f5f-bdba-19e34f2c403a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:17.767137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a21a7eb2-ac14-4f5f-bdba-19e34f2c403a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:17.825687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a21a7eb2-ac14-4f5f-bdba-19e34f2c403a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:17.833110 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a21a7eb2-ac14-4f5f-bdba-19e34f2c403a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1232 microversion: 2.1 time: 0.072064 Nov 02 14:07:17.833712 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3490/7351] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:17 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1232 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:18.858115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:18.859499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:18.866611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:18.867473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:18.867992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:18.869089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:18.869617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:18.870120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:18.946690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:18.954706 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a1ffa2a6-ee3c-4fc9-804f-2068e69b5f04 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1302 microversion: 2.1 time: 0.102062 Nov 02 14:07:18.955421 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3862/7352] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:18 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:19.981186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:19.982737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:19.990875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:19.991431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:19.991887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:19.993234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:19.993724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:19.994174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:20.168613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:20.184788 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40db1ed2-57ca-4212-ac9d-891d13fc672d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.208689 Nov 02 14:07:20.187435 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3491/7353] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:19 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:20.464634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ddf450fc-66c1-4530-83bd-6ed6f624f65a req-c481da5f-01b0-4a3a-a361-4526cb8eb2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a1520f5-23fc-4220-ae5d-f2aee1262ec5", "tag": "bae4c25b-d97a-43bd-bb59-b023945d75d8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:20.475984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ddf450fc-66c1-4530-83bd-6ed6f624f65a req-c481da5f-01b0-4a3a-a361-4526cb8eb2fb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:20.476914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ddf450fc-66c1-4530-83bd-6ed6f624f65a req-c481da5f-01b0-4a3a-a361-4526cb8eb2fb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:20.477628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ddf450fc-66c1-4530-83bd-6ed6f624f65a req-c481da5f-01b0-4a3a-a361-4526cb8eb2fb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:20.495771 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ddf450fc-66c1-4530-83bd-6ed6f624f65a req-c481da5f-01b0-4a3a-a361-4526cb8eb2fb service nova] Creating event network-changed:bae4c25b-d97a-43bd-bb59-b023945d75d8 for instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 on n-h2-858384-19 Nov 02 14:07:20.502652 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ddf450fc-66c1-4530-83bd-6ed6f624f65a req-c481da5f-01b0-4a3a-a361-4526cb8eb2fb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134943 Nov 02 14:07:20.504113 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3863/7354] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:21.213723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:21.215149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:21.223697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:21.224216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:21.224925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:21.225694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:21.226176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:21.226628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:21.388732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:21.399249 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-358f8266-45f3-4c9f-ab74-1a055cf30224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.189610 Nov 02 14:07:21.400843 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3492/7355] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:21 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:22.424486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:22.425867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:22.433440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:22.433935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:22.434385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:22.435119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:22.435594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:22.436036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:22.605783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:22.615359 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-62e28b5f-d4e4-4f09-aa95-ced3e39da40f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.194982 Nov 02 14:07:22.619140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3864/7356] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:22 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:23.640862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:23.642351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:23.653512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.653512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.653512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:23.655369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:23.655369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:23.655592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:23.839339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:23.849145 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e8478a63-3fb9-4014-9392-edfac74b228b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.213175 Nov 02 14:07:23.849854 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3493/7357] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:23 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:24.894970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:24.895964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:24.904382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:24.904887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:24.905332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:24.907072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:24.907845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:24.911172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:24.951051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=73 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:25.117933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:25.126391 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0a6f702-7fe8-4006-9c37-72edd68b3e59 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.236215 Nov 02 14:07:25.127826 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3865/7358] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:24 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:26.150900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:26.151662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:26.154664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=35 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:26.161215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:26.161717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:26.162182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:26.162918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:26.163421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:26.163870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:26.167009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:26.309668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:26.318322 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-84ed2e40-5602-4a5b-8146-63bd99d2ea2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.171383 Nov 02 14:07:26.334962 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3494/7359] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:26 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:27.342846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:27.343622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:27.350477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:27.355908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:27.356416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:27.356853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:27.359335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:27.359827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:27.360273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:27.517563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:27.525732 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-14b0898c-f77c-448e-a1d5-91c4fbce85cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.187097 Nov 02 14:07:27.526335 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3866/7360] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:27 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:28.549890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:28.550853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:28.553419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:28.560258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:28.560762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:28.561307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:28.562181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:28.562809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:28.563288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:28.705244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:28.713978 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6db7b4c9-d207-4324-8ae5-19ca6df8dc9e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.167907 Nov 02 14:07:28.714603 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3495/7361] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:28 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:29.737885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:29.738715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:29.742470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:29.743234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:29.748982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:29.749480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:29.749931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:29.750652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:29.751164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:29.751605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:29.893876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:29.902264 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d30a7deb-fb2c-402b-b02d-4bcc40916ba2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.168916 Nov 02 14:07:29.902861 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3867/7362] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:29 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:30.926113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:30.926766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:30.935519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.936024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.936477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:30.937203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:30.937672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:30.938114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:31.088001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:31.095893 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83bd0de0-b6d0-4b20-81fd-b0e97066c224 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.173805 Nov 02 14:07:31.096493 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3496/7363] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:30 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:32.119873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:32.120395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:32.127340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.128044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.128596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.129478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:32.130045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:32.130780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:32.277828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:32.286783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9cb0c341-e08a-4181-ac4e-672155c08f3b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.171176 Nov 02 14:07:32.287492 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3868/7364] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:32 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:33.310152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:33.311638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:33.319422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.320219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.320909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:33.321942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:33.322830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:33.323516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:33.569450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:33.578872 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c0a60994-27ce-4ac9-b18b-d7e43b711753 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1344 microversion: 2.1 time: 0.272629 Nov 02 14:07:33.579831 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3497/7365] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:33 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1344 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:34.601905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:34.602515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:34.609485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:34.609966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:34.610405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:34.611100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:34.611856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:34.612280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:34.753066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:34.763219 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df6ebce4-f9da-4fde-aff7-4c3e00dcbbfd tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.165107 Nov 02 14:07:34.763998 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3869/7366] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:34 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:35.787651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:35.788505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:35.792273 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:07:35.792273 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:07:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 (ip 10.222.0.113) !!! Nov 02 14:07:35.798083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:35.798606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:35.799157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:35.799886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:35.800353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:35.800793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:35.951843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:35.960426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20db1c44-e00f-4412-9bbe-9945be9cceef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.176938 Nov 02 14:07:35.961031 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3498/7367] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:35 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:36.985846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:36.986763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:36.989368 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:07:36.989538 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 (ip 10.222.0.113) !!! Nov 02 14:07:37.002557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:37.003035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:37.003504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:37.004217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:37.004677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:37.005110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:37.141802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:37.149689 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-12119bc8-84c8-48d8-a41c-ff4b2c9a7b46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.167899 Nov 02 14:07:37.150902 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3870/7368] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:36 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:38.174668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:38.175908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:38.185141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.185825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.186542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:38.187695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:38.188495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:38.189156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:38.331929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:38.339747 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7431588a-6fdc-46c0-9e28-777777545013 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.170608 Nov 02 14:07:38.340334 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3499/7369] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:38 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:39.363023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:39.363782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:39.372038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.372224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.372606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.373332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:39.373965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:39.374472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:39.513899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:39.521801 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e7e58903-6584-49b6-8c72-2dd27ea8e06e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.163679 Nov 02 14:07:39.522400 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3871/7370] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:39 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:40.546933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:40.547622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:40.554376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.555069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.555360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.556086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:40.556563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:40.557049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:40.693614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:40.702368 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3445604c-64ea-4e04-b640-fd48e09839c6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.160395 Nov 02 14:07:40.702955 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3500/7371] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:40 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:41.725099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:41.725652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:41.732595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:41.733076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:41.733512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:41.734208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:41.734662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:41.735084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:41.869499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:41.878061 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c569a886-548b-47e6-bfd4-27728dad1ec7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.157110 Nov 02 14:07:41.878651 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3872/7372] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:41 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:42.903053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:42.903816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:42.911561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:42.912064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:42.912514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:42.913233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:42.913784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:42.914297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:43.070604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:43.080600 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cfae7b78-51b5-4700-b48b-ad0c00555270 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.182277 Nov 02 14:07:43.081416 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3501/7373] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:42 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:44.106037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:44.106872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:44.115204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.115971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.116497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.117384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.117925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.118361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.271791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:44.281104 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0fd2743-3b9d-43d2-b767-3b7b20cda474 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.180164 Nov 02 14:07:44.281746 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3873/7374] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:44 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:44.903934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d3ddb605-998b-454a-adaf-5139be90f46f req-0f745a37-71cb-45f4-a18b-7dbfff5b0851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1520f5-23fc-4220-ae5d-f2aee1262ec5", "name": "network-vif-plugged", "status": "completed", "tag": "bae4c25b-d97a-43bd-bb59-b023945d75d8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:44.915482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3ddb605-998b-454a-adaf-5139be90f46f req-0f745a37-71cb-45f4-a18b-7dbfff5b0851 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:44.916825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3ddb605-998b-454a-adaf-5139be90f46f req-0f745a37-71cb-45f4-a18b-7dbfff5b0851 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:44.916825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3ddb605-998b-454a-adaf-5139be90f46f req-0f745a37-71cb-45f4-a18b-7dbfff5b0851 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:44.930733 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d3ddb605-998b-454a-adaf-5139be90f46f req-0f745a37-71cb-45f4-a18b-7dbfff5b0851 service nova] Creating event network-vif-plugged:bae4c25b-d97a-43bd-bb59-b023945d75d8 for instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 on n-h2-858384-19 Nov 02 14:07:44.937695 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d3ddb605-998b-454a-adaf-5139be90f46f req-0f745a37-71cb-45f4-a18b-7dbfff5b0851 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119728 Nov 02 14:07:44.938318 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3502/7375] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:45.307300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:45.307963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:45.315496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.316078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.316570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.317310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:45.317998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:45.318462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:45.468954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:45.476954 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-71398815-78ba-4f8b-927c-15096e67c2b6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1378 microversion: 2.1 time: 0.174235 Nov 02 14:07:45.477545 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3874/7376] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:45 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1378 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:46.502591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:46.503355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:46.510596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.511036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.512422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.513356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.513887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.514280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.672882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.681172 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ef323e1-58c2-4e01-9c2a-77526f258418 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1565 microversion: 2.1 time: 0.182915 Nov 02 14:07:46.681763 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3503/7377] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:46 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:46.704442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:46.705084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:46.712036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.712520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.712965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.713660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.714116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.714797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.844857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:46.852707 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-98495674-164b-491e-9e43-0bbedfcc216a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1565 microversion: 2.1 time: 0.152193 Nov 02 14:07:46.853292 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3875/7378] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:46 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:46.933858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:46.934410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:46.940552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.941054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.941510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.942222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:46.942695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:46.943159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:46.968713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:07:47.047278 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e42c2a9a-ae1e-4829-9b87-79718ae00cda tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 204 len: 0 microversion: 2.1 time: 0.117621 Nov 02 14:07:47.047826 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3504/7379] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:07:46 2022] DELETE /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:07:47.056338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:47.056977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:47.063380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.063872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.064322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:47.065026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:47.065488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:47.065927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:47.201948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:47.209706 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edc08c3f-be42-4823-8718-ae0f832c9152 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1571 microversion: 2.1 time: 0.157535 Nov 02 14:07:47.210289 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3876/7380] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:47 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:48.233863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:48.234580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:48.241642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:48.242137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:48.242614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:48.243356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:48.243973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:48.244438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:48.382269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:48.390592 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-06789b48-1fdd-4969-a5f7-88997bb45e3d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1571 microversion: 2.1 time: 0.161106 Nov 02 14:07:48.391200 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3505/7381] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:48 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:49.182924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-906adde6-8776-4e57-9220-4c3f5c39ba7b req-1cd43dd3-2830-402a-9fe3-869fbcf75f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1520f5-23fc-4220-ae5d-f2aee1262ec5", "name": "network-vif-deleted", "tag": "bae4c25b-d97a-43bd-bb59-b023945d75d8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:49.196015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-906adde6-8776-4e57-9220-4c3f5c39ba7b req-1cd43dd3-2830-402a-9fe3-869fbcf75f79 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:49.196842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-906adde6-8776-4e57-9220-4c3f5c39ba7b req-1cd43dd3-2830-402a-9fe3-869fbcf75f79 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:49.197579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-906adde6-8776-4e57-9220-4c3f5c39ba7b req-1cd43dd3-2830-402a-9fe3-869fbcf75f79 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:49.210970 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-906adde6-8776-4e57-9220-4c3f5c39ba7b req-1cd43dd3-2830-402a-9fe3-869fbcf75f79 service nova] Creating event network-vif-deleted:bae4c25b-d97a-43bd-bb59-b023945d75d8 for instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 on n-h2-858384-19 Nov 02 14:07:49.219676 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-906adde6-8776-4e57-9220-4c3f5c39ba7b req-1cd43dd3-2830-402a-9fe3-869fbcf75f79 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040725 Nov 02 14:07:49.224228 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3877/7382] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:49.415153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:49.420175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:49.427520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:49.428183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:49.428652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:49.429445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:49.429925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:49.430374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:49.498339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:49.507339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b496ab6e-ad88-4f84-b128-0c49cb63aa2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1363 microversion: 2.1 time: 0.096215 Nov 02 14:07:49.508120 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3506/7383] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:49 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1363 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:50.532599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:50.533350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:50.540823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.541370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.541813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.542528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:50.543576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:50.543970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:50.614117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:50.622996 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f5c5f12-4a24-4fcf-9c76-35aed318c5f7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1363 microversion: 2.1 time: 0.095065 Nov 02 14:07:50.623621 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3878/7384] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:50 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:51.646566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:51.647238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:51.655419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:51.655935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:51.656432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:51.657185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:51.657663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:51.658110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:51.735290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:51.743555 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e2430067-d279-4972-bc41-f03ea340aae7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1363 microversion: 2.1 time: 0.101161 Nov 02 14:07:51.744149 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3507/7385] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:51 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1363 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:52.767080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:52.767724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:52.775126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:52.775729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:52.776187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:52.776940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:52.777451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:52.777903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:52.859322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:52.868336 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a7a7c34c-a948-4536-8e82-c459a1b521a8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1363 microversion: 2.1 time: 0.105184 Nov 02 14:07:52.868918 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3879/7386] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:52 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1363 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:53.506316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:53.507364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:53.514744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.515532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.516332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.517656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.518286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.518885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.570951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:07:53.618236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:53.698272 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e896f020-0b4c-4029-916f-1e0eb7545a2b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "DELETE /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 204 len: 0 microversion: 2.1 time: 0.321152 Nov 02 14:07:53.701486 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3508/7387] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:07:53 2022] DELETE /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:07:53.710228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:53.710917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:53.719752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.720615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.721108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.722020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.722507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.723623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.894833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:53.895793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:53.900839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:53.909784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.910303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.910752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.913980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.918538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.919219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.923232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5eca0b1c-9f7b-41f9-b458-871b8ffdbde7 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1738 microversion: 2.1 time: 0.217449 Nov 02 14:07:53.924455 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3880/7388] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:53 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:53.966684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:53.967336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:53.967946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:53.968489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lazy-loading 'fault' on Instance uuid 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:07:54.013261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:54.021618 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-df7976fb-80ad-4a67-8cd3-f52f030d9e40 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 200 len: 1368 microversion: 2.1 time: 0.131677 Nov 02 14:07:54.022411 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3509/7389] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:53 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 1368 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:07:54.952932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:54.953803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:54.961805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.962621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.963133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.964033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:54.965220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:54.965852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:54.969430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=90 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:55.048306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:55.049161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:55.059765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.060658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.061596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.062461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.063833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.065402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.082626 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 HTTP/1.1 Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7a1520f5-23fc-4220-ae5d-f2aee1262ec5'} Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:55.085061 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.088827 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:55.088827 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:55.088827 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:55.088827 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:07:55.088827 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:07:55.088827 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:07:55.088827 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:55.091526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:07:55.092739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-92e0c293-42b2-4997-854b-52e224a0a8f9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 404 len: 111 microversion: 2.1 time: 0.050915 Nov 02 14:07:55.094241 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3510/7390] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:55 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:07:55.213943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c12ea052c24d73b754c4ece09f7a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b894356f14004ae1b15a35da13667a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:55.224222 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b73a451c-657a-4463-b4f2-353dd215441f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 200 len: 1670 microversion: 2.1 time: 0.276422 Nov 02 14:07:55.225403 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3881/7391] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:54 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 1670 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:07:55.554540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-01517d77-2dcf-4041-b56b-ee18c8718be1 req-3e6e49b8-67c1-46bf-a863-0715fef82e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c7ad13-5db7-4b03-b038-f768182e2700", "name": "network-vif-deleted", "tag": "e8aeddd2-e869-4c37-bdb0-6eb4280b4aa5"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:07:55.570179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-01517d77-2dcf-4041-b56b-ee18c8718be1 req-3e6e49b8-67c1-46bf-a863-0715fef82e9f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:55.570931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-01517d77-2dcf-4041-b56b-ee18c8718be1 req-3e6e49b8-67c1-46bf-a863-0715fef82e9f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:55.571437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-01517d77-2dcf-4041-b56b-ee18c8718be1 req-3e6e49b8-67c1-46bf-a863-0715fef82e9f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:55.585555 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-01517d77-2dcf-4041-b56b-ee18c8718be1 req-3e6e49b8-67c1-46bf-a863-0715fef82e9f service nova] Creating event network-vif-deleted:e8aeddd2-e869-4c37-bdb0-6eb4280b4aa5 for instance 30c7ad13-5db7-4b03-b038-f768182e2700 on n-h2-858384-19 Nov 02 14:07:55.591723 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-01517d77-2dcf-4041-b56b-ee18c8718be1 req-3e6e49b8-67c1-46bf-a863-0715fef82e9f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041641 Nov 02 14:07:55.592348 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3511/7392] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:07:56.253042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:56.253774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:56.262303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.263168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.263803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.264812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.265547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.266035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.283599 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] HTTP exception thrown: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Request method failure captured: Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 HTTP/1.1 Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnhfzw86NVbEQKGwcHv7OyYga_oVTQEb6UbJHXp3UmOcZb1HmBDhAq6IbJYmRrT-eTKzki3LPx2SG9-sYbIqlHplPU8ebLfsvl-oSBiGMsI4IRcUclSp7B7XqyzwWHOe57XwzQ6EM_UBksALsElfjUGD_91l2mNdBE4i77BwxQazhss Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b894356f14004ae1b15a35da13667a3b Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestServerBasicOps-1619436207 Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b894356f14004ae1b15a35da13667a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b894356f14004ae1b15a35da13667a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b894356f14004ae1b15a35da13667a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b894356f14004ae1b15a35da13667a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestServerBasicOps-1619436207 Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b894356f14004ae1b15a35da13667a3b Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestServerBasicOps-1619436207 Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestServerBasicOps-1619436207-project Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f5c12ea052c24d73b754c4ece09f7a1c Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestServerBasicOps-1619436207-project Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '30c7ad13-5db7-4b03-b038-f768182e2700'} Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:56.285592 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.292076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:56.292076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:56.292076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:56.292076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:07:56.292076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:07:56.292076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.292076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.295940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Returning 404 to user: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:07:56.296954 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fc31c4fc-5786-4c63-8b72-5a12fd7a42f6 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 404 len: 111 microversion: 2.1 time: 0.048197 Nov 02 14:07:56.297856 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3882/7393] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:56 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:07:56.868113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:56.869009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:56.871040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:56.877008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.877637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.878159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.878865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.879358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.879810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.895288 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] HTTP exception thrown: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Request method failure captured: Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 HTTP/1.1 Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnhfzw86NVbEQKGwcHv7OyYga_oVTQEb6UbJHXp3UmOcZb1HmBDhAq6IbJYmRrT-eTKzki3LPx2SG9-sYbIqlHplPU8ebLfsvl-oSBiGMsI4IRcUclSp7B7XqyzwWHOe57XwzQ6EM_UBksALsElfjUGD_91l2mNdBE4i77BwxQazhss Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: b894356f14004ae1b15a35da13667a3b Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestServerBasicOps-1619436207 Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b894356f14004ae1b15a35da13667a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b894356f14004ae1b15a35da13667a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b894356f14004ae1b15a35da13667a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b894356f14004ae1b15a35da13667a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestServerBasicOps-1619436207 Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: b894356f14004ae1b15a35da13667a3b Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestServerBasicOps-1619436207 Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestServerBasicOps-1619436207-project Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: f5c12ea052c24d73b754c4ece09f7a1c Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestServerBasicOps-1619436207-project Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '30c7ad13-5db7-4b03-b038-f768182e2700'} Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:07:56.897025 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Returning 404 to user: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-75caf8ac-8e40-4746-a6ff-d08a88fc89e0 tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "DELETE /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 404 len: 111 microversion: 2.1 time: 0.035636 Nov 02 14:07:56.906311 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3512/7394] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:07:56 2022] DELETE /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:07:56.908681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:56.909407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] [instance: 30c7ad13-5db7-4b03-b038-f768182e2700] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:56.916712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.917311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.918501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.919425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:56.920051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:56.920493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:56.936097 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] HTTP exception thrown: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Request method failure captured: Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 HTTP/1.1 Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnhfzw86NVbEQKGwcHv7OyYga_oVTQEb6UbJHXp3UmOcZb1HmBDhAq6IbJYmRrT-eTKzki3LPx2SG9-sYbIqlHplPU8ebLfsvl-oSBiGMsI4IRcUclSp7B7XqyzwWHOe57XwzQ6EM_UBksALsElfjUGD_91l2mNdBE4i77BwxQazhss Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: b894356f14004ae1b15a35da13667a3b Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestServerBasicOps-1619436207 Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b894356f14004ae1b15a35da13667a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/b894356f14004ae1b15a35da13667a3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_b894356f14004ae1b15a35da13667a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/b894356f14004ae1b15a35da13667a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestServerBasicOps-1619436207 Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: b894356f14004ae1b15a35da13667a3b Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestServerBasicOps-1619436207 Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestServerBasicOps-1619436207-project Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: f5c12ea052c24d73b754c4ece09f7a1c Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestServerBasicOps-1619436207-project Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '30c7ad13-5db7-4b03-b038-f768182e2700'} Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:07:56.937689 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Returning 404 to user: Instance 30c7ad13-5db7-4b03-b038-f768182e2700 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b62bd70-c70d-4fcb-82de-1197f680446f tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700" status: 404 len: 111 microversion: 2.1 time: 0.035092 Nov 02 14:07:56.946423 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3883/7395] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:56 2022] GET /compute/v2.1/servers/30c7ad13-5db7-4b03-b038-f768182e2700 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:07:57.134370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ac69fef-7fce-4b97-bd80-fb1297adaa6b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] Calling method '.version_select at 0x7fe78cf484c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:57.172175 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ac69fef-7fce-4b97-bd80-fb1297adaa6b tempest-TestServerBasicOps-1619436207 tempest-TestServerBasicOps-1619436207-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-651042462" status: 202 len: 0 microversion: 2.1 time: 0.043516 Nov 02 14:07:57.172880 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3513/7396] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 14:07:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-651042462 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:07:59.508068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:59.508804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:59.514984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=36 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:07:59.522455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.523540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.524713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.526396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.527100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.528054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.567064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:07:59.691523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f97fe8c3-aaa8-48d8-a569-5424e007e0d7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 204 len: 0 microversion: 2.1 time: 0.190204 Nov 02 14:07:59.692539 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3884/7397] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:07:59 2022] DELETE /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:07:59.704000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:07:59.704845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:07:59.712950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.712950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.713347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.715164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:07:59.716417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:07:59.717197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:07:59.872993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:07:59.885736 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-21938012-4e99-4b9f-8a01-37101d42b87d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1413 microversion: 2.1 time: 0.186672 Nov 02 14:07:59.886410 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3514/7398] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:07:59 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1413 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:00.910645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:00.911394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:00.919059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.919588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.920034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:00.920750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:00.921214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:00.921651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:01.158311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:01.166276 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9dccde91-7d5e-4f52-8082-f3c1dba3c6ef tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1413 microversion: 2.1 time: 0.259953 Nov 02 14:08:01.166881 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3885/7399] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:00 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1413 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:02.049288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9dafa4e5-8902-41b7-83a4-ec8abc636e57 req-7b55f27c-5ca6-4fd4-b1c7-629263b305aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d92672bc-135e-48cb-bdfa-c05f7346db35", "name": "network-vif-deleted", "tag": "51088917-eb61-4282-ae9f-545da2b0b5ef"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:02.061154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9dafa4e5-8902-41b7-83a4-ec8abc636e57 req-7b55f27c-5ca6-4fd4-b1c7-629263b305aa service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:02.061656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9dafa4e5-8902-41b7-83a4-ec8abc636e57 req-7b55f27c-5ca6-4fd4-b1c7-629263b305aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:02.062106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9dafa4e5-8902-41b7-83a4-ec8abc636e57 req-7b55f27c-5ca6-4fd4-b1c7-629263b305aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:02.077827 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9dafa4e5-8902-41b7-83a4-ec8abc636e57 req-7b55f27c-5ca6-4fd4-b1c7-629263b305aa service nova] Creating event network-vif-deleted:51088917-eb61-4282-ae9f-545da2b0b5ef for instance d92672bc-135e-48cb-bdfa-c05f7346db35 on n-h1-858384-19 Nov 02 14:08:02.083298 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9dafa4e5-8902-41b7-83a4-ec8abc636e57 req-7b55f27c-5ca6-4fd4-b1c7-629263b305aa service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037673 Nov 02 14:08:02.084207 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3515/7400] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:02.190230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:02.190990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:02.204778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:02.205496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:02.205928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:02.206651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:02.207126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:02.210657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:02.346751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:02.355615 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-36d4fa11-54bf-488e-b778-66a5d6032899 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1204 microversion: 2.1 time: 0.168976 Nov 02 14:08:02.356854 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3886/7401] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:02 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1204 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:03.381893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:03.383494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:03.405560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.407806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.409856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.413526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:03.414299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:03.418836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:03.579536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:03.588710 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2b27b7e2-8045-4016-9efe-7f2289026949 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1204 microversion: 2.1 time: 0.212620 Nov 02 14:08:03.590423 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3516/7402] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:03 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1204 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:04.613187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:04.614394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:04.622364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:04.622857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:04.623328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:04.624055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:04.624494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:04.625121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:04.713298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:04.733678 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-94c0757b-6dcb-4a44-83ff-8335abc8fb5b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1204 microversion: 2.1 time: 0.124758 Nov 02 14:08:04.735153 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3887/7403] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:04 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1204 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:05.758772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:05.759697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:05.768149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.768845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.769456 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:05.770196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:05.770672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:05.771146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:05.848859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:05.861573 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c861ad40-7478-4a9b-9cfa-f06809ea2a42 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1204 microversion: 2.1 time: 0.107774 Nov 02 14:08:05.873823 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3517/7404] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:05 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1204 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:06.886123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:06.887383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:06.894345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:06.894828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:06.895294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:06.895997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:06.896452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:06.896875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:06.927937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:06.928437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:06.928851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:06.929297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lazy-loading 'fault' on Instance uuid d92672bc-135e-48cb-bdfa-c05f7346db35 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:08:06.971346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:06.980484 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f2b5d65-a621-4626-83fa-804b19ed4576 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 200 len: 1209 microversion: 2.1 time: 0.098535 Nov 02 14:08:06.981121 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3888/7405] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:06 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:08.006216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:08.006775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:08.014552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:08.015060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:08.015642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:08.016370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:08.016847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:08.017299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:08.032202 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 HTTP/1.1 Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd92672bc-135e-48cb-bdfa-c05f7346db35'} Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:08.033933 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-81d33c87-eb60-4235-a0f9-3fd96a617ec1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 404 len: 111 microversion: 2.1 time: 0.033673 Nov 02 14:08:08.037923 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3518/7406] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:08 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:10.181343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:10.181852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:10.189308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.189801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.190249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.190954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.191547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.191984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.206900 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 HTTP/1.1 Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '7a1520f5-23fc-4220-ae5d-f2aee1262ec5'} Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:10.208622 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59fb7cb7-5e8a-4438-bb60-d6881a63278e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 404 len: 111 microversion: 2.1 time: 0.032944 Nov 02 14:08:10.212445 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3889/7407] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:08:10 2022] DELETE /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:10.220005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:10.220641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 7a1520f5-23fc-4220-ae5d-f2aee1262ec5] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:10.227241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.227747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.228301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.229025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.229498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.230046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.244117 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 HTTP/1.1 Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '7a1520f5-23fc-4220-ae5d-f2aee1262ec5'} Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:10.245715 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance 7a1520f5-23fc-4220-ae5d-f2aee1262ec5 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74613127-161d-4c5a-8d9d-919c45127afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5" status: 404 len: 111 microversion: 2.1 time: 0.031380 Nov 02 14:08:10.250186 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3519/7408] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:10 2022] GET /compute/v2.1/servers/7a1520f5-23fc-4220-ae5d-f2aee1262ec5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:10.797091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:10.797585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:10.803519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.803995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.804434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.805119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.805570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.805994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.820074 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 HTTP/1.1 Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'd92672bc-135e-48cb-bdfa-c05f7346db35'} Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:10.821705 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93aa3bc0-8d81-43aa-898d-fdd4ac4746ec tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 404 len: 111 microversion: 2.1 time: 0.030264 Nov 02 14:08:10.826638 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3890/7409] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:08:10 2022] DELETE /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:10.832805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:10.833444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: d92672bc-135e-48cb-bdfa-c05f7346db35] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:10.840234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.840735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.841190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.841905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:10.842380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:10.842824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:10.856453 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 HTTP/1.1 Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'd92672bc-135e-48cb-bdfa-c05f7346db35'} Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:08:10.857992 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance d92672bc-135e-48cb-bdfa-c05f7346db35 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1cb42622-9c7d-48fb-ae78-8124d3f2ed75 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35" status: 404 len: 111 microversion: 2.1 time: 0.030645 Nov 02 14:08:10.862631 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3520/7410] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:10 2022] GET /compute/v2.1/servers/d92672bc-135e-48cb-bdfa-c05f7346db35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:08:10.932367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-299ce7c0-ca8f-45f1-8e0c-36577f79ba0b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'create', calling method: .version_select at 0x7fe78f841e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-618393204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMbQny7bM/QMs0sXyf55QyZKjWys344r72IK0rhbaP+lRg7EIQhSV7KtYQOkL1Z8Gsk8czSjwUPQ3Uz3hV1accBla+l/0P9dOGJb1RylCvBZZKCd4pQPCrF/8IugJk0Hg=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:10.948973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-299ce7c0-ca8f-45f1-8e0c-36577f79ba0b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:08:10.954304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-299ce7c0-ca8f-45f1-8e0c-36577f79ba0b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for user 5b2bb8e9b22043ca88ee5a68f23358d1 and project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:08:10.982267 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-299ce7c0-ca8f-45f1-8e0c-36577f79ba0b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.053808 Nov 02 14:08:10.982870 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3891/7411] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:08:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:27.264785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-285522087", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-618393204", "security_groups": [{"name": "tempest-secgroup-smoke-2089997176"}], "block_device_mapping_v2": [{"uuid": "244eec54-9164-456d-8472-dada36824475", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a091e626-fbaf-4376-b09d-38c161b3ee11"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:27.276118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:27.277814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:27.383381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] validate_networks() for [('a091e626-fbaf-4376-b09d-38c161b3ee11', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:08:27.770968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:08:27.771444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:08:27.771954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:08:27.772381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:08:27.772814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:08:27.782506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:27.783010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:27.783521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:27.784266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:27.784737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:27.785178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:27.802176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:08:27.807574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for user 5b2bb8e9b22043ca88ee5a68f23358d1 and project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:08:27.866284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:08:27.868530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='244eec54-9164-456d-8472-dada36824475',volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:08:28.000141 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4e64a358-30eb-47e8-8292-727d1d8a2ac8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.739885 Nov 02 14:08:28.001045 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3521/7412] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:08:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:08:28.013259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e440825c-b362-4ec4-81c0-d9558db64d2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:28.014483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e440825c-b362-4ec4-81c0-d9558db64d2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:28.018251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:28.018943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:28.019791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:28.084138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e440825c-b362-4ec4-81c0-d9558db64d2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:28.091900 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e440825c-b362-4ec4-81c0-d9558db64d2b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1096 microversion: 2.1 time: 0.083879 Nov 02 14:08:28.092483 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3892/7413] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:28 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1096 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:29.114640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:29.115316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:29.122776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:29.123336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:29.123990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:29.124817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:29.125399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:29.126078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:29.195279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:29.204259 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e255b53-c4d7-4fe9-90d4-f5006bc0a16a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1202 microversion: 2.1 time: 0.094008 Nov 02 14:08:29.204891 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3522/7414] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:29 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:30.229191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:30.230927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:30.238460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:30.239177 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:30.239798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:30.240649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:30.241260 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:30.241846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:30.485909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:30.499918 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-354be168-9abb-4b90-b466-1990404c671a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1280 microversion: 2.1 time: 0.274364 Nov 02 14:08:30.502597 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3893/7415] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:30 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1280 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:30.683664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b3229077-2107-470f-aef1-860084b34d9a req-ad6e7d8a-c83c-4099-9fc0-9f56ad04dd10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe3343da-5ecf-431b-8514-2fb527454703", "tag": "a86d970a-df50-4520-b785-2fbe62384d2d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:30.695335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b3229077-2107-470f-aef1-860084b34d9a req-ad6e7d8a-c83c-4099-9fc0-9f56ad04dd10 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:30.696091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b3229077-2107-470f-aef1-860084b34d9a req-ad6e7d8a-c83c-4099-9fc0-9f56ad04dd10 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:30.696694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b3229077-2107-470f-aef1-860084b34d9a req-ad6e7d8a-c83c-4099-9fc0-9f56ad04dd10 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:30.712319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b3229077-2107-470f-aef1-860084b34d9a req-ad6e7d8a-c83c-4099-9fc0-9f56ad04dd10 service nova] Creating event network-changed:a86d970a-df50-4520-b785-2fbe62384d2d for instance fe3343da-5ecf-431b-8514-2fb527454703 on n-h2-858384-19 Nov 02 14:08:30.718429 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b3229077-2107-470f-aef1-860084b34d9a req-ad6e7d8a-c83c-4099-9fc0-9f56ad04dd10 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038862 Nov 02 14:08:30.719329 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3523/7416] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:08:31.524024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:31.524645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:31.538022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:31.538516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:31.538959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:31.540089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:31.540241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:31.540597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:31.735261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:31.744116 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a590ede-c669-41b3-b292-5126220bb8c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1280 microversion: 2.1 time: 0.224034 Nov 02 14:08:31.744719 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3894/7417] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:31 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:32.769476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:32.770228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:32.776832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:32.777799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:32.778313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:32.779003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:32.779501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:32.779953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:32.920840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:32.928688 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8255a350-b76e-4744-ac6c-c64603a9ad24 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1280 microversion: 2.1 time: 0.164484 Nov 02 14:08:32.929274 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3524/7418] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:32 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:33.954757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:33.955395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:33.962731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:33.963387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:33.963864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:33.964656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:33.965096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:33.965526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:34.108117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:34.118440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11e9483f-7af4-4d16-8e98-497a5cace53f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1280 microversion: 2.1 time: 0.170620 Nov 02 14:08:34.119149 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3895/7419] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:33 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:35.142604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:35.143179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:35.150268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:35.150783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:35.151273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:35.152258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:35.153090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:35.153548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:35.290610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:35.299444 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8bbbbc4d-ebc8-4a7a-8dc2-d2a46e0e1ee7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.160999 Nov 02 14:08:35.300049 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3525/7420] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:35 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:36.322832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:36.323458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:36.331014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:36.331523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:36.331959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:36.332651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:36.333103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:36.333530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:36.467090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:36.475026 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b6112876-c328-4eb8-b701-d58b0ca504df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.156202 Nov 02 14:08:36.475643 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3896/7421] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:36 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:37.498211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:37.498897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:37.506483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:37.506997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:37.507489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:37.508229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:37.508706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:37.509158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:37.645346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:37.654009 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b02b3689-52e2-40fc-9b3a-ad4d1c5a7ab0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.160041 Nov 02 14:08:37.654614 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3526/7422] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:37 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:38.676973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:38.677625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:38.680610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:38.686628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:38.687138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:38.687593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:38.688303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:38.688768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:38.689211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:38.829395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:38.838653 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d515490d-4fdd-4020-b24a-d666ecdfb13c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.165486 Nov 02 14:08:38.849214 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3897/7423] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:38 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:39.864087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:39.864622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:39.866585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:39.867483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:08:39.874535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:39.875038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:39.875522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:39.876238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:39.876706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:39.877150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:40.017400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:40.025183 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e7c48580-4599-48ca-9eb1-c8bb62581bc1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.165409 Nov 02 14:08:40.025770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3527/7424] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:39 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:41.049193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:41.049857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:41.056525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:41.057009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:41.057460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:41.058165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:41.058628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:41.059059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:41.191259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:41.199028 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e9582c5a-ba0f-4829-aa25-3f827bd48fb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.154029 Nov 02 14:08:41.199615 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3898/7425] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:41 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:08:42.223076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:42.223739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:42.230262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:42.230767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:42.231281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:42.232183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:42.232658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:42.233106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:42.367677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:42.375483 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f662a78d-fd92-477d-b60f-3677f8bfa7a0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.156727 Nov 02 14:08:42.376062 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3528/7426] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:42 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:43.398121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:43.398668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:43.406327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:43.406812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:43.407289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:43.407989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:43.408478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:43.408903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:43.549469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:43.557508 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b2a655d-78b3-46be-afb3-5a70e2459930 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.163440 Nov 02 14:08:43.558108 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3899/7427] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:43 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:44.587942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:44.588571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:44.595558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:44.596058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:44.596522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:44.597231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:44.597703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:44.598145 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:44.737976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:44.745689 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6dc240a-3fcf-4bee-8282-4b7c15473007 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.161750 Nov 02 14:08:44.746268 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3529/7428] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:44 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:45.039524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-bb239c0c-02ee-448e-a9f5-e2cb2d19ce90 req-2040b308-d790-450b-8fba-a134846c4bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3343da-5ecf-431b-8514-2fb527454703", "name": "network-vif-plugged", "status": "completed", "tag": "a86d970a-df50-4520-b785-2fbe62384d2d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:45.050628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bb239c0c-02ee-448e-a9f5-e2cb2d19ce90 req-2040b308-d790-450b-8fba-a134846c4bf8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:45.051082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bb239c0c-02ee-448e-a9f5-e2cb2d19ce90 req-2040b308-d790-450b-8fba-a134846c4bf8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:45.051543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bb239c0c-02ee-448e-a9f5-e2cb2d19ce90 req-2040b308-d790-450b-8fba-a134846c4bf8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:45.063848 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-bb239c0c-02ee-448e-a9f5-e2cb2d19ce90 req-2040b308-d790-450b-8fba-a134846c4bf8 service nova] Creating event network-vif-plugged:a86d970a-df50-4520-b785-2fbe62384d2d for instance fe3343da-5ecf-431b-8514-2fb527454703 on n-h2-858384-19 Nov 02 14:08:45.068925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-bb239c0c-02ee-448e-a9f5-e2cb2d19ce90 req-2040b308-d790-450b-8fba-a134846c4bf8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033258 Nov 02 14:08:45.069797 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3900/7429] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:08:45.769179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:45.769876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:45.776855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:45.777335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:45.777784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:45.779045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:45.779711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:45.780239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:45.913537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:45.921926 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5b00136-abf2-4c00-8873-02f30590db93 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1268 microversion: 2.1 time: 0.156652 Nov 02 14:08:45.922504 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3530/7430] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:45 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:46.946743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:46.947395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:46.954553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:46.955039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:46.955516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:46.956227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:46.956692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:46.957131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:47.093871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:47.101733 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00a9f3bd-713d-4f98-babb-01411ef08d07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1455 microversion: 2.1 time: 0.160294 Nov 02 14:08:47.102324 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3901/7431] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:46 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:47.127169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:08:47.127834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:08:47.134703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:47.135243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:47.135705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:47.136423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:47.136900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:47.137348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:47.271142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:08:47.278996 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-19d86b02-26d6-4695-b50e-29370e10e529 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1455 microversion: 2.1 time: 0.156595 Nov 02 14:08:47.279595 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3531/7432] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:08:47 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:08:48.894319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9003894d-1098-4d9b-8240-d249bc08dd36 req-8547df3b-e1d7-4c34-a5bf-af7c317f31f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe3343da-5ecf-431b-8514-2fb527454703", "tag": "a86d970a-df50-4520-b785-2fbe62384d2d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:08:48.904675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9003894d-1098-4d9b-8240-d249bc08dd36 req-8547df3b-e1d7-4c34-a5bf-af7c317f31f3 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:08:48.905155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9003894d-1098-4d9b-8240-d249bc08dd36 req-8547df3b-e1d7-4c34-a5bf-af7c317f31f3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:08:48.905584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9003894d-1098-4d9b-8240-d249bc08dd36 req-8547df3b-e1d7-4c34-a5bf-af7c317f31f3 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:08:48.917832 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9003894d-1098-4d9b-8240-d249bc08dd36 req-8547df3b-e1d7-4c34-a5bf-af7c317f31f3 service nova] Creating event network-changed:a86d970a-df50-4520-b785-2fbe62384d2d for instance fe3343da-5ecf-431b-8514-2fb527454703 on n-h2-858384-19 Nov 02 14:08:48.923418 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9003894d-1098-4d9b-8240-d249bc08dd36 req-8547df3b-e1d7-4c34-a5bf-af7c317f31f3 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032395 Nov 02 14:08:48.924568 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3902/7433] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:46.438512 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:10:46.439439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:46.440229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=58 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:46.441843 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:10:46.441988 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 (ip 10.222.0.113) !!! Nov 02 14:10:46.444380 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:10:46.444499 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 (ip 10.222.0.113) !!! Nov 02 14:10:46.723656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:46.724180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:46.730645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:46.731179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:46.731642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:46.732355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:46.732830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:46.733273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:46.760483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:10:46.836916 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e650e15-7d11-4408-b415-72c31c0e7d94 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 204 len: 0 microversion: 2.1 time: 0.400138 Nov 02 14:10:46.837818 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3532/7434] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:10:46 2022] DELETE /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:10:46.844605 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:10:46.845617 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:10:46.846363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=24 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:46.847216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=52 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:10:46.848609 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:10:46.848760 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 (ip 10.222.0.113) !!! Nov 02 14:10:46.849746 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:10:46.849907 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 (ip 10.222.0.113) !!! Nov 02 14:10:46.856382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:46.857078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:46.868120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:46.868604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:46.869041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:46.869735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:46.870186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:46.870611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:47.077993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:47.087545 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ffaa755-78fb-4471-8854-6a1973bfd808 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1579 microversion: 2.1 time: 0.244755 Nov 02 14:10:47.088144 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3903/7435] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:46 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1579 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:48.111551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:48.112293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:48.122154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:48.122652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:48.123102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:48.123839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:48.124308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:48.124742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:48.131379 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 41282. Nov 02 14:10:48.327765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:48.335739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd3ab789-e6f3-4e96-8e45-b9e514155ae6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1579 microversion: 2.1 time: 0.228833 Nov 02 14:10:48.336321 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3533/7436] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:48 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1579 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:49.360100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:49.360980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:49.370825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:49.371355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:49.371799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:49.372519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:49.373018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:49.373907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:49.396722 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 41290. Nov 02 14:10:49.397549 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 41292. Nov 02 14:10:49.436473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c3261a34-d13a-45bf-8079-5c0f3bd8bbdb req-e6e87fe8-7cef-4ed1-ab06-3830b687ff6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3343da-5ecf-431b-8514-2fb527454703", "name": "network-vif-deleted", "tag": "a86d970a-df50-4520-b785-2fbe62384d2d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:49.447401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c3261a34-d13a-45bf-8079-5c0f3bd8bbdb req-e6e87fe8-7cef-4ed1-ab06-3830b687ff6b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:49.448082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c3261a34-d13a-45bf-8079-5c0f3bd8bbdb req-e6e87fe8-7cef-4ed1-ab06-3830b687ff6b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:49.448345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c3261a34-d13a-45bf-8079-5c0f3bd8bbdb req-e6e87fe8-7cef-4ed1-ab06-3830b687ff6b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:49.467029 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c3261a34-d13a-45bf-8079-5c0f3bd8bbdb req-e6e87fe8-7cef-4ed1-ab06-3830b687ff6b service nova] Creating event network-vif-deleted:a86d970a-df50-4520-b785-2fbe62384d2d for instance fe3343da-5ecf-431b-8514-2fb527454703 on n-h2-858384-19 Nov 02 14:10:49.473004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:49.473961 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c3261a34-d13a-45bf-8079-5c0f3bd8bbdb req-e6e87fe8-7cef-4ed1-ab06-3830b687ff6b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041331 Nov 02 14:10:49.475281 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3534/7437] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:10:49.487834 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e5b479a1-ccef-4194-9163-420250aac5a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1511 microversion: 2.1 time: 0.131072 Nov 02 14:10:49.488443 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3904/7438] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:49 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1511 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:50.514964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:50.515797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:50.523208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:50.523844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:50.524967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:50.525947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:50.526591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:50.527312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:50.601994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:50.610597 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-79efac0f-9668-4f35-ac4f-478962e1e891 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1227 microversion: 2.1 time: 0.102413 Nov 02 14:10:50.611475 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3535/7439] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:50 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1227 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:51.634071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:51.634721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:51.641786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:51.642279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:51.642718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:51.643471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:51.643926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:51.644354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:51.713176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:51.721282 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-75a89829-2452-49e5-929a-6e5474e5f9d8 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1227 microversion: 2.1 time: 0.091472 Nov 02 14:10:51.721876 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3905/7440] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:51 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1227 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:52.746605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:52.747213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:52.754586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:52.755138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:52.755599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:52.758121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:52.759448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:52.760036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:52.830945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:52.840293 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8b0794ca-ac86-4d6e-ab3c-04ca28fbf6c1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1227 microversion: 2.1 time: 0.098479 Nov 02 14:10:52.841147 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3536/7441] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:52 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1227 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:53.864539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:53.865191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:53.873023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:53.873513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:53.873962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:53.874659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:53.875138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:53.875564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:53.911402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:53.911994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:53.912505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:53.913028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lazy-loading 'fault' on Instance uuid fe3343da-5ecf-431b-8514-2fb527454703 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:10:53.956524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:53.965076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-759a7d5e-6aa0-425a-bc8e-705ed201ad23 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 200 len: 1232 microversion: 2.1 time: 0.104764 Nov 02 14:10:53.965688 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3906/7442] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:53 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 1232 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:54.989493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:54.990041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:54.997829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:54.998331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:54.998789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:54.999611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:55.000088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:55.000551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:55.015496 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 HTTP/1.1 Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fe3343da-5ecf-431b-8514-2fb527454703'} Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:10:55.017168 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f790bf59-0f9e-4caa-9c8d-e05545ba9937 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 404 len: 111 microversion: 2.1 time: 0.033513 Nov 02 14:10:55.021127 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3537/7443] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:54 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:10:55.069091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1964923509", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-618393204", "security_groups": [{"name": "tempest-secgroup-smoke-2089997176"}], "block_device_mapping_v2": [{"uuid": "244eec54-9164-456d-8472-dada36824475", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a091e626-fbaf-4376-b09d-38c161b3ee11"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:55.189804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] validate_networks() for [('a091e626-fbaf-4376-b09d-38c161b3ee11', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:10:55.621649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:10:55.622081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:10:55.622597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:10:55.623011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:10:55.623468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:10:55.632805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:55.634503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:55.634957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:55.635739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:55.636209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:55.636646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:55.654467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:10:55.659935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for user 5b2bb8e9b22043ca88ee5a68f23358d1 and project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:10:55.721407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:10:55.723610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='244eec54-9164-456d-8472-dada36824475',volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:10:55.859570 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-63754fac-74bf-4925-b302-6224706acfd6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.794440 Nov 02 14:10:55.860250 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3907/7444] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:10:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:10:55.872743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e1e559cb-05d7-4eba-bfc1-fc03cf0fbb7b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:55.873390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e1e559cb-05d7-4eba-bfc1-fc03cf0fbb7b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:55.939318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e1e559cb-05d7-4eba-bfc1-fc03cf0fbb7b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:55.948740 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e1e559cb-05d7-4eba-bfc1-fc03cf0fbb7b tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1097 microversion: 2.1 time: 0.080512 Nov 02 14:10:55.955495 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3538/7445] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:55 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1097 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:56.974178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:56.974815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:56.984202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:56.984705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:56.985154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:56.986285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:56.986749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:56.987252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:57.073288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:57.082323 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-86b4997b-adbe-47fd-8a82-cddd6872006e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1213 microversion: 2.1 time: 0.113695 Nov 02 14:10:57.089503 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3908/7446] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:56 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:58.107659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:58.108455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:58.116427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:58.117162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:58.117621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:58.118700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:58.119203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:58.119826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:58.276510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:58.287330 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1fc5d594-2565-4940-9be2-c988832f16b7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1281 microversion: 2.1 time: 0.185003 Nov 02 14:10:58.289609 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3539/7447] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:58 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1281 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:10:58.389545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8eeaf2df-e5d5-45f8-9577-bd53f0f23eac req-8a45d04e-0574-4f35-9668-327515b744b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e814a4f-4b8a-425f-9a6a-dda804ac20b2", "tag": "d546ec6e-a3a6-4f73-b489-bbaf0b871e4d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:10:58.402265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8eeaf2df-e5d5-45f8-9577-bd53f0f23eac req-8a45d04e-0574-4f35-9668-327515b744b4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:58.403915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8eeaf2df-e5d5-45f8-9577-bd53f0f23eac req-8a45d04e-0574-4f35-9668-327515b744b4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:58.404604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8eeaf2df-e5d5-45f8-9577-bd53f0f23eac req-8a45d04e-0574-4f35-9668-327515b744b4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:58.419679 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8eeaf2df-e5d5-45f8-9577-bd53f0f23eac req-8a45d04e-0574-4f35-9668-327515b744b4 service nova] Creating event network-changed:d546ec6e-a3a6-4f73-b489-bbaf0b871e4d for instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 on n-h2-858384-19 Nov 02 14:10:58.425724 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8eeaf2df-e5d5-45f8-9577-bd53f0f23eac req-8a45d04e-0574-4f35-9668-327515b744b4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040454 Nov 02 14:10:58.426745 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3909/7448] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:10:59.313297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:10:59.314240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:10:59.323188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:59.323809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:59.324379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:59.325249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:10:59.325848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:10:59.326377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:10:59.479418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:10:59.488336 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8ab0d3f9-4ebc-4e05-8263-0cc7bac09afe tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1281 microversion: 2.1 time: 0.179416 Nov 02 14:10:59.488930 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3540/7449] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:10:59 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:00.513118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:00.513829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:00.520308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:00.520791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:00.521222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:00.521922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:00.522370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:00.522794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:00.673438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:00.682205 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31d642a0-a3d9-4b08-8549-58bb932cc692 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1281 microversion: 2.1 time: 0.174462 Nov 02 14:11:00.682799 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3910/7450] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:00 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:01.705521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:01.706072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:01.714131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:01.714647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:01.715127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:01.715887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:01.716365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:01.716821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:01.873028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:01.881098 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-819bafdd-3061-41da-a66c-4b24f7b0f3a5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1281 microversion: 2.1 time: 0.179699 Nov 02 14:11:01.881694 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3541/7451] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:01 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:02.910994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:02.911550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:02.925413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:02.925906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:02.926357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:02.927072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:02.927557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:02.927994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:03.069582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:03.078339 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-674e34fd-f888-4a91-8dd0-dec01db55dbf tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.171422 Nov 02 14:11:03.078931 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3911/7452] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:02 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:04.104649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:04.105375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:04.112719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:04.113213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:04.113661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:04.114444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:04.114958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:04.115430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:04.251022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:04.258945 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc23f0b4-5137-4d19-a692-0f8ffda24c51 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.159303 Nov 02 14:11:04.259559 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3542/7453] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:04 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:05.282171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:05.282811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:05.289976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:05.290458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:05.290901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:05.291632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:05.292093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:05.292521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:05.431913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:05.439751 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-07db570d-3469-4574-9954-7b73363d1325 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.161496 Nov 02 14:11:05.440334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3912/7454] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:05 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:06.464133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:06.464802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:06.468026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:06.473640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:06.474138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:06.474591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:06.475361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:06.475835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:06.476276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:06.614717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:06.623381 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ca447cd3-7acb-49ab-b10d-d33a4ea03066 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.163974 Nov 02 14:11:06.623975 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3543/7455] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:06 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:07.647101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:07.647725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:07.649746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:07.650414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:07.657532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:07.658012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:07.658448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:07.659201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:07.659659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:07.660084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:07.804422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:07.813306 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae91d6e8-10a1-4ae9-9d60-673df03f83c9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.170116 Nov 02 14:11:07.813884 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3913/7456] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:07 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:08.838375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:08.839057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:08.846211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:08.846703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:08.847177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:08.847896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:08.848363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:08.848804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:08.990029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:08.998071 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6e2ed10d-5216-4526-b820-64f85991ec46 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.164498 Nov 02 14:11:08.998650 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3544/7457] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:08 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:10.021330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:10.021932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:10.029525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:10.030006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:10.030446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:10.031167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:10.031628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:10.032062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:10.165084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:10.172891 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-df16c62d-9d64-4640-b8a9-ec6094309ef9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.155575 Nov 02 14:11:10.173485 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3914/7458] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:10 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:11.196965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:11.197597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:11.204542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:11.205096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:11.205556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:11.206280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:11.206753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:11.207221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:11.341163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:11.348939 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f5aa6ea-1021-47ad-a586-39c22d213ae5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.156736 Nov 02 14:11:11.349517 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3545/7459] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:11 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:12.374042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:12.374672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:12.381821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:12.382313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:12.383381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:12.384108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:12.384572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:12.385011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:12.523721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:12.532177 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b4a87d43-4485-481d-a81e-e9ba5987798a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.162151 Nov 02 14:11:12.532778 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3915/7460] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:12 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:13.556501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:13.557138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:13.564250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:13.564754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:13.565238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:13.565957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:13.566439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:13.566965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:13.704551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:13.713224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f5c5740c-9949-443e-8d6c-b2b3dc01fd57 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.161016 Nov 02 14:11:13.720426 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3546/7461] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:13 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:14.029104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7f6f482a-ea8f-4893-8b8f-a5b0ba6ab4b5 req-369d41f8-41c2-4039-a208-bd13fc359b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e814a4f-4b8a-425f-9a6a-dda804ac20b2", "name": "network-vif-plugged", "status": "completed", "tag": "d546ec6e-a3a6-4f73-b489-bbaf0b871e4d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:14.041764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7f6f482a-ea8f-4893-8b8f-a5b0ba6ab4b5 req-369d41f8-41c2-4039-a208-bd13fc359b75 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:14.042242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7f6f482a-ea8f-4893-8b8f-a5b0ba6ab4b5 req-369d41f8-41c2-4039-a208-bd13fc359b75 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:14.042682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7f6f482a-ea8f-4893-8b8f-a5b0ba6ab4b5 req-369d41f8-41c2-4039-a208-bd13fc359b75 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:14.054861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7f6f482a-ea8f-4893-8b8f-a5b0ba6ab4b5 req-369d41f8-41c2-4039-a208-bd13fc359b75 service nova] Creating event network-vif-plugged:d546ec6e-a3a6-4f73-b489-bbaf0b871e4d for instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 on n-h2-858384-19 Nov 02 14:11:14.060017 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7f6f482a-ea8f-4893-8b8f-a5b0ba6ab4b5 req-369d41f8-41c2-4039-a208-bd13fc359b75 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Nov 02 14:11:14.060633 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3916/7462] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:11:14.736063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:14.736699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:14.745054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:14.745564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:14.746022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:14.746748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:14.747260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:14.747710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:14.883174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:14.890997 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-632486e7-3690-4046-ad3b-f43e04f524dc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1269 microversion: 2.1 time: 0.159218 Nov 02 14:11:14.891635 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3547/7463] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:14 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:11:15.916881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:15.917489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:15.923895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:15.924377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:15.924960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:15.925491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:15.925996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:15.926462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:16.066316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:16.074369 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f51a1111-98c0-4980-b8a2-a5c517a902d3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1456 microversion: 2.1 time: 0.163588 Nov 02 14:11:16.074958 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3917/7464] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:15 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1456 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:16.096776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:11:16.097403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:11:16.104906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:16.105431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:16.105884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:16.106593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:16.107058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:16.107680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:16.240526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:11:16.249548 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-110a8a07-9dc6-4d1a-9fc6-f5d4af0d7e15 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1456 microversion: 2.1 time: 0.156739 Nov 02 14:11:16.250135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3548/7465] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:11:16 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1456 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:11:18.393494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5295fa50-f1b9-4fd1-a597-3ee2780bc20f req-d6fab8f2-6093-484b-88d6-ec3fd1eb9c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e814a4f-4b8a-425f-9a6a-dda804ac20b2", "tag": "d546ec6e-a3a6-4f73-b489-bbaf0b871e4d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:11:18.399437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:18.405457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5295fa50-f1b9-4fd1-a597-3ee2780bc20f req-d6fab8f2-6093-484b-88d6-ec3fd1eb9c40 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:11:18.405945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5295fa50-f1b9-4fd1-a597-3ee2780bc20f req-d6fab8f2-6093-484b-88d6-ec3fd1eb9c40 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:11:18.406385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5295fa50-f1b9-4fd1-a597-3ee2780bc20f req-d6fab8f2-6093-484b-88d6-ec3fd1eb9c40 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:11:18.409543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=81 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:11:18.420465 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5295fa50-f1b9-4fd1-a597-3ee2780bc20f req-d6fab8f2-6093-484b-88d6-ec3fd1eb9c40 service nova] Creating event network-changed:d546ec6e-a3a6-4f73-b489-bbaf0b871e4d for instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 on n-h2-858384-19 Nov 02 14:11:18.425543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5295fa50-f1b9-4fd1-a597-3ee2780bc20f req-d6fab8f2-6093-484b-88d6-ec3fd1eb9c40 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108090 Nov 02 14:11:18.426474 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3918/7466] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:13:08.208939 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:13:08.213262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2141185776", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-618393204", "security_groups": [{"name": "tempest-secgroup-smoke-2089997176"}], "block_device_mapping_v2": [{"uuid": "16e52f83-2e82-41fb-b7c5-0f58606c1b9b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a091e626-fbaf-4376-b09d-38c161b3ee11"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:08.225102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:08.226049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:08.226929 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:13:08.227145 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:13:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.113) !!! Nov 02 14:13:08.616029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] validate_networks() for [('a091e626-fbaf-4376-b09d-38c161b3ee11', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:13:09.109602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:13:09.110310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:13:09.110807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:13:09.111272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:13:09.111733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:13:09.123408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:09.123845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:09.124303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:09.125055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:09.125530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:09.125977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:09.147430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:13:09.153320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Getting quotas for user 5b2bb8e9b22043ca88ee5a68f23358d1 and project 8c406124bb164c988b18c0b9cf5369ad. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:13:09.210250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:13:09.212392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16e52f83-2e82-41fb-b7c5-0f58606c1b9b',volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:13:09.223281 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 41486. Nov 02 14:13:09.356122 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c5eb9e75-219a-4388-8e9d-d84b5a2e44e5 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.148233 Nov 02 14:13:09.363731 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3549/7467] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:13:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:13:09.367592 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] AMQP server on 10.222.0.113:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 14:13:09.368799 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] AMQP server on 10.222.0.113:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 14:13:09.369380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:09.370506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:09.378513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-430326c3-62ea-41dd-a359-273ac601f0cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:09.379244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-430326c3-62ea-41dd-a359-273ac601f0cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:09.579207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-430326c3-62ea-41dd-a359-273ac601f0cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:09.589460 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-430326c3-62ea-41dd-a359-273ac601f0cc tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1097 microversion: 2.1 time: 0.224060 Nov 02 14:13:09.590275 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3919/7468] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:09 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1097 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:10.613467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6e9987c-1a93-4acf-84b3-76fa6aa4e368 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:10.614103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a6e9987c-1a93-4acf-84b3-76fa6aa4e368 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:10.668611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a6e9987c-1a93-4acf-84b3-76fa6aa4e368 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:10.675993 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6e9987c-1a93-4acf-84b3-76fa6aa4e368 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1097 microversion: 2.1 time: 0.067654 Nov 02 14:13:10.676570 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3550/7469] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:10 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1097 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:11.700219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ba557c42-8fd0-499b-a597-e1be8f6fb540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:11.700839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ba557c42-8fd0-499b-a597-e1be8f6fb540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:11.713804 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 41516. Nov 02 14:13:11.716372 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 41518. Nov 02 14:13:11.766672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ba557c42-8fd0-499b-a597-e1be8f6fb540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:11.774252 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ba557c42-8fd0-499b-a597-e1be8f6fb540 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1097 microversion: 2.1 time: 0.078721 Nov 02 14:13:11.774816 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3920/7470] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:11 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1097 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:12.797830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:12.798473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:12.806074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:12.806520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:12.806981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:12.807729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:12.808210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:12.808711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:12.874336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:12.882080 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cd499b01-2500-44b8-9411-01deb145a493 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1147 microversion: 2.1 time: 0.088328 Nov 02 14:13:12.882658 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3551/7471] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:12 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1147 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:13.905797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:13.906330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:13.913664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:13.914157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:13.914604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:13.915357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:13.915819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:13.916253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:13.987832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:13.996763 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9cd12a1e-cf43-48a6-b6d9-cd15bd0afbb3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1139 microversion: 2.1 time: 0.095214 Nov 02 14:13:13.997557 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3921/7472] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:13 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1139 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:15.022733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:15.024190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:15.034201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:15.035102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:15.035880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:15.036627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:15.037446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:15.037945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:15.129633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:15.140597 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d638da21-bff9-4a0a-b350-2a106d3ca447 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1213 microversion: 2.1 time: 0.122378 Nov 02 14:13:15.151969 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3552/7473] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:15 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1213 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:16.166853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:16.167759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:16.175632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:16.176339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:16.176905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:16.177904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:16.178582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:16.179098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:16.347655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b9e82bd2-130c-4855-b3a2-ef498f40d1db req-753b7bf9-d78f-4d58-bdf2-740b5a09502c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08393d41-099f-4c8d-90e2-e8b73c5db7bc", "tag": "01d879a0-f7b8-4f47-8944-5ecc75e7daaa"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:16.360888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9e82bd2-130c-4855-b3a2-ef498f40d1db req-753b7bf9-d78f-4d58-bdf2-740b5a09502c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:16.361059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:16.361326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9e82bd2-130c-4855-b3a2-ef498f40d1db req-753b7bf9-d78f-4d58-bdf2-740b5a09502c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:16.361867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9e82bd2-130c-4855-b3a2-ef498f40d1db req-753b7bf9-d78f-4d58-bdf2-740b5a09502c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:16.371413 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-14dde8be-e707-4fd5-9595-cd58071d077a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1281 microversion: 2.1 time: 0.208988 Nov 02 14:13:16.372715 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3922/7474] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:16 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:16.386465 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b9e82bd2-130c-4855-b3a2-ef498f40d1db req-753b7bf9-d78f-4d58-bdf2-740b5a09502c service nova] Creating event network-changed:01d879a0-f7b8-4f47-8944-5ecc75e7daaa for instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc on n-h1-858384-19 Nov 02 14:13:16.394423 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b9e82bd2-130c-4855-b3a2-ef498f40d1db req-753b7bf9-d78f-4d58-bdf2-740b5a09502c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119969 Nov 02 14:13:16.395287 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3553/7475] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:13:17.397114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:17.397716 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:17.405368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:17.405859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:17.406302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:17.407011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:17.407504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:17.407940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:17.552995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:17.562502 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5793b4df-dad3-459b-8e1d-3a645a18045a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1281 microversion: 2.1 time: 0.169415 Nov 02 14:13:17.563070 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3923/7476] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:17 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:18.587733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:18.588449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:18.595020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:18.595551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:18.595999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:18.596724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:18.597191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:18.597632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:18.740589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:18.749736 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0c41e535-1e6f-4240-a0a4-fae09a9a81a6 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1281 microversion: 2.1 time: 0.167199 Nov 02 14:13:18.750341 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3554/7477] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:18 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:19.774073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:19.778384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:19.785171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:19.785662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:19.786102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:19.786805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:19.787288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:19.787717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:19.935292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:19.943032 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-819d9d21-dcf2-42d2-8958-dd06d12ca258 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1281 microversion: 2.1 time: 0.173227 Nov 02 14:13:19.943640 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3924/7478] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:19 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:20.967280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:20.967921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:20.969935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:20.971693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:20.979837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:20.980577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:20.981046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:20.981777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:20.982254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:20.982704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:21.123835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:21.131545 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-08feda1e-6728-4efb-8aa9-ec6cc95df87a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.168942 Nov 02 14:13:21.132119 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3555/7479] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:20 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:22.155660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:22.156277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:22.158977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:13:22.164422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:22.164917 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:22.165364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:22.166056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:22.166510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:22.166940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:22.301483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:22.309774 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3c8d8237-bcff-498c-a0d0-4e3dae06556e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.158126 Nov 02 14:13:22.310353 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3925/7480] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:22 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:23.333105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:23.333732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:23.341295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:23.341875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:23.342328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:23.343077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:23.343568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:23.344008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:23.477968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:23.485928 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b54bc252-bbb5-4b19-b8af-be5b11fcefd3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.156776 Nov 02 14:13:23.486519 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3556/7481] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:23 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:24.508565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:24.509172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:24.516252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:24.516713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:24.517147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:24.517839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:24.518290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:24.518714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:24.654961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:24.662620 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-66f0c7f9-439c-4ccd-af11-fae2592be950 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.157984 Nov 02 14:13:24.663210 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3926/7482] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:24 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:25.685353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:25.685997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:25.693153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:25.693655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:25.694128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:25.694839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:25.695338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:25.695778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:25.836784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:25.844562 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6093b55-e6a7-4bdc-a98b-0ac109deeca7 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.163785 Nov 02 14:13:25.845142 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3557/7483] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:25 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:26.867375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:26.868036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:26.875353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:26.875854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:26.876308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:26.877020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:26.877486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:26.877922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:27.014815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:27.023075 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1ad5996-5f59-42cf-aaa8-883d72f4276e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.159675 Nov 02 14:13:27.023696 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3927/7484] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:26 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:28.047989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:28.048617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:28.055549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:28.056055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:28.056514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:28.057232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:28.057708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:28.058156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:28.190178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:28.197843 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-12810c6d-9447-424c-b18f-1bd8dd7ae44e tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.153939 Nov 02 14:13:28.198424 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3558/7485] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:28 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:29.221626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:29.222178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:29.229141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:29.229634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:29.230081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:29.231397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:29.232103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:29.232333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:29.372677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:29.380483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ba72892-0531-495b-81f6-3d35d0d36d25 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.162998 Nov 02 14:13:29.381077 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3928/7486] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:29 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:30.403994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:30.404653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:30.411637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:30.412079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:30.412534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:30.413244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:30.413716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:30.414163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:30.553856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:30.561934 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9dd7e135-1666-4136-83e8-6d89552f5470 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.162530 Nov 02 14:13:30.562519 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3559/7487] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:30 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:31.585965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:31.586588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:31.596468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:31.596993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:31.597444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:31.598170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:31.598631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:31.599066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:31.660424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e877dcb9-9829-4ee7-ab60-e5fc6f5d0830 req-9451ae8e-1cf5-4c04-8e9f-1c2cc9f1f8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08393d41-099f-4c8d-90e2-e8b73c5db7bc", "name": "network-vif-plugged", "status": "completed", "tag": "01d879a0-f7b8-4f47-8944-5ecc75e7daaa"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:31.671176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e877dcb9-9829-4ee7-ab60-e5fc6f5d0830 req-9451ae8e-1cf5-4c04-8e9f-1c2cc9f1f8cd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:31.671727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e877dcb9-9829-4ee7-ab60-e5fc6f5d0830 req-9451ae8e-1cf5-4c04-8e9f-1c2cc9f1f8cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:31.672179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e877dcb9-9829-4ee7-ab60-e5fc6f5d0830 req-9451ae8e-1cf5-4c04-8e9f-1c2cc9f1f8cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:31.683522 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e877dcb9-9829-4ee7-ab60-e5fc6f5d0830 req-9451ae8e-1cf5-4c04-8e9f-1c2cc9f1f8cd service nova] Creating event network-vif-plugged:01d879a0-f7b8-4f47-8944-5ecc75e7daaa for instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc on n-h1-858384-19 Nov 02 14:13:31.689662 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e877dcb9-9829-4ee7-ab60-e5fc6f5d0830 req-9451ae8e-1cf5-4c04-8e9f-1c2cc9f1f8cd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086555 Nov 02 14:13:31.689920 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3560/7488] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:13:31.745802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:31.754335 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b56d538-454a-4a7c-bf78-42f139176985 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.172440 Nov 02 14:13:31.754932 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3929/7489] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:31 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:32.778631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:32.779366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:32.786296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:32.786788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:32.787268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:32.787973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:32.788439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:32.788877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:32.923388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:32.931104 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-feb52351-655e-438e-a9d2-8b8d06042452 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1269 microversion: 2.1 time: 0.156755 Nov 02 14:13:32.931699 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3561/7490] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:32 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:33.955971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:33.956492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:33.963537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:33.964026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:33.964471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:33.965919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:33.966381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:33.966866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:34.104742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:34.112957 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-50685a9b-a197-44ba-b993-c67805a4ebbb tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1457 microversion: 2.1 time: 0.161030 Nov 02 14:13:34.113546 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3930/7491] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:33 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1457 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:13:34.135487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:13:34.136120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:13:34.143818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:34.144316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:34.144779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:34.145491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:34.145964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:34.146408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:34.287982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:13:34.296630 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c58947da-2edc-4dba-b516-2091d800b846 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1457 microversion: 2.1 time: 0.165082 Nov 02 14:13:34.297225 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3562/7492] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:13:34 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1457 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:13:36.236976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e070c4de-0a61-44fd-b6b7-b1f4a9780d9c req-e30b760f-ebb8-4fc6-a53a-3e036022ce32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08393d41-099f-4c8d-90e2-e8b73c5db7bc", "tag": "01d879a0-f7b8-4f47-8944-5ecc75e7daaa"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:13:36.247619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e070c4de-0a61-44fd-b6b7-b1f4a9780d9c req-e30b760f-ebb8-4fc6-a53a-3e036022ce32 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:13:36.248099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e070c4de-0a61-44fd-b6b7-b1f4a9780d9c req-e30b760f-ebb8-4fc6-a53a-3e036022ce32 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:13:36.248630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e070c4de-0a61-44fd-b6b7-b1f4a9780d9c req-e30b760f-ebb8-4fc6-a53a-3e036022ce32 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:13:36.259953 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e070c4de-0a61-44fd-b6b7-b1f4a9780d9c req-e30b760f-ebb8-4fc6-a53a-3e036022ce32 service nova] Creating event network-changed:01d879a0-f7b8-4f47-8944-5ecc75e7daaa for instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc on n-h1-858384-19 Nov 02 14:13:36.265864 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e070c4de-0a61-44fd-b6b7-b1f4a9780d9c req-e30b760f-ebb8-4fc6-a53a-3e036022ce32 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033351 Nov 02 14:13:36.266535 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3931/7493] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:13.158283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:13.158802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:13.161368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:13.162439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=66 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:13.163643 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:15:13.163773 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:15:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc (ip 10.222.0.113) !!! Nov 02 14:15:13.177409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:13.177913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:13.178368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:13.179087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:13.179573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:13.180013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:13.210521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:15:13.213610 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] AMQP server on 10.222.0.113:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 14:15:13.215717 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] AMQP server on 10.222.0.113:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 14:15:13.216612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=30 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:13.217565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=62 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:13.218903 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:15:13.219048 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:15:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.113) !!! Nov 02 14:15:13.220459 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:15:13.220829 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:15:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.113) !!! Nov 02 14:15:13.287167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-13824b25-edc6-4d78-b37c-3aec0eef40e9 req-5b027bb6-b286-4448-9a6d-f3b18716f22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08393d41-099f-4c8d-90e2-e8b73c5db7bc", "tag": "01d879a0-f7b8-4f47-8944-5ecc75e7daaa"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:13.305884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-13824b25-edc6-4d78-b37c-3aec0eef40e9 req-5b027bb6-b286-4448-9a6d-f3b18716f22f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:13.306665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-13824b25-edc6-4d78-b37c-3aec0eef40e9 req-5b027bb6-b286-4448-9a6d-f3b18716f22f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:13.307152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-13824b25-edc6-4d78-b37c-3aec0eef40e9 req-5b027bb6-b286-4448-9a6d-f3b18716f22f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:13.312037 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6898728a-9012-421c-8380-064d4cda2659 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 204 len: 0 microversion: 2.1 time: 0.159658 Nov 02 14:15:13.312642 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3563/7494] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:15:13 2022] DELETE /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:15:13.321905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:13.322639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:13.328797 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-13824b25-edc6-4d78-b37c-3aec0eef40e9 req-5b027bb6-b286-4448-9a6d-f3b18716f22f service nova] Creating event network-changed:01d879a0-f7b8-4f47-8944-5ecc75e7daaa for instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc on n-h1-858384-19 Nov 02 14:15:13.330249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:13.330766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:13.331258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:13.332882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:13.332882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:13.332882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:13.335151 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-13824b25-edc6-4d78-b37c-3aec0eef40e9 req-5b027bb6-b286-4448-9a6d-f3b18716f22f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123330 Nov 02 14:15:13.335769 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3932/7495] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:13.474250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:13.482222 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eef1209b-72c3-4bdb-af0a-61349bbe8543 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1582 microversion: 2.1 time: 0.164655 Nov 02 14:15:13.482806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3564/7496] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:13 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1582 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:14.507883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:14.508596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:14.518549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.519041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.519509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.520219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:14.520675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:14.521107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:14.525860 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 41688. Nov 02 14:15:14.526714 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 41690. Nov 02 14:15:14.666200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:14.674475 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dea92142-ecac-4620-bac3-e4dbe9cb1468 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1582 microversion: 2.1 time: 0.172385 Nov 02 14:15:14.675061 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3933/7497] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:14 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1582 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:15.698349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:15.699012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:15.707143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:15.707673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:15.708158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:15.708961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:15.709358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:15.709780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:15.789120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:15.797948 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a1e9b77-7e79-40f3-b77c-18d2babb07df tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1395 microversion: 2.1 time: 0.103807 Nov 02 14:15:15.798992 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3565/7498] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:15 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1395 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:15.846338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-51b926f2-258c-4bb4-935d-573436c57a1b req-07f9cab0-9b95-4346-9396-406f2fbf1f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08393d41-099f-4c8d-90e2-e8b73c5db7bc", "name": "network-vif-deleted", "tag": "01d879a0-f7b8-4f47-8944-5ecc75e7daaa"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:15.858616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-51b926f2-258c-4bb4-935d-573436c57a1b req-07f9cab0-9b95-4346-9396-406f2fbf1f14 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:15.859102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-51b926f2-258c-4bb4-935d-573436c57a1b req-07f9cab0-9b95-4346-9396-406f2fbf1f14 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:15.859828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-51b926f2-258c-4bb4-935d-573436c57a1b req-07f9cab0-9b95-4346-9396-406f2fbf1f14 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:15.876177 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-51b926f2-258c-4bb4-935d-573436c57a1b req-07f9cab0-9b95-4346-9396-406f2fbf1f14 service nova] Creating event network-vif-deleted:01d879a0-f7b8-4f47-8944-5ecc75e7daaa for instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc on n-h1-858384-19 Nov 02 14:15:15.881059 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-51b926f2-258c-4bb4-935d-573436c57a1b req-07f9cab0-9b95-4346-9396-406f2fbf1f14 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038561 Nov 02 14:15:15.881686 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3934/7499] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:16.821822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:16.822376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:16.829861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:16.830355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:16.830807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:16.831546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:16.832013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:16.832452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:16.897603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:16.907378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2f635f68-a7c1-43d9-aa1e-8faf082dcea1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1228 microversion: 2.1 time: 0.089458 Nov 02 14:15:16.908314 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3566/7500] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:16 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:17.931491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:17.932086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:17.939096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:17.939601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:17.940041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:17.940739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:17.941191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:17.941615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:18.012904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:18.021048 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae8bac43-0c2d-41d8-b0a8-62f156a1a7e2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1228 microversion: 2.1 time: 0.094846 Nov 02 14:15:18.021665 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3935/7501] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:17 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:19.044597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:19.045249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:19.051679 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:19.052170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:19.052632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:19.053330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:19.053795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:19.054238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:19.121882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:19.130258 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de910de4-db68-4063-b66d-658a1c0c2e66 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1228 microversion: 2.1 time: 0.089778 Nov 02 14:15:19.130868 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3567/7502] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:19 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:20.158998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:20.160929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:20.167299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:20.168365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:20.169187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:20.169715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:20.170171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:20.170628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:20.210637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:20.211142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:20.211597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:20.212046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lazy-loading 'fault' on Instance uuid 08393d41-099f-4c8d-90e2-e8b73c5db7bc {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:15:20.254242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:20.262588 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a7d6aaaa-c968-4125-8838-80b13a8c845d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 200 len: 1233 microversion: 2.1 time: 0.110247 Nov 02 14:15:20.263189 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3936/7503] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:20 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 1233 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:21.285526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:21.286164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 08393d41-099f-4c8d-90e2-e8b73c5db7bc] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:21.293932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:21.294439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:21.294895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:21.295649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:21.296131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:21.296577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:21.310719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc could not be found. Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc HTTP/1.1 Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc could not be found. Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '08393d41-099f-4c8d-90e2-e8b73c5db7bc'} Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc could not be found. Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc could not be found. Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:21.312414 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc could not be found. Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance 08393d41-099f-4c8d-90e2-e8b73c5db7bc could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6a279575-d2ec-46c2-9231-e7264186907f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc" status: 404 len: 111 microversion: 2.1 time: 0.032486 Nov 02 14:15:21.317105 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3568/7504] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:21 2022] GET /compute/v2.1/servers/08393d41-099f-4c8d-90e2-e8b73c5db7bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:27.544486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:27.545063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:27.548195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4f674e74-f31f-4b9b-aaef-0664e8b1188c req-3f6f754c-30b7-4127-b591-1d1665c0ef9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e814a4f-4b8a-425f-9a6a-dda804ac20b2", "tag": "d546ec6e-a3a6-4f73-b489-bbaf0b871e4d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:27.555894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:27.556462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:27.557191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:27.558531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:27.559042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:27.559626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:27.561004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4f674e74-f31f-4b9b-aaef-0664e8b1188c req-3f6f754c-30b7-4127-b591-1d1665c0ef9a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:27.561508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4f674e74-f31f-4b9b-aaef-0664e8b1188c req-3f6f754c-30b7-4127-b591-1d1665c0ef9a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:27.561963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4f674e74-f31f-4b9b-aaef-0664e8b1188c req-3f6f754c-30b7-4127-b591-1d1665c0ef9a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:27.574546 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4f674e74-f31f-4b9b-aaef-0664e8b1188c req-3f6f754c-30b7-4127-b591-1d1665c0ef9a service nova] Creating event network-changed:d546ec6e-a3a6-4f73-b489-bbaf0b871e4d for instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 on n-h2-858384-19 Nov 02 14:15:27.580550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4f674e74-f31f-4b9b-aaef-0664e8b1188c req-3f6f754c-30b7-4127-b591-1d1665c0ef9a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036912 Nov 02 14:15:27.581637 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3569/7505] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:27.588085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:15:27.687842 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-48548aee-ae2f-4fbd-b33e-070909df662c tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 204 len: 0 microversion: 2.1 time: 0.147288 Nov 02 14:15:27.688560 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3937/7506] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:15:27 2022] DELETE /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:15:27.698136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:27.699874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:27.708121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:27.709032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:27.709676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:27.710600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:27.711468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:27.712138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:27.863023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:27.871557 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-49c37068-9431-4693-a0fe-9ae51e2274b9 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1581 microversion: 2.1 time: 0.178387 Nov 02 14:15:27.872154 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3570/7507] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:27 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1581 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:15:28.897232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:28.897943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:28.905483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:28.906055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:28.906494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:28.907375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:28.908095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:28.908647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:29.064064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:29.072043 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b77aecc7-15e6-4fb8-b7d5-8200c152fdc2 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1581 microversion: 2.1 time: 0.180619 Nov 02 14:15:29.072632 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3938/7508] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:28 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1581 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:30.095665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:30.096356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:30.103081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:30.103624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:30.104125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:30.104965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:30.105474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:30.105911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:30.172192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:30.179449 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c147bfd8-c5f6-404d-b6ce-c67427ec5657 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1394 microversion: 2.1 time: 0.087870 Nov 02 14:15:30.180029 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3571/7509] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:30 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1394 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:30.206826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-23c0485f-7300-4cc1-9a39-d10e8a0bce85 req-84bdfde6-e8c5-4226-9e15-da707f370ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e814a4f-4b8a-425f-9a6a-dda804ac20b2", "name": "network-vif-deleted", "tag": "d546ec6e-a3a6-4f73-b489-bbaf0b871e4d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:30.218818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-23c0485f-7300-4cc1-9a39-d10e8a0bce85 req-84bdfde6-e8c5-4226-9e15-da707f370ed1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:30.219348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-23c0485f-7300-4cc1-9a39-d10e8a0bce85 req-84bdfde6-e8c5-4226-9e15-da707f370ed1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:30.220000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-23c0485f-7300-4cc1-9a39-d10e8a0bce85 req-84bdfde6-e8c5-4226-9e15-da707f370ed1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:30.232801 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-23c0485f-7300-4cc1-9a39-d10e8a0bce85 req-84bdfde6-e8c5-4226-9e15-da707f370ed1 service nova] Creating event network-vif-deleted:d546ec6e-a3a6-4f73-b489-bbaf0b871e4d for instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 on n-h2-858384-19 Nov 02 14:15:30.237936 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-23c0485f-7300-4cc1-9a39-d10e8a0bce85 req-84bdfde6-e8c5-4226-9e15-da707f370ed1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035505 Nov 02 14:15:30.238594 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3939/7510] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:15:31.204632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:31.205190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:31.212165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:31.212675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:31.213137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:31.213860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:31.215063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:31.215547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:31.279435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:31.287391 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5173d931-9e8f-4c04-8171-e04e4484eee0 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1228 microversion: 2.1 time: 0.086950 Nov 02 14:15:31.287973 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3572/7511] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:31 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:32.313420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:32.314115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:32.320515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.321003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.321443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.322140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:32.322604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:32.323027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:32.395013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:32.403719 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79cc7de1-e215-41e4-8b64-12d5f0422ef1 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1228 microversion: 2.1 time: 0.096052 Nov 02 14:15:32.404316 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3940/7512] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:32 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:33.427770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:33.428436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:33.437156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:33.437671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:33.438131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:33.438884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:33.439387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:33.439835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:33.510208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:33.518681 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-610b9adf-e4b9-4114-b276-5189d121dd0a tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1228 microversion: 2.1 time: 0.094959 Nov 02 14:15:33.519406 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3573/7513] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:33 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1228 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:34.541756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:34.543076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:34.550064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:34.550580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:34.551024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:34.551758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:34.552215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:34.552652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:34.582914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:34.583430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:34.583871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:34.584315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lazy-loading 'fault' on Instance uuid 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:15:34.626738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2bb8e9b22043ca88ee5a68f23358d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c406124bb164c988b18c0b9cf5369ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:15:34.634903 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2a2ee3f6-7c4f-4324-88f6-2b503fb5907d tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 200 len: 1233 microversion: 2.1 time: 0.096996 Nov 02 14:15:34.635513 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3941/7514] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:34 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 1233 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:15:35.658612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:35.659289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: 2e814a4f-4b8a-425f-9a6a-dda804ac20b2] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:35.666106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:35.666614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:35.667129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:35.667963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:35.668442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:35.668891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:35.682246 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 could not be found. Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 HTTP/1.1 Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 could not be found. Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '2e814a4f-4b8a-425f-9a6a-dda804ac20b2'} Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 could not be found. Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 could not be found. Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:35.684079 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 could not be found. Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance 2e814a4f-4b8a-425f-9a6a-dda804ac20b2 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1dee57eb-5ee2-4d79-a1ec-0461a6a0382f tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2" status: 404 len: 111 microversion: 2.1 time: 0.030901 Nov 02 14:15:35.688617 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3574/7515] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:35 2022] GET /compute/v2.1/servers/2e814a4f-4b8a-425f-9a6a-dda804ac20b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:36.141971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:36.142490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:36.149486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:36.149974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:36.150428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:36.151156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:36.152233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:36.152685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:36.166173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 HTTP/1.1 Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'fe3343da-5ecf-431b-8514-2fb527454703'} Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:36.168461 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1fbe8e64-3a2a-454f-a6dc-823a0455f1b3 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 404 len: 111 microversion: 2.1 time: 0.031915 Nov 02 14:15:36.172630 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3942/7516] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:15:36 2022] DELETE /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:36.178658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:36.179311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] [instance: fe3343da-5ecf-431b-8514-2fb527454703] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:15:36.185947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:36.186440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:36.186890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:36.187629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:36.188094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:36.188533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:36.202538 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] HTTP exception thrown: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Request method failure captured: Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 HTTP/1.1 Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnjlZ1fqzsOplvpSkywbqPtjoLlG7WBrXTYv4s8GQ_iMrvqpUr6wKlC9uuUlbxsusxN38HgjD9STHR2iCfv97kEMgqLHjy6xl-aTCRJtL4FD63u_lajAxWywSBu9qRTiJGQrARxYKgTSrpgJHfiWBRE2fqfKkNnJzjx_5JescZuEabY Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/8c406124bb164c988b18c0b9cf5369ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 8c406124bb164c988b18c0b9cf5369ad Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestVolumeBootPattern-504483991 Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 5b2bb8e9b22043ca88ee5a68f23358d1 Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestVolumeBootPattern-504483991-project Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'fe3343da-5ecf-431b-8514-2fb527454703'} Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:15:36.204102 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Returning 404 to user: Instance fe3343da-5ecf-431b-8514-2fb527454703 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bff5c1fc-09c8-4862-a69a-271d286d7a47 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703" status: 404 len: 111 microversion: 2.1 time: 0.030812 Nov 02 14:15:36.208775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3575/7517] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:15:36 2022] GET /compute/v2.1/servers/fe3343da-5ecf-431b-8514-2fb527454703 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:15:39.630597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-67d97d96-ac6a-4f42-b356-bac56937ce07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] Calling method '.version_select at 0x7fe785f9f9d0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:15:39.661641 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-67d97d96-ac6a-4f42-b356-bac56937ce07 tempest-TestVolumeBootPattern-504483991 tempest-TestVolumeBootPattern-504483991-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-618393204" status: 202 len: 0 microversion: 2.1 time: 0.034912 Nov 02 14:15:39.662452 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3943/7518] 10.222.0.113 () {58 vars in 1265 bytes} [Wed Nov 2 14:15:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-618393204 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:15:59.317982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:59.319054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:15:59.428046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1353719052", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:15:59.482660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] validate_networks() for None {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:15:59.676992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:15:59.677435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:15:59.677948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:15:59.678499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:15:59.678929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:15:59.688906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:59.689406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:59.689876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:59.690601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:15:59.691072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:15:59.691538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:15:59.708464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Getting quotas for project 4815f681044041f28862117b8e27caa9. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:15:59.713701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Getting quotas for user 0e9397c3edae46a8a26a8797d2f55534 and project 4815f681044041f28862117b8e27caa9. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:15:59.726347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:15:59.728792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:15:59.773829 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [47ea6434-e0ae-4224-b6a5-a3168bce624c] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:16:00.781629 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [47ea6434-e0ae-4224-b6a5-a3168bce624c] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 41872. Nov 02 14:16:00.785470 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f30c65ec-e63e-4d61-b882-0c967c253b8d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.472821 Nov 02 14:16:00.786137 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3576/7519] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:15:59 2022] POST /compute/v2.1/servers => generated 382 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:16:00.799592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:00.800445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:00.807838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e551993e-20ed-4a9f-ac0c-14daaf4ec615 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:00.808383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e551993e-20ed-4a9f-ac0c-14daaf4ec615 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:00.871710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e551993e-20ed-4a9f-ac0c-14daaf4ec615 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:00.878597 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e551993e-20ed-4a9f-ac0c-14daaf4ec615 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1226 microversion: 2.1 time: 0.081146 Nov 02 14:16:00.879181 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3944/7520] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:00 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:01.904609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:01.905207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:01.911489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:01.911996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:01.912451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:01.913169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:01.913798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:01.914253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:01.986771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:01.995481 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a389eb98-343e-46d2-99e4-c786d3d0e5d3 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1278 microversion: 2.1 time: 0.096884 Nov 02 14:16:01.996664 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3577/7521] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:01 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:03.021158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:03.021780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:03.029661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:03.030168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:03.030622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:03.031373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:03.031847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:03.032283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:03.251735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:03.259960 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8b998d6-c9a5-4841-9f61-f113e8d7789e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1326 microversion: 2.1 time: 0.242779 Nov 02 14:16:03.260480 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3945/7522] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:03 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1326 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:03.601831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-75d752db-48e4-4044-b6cf-452341113891 req-77bb1517-8de1-4ce4-a04c-8d814128559f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0773cb5-f258-4cb8-852b-7f104871b2ee", "tag": "9c3a306c-5da8-4920-9c1a-d8015e7f3e3c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:03.613978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-75d752db-48e4-4044-b6cf-452341113891 req-77bb1517-8de1-4ce4-a04c-8d814128559f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:03.614480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-75d752db-48e4-4044-b6cf-452341113891 req-77bb1517-8de1-4ce4-a04c-8d814128559f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:03.614925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-75d752db-48e4-4044-b6cf-452341113891 req-77bb1517-8de1-4ce4-a04c-8d814128559f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:03.628029 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-75d752db-48e4-4044-b6cf-452341113891 req-77bb1517-8de1-4ce4-a04c-8d814128559f service nova] Creating event network-changed:9c3a306c-5da8-4920-9c1a-d8015e7f3e3c for instance e0773cb5-f258-4cb8-852b-7f104871b2ee on n-h2-858384-19 Nov 02 14:16:03.632892 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-75d752db-48e4-4044-b6cf-452341113891 req-77bb1517-8de1-4ce4-a04c-8d814128559f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034929 Nov 02 14:16:03.633519 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3578/7523] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:16:04.282484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:04.283164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:04.290832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:04.291351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:04.291795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:04.292538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:04.293165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:04.293603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:04.422854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:04.430497 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19c60b5c-f4df-4a19-a34b-75ad313da53b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1326 microversion: 2.1 time: 0.151959 Nov 02 14:16:04.431075 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3946/7524] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:04 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:05.455940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:05.456654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:05.462830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:05.463423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:05.463876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:05.465284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:05.465858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:05.466303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:05.602101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:05.610304 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-348dd864-8b84-42ca-9e5a-5243e6f7cb90 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1326 microversion: 2.1 time: 0.159676 Nov 02 14:16:05.610919 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3579/7525] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:05 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:16:06.633024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:06.633639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:06.641446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:06.641935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:06.642378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:06.643090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:06.643570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:06.644002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:06.783968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:06.792754 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f6a7501f-b884-46d3-9eea-75e0054dba29 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1326 microversion: 2.1 time: 0.163205 Nov 02 14:16:06.793778 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3947/7526] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:06 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:07.823237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:07.823962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:07.830873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:07.831686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:07.832157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:07.832989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:07.833500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:07.833993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:07.963836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:07.971888 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-14a7ed9c-d667-40e1-bdd5-506c9a1fb616 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1326 microversion: 2.1 time: 0.152648 Nov 02 14:16:07.972515 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3580/7527] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:07 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:08.996210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:08.996855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:09.004323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:09.004869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:09.005320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:09.006039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:09.006503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:09.006938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:09.018071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-24412d59-3378-4dce-9db6-99f20f59ff5e req-f73cc0bc-b073-4315-96c7-62f51b0a5003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0773cb5-f258-4cb8-852b-7f104871b2ee", "name": "network-vif-plugged", "status": "completed", "tag": "9c3a306c-5da8-4920-9c1a-d8015e7f3e3c"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:09.030666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-24412d59-3378-4dce-9db6-99f20f59ff5e req-f73cc0bc-b073-4315-96c7-62f51b0a5003 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:09.031664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-24412d59-3378-4dce-9db6-99f20f59ff5e req-f73cc0bc-b073-4315-96c7-62f51b0a5003 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:09.032328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-24412d59-3378-4dce-9db6-99f20f59ff5e req-f73cc0bc-b073-4315-96c7-62f51b0a5003 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:09.044166 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-24412d59-3378-4dce-9db6-99f20f59ff5e req-f73cc0bc-b073-4315-96c7-62f51b0a5003 service nova] Creating event network-vif-plugged:9c3a306c-5da8-4920-9c1a-d8015e7f3e3c for instance e0773cb5-f258-4cb8-852b-7f104871b2ee on n-h2-858384-19 Nov 02 14:16:09.049618 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-24412d59-3378-4dce-9db6-99f20f59ff5e req-f73cc0bc-b073-4315-96c7-62f51b0a5003 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035300 Nov 02 14:16:09.050236 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3581/7528] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:16:09.211718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:09.219649 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e55fd97c-46de-4c8c-8c49-ea45ff2d2d70 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1326 microversion: 2.1 time: 0.228031 Nov 02 14:16:09.220248 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3948/7529] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:08 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1326 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:10.244379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:10.245168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:10.248018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:10.248769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:10.255581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:10.256081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:10.256533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:10.257264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:10.257756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:10.258200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:10.396102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:10.402951 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8b26f5a4-e4d9-4aeb-be99-60adcd7d5057 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1326 microversion: 2.1 time: 0.163232 Nov 02 14:16:10.403569 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3582/7530] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:10 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:11.426210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:11.426818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:11.429541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:11.435551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:11.436040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:11.436484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:11.437219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:11.437672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:11.438100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:11.571722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:11.580003 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-131378df-d13b-45d2-979e-7875f552663b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1475 microversion: 2.1 time: 0.157765 Nov 02 14:16:11.580578 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3949/7531] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:11 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1475 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:11.653297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-851b1bf4-9940-4e17-9db9-2c8449d1db5c tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Calling method '.version_select at 0x7fe786500820>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:11.716957 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-851b1bf4-9940-4e17-9db9-2c8449d1db5c tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/042594c5f9884f2ebf16c2c7c4e6413b" status: 200 len: 371 microversion: 2.1 time: 0.115170 Nov 02 14:16:11.717541 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3583/7532] 10.222.0.113 () {58 vars in 1247 bytes} [Wed Nov 2 14:16:11 2022] GET /compute/v2.1/os-quota-sets/042594c5f9884f2ebf16c2c7c4e6413b => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:11.729297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e11b7891-1fdc-4088-8e4d-0f2f88952552 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-778163897", "id": 1432979582, "os-flavor-access:is_public": "True"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:11.748848 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e11b7891-1fdc-4088-8e4d-0f2f88952552 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.023289 Nov 02 14:16:11.749444 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3950/7533] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:16:11 2022] POST /compute/v2.1/flavors => generated 439 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:11.761729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1432979582"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:11.764024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:11.770024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:11.770527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:11.770973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:11.771714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:11.772183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:11.772635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:11.860904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e9b3af6a4ea14f9f946bb7160385032e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042594c5f9884f2ebf16c2c7c4e6413b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:11.867100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-778163897 {{(pid=120929) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:16:11.875390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:11.875886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:11.876342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:11.877087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:11.877670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:11.878123 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:11.900807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Getting quotas for project 4815f681044041f28862117b8e27caa9. Resources: {'ram', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:16:11.906879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Getting quotas for user 0e9397c3edae46a8a26a8797d2f55534 and project 4815f681044041f28862117b8e27caa9. Resources: {'ram', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:16:11.922514 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.api [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] ram quota exceeded for 042594c5f9884f2ebf16c2c7c4e6413b, tried to resize instance. Nov 02 14:16:11.923070 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Request method failure captured: Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee/action HTTP/1.1 Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 39 Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnufGHjdmwKDG6irZRUMwS52XSJvaPDjz8DAFp4f1UeYncS_EXsnZnwYff9ZxfguE8sBdHbpSfd3T2SuhyYZ_kr-6i3Uw9be5jJg51mA5f6N6IAYXstMwmdjbGZvmlOByo8IRzOGUirYjYI6Ot4WkUhP5TpkytoHX2GQBBwnNV1TOio Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 042594c5f9884f2ebf16c2c7c4e6413b Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1989514784 Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader,admin Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader,admin Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/042594c5f9884f2ebf16c2c7c4e6413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/042594c5f9884f2ebf16c2c7c4e6413b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_042594c5f9884f2ebf16c2c7c4e6413b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/042594c5f9884f2ebf16c2c7c4e6413b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1989514784 Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 042594c5f9884f2ebf16c2c7c4e6413b Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1989514784 Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersAdminNegativeTestJSON-1989514784-project-admin Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: e9b3af6a4ea14f9f946bb7160385032e Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1989514784-project-admin Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: {"resize": {"flavorRef": "1432979582"}} Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e0773cb5-f258-4cb8-852b-7f104871b2ee', 'body': {'resize': {'flavorRef': '1432979582'}}} Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3879, in _check_quota_for_upsize Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:16:11.925156 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4245, in resize Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3897, in _check_quota_for_upsize Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6111292-04b1-40f4-9825-0e4f69bace4f tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee/action" status: 403 len: 118 microversion: 2.1 time: 0.168930 Nov 02 14:16:11.930242 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3584/7534] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:16:11 2022] POST /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee/action => generated 118 bytes in 170 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:16:11.936309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-427014a6-e49f-49ad-bc25-747d805b3a72 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:11.953880 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-427014a6-e49f-49ad-bc25-747d805b3a72 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1432979582" status: 202 len: 0 microversion: 2.1 time: 0.022007 Nov 02 14:16:11.954476 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3951/7535] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 14:16:11 2022] DELETE /compute/v2.1/flavors/1432979582 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:16:11.962321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3bea1e0f-0da9-4aec-91a0-ad5bd8cb8480 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:11.983315 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3bea1e0f-0da9-4aec-91a0-ad5bd8cb8480 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.024560 Nov 02 14:16:11.983890 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3585/7536] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 14:16:11 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:12.005548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-762d986b-ff5c-48a2-8e9c-32aa8767b5b2 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Calling method '.version_select at 0x7fe786314160>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:12.078128 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-762d986b-ff5c-48a2-8e9c-32aa8767b5b2 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "GET /compute/v2.1/os-quota-sets/042594c5f9884f2ebf16c2c7c4e6413b" status: 200 len: 371 microversion: 2.1 time: 0.076356 Nov 02 14:16:12.078710 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3952/7537] 10.222.0.113 () {58 vars in 1247 bytes} [Wed Nov 2 14:16:12 2022] GET /compute/v2.1/os-quota-sets/042594c5f9884f2ebf16c2c7c4e6413b => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:12.091783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-265135f2-bc36-40aa-8427-fbe48965947b tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1247193511", "id": 1108957138, "os-flavor-access:is_public": "True"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:12.110535 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-265135f2-bc36-40aa-8427-fbe48965947b tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.023721 Nov 02 14:16:12.111060 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3586/7538] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:16:12 2022] POST /compute/v2.1/flavors => generated 439 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:12.123936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1108957138"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:12.126441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:12.132581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:12.133074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:12.133541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:12.134235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:12.134700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:12.135154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:12.356530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e9b3af6a4ea14f9f946bb7160385032e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042594c5f9884f2ebf16c2c7c4e6413b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:12.363170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1247193511 {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:16:12.369816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:12.370330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:12.370775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:12.371546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:12.372005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:12.372438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:12.397484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Getting quotas for project 4815f681044041f28862117b8e27caa9. Resources: {'ram', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:16:12.403337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Getting quotas for user 0e9397c3edae46a8a26a8797d2f55534 and project 4815f681044041f28862117b8e27caa9. Resources: {'ram', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:16:12.415785 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.compute.api [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] cores quota exceeded for 042594c5f9884f2ebf16c2c7c4e6413b, tried to resize instance. Nov 02 14:16:12.416334 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Request method failure captured: Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee/action HTTP/1.1 Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 39 Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnufGHjdmwKDG6irZRUMwS52XSJvaPDjz8DAFp4f1UeYncS_EXsnZnwYff9ZxfguE8sBdHbpSfd3T2SuhyYZ_kr-6i3Uw9be5jJg51mA5f6N6IAYXstMwmdjbGZvmlOByo8IRzOGUirYjYI6Ot4WkUhP5TpkytoHX2GQBBwnNV1TOio Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 042594c5f9884f2ebf16c2c7c4e6413b Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1989514784 Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader,admin Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader,admin Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/042594c5f9884f2ebf16c2c7c4e6413b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/042594c5f9884f2ebf16c2c7c4e6413b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_042594c5f9884f2ebf16c2c7c4e6413b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/042594c5f9884f2ebf16c2c7c4e6413b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1989514784 Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 042594c5f9884f2ebf16c2c7c4e6413b Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1989514784 Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersAdminNegativeTestJSON-1989514784-project-admin Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: e9b3af6a4ea14f9f946bb7160385032e Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1989514784-project-admin Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: {"resize": {"flavorRef": "1108957138"}} Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e0773cb5-f258-4cb8-852b-7f104871b2ee', 'body': {'resize': {'flavorRef': '1108957138'}}} Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3879, in _check_quota_for_upsize Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:16:12.418491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4245, in resize Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3897, in _check_quota_for_upsize Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-61dcd096-e9c2-4784-aaca-2681037000c8 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "POST /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee/action" status: 403 len: 113 microversion: 2.1 time: 0.300614 Nov 02 14:16:12.422726 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3953/7539] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:16:12 2022] POST /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee/action => generated 113 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:16:12.429167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-82f46343-8711-4eed-9269-a94bc21880c2 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:12.445936 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-82f46343-8711-4eed-9269-a94bc21880c2 tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "DELETE /compute/v2.1/flavors/1108957138" status: 202 len: 0 microversion: 2.1 time: 0.020518 Nov 02 14:16:12.446500 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3587/7540] 10.222.0.113 () {58 vars in 1166 bytes} [Wed Nov 2 14:16:12 2022] DELETE /compute/v2.1/flavors/1108957138 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:16:12.455134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8c0eb05-916e-4b03-bb84-5f49ad6b0aec tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:12.476925 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8c0eb05-916e-4b03-bb84-5f49ad6b0aec tempest-ServersAdminNegativeTestJSON-1989514784 tempest-ServersAdminNegativeTestJSON-1989514784-project-admin] 10.222.0.113 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.025502 Nov 02 14:16:12.477513 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3954/7541] 10.222.0.113 () {58 vars in 1151 bytes} [Wed Nov 2 14:16:12 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:12.498994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:12.499589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:12.505671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:12.506165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:12.506611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:12.507351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:12.507816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:12.508251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:12.535154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:16:12.611611 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-80fde19e-7825-4b96-b7aa-6d1fde1d213e tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 204 len: 0 microversion: 2.1 time: 0.116535 Nov 02 14:16:12.612366 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3588/7542] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:16:12 2022] DELETE /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:16:12.621967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:12.622522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:12.628617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:12.629108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:12.629554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:12.630253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:12.630714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:12.631172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:12.763742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:12.771455 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0337253c-1218-4b1f-80c8-084129ae0d2d tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1481 microversion: 2.1 time: 0.154926 Nov 02 14:16:12.772034 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3955/7543] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:12 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1481 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:13.795024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:13.795774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:13.803650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:13.804209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:13.804611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:13.805323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:13.805798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:13.806246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:13.940451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:13.948364 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-712d52af-ab0a-4f74-830d-b0bc81675d4b tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1481 microversion: 2.1 time: 0.158317 Nov 02 14:16:13.948956 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3589/7544] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:13 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1481 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:14.671958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-049d233b-9146-481e-a169-82be34123f3a req-4fcfc61d-bd26-4079-8cc7-c1db7c076a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0773cb5-f258-4cb8-852b-7f104871b2ee", "name": "network-vif-deleted", "tag": "9c3a306c-5da8-4920-9c1a-d8015e7f3e3c"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:14.682439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-049d233b-9146-481e-a169-82be34123f3a req-4fcfc61d-bd26-4079-8cc7-c1db7c076a4c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:14.683506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-049d233b-9146-481e-a169-82be34123f3a req-4fcfc61d-bd26-4079-8cc7-c1db7c076a4c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:14.683965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-049d233b-9146-481e-a169-82be34123f3a req-4fcfc61d-bd26-4079-8cc7-c1db7c076a4c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:14.697516 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-049d233b-9146-481e-a169-82be34123f3a req-4fcfc61d-bd26-4079-8cc7-c1db7c076a4c service nova] Creating event network-vif-deleted:9c3a306c-5da8-4920-9c1a-d8015e7f3e3c for instance e0773cb5-f258-4cb8-852b-7f104871b2ee on n-h2-858384-19 Nov 02 14:16:14.703515 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-049d233b-9146-481e-a169-82be34123f3a req-4fcfc61d-bd26-4079-8cc7-c1db7c076a4c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035666 Nov 02 14:16:14.704708 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3956/7545] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:14.971501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:14.972208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:14.979528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:14.980634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:14.981089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:14.981882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:14.982350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:14.982784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:15.016694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:15.017183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:15.017630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:15.018086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lazy-loading 'fault' on Instance uuid e0773cb5-f258-4cb8-852b-7f104871b2ee {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:16:15.060816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9397c3edae46a8a26a8797d2f55534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4815f681044041f28862117b8e27caa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:15.068904 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-46cebcf3-684d-4f81-9d83-ab0775bf6a22 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 200 len: 1316 microversion: 2.1 time: 0.101295 Nov 02 14:16:15.069421 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3590/7546] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:14 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 1316 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:16.094021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:16.094720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] [instance: e0773cb5-f258-4cb8-852b-7f104871b2ee] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:16.100952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:16.101438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:16.101867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:16.102558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:16.103009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:16.103484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:16.124659 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] HTTP exception thrown: Instance e0773cb5-f258-4cb8-852b-7f104871b2ee could not be found. Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Request method failure captured: Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee HTTP/1.1 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnuerT_414Qzm_pKA3tZd0Ym-hPBYvNWzgaZYyEZolSIqspaNBfBDfLuKERjW8YH_ZxpE2NGUJ6oeoi95KxKJbGcTlA6EiA7XdMEM28ISyPLs82c4h5bhueK0RqB_n9jGhkrHv4InAAUa12cECS7fxJPLEeRUJm5Xl2LnhuWHtv8kY8 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 4815f681044041f28862117b8e27caa9 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-418064095 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4815f681044041f28862117b8e27caa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/4815f681044041f28862117b8e27caa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_4815f681044041f28862117b8e27caa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/4815f681044041f28862117b8e27caa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersAdminNegativeTestJSON-418064095 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 4815f681044041f28862117b8e27caa9 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-418064095 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersAdminNegativeTestJSON-418064095-project Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 0e9397c3edae46a8a26a8797d2f55534 Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersAdminNegativeTestJSON-418064095-project Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e0773cb5-f258-4cb8-852b-7f104871b2ee could not be found. Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e0773cb5-f258-4cb8-852b-7f104871b2ee'} Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0773cb5-f258-4cb8-852b-7f104871b2ee could not be found. Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0773cb5-f258-4cb8-852b-7f104871b2ee could not be found. Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:16.126312 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0773cb5-f258-4cb8-852b-7f104871b2ee could not be found. Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] Returning 404 to user: Instance e0773cb5-f258-4cb8-852b-7f104871b2ee could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1e826fa9-b2e2-4c87-9ef0-83c916104e02 tempest-ServersAdminNegativeTestJSON-418064095 tempest-ServersAdminNegativeTestJSON-418064095-project] 10.222.0.113 "GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee" status: 404 len: 111 microversion: 2.1 time: 0.039212 Nov 02 14:16:16.131142 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3957/7547] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:16 2022] GET /compute/v2.1/servers/e0773cb5-f258-4cb8-852b-7f104871b2ee => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:16:23.028280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:23.030119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:23.175532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-647136511", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "531db1f3-21da-49e2-8e5b-b862e164dc06"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:23.254653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] validate_networks() for [('531db1f3-21da-49e2-8e5b-b862e164dc06', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:16:23.678090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:16:23.678522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:16:23.679009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:16:23.679474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:16:23.679906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:16:23.693859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:23.694370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:23.694853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:23.695665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:23.696136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:23.696577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:23.714363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Getting quotas for project fa1c2bb6cf894036aae1432cca8e4c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:16:23.720151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Getting quotas for user 877cc0a6e4464d65b3aed98f96eb43e0 and project fa1c2bb6cf894036aae1432cca8e4c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:16:23.733588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:16:23.736225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:16:23.784920 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a238ecc-69d6-4331-86c7-1a7592d190e7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.763099 Nov 02 14:16:23.785871 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3591/7548] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:16:23 2022] POST /compute/v2.1/servers => generated 382 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:16:23.797947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a47497a7-5e4b-46e8-b7f9-7abdd886866f tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:23.799170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a47497a7-5e4b-46e8-b7f9-7abdd886866f tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:23.803428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:23.804764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:23.869239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a47497a7-5e4b-46e8-b7f9-7abdd886866f tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:23.877909 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a47497a7-5e4b-46e8-b7f9-7abdd886866f tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1218 microversion: 2.1 time: 0.083941 Nov 02 14:16:23.878503 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3958/7549] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:23 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:24.901780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:24.902411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:24.912799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:24.913305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:24.914008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:24.914902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:24.915397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:24.916095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:25.008309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:25.019690 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5999cf50-3c7e-44d1-9d95-ed605df67734 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1278 microversion: 2.1 time: 0.122704 Nov 02 14:16:25.021030 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3592/7550] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:24 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1278 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:26.042702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:26.043355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:26.052054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:26.052905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:26.053807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:26.054827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:26.055391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:26.056099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:26.271307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:26.280385 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e53d4e26-e1fb-49c5-83c1-8e08892652ae tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1318 microversion: 2.1 time: 0.241602 Nov 02 14:16:26.281321 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3959/7551] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:26 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:26.547973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b9d65f56-996b-4924-955c-8504cac0fec4 req-3da40532-d508-423d-b3cb-3f3b738ecc76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079351e7-8fb9-4ae4-8a4e-6da55b3a9097", "tag": "ffd92236-4700-450c-93b0-927242e66d7f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:26.570697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9d65f56-996b-4924-955c-8504cac0fec4 req-3da40532-d508-423d-b3cb-3f3b738ecc76 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:26.571251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9d65f56-996b-4924-955c-8504cac0fec4 req-3da40532-d508-423d-b3cb-3f3b738ecc76 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:26.571703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b9d65f56-996b-4924-955c-8504cac0fec4 req-3da40532-d508-423d-b3cb-3f3b738ecc76 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:26.596756 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b9d65f56-996b-4924-955c-8504cac0fec4 req-3da40532-d508-423d-b3cb-3f3b738ecc76 service nova] Creating event network-changed:ffd92236-4700-450c-93b0-927242e66d7f for instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 on n-h2-858384-19 Nov 02 14:16:26.604015 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b9d65f56-996b-4924-955c-8504cac0fec4 req-3da40532-d508-423d-b3cb-3f3b738ecc76 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061775 Nov 02 14:16:26.605030 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3593/7552] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:27.312872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:27.313661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:27.320730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:27.321218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:27.322279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:27.323598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:27.324540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:27.324981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:27.456367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:27.465215 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e342bd0-ec89-4b41-a3cf-3e5e69236dc9 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1318 microversion: 2.1 time: 0.157935 Nov 02 14:16:27.465814 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3960/7553] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:27 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:28.489675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:28.490304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:28.496559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:28.497053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:28.497501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:28.498209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:28.498682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:28.499353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:28.661339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:28.669898 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5ac42ab9-4589-47dc-b3ba-99083be4fd76 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1318 microversion: 2.1 time: 0.185725 Nov 02 14:16:28.670487 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3594/7554] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:28 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:29.696925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:29.698121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:29.709911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:29.710704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:29.711537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:29.712777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:29.713453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:29.713987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:29.850432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:29.858645 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-abc8aa8d-d584-4eb4-8c69-be1389794785 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1318 microversion: 2.1 time: 0.169134 Nov 02 14:16:29.859522 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3961/7555] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:29 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:30.881985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:30.882512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:30.886001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:30.891383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:30.891885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:30.892340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:30.893055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:30.893522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:30.893962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:30.898704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:31.032562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:31.040290 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c661d42-7de8-48c5-b4fa-e87e852d10ce tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1318 microversion: 2.1 time: 0.162443 Nov 02 14:16:31.040873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3595/7556] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:30 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:32.063909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:32.064563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:32.067169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:32.073055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:32.073688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:32.074136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:32.074834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:32.075319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:32.075750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:32.078826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=72 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:32.208052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:32.217562 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7da33dc9-ac79-4fd5-bf6d-78f866b4e88c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1318 microversion: 2.1 time: 0.157266 Nov 02 14:16:32.218426 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3962/7557] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:32 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:33.130919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-8677ef6a-fe30-43d0-a325-3849270c491a req-4d74b888-2cd2-448b-931a-4d95f5d8f1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079351e7-8fb9-4ae4-8a4e-6da55b3a9097", "name": "network-vif-plugged", "status": "completed", "tag": "ffd92236-4700-450c-93b0-927242e66d7f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:33.143317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8677ef6a-fe30-43d0-a325-3849270c491a req-4d74b888-2cd2-448b-931a-4d95f5d8f1ea service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:33.144150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8677ef6a-fe30-43d0-a325-3849270c491a req-4d74b888-2cd2-448b-931a-4d95f5d8f1ea service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:33.144611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-8677ef6a-fe30-43d0-a325-3849270c491a req-4d74b888-2cd2-448b-931a-4d95f5d8f1ea service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:33.156766 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-8677ef6a-fe30-43d0-a325-3849270c491a req-4d74b888-2cd2-448b-931a-4d95f5d8f1ea service nova] Creating event network-vif-plugged:ffd92236-4700-450c-93b0-927242e66d7f for instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 on n-h2-858384-19 Nov 02 14:16:33.161987 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-8677ef6a-fe30-43d0-a325-3849270c491a req-4d74b888-2cd2-448b-931a-4d95f5d8f1ea service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035110 Nov 02 14:16:33.162872 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3596/7558] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:16:33.241974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:33.242638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:33.250301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:33.251486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:33.251486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:33.252186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:33.252644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:33.253264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:33.413166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:33.421095 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8f93a3ee-21d4-49f5-bbad-907f74d26eb7 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1318 microversion: 2.1 time: 0.183102 Nov 02 14:16:33.421714 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3963/7559] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:33 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:34.445292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:34.446022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:34.448092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:34.448871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:34.456550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:34.457050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:34.457506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:34.458222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:34.458689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:34.459154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:34.608140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:34.617616 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2c00ea56-93a6-4d0f-92ec-f45ed522f7be tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1318 microversion: 2.1 time: 0.176590 Nov 02 14:16:34.618252 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3597/7560] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:34 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:35.643088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:35.643730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:35.645673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:16:35.651761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:35.652857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:35.653303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:35.654003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:35.654464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:35.654896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:35.794336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:35.803262 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cfe40902-ca98-4125-96ac-3c8c1c01f24b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1505 microversion: 2.1 time: 0.163999 Nov 02 14:16:35.803790 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3964/7561] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:35 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:35.825469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:16:35.827737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:35.834671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:35.835780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:35.836824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:35.836824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:35.837466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:35.837719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:35.869177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:35.875095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Old instance type m1.heat2, new instance type m1.heat {{(pid=120929) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:16:35.881652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:16:35.882090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:16:35.882612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:16:35.883034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:16:35.883495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:16:35.952394 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e5beb862-b0da-44d6-957f-1b7105f1bbfe tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "POST /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097/action" status: 202 len: 0 microversion: 2.1 time: 0.130972 Nov 02 14:16:35.953033 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3598/7562] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:16:35 2022] POST /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:16:35.963966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:35.967536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:35.977691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:35.978774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:35.979834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:35.981880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:35.982964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:35.984039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:36.143441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:36.151398 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1b45c1c8-f5c8-4e43-adb6-f6053c403339 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1514 microversion: 2.1 time: 0.194038 Nov 02 14:16:36.152116 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3965/7563] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:35 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:37.181062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:37.181906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:37.191543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:37.192394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:37.193162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:37.194177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:37.194991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:37.195766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:37.337566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:37.352994 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cee5a31d-bade-456f-9e68-fcf9d0704de1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1514 microversion: 2.1 time: 0.180299 Nov 02 14:16:37.353590 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3599/7564] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:37 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:38.376182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:38.376733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:38.384079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:38.384593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:38.385040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:38.385741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:38.386241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:38.386671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:38.526510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:38.536718 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5e8b77bb-fe89-4785-8574-78b3fe3df327 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1514 microversion: 2.1 time: 0.164482 Nov 02 14:16:38.537322 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3966/7565] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:38 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:39.561089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:39.561716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:39.568641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:39.569138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:39.569589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:39.570301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:39.570759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:39.571227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:39.706217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:39.714751 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ac853d20-0ba8-4b04-b66e-9891e0922bec tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.157377 Nov 02 14:16:39.715378 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3600/7566] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:39 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:40.742646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:40.743709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:40.753572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:40.754066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:40.754514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:40.755267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:40.755775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:40.756218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:40.966121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:40.975252 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2c09daf8-e2b0-415f-b2ee-7d3e90bb97a5 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.238691 Nov 02 14:16:40.976029 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3967/7567] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:40 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:42.002737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:42.003572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:42.010513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:42.011020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:42.012180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:42.012915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:42.013397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:42.013849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:42.145939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:42.154024 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a9e36e7-5ca0-46e8-b1b7-d0d2be56414e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.157983 Nov 02 14:16:42.154615 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3601/7568] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:41 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:43.177777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:43.178389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:43.185470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:43.185950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:43.186382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:43.187080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:43.187560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:43.187988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:43.329223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:43.337178 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1830b055-3959-43b4-be6e-fd1b730e7c7c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.163410 Nov 02 14:16:43.337808 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3968/7569] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:43 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:16:44.361802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:44.362818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:44.370034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:44.370533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:44.371617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:44.372339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:44.372807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:44.373249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:44.513070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:44.521291 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c235e9d0-5950-4de6-8ba7-991fcca7e3d4 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.164043 Nov 02 14:16:44.522263 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3602/7570] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:44 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:45.551140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:45.551805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:45.559040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:45.559610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:45.559911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:45.560620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:45.561106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:45.561558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:45.696202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:45.704750 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-61792e00-863c-4dd5-9b8d-efacd6407562 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.157825 Nov 02 14:16:45.705346 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3969/7571] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:45 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:46.729401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:46.730605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:46.738849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:46.739451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:46.740010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:46.740764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:46.741298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:46.741796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:46.883414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:46.891471 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b6ebaa71-4638-413d-867f-75604183693a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.166497 Nov 02 14:16:46.891989 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3603/7572] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:46 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:47.917920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:47.919130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:47.926102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:47.926580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:47.927016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:47.927731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:47.928183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:47.928606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:48.066552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:48.074508 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b99bb25f-b887-4cba-a27f-6d5b49438ee8 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.160641 Nov 02 14:16:48.075735 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3970/7573] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:47 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:49.098678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:49.099343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:49.106712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:49.107247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:49.107700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:49.108449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:49.109183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:49.109626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:49.252525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:49.260493 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-61036f0a-ed08-477c-8688-dc0ab43fa2ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.165736 Nov 02 14:16:49.261076 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3604/7574] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:49 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:50.285317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:50.285999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:50.293171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:50.293764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:50.294712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:50.295479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:50.295936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:50.296364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:50.444211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:50.454689 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2bf9ae63-dcdd-4c6e-9d19-af1d53b42e7b tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.173379 Nov 02 14:16:50.455522 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3971/7575] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:50 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:51.480251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:51.480881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:51.488682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:51.489207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:51.489648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:51.490361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:51.490838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:51.491318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:51.631282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:51.639547 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-afcc8f48-bd57-4675-aaa0-64c8d1f89a4c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.163208 Nov 02 14:16:51.640161 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3605/7576] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:51 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:52.663384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:52.664010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:52.671518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:52.672001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:52.672441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:52.673142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:52.673607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:52.674056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:52.817279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:52.825872 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4ac96d67-749b-4038-973c-e04f85b027e6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.166446 Nov 02 14:16:52.826666 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3972/7577] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:52 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:53.849475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:53.850150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:53.859643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:53.860174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:53.860659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:53.861387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:53.861880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:53.862322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:54.001907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:54.009756 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ab012beb-d698-403b-9eac-dcafc461a1ea tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.164247 Nov 02 14:16:54.010336 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3606/7578] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:53 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:55.033950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:55.034560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:55.042133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:55.042638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:55.043073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:55.043815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:55.044266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:55.045237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:55.181986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:55.190698 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a016af0-fe1e-4920-a5eb-c455b37b5d7a tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.161157 Nov 02 14:16:55.191233 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3973/7579] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:55 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:56.214436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:56.215066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:56.222276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:56.222946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:56.223424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:56.224140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:56.224609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:56.225052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:56.368153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:56.376544 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f2b902e-2d04-468b-a08f-a29cd8db2ae0 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.166053 Nov 02 14:16:56.377140 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3607/7580] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:56 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:57.403570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:57.405144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:57.412641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:57.413225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:57.413727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:57.414501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:57.415020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:57.415666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:57.575405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:57.584935 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6af929d6-a23a-4fda-8cb4-050c8c411abb tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.185279 Nov 02 14:16:57.586170 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3974/7581] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:57 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:58.610048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:58.610672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:58.617902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:58.618408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:58.618858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:58.619606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:58.620105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:58.620547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:58.756072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:58.764323 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-53cb5e55-f501-4cf7-a79d-d3bddba74ba6 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.158987 Nov 02 14:16:58.764903 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3608/7582] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:58 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:16:59.789418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:16:59.790126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:16:59.798151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:59.798641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:59.799092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:59.799973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:16:59.800435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:16:59.800867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:16:59.936715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:16:59.944505 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c986dc0-6b15-405a-a8d8-4798206ea709 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.159521 Nov 02 14:16:59.945089 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3975/7583] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:16:59 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:00.966859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:00.967528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:00.970206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=32 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:00.975483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:00.975987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:00.976443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:00.977166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:00.977638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:00.978079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:00.981226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:01.120364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:01.128901 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-02a1af3b-9ff0-405f-a2ef-352ace3d795e tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.166011 Nov 02 14:17:01.129489 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3609/7584] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:00 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:02.152915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:02.153646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:02.156498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=28 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:02.162351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:02.162842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:02.163317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:02.164023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:02.164479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:02.164910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:02.167833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=84 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:02.304318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:02.312849 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ffdff173-bd9b-448a-b418-2407a0aeb948 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.163882 Nov 02 14:17:02.313438 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3976/7585] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:02 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:03.336791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:03.337429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:03.345496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:03.346028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:03.346492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:03.347244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:03.347724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:03.348277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:03.485138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:03.492968 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5653e63b-441a-4254-b52f-9b312699a969 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.160196 Nov 02 14:17:03.493566 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3610/7586] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:03 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:04.516945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:04.517564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:04.524529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:04.525023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:04.525469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:04.526170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:04.526627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:04.527059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:04.668251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:04.676972 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a7bee37e-41c9-4fc8-88f9-7d548523dbe2 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1519 microversion: 2.1 time: 0.164453 Nov 02 14:17:04.677554 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3977/7587] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:04 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:05.699578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:05.700366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:05.708128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:05.708625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:05.709078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:05.709795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:05.710481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:05.710924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:05.921049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3d8a083b-2167-414a-9e4a-1a6fbb90c0dc req-4df61806-46a3-4715-907a-82d93725e8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079351e7-8fb9-4ae4-8a4e-6da55b3a9097", "name": "network-vif-unplugged", "status": "completed", "tag": "ffd92236-4700-450c-93b0-927242e66d7f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:05.921568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:05.929358 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f556dc44-4a5c-44a9-b739-7c11915352db tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1518 microversion: 2.1 time: 0.233709 Nov 02 14:17:05.930429 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3611/7588] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:05 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:05.931620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3d8a083b-2167-414a-9e4a-1a6fbb90c0dc req-4df61806-46a3-4715-907a-82d93725e8bd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:05.932241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3d8a083b-2167-414a-9e4a-1a6fbb90c0dc req-4df61806-46a3-4715-907a-82d93725e8bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:05.932730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3d8a083b-2167-414a-9e4a-1a6fbb90c0dc req-4df61806-46a3-4715-907a-82d93725e8bd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:05.946609 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3d8a083b-2167-414a-9e4a-1a6fbb90c0dc req-4df61806-46a3-4715-907a-82d93725e8bd service nova] Creating event network-vif-unplugged:ffd92236-4700-450c-93b0-927242e66d7f for instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 on n-h1-858384-19 Nov 02 14:17:05.953168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-3d8a083b-2167-414a-9e4a-1a6fbb90c0dc req-4df61806-46a3-4715-907a-82d93725e8bd service nova] Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:17:05.964308 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3d8a083b-2167-414a-9e4a-1a6fbb90c0dc req-4df61806-46a3-4715-907a-82d93725e8bd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048609 Nov 02 14:17:05.964926 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3978/7589] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:17:06.953992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:06.954614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:06.961619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.962108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.962584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:06.963349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:06.963811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:06.964247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:07.102627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:07.111284 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-42d0c4ab-59f7-4159-a5fd-2a847e5a9724 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1516 microversion: 2.1 time: 0.161320 Nov 02 14:17:07.111865 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3612/7590] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:06 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:07.982575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-04b198ff-3cdb-4774-831c-2c8c97b6676b req-b9fbab96-0f9f-485a-8dc7-96bbda34a3fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079351e7-8fb9-4ae4-8a4e-6da55b3a9097", "tag": "ffd92236-4700-450c-93b0-927242e66d7f"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:07.993457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-04b198ff-3cdb-4774-831c-2c8c97b6676b req-b9fbab96-0f9f-485a-8dc7-96bbda34a3fa service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:07.994195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-04b198ff-3cdb-4774-831c-2c8c97b6676b req-b9fbab96-0f9f-485a-8dc7-96bbda34a3fa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:07.994658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-04b198ff-3cdb-4774-831c-2c8c97b6676b req-b9fbab96-0f9f-485a-8dc7-96bbda34a3fa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:08.008108 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-04b198ff-3cdb-4774-831c-2c8c97b6676b req-b9fbab96-0f9f-485a-8dc7-96bbda34a3fa service nova] Creating event network-changed:ffd92236-4700-450c-93b0-927242e66d7f for instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 on n-h1-858384-19 Nov 02 14:17:08.013776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-04b198ff-3cdb-4774-831c-2c8c97b6676b req-b9fbab96-0f9f-485a-8dc7-96bbda34a3fa service nova] Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:17:08.025627 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-04b198ff-3cdb-4774-831c-2c8c97b6676b req-b9fbab96-0f9f-485a-8dc7-96bbda34a3fa service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048141 Nov 02 14:17:08.026245 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3979/7591] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:08.138175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:08.139877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:08.149112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:08.149621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:08.150087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:08.151028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:08.151737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:08.152191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:08.306095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:08.316975 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-71b72b5f-06db-46e3-9a8a-9b5822716a14 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1516 microversion: 2.1 time: 0.184518 Nov 02 14:17:08.318024 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3613/7592] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:08 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:09.348473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:09.349191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:09.355747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:09.356269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:09.356718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:09.357421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:09.357892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:09.358340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:09.495474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:09.504294 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-26d14967-ae82-488b-8fac-44b6582b1046 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1516 microversion: 2.1 time: 0.161112 Nov 02 14:17:09.504912 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3980/7593] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:09 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:10.528203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:10.528863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:10.536232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.536826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.537312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.538034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.538495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.539039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.681438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:10.692052 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de0f213d-925e-441e-a071-9278afad61ac tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1513 microversion: 2.1 time: 0.167953 Nov 02 14:17:10.692749 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3614/7594] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:10 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:10.715244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:10.715811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:10.723074 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.723567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.724017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.724723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:10.725178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:10.725606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:10.754135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:17:10.804971 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.compute.api [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Found an unconfirmed migration during delete, id: 16, status: finished Nov 02 14:17:12.420189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-eb8f0c88-9791-4f7d-aff8-ee2f22109c4a req-16d8dad4-9d09-4812-b847-b9295ec191c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079351e7-8fb9-4ae4-8a4e-6da55b3a9097", "name": "network-vif-plugged", "status": "completed", "tag": "ffd92236-4700-450c-93b0-927242e66d7f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:12.432647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eb8f0c88-9791-4f7d-aff8-ee2f22109c4a req-16d8dad4-9d09-4812-b847-b9295ec191c0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:12.433141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eb8f0c88-9791-4f7d-aff8-ee2f22109c4a req-16d8dad4-9d09-4812-b847-b9295ec191c0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:12.433590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eb8f0c88-9791-4f7d-aff8-ee2f22109c4a req-16d8dad4-9d09-4812-b847-b9295ec191c0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:12.447100 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-eb8f0c88-9791-4f7d-aff8-ee2f22109c4a req-16d8dad4-9d09-4812-b847-b9295ec191c0 service nova] Creating event network-vif-plugged:ffd92236-4700-450c-93b0-927242e66d7f for instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 on n-h1-858384-19 Nov 02 14:17:12.453660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-eb8f0c88-9791-4f7d-aff8-ee2f22109c4a req-16d8dad4-9d09-4812-b847-b9295ec191c0 service nova] Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:17:12.468863 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-eb8f0c88-9791-4f7d-aff8-ee2f22109c4a req-16d8dad4-9d09-4812-b847-b9295ec191c0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052272 Nov 02 14:17:12.469497 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3615/7595] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:17:12.798466 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-badd6a57-041c-4b7e-9889-02e003d50037 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "DELETE /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 204 len: 0 microversion: 2.1 time: 2.086970 Nov 02 14:17:12.799332 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3981/7596] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:17:10 2022] DELETE /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 0 bytes in 2089 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:17:12.808821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:12.809544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:12.816480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:12.816989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:12.817476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:12.818463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:12.818941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:12.819422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:12.950073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:12.958161 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ceab026-3de9-4ff6-9a93-93a5ff4d4d70 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1505 microversion: 2.1 time: 0.153642 Nov 02 14:17:12.958745 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3616/7597] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:12 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:17:13.982291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:13.983797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:13.990847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:13.991373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:13.991823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:13.992529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:13.992985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:13.993422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:14.131223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '877cc0a6e4464d65b3aed98f96eb43e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1c2bb6cf894036aae1432cca8e4c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:14.138955 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-565a19f5-a02b-462b-a1e5-4812225e71a1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 200 len: 1505 microversion: 2.1 time: 0.161027 Nov 02 14:17:14.139741 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3982/7598] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:13 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:14.899055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5b7e5830-f9bf-428b-8a33-5c85cc73b0e6 req-ab661b63-990c-484d-b709-aa4a172ec465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079351e7-8fb9-4ae4-8a4e-6da55b3a9097", "name": "network-vif-deleted", "tag": "ffd92236-4700-450c-93b0-927242e66d7f"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:14.910999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5b7e5830-f9bf-428b-8a33-5c85cc73b0e6 req-ab661b63-990c-484d-b709-aa4a172ec465 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:14.911530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5b7e5830-f9bf-428b-8a33-5c85cc73b0e6 req-ab661b63-990c-484d-b709-aa4a172ec465 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:14.911972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5b7e5830-f9bf-428b-8a33-5c85cc73b0e6 req-ab661b63-990c-484d-b709-aa4a172ec465 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:14.928281 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5b7e5830-f9bf-428b-8a33-5c85cc73b0e6 req-ab661b63-990c-484d-b709-aa4a172ec465 service nova] Creating event network-vif-deleted:ffd92236-4700-450c-93b0-927242e66d7f for instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 on n-h1-858384-19 Nov 02 14:17:14.934073 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5b7e5830-f9bf-428b-8a33-5c85cc73b0e6 req-ab661b63-990c-484d-b709-aa4a172ec465 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038656 Nov 02 14:17:14.934944 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3617/7599] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:15.162646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:15.163281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:15.170081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.171638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.171780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.172427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.172879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.173303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.190060 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] HTTP exception thrown: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Request method failure captured: Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 HTTP/1.1 Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnu27hciIBAW445mdBccfA8Bb5kCZBhf_zmYy9ISOxYsHsD4a6AC9snTiJbmgsfkYhEbFX-cHnoAemJxH3Ifp_eFPuKKSs6_ZX7LOSyIsuPcv1GwTTPSyO1ipNeZZtVL7m7c4VonT0ZcBQB0l8gprUAn8elzNw6zxAnhgsPnwI06h4k Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: fa1c2bb6cf894036aae1432cca8e4c6f Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-1555457535 Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-1555457535 Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: fa1c2bb6cf894036aae1432cca8e4c6f Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-1555457535 Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-1555457535-project Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 877cc0a6e4464d65b3aed98f96eb43e0 Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-1555457535-project Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '079351e7-8fb9-4ae4-8a4e-6da55b3a9097'} Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:15.191789 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Returning 404 to user: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69e8389d-6b39-42bc-b81a-8bf690040271 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 404 len: 111 microversion: 2.1 time: 0.034863 Nov 02 14:17:15.196367 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3983/7600] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:15 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:17:15.210292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:15.210883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:15.216987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.218026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.218566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.219294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.219758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.220193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.234723 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] HTTP exception thrown: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Request method failure captured: Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 HTTP/1.1 Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnu27hciIBAW445mdBccfA8Bb5kCZBhf_zmYy9ISOxYsHsD4a6AC9snTiJbmgsfkYhEbFX-cHnoAemJxH3Ifp_eFPuKKSs6_ZX7LOSyIsuPcv1GwTTPSyO1ipNeZZtVL7m7c4VonT0ZcBQB0l8gprUAn8elzNw6zxAnhgsPnwI06h4k Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: fa1c2bb6cf894036aae1432cca8e4c6f Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-DeleteServersTestJSON-1555457535 Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-DeleteServersTestJSON-1555457535 Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: fa1c2bb6cf894036aae1432cca8e4c6f Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-DeleteServersTestJSON-1555457535 Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-DeleteServersTestJSON-1555457535-project Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 877cc0a6e4464d65b3aed98f96eb43e0 Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-DeleteServersTestJSON-1555457535-project Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '079351e7-8fb9-4ae4-8a4e-6da55b3a9097'} Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:17:15.236406 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Returning 404 to user: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fd9c5cae-4b19-4119-9191-20d6685e00d1 tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "DELETE /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 404 len: 111 microversion: 2.1 time: 0.031964 Nov 02 14:17:15.240876 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3618/7601] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:17:15 2022] DELETE /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:17:15.246713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:15.247388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] [instance: 079351e7-8fb9-4ae4-8a4e-6da55b3a9097] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:15.253808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.254290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.254726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.255448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:15.255905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:15.256332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:15.269878 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] HTTP exception thrown: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Request method failure captured: Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 HTTP/1.1 Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnu27hciIBAW445mdBccfA8Bb5kCZBhf_zmYy9ISOxYsHsD4a6AC9snTiJbmgsfkYhEbFX-cHnoAemJxH3Ifp_eFPuKKSs6_ZX7LOSyIsuPcv1GwTTPSyO1ipNeZZtVL7m7c4VonT0ZcBQB0l8gprUAn8elzNw6zxAnhgsPnwI06h4k Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: fa1c2bb6cf894036aae1432cca8e4c6f Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-DeleteServersTestJSON-1555457535 Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/fa1c2bb6cf894036aae1432cca8e4c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-DeleteServersTestJSON-1555457535 Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: fa1c2bb6cf894036aae1432cca8e4c6f Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-DeleteServersTestJSON-1555457535 Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-DeleteServersTestJSON-1555457535-project Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 877cc0a6e4464d65b3aed98f96eb43e0 Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-DeleteServersTestJSON-1555457535-project Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '079351e7-8fb9-4ae4-8a4e-6da55b3a9097'} Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:17:15.271441 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] Returning 404 to user: Instance 079351e7-8fb9-4ae4-8a4e-6da55b3a9097 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3c6da021-0f5c-4f93-a28f-1326a6e99d6c tempest-DeleteServersTestJSON-1555457535 tempest-DeleteServersTestJSON-1555457535-project] 10.222.0.113 "GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097" status: 404 len: 111 microversion: 2.1 time: 0.030018 Nov 02 14:17:15.278550 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3984/7602] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:15 2022] GET /compute/v2.1/servers/079351e7-8fb9-4ae4-8a4e-6da55b3a9097 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:17:24.365901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1320109162", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "bd9f5daf-8c75-4829-bb90-eb51703b1302"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:24.423191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] validate_networks() for [('bd9f5daf-8c75-4829-bb90-eb51703b1302', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:17:24.800008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:17:24.800452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:17:24.800976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:17:24.801401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:17:24.801854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:17:24.810891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:24.811414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:24.811866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:24.812610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:24.813824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:24.814032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:24.831753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Getting quotas for project cfaa84cd1f1b4115aaa3567b4045f995. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:17:24.837213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Getting quotas for user 54de0593409e44e8bff464a8490c9484 and project cfaa84cd1f1b4115aaa3567b4045f995. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:17:24.850206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:17:24.852587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:17:24.901908 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c3ed129a-df33-4d29-a8cb-c85172189907 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.664487 Nov 02 14:17:24.909431 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3619/7603] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:17:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:17:24.916311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-08d895c6-0414-4a2f-9fe8-0760c4aaf251 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:24.917065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-08d895c6-0414-4a2f-9fe8-0760c4aaf251 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:24.997544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-08d895c6-0414-4a2f-9fe8-0760c4aaf251 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:25.005930 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-08d895c6-0414-4a2f-9fe8-0760c4aaf251 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1222 microversion: 2.1 time: 0.095211 Nov 02 14:17:25.007896 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3985/7604] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:24 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:26.033130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:26.034386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:26.041810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.042844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.042844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.043515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:26.043986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:26.044428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:26.122899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:26.131359 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5ec34f87-c9b5-40ee-a939-dfb5fd186390 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1292 microversion: 2.1 time: 0.103983 Nov 02 14:17:26.132274 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3620/7605] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:26 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:27.157964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:27.158684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:27.171084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:27.178069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:27.184335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:27.184936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:27.185808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:27.186401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:27.186954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:27.411824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:27.428698 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-854c6b75-522a-492d-bebc-05de76a3e9ea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1322 microversion: 2.1 time: 0.275036 Nov 02 14:17:27.429779 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3986/7606] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:27 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:27.585484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-fadfa929-d4dd-48a9-a646-920630bb793c req-05180038-afdc-4ba0-84f4-f72407a7816f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758749ad-42e5-4e5b-b186-b5e6eccad2d4", "tag": "939a0522-68e9-4929-95bf-e4423e1d68c7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:27.604120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fadfa929-d4dd-48a9-a646-920630bb793c req-05180038-afdc-4ba0-84f4-f72407a7816f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:27.604927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fadfa929-d4dd-48a9-a646-920630bb793c req-05180038-afdc-4ba0-84f4-f72407a7816f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:27.605412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-fadfa929-d4dd-48a9-a646-920630bb793c req-05180038-afdc-4ba0-84f4-f72407a7816f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:27.632051 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-fadfa929-d4dd-48a9-a646-920630bb793c req-05180038-afdc-4ba0-84f4-f72407a7816f service nova] Creating event network-changed:939a0522-68e9-4929-95bf-e4423e1d68c7 for instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 on n-h2-858384-19 Nov 02 14:17:27.637825 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-fadfa929-d4dd-48a9-a646-920630bb793c req-05180038-afdc-4ba0-84f4-f72407a7816f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056412 Nov 02 14:17:27.638933 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3621/7607] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:17:28.452865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:28.453462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:28.460442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:28.460926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:28.461366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:28.462060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:28.462514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:28.462949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:28.599694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:28.607445 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ec94d366-9138-42b0-9a88-c43bcbf8be78 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1322 microversion: 2.1 time: 0.158615 Nov 02 14:17:28.608020 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3987/7608] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:28 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:29.633217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:29.634008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:29.640227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:29.641374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:29.642604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:29.643177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:29.643681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:29.644163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:29.778268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:29.786836 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6c359b26-d9e9-408f-a9af-cdf0601e3834 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1322 microversion: 2.1 time: 0.158702 Nov 02 14:17:29.787398 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3622/7609] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:29 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:30.810377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:30.811002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:30.818370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:30.818855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:30.819328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:30.820028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:30.820483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:30.820913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:30.951628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:30.960433 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-691faa01-ada1-4fb2-9bc4-fa5585eae6c6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1322 microversion: 2.1 time: 0.154001 Nov 02 14:17:30.960992 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3988/7610] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:30 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:31.983831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:31.984421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:31.987244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:31.993576 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:31.994061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:31.994514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:31.995267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:31.995738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:31.996179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:31.999421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=66 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:32.131057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:32.138750 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cd0e0a5b-ef87-4b96-984a-6723c9b86472 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1322 microversion: 2.1 time: 0.159310 Nov 02 14:17:32.139384 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3623/7611] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:31 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:33.162559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:33.163335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:33.165871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:33.171061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:33.171586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:33.172638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:33.173346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:33.173871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:33.174308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:33.300709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-54df7fa5-aaef-4b5d-905c-c03ff58b5c7c req-9ef8625a-f746-47b6-982c-6fe235aa7312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758749ad-42e5-4e5b-b186-b5e6eccad2d4", "name": "network-vif-plugged", "status": "completed", "tag": "939a0522-68e9-4929-95bf-e4423e1d68c7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:33.313906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-54df7fa5-aaef-4b5d-905c-c03ff58b5c7c req-9ef8625a-f746-47b6-982c-6fe235aa7312 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:33.313906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-54df7fa5-aaef-4b5d-905c-c03ff58b5c7c req-9ef8625a-f746-47b6-982c-6fe235aa7312 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:33.313906 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-54df7fa5-aaef-4b5d-905c-c03ff58b5c7c req-9ef8625a-f746-47b6-982c-6fe235aa7312 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:33.318617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:33.327294 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05273a2a-9efb-4fbd-993e-c6e0168dea30 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1322 microversion: 2.1 time: 0.168643 Nov 02 14:17:33.328935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3989/7612] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:33 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:33.332236 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-54df7fa5-aaef-4b5d-905c-c03ff58b5c7c req-9ef8625a-f746-47b6-982c-6fe235aa7312 service nova] Creating event network-vif-plugged:939a0522-68e9-4929-95bf-e4423e1d68c7 for instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 on n-h2-858384-19 Nov 02 14:17:33.337486 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-54df7fa5-aaef-4b5d-905c-c03ff58b5c7c req-9ef8625a-f746-47b6-982c-6fe235aa7312 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041906 Nov 02 14:17:33.338517 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3624/7613] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:17:34.352949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:34.353562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:34.360770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:34.361253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:34.361691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:34.362390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:34.362845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:34.363320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:34.496382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:34.504155 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ec373afc-dc50-49f7-ab4b-21b0d840492c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1322 microversion: 2.1 time: 0.155114 Nov 02 14:17:34.504738 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3990/7614] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:34 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:35.525157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:35.525995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:35.530668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:35.531953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:35.539321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:35.539825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:35.540285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:35.541004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:35.541494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:35.541920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:35.679176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:35.687007 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2fab056a-7e3a-428f-9ac2-ed4939a52cf3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1512 microversion: 2.1 time: 0.163719 Nov 02 14:17:35.687625 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3625/7615] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:35 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:35.709964 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:35.710584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:35.712673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:35.719313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:35.720238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:35.720685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:35.721393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:35.721850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:35.722277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:35.855195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:35.865532 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-529b210e-eb0c-4cd3-99f4-6aa18b2740ff tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1512 microversion: 2.1 time: 0.159484 Nov 02 14:17:35.866133 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3991/7616] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:35 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:35.888200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-afa0abf2-2e4b-4890-a2ab-2c3dab4a6b6a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:35.890477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-afa0abf2-2e4b-4890-a2ab-2c3dab4a6b6a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:35.896432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afa0abf2-2e4b-4890-a2ab-2c3dab4a6b6a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:35.896918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afa0abf2-2e4b-4890-a2ab-2c3dab4a6b6a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:35.897364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afa0abf2-2e4b-4890-a2ab-2c3dab4a6b6a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:35.898061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afa0abf2-2e4b-4890-a2ab-2c3dab4a6b6a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:35.898523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afa0abf2-2e4b-4890-a2ab-2c3dab4a6b6a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:35.898958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-afa0abf2-2e4b-4890-a2ab-2c3dab4a6b6a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:35.962549 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-afa0abf2-2e4b-4890-a2ab-2c3dab4a6b6a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "PUT /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1084 microversion: 2.1 time: 0.078212 Nov 02 14:17:35.963211 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3626/7617] 10.222.0.113 () {60 vars in 1261 bytes} [Wed Nov 2 14:17:35 2022] PUT /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1084 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:35.981565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:35.982179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:35.989094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:35.989578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:35.990019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:35.990719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:35.991203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:35.991638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:36.121427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:36.129665 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c3fa010f-fce9-4bd4-98a9-6ea94f97c803 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1510 microversion: 2.1 time: 0.152001 Nov 02 14:17:36.130249 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3992/7618] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:35 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:36.151407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:36.152006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:36.158518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:36.159036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:36.159512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:36.160219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:36.160687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:36.161126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:36.290503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:36.298942 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f63eda93-8252-4278-91ed-3dce7d4a45f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1510 microversion: 2.1 time: 0.151612 Nov 02 14:17:36.299551 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3627/7619] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:36 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:36.320889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:17:36.323285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:36.329607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:36.330096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:36.330545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:36.331283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:36.331746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:36.332186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:36.363531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:36.369489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Old instance type m1.heat2, new instance type m1.heat {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:17:36.376371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:17:36.376799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:17:36.377276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:17:36.377690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:17:36.378104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:17:36.443651 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-baec644c-3a8f-4e41-bff1-1dfbf393fd99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "POST /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4/action" status: 202 len: 0 microversion: 2.1 time: 0.126329 Nov 02 14:17:36.444406 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3993/7620] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:17:36 2022] POST /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:17:36.452459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:36.453095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:36.461498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:36.462008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:36.462473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:36.463223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:36.463745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:36.464235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:36.631248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:36.639772 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20f1ead2-9bea-4542-9414-a12ef4444f61 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1521 microversion: 2.1 time: 0.191218 Nov 02 14:17:36.640364 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3628/7621] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:36 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:37.664799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:37.665375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:37.672957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:37.673440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:37.673878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:37.674606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:37.675060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:37.675515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:37.852104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:37.862509 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-03abccf1-d8bf-41a5-8355-13880877be25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1521 microversion: 2.1 time: 0.202532 Nov 02 14:17:37.863134 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3994/7622] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:37 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:38.886954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:38.887555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:38.894858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:38.895395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:38.895854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:38.896567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:38.897037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:38.897481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:39.031776 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:39.039792 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee9a37e3-fd6f-4ca4-b5c4-1886861ca07b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.156871 Nov 02 14:17:39.040374 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3629/7623] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:38 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:40.064270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:40.064904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:40.071763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:40.072235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:40.072667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:40.073363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:40.073807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:40.074230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:40.204860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:40.212650 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ef90073e-e187-47e9-a4b8-37af6f12c637 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.152824 Nov 02 14:17:40.213237 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3995/7624] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:40 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:41.236110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:41.236734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:41.243324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:41.243817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:41.244261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:41.244961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:41.245424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:41.245861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:41.380702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:41.388444 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d187429a-894b-49b6-b1eb-51826f771131 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.156942 Nov 02 14:17:41.389016 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3630/7625] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:41 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:42.412563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:42.413175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:42.421297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:42.422369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:42.423001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:42.423820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:42.424281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:42.424710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:42.563251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:42.571150 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41460f4f-4314-4d09-87a8-aa2554a4d262 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.162514 Nov 02 14:17:42.571737 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3996/7626] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:42 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:43.594206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:43.594848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:43.601811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:43.602320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:43.602773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:43.603516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:43.603992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:43.604437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:43.752119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:43.759972 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1ff424bd-0f01-4ae1-8fb0-5a06c2f4c004 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.170202 Nov 02 14:17:43.760565 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3631/7627] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:43 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:44.785102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:44.785727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:44.791827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:44.792322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:44.792770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:44.793503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:44.793965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:44.794410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:44.931761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:44.939776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-469cb964-8430-4e62-886a-7a0d1523e423 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.159933 Nov 02 14:17:44.940360 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3997/7628] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:44 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:45.963827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:45.964383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:45.972451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:45.972951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:45.973407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:45.974117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:45.974686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:45.975158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:46.110736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:46.118794 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a3be8468-728f-43e6-9459-13cb73b2d363 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.158994 Nov 02 14:17:46.119437 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3632/7629] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:45 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:47.143299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:47.143908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:47.150860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:47.151399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:47.151834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:47.152522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:47.152969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:47.153399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:47.286625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:47.294995 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f853202f-bc5f-47b2-8e28-d7dbb6d35f5b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.155717 Nov 02 14:17:47.295605 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3998/7630] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:47 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:48.319094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:48.319748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:48.326366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:48.326868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:48.327358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:48.328892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:48.329441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:48.329896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:48.461013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:48.468823 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5df71cf3-2127-4639-9b70-b282683d58a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.153784 Nov 02 14:17:48.469402 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3633/7631] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:48 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:49.492943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:49.493563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:49.501752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:49.502241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:49.502690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:49.503434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:49.503898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:49.504334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:49.645123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:49.653233 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3b8776f-0249-4b8a-905e-8e31caeff7d3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.164348 Nov 02 14:17:49.653827 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 3999/7632] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:49 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:50.678195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:50.678859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:50.685780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:50.686280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:50.686736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:50.688025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:50.688504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:50.688955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:50.826256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:50.834969 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ec24799c-2f44-4c98-bae5-6bb6e18c9b56 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.160800 Nov 02 14:17:50.835580 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3634/7633] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:50 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:51.858217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:51.860613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:51.866588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:51.867073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:51.867546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:51.868244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:51.868701 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:51.869134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:51.998948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:52.007436 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-851a392d-9311-4ca2-88e5-f034f2bf8d81 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.153229 Nov 02 14:17:52.008011 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4000/7634] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:51 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:53.031884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:53.032521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:53.039435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:53.039940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:53.040397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:53.041112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:53.041583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:53.042025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:53.176098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:53.184196 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-03b8a08e-c959-4cc8-b171-40932da697e7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.156654 Nov 02 14:17:53.184785 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3635/7635] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:53 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:54.208616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:54.209228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:54.216109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:54.216585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:54.217019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:54.217710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:54.218159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:54.219203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:54.223227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:17:54.350962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:54.359748 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a8833e86-eb40-46e2-8aea-38ba7c9a6f1b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.154006 Nov 02 14:17:54.360467 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4001/7636] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:54 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:55.381880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:55.382513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:55.389343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:55.389841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:55.391404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:55.392131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:55.392606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:55.393051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:55.527074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:55.535081 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d6314f85-325f-466d-95e8-0089dcf6973c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.157111 Nov 02 14:17:55.535683 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3636/7637] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:55 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:56.558910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:56.559564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:56.567061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:56.567578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:56.568027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:56.568728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:56.569191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:56.569627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:56.705669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:56.713425 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ed6e399b-a2d8-46ef-b692-26fc3f5d2780 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.158535 Nov 02 14:17:56.714002 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4002/7638] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:56 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:57.737083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:57.737713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:57.744951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:57.745451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:57.745903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:57.746616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:57.747082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:57.747549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:57.884871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:57.892947 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f8cf2fcf-8922-4e6e-8a99-fc1db847f63b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.160073 Nov 02 14:17:57.893571 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3637/7639] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:57 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:17:58.916800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:17:58.917356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:17:58.925030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:58.925714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:58.926209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:58.926930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:17:58.927405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:17:58.927836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:17:59.060792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:17:59.069268 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1165289d-1eef-405e-aead-857c133133e5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.156541 Nov 02 14:17:59.069866 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4003/7640] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:17:58 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:00.093536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:00.094569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:00.101818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:00.102395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:00.102861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:00.103613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:00.104180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:00.104630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:00.246000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:00.254719 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7f5be7d3-f6b2-43c5-88ce-4b99459a09d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.165778 Nov 02 14:18:00.255349 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3638/7641] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:00 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:01.278204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:01.278825 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:01.286073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.286791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.287205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.287919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:01.288371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:01.288803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:01.431420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:01.439877 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e875acd1-f959-4e88-91eb-d4a3327e127c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.166031 Nov 02 14:18:01.440475 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4004/7642] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:01 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:02.463822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:02.464476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:02.467232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=32 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:02.474043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:02.474546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:02.475004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:02.475752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:02.476247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:02.476689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:02.479481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:02.625231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:02.633752 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-82a27bb6-88aa-4703-97a7-1fb468ab897f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.173882 Nov 02 14:18:02.634432 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3639/7643] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:02 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:03.658047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:03.658725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:03.661453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=36 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:03.667044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:03.667570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:03.668020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:03.668736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:03.669198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:03.669635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:03.803517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:03.811411 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a63a9efd-21b0-4e32-a175-0930b4a76362 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.157718 Nov 02 14:18:03.811972 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4005/7644] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:03 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:04.834831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:04.835429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:04.842294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:04.842794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:04.843950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:04.844646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:04.845121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:04.845571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:04.979886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:04.988705 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9cf9d4c5-fcfb-476f-8908-f8c2050bdb33 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1526 microversion: 2.1 time: 0.158022 Nov 02 14:18:04.989292 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3640/7645] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:04 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:05.711403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c8931fb2-727d-4015-9744-f1e854906a16 req-0b868002-2efb-4272-b46a-6cbf968bf09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758749ad-42e5-4e5b-b186-b5e6eccad2d4", "name": "network-vif-unplugged", "status": "completed", "tag": "939a0522-68e9-4929-95bf-e4423e1d68c7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:05.725793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c8931fb2-727d-4015-9744-f1e854906a16 req-0b868002-2efb-4272-b46a-6cbf968bf09c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:05.726415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c8931fb2-727d-4015-9744-f1e854906a16 req-0b868002-2efb-4272-b46a-6cbf968bf09c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:05.726802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c8931fb2-727d-4015-9744-f1e854906a16 req-0b868002-2efb-4272-b46a-6cbf968bf09c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:05.742089 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c8931fb2-727d-4015-9744-f1e854906a16 req-0b868002-2efb-4272-b46a-6cbf968bf09c service nova] Creating event network-vif-unplugged:939a0522-68e9-4929-95bf-e4423e1d68c7 for instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 on n-h1-858384-19 Nov 02 14:18:05.747668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-c8931fb2-727d-4015-9744-f1e854906a16 req-0b868002-2efb-4272-b46a-6cbf968bf09c service nova] Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:18:05.759878 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c8931fb2-727d-4015-9744-f1e854906a16 req-0b868002-2efb-4272-b46a-6cbf968bf09c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051953 Nov 02 14:18:05.760503 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4006/7646] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:06.011928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:06.013300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:06.021482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:06.022081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:06.022599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:06.023567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:06.024126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:06.024481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:06.234647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:06.242375 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cac999fa-f776-4dd7-84ac-b35ad9c1073b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1525 microversion: 2.1 time: 0.234352 Nov 02 14:18:06.242960 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3641/7647] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:06 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1525 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:07.267998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:07.268623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:07.275788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:07.276277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:07.276722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:07.277426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:07.277887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:07.278324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:07.416711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:07.424744 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3872709d-2036-487b-b678-03b9d40622fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1523 microversion: 2.1 time: 0.161657 Nov 02 14:18:07.425335 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4007/7648] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:07 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:07.780939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b29ef8b2-b6a8-432a-85d0-26534f1a3b87 req-d22b655f-f2d1-45c7-81fc-04dff6247605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758749ad-42e5-4e5b-b186-b5e6eccad2d4", "tag": "939a0522-68e9-4929-95bf-e4423e1d68c7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:07.791292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b29ef8b2-b6a8-432a-85d0-26534f1a3b87 req-d22b655f-f2d1-45c7-81fc-04dff6247605 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:07.791778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b29ef8b2-b6a8-432a-85d0-26534f1a3b87 req-d22b655f-f2d1-45c7-81fc-04dff6247605 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:07.792217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b29ef8b2-b6a8-432a-85d0-26534f1a3b87 req-d22b655f-f2d1-45c7-81fc-04dff6247605 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:07.805323 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b29ef8b2-b6a8-432a-85d0-26534f1a3b87 req-d22b655f-f2d1-45c7-81fc-04dff6247605 service nova] Creating event network-changed:939a0522-68e9-4929-95bf-e4423e1d68c7 for instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 on n-h1-858384-19 Nov 02 14:18:07.810539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-b29ef8b2-b6a8-432a-85d0-26534f1a3b87 req-d22b655f-f2d1-45c7-81fc-04dff6247605 service nova] Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:18:07.821909 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b29ef8b2-b6a8-432a-85d0-26534f1a3b87 req-d22b655f-f2d1-45c7-81fc-04dff6247605 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044683 Nov 02 14:18:07.822507 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3642/7649] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:08.447495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:08.448113 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:08.454931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:08.455444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:08.455889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:08.456594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:08.457048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:08.457480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:08.588148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:08.597255 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1adb116c-82ee-40db-92d9-55c5941c5c04 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1523 microversion: 2.1 time: 0.153714 Nov 02 14:18:08.598038 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4008/7650] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:08 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:09.625065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:09.626321 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:09.645276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:09.645788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:09.646243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:09.646974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:09.647599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:09.647946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:09.920681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:09.931247 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-99087706-991a-4cfb-836f-ef0208fbed42 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1523 microversion: 2.1 time: 0.312731 Nov 02 14:18:09.943136 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3643/7651] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:09 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:10.957735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:10.958348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:10.965458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:10.965937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:10.966373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:10.967066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:10.967614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:10.968786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:11.148594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:11.157141 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af5441da-3f5a-46ab-9401-f11940506343 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1520 microversion: 2.1 time: 0.203365 Nov 02 14:18:11.157716 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4009/7652] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:10 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:11.179598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d7aefb44-b85f-4243-ba91-0f7015a5a711 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:11.180149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d7aefb44-b85f-4243-ba91-0f7015a5a711 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:11.186924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7aefb44-b85f-4243-ba91-0f7015a5a711 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:11.187455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7aefb44-b85f-4243-ba91-0f7015a5a711 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:11.187912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7aefb44-b85f-4243-ba91-0f7015a5a711 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:11.188617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7aefb44-b85f-4243-ba91-0f7015a5a711 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:11.189086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7aefb44-b85f-4243-ba91-0f7015a5a711 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:11.189527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d7aefb44-b85f-4243-ba91-0f7015a5a711 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:11.251094 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d7aefb44-b85f-4243-ba91-0f7015a5a711 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "POST /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4/action" status: 204 len: 0 microversion: 2.1 time: 0.074893 Nov 02 14:18:11.251706 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3644/7653] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:18:11 2022] POST /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:18:11.269437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:11.270088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:11.276679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:11.277132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:11.277576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:11.278290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:11.278752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:11.279212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:11.490869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:11.498842 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a111d97-2369-4f41-8173-ad408c44c986 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1520 microversion: 2.1 time: 0.242434 Nov 02 14:18:11.499487 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4010/7654] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:11 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:18:12.523578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:12.524385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:12.531649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.532838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.533364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.534218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.534868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.535519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.660811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-693af5b7-1071-4165-8ee6-68facbe7b0ce req-9e744011-5fa4-4558-b1a7-a348e96e5cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758749ad-42e5-4e5b-b186-b5e6eccad2d4", "name": "network-vif-plugged", "status": "completed", "tag": "939a0522-68e9-4929-95bf-e4423e1d68c7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:12.672572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-693af5b7-1071-4165-8ee6-68facbe7b0ce req-9e744011-5fa4-4558-b1a7-a348e96e5cf6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:12.673465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-693af5b7-1071-4165-8ee6-68facbe7b0ce req-9e744011-5fa4-4558-b1a7-a348e96e5cf6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:12.674065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-693af5b7-1071-4165-8ee6-68facbe7b0ce req-9e744011-5fa4-4558-b1a7-a348e96e5cf6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:12.680890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:12.687974 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-693af5b7-1071-4165-8ee6-68facbe7b0ce req-9e744011-5fa4-4558-b1a7-a348e96e5cf6 service nova] Creating event network-vif-plugged:939a0522-68e9-4929-95bf-e4423e1d68c7 for instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 on n-h1-858384-19 Nov 02 14:18:12.691371 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6cc06afe-41d6-4d95-8156-ae16cda9da4d tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1520 microversion: 2.1 time: 0.173014 Nov 02 14:18:12.692620 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3645/7655] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:12 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:12.694372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-693af5b7-1071-4165-8ee6-68facbe7b0ce req-9e744011-5fa4-4558-b1a7-a348e96e5cf6 service nova] Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:18:12.715467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-693af5b7-1071-4165-8ee6-68facbe7b0ce req-9e744011-5fa4-4558-b1a7-a348e96e5cf6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060032 Nov 02 14:18:12.716251 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4011/7656] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:18:13.714116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:13.714728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:13.722196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:13.722680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:13.723144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:13.723842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:13.724303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:13.724736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:13.861370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:13.869045 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bd196f4a-dae0-43b2-a27e-ce9af0933b99 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1512 microversion: 2.1 time: 0.158867 Nov 02 14:18:13.869626 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3646/7657] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:13 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:13.893901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:13.894610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:13.900867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:13.901356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:13.901802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:13.902502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:13.902963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:13.903420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:14.037720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:14.045446 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69b51325-fb3a-4cdd-bbc1-ce5771110216 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1512 microversion: 2.1 time: 0.157694 Nov 02 14:18:14.046051 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4012/7658] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:13 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:14.070686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17f55da7-19db-4123-b535-c42df184a813 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Action: 'create', calling method: .version_select at 0x7fe78f8dfee0>, body: {"keypair": {"name": "tempest-keypair-1474584846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEo6S3qihmz5U7pdBVkHpMaTP6+kaLA20s8R9tjiKkf4zk88nsWcIZIqHFp7NbXJPXPIb0YbmV9xGxt9yK6EMhXruCoHVO3iVVsuA1r8gpp4s4qhclfOlRQmjDfJTx/yQ=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:14.087413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-17f55da7-19db-4123-b535-c42df184a813 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Getting quotas for project cfaa84cd1f1b4115aaa3567b4045f995. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:18:14.092552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-17f55da7-19db-4123-b535-c42df184a813 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Getting quotas for user 54de0593409e44e8bff464a8490c9484 and project cfaa84cd1f1b4115aaa3567b4045f995. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:18:14.107540 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17f55da7-19db-4123-b535-c42df184a813 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [5634e798-45da-4415-a7fa-7f9b15ccaa68] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:18:15.116347 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [None req-17f55da7-19db-4123-b535-c42df184a813 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [5634e798-45da-4415-a7fa-7f9b15ccaa68] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 42404. Nov 02 14:18:15.132714 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17f55da7-19db-4123-b535-c42df184a813 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.066001 Nov 02 14:18:15.133451 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3647/7659] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:18:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:16.319152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:16.319783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:16.325672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:16.326145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:16.326577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:16.327947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:16.328433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:16.328862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:16.459040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:16.466968 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0b9f75c3-e6c6-4cf3-8d13-5d92c69ead16 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 200 len: 1512 microversion: 2.1 time: 0.152039 Nov 02 14:18:16.467604 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4013/7660] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:16 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:16.491829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:16.493089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:16.500130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:16.500639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:16.501098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:16.501824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:16.502294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:16.502742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:16.528534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:18:16.607717 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-53bc7ea4-7f90-4951-a058-f46bbfffc28c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "DELETE /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 204 len: 0 microversion: 2.1 time: 0.120500 Nov 02 14:18:16.608827 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3648/7661] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:18:16 2022] DELETE /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:18:16.668162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1412122758", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "bd9f5daf-8c75-4829-bb90-eb51703b1302"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:16.722154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] validate_networks() for [('bd9f5daf-8c75-4829-bb90-eb51703b1302', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:18:17.435715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:18:17.436222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:18:17.436713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:18:17.437235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:18:17.437647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:18:17.446765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:17.447282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:17.447724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:17.448452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:17.448910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:17.449339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:17.465898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Getting quotas for project cfaa84cd1f1b4115aaa3567b4045f995. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:18:17.471761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Getting quotas for user 54de0593409e44e8bff464a8490c9484 and project cfaa84cd1f1b4115aaa3567b4045f995. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:18:17.484768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:18:17.486962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:18:17.533621 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f68ebd95-1fa6-4c7e-a280-b017c32409b7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.868870 Nov 02 14:18:17.534811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4014/7662] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:18:16 2022] POST /compute/v2.1/servers => generated 382 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 02 14:18:17.547241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4f06a460-6937-4ecc-b3ba-a92206c29709 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:17.548099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4f06a460-6937-4ecc-b3ba-a92206c29709 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:17.611985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4f06a460-6937-4ecc-b3ba-a92206c29709 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:17.619883 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4f06a460-6937-4ecc-b3ba-a92206c29709 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1222 microversion: 2.1 time: 0.077484 Nov 02 14:18:17.620461 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3649/7663] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:17 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:18.645781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:18.646463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:18.674497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:18.675135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:18.675618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:18.676379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:18.676839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:18.677271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:18.796573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:18.805032 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5ab7de08-a052-46db-832c-d9df25d619bd tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1280 microversion: 2.1 time: 0.165994 Nov 02 14:18:18.822041 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4015/7664] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:18 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:18.844420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7008f1cd-41ef-4b79-a139-1ab24c010af5 req-23e8ccac-9980-4509-8d8e-51582548e065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758749ad-42e5-4e5b-b186-b5e6eccad2d4", "name": "network-vif-deleted", "tag": "939a0522-68e9-4929-95bf-e4423e1d68c7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:18.860303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7008f1cd-41ef-4b79-a139-1ab24c010af5 req-23e8ccac-9980-4509-8d8e-51582548e065 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:18.860714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7008f1cd-41ef-4b79-a139-1ab24c010af5 req-23e8ccac-9980-4509-8d8e-51582548e065 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:18.861346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7008f1cd-41ef-4b79-a139-1ab24c010af5 req-23e8ccac-9980-4509-8d8e-51582548e065 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:18.874714 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7008f1cd-41ef-4b79-a139-1ab24c010af5 req-23e8ccac-9980-4509-8d8e-51582548e065 service nova] Creating event network-vif-deleted:939a0522-68e9-4929-95bf-e4423e1d68c7 for instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 on n-h1-858384-19 Nov 02 14:18:18.879875 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7008f1cd-41ef-4b79-a139-1ab24c010af5 req-23e8ccac-9980-4509-8d8e-51582548e065 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128288 Nov 02 14:18:18.880872 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3650/7665] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:19.830480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:19.831069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:19.838106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:19.838590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:19.839028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:19.839755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:19.840205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:19.841095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:20.033483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:20.041245 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6cd7cb42-8b97-49d5-a7eb-69426d45869c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1322 microversion: 2.1 time: 0.215596 Nov 02 14:18:20.041823 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4016/7666] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:19 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:20.118685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-477a77a3-d643-44de-803a-ead5ddd66807 req-ba714f88-e387-45dd-96e3-8f77c8d4cf9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fe848e-9619-458d-a2a0-7b78fa5eb48a", "tag": "b2ccb495-bc77-446a-b256-f00459f2845d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:20.130200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-477a77a3-d643-44de-803a-ead5ddd66807 req-ba714f88-e387-45dd-96e3-8f77c8d4cf9d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:20.130996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-477a77a3-d643-44de-803a-ead5ddd66807 req-ba714f88-e387-45dd-96e3-8f77c8d4cf9d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:20.131479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-477a77a3-d643-44de-803a-ead5ddd66807 req-ba714f88-e387-45dd-96e3-8f77c8d4cf9d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:20.143750 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-477a77a3-d643-44de-803a-ead5ddd66807 req-ba714f88-e387-45dd-96e3-8f77c8d4cf9d service nova] Creating event network-changed:b2ccb495-bc77-446a-b256-f00459f2845d for instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a on n-h2-858384-19 Nov 02 14:18:20.148970 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-477a77a3-d643-44de-803a-ead5ddd66807 req-ba714f88-e387-45dd-96e3-8f77c8d4cf9d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035532 Nov 02 14:18:20.149830 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3651/7667] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:21.065572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:21.066185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:21.073054 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:21.073531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:21.073970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:21.074668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:21.075140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:21.075571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:21.209876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:21.217634 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0010afb3-ffca-4d63-857c-31f54f691388 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1322 microversion: 2.1 time: 0.156730 Nov 02 14:18:21.218215 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4017/7668] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:21 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:22.242037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:22.242752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:22.249704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:22.250201 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:22.250681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:22.251436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:22.251904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:22.252346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:22.386777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:22.397750 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7fb5aafc-3a04-4005-833f-d45c5d2e6814 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1322 microversion: 2.1 time: 0.159734 Nov 02 14:18:22.401051 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3652/7669] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:22 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:23.427139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:23.427846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:23.434902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:23.435428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:23.435860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:23.436593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:23.437240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:23.437674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:23.592376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:23.600724 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6fdac633-83b4-4f98-9646-dc8a9017e0be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1322 microversion: 2.1 time: 0.177559 Nov 02 14:18:23.601322 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4018/7670] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:23 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:24.624695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:24.625687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:24.634021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:24.634532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:24.634983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:24.635794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:24.636263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:24.636717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:24.787582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:24.795744 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fb20d66e-8bfc-4ad8-ba4d-b9baaa1f59a2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1322 microversion: 2.1 time: 0.175143 Nov 02 14:18:24.796411 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3653/7671] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:24 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:25.459318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f6e8ffaf-dcc0-4dc7-a5c4-60613350221d req-42ee4be7-3bde-4554-9d83-59527880ce83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fe848e-9619-458d-a2a0-7b78fa5eb48a", "name": "network-vif-plugged", "status": "completed", "tag": "b2ccb495-bc77-446a-b256-f00459f2845d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:25.472433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f6e8ffaf-dcc0-4dc7-a5c4-60613350221d req-42ee4be7-3bde-4554-9d83-59527880ce83 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:25.472874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f6e8ffaf-dcc0-4dc7-a5c4-60613350221d req-42ee4be7-3bde-4554-9d83-59527880ce83 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:25.473314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f6e8ffaf-dcc0-4dc7-a5c4-60613350221d req-42ee4be7-3bde-4554-9d83-59527880ce83 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:25.476668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=99 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:25.487141 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f6e8ffaf-dcc0-4dc7-a5c4-60613350221d req-42ee4be7-3bde-4554-9d83-59527880ce83 service nova] Creating event network-vif-plugged:b2ccb495-bc77-446a-b256-f00459f2845d for instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a on n-h2-858384-19 Nov 02 14:18:25.492361 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f6e8ffaf-dcc0-4dc7-a5c4-60613350221d req-42ee4be7-3bde-4554-9d83-59527880ce83 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036866 Nov 02 14:18:25.492971 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4019/7672] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:25.818854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:25.819436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:25.826220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:25.826714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:25.827383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:25.828122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:25.828606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:25.829064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:25.972532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:25.981278 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-72781d7a-34d2-4863-8a24-fc1d8fa3092c tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1322 microversion: 2.1 time: 0.166457 Nov 02 14:18:25.981902 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3654/7673] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:25 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:27.013205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:27.014999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:27.024527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:27.025097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:27.025670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:27.026441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:27.027166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:27.027684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:27.163423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:27.171330 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d229309-9b65-4b73-b6de-3cb3cb420ab2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1512 microversion: 2.1 time: 0.167266 Nov 02 14:18:27.171919 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4020/7674] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:27 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:27.194205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:27.194822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:27.201729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:27.202759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:27.203237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:27.203935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:27.204398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:27.204832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:27.340266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:27.348221 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7159fa49-21e5-445d-92b4-12852f3d93c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1512 microversion: 2.1 time: 0.157897 Nov 02 14:18:27.348796 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3655/7675] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:27 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:27.371224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:27.374134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:27.380173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:27.380652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:27.381094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:27.381788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:27.382246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:27.382677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:27.410931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:27.416550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:18:27.423732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:18:27.424272 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:18:27.424634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:18:27.425052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:18:27.425462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:18:27.462529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:27.478289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:27.492684 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-33b80306-220f-4d74-9a0e-f4cf31a44de3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "POST /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a/action" status: 202 len: 0 microversion: 2.1 time: 0.125459 Nov 02 14:18:27.493301 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4021/7676] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:18:27 2022] POST /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:18:27.502605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:27.503314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:27.509296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:27.509793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:27.510240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:27.511161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:27.511633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:27.512073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:27.533810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:27.616712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:27.678049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:27.685810 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-918fe18f-8dc7-44fd-b398-feaf891e76e9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1519 microversion: 2.1 time: 0.188002 Nov 02 14:18:27.687266 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3656/7677] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:27 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:28.711206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:28.711889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:28.721740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:28.722237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:28.722814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:28.723643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:28.724092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:28.724526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:28.922940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:28.931004 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88111c7a-d554-4d91-b1a1-3bc0495db04f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1519 microversion: 2.1 time: 0.224225 Nov 02 14:18:28.931993 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4022/7678] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:28 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:29.955342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:29.955920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:29.968176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:29.970754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:29.970754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:29.971624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:29.972436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:29.973214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:30.144752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:30.152826 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1578b1d1-0265-4620-855f-c376354b911a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.202126 Nov 02 14:18:30.153424 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3657/7679] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:29 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:31.177004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:31.177619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:31.184562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:31.185041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:31.185484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:31.186938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:31.187431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:31.187862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:31.323476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:31.332560 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9cd2e99e-97c9-4105-9bc9-0474434cd2cf tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.159514 Nov 02 14:18:31.333145 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4023/7680] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:31 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:18:32.356531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:32.357263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:32.365300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:32.365802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:32.366254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:32.366973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:32.367487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:32.367929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:32.506324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:32.514511 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1f3e5e49-69ed-41a2-8213-8019c7613d02 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.161918 Nov 02 14:18:32.515767 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3658/7681] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:32 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:33.539545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:33.540188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:33.548259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:33.548876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:33.549802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:33.550892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:33.551634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:33.552252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:33.692184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:33.700000 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc5ebc5f-fcff-41f2-81b9-d8450896bb39 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.164490 Nov 02 14:18:33.700586 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4024/7682] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:33 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:34.724508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:34.725125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:34.728462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:34.734114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:34.734611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:34.735099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:34.735844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:34.737023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:34.737489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:34.877473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:34.885237 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fae6e63d-06e9-4867-a01b-f11139fc5a9e tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.165575 Nov 02 14:18:34.885818 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3659/7683] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:34 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:35.911872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:35.912534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:35.915406 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:18:35.915548 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:18:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a (ip 10.222.0.113) !!! Nov 02 14:18:35.916660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:35.923324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:35.923817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:35.924324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:35.925354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:35.925686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:35.926115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:36.069142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:36.076996 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2214d616-93af-4496-b216-0debea352447 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.170135 Nov 02 14:18:36.077579 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4025/7684] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:35 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:18:37.101532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:37.102216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:37.109363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:37.109860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:37.110315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:37.111702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:37.112028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:37.112642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:37.245042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:37.253523 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-36d50723-9258-4e57-8fbc-7a77a62d3735 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.155978 Nov 02 14:18:37.254118 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3660/7685] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:37 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:38.277133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:38.277756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:38.284919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:38.285400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:38.285844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:38.286542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:38.286999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:38.287464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:38.420425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:38.428459 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-05f5f179-23c7-4c40-bd9f-4061bca906d7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.155353 Nov 02 14:18:38.429041 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4026/7686] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:38 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:39.452493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:39.453120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:39.460452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:39.460952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:39.461409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:39.462131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:39.462602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:39.463043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:39.607914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:39.616124 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d53f4c04-6f0d-4df5-8b7f-d856c0c26e49 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.167748 Nov 02 14:18:39.616680 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3661/7687] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:39 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:40.641863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:40.642478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:40.649462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:40.649947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:40.650392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:40.651094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:40.651578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:40.652009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:40.785694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:40.793441 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6f4098bc-f990-40ef-b9b5-49db8ad22f8a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.155580 Nov 02 14:18:40.794012 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4027/7688] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:40 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:41.817558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:41.818097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:41.825063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:41.825566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:41.826024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:41.826738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:41.827239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:41.827686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:41.959407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:41.967277 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-faa9aa8a-a556-4975-8e39-507afce0c1b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.154118 Nov 02 14:18:41.967858 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3662/7689] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:41 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:42.994237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:42.994851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:43.001623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:43.002097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:43.002532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:43.003654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:43.004442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:43.005162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:43.142276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:43.150875 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fa3baa08-6fa0-4e08-8b4b-5e070f68e54b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.163387 Nov 02 14:18:43.151488 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4028/7690] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:42 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:44.174606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:44.175274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:44.182080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:44.182578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:44.183033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:44.183766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:44.184233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:44.184674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:44.326432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:44.335131 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c170f7f4-578f-45fe-bb80-9134353812d0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.164542 Nov 02 14:18:44.336343 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3663/7691] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:44 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:45.359505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:45.360125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:45.367567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:45.368056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:45.368522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:45.369246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:45.369704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:45.370141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:45.499741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:45.508535 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cb13e929-b252-406a-a7a3-11916bb7e6a3 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.153476 Nov 02 14:18:45.509121 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4029/7692] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:45 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:46.532516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:46.533255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:46.540551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:46.541040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:46.541484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:46.542188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:46.542650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:46.543130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:46.677631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:46.686810 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-18df1271-2804-468f-928d-accc0d85caea tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.158318 Nov 02 14:18:46.687423 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3664/7693] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:46 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:47.710283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:47.710861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:47.717718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:47.718203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:47.718651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:47.719382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:47.719886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:47.720360 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:47.858423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:47.867032 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-035159ae-8b35-4d8d-86d1-53ab9c2540ef tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.160982 Nov 02 14:18:47.867661 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4030/7694] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:47 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:48.891465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:48.892043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:48.898852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:48.899385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:48.899835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:48.900570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:48.901036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:48.901478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:49.037488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:49.045539 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5eb93035-d0f6-439e-9a39-5de1cfbb8fc6 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.158384 Nov 02 14:18:49.046130 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3665/7695] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:48 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:50.069796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:50.070419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:50.077481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:50.077958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:50.078407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:50.079135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:50.079602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:50.080041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:50.214020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:50.221752 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dfd6ec55-e753-48ac-bf0f-a0b0f456ff25 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.156535 Nov 02 14:18:50.222331 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4031/7696] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:50 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:51.247691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:51.248265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:51.255861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:51.256357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:51.256809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:51.257517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:51.257984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:51.258424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:51.391008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:51.399826 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-201b9fa6-54d4-40c7-a7ef-8c9ed06f35c7 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.156170 Nov 02 14:18:51.400408 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3666/7697] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:51 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:52.423398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:52.424019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:52.431496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:52.431988 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:52.432431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:52.433128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:52.433587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:52.434019 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:52.565618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:52.574015 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c2b5d585-3a0b-48bd-8d6c-ea45ccfe21a0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.154629 Nov 02 14:18:52.574602 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4032/7698] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:52 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:53.598604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:53.599444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:53.606665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:53.607279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:53.607762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:53.608745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:53.609214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:53.609657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:53.752893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:53.760893 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3ab2b60d-e60b-4748-8cb1-ad41c858e879 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.167006 Nov 02 14:18:53.761477 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3667/7699] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:53 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:54.785908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:54.786518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:54.793479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:54.793965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:54.794406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:54.795105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:54.795584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:54.796020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:54.932738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:54.940458 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6852aab3-7887-4c89-b7eb-c8aea0e0bbe2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.159067 Nov 02 14:18:54.941034 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4033/7700] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:54 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:55.964369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:55.964927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:55.971797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:55.972291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:55.973480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:55.974196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:55.974665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:55.975130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:56.109844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:56.117753 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c2c661b3-01b1-4688-add2-84ce684ca105 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1524 microversion: 2.1 time: 0.157434 Nov 02 14:18:56.118326 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3668/7701] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:55 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1524 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:57.140837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:57.141453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:57.148594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:57.149079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:57.149522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:57.150227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:57.150694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:57.151136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:57.155294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:57.182997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-700331c7-92f1-4b88-b6e8-0d81a561c657 req-e58a7649-3886-495a-b823-b65448f9502a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fe848e-9619-458d-a2a0-7b78fa5eb48a", "name": "network-vif-unplugged", "status": "completed", "tag": "b2ccb495-bc77-446a-b256-f00459f2845d"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:57.194855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-700331c7-92f1-4b88-b6e8-0d81a561c657 req-e58a7649-3886-495a-b823-b65448f9502a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:57.195342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-700331c7-92f1-4b88-b6e8-0d81a561c657 req-e58a7649-3886-495a-b823-b65448f9502a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:57.195792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-700331c7-92f1-4b88-b6e8-0d81a561c657 req-e58a7649-3886-495a-b823-b65448f9502a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:57.208940 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-700331c7-92f1-4b88-b6e8-0d81a561c657 req-e58a7649-3886-495a-b823-b65448f9502a service nova] Creating event network-vif-unplugged:b2ccb495-bc77-446a-b256-f00459f2845d for instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a on n-h1-858384-19 Nov 02 14:18:57.214743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-700331c7-92f1-4b88-b6e8-0d81a561c657 req-e58a7649-3886-495a-b823-b65448f9502a service nova] Instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:18:57.226588 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-700331c7-92f1-4b88-b6e8-0d81a561c657 req-e58a7649-3886-495a-b823-b65448f9502a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047611 Nov 02 14:18:57.227383 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3669/7702] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:18:57.296868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:57.305322 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-760a345c-e958-4bf2-a832-03ac881e7f3f tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1523 microversion: 2.1 time: 0.168422 Nov 02 14:18:57.305925 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4034/7703] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:57 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:58.330602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:58.331353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:58.338358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:58.338861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:58.339352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:58.340074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:58.340547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:58.340980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:58.343842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=79 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:18:58.474778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:58.482523 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-861a5225-fbff-4596-a623-721d583afdc0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1521 microversion: 2.1 time: 0.157050 Nov 02 14:18:58.483398 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3670/7704] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:58 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:18:59.251842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1a785acf-f18d-439a-a645-369e3dab8d1f req-a9b5b125-2e45-411b-ae20-4434b857a499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fe848e-9619-458d-a2a0-7b78fa5eb48a", "tag": "b2ccb495-bc77-446a-b256-f00459f2845d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:18:59.262613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1a785acf-f18d-439a-a645-369e3dab8d1f req-a9b5b125-2e45-411b-ae20-4434b857a499 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:59.263089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1a785acf-f18d-439a-a645-369e3dab8d1f req-a9b5b125-2e45-411b-ae20-4434b857a499 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:59.263549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1a785acf-f18d-439a-a645-369e3dab8d1f req-a9b5b125-2e45-411b-ae20-4434b857a499 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:59.275886 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1a785acf-f18d-439a-a645-369e3dab8d1f req-a9b5b125-2e45-411b-ae20-4434b857a499 service nova] Creating event network-changed:b2ccb495-bc77-446a-b256-f00459f2845d for instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a on n-h1-858384-19 Nov 02 14:18:59.281162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-1a785acf-f18d-439a-a645-369e3dab8d1f req-a9b5b125-2e45-411b-ae20-4434b857a499 service nova] Instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:18:59.292159 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1a785acf-f18d-439a-a645-369e3dab8d1f req-a9b5b125-2e45-411b-ae20-4434b857a499 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044153 Nov 02 14:18:59.292848 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4035/7705] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:18:59.507199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:18:59.507964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:18:59.515064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:59.515602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:59.516050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:59.516841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:18:59.517489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:18:59.517948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:18:59.659514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:18:59.668732 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c76b8dba-3f5e-4834-83dd-a24a04e9ac6b tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1521 microversion: 2.1 time: 0.166713 Nov 02 14:18:59.669419 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3671/7706] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:18:59 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:00.694033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:00.694746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:00.701004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:00.701493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:00.701936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:00.702638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:00.703102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:00.703563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:00.844801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:00.854691 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-46533643-19b2-4be1-a2f1-22aa492c21fa tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1521 microversion: 2.1 time: 0.165958 Nov 02 14:19:00.867138 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4036/7707] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:00 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:01.879955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:01.880584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:01.887448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:01.887944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:01.888398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:01.889139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:01.889668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:01.890114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:02.030780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:02.038917 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-29faa782-c319-494f-97e9-be5bec9d65f5 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1518 microversion: 2.1 time: 0.163249 Nov 02 14:19:02.039622 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3672/7708] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:01 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:02.061985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8c3d5734-b3ed-4698-8b3c-a6fe589dc3be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:02.062510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8c3d5734-b3ed-4698-8b3c-a6fe589dc3be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:02.070066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c3d5734-b3ed-4698-8b3c-a6fe589dc3be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:02.070555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c3d5734-b3ed-4698-8b3c-a6fe589dc3be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:02.070999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c3d5734-b3ed-4698-8b3c-a6fe589dc3be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:02.071727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c3d5734-b3ed-4698-8b3c-a6fe589dc3be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:02.072189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c3d5734-b3ed-4698-8b3c-a6fe589dc3be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:02.072626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8c3d5734-b3ed-4698-8b3c-a6fe589dc3be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:02.132483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8c3d5734-b3ed-4698-8b3c-a6fe589dc3be tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "POST /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a/action" status: 204 len: 0 microversion: 2.1 time: 0.074208 Nov 02 14:19:02.133040 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4037/7709] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:19:02 2022] POST /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:19:02.141194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:02.141822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:02.148330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:02.149003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:02.149585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:02.150547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:02.151162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:02.151606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:02.287023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:02.295236 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0d317f56-2493-4549-ae75-9f88380c9808 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1518 microversion: 2.1 time: 0.157806 Nov 02 14:19:02.295957 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3673/7710] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:02 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:03.080415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e74bf93d-d5e1-4f8d-9713-ffd350482e7e req-7b018b52-a270-4e10-8d09-4d7273d4a85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fe848e-9619-458d-a2a0-7b78fa5eb48a", "name": "network-vif-plugged", "status": "completed", "tag": "b2ccb495-bc77-446a-b256-f00459f2845d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:03.091327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e74bf93d-d5e1-4f8d-9713-ffd350482e7e req-7b018b52-a270-4e10-8d09-4d7273d4a85f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.091802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e74bf93d-d5e1-4f8d-9713-ffd350482e7e req-7b018b52-a270-4e10-8d09-4d7273d4a85f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.092235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e74bf93d-d5e1-4f8d-9713-ffd350482e7e req-7b018b52-a270-4e10-8d09-4d7273d4a85f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.103632 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e74bf93d-d5e1-4f8d-9713-ffd350482e7e req-7b018b52-a270-4e10-8d09-4d7273d4a85f service nova] Creating event network-vif-plugged:b2ccb495-bc77-446a-b256-f00459f2845d for instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a on n-h1-858384-19 Nov 02 14:19:03.109124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-e74bf93d-d5e1-4f8d-9713-ffd350482e7e req-7b018b52-a270-4e10-8d09-4d7273d4a85f service nova] Instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:19:03.119818 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e74bf93d-d5e1-4f8d-9713-ffd350482e7e req-7b018b52-a270-4e10-8d09-4d7273d4a85f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102674 Nov 02 14:19:03.120420 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4038/7711] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:03.320915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:03.321627 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:03.328434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.328931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.329383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.330217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.330771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.331245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.470999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:03.480166 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-292e8fd5-abb2-4b04-939c-cb0ccbd2b383 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1510 microversion: 2.1 time: 0.163755 Nov 02 14:19:03.480877 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3674/7712] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:03 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:03.503367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:03.504068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:03.510196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.510705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.511228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.511918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.512367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.512790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.649050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:03.656879 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-714c4b27-e5f3-43ef-9f60-d9814f7fdb54 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1510 microversion: 2.1 time: 0.157781 Nov 02 14:19:03.657497 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4039/7713] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:03 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:03.680252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:03.680909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:03.686963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.687490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.687945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.688650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.689117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.689559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.825639 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:03.833450 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f2a08df-2c5e-4171-885e-965ec0a9143a tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1510 microversion: 2.1 time: 0.157883 Nov 02 14:19:03.834023 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3675/7714] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:03 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:03.855801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:03.856297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:03.862502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.863655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.864251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.864951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.865409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.865840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.890458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:19:03.966873 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4f4f9bc8-94a3-4533-b88e-08edceef36af tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "DELETE /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 204 len: 0 microversion: 2.1 time: 0.114407 Nov 02 14:19:03.967655 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4040/7715] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:19:03 2022] DELETE /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:19:03.983299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:03.983828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:03.990417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.990910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.991399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:03.992103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:03.992569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:03.993008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:04.018574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:19:04.063327 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.compute.api [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Instance is already in deleting state, ignoring this request Nov 02 14:19:04.064055 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9179c6f4-7f8d-4b42-8996-3d81ac11c5b2 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "DELETE /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 204 len: 0 microversion: 2.1 time: 0.085108 Nov 02 14:19:04.064625 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3676/7716] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:19:03 2022] DELETE /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:19:04.074162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:04.074881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:04.081657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:04.082347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:04.082551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:04.083279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:04.083727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:04.084157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:04.215025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:04.222752 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-78d469fd-d4ea-424f-962f-c6c9d7a06698 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1516 microversion: 2.1 time: 0.152970 Nov 02 14:19:04.223365 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4041/7717] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:04 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:05.247008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:05.247686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:05.250230 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=36 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:05.256099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:05.256595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:05.257048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:05.257757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:05.258225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:05.258667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:05.389372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54de0593409e44e8bff464a8490c9484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfaa84cd1f1b4115aaa3567b4045f995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:05.397341 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-23832a17-b99c-4c5c-b6d0-0c8c9020c7e1 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 200 len: 1516 microversion: 2.1 time: 0.154396 Nov 02 14:19:05.397920 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3677/7718] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:05 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:05.996796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-2525e265-c044-4ba0-83d1-baafce1b136d req-30358cd1-8afc-49a2-a27f-93b7644a8153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fe848e-9619-458d-a2a0-7b78fa5eb48a", "name": "network-vif-deleted", "tag": "b2ccb495-bc77-446a-b256-f00459f2845d"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:06.007337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:06.011759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2525e265-c044-4ba0-83d1-baafce1b136d req-30358cd1-8afc-49a2-a27f-93b7644a8153 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:06.012244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2525e265-c044-4ba0-83d1-baafce1b136d req-30358cd1-8afc-49a2-a27f-93b7644a8153 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:06.012676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-2525e265-c044-4ba0-83d1-baafce1b136d req-30358cd1-8afc-49a2-a27f-93b7644a8153 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:06.030640 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-2525e265-c044-4ba0-83d1-baafce1b136d req-30358cd1-8afc-49a2-a27f-93b7644a8153 service nova] Creating event network-vif-deleted:b2ccb495-bc77-446a-b256-f00459f2845d for instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a on n-h1-858384-19 Nov 02 14:19:06.036027 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-2525e265-c044-4ba0-83d1-baafce1b136d req-30358cd1-8afc-49a2-a27f-93b7644a8153 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043428 Nov 02 14:19:06.037609 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4042/7719] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:06.421205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:06.421761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 51fe848e-9619-458d-a2a0-7b78fa5eb48a] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:06.429559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:06.430061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:06.430515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:06.431276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:06.431745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:06.432188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:06.446337 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] HTTP exception thrown: Instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a could not be found. Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Request method failure captured: Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a HTTP/1.1 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnv0FF9O5TFdj4nCPYAzCWnB0cIgRCVm_rRady73R4pU-y9Nva_T1scTLO6AlrDNBADN2vyjKkR3XI4VVasqD11Ztqie2cDiux8uyVwTzBgQRidiLPhY-Yl1rYqHZCq-3sXYitdQCe3MZdK2sVeFcL9Tj0Uk68m2vEUKBxuY-zW3n1c Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cfaa84cd1f1b4115aaa3567b4045f995 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerDiskConfigTestJSON-777107405 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerDiskConfigTestJSON-777107405 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cfaa84cd1f1b4115aaa3567b4045f995 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-777107405 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerDiskConfigTestJSON-777107405-project Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 54de0593409e44e8bff464a8490c9484 Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerDiskConfigTestJSON-777107405-project Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a could not be found. Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '51fe848e-9619-458d-a2a0-7b78fa5eb48a'} Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a could not be found. Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a could not be found. Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:19:06.448027 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a could not be found. Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Returning 404 to user: Instance 51fe848e-9619-458d-a2a0-7b78fa5eb48a could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5190362b-ad83-47a9-9576-fa50476f35c0 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a" status: 404 len: 111 microversion: 2.1 time: 0.032254 Nov 02 14:19:06.452785 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3678/7720] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:06 2022] GET /compute/v2.1/servers/51fe848e-9619-458d-a2a0-7b78fa5eb48a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:19:06.459435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a96ff264-ebaa-48f0-9499-bedd99a78f24 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '.version_select at 0x7fe7873881f0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:06.483985 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a96ff264-ebaa-48f0-9499-bedd99a78f24 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474584846" status: 202 len: 0 microversion: 2.1 time: 0.029304 Nov 02 14:19:06.484577 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4043/7721] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 14:19:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1474584846 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:19:07.099219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:07.099852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:07.105931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:07.106425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:07.106876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:07.107616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:07.108349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:07.108788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:07.122795 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] HTTP exception thrown: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Request method failure captured: Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 HTTP/1.1 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnv0FF9O5TFdj4nCPYAzCWnB0cIgRCVm_rRady73R4pU-y9Nva_T1scTLO6AlrDNBADN2vyjKkR3XI4VVasqD11Ztqie2cDiux8uyVwTzBgQRidiLPhY-Yl1rYqHZCq-3sXYitdQCe3MZdK2sVeFcL9Tj0Uk68m2vEUKBxuY-zW3n1c Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cfaa84cd1f1b4115aaa3567b4045f995 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerDiskConfigTestJSON-777107405 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerDiskConfigTestJSON-777107405 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cfaa84cd1f1b4115aaa3567b4045f995 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-777107405 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerDiskConfigTestJSON-777107405-project Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 54de0593409e44e8bff464a8490c9484 Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerDiskConfigTestJSON-777107405-project Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '758749ad-42e5-4e5b-b186-b5e6eccad2d4'} Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:19:07.124392 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Returning 404 to user: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-276a1b1c-ed2b-4162-817f-87d28e77a7b9 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "DELETE /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 404 len: 111 microversion: 2.1 time: 0.030656 Nov 02 14:19:07.128630 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3679/7722] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:19:07 2022] DELETE /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:19:07.134986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:07.135752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] [instance: 758749ad-42e5-4e5b-b186-b5e6eccad2d4] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:07.143403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:07.143888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:07.144328 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:07.145026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:07.145547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:07.145985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:07.161862 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] HTTP exception thrown: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Request method failure captured: Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 HTTP/1.1 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnv0FF9O5TFdj4nCPYAzCWnB0cIgRCVm_rRady73R4pU-y9Nva_T1scTLO6AlrDNBADN2vyjKkR3XI4VVasqD11Ztqie2cDiux8uyVwTzBgQRidiLPhY-Yl1rYqHZCq-3sXYitdQCe3MZdK2sVeFcL9Tj0Uk68m2vEUKBxuY-zW3n1c Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cfaa84cd1f1b4115aaa3567b4045f995 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerDiskConfigTestJSON-777107405 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cfaa84cd1f1b4115aaa3567b4045f995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerDiskConfigTestJSON-777107405 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cfaa84cd1f1b4115aaa3567b4045f995 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-777107405 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerDiskConfigTestJSON-777107405-project Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 54de0593409e44e8bff464a8490c9484 Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerDiskConfigTestJSON-777107405-project Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '758749ad-42e5-4e5b-b186-b5e6eccad2d4'} Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:19:07.166283 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] Returning 404 to user: Instance 758749ad-42e5-4e5b-b186-b5e6eccad2d4 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-392b0885-12a9-4160-b80e-e257450690b4 tempest-ServerDiskConfigTestJSON-777107405 tempest-ServerDiskConfigTestJSON-777107405-project] 10.222.0.113 "GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4" status: 404 len: 111 microversion: 2.1 time: 0.037297 Nov 02 14:19:07.171613 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4044/7723] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:07 2022] GET /compute/v2.1/servers/758749ad-42e5-4e5b-b186-b5e6eccad2d4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:19:16.305100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3d1a5673-c06e-45eb-9e6a-2b75ba7979d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'create', calling method: .version_select at 0x7fe78686f940>, body: {"keypair": {"name": "tempest-keypair-1433767863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqvLjuWqobI6jt6vBHL8e5nEU1naPUlU6ylsA22Eb3XWJvlC+QMCw5UDgU7BPyHK6NHYpjlwGGl4ZRawu4qn82axTIiI6FofQeoQOqoaOXmQYaPgqmTygSsWhIva87K3Q=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:16.325173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-3d1a5673-c06e-45eb-9e6a-2b75ba7979d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:19:16.332826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-3d1a5673-c06e-45eb-9e6a-2b75ba7979d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for user 1ee11c6caa3a475b92ce013a5cdb239b and project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:19:16.371088 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3d1a5673-c06e-45eb-9e6a-2b75ba7979d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.186787 Nov 02 14:19:16.371877 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3680/7724] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:19:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:17.730687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-280663235", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ab4ea58-3844-4180-a1e3-f0933a456e95"}], "security_groups": [{"name": "tempest-securitygroup--1749494928"}], "key_name": "tempest-keypair-1433767863", "user_data": "}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:17.740561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:17.741416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:17.845275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] validate_networks() for [('7ab4ea58-3844-4180-a1e3-f0933a456e95', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:19:18.230945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:19:18.231408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:19:18.232224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:19:18.232630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:19:18.233422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:19:18.244757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:18.245255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:18.245698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:18.246431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:18.246889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:18.247750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:18.266344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:19:18.271761 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for user 1ee11c6caa3a475b92ce013a5cdb239b and project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:19:18.284453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:19:18.286890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:19:18.352975 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6706932a-6cce-4f49-b703-0aaf2306d3cd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.626535 Nov 02 14:19:18.354060 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4045/7725] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:19:17 2022] POST /compute/v2.1/servers => generated 411 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:19:18.366887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e230504-ad9e-4f3b-9a41-1c6c52282674 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:18.367571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8e230504-ad9e-4f3b-9a41-1c6c52282674 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:18.369687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:18.767390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8e230504-ad9e-4f3b-9a41-1c6c52282674 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:18.775740 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e230504-ad9e-4f3b-9a41-1c6c52282674 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1242 microversion: 2.1 time: 0.414404 Nov 02 14:19:18.776968 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3681/7726] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:18 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1242 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:19.802631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:19.803517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:19.809973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:19.810461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:19.810904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:19.811648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:19.812103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:19.812535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:19.911234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:19.919577 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efbe93af-4692-4c47-87de-85c87908ec92 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1300 microversion: 2.1 time: 0.123343 Nov 02 14:19:19.920182 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4046/7727] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:19 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:20.944291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:20.945062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:20.953303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:20.953800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:20.954250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:20.955532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:20.956009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:20.956443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:20.971194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6e79159b-a33d-4c18-a87f-553ac8151a04 req-a467ddf0-4184-40a8-ba24-e40e7d3bd3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "620685e8-4d90-42a2-95d1-9bfa3c9b7df0", "tag": "51ec97de-f211-4566-8407-4e6bb3680632"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:20.992779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6e79159b-a33d-4c18-a87f-553ac8151a04 req-a467ddf0-4184-40a8-ba24-e40e7d3bd3f9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:20.993427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6e79159b-a33d-4c18-a87f-553ac8151a04 req-a467ddf0-4184-40a8-ba24-e40e7d3bd3f9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:20.994022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6e79159b-a33d-4c18-a87f-553ac8151a04 req-a467ddf0-4184-40a8-ba24-e40e7d3bd3f9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:21.025005 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6e79159b-a33d-4c18-a87f-553ac8151a04 req-a467ddf0-4184-40a8-ba24-e40e7d3bd3f9 service nova] Creating event network-changed:51ec97de-f211-4566-8407-4e6bb3680632 for instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 on n-h2-858384-19 Nov 02 14:19:21.038897 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6e79159b-a33d-4c18-a87f-553ac8151a04 req-a467ddf0-4184-40a8-ba24-e40e7d3bd3f9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073980 Nov 02 14:19:21.041421 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4047/7728] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:21.128254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:21.136501 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dd5160cc-931e-41af-9ac8-9d9e148a2122 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1368 microversion: 2.1 time: 0.196683 Nov 02 14:19:21.137103 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3682/7729] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:20 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:22.161198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:22.161866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:22.168277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:22.168765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:22.169212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:22.169945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:22.170402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:22.170836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:22.300313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:22.308605 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f4f2b2e6-ebe1-44c1-a285-6e0c1bc890a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1368 microversion: 2.1 time: 0.152776 Nov 02 14:19:22.309181 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4048/7730] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:22 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:23.331882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:23.333742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:23.340913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:23.341022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:23.341403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:23.342127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:23.342590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:23.343024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:23.480042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:23.488388 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e25ed87-73fb-4541-b230-9dbf2499de03 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1368 microversion: 2.1 time: 0.160514 Nov 02 14:19:23.489275 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3683/7731] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:23 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:24.511170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:24.511785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:24.519029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:24.519543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:24.520501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:24.521196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:24.521650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:24.522078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:24.652230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:24.659954 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7474c7d9-6d0c-4d0c-98c8-cba5d03fdf52 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1368 microversion: 2.1 time: 0.152766 Nov 02 14:19:24.660602 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4049/7732] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:24 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:19:25.682802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:25.683467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:25.690214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:25.690714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:25.691191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:25.692055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:25.692537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:25.692982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:25.744921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7297e53d-099d-4fd8-b2ba-8eb416cee46f req-a34a78b8-ffc7-4426-9db7-1465798890db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620685e8-4d90-42a2-95d1-9bfa3c9b7df0", "name": "network-vif-plugged", "status": "completed", "tag": "51ec97de-f211-4566-8407-4e6bb3680632"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:25.756599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7297e53d-099d-4fd8-b2ba-8eb416cee46f req-a34a78b8-ffc7-4426-9db7-1465798890db service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:25.757434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7297e53d-099d-4fd8-b2ba-8eb416cee46f req-a34a78b8-ffc7-4426-9db7-1465798890db service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:25.757886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7297e53d-099d-4fd8-b2ba-8eb416cee46f req-a34a78b8-ffc7-4426-9db7-1465798890db service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:25.771141 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7297e53d-099d-4fd8-b2ba-8eb416cee46f req-a34a78b8-ffc7-4426-9db7-1465798890db service nova] Creating event network-vif-plugged:51ec97de-f211-4566-8407-4e6bb3680632 for instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 on n-h2-858384-19 Nov 02 14:19:25.776463 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7297e53d-099d-4fd8-b2ba-8eb416cee46f req-a34a78b8-ffc7-4426-9db7-1465798890db service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035555 Nov 02 14:19:25.777163 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4050/7733] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:19:25.841535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:25.850189 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-abdcc9e9-c413-408e-a938-48abfedf57e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1368 microversion: 2.1 time: 0.171331 Nov 02 14:19:25.850794 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3684/7734] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:25 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:26.873616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:26.874216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:26.880729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:26.881213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:26.881658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:26.882362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:26.882824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:26.883292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:27.013233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:27.021716 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb3aed16-b7b3-4987-9e0d-43717c39e745 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1368 microversion: 2.1 time: 0.153352 Nov 02 14:19:27.022290 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4051/7735] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:26 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:28.044585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:28.045222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:28.052698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:28.053200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:28.053658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:28.054372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:28.054847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:28.055331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:28.182887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:19:28.190700 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d6accd96-1f36-412f-8b69-bb47a7b46a66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1556 microversion: 2.1 time: 0.150146 Nov 02 14:19:28.191305 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3685/7736] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:19:28 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:19:28.215073 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-60d5cb1c-5108-4eaa-81a6-52ebe90e560c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:19:28.215639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-60d5cb1c-5108-4eaa-81a6-52ebe90e560c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:19:28.221547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60d5cb1c-5108-4eaa-81a6-52ebe90e560c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:28.222030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60d5cb1c-5108-4eaa-81a6-52ebe90e560c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:28.222472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60d5cb1c-5108-4eaa-81a6-52ebe90e560c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:28.224170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60d5cb1c-5108-4eaa-81a6-52ebe90e560c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:28.224620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60d5cb1c-5108-4eaa-81a6-52ebe90e560c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:28.225053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-60d5cb1c-5108-4eaa-81a6-52ebe90e560c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:28.256352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:28.278290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:28.307319 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-60d5cb1c-5108-4eaa-81a6-52ebe90e560c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097039 Nov 02 14:19:28.307941 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4052/7737] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 14:19:28 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:19:29.260792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4ce63fda-43ba-40fb-8fc9-94b6127c504a req-65f96172-dfb1-4feb-ac49-f2035ec1619a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "620685e8-4d90-42a2-95d1-9bfa3c9b7df0", "tag": "51ec97de-f211-4566-8407-4e6bb3680632"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:19:29.265920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:19:29.273820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4ce63fda-43ba-40fb-8fc9-94b6127c504a req-65f96172-dfb1-4feb-ac49-f2035ec1619a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:19:29.274319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4ce63fda-43ba-40fb-8fc9-94b6127c504a req-65f96172-dfb1-4feb-ac49-f2035ec1619a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:19:29.274771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4ce63fda-43ba-40fb-8fc9-94b6127c504a req-65f96172-dfb1-4feb-ac49-f2035ec1619a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:19:29.287085 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4ce63fda-43ba-40fb-8fc9-94b6127c504a req-65f96172-dfb1-4feb-ac49-f2035ec1619a service nova] Creating event network-changed:51ec97de-f211-4566-8407-4e6bb3680632 for instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 on n-h2-858384-19 Nov 02 14:19:29.292389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4ce63fda-43ba-40fb-8fc9-94b6127c504a req-65f96172-dfb1-4feb-ac49-f2035ec1619a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035349 Nov 02 14:19:29.293271 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3686/7738] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:34.009781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:34.010521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=34 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:34.015854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:34.016463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:34.027346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.027831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.028268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.028966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.029417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.029843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.445544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:34.453570 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b4eb1d20-b64c-46ca-9737-10b6ea677906 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1675 microversion: 2.1 time: 0.446563 Nov 02 14:20:34.454161 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4053/7739] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:34 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1675 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:34.475474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:34.476282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=26 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:34.477083 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:20:34.477290 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:20:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 (ip 10.222.0.113) !!! Nov 02 14:20:34.484074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:34.484770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:34.494025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.494518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.494967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.495707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.496174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.496611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.634562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:34.642508 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-31018532-314b-4177-8d51-a03b9b311c3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1675 microversion: 2.1 time: 0.169694 Nov 02 14:20:34.643024 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3687/7740] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:34 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:34.665597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:34.666219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:34.672161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.672647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.673093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.673799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.674252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.674688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.807150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:34.815365 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3889258d-8af1-4957-a8c4-6f6a9e6dafbe tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1675 microversion: 2.1 time: 0.154330 Nov 02 14:20:34.815941 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4054/7741] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:34 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:34.838141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:34.840493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:34.846871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.847407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.847868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.849527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.850015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.850470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.883715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:34.889335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Old instance type m1.heat2, new instance type m1.heat {{(pid=120929) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:20:34.897912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:20:34.898350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:20:34.898755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:20:34.899204 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:20:34.899632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:20:34.979966 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5af3b0a5-9dd6-4049-8c18-69d2ee1369ef tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0/action" status: 202 len: 0 microversion: 2.1 time: 0.145744 Nov 02 14:20:34.980686 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3688/7742] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:20:34 2022] POST /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:20:34.989682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:34.990802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:34.996858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.997348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.997792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:34.998505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:34.998963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:34.999430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:35.135509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:35.143959 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-835c8f0e-8e87-4715-a838-4b1fdb399aa2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1684 microversion: 2.1 time: 0.158743 Nov 02 14:20:35.144677 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4055/7743] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:34 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:36.170046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:36.170673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:36.178303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:36.178802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:36.179208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:36.179918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:36.180398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:36.180843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:36.319807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:36.327828 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6128fc12-aecb-4493-b5ae-aa59081921d4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1684 microversion: 2.1 time: 0.162786 Nov 02 14:20:36.328417 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3689/7744] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:36 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:37.351286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:37.351915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:37.361161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:37.361641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:37.362079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:37.362780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:37.363262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:37.363692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:37.498757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:37.507262 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-737defb6-097d-4571-bac8-350477a331ba tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.160083 Nov 02 14:20:37.507835 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4056/7745] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:37 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:38.530815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:38.531495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:38.539037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:38.539560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:38.540009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:38.540718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:38.541183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:38.541621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:38.674696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:38.683206 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5fb782c3-1835-44b8-85aa-743c6a726609 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.156381 Nov 02 14:20:38.683784 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3690/7746] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:38 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:39.707899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:39.708526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:39.716038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:39.716534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:39.716973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:39.717678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:39.718137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:39.718567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:39.847194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:39.856047 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-708d780d-f261-4bb2-933d-d6bede32203f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.152589 Nov 02 14:20:39.856629 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4057/7747] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:39 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:40.881442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:40.882488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:40.889059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:40.889561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:40.890016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:40.890739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:40.891247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:40.891694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:41.027023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:41.034861 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0bc6d561-a6e6-47a2-86b7-a43fc4d66a8b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.158287 Nov 02 14:20:41.035483 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3691/7748] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:40 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:42.057952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:42.058570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:42.065461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:42.065945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:42.066385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:42.067081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:42.067562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:42.067990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:42.207455 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:42.216090 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-59aa2c95-9e09-42ea-a2a6-6b6bf1d5da17 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.162109 Nov 02 14:20:42.216671 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4058/7749] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:42 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:20:43.239905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:43.240559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:43.248316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:43.248822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:43.249280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:43.250004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:43.250484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:43.250931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:43.380748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:43.389706 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8ba59749-5509-49b1-b4a1-7693d4685ff4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.153786 Nov 02 14:20:43.390293 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3692/7750] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:43 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:44.413772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:44.415070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:44.422018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:44.422504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:44.422948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:44.423682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:44.424139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:44.424570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:44.559636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:44.568627 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e0d55cd4-5f70-402c-8519-39ea90aa1a2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.157736 Nov 02 14:20:44.569228 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4059/7751] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:44 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:45.592873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:45.593507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:45.600543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:45.601041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:45.601494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:45.602364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:45.602836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:45.603313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:45.737589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:45.746203 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a0cdff27-e637-4b5e-9686-e1f1f57368c4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.157345 Nov 02 14:20:45.746788 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3693/7752] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:45 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:46.770226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:46.770874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:46.778555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:46.779040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:46.779527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:46.780230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:46.780688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:46.781121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:46.911365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:46.919753 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e6b04db-35bc-4472-a846-2f2cb7f3bd5a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.153488 Nov 02 14:20:46.920334 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4060/7753] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:46 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:47.943825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:47.944482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:47.952075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:47.952560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:47.953001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:47.953698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:47.954157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:47.954595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:48.094461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:48.102785 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f4e9e09-fe3c-464d-abaa-7079a2efc99f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1689 microversion: 2.1 time: 0.162893 Nov 02 14:20:48.103387 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3694/7754] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:47 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:49.127409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:49.129479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:49.135537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:49.143504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:49.144041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:49.144889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:49.145357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:49.145791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:49.292926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:49.301035 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aae962c2-9bac-4d84-b130-d8f114abc864 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1688 microversion: 2.1 time: 0.177545 Nov 02 14:20:49.301664 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4061/7755] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:49 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:49.587260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ad2e2d97-5bfb-499e-b5e4-fe30c7523ef0 req-40b80ebc-7b0b-4ce2-9966-59778e973b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620685e8-4d90-42a2-95d1-9bfa3c9b7df0", "name": "network-vif-unplugged", "status": "completed", "tag": "51ec97de-f211-4566-8407-4e6bb3680632"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:49.597855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ad2e2d97-5bfb-499e-b5e4-fe30c7523ef0 req-40b80ebc-7b0b-4ce2-9966-59778e973b78 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:49.598552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ad2e2d97-5bfb-499e-b5e4-fe30c7523ef0 req-40b80ebc-7b0b-4ce2-9966-59778e973b78 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:49.599012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ad2e2d97-5bfb-499e-b5e4-fe30c7523ef0 req-40b80ebc-7b0b-4ce2-9966-59778e973b78 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:49.612466 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ad2e2d97-5bfb-499e-b5e4-fe30c7523ef0 req-40b80ebc-7b0b-4ce2-9966-59778e973b78 service nova] Creating event network-vif-unplugged:51ec97de-f211-4566-8407-4e6bb3680632 for instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 on n-h1-858384-19 Nov 02 14:20:49.618058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-ad2e2d97-5bfb-499e-b5e4-fe30c7523ef0 req-40b80ebc-7b0b-4ce2-9966-59778e973b78 service nova] Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:20:49.629205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ad2e2d97-5bfb-499e-b5e4-fe30c7523ef0 req-40b80ebc-7b0b-4ce2-9966-59778e973b78 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046289 Nov 02 14:20:49.630015 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3695/7756] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:50.325223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:50.325845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:50.332780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:50.333274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:50.333722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:50.334443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:50.334901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:50.335371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:50.474676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:50.483337 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-266b9040-3ce8-4c05-9bef-e3b544a84a5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1688 microversion: 2.1 time: 0.162653 Nov 02 14:20:50.483925 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4062/7757] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:50 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:51.509282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:51.510759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:51.517077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:51.517568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:51.518012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:51.518715 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:51.519203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:51.519640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:51.651549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:51.658772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3992569e-4b6b-4715-93ac-bc9654bfde70 req-44f41cfa-d6a8-4792-801c-8e8a792b445f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "620685e8-4d90-42a2-95d1-9bfa3c9b7df0", "tag": "51ec97de-f211-4566-8407-4e6bb3680632"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:51.659512 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c0a6c1b-e550-4410-bdd1-96a939ee7b99 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1686 microversion: 2.1 time: 0.155439 Nov 02 14:20:51.660086 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3696/7758] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:51 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:51.668948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3992569e-4b6b-4715-93ac-bc9654bfde70 req-44f41cfa-d6a8-4792-801c-8e8a792b445f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:51.669423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3992569e-4b6b-4715-93ac-bc9654bfde70 req-44f41cfa-d6a8-4792-801c-8e8a792b445f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:51.669863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3992569e-4b6b-4715-93ac-bc9654bfde70 req-44f41cfa-d6a8-4792-801c-8e8a792b445f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:51.681934 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3992569e-4b6b-4715-93ac-bc9654bfde70 req-44f41cfa-d6a8-4792-801c-8e8a792b445f service nova] Creating event network-changed:51ec97de-f211-4566-8407-4e6bb3680632 for instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 on n-h1-858384-19 Nov 02 14:20:51.687705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-3992569e-4b6b-4715-93ac-bc9654bfde70 req-44f41cfa-d6a8-4792-801c-8e8a792b445f service nova] Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:20:51.699379 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3992569e-4b6b-4715-93ac-bc9654bfde70 req-44f41cfa-d6a8-4792-801c-8e8a792b445f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044229 Nov 02 14:20:51.700156 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4063/7759] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:20:52.683299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:52.683839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:52.690691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:52.691229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:52.691685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:52.692396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:52.692861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:52.693298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:52.825244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:52.833485 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8574d02d-8365-405e-91a9-318cf70907f0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1686 microversion: 2.1 time: 0.154215 Nov 02 14:20:52.834089 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3697/7760] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:52 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:53.860784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:53.862164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:53.871042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:53.872707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:53.873299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:53.874546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:53.875268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:53.875792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:54.024728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:54.033891 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e08f1096-aee0-4619-851e-777a392978b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1683 microversion: 2.1 time: 0.178151 Nov 02 14:20:54.047898 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4064/7761] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:53 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:54.059556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-36366490-9b7a-4fc8-b04f-6e200c4b1700 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:54.060149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-36366490-9b7a-4fc8-b04f-6e200c4b1700 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:54.067478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36366490-9b7a-4fc8-b04f-6e200c4b1700 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:54.068296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36366490-9b7a-4fc8-b04f-6e200c4b1700 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:54.068765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36366490-9b7a-4fc8-b04f-6e200c4b1700 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:54.069509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36366490-9b7a-4fc8-b04f-6e200c4b1700 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:54.070000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36366490-9b7a-4fc8-b04f-6e200c4b1700 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:54.070453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-36366490-9b7a-4fc8-b04f-6e200c4b1700 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:54.131963 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-36366490-9b7a-4fc8-b04f-6e200c4b1700 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0/action" status: 204 len: 0 microversion: 2.1 time: 0.077444 Nov 02 14:20:54.132541 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3698/7762] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:20:54 2022] POST /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:20:54.141139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:54.141763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:54.147706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:54.148334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:54.148892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:54.149728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:54.150437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:54.150981 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:54.364750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:54.373352 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-791f90ad-dc01-467a-9f41-9345deceb552 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1683 microversion: 2.1 time: 0.236248 Nov 02 14:20:54.373953 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4065/7763] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:54 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1683 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:55.399308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:55.400700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:55.407018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.407549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.407993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.408701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.409161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.409717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.499085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-e398880e-398f-48f8-b342-1dc0e87e23a7 req-1d7e6a1c-a7b2-44a5-9523-0c89830e252e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620685e8-4d90-42a2-95d1-9bfa3c9b7df0", "name": "network-vif-plugged", "status": "completed", "tag": "51ec97de-f211-4566-8407-4e6bb3680632"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:55.517247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e398880e-398f-48f8-b342-1dc0e87e23a7 req-1d7e6a1c-a7b2-44a5-9523-0c89830e252e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.518413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e398880e-398f-48f8-b342-1dc0e87e23a7 req-1d7e6a1c-a7b2-44a5-9523-0c89830e252e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.519086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-e398880e-398f-48f8-b342-1dc0e87e23a7 req-1d7e6a1c-a7b2-44a5-9523-0c89830e252e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.539445 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-e398880e-398f-48f8-b342-1dc0e87e23a7 req-1d7e6a1c-a7b2-44a5-9523-0c89830e252e service nova] Creating event network-vif-plugged:51ec97de-f211-4566-8407-4e6bb3680632 for instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 on n-h1-858384-19 Nov 02 14:20:55.546140 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-e398880e-398f-48f8-b342-1dc0e87e23a7 req-1d7e6a1c-a7b2-44a5-9523-0c89830e252e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053243 Nov 02 14:20:55.546863 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4066/7764] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:20:55.566868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:55.578991 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40342a24-15d9-4190-86b4-e3cccaf7139c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1675 microversion: 2.1 time: 0.185221 Nov 02 14:20:55.579773 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3699/7765] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:55 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:55.603225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:55.604035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:55.610578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.611069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.611550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.612263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.612727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.613163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.744501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:55.756530 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d5f533b3-0370-415e-88f3-97fd53038aad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1675 microversion: 2.1 time: 0.157718 Nov 02 14:20:55.757131 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4067/7766] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:55 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:55.781063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:55.781711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:55.787829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.788316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.788764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.789458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.789917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.790382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.923737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:55.932131 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8bc768ff-6c3a-4a0c-9b70-1caa6c8fec0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1675 microversion: 2.1 time: 0.154362 Nov 02 14:20:55.932829 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3700/7767] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:55 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:55.954753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:55.955289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:55.961243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.961729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.962175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.963468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:55.963931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:55.964374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:55.990324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:20:56.040512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:56.068212 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8aeafefc-1d41-4278-94ab-c78179aadd75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "DELETE /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 204 len: 0 microversion: 2.1 time: 0.116919 Nov 02 14:20:56.069108 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4068/7768] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:20:55 2022] DELETE /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:20:56.078214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:56.078837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:56.084795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:56.085284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:56.085729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:56.086424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:56.086884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:56.087353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:56.107672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:20:56.226125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:56.234827 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e8fd6e1c-bcbf-49c0-950a-3b5e6f4cfb61 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1681 microversion: 2.1 time: 0.160585 Nov 02 14:20:56.235444 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3701/7769] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:56 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:20:57.259772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:57.260779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:57.267559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:57.268040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:57.268481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:57.269183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:57.269637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:57.270064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:57.404762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:57.412709 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-830a1c90-5d02-4f84-9b03-f97a548a8dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1681 microversion: 2.1 time: 0.157394 Nov 02 14:20:57.413294 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4069/7770] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:57 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:20:58.422528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-782014fe-686c-48ab-add1-1e5e42a28660 req-5c2585c4-f970-4608-a8bd-4ad3068a9c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620685e8-4d90-42a2-95d1-9bfa3c9b7df0", "name": "network-vif-deleted", "tag": "51ec97de-f211-4566-8407-4e6bb3680632"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:58.437291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:58.437967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:58.444828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:58.445579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:58.446186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:58.446806 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-782014fe-686c-48ab-add1-1e5e42a28660 req-5c2585c4-f970-4608-a8bd-4ad3068a9c30 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:58.447356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-782014fe-686c-48ab-add1-1e5e42a28660 req-5c2585c4-f970-4608-a8bd-4ad3068a9c30 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:58.447648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:58.448121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:58.448449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-782014fe-686c-48ab-add1-1e5e42a28660 req-5c2585c4-f970-4608-a8bd-4ad3068a9c30 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:58.448598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:58.461396 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-782014fe-686c-48ab-add1-1e5e42a28660 req-5c2585c4-f970-4608-a8bd-4ad3068a9c30 service nova] Creating event network-vif-deleted:51ec97de-f211-4566-8407-4e6bb3680632 for instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 on n-h1-858384-19 Nov 02 14:20:58.468983 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-782014fe-686c-48ab-add1-1e5e42a28660 req-5c2585c4-f970-4608-a8bd-4ad3068a9c30 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050008 Nov 02 14:20:58.470382 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3702/7771] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:20:58.539582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:20:58.557162 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f6167485-9fb4-4ab4-a78f-5c83ca34a88f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 200 len: 1613 microversion: 2.1 time: 0.123462 Nov 02 14:20:58.558102 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4070/7772] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:58 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 1613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:20:59.582508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:59.583170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:59.590015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:59.590503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:59.590957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:59.591698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:59.592159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:59.592597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:59.606048 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 HTTP/1.1 Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '620685e8-4d90-42a2-95d1-9bfa3c9b7df0'} Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:59.607956 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1aae66f3-7c0c-454e-8da2-7cb242a4ed3e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 404 len: 111 microversion: 2.1 time: 0.032094 Nov 02 14:20:59.612900 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3703/7773] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:59 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:20:59.621587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:20:59.622200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:20:59.629169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:59.629654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:59.630096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:59.630822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:20:59.631369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:20:59.631803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:20:59.646785 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 HTTP/1.1 Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '620685e8-4d90-42a2-95d1-9bfa3c9b7df0'} Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:20:59.648532 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.654795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:20:59.654795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:20:59.654795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:20:59.654795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:20:59.654795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:20:59.654795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:20:59.654795 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:20:59.654795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:20:59.654795 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d3d69a5f-e2ea-458f-b594-62907bb71366 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 404 len: 111 microversion: 2.1 time: 0.032720 Nov 02 14:20:59.659606 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4071/7774] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:20:59 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:20:59.699420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1734868595", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "7ab4ea58-3844-4180-a1e3-f0933a456e95"}], "security_groups": [{"name": "tempest-securitygroup--1749494928"}], "key_name": "tempest-keypair-1433767863", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:20:59.814403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] validate_networks() for [('7ab4ea58-3844-4180-a1e3-f0933a456e95', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:21:00.249645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:21:00.250088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:21:00.250589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:21:00.251016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:21:00.251481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:21:00.260888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:00.261390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:00.261956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:00.262699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:00.263200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:00.263652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:00.281251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:21:00.286609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for user 1ee11c6caa3a475b92ce013a5cdb239b and project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:21:00.300390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:21:00.302708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:21:00.352509 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-174d77b8-b9e1-49ae-a63a-7936b5e2c3a4 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.657676 Nov 02 14:21:00.353205 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3704/7775] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:20:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:21:00.365262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0c164bd-a537-4189-a023-040f7b4fa0aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:00.366006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0c164bd-a537-4189-a023-040f7b4fa0aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:00.433329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0c164bd-a537-4189-a023-040f7b4fa0aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:00.440348 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0c164bd-a537-4189-a023-040f7b4fa0aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1243 microversion: 2.1 time: 0.079138 Nov 02 14:21:00.440924 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4072/7776] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:00 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1243 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:01.466357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:01.467338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:01.474394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:01.474920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:01.475396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:01.476112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:01.476575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:01.477012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:01.546680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:01.559581 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-169054fe-fcb9-497c-bfbb-f27ab1c88d0e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1301 microversion: 2.1 time: 0.098825 Nov 02 14:21:01.560179 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3705/7777] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:01 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:02.584078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:02.584733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:02.592867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:02.593363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:02.593816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:02.594530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:02.594995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:02.595469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:02.821414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:02.829645 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16f3df18-bcba-4031-a064-0d4cc4d9979f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1369 microversion: 2.1 time: 0.249561 Nov 02 14:21:02.830245 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4073/7778] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:02 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1369 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:03.300636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-0a101e60-e24e-46ec-810d-eb97f6789144 req-3de934ad-095b-48eb-9cde-b9db9df2ce79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e", "tag": "1de1ff2b-6f9c-4044-ba0c-49d78999d876"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:03.312111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0a101e60-e24e-46ec-810d-eb97f6789144 req-3de934ad-095b-48eb-9cde-b9db9df2ce79 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:03.312617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0a101e60-e24e-46ec-810d-eb97f6789144 req-3de934ad-095b-48eb-9cde-b9db9df2ce79 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:03.313153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0a101e60-e24e-46ec-810d-eb97f6789144 req-3de934ad-095b-48eb-9cde-b9db9df2ce79 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:03.331944 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-0a101e60-e24e-46ec-810d-eb97f6789144 req-3de934ad-095b-48eb-9cde-b9db9df2ce79 service nova] Creating event network-changed:1de1ff2b-6f9c-4044-ba0c-49d78999d876 for instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e on n-h2-858384-19 Nov 02 14:21:03.340534 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-0a101e60-e24e-46ec-810d-eb97f6789144 req-3de934ad-095b-48eb-9cde-b9db9df2ce79 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138968 Nov 02 14:21:03.341245 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3706/7779] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:03.857197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:03.858288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:03.869212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:03.870957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:03.871811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:03.873105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:03.873919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:03.874468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:04.022256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:04.031007 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eb7f2da5-3d5a-45fb-8e60-915f1f81ef1c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1369 microversion: 2.1 time: 0.180773 Nov 02 14:21:04.031654 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4074/7780] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:03 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:05.057764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:05.058350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:05.060175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:05.065692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:05.066190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:05.066646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:05.067382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:05.067844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:05.068282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:05.208684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:05.216894 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ea17432d-18a9-4687-afdf-b1a4e83a0dab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1369 microversion: 2.1 time: 0.165180 Nov 02 14:21:05.217474 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3707/7781] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:05 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:06.240742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:06.241405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:06.244568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:06.249965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:06.250460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:06.250908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:06.251645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:06.252104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:06.252546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:06.388450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:06.396276 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-064d070a-b330-4ada-8809-0e3a9e402f46 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1369 microversion: 2.1 time: 0.159479 Nov 02 14:21:06.396854 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4075/7782] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:06 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:07.420487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:07.421036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:07.428020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:07.428513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:07.428960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:07.429665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:07.430131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:07.430569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:07.564720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:07.573088 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-04a10d62-240e-40f0-af61-aa9da7719566 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1369 microversion: 2.1 time: 0.156935 Nov 02 14:21:07.573753 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3708/7783] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:07 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:21:08.597614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:08.598232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:08.606255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:08.606757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:08.607501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:08.608259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:08.608728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:08.609171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:08.743203 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:08.751428 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93e2fda0-885e-4804-ac27-9818a26919ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1369 microversion: 2.1 time: 0.157904 Nov 02 14:21:08.752027 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4076/7784] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:08 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:09.773830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:09.774451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:09.780963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:09.781454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:09.781902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:09.782603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:09.783065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:09.783570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:09.922317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:09.930115 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c20e9afc-5af8-4b91-af5c-226d70fc6362 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1369 microversion: 2.1 time: 0.160371 Nov 02 14:21:09.930707 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3709/7785] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:09 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:10.231808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-12637cfb-1654-4d4e-8df9-528922114aa1 req-6904fdf2-128a-4226-88a1-a9c68aeffeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e", "name": "network-vif-plugged", "status": "completed", "tag": "1de1ff2b-6f9c-4044-ba0c-49d78999d876"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:10.242334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-12637cfb-1654-4d4e-8df9-528922114aa1 req-6904fdf2-128a-4226-88a1-a9c68aeffeda service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:10.242822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-12637cfb-1654-4d4e-8df9-528922114aa1 req-6904fdf2-128a-4226-88a1-a9c68aeffeda service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:10.243281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-12637cfb-1654-4d4e-8df9-528922114aa1 req-6904fdf2-128a-4226-88a1-a9c68aeffeda service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:10.254572 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-12637cfb-1654-4d4e-8df9-528922114aa1 req-6904fdf2-128a-4226-88a1-a9c68aeffeda service nova] Creating event network-vif-plugged:1de1ff2b-6f9c-4044-ba0c-49d78999d876 for instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e on n-h2-858384-19 Nov 02 14:21:10.259510 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-12637cfb-1654-4d4e-8df9-528922114aa1 req-6904fdf2-128a-4226-88a1-a9c68aeffeda service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032172 Nov 02 14:21:10.260425 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4077/7786] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:10.955930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:10.956478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:10.958360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:10.959044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:10.965914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:10.966411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:10.966867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:10.967808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:10.968275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:10.968719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:11.104974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:11.113166 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e38a2d12-ab18-4d04-ac3c-61edf81961d2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1369 microversion: 2.1 time: 0.161474 Nov 02 14:21:11.113742 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3710/7787] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:10 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:12.134319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:21:12.140528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:12.141256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:12.147770 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:12.148255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:12.148694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:12.149384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:12.149840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:12.150265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:12.281793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:21:12.289608 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5fb15934-0d23-4c63-b7ac-a03fffaa907a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1556 microversion: 2.1 time: 0.156260 Nov 02 14:21:12.290225 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4078/7788] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:21:12 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:21:12.313382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-477b812c-5405-458d-bd0c-7e5b1f98f180 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:21:12.313900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-477b812c-5405-458d-bd0c-7e5b1f98f180 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:21:12.320861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477b812c-5405-458d-bd0c-7e5b1f98f180 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:12.321366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477b812c-5405-458d-bd0c-7e5b1f98f180 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:12.321822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477b812c-5405-458d-bd0c-7e5b1f98f180 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:12.322538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477b812c-5405-458d-bd0c-7e5b1f98f180 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:12.323009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477b812c-5405-458d-bd0c-7e5b1f98f180 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:12.324111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-477b812c-5405-458d-bd0c-7e5b1f98f180 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:12.405478 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-477b812c-5405-458d-bd0c-7e5b1f98f180 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095956 Nov 02 14:21:12.406085 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3711/7789] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 14:21:12 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:21:13.661935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-606adade-5412-46ba-b1f1-2d77357e32b3 req-1dbf5204-8e3d-4356-87d8-8dd285d5e53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e", "tag": "1de1ff2b-6f9c-4044-ba0c-49d78999d876"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:21:13.673864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-606adade-5412-46ba-b1f1-2d77357e32b3 req-1dbf5204-8e3d-4356-87d8-8dd285d5e53d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:21:13.674354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-606adade-5412-46ba-b1f1-2d77357e32b3 req-1dbf5204-8e3d-4356-87d8-8dd285d5e53d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:21:13.674800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-606adade-5412-46ba-b1f1-2d77357e32b3 req-1dbf5204-8e3d-4356-87d8-8dd285d5e53d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:21:13.686601 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-606adade-5412-46ba-b1f1-2d77357e32b3 req-1dbf5204-8e3d-4356-87d8-8dd285d5e53d service nova] Creating event network-changed:1de1ff2b-6f9c-4044-ba0c-49d78999d876 for instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e on n-h2-858384-19 Nov 02 14:21:13.691676 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-606adade-5412-46ba-b1f1-2d77357e32b3 req-1dbf5204-8e3d-4356-87d8-8dd285d5e53d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033447 Nov 02 14:21:13.692301 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4079/7790] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:28.016671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=9 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:28.017437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=45 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:28.018516 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:22:28.018696 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:22:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/action (ip 10.222.0.113) !!! Nov 02 14:22:28.026523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e059330a-78ee-4da7-9755-4ceeb0de29b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:28.036106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e059330a-78ee-4da7-9755-4ceeb0de29b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:28.036610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e059330a-78ee-4da7-9755-4ceeb0de29b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:28.037061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e059330a-78ee-4da7-9755-4ceeb0de29b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:28.061244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e059330a-78ee-4da7-9755-4ceeb0de29b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Going to try to stop instance {{(pid=120929) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:22:28.103410 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e059330a-78ee-4da7-9755-4ceeb0de29b1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/action" status: 202 len: 0 microversion: 2.1 time: 0.089288 Nov 02 14:22:28.104151 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3712/7791] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:22:28 2022] POST /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:22:28.115386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=9 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:28.116139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=48 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:28.117364 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:22:28.117522 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:22:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e (ip 10.222.0.113) !!! Nov 02 14:22:28.119810 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:22:28.119810 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:22:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e (ip 10.222.0.113) !!! Nov 02 14:22:28.130079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:28.130790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:28.142502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:28.143000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:28.143472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:28.144184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:28.144669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:28.145100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:28.294355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:28.302940 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-de7a6ecf-297b-4cdb-8e3b-386dda7c95c6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.190781 Nov 02 14:22:28.303566 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4080/7792] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:28 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:29.329284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:29.329991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:29.336193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:29.336692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:29.337137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:29.337841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:29.338306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:29.338744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:29.478152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:29.487793 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-faaf4040-db17-40c2-8f17-c828b20b678e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.163392 Nov 02 14:22:29.489510 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3713/7793] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:29 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:30.511373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:30.512096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:30.519850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:30.520413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:30.520944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:30.521714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:30.522240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:30.522739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:30.678407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:30.686430 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3e9c9c75-4fa3-45c9-91c9-acce79efe99d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.178962 Nov 02 14:22:30.686945 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4081/7794] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:30 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:31.709987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:31.710615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:31.718253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:31.718749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:31.719227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:31.719940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:31.720406 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:31.720848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:31.851556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:31.860224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1e6319f7-f728-479f-99b1-914ba433aee2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.154228 Nov 02 14:22:31.860817 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3714/7795] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:31 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:32.884560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:32.885174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:32.893183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:32.893666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:32.894104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:32.894802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:32.895292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:32.895723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:33.028715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:33.037092 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29cadbce-6ad0-4151-ba7c-e17a79da0019 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.156551 Nov 02 14:22:33.037672 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4082/7796] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:32 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:22:34.061466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:34.062103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:34.069005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:34.069507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:34.069965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:34.071758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:34.071758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:34.071758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:34.207737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:34.215578 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b1a4bc26-5e84-490c-852f-6601462710c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.158413 Nov 02 14:22:34.216192 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3715/7797] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:34 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:35.240041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:35.240574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:35.247642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:35.248707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:35.249178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:35.249888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:35.250350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:35.250789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:35.386714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:35.395743 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88ae5a3f-f3c7-4c3b-a153-ac7d67fe1621 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.159767 Nov 02 14:22:35.396333 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4083/7798] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:35 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:36.419329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:36.420075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:36.427033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:36.427563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:36.428019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:36.428731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:36.429202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:36.429644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:36.563376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:36.571445 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b5a380a-6dc7-4a24-9353-d45d74b4daa7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.156127 Nov 02 14:22:36.572042 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3716/7799] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:36 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:37.595650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:37.596271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:37.603185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:37.603673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:37.604119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:37.604858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:37.605316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:37.605749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:37.737041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:37.744850 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2e8393ef-f1c5-4e79-8ebb-ac43019745bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.153746 Nov 02 14:22:37.745435 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4084/7800] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:37 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:38.770184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:38.770721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:38.777970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:38.778472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:38.779466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:38.780179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:38.780665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:38.781085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:38.926572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:38.927257 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7264171-27e4-4f2b-9f12-a784acb777f6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1662 microversion: 2.1 time: 0.161205 Nov 02 14:22:38.927872 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3717/7801] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:38 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:38.950569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:38.952979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:38.959931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:38.960415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:38.960857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:38.962207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:38.962207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:38.962494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:38.992036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:38.997692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Old instance type m1.heat2, new instance type m1.heat {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:22:39.004983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:22:39.005414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:22:39.005897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:22:39.006316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:22:39.006737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:22:39.071932 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-714ef358-4b71-4b62-9dc5-1f40e0ad287c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/action" status: 202 len: 0 microversion: 2.1 time: 0.125254 Nov 02 14:22:39.075699 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4085/7802] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:22:38 2022] POST /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:22:39.080866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:39.081504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:39.087967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:39.088382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:39.088837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:39.089560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:39.090030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:39.090480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:39.261477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:39.270440 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fb8596e3-b108-4266-9bab-8d4520f89528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.193455 Nov 02 14:22:39.271051 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3718/7803] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:39 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:22:40.294930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:40.295773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:40.305860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:40.306359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:40.306808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:40.307586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:40.308130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:40.308570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:40.443387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:40.451858 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d244f3ed-afaa-405d-9831-f76561f3253b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1685 microversion: 2.1 time: 0.161976 Nov 02 14:22:40.452453 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4086/7804] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:40 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:41.475979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:41.476536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:41.484096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:41.484599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:41.485058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:41.485774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:41.486248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:41.486696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:41.623181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:41.631357 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-222858a4-be27-4372-acbb-2f2e017f0236 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1690 microversion: 2.1 time: 0.159424 Nov 02 14:22:41.631945 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3719/7805] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:41 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:22:42.656263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:42.656912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:42.663857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:42.664344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:42.664787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:42.665504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:42.665949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:42.666383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:42.798414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:42.806293 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-daa72254-14be-41bb-9ffd-315b7f09227d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1690 microversion: 2.1 time: 0.154098 Nov 02 14:22:42.806811 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4087/7806] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:42 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:43.753364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a7559b41-961e-49c6-b235-feeed21a93df req-b6c70371-4375-4414-b5ec-32d36a986326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e", "name": "network-vif-unplugged", "status": "completed", "tag": "1de1ff2b-6f9c-4044-ba0c-49d78999d876"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:43.771041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a7559b41-961e-49c6-b235-feeed21a93df req-b6c70371-4375-4414-b5ec-32d36a986326 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:43.771578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a7559b41-961e-49c6-b235-feeed21a93df req-b6c70371-4375-4414-b5ec-32d36a986326 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:43.772033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a7559b41-961e-49c6-b235-feeed21a93df req-b6c70371-4375-4414-b5ec-32d36a986326 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:43.784493 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a7559b41-961e-49c6-b235-feeed21a93df req-b6c70371-4375-4414-b5ec-32d36a986326 service nova] Creating event network-vif-unplugged:1de1ff2b-6f9c-4044-ba0c-49d78999d876 for instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e on n-h1-858384-19 Nov 02 14:22:43.790044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-a7559b41-961e-49c6-b235-feeed21a93df req-b6c70371-4375-4414-b5ec-32d36a986326 service nova] Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:22:43.801931 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a7559b41-961e-49c6-b235-feeed21a93df req-b6c70371-4375-4414-b5ec-32d36a986326 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056442 Nov 02 14:22:43.802827 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3720/7807] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:43.830787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:43.831666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:43.838696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:43.839218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:43.839778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:43.840490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:43.840945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:43.841993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:43.985255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:43.993263 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ae515dab-fdd5-46e5-9d1c-4b1f06e7d342 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1689 microversion: 2.1 time: 0.166962 Nov 02 14:22:44.000756 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4088/7808] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:43 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:22:45.018668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:45.019346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:45.025672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:45.026171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:45.026618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:45.027361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:45.027832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:45.028275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:45.163602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:45.172011 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a1cc65c0-a466-4bdf-ae9f-ab43e7c8e336 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1687 microversion: 2.1 time: 0.158647 Nov 02 14:22:45.172600 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3721/7809] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:45 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:45.834234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-5bf3b571-afb2-4ca7-b73e-ed2083873031 req-463bd9ee-9f74-465e-adee-fa494840d505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e", "tag": "1de1ff2b-6f9c-4044-ba0c-49d78999d876"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:45.844949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5bf3b571-afb2-4ca7-b73e-ed2083873031 req-463bd9ee-9f74-465e-adee-fa494840d505 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:45.845431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5bf3b571-afb2-4ca7-b73e-ed2083873031 req-463bd9ee-9f74-465e-adee-fa494840d505 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:45.845873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-5bf3b571-afb2-4ca7-b73e-ed2083873031 req-463bd9ee-9f74-465e-adee-fa494840d505 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:45.857876 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-5bf3b571-afb2-4ca7-b73e-ed2083873031 req-463bd9ee-9f74-465e-adee-fa494840d505 service nova] Creating event network-changed:1de1ff2b-6f9c-4044-ba0c-49d78999d876 for instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e on n-h1-858384-19 Nov 02 14:22:45.865916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-5bf3b571-afb2-4ca7-b73e-ed2083873031 req-463bd9ee-9f74-465e-adee-fa494840d505 service nova] Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:22:45.877715 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-5bf3b571-afb2-4ca7-b73e-ed2083873031 req-463bd9ee-9f74-465e-adee-fa494840d505 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047439 Nov 02 14:22:45.878410 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4089/7810] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:46.196368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:46.197007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:46.204838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:46.205344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:46.205803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:46.206530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:46.207004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:46.207480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:46.349587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:46.358958 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fee395e8-1cfc-49bb-9e2c-0652ae6f2308 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1687 microversion: 2.1 time: 0.166468 Nov 02 14:22:46.359510 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3722/7811] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:46 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:47.385755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:47.386476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:47.393634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:47.394141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:47.394589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:47.395352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:47.396404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:47.396846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:47.548427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:47.556966 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8fd3c0b-57cb-49f4-8f96-b6245fceaf25 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1683 microversion: 2.1 time: 0.176316 Nov 02 14:22:47.557642 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4090/7812] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:47 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:47.581303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5407f35d-eff4-4ffa-a425-d06b8b11ce65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:47.581884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5407f35d-eff4-4ffa-a425-d06b8b11ce65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:47.588605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5407f35d-eff4-4ffa-a425-d06b8b11ce65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:47.589101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5407f35d-eff4-4ffa-a425-d06b8b11ce65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:47.589690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5407f35d-eff4-4ffa-a425-d06b8b11ce65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:47.590286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5407f35d-eff4-4ffa-a425-d06b8b11ce65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:47.590748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5407f35d-eff4-4ffa-a425-d06b8b11ce65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:47.591273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5407f35d-eff4-4ffa-a425-d06b8b11ce65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:47.655174 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5407f35d-eff4-4ffa-a425-d06b8b11ce65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/action" status: 204 len: 0 microversion: 2.1 time: 0.077783 Nov 02 14:22:47.655690 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3723/7813] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:22:47 2022] POST /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:22:47.663946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:47.664578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:47.672553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:47.673227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:47.673586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:47.674413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:47.674899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:47.675542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:47.902579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:47.912522 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-069453db-bab9-4c08-bd8d-532a57ecd320 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1683 microversion: 2.1 time: 0.252464 Nov 02 14:22:47.913633 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4091/7814] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:47 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1683 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:48.937464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:48.938185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:48.945622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:48.946125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:48.946580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:48.947327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:48.947804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:48.948249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:49.090072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:49.101395 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a939a3ee-33b7-4c46-a2a5-47c128582cd8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1662 microversion: 2.1 time: 0.168878 Nov 02 14:22:49.102007 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3724/7815] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:48 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:49.126144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:49.126762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:49.133915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:49.134404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:49.134846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:49.135585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:49.136039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:49.136466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:49.271708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:49.280440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-009b10a9-fe23-4dfc-b918-32c26092d8f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1662 microversion: 2.1 time: 0.158474 Nov 02 14:22:49.281030 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4092/7816] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:49 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:49.303496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-854ac004-d540-494d-8d7c-90430bd2a144 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:49.309728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-854ac004-d540-494d-8d7c-90430bd2a144 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:49.311480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-854ac004-d540-494d-8d7c-90430bd2a144 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:49.311870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-854ac004-d540-494d-8d7c-90430bd2a144 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:49.335054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-854ac004-d540-494d-8d7c-90430bd2a144 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Going to try to start instance {{(pid=120929) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:22:49.369784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:49.380741 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-854ac004-d540-494d-8d7c-90430bd2a144 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/action" status: 202 len: 0 microversion: 2.1 time: 0.081471 Nov 02 14:22:49.381355 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3725/7817] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:22:49 2022] POST /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:22:49.389861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:49.390491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:49.397111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:49.397575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:49.398129 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:49.399092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:49.399496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:49.399961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:49.549005 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:49.557245 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f9b47dd-1012-4930-8fc5-637f25651111 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1671 microversion: 2.1 time: 0.171382 Nov 02 14:22:49.557842 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4093/7818] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:49 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:49.980902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-eac7a9ba-61c6-4129-b14a-fade2f74634e req-a9aa0b48-81cd-4980-96c7-11c1b8203f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e", "name": "network-vif-plugged", "status": "completed", "tag": "1de1ff2b-6f9c-4044-ba0c-49d78999d876"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:49.996874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eac7a9ba-61c6-4129-b14a-fade2f74634e req-a9aa0b48-81cd-4980-96c7-11c1b8203f64 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:49.997476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eac7a9ba-61c6-4129-b14a-fade2f74634e req-a9aa0b48-81cd-4980-96c7-11c1b8203f64 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:49.998601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-eac7a9ba-61c6-4129-b14a-fade2f74634e req-a9aa0b48-81cd-4980-96c7-11c1b8203f64 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:50.011799 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-eac7a9ba-61c6-4129-b14a-fade2f74634e req-a9aa0b48-81cd-4980-96c7-11c1b8203f64 service nova] Creating event network-vif-plugged:1de1ff2b-6f9c-4044-ba0c-49d78999d876 for instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e on n-h1-858384-19 Nov 02 14:22:50.017681 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-eac7a9ba-61c6-4129-b14a-fade2f74634e req-a9aa0b48-81cd-4980-96c7-11c1b8203f64 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042408 Nov 02 14:22:50.018214 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3726/7819] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:50.581623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:50.582252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:50.589381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:50.589877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:50.590323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:50.591043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:50.591542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:50.592151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:50.734452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:50.742609 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-17b51ed3-24d8-425b-a45a-aa0b15e38bc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1671 microversion: 2.1 time: 0.165015 Nov 02 14:22:50.743408 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4094/7820] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:50 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:51.770180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:51.770810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:51.777311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:51.777808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:51.778259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:51.779689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:51.780167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:51.780605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:51.918225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:51.926155 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9c7d1848-58a3-4880-952a-f50a2ffa36b5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1675 microversion: 2.1 time: 0.161565 Nov 02 14:22:51.926743 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3727/7821] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:51 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:51.948923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:51.949476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:51.956817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:51.957301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:51.957738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:51.958438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:51.958899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:51.959368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:51.977947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:51.988095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:22:52.065805 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-aaebe52d-4d3a-4ba4-b974-29615c197e65 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 204 len: 0 microversion: 2.1 time: 0.120558 Nov 02 14:22:52.066740 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4095/7822] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:22:51 2022] DELETE /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:22:52.078095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:52.078745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:52.085280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:52.085784 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:52.086239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:52.086963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:52.087479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:52.088327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:52.223548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:52.231458 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c7af3df-3d1f-4a6e-9975-3f59287d285e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1681 microversion: 2.1 time: 0.159966 Nov 02 14:22:52.232667 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3728/7823] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:52 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:22:53.256940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:53.257646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:53.265205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:53.265695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:53.266132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:53.266837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:53.267326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:53.267758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:53.406217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:53.414422 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfffd614-f6ba-4dbb-94ed-d1ade990e5bb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1681 microversion: 2.1 time: 0.161697 Nov 02 14:22:53.415033 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4096/7824] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:53 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:54.439102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:54.439753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:54.447654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:54.448255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:54.448704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:54.449425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:54.449888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:54.451287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:54.548560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:54.557672 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7be5e0d6-0baa-4409-a01d-1a2481fcd1d9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 200 len: 1613 microversion: 2.1 time: 0.122642 Nov 02 14:22:54.571148 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3729/7825] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:54 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 1613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:54.616942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c4de04b9-a351-4279-8caa-d5621b46f8a1 req-b234e4bb-10a2-4bd9-97a6-5abb33889321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e", "name": "network-vif-deleted", "tag": "1de1ff2b-6f9c-4044-ba0c-49d78999d876"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:54.628597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c4de04b9-a351-4279-8caa-d5621b46f8a1 req-b234e4bb-10a2-4bd9-97a6-5abb33889321 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:54.629090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c4de04b9-a351-4279-8caa-d5621b46f8a1 req-b234e4bb-10a2-4bd9-97a6-5abb33889321 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:54.629534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c4de04b9-a351-4279-8caa-d5621b46f8a1 req-b234e4bb-10a2-4bd9-97a6-5abb33889321 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:54.642463 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c4de04b9-a351-4279-8caa-d5621b46f8a1 req-b234e4bb-10a2-4bd9-97a6-5abb33889321 service nova] Creating event network-vif-deleted:1de1ff2b-6f9c-4044-ba0c-49d78999d876 for instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e on n-h1-858384-19 Nov 02 14:22:54.648713 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c4de04b9-a351-4279-8caa-d5621b46f8a1 req-b234e4bb-10a2-4bd9-97a6-5abb33889321 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036347 Nov 02 14:22:54.649567 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4097/7826] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:55.583698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:55.584524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:55.591498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:55.592135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:55.592592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:55.593314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:55.593782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:55.594222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:55.613317 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e HTTP/1.1 Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e'} Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:22:55.615314 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-170a3294-75a0-4497-8115-fe34d304c499 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 404 len: 111 microversion: 2.1 time: 0.037505 Nov 02 14:22:55.622113 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3730/7827] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:55 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:22:55.636086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:55.636805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:55.643915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:55.644409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:55.644856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:55.645571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:55.646029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:55.646469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:55.660926 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e HTTP/1.1 Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e'} Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:22:55.662728 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6e41a688-4b26-401f-a7f4-ad8e958fe5d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 404 len: 111 microversion: 2.1 time: 0.033804 Nov 02 14:22:55.667166 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4098/7828] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:55 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:22:55.714979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-334044798", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "7ab4ea58-3844-4180-a1e3-f0933a456e95"}], "security_groups": [{"name": "tempest-securitygroup--1749494928"}], "key_name": "tempest-keypair-1433767863", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:55.822051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] validate_networks() for [('7ab4ea58-3844-4180-a1e3-f0933a456e95', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:22:56.198960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:22:56.199433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:22:56.199929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:22:56.200886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:22:56.201455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:22:56.210735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:56.211269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:56.211730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:56.212484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:56.212959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:56.213409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:56.231374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:22:56.237420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for user 1ee11c6caa3a475b92ce013a5cdb239b and project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:22:56.250602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:22:56.252963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:22:56.300622 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dff8d017-7abc-420f-bc18-5753a709c960 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.589578 Nov 02 14:22:56.301273 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3731/7829] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:22:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:22:56.313232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d0da7326-7a24-48f7-afc8-7335b3700439 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:56.313852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d0da7326-7a24-48f7-afc8-7335b3700439 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:56.370703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d0da7326-7a24-48f7-afc8-7335b3700439 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:56.378094 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d0da7326-7a24-48f7-afc8-7335b3700439 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1242 microversion: 2.1 time: 0.069409 Nov 02 14:22:56.378675 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4099/7830] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:56 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:57.403913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:57.405037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:57.411997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:57.412646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:57.413112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:57.413840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:57.415170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:57.415653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:57.486104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:57.494030 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22f511c0-647f-4a82-8072-5507c60d4b51 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1312 microversion: 2.1 time: 0.095875 Nov 02 14:22:57.494616 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3732/7831] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:57 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:58.518732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:58.519316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:58.523513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:58.535752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:58.536253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:58.536724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:58.537450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:58.537914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:58.538351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:58.807334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:22:58.816114 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-afb974fc-a5f6-445c-8af0-66ade4a253a9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1368 microversion: 2.1 time: 0.301698 Nov 02 14:22:58.816706 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4100/7832] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:58 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1368 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:22:59.207258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-cf4e6c66-4cf2-4216-ba0c-0543c989a5d7 req-12d0eebe-e570-4115-9910-f7feabd1fc84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afdd153a-bd38-4e4b-9475-6fdee47eb75d", "tag": "f8e1b913-0e91-406c-b339-dee2895efee2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:22:59.217146 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:22:59.227794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cf4e6c66-4cf2-4216-ba0c-0543c989a5d7 req-12d0eebe-e570-4115-9910-f7feabd1fc84 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:59.228322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cf4e6c66-4cf2-4216-ba0c-0543c989a5d7 req-12d0eebe-e570-4115-9910-f7feabd1fc84 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:59.230435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cf4e6c66-4cf2-4216-ba0c-0543c989a5d7 req-12d0eebe-e570-4115-9910-f7feabd1fc84 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:59.257916 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-cf4e6c66-4cf2-4216-ba0c-0543c989a5d7 req-12d0eebe-e570-4115-9910-f7feabd1fc84 service nova] Creating event network-changed:f8e1b913-0e91-406c-b339-dee2895efee2 for instance afdd153a-bd38-4e4b-9475-6fdee47eb75d on n-h2-858384-19 Nov 02 14:22:59.266909 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-cf4e6c66-4cf2-4216-ba0c-0543c989a5d7 req-12d0eebe-e570-4115-9910-f7feabd1fc84 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064448 Nov 02 14:22:59.267736 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3733/7833] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:22:59.842196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:22:59.842841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:22:59.849822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:59.850244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:59.850686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:59.851422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:22:59.851877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:22:59.852305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:22:59.994323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:23:00.002852 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19633b6a-37d6-4711-8d96-02d7cc6da495 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1368 microversion: 2.1 time: 0.165551 Nov 02 14:23:00.003488 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4101/7834] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:22:59 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:23:01.028617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:01.029315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:01.035582 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:01.036076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:01.036526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:01.037234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:01.037700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:01.038144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:01.177408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:23:01.185103 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aa877a30-5bde-4344-ba42-f214ca861304 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1368 microversion: 2.1 time: 0.162462 Nov 02 14:23:01.185673 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3734/7835] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:23:01 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:23:02.208075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:02.208687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:02.215887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:02.216369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:02.216809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:02.217515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:02.217968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:02.218394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:02.360555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:23:02.368360 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a1f8149-b8fc-483e-8abf-29f4a1dc149a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1368 microversion: 2.1 time: 0.164277 Nov 02 14:23:02.368950 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4102/7836] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:23:02 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:23:03.392468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:03.393019 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:03.399940 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:03.400439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:03.400888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:03.401595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:03.402062 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:03.402501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:03.533078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:23:03.540894 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b6fde47-f8a3-4c96-9a35-94d19525de2c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1368 microversion: 2.1 time: 0.153089 Nov 02 14:23:03.541469 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3735/7837] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:23:03 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:23:04.564760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:04.565386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:04.572491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:04.572990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:04.573441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:04.574163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:04.574692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:04.576304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:04.716393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:23:04.724579 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5997d3b5-23c9-49ad-993d-5edfda105c58 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1368 microversion: 2.1 time: 0.163681 Nov 02 14:23:04.725091 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4103/7838] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:23:04 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:23:05.749580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:05.750237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:05.757930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:05.758543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:05.759094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:05.759917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:05.760409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:05.760825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:05.897372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:23:05.905669 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-91bda7e5-de5e-4217-822e-d7f041a2277d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1368 microversion: 2.1 time: 0.160543 Nov 02 14:23:05.906249 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3736/7839] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:23:05 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:23:06.803670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-13d62ad0-9b4f-4683-a881-ede7a6eccdb5 req-fa5a99d3-ca6d-4666-91ba-e7a598aef620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afdd153a-bd38-4e4b-9475-6fdee47eb75d", "name": "network-vif-plugged", "status": "completed", "tag": "f8e1b913-0e91-406c-b339-dee2895efee2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:23:06.809445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:06.815780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-13d62ad0-9b4f-4683-a881-ede7a6eccdb5 req-fa5a99d3-ca6d-4666-91ba-e7a598aef620 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:06.816374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-13d62ad0-9b4f-4683-a881-ede7a6eccdb5 req-fa5a99d3-ca6d-4666-91ba-e7a598aef620 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:06.816807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-13d62ad0-9b4f-4683-a881-ede7a6eccdb5 req-fa5a99d3-ca6d-4666-91ba-e7a598aef620 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:06.828778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-13d62ad0-9b4f-4683-a881-ede7a6eccdb5 req-fa5a99d3-ca6d-4666-91ba-e7a598aef620 service nova] Creating event network-vif-plugged:f8e1b913-0e91-406c-b339-dee2895efee2 for instance afdd153a-bd38-4e4b-9475-6fdee47eb75d on n-h2-858384-19 Nov 02 14:23:06.834673 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-13d62ad0-9b4f-4683-a881-ede7a6eccdb5 req-fa5a99d3-ca6d-4666-91ba-e7a598aef620 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034740 Nov 02 14:23:06.835472 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4104/7840] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:06.928947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:06.929608 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:06.931579 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:06.932402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:23:06.941435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:06.941952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:06.942414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:06.943171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:06.943652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:06.944134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:07.080517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:23:07.088355 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ef0b803c-b8df-4a9a-8f31-f9a7e1b3e7f9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1368 microversion: 2.1 time: 0.163400 Nov 02 14:23:07.088954 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3737/7841] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:23:06 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:23:08.114400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:08.115131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:08.121437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:08.122599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:08.123041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:08.123768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:08.124229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:08.124671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:08.256392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:23:08.264671 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9dc4387b-cac6-496c-aa4b-ed86f8d8cb82 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1368 microversion: 2.1 time: 0.155462 Nov 02 14:23:08.265261 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4105/7842] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:23:08 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:23:09.288703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:09.289322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:09.295925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:09.296421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:09.296870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:09.297574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:09.298038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:09.298478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:09.429199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:23:09.437582 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bae4aaa5-ba3a-4720-94f7-def42908f76a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1555 microversion: 2.1 time: 0.153001 Nov 02 14:23:09.438160 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3738/7843] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:23:09 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:23:09.461599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b55b63e9-b27f-43d6-9c7c-51442c983429 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:23:09.462095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b55b63e9-b27f-43d6-9c7c-51442c983429 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:23:09.469294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b55b63e9-b27f-43d6-9c7c-51442c983429 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:09.469780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b55b63e9-b27f-43d6-9c7c-51442c983429 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:09.470222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b55b63e9-b27f-43d6-9c7c-51442c983429 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:09.470927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b55b63e9-b27f-43d6-9c7c-51442c983429 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:09.471413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b55b63e9-b27f-43d6-9c7c-51442c983429 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:09.471844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b55b63e9-b27f-43d6-9c7c-51442c983429 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:09.551483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b55b63e9-b27f-43d6-9c7c-51442c983429 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093656 Nov 02 14:23:09.552097 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4106/7844] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 14:23:09 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:23:10.506293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-44aa5b6a-38ff-4d6b-ab17-d20edf53e4a1 req-1ce18aa7-b5d4-4c2c-94b0-25ed58c00d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afdd153a-bd38-4e4b-9475-6fdee47eb75d", "tag": "f8e1b913-0e91-406c-b339-dee2895efee2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:23:10.517771 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-44aa5b6a-38ff-4d6b-ab17-d20edf53e4a1 req-1ce18aa7-b5d4-4c2c-94b0-25ed58c00d62 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:23:10.518277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-44aa5b6a-38ff-4d6b-ab17-d20edf53e4a1 req-1ce18aa7-b5d4-4c2c-94b0-25ed58c00d62 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:23:10.518733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-44aa5b6a-38ff-4d6b-ab17-d20edf53e4a1 req-1ce18aa7-b5d4-4c2c-94b0-25ed58c00d62 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:23:10.530765 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-44aa5b6a-38ff-4d6b-ab17-d20edf53e4a1 req-1ce18aa7-b5d4-4c2c-94b0-25ed58c00d62 service nova] Creating event network-changed:f8e1b913-0e91-406c-b339-dee2895efee2 for instance afdd153a-bd38-4e4b-9475-6fdee47eb75d on n-h2-858384-19 Nov 02 14:23:10.536240 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-44aa5b6a-38ff-4d6b-ab17-d20edf53e4a1 req-1ce18aa7-b5d4-4c2c-94b0-25ed58c00d62 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033483 Nov 02 14:23:10.536973 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3739/7845] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:22.869275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=13 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:22.869933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:22.959877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:22.962254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:22.969199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:22.969692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:22.970135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:22.970837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:22.971335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:22.971771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:23.001153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:23.006840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Old instance type m1.heat2, new instance type m1.heat {{(pid=120928) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:24:23.013562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:24:23.013990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:24:23.014472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:24:23.014887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:24:23.015338 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:24:23.084589 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-327cde2f-5279-41c9-a633-9f08efbdc9f3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d/action" status: 202 len: 0 microversion: 2.1 time: 0.218169 Nov 02 14:24:23.085283 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4107/7846] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:24:22 2022] POST /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:24:23.092127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=13 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:23.093029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=64 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:23.098550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:23.099209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:23.108331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:23.108682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:23.109153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:23.109988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:23.110497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:23.111063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:23.629016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:23.637587 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-805406eb-b436-4219-8555-f8e40f3cc95c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1683 microversion: 2.1 time: 0.547582 Nov 02 14:24:23.638184 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3740/7847] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:23 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1683 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:24.663031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:24.663813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:24.670903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:24.671422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:24.671861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:24.672563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:24.673017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:24.673448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:24.975061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:24.984066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca6ea1a5-0ab6-4ae9-a667-09bfef587e4a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1683 microversion: 2.1 time: 0.325902 Nov 02 14:24:24.984654 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4108/7848] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:24 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1683 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:24:26.007581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:26.008107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:26.015208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:26.015706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:26.016157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:26.016866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:26.017334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:26.017774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:26.152826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:26.160641 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ab877b6b-afd0-42f2-b7eb-b2272c1ae0e0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.157156 Nov 02 14:24:26.161218 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3741/7849] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:26 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:27.185111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:27.185726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:27.192680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.193161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.193600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:27.194299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:27.194751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:27.195205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:27.330413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:27.339047 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b334be8-fede-4345-9e99-329d83e1b553 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.158674 Nov 02 14:24:27.339658 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4109/7850] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:27 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:28.363530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:28.364127 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:28.370840 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:28.371367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:28.371819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:28.372532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:28.373002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:28.373443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:28.504211 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:28.512219 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-67f1990c-c0a0-44fc-916d-a9ba480f9f33 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.153060 Nov 02 14:24:28.512805 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3742/7851] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:28 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:29.535952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:29.536521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:29.544185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:29.544671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:29.545114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:29.545823 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:29.546282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:29.546717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:29.682122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:29.689955 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c282a25c-a022-45fe-9016-f60ca697312b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.158076 Nov 02 14:24:29.690534 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4110/7852] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:29 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:30.713815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:30.714400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:30.721447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:30.721952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:30.722415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:30.723152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:30.723631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:30.724079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:30.859571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:30.867578 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-65183d6c-9e41-48f3-a86a-27281a49728a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.158512 Nov 02 14:24:30.868160 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3743/7853] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:30 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:24:31.891447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:31.891993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:31.898747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:31.899258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:31.899842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:31.900554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:31.901006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:31.901436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:32.033869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:32.041878 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b1073bd4-cd74-48e0-bb8b-8b0978989c5b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.154516 Nov 02 14:24:32.042468 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4111/7854] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:31 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:33.067530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:33.068180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:33.075601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:33.076096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:33.076547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:33.077258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:33.077723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:33.078160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:33.211357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:33.220088 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aac69ac7-b5f0-456b-8eba-ccc1382544a2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.156623 Nov 02 14:24:33.220677 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3744/7855] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:33 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:34.244157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:34.244726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:34.251652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:34.252138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:34.252580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:34.253277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:34.253731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:34.254161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:34.388095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:34.397203 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-58cd9ade-c157-434d-9373-6fcf9d4bf8c8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.157369 Nov 02 14:24:34.397782 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4112/7856] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:34 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:35.421733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:35.422351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:35.429179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:35.429670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:35.430119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:35.431578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:35.432310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:35.433004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:35.571197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:35.579251 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-558c0448-c51b-40d9-ac6b-057ca5a7761e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.161413 Nov 02 14:24:35.579839 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3745/7857] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:35 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:36.604579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:36.605233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:36.612469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:36.613259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:36.613448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:36.614170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:36.614634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:36.615070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:36.759465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:36.767081 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e52f73f5-ff2b-4836-9fec-1aa7b7fbc2c7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.167432 Nov 02 14:24:36.767705 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4113/7858] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:36 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:37.790669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:37.791619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:37.798501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:37.798997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:37.799487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:37.800199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:37.800673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:37.801116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:37.932294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:37.940127 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d18bb054-c177-4672-b348-e516dd39889b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.154151 Nov 02 14:24:37.940712 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3746/7859] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:37 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:38.964633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:38.965262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:38.972112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:38.972600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:38.973048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:38.973780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:38.974218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:38.974657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:39.107724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:39.115556 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c448f705-f639-4e36-bef1-7e90bda9aebb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.155734 Nov 02 14:24:39.116136 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4114/7860] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:38 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:40.140559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:40.141188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:40.147989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:40.148483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:40.148937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:40.149756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:40.150228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:40.150672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:40.280546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:40.288322 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6bcbb23b-7a6f-48dc-82b9-40acbeae5e60 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.151736 Nov 02 14:24:40.288907 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3747/7861] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:40 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:41.311985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:41.312603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:41.319496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:41.319986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:41.320432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:41.321705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:41.322302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:41.322789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:41.452858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:41.460678 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89e5212a-2242-48ad-9d32-49ed3233e831 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.152677 Nov 02 14:24:41.461261 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4115/7862] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:41 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:42.486186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:42.486814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:42.494419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:42.494918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:42.495405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:42.496144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:42.496611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:42.497051 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:42.635542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:42.643652 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-56bf3621-4363-43be-8085-2bac57d3f01e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.161417 Nov 02 14:24:42.644314 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3748/7863] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:42 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:43.669206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:43.669857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:43.676809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:43.677301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:43.677749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:43.678462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:43.678926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:43.679390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:43.813318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:43.822356 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4dff364-8d15-4241-a978-dae5652950a5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.157389 Nov 02 14:24:43.822981 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4116/7864] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:43 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:44.846814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:44.847415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:44.855042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:44.855815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:44.856262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:44.856962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:44.857423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:44.857858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:44.988919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:44.997786 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2e6efd30-99a9-44ba-bb76-da08ec082be1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.154968 Nov 02 14:24:44.998384 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3749/7865] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:44 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:46.020991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:46.021549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:46.028601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:46.029091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:46.029534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:46.030243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:46.030703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:46.031158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:46.162783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:46.171429 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8ab808ca-e4f8-4777-bb58-6845576e3e22 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.154704 Nov 02 14:24:46.172021 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4117/7866] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:46 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:47.195027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:47.195702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:47.203096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:47.203634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:47.204094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:47.204824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:47.205299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:47.205747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:47.359998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:47.370235 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-193bdb27-1757-4881-a8bd-546c9a8a4ec3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1688 microversion: 2.1 time: 0.179028 Nov 02 14:24:47.370993 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3750/7867] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:47 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:47.911623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-b766752a-acf6-40ac-8aca-af4950f98cf1 req-7a2f59b9-bf3b-42bf-937b-cb91bd8c1480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afdd153a-bd38-4e4b-9475-6fdee47eb75d", "name": "network-vif-unplugged", "status": "completed", "tag": "f8e1b913-0e91-406c-b339-dee2895efee2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:47.921694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b766752a-acf6-40ac-8aca-af4950f98cf1 req-7a2f59b9-bf3b-42bf-937b-cb91bd8c1480 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:47.922181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b766752a-acf6-40ac-8aca-af4950f98cf1 req-7a2f59b9-bf3b-42bf-937b-cb91bd8c1480 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:47.922627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-b766752a-acf6-40ac-8aca-af4950f98cf1 req-7a2f59b9-bf3b-42bf-937b-cb91bd8c1480 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:47.935238 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-b766752a-acf6-40ac-8aca-af4950f98cf1 req-7a2f59b9-bf3b-42bf-937b-cb91bd8c1480 service nova] Creating event network-vif-unplugged:f8e1b913-0e91-406c-b339-dee2895efee2 for instance afdd153a-bd38-4e4b-9475-6fdee47eb75d on n-h1-858384-19 Nov 02 14:24:47.941421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-b766752a-acf6-40ac-8aca-af4950f98cf1 req-7a2f59b9-bf3b-42bf-937b-cb91bd8c1480 service nova] Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:24:47.954170 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-b766752a-acf6-40ac-8aca-af4950f98cf1 req-7a2f59b9-bf3b-42bf-937b-cb91bd8c1480 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110484 Nov 02 14:24:47.955050 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4118/7868] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:24:48.394403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:48.395719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:48.402581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:48.403083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:48.403564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:48.404287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:48.404754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:48.405195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:48.691434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:48.702878 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9d9fa10-a4c4-4308-8246-f6994f20c501 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1687 microversion: 2.1 time: 0.312863 Nov 02 14:24:48.703628 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3751/7869] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:48 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1687 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:49.731924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:49.732590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:49.739141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:49.739644 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:49.740094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:49.740802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:49.741268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:49.741704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:49.877241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:49.886484 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edd6f092-5a9e-4789-a2e2-39f6594017ff tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1685 microversion: 2.1 time: 0.161298 Nov 02 14:24:49.887079 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4119/7870] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:49 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:49.972994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6614c951-ed4e-46c2-a0b8-3d9f8b63954b req-0cd2081f-7557-45b2-ad3e-54ebe74e8993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afdd153a-bd38-4e4b-9475-6fdee47eb75d", "tag": "f8e1b913-0e91-406c-b339-dee2895efee2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:49.984426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6614c951-ed4e-46c2-a0b8-3d9f8b63954b req-0cd2081f-7557-45b2-ad3e-54ebe74e8993 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:49.984856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6614c951-ed4e-46c2-a0b8-3d9f8b63954b req-0cd2081f-7557-45b2-ad3e-54ebe74e8993 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:49.985303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6614c951-ed4e-46c2-a0b8-3d9f8b63954b req-0cd2081f-7557-45b2-ad3e-54ebe74e8993 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:49.996896 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6614c951-ed4e-46c2-a0b8-3d9f8b63954b req-0cd2081f-7557-45b2-ad3e-54ebe74e8993 service nova] Creating event network-changed:f8e1b913-0e91-406c-b339-dee2895efee2 for instance afdd153a-bd38-4e4b-9475-6fdee47eb75d on n-h1-858384-19 Nov 02 14:24:50.002169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-6614c951-ed4e-46c2-a0b8-3d9f8b63954b req-0cd2081f-7557-45b2-ad3e-54ebe74e8993 service nova] Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:24:50.014081 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6614c951-ed4e-46c2-a0b8-3d9f8b63954b req-0cd2081f-7557-45b2-ad3e-54ebe74e8993 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044727 Nov 02 14:24:50.014690 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3752/7871] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:50.909953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:50.910707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:50.917765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:50.918271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:50.919318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:50.920055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:50.920623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:50.921067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:51.061702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:51.069680 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8552303c-8330-4bc9-9ed0-6ad69397e9aa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1685 microversion: 2.1 time: 0.163721 Nov 02 14:24:51.070284 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4120/7872] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:50 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:52.099050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:52.099930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:52.107173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:52.107762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:52.108220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:52.109033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:52.109706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:52.110150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:52.335647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:52.343639 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-545a6e78-9caa-4329-8c9b-66ce70890ace tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1685 microversion: 2.1 time: 0.249767 Nov 02 14:24:52.344234 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3753/7873] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:52 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1685 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:53.367505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:53.369118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:53.371532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=33 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:53.376747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.377235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.377677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.378385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.378842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.379344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.382100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:53.527089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:53.535601 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-049c6b44-c9eb-43ae-924b-2d4b66d420fa tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1682 microversion: 2.1 time: 0.172113 Nov 02 14:24:53.536195 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4121/7874] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:53 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:53.558877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:53.559482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:53.562264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=29 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:53.567676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.568203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.568652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.569361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.569831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.570266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.573262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=83 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:24:53.611851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.612344 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.612793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.613524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.613995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.614433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.638442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:24:53.643803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for user 1ee11c6caa3a475b92ce013a5cdb239b and project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:24:53.750467 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ddbe6b9b-182a-405e-9f6f-01f84d063cc8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d/action" status: 202 len: 0 microversion: 2.1 time: 0.195182 Nov 02 14:24:53.753980 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3754/7875] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:24:53 2022] POST /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:24:53.759853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:53.760469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:53.766597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.767327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.767567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.768346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:53.768739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:53.769252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:53.914075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:53.923278 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d5d83533-7578-4e64-8016-f32f9b8d8a3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1681 microversion: 2.1 time: 0.167830 Nov 02 14:24:53.923913 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4122/7876] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:53 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:54.608573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f197b7db-65be-4f78-b62a-716760dd1239 req-44b3000a-f98b-428b-998d-cf226e503b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afdd153a-bd38-4e4b-9475-6fdee47eb75d", "name": "network-vif-plugged", "status": "completed", "tag": "f8e1b913-0e91-406c-b339-dee2895efee2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:54.619951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f197b7db-65be-4f78-b62a-716760dd1239 req-44b3000a-f98b-428b-998d-cf226e503b3d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:54.620448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f197b7db-65be-4f78-b62a-716760dd1239 req-44b3000a-f98b-428b-998d-cf226e503b3d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:54.620897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f197b7db-65be-4f78-b62a-716760dd1239 req-44b3000a-f98b-428b-998d-cf226e503b3d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:54.632763 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f197b7db-65be-4f78-b62a-716760dd1239 req-44b3000a-f98b-428b-998d-cf226e503b3d service nova] Creating event network-vif-plugged:f8e1b913-0e91-406c-b339-dee2895efee2 for instance afdd153a-bd38-4e4b-9475-6fdee47eb75d on n-h1-858384-19 Nov 02 14:24:54.638400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-f197b7db-65be-4f78-b62a-716760dd1239 req-44b3000a-f98b-428b-998d-cf226e503b3d service nova] Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:24:54.649042 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f197b7db-65be-4f78-b62a-716760dd1239 req-44b3000a-f98b-428b-998d-cf226e503b3d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103526 Nov 02 14:24:54.649866 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3755/7877] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:54.948036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:54.948638 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:54.956020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:54.956507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:54.956983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:54.957693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:54.958153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:54.958585 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:55.096288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:55.106632 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3e7a1eba-191a-413a-b7c8-198342af6585 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1681 microversion: 2.1 time: 0.161732 Nov 02 14:24:55.106632 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4123/7878] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:54 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:56.133284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:56.134903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:56.141336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:56.141843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:56.142563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:56.143012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:56.143526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:56.144001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:56.280360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:56.288181 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dcdaee58-88eb-4f3d-9aa4-3ebdad74f5f7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1681 microversion: 2.1 time: 0.160261 Nov 02 14:24:56.288756 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3756/7879] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:56 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:57.196866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-bf83b0c3-15a8-4f16-b250-1f3bdf462cb6 req-d74a1ef6-5cd8-40f8-8e1a-d58ce32b4acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afdd153a-bd38-4e4b-9475-6fdee47eb75d", "name": "network-vif-unplugged", "status": "completed", "tag": "f8e1b913-0e91-406c-b339-dee2895efee2"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:57.206888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bf83b0c3-15a8-4f16-b250-1f3bdf462cb6 req-d74a1ef6-5cd8-40f8-8e1a-d58ce32b4acb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:57.207620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bf83b0c3-15a8-4f16-b250-1f3bdf462cb6 req-d74a1ef6-5cd8-40f8-8e1a-d58ce32b4acb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:57.207859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-bf83b0c3-15a8-4f16-b250-1f3bdf462cb6 req-d74a1ef6-5cd8-40f8-8e1a-d58ce32b4acb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:57.221309 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-bf83b0c3-15a8-4f16-b250-1f3bdf462cb6 req-d74a1ef6-5cd8-40f8-8e1a-d58ce32b4acb service nova] Creating event network-vif-unplugged:f8e1b913-0e91-406c-b339-dee2895efee2 for instance afdd153a-bd38-4e4b-9475-6fdee47eb75d on n-h2-858384-19 Nov 02 14:24:57.226926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-bf83b0c3-15a8-4f16-b250-1f3bdf462cb6 req-d74a1ef6-5cd8-40f8-8e1a-d58ce32b4acb service nova] Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:24:57.238916 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-bf83b0c3-15a8-4f16-b250-1f3bdf462cb6 req-d74a1ef6-5cd8-40f8-8e1a-d58ce32b4acb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048060 Nov 02 14:24:57.239610 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4124/7880] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:57.313287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:57.313925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:57.322366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:57.322869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:57.323358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:57.324085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:57.324555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:57.324994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:57.468109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:57.476187 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63624f43-24aa-4ee6-b833-117da20a1ec7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1681 microversion: 2.1 time: 0.167337 Nov 02 14:24:57.477504 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3757/7881] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:57 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:58.502715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:58.503315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:58.510374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:58.510854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:58.511333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:58.512030 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:58.512485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:58.512916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:58.647706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:58.655745 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22d6e54c-746c-4f9a-80c4-80fe6394c62c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1681 microversion: 2.1 time: 0.158458 Nov 02 14:24:58.656338 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4125/7882] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:58 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:24:59.281031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d6733c07-1239-40f7-9ad3-26f348451f82 req-7a689651-f419-4db5-bd7e-e7b885967630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afdd153a-bd38-4e4b-9475-6fdee47eb75d", "tag": "f8e1b913-0e91-406c-b339-dee2895efee2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:24:59.292175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d6733c07-1239-40f7-9ad3-26f348451f82 req-7a689651-f419-4db5-bd7e-e7b885967630 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:59.292647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d6733c07-1239-40f7-9ad3-26f348451f82 req-7a689651-f419-4db5-bd7e-e7b885967630 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:59.293094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d6733c07-1239-40f7-9ad3-26f348451f82 req-7a689651-f419-4db5-bd7e-e7b885967630 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:59.304659 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d6733c07-1239-40f7-9ad3-26f348451f82 req-7a689651-f419-4db5-bd7e-e7b885967630 service nova] Creating event network-changed:f8e1b913-0e91-406c-b339-dee2895efee2 for instance afdd153a-bd38-4e4b-9475-6fdee47eb75d on n-h2-858384-19 Nov 02 14:24:59.310617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-d6733c07-1239-40f7-9ad3-26f348451f82 req-7a689651-f419-4db5-bd7e-e7b885967630 service nova] Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:24:59.322176 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d6733c07-1239-40f7-9ad3-26f348451f82 req-7a689651-f419-4db5-bd7e-e7b885967630 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044850 Nov 02 14:24:59.322818 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3758/7883] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:24:59.679492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:24:59.680179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:24:59.689383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:59.690042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:59.690324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:59.691055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:24:59.691559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:24:59.692002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:24:59.841646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:24:59.850256 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5e328771-c05a-4bd3-8537-e47262bdd0d5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1681 microversion: 2.1 time: 0.174737 Nov 02 14:24:59.851019 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4126/7884] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:24:59 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:00.881302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:00.882058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:00.888864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:00.889364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:00.889809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:00.890519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:00.890983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:00.891460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:01.028558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:01.036765 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-671e4a39-35cb-44f9-ac14-da68aa50af0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1681 microversion: 2.1 time: 0.160656 Nov 02 14:25:01.037375 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3759/7885] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:00 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:02.060284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:02.060905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:02.067893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.068353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.068803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.069510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.069990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.070467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.205152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:02.213610 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-157be5c7-f891-42c3-966f-efc81611b739 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1674 microversion: 2.1 time: 0.157314 Nov 02 14:25:02.214199 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4127/7886] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:02 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:02.236529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:02.237183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:02.244026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.244515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.244961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.245662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.246124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.246567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.381515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:02.390156 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2671799f-b9d8-4975-a7b1-71a14758ce84 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1674 microversion: 2.1 time: 0.157887 Nov 02 14:25:02.390738 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3760/7887] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:02 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:02.412925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:02.413535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:02.419711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.420198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.420642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.421337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.421793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.422229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.562655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:02.571310 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0fd4d235-0c85-466d-986d-2ae4fb88e4ab tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1674 microversion: 2.1 time: 0.161474 Nov 02 14:25:02.571948 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4128/7888] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:02 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:02.594527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:02.594954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:02.601038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.601569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.602021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.602718 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.603224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.603665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.630178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:25:02.706118 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-35172e6a-3251-43da-a5f5-e7d02abed511 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "DELETE /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 204 len: 0 microversion: 2.1 time: 0.115424 Nov 02 14:25:02.706765 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3761/7889] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:25:02 2022] DELETE /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:25:02.715652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:02.716300 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:02.722307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.722795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.723274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.723977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:02.724437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:02.724872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:02.859014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:02.866796 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e1ac1b5e-433c-44f3-b587-baf49c52863f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1680 microversion: 2.1 time: 0.155070 Nov 02 14:25:02.867403 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4129/7890] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:02 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:03.892416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:03.893132 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:03.895942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:03.901569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:03.902068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:03.902520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:03.903265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:03.903737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:03.904180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:04.042781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:04.052853 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-56683981-8762-4d4b-86ca-e70086f2a332 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1680 microversion: 2.1 time: 0.164607 Nov 02 14:25:04.053625 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3762/7891] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:03 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:05.079061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:05.079787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:05.087064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:05.087313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:05.087744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:05.089325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:05.090368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:05.091762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:05.182973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:05.203948 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5cf121d4-b3f0-4184-8421-b0ef5e23819c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 200 len: 1612 microversion: 2.1 time: 0.129431 Nov 02 14:25:05.204655 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4130/7892] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:05 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 1612 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:05.303421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-367ae7a6-415b-48d4-88fe-7472f3e8cf1f req-8417e9fe-3629-40e3-ba2c-24f70c381ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afdd153a-bd38-4e4b-9475-6fdee47eb75d", "name": "network-vif-deleted", "tag": "f8e1b913-0e91-406c-b339-dee2895efee2"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:05.317164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-367ae7a6-415b-48d4-88fe-7472f3e8cf1f req-8417e9fe-3629-40e3-ba2c-24f70c381ea0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:05.317662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-367ae7a6-415b-48d4-88fe-7472f3e8cf1f req-8417e9fe-3629-40e3-ba2c-24f70c381ea0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:05.318303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-367ae7a6-415b-48d4-88fe-7472f3e8cf1f req-8417e9fe-3629-40e3-ba2c-24f70c381ea0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:05.334134 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-367ae7a6-415b-48d4-88fe-7472f3e8cf1f req-8417e9fe-3629-40e3-ba2c-24f70c381ea0 service nova] Creating event network-vif-deleted:f8e1b913-0e91-406c-b339-dee2895efee2 for instance afdd153a-bd38-4e4b-9475-6fdee47eb75d on n-h2-858384-19 Nov 02 14:25:05.340502 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-367ae7a6-415b-48d4-88fe-7472f3e8cf1f req-8417e9fe-3629-40e3-ba2c-24f70c381ea0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041665 Nov 02 14:25:05.341375 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3763/7893] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:25:06.230740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:06.231476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:06.238614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:06.239163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:06.239598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:06.240320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:06.240787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:06.241226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:06.256342 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d HTTP/1.1 Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'afdd153a-bd38-4e4b-9475-6fdee47eb75d'} Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:25:06.258764 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.264570 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:06.264570 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:25:06.264570 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:25:06.264570 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:25:06.264570 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:25:06.264570 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.264570 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.264570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:25:06.264570 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fa982365-02d2-4b2b-99f2-db221490fd7d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 404 len: 111 microversion: 2.1 time: 0.038475 Nov 02 14:25:06.265860 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4131/7894] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:06 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:25:06.281738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:06.282577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:06.289691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:06.290312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:06.290759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:06.291509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:06.291984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:06.292433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:06.310744 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d HTTP/1.1 Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'afdd153a-bd38-4e4b-9475-6fdee47eb75d'} Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:25:06.312482 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-931e4aa6-4df9-4608-8316-3fcb66bdb3ac tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 404 len: 111 microversion: 2.1 time: 0.036652 Nov 02 14:25:06.316649 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3764/7895] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:06 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:25:06.366631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1263709373", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "7ab4ea58-3844-4180-a1e3-f0933a456e95"}], "security_groups": [{"name": "tempest-securitygroup--1749494928"}], "key_name": "tempest-keypair-1433767863", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:06.479321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] validate_networks() for [('7ab4ea58-3844-4180-a1e3-f0933a456e95', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:25:06.901398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:25:06.901826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:25:06.902305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:25:06.902776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:25:06.903214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:25:06.912185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:06.912695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:06.913152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:06.913915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:06.914490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:06.914926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:06.931932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:25:06.937348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for user 1ee11c6caa3a475b92ce013a5cdb239b and project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:25:06.950312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:25:06.952648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:25:07.000636 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dd8a5435-1119-4483-882e-178296e8ab40 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.637997 Nov 02 14:25:07.001303 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4132/7896] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:25:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:25:07.013908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f44c0a4b-c5f4-4b27-b71a-6fcc473dbd86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:07.014543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f44c0a4b-c5f4-4b27-b71a-6fcc473dbd86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:07.071728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f44c0a4b-c5f4-4b27-b71a-6fcc473dbd86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:07.079663 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f44c0a4b-c5f4-4b27-b71a-6fcc473dbd86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1243 microversion: 2.1 time: 0.069643 Nov 02 14:25:07.080239 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3765/7897] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:07 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1243 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:08.107140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:08.107931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:08.115664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:08.116505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:08.117116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:08.118240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:08.118885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:08.119562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:08.192475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:08.201305 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a1c85672-f28a-4b5b-848e-3d22ff605c67 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1301 microversion: 2.1 time: 0.100715 Nov 02 14:25:08.201906 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4133/7898] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:08 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:09.225694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:09.226574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:09.234353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:09.234851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:09.235379 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:09.236105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:09.236581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:09.237017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:09.378753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:09.387469 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a2ea2ac9-c801-4f2f-9bb1-5fea2b2116dd tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1369 microversion: 2.1 time: 0.165510 Nov 02 14:25:09.387988 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3766/7899] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:09 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:09.804635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3eaaefed-f41a-4592-9e72-3663ca5aeeb2 req-547e5cc3-0575-4a0d-ab5e-2ff24f8dfab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:09.815935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3eaaefed-f41a-4592-9e72-3663ca5aeeb2 req-547e5cc3-0575-4a0d-ab5e-2ff24f8dfab0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:09.816427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3eaaefed-f41a-4592-9e72-3663ca5aeeb2 req-547e5cc3-0575-4a0d-ab5e-2ff24f8dfab0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:09.816874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3eaaefed-f41a-4592-9e72-3663ca5aeeb2 req-547e5cc3-0575-4a0d-ab5e-2ff24f8dfab0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:09.829311 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3eaaefed-f41a-4592-9e72-3663ca5aeeb2 req-547e5cc3-0575-4a0d-ab5e-2ff24f8dfab0 service nova] Creating event network-changed:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h2-858384-19 Nov 02 14:25:09.834402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3eaaefed-f41a-4592-9e72-3663ca5aeeb2 req-547e5cc3-0575-4a0d-ab5e-2ff24f8dfab0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033917 Nov 02 14:25:09.835017 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4134/7900] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:25:10.410904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:10.411570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:10.419393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:10.419900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:10.420360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:10.421084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:10.421560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:10.422007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:10.558443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:10.566400 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38895394-fad4-4dfd-b0f6-e9c48f2bd984 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1369 microversion: 2.1 time: 0.159470 Nov 02 14:25:10.566977 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3767/7901] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:10 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:11.592406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:11.593122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:11.599737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:11.600228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:11.600669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:11.602369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:11.602832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:11.603333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:11.735757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:11.744211 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b5e1bcc4-64fb-4fcb-b521-87fb3a9b3e3b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1369 microversion: 2.1 time: 0.157620 Nov 02 14:25:11.744801 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4135/7902] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:11 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:12.768752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:12.769383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:12.777317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:12.777826 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:12.778285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:12.779039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:12.779542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:12.779990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:12.914660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:12.922862 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6e6c3d4d-574d-461f-8627-21ff6b0d571b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1369 microversion: 2.1 time: 0.158034 Nov 02 14:25:12.923488 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3768/7903] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:12 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:13.947660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:13.948432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:13.955378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:13.955853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:13.956296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:13.957007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:13.957463 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:13.957896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:14.092364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:14.100228 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e371e3de-da53-4739-9063-a58e1f6325c1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1369 microversion: 2.1 time: 0.156765 Nov 02 14:25:14.100822 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4136/7904] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:13 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:15.113047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-06b83c70-ac47-41b4-8498-ee79c6b59536 req-cd469cf7-94f6-4156-bbf9-253a3b0aa990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "name": "network-vif-plugged", "status": "completed", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:15.125292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:15.126185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:15.131065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-06b83c70-ac47-41b4-8498-ee79c6b59536 req-cd469cf7-94f6-4156-bbf9-253a3b0aa990 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:15.131739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-06b83c70-ac47-41b4-8498-ee79c6b59536 req-cd469cf7-94f6-4156-bbf9-253a3b0aa990 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:15.132225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-06b83c70-ac47-41b4-8498-ee79c6b59536 req-cd469cf7-94f6-4156-bbf9-253a3b0aa990 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:15.136199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:15.137529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:15.137680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:15.137789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:15.137901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:15.138447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:15.138771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:15.144937 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-06b83c70-ac47-41b4-8498-ee79c6b59536 req-cd469cf7-94f6-4156-bbf9-253a3b0aa990 service nova] Creating event network-vif-plugged:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h2-858384-19 Nov 02 14:25:15.151987 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-06b83c70-ac47-41b4-8498-ee79c6b59536 req-cd469cf7-94f6-4156-bbf9-253a3b0aa990 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042822 Nov 02 14:25:15.152908 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3769/7905] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:25:15.337498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:15.345502 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7482d1e6-0a39-441e-8cee-51eb9da92b10 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1369 microversion: 2.1 time: 0.224331 Nov 02 14:25:15.346093 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4137/7906] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:15 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1369 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:25:16.372570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:16.373308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:16.380516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:16.381010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:16.381458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:16.382662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:16.383154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:16.383599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:16.840268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:16.847988 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2301dad5-0735-49f1-b33d-ca5c21cf20c9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1369 microversion: 2.1 time: 0.481047 Nov 02 14:25:16.848566 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3770/7907] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:16 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1369 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:17.872979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:17.873605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:17.876445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:17.877262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:17.883830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:17.884325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:17.884783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:17.885530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:17.886332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:17.886831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:18.050229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:25:18.059219 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b47d79e-01a9-4b09-ba6b-14050549a7cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1556 microversion: 2.1 time: 0.190215 Nov 02 14:25:18.059813 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4138/7908] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:25:17 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:25:18.084140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5d079642-beb6-4082-8aa3-b03dc341f6a7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:25:18.084735 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5d079642-beb6-4082-8aa3-b03dc341f6a7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:25:18.087401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:25:18.094848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d079642-beb6-4082-8aa3-b03dc341f6a7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:18.095380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d079642-beb6-4082-8aa3-b03dc341f6a7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:18.095832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d079642-beb6-4082-8aa3-b03dc341f6a7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:18.096548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d079642-beb6-4082-8aa3-b03dc341f6a7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:18.097007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d079642-beb6-4082-8aa3-b03dc341f6a7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:18.097440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d079642-beb6-4082-8aa3-b03dc341f6a7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:18.187249 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5d079642-beb6-4082-8aa3-b03dc341f6a7 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107028 Nov 02 14:25:18.187874 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3771/7909] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 14:25:18 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:25:19.189831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8add7db0-e635-4245-b3de-094c9f4e063e req-bff104b7-be7d-48a6-8456-613f6703c59e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:25:19.201075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8add7db0-e635-4245-b3de-094c9f4e063e req-bff104b7-be7d-48a6-8456-613f6703c59e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:25:19.201564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8add7db0-e635-4245-b3de-094c9f4e063e req-bff104b7-be7d-48a6-8456-613f6703c59e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:25:19.201991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8add7db0-e635-4245-b3de-094c9f4e063e req-bff104b7-be7d-48a6-8456-613f6703c59e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:25:19.213349 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8add7db0-e635-4245-b3de-094c9f4e063e req-bff104b7-be7d-48a6-8456-613f6703c59e service nova] Creating event network-changed:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h2-858384-19 Nov 02 14:25:19.218492 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8add7db0-e635-4245-b3de-094c9f4e063e req-bff104b7-be7d-48a6-8456-613f6703c59e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032463 Nov 02 14:25:19.219513 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4139/7910] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:26:33.258047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:33.259005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=11 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:33.260001 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:26:33.260137 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 (ip 10.222.0.113) !!! Nov 02 14:26:33.261210 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:26:33.261322 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 (ip 10.222.0.113) !!! Nov 02 14:26:33.267271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:33.267907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:33.281503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:33.282008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:33.282461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:33.283208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:33.283685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:33.284130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:33.427851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:33.435886 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7c13b7ab-d5d2-4136-95a2-cd4958bd3ff2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1675 microversion: 2.1 time: 0.181388 Nov 02 14:26:33.436474 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3772/7911] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:33 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:33.459907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:33.460711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:33.461730 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:26:33.461876 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/os-volume_attachments (ip 10.222.0.113) !!! Nov 02 14:26:33.468305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-55f1f7b2-d7c1-492b-ba45-35d8e4d2af66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f44814f-ea89-4284-98ae-603c3ccd2b77"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:33.470609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-55f1f7b2-d7c1-492b-ba45-35d8e4d2af66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:33.480442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55f1f7b2-d7c1-492b-ba45-35d8e4d2af66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:33.480932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55f1f7b2-d7c1-492b-ba45-35d8e4d2af66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:33.481383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55f1f7b2-d7c1-492b-ba45-35d8e4d2af66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:33.482101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55f1f7b2-d7c1-492b-ba45-35d8e4d2af66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:33.482565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55f1f7b2-d7c1-492b-ba45-35d8e4d2af66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:33.483001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-55f1f7b2-d7c1-492b-ba45-35d8e4d2af66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:33.731092 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-55f1f7b2-d7c1-492b-ba45-35d8e4d2af66 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274099 Nov 02 14:26:33.731782 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4140/7912] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 14:26:33 2022] POST /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:26:45.538717 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:26:45.541013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:45.543493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:45.544179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:45.549849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:45.550366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:45.550825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:45.552696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:45.553190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:45.553643 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:45.637101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:45.643400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Old instance type m1.heat2, new instance type m1.heat {{(pid=120929) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:26:45.650701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:26:45.651162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:26:45.651661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:26:45.652088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:26:45.652516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:26:45.718673 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3cd4bdca-0952-44ad-aa8f-2827e13f536a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/action" status: 202 len: 0 microversion: 2.1 time: 0.184719 Nov 02 14:26:45.722196 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3773/7913] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:26:45 2022] POST /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:26:45.727056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:45.727869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:26:45.732370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:45.733225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:45.742247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:45.742746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:45.743236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:45.743949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:45.744424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:45.744855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:45.884916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:45.893632 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b8e4fee8-cd33-4862-9487-5ed19d9732fc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1730 microversion: 2.1 time: 0.168492 Nov 02 14:26:45.894386 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4141/7914] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:45 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:46.918339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:46.918895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:46.925694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:46.926186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:46.927171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:46.928008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:46.928337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:46.928773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:47.072391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:47.080891 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d663319a-e5ba-49fc-b002-bee5d4a98137 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1730 microversion: 2.1 time: 0.167534 Nov 02 14:26:47.081474 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3774/7915] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:46 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:48.106162 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:48.106774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:48.113653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:48.114176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:48.114613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:48.115886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:48.116341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:48.116767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:48.262408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:48.271635 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c86bbc75-360e-4dcc-8f26-e11b2b950ede tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1730 microversion: 2.1 time: 0.169700 Nov 02 14:26:48.272257 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4142/7916] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:48 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:49.296333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:49.296957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:49.304048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:49.304545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:49.304997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:49.305709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:49.306175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:49.306617 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:49.441268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:49.450848 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6c6ca0c6-4eb1-47dd-a359-f3c96183840b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1730 microversion: 2.1 time: 0.158571 Nov 02 14:26:49.451682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3775/7917] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:49 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:50.479264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:50.480190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:50.487446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:50.487942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:50.488388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:50.489696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:50.490263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:50.490711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:50.641280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:50.649776 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc302724-b2a5-4d7f-bc88-454e38420c7a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1730 microversion: 2.1 time: 0.175373 Nov 02 14:26:50.650487 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4143/7918] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:50 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:51.674850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:51.675545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:51.683920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:51.684421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:51.684876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:51.685601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:51.686070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:51.686514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:51.824637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:51.833330 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20eff39b-5511-491e-aad4-46b817768ea1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1730 microversion: 2.1 time: 0.162957 Nov 02 14:26:51.833912 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3776/7919] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:51 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:52.857877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:52.858622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:52.865951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:52.866530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:52.867070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:52.867886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:52.868417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:52.868923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:53.005650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:53.014341 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-670f6c39-249f-42af-81cc-05c1e6796b0d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.160762 Nov 02 14:26:53.015037 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4144/7920] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:52 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:54.038925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:54.039592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:54.046473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:54.046979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:54.047469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:54.048189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:54.048663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:54.049110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:54.188001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:54.197079 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-98e71331-a835-4daf-8269-f69da1a36c3f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.163159 Nov 02 14:26:54.197668 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3777/7921] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:54 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:55.221947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:55.222568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:55.230374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:55.230867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:55.231351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:55.232063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:55.232527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:55.232977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:55.372777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:55.381399 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3aa784e6-6769-4156-a1d5-da79ed1bdf0b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.163428 Nov 02 14:26:55.381995 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4145/7922] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:55 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:56.405016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:56.405637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:56.413301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:56.413794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:56.414238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:56.414941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:56.415434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:56.415872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:56.550170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:56.559103 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83777e9b-f37b-4d5d-9081-cfab24325528 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.157996 Nov 02 14:26:56.559709 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3778/7923] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:56 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:57.584223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:57.584223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:57.593125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:57.593125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:57.593125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:57.593835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:57.594298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:57.594755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:57.729126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:57.737758 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3861c89d-ea25-469d-9504-acdbb89650cb tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.158257 Nov 02 14:26:57.738359 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4146/7924] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:57 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:58.761348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:58.761980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:58.769044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:58.769547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:58.771181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:58.771909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:58.772424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:58.772875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:58.913167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:26:58.921503 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c6ecc51f-6201-4ce1-964c-87573f41904d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.164081 Nov 02 14:26:58.922078 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3779/7925] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:58 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:26:59.944804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:26:59.945409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:26:59.952288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:59.952778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:59.953224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:26:59.953930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:26:59.954389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:26:59.954826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:00.093067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:00.101721 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a80282da-1188-4b06-be45-4d3675969fce tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.161495 Nov 02 14:27:00.102325 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4147/7926] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:26:59 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:01.125925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:01.126544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:01.133601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:01.134093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:01.134540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:01.135268 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:01.135764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:01.136198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:01.267847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:01.276505 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17ccfa29-efaf-408c-9d11-7a7b324d3cf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.154499 Nov 02 14:27:01.277093 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3780/7927] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:01 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:02.300571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:02.301196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:02.308056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:02.308544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:02.308984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:02.309681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:02.310133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:02.310559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:02.449905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:02.459586 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74b12af0-be05-497a-833a-3253cb89a912 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.162948 Nov 02 14:27:02.460191 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4148/7928] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:02 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:03.484572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:03.485185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:03.493266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:03.493765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:03.494214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:03.494927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:03.495427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:03.495871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:03.630033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:03.638752 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94e06249-fb04-418b-a8fc-87683868b433 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.158374 Nov 02 14:27:03.639358 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3781/7929] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:03 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:04.662771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:04.663396 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:04.670237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:04.670719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:04.671182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:04.671886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:04.672341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:04.672769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:04.804827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:04.813144 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4ea98483-78c4-4429-ad61-f6e326ee3559 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.154990 Nov 02 14:27:04.813731 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4149/7930] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:04 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:05.836337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:05.836920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:05.843943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:05.844437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:05.844886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:05.845598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:05.846867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:05.847489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:05.988932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:05.997399 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1cbaec5b-f544-4129-b211-dfbf600bc8e9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.165118 Nov 02 14:27:05.997984 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3782/7931] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:05 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:07.020992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:07.021545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:07.028344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:07.028820 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:07.029256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:07.029950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:07.030401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:07.030828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:07.170116 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:07.179276 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e8768cf9-38da-4e2d-a822-4ced11e5c54c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.162246 Nov 02 14:27:07.179872 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4150/7932] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:07 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:08.202956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:08.203612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:08.211189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:08.211685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:08.212130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:08.212835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:08.213303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:08.213738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:08.352125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:08.360892 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8fcc986c-c434-4dc8-9e1d-e4f8f167c0bc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.161893 Nov 02 14:27:08.361497 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3783/7933] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:08 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:09.386287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:09.386819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:09.394039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:09.394541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:09.395748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:09.396478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:09.396945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:09.397390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:09.532076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:09.541109 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06e9602e-ad2d-436f-8c73-dd47d8b86d2d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.158855 Nov 02 14:27:09.541703 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4151/7934] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:09 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:10.564864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:10.565496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:10.572444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:10.572952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:10.573409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:10.574163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:10.574636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:10.575082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:10.722403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:10.732773 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-470dee0b-f70d-4f42-8695-8f682cf2185c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1735 microversion: 2.1 time: 0.171771 Nov 02 14:27:10.733386 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3784/7935] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:10 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:11.492682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-ee533002-c834-4fe0-9cb3-29626958e7d6 req-a6f5209e-c48d-4536-bb1d-32e5004473aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "name": "network-vif-unplugged", "status": "completed", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:11.503695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ee533002-c834-4fe0-9cb3-29626958e7d6 req-a6f5209e-c48d-4536-bb1d-32e5004473aa service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:11.504763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ee533002-c834-4fe0-9cb3-29626958e7d6 req-a6f5209e-c48d-4536-bb1d-32e5004473aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:11.505250 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-ee533002-c834-4fe0-9cb3-29626958e7d6 req-a6f5209e-c48d-4536-bb1d-32e5004473aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:11.517885 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-ee533002-c834-4fe0-9cb3-29626958e7d6 req-a6f5209e-c48d-4536-bb1d-32e5004473aa service nova] Creating event network-vif-unplugged:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h1-858384-19 Nov 02 14:27:11.523589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-ee533002-c834-4fe0-9cb3-29626958e7d6 req-a6f5209e-c48d-4536-bb1d-32e5004473aa service nova] Instance 179296bd-5895-4e0a-8fd7-a961315f9839 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:27:11.536664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-ee533002-c834-4fe0-9cb3-29626958e7d6 req-a6f5209e-c48d-4536-bb1d-32e5004473aa service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048115 Nov 02 14:27:11.537409 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4152/7936] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:27:11.756067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:11.756624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:11.763685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:11.764193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:11.764653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:11.765649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:11.766129 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:11.766578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:11.956682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:11.965856 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-06af3030-0f68-46e5-aa3a-2b60c908f3cf tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1734 microversion: 2.1 time: 0.213879 Nov 02 14:27:11.966440 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3785/7937] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:11 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:12.993217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:12.993814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:13.000223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:13.000718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:13.001171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:13.001890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:13.002354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:13.002808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:13.146092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:13.154971 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b9ef4da9-17f6-402f-b31d-0abb32a6e310 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.167689 Nov 02 14:27:13.155603 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4153/7938] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:12 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:13.574665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6eed6620-d552-4756-9144-0a5d0648997f req-35af2003-9495-49f1-ae54-f6be703d7e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:13.585786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6eed6620-d552-4756-9144-0a5d0648997f req-35af2003-9495-49f1-ae54-f6be703d7e97 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:13.586287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6eed6620-d552-4756-9144-0a5d0648997f req-35af2003-9495-49f1-ae54-f6be703d7e97 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:13.586738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6eed6620-d552-4756-9144-0a5d0648997f req-35af2003-9495-49f1-ae54-f6be703d7e97 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:13.601088 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6eed6620-d552-4756-9144-0a5d0648997f req-35af2003-9495-49f1-ae54-f6be703d7e97 service nova] Creating event network-changed:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h1-858384-19 Nov 02 14:27:13.608575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-6eed6620-d552-4756-9144-0a5d0648997f req-35af2003-9495-49f1-ae54-f6be703d7e97 service nova] Instance 179296bd-5895-4e0a-8fd7-a961315f9839 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:27:13.620943 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6eed6620-d552-4756-9144-0a5d0648997f req-35af2003-9495-49f1-ae54-f6be703d7e97 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049944 Nov 02 14:27:13.621575 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3786/7939] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:27:14.183418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:14.185425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:14.194920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:14.195464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:14.195913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:14.196637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:14.197097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:14.197531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:14.336171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:14.345078 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16d7de23-1cb3-40b1-9166-8adaab76f38b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.167948 Nov 02 14:27:14.345664 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4154/7940] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:14 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:15.370111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:15.370831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:15.378904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:15.379441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:15.379895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:15.380628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:15.381096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:15.381541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:15.524297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:15.537300 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05f5cbe8-8cf5-4bc2-9c2c-5b9b684e83ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.171443 Nov 02 14:27:15.538008 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3787/7941] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:15 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:16.562179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:16.562810 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:16.565191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=29 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:16.571714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:16.572218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:16.572665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:16.573388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:16.573850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:16.574285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:16.577512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=83 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:16.723715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:16.732791 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-920db464-5e3a-4f80-a975-c0248ac9fbf2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.174720 Nov 02 14:27:16.733663 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4155/7942] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:16 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:17.756842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:17.757401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:17.760168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=35 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:17.765612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:17.766104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:17.766577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:17.767322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:17.767790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:17.768227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:17.771208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:17.902081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:17.910840 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8651a06c-d059-488a-bc7f-5d379750a594 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.158103 Nov 02 14:27:17.911465 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3788/7943] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:17 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:18.934986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:18.935582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:18.943211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:18.943960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:18.944403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:18.945106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:18.945567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:18.945995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:19.080788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:19.089796 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e93b1c38-ac93-4960-acec-9b9bfedcbf21 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.159001 Nov 02 14:27:19.090377 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4156/7944] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:18 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:20.114752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:20.115399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:20.122403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:20.122907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:20.123392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:20.124103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:20.124572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:20.125013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:20.257334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:20.265627 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bfba0370-e513-4125-89cb-6f7da3df4b8d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.155509 Nov 02 14:27:20.266202 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3789/7945] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:20 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:21.289973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:21.290838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:21.300031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:21.300528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:21.301481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:21.302298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:21.302758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:21.303238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:21.486857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:21.496586 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1a2732b7-3de4-4e0a-a8aa-491941883773 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.210636 Nov 02 14:27:21.497210 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4157/7946] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:21 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:22.521552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:22.522187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:22.529176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:22.529678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:22.530134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:22.530853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:22.531458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:22.532057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:22.670882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:22.681302 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5f53d5cb-a3ab-4c58-b889-0315c25a06ca tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.164716 Nov 02 14:27:22.681902 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3790/7947] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:22 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:23.708593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:23.709213 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:23.716257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:23.716747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:23.717199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:23.717912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:23.718374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:23.718822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:23.854138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:23.863035 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c1157542-c966-4dcb-a6d3-7ff140e4e6f1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.159714 Nov 02 14:27:23.863936 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4158/7948] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:23 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:24.887205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:24.887748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:24.895236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:24.895739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:24.896198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:24.896902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:24.897370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:24.897818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:25.031156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:25.040756 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-85081e82-0b03-43d2-aea5-bfa2ceb91f86 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.157580 Nov 02 14:27:25.041355 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3791/7949] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:24 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:26.065051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:26.065606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:26.072858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:26.073349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:26.073830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:26.074539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:26.075013 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:26.075479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:26.213063 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:26.223288 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b1910259-f455-4ea0-a74c-166992e57bf0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1732 microversion: 2.1 time: 0.161509 Nov 02 14:27:26.224463 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4159/7950] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:26 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:27.221174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a4fb96f0-53cc-48bd-bb66-f396fb63f3fe req-a6b093ec-09ee-459b-9aa7-81a37d6625cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "name": "network-vif-plugged", "status": "completed", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:27.232662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a4fb96f0-53cc-48bd-bb66-f396fb63f3fe req-a6b093ec-09ee-459b-9aa7-81a37d6625cf service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.232881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a4fb96f0-53cc-48bd-bb66-f396fb63f3fe req-a6b093ec-09ee-459b-9aa7-81a37d6625cf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.233287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a4fb96f0-53cc-48bd-bb66-f396fb63f3fe req-a6b093ec-09ee-459b-9aa7-81a37d6625cf service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.246259 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a4fb96f0-53cc-48bd-bb66-f396fb63f3fe req-a6b093ec-09ee-459b-9aa7-81a37d6625cf service nova] Creating event network-vif-plugged:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h1-858384-19 Nov 02 14:27:27.248405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:27.249098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:27.252702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-a4fb96f0-53cc-48bd-bb66-f396fb63f3fe req-a6b093ec-09ee-459b-9aa7-81a37d6625cf service nova] Instance 179296bd-5895-4e0a-8fd7-a961315f9839 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:27:27.257530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.258027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.258671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.260269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.260961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.261598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.264436 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a4fb96f0-53cc-48bd-bb66-f396fb63f3fe req-a6b093ec-09ee-459b-9aa7-81a37d6625cf service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047085 Nov 02 14:27:27.265049 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3792/7951] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:27:27.403841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:27.412749 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a8fe099-bcb1-4b05-8a09-8e979274d12e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1729 microversion: 2.1 time: 0.168282 Nov 02 14:27:27.413349 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4160/7952] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:27 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:27:27.437084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:27.437823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:27.445010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.445510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.445958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.446805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.447382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.447819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.486890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.487398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.487845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.488664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.489125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.489561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.510250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:27:27.515448 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Getting quotas for user 1ee11c6caa3a475b92ce013a5cdb239b and project d73c797573fa4bbe9e5ee8afb7ced9c0. Resources: {'ram', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:27:27.621285 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6b1cae4c-d878-4a3d-962b-316dc7555b2a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "POST /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/action" status: 202 len: 0 microversion: 2.1 time: 0.188443 Nov 02 14:27:27.621807 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3793/7953] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:27:27 2022] POST /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:27:27.630744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:27.631510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:27.637737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.638322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.638855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.639613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:27.640159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:27.640606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:27.779830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:27.789296 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c0ce72a3-7b30-445c-bbc5-135854380b75 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.163020 Nov 02 14:27:27.789881 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4161/7954] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:27 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:28.815196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:28.815832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:28.823150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:28.823653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:28.824107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:28.824849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:28.825334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:28.825763 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:28.963097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:28.971649 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b99c0c29-181f-49e1-b712-cc766972228b tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.161720 Nov 02 14:27:28.972227 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3794/7955] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:28 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:29.996076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:29.996636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:30.003446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:30.003976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:30.004523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:30.005232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:30.005687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:30.006120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:30.146221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:30.154734 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-02017ec1-2dc2-4189-bf20-cfbfd5eb4c5e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.162742 Nov 02 14:27:30.155344 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4162/7956] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:29 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:31.179800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:31.180437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:31.188030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:31.188536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:31.188999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:31.189723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:31.190196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:31.190642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:31.335787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:31.344311 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4c9fd1a3-c913-47f8-a237-158b9ed9cbf6 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.169260 Nov 02 14:27:31.344919 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3795/7957] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:31 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:32.427282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:32.428207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:32.434994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:32.435573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:32.436020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:32.436735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:32.437201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:32.437637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:32.580613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:32.589831 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a4c30474-ef8f-4dff-a58e-45a2bc45c09a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.167139 Nov 02 14:27:32.590417 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4163/7958] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:32 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:33.535356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f1b3c4e0-c935-4860-9483-2b0724e74367 req-b460b022-6203-4ea9-8222-e916f4796118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "name": "network-vif-unplugged", "status": "completed", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:33.546205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f1b3c4e0-c935-4860-9483-2b0724e74367 req-b460b022-6203-4ea9-8222-e916f4796118 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:33.546692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f1b3c4e0-c935-4860-9483-2b0724e74367 req-b460b022-6203-4ea9-8222-e916f4796118 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:33.547152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f1b3c4e0-c935-4860-9483-2b0724e74367 req-b460b022-6203-4ea9-8222-e916f4796118 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:33.563322 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f1b3c4e0-c935-4860-9483-2b0724e74367 req-b460b022-6203-4ea9-8222-e916f4796118 service nova] Creating event network-vif-unplugged:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h2-858384-19 Nov 02 14:27:33.569152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-f1b3c4e0-c935-4860-9483-2b0724e74367 req-b460b022-6203-4ea9-8222-e916f4796118 service nova] Instance 179296bd-5895-4e0a-8fd7-a961315f9839 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:27:33.581296 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f1b3c4e0-c935-4860-9483-2b0724e74367 req-b460b022-6203-4ea9-8222-e916f4796118 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108828 Nov 02 14:27:33.582691 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3796/7959] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:27:33.615680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:33.616334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:33.623277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:33.623767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:33.624209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:33.624914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:33.625368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:33.625799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:33.857350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:33.866920 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8d170c4-601a-4a0e-8c58-eef5866d7a74 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.255832 Nov 02 14:27:33.867638 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4164/7960] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:33 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:34.891824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:34.892437 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:34.899606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:34.900110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:34.900569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:34.901329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:34.901778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:34.902222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:35.038381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:35.046950 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8628c061-1856-43b5-b84e-75d68b4c992c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.160512 Nov 02 14:27:35.047808 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3797/7961] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:34 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:35.597227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9473fcae-0181-4ff2-8992-7820da0adc63 req-93db2b39-1fd7-4b25-8f96-a073d56647ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:35.609315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9473fcae-0181-4ff2-8992-7820da0adc63 req-93db2b39-1fd7-4b25-8f96-a073d56647ab service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:35.609794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9473fcae-0181-4ff2-8992-7820da0adc63 req-93db2b39-1fd7-4b25-8f96-a073d56647ab service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:35.610233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9473fcae-0181-4ff2-8992-7820da0adc63 req-93db2b39-1fd7-4b25-8f96-a073d56647ab service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:35.622518 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9473fcae-0181-4ff2-8992-7820da0adc63 req-93db2b39-1fd7-4b25-8f96-a073d56647ab service nova] Creating event network-changed:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h2-858384-19 Nov 02 14:27:35.629691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [req-9473fcae-0181-4ff2-8992-7820da0adc63 req-93db2b39-1fd7-4b25-8f96-a073d56647ab service nova] Instance 179296bd-5895-4e0a-8fd7-a961315f9839 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120928) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:27:35.640920 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9473fcae-0181-4ff2-8992-7820da0adc63 req-93db2b39-1fd7-4b25-8f96-a073d56647ab service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047438 Nov 02 14:27:35.641631 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4165/7962] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:27:36.072859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:36.074117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:36.083291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:36.084798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:36.085013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:36.085758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:36.086749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:36.087308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:36.315189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:36.325293 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-34f4b087-d868-4379-b6ff-ed28c8a296f2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.256730 Nov 02 14:27:36.325972 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3798/7963] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:36 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:27:37.350967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:37.351694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:37.358349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:37.358835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:37.359304 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:37.360016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:37.360620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:37.361060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:37.497296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:37.506272 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8d1f032d-e5a7-448a-b1ce-716896cf9e97 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.161211 Nov 02 14:27:37.506869 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4166/7964] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:37 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:38.530025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:38.531351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:38.534597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:38.541136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:38.541634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:38.542083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:38.542830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:38.543329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:38.543770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:38.685460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:38.694724 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af7f91fa-60be-42eb-9da4-e4e4d9ba2a79 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.168675 Nov 02 14:27:38.695973 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3799/7965] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:38 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:39.720038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:39.720658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:39.728185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:39.728675 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:39.729118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:39.729833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:39.730550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:39.730996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:39.868179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:39.876746 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5fcd3273-3382-4826-ac01-3fe891f3dca1 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.160757 Nov 02 14:27:39.877360 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4167/7966] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:39 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:40.901380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:40.901935 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:40.908556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:40.909052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:40.909529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:40.910871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:40.911358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:40.911794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:41.044549 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:41.053907 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d85cba7-135a-4502-931d-91450393cf2e tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.156719 Nov 02 14:27:41.054501 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3800/7967] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:40 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:42.077363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:42.077989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:42.085847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:42.086341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:42.086785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:42.087523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:42.087985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:42.088424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:42.228565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:42.237471 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1ac697b2-598d-4e80-90ad-288fb4476a41 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.164105 Nov 02 14:27:42.238069 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4168/7968] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:42 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:43.261203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:43.261733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:43.270380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:43.270884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:43.271366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:43.272082 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:43.272542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:43.272975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:43.407869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:43.416970 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-41281f22-0a75-4053-b180-2d00d37d5555 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.159806 Nov 02 14:27:43.417563 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3801/7969] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:43 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:44.440379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:44.440992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:44.448038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:44.448531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:44.448978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:44.449688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:44.450152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:44.450591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:44.583283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:44.591846 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc08ed32-52be-4884-8d6a-1596463dbbf3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.155454 Nov 02 14:27:44.592435 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4169/7970] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:44 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:45.616926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:45.617555 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:45.625343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:45.625845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:45.626302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:45.627024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:45.627527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:45.627975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:45.642918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:45.768505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:45.777458 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f7002489-ebd1-4c57-b3e1-824d9e596386 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.165106 Nov 02 14:27:45.778058 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3802/7971] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:45 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:46.801950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:46.802568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:46.805584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=30 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:46.810852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:46.811366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:46.811816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:46.812527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:46.813016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:46.813452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:46.816349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=88 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:47.283441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:47.292494 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-046988ed-1d2a-4039-9837-b67685d299e3 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1728 microversion: 2.1 time: 0.494533 Nov 02 14:27:47.293094 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4170/7972] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:46 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1728 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:48.317759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:48.318493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:48.321148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:27:48.327785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.328285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.328733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.329453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.329915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.330957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.471215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:48.480259 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-abbace5c-8711-489c-aba6-54b699254291 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1721 microversion: 2.1 time: 0.167156 Nov 02 14:27:48.481107 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3803/7973] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:48 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:48.503950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:48.504573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:48.511549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.512038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.512484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.513197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.513664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.514090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.647773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:48.656322 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e9599e1a-abf1-4cc0-abfa-056ce739c7e5 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1721 microversion: 2.1 time: 0.156563 Nov 02 14:27:48.656904 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4171/7974] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:48 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:48.679667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:48.680289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:48.686427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.686918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.687397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.688098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.688562 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.689000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.820948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:48.829401 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c4ec6de1-33f6-4258-b1c5-76949ddaddc2 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1721 microversion: 2.1 time: 0.154310 Nov 02 14:27:48.829989 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3804/7975] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:48 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:48.853364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:48.853871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:48.860184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.860677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.861128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.861840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.862301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.862741 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.888380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:27:48.970215 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-655f6708-33aa-444b-a1db-d82c0c35f630 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "DELETE /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 204 len: 0 microversion: 2.1 time: 0.120304 Nov 02 14:27:48.972226 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4172/7976] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:27:48 2022] DELETE /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:27:48.980878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:48.981646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:48.988055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.988559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.989002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:48.989705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:48.990166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:48.990601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:49.124899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:49.133825 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-425bbf42-a35c-4b24-96fc-a769e8eee97f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1727 microversion: 2.1 time: 0.157471 Nov 02 14:27:49.134412 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3805/7977] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:48 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:49.952612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-24716d5b-060e-449f-b9cb-430f6380d87f req-d9a1d956-5a01-49fc-b429-d10bfa2ee366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "name": "network-vif-plugged", "status": "completed", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:49.965869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-24716d5b-060e-449f-b9cb-430f6380d87f req-d9a1d956-5a01-49fc-b429-d10bfa2ee366 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:49.966363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-24716d5b-060e-449f-b9cb-430f6380d87f req-d9a1d956-5a01-49fc-b429-d10bfa2ee366 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:49.966817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-24716d5b-060e-449f-b9cb-430f6380d87f req-d9a1d956-5a01-49fc-b429-d10bfa2ee366 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:49.978754 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-24716d5b-060e-449f-b9cb-430f6380d87f req-d9a1d956-5a01-49fc-b429-d10bfa2ee366 service nova] Creating event network-vif-plugged:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h2-858384-19 Nov 02 14:27:49.984333 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-24716d5b-060e-449f-b9cb-430f6380d87f req-d9a1d956-5a01-49fc-b429-d10bfa2ee366 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036011 Nov 02 14:27:49.984956 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4173/7978] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:27:50.157796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:50.158364 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:50.166353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:50.166855 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:50.167345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:50.168059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:50.168531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:50.168983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:50.306309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:50.317601 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f83648c3-53e3-4f24-8f6e-d35c5851a6b0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1727 microversion: 2.1 time: 0.163914 Nov 02 14:27:50.318208 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3806/7979] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:50 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:51.344440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:51.345329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:51.352771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:51.353363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:51.353883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:51.354673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:51.355291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:51.356082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:51.436431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:51.446071 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-36bd3a05-8102-40b1-89e6-0b50be682b08 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1659 microversion: 2.1 time: 0.106885 Nov 02 14:27:51.447057 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4174/7980] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:51 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1659 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:51.623002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4db3859f-8f39-4bd1-a2e5-49e6184b8a97 req-d9a591c2-ebe7-4d83-9ef3-9d6c46307522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "179296bd-5895-4e0a-8fd7-a961315f9839", "name": "network-vif-deleted", "tag": "56c68427-0a84-4e24-a5d9-923f1e880789"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:27:51.637231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4db3859f-8f39-4bd1-a2e5-49e6184b8a97 req-d9a591c2-ebe7-4d83-9ef3-9d6c46307522 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:51.637651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4db3859f-8f39-4bd1-a2e5-49e6184b8a97 req-d9a591c2-ebe7-4d83-9ef3-9d6c46307522 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:51.638104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4db3859f-8f39-4bd1-a2e5-49e6184b8a97 req-d9a591c2-ebe7-4d83-9ef3-9d6c46307522 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:51.651156 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4db3859f-8f39-4bd1-a2e5-49e6184b8a97 req-d9a591c2-ebe7-4d83-9ef3-9d6c46307522 service nova] Creating event network-vif-deleted:56c68427-0a84-4e24-a5d9-923f1e880789 for instance 179296bd-5895-4e0a-8fd7-a961315f9839 on n-h2-858384-19 Nov 02 14:27:51.656379 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4db3859f-8f39-4bd1-a2e5-49e6184b8a97 req-d9a591c2-ebe7-4d83-9ef3-9d6c46307522 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038172 Nov 02 14:27:51.657066 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3807/7981] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:27:52.471270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:52.471968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:52.478870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:52.479399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:52.479848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:52.480840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:52.481303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:52.481745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:52.560432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:52.569936 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ee43544-857b-4284-8cec-436c72bd2fcc tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1374 microversion: 2.1 time: 0.103708 Nov 02 14:27:52.570529 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4175/7982] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:52 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1374 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:53.595184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:53.596205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:53.603401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:53.603907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:53.604354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:53.605066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:53.605811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:53.606495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:53.673948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:53.684369 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3a2b2af4-0637-42ef-8b00-6290052f942f tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1374 microversion: 2.1 time: 0.094404 Nov 02 14:27:53.685063 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3808/7983] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:53 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1374 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:54.709034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:54.709652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:54.716841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:54.717333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:54.717783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:54.718736 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:54.719132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:54.719574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:54.784337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:54.793608 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-61f29e52-d88d-4f69-aa49-c36b0878132d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1374 microversion: 2.1 time: 0.089393 Nov 02 14:27:54.794216 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4176/7984] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:54 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1374 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:55.818744 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:55.819524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:55.827865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:55.828537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:55.828985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:55.829732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:55.830197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:55.830632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:55.866537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:55.867089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:55.867697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:55.868109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lazy-loading 'fault' on Instance uuid 179296bd-5895-4e0a-8fd7-a961315f9839 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:27:55.914260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee11c6caa3a475b92ce013a5cdb239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd73c797573fa4bbe9e5ee8afb7ced9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:27:55.922748 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-938cbf63-22ad-450b-9f45-3cf7df653af0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 200 len: 1379 microversion: 2.1 time: 0.109198 Nov 02 14:27:55.932992 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3809/7985] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:55 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 1379 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:27:56.946828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:56.947427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:56.954337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:56.954836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:56.955352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:56.956081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:56.957634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:56.958103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:56.972843 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 HTTP/1.1 Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '179296bd-5895-4e0a-8fd7-a961315f9839'} Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:27:56.974713 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a6bda0a-68e5-42bc-8d98-0ff00ede145a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 404 len: 111 microversion: 2.1 time: 0.033463 Nov 02 14:27:56.980388 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4177/7986] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:27:56 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:27:57.043014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:27:57.045202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:27:57.052298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:57.052789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:57.053234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:57.053941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:27:57.054426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:27:57.054843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:27:57.070339 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/os-volume_attachments HTTP/1.1 Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': '179296bd-5895-4e0a-8fd7-a961315f9839'} Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:27:57.072086 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-042cb203-3fb4-4988-b213-ed0f06f0c02d tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034558 Nov 02 14:27:57.076973 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3810/7987] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:27:57 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:00.403194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:00.404253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:00.413974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.414478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.414930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.415689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.416156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.416600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.433168 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 HTTP/1.1 Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '179296bd-5895-4e0a-8fd7-a961315f9839'} Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:00.434792 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:00.438909 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01301530-66b7-444f-a56b-107c17fefda9 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "DELETE /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 404 len: 111 microversion: 2.1 time: 0.037169 Nov 02 14:28:00.440678 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4178/7988] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:28:00 2022] DELETE /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:00.445405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:00.446036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 179296bd-5895-4e0a-8fd7-a961315f9839] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:00.453070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.453569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.454022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.454729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.455541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.455987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.471870 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 HTTP/1.1 Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '179296bd-5895-4e0a-8fd7-a961315f9839'} Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.474244 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance 179296bd-5895-4e0a-8fd7-a961315f9839 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-040acd5d-f72b-488d-9edf-e63e6c17ec1a tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839" status: 404 len: 111 microversion: 2.1 time: 0.034230 Nov 02 14:28:00.478949 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3811/7989] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:00 2022] GET /compute/v2.1/servers/179296bd-5895-4e0a-8fd7-a961315f9839 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:28:00.485064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:00.485709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:00.492266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.492765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.493218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.493940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.494410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.494993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.509697 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d HTTP/1.1 Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'afdd153a-bd38-4e4b-9475-6fdee47eb75d'} Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:00.511333 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3fa7c121-b938-4448-8f2c-361d41f91dae tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "DELETE /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 404 len: 111 microversion: 2.1 time: 0.032212 Nov 02 14:28:00.515559 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4179/7990] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:28:00 2022] DELETE /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:00.522431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:00.523072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: afdd153a-bd38-4e4b-9475-6fdee47eb75d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:00.530728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.531293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.531986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.536505 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.537027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.537487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.554867 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d HTTP/1.1 Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'afdd153a-bd38-4e4b-9475-6fdee47eb75d'} Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.556504 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance afdd153a-bd38-4e4b-9475-6fdee47eb75d could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-88564c99-6b3c-4c54-b166-e693ec5e26d8 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d" status: 404 len: 111 microversion: 2.1 time: 0.040360 Nov 02 14:28:00.560556 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3812/7991] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:00 2022] GET /compute/v2.1/servers/afdd153a-bd38-4e4b-9475-6fdee47eb75d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:28:00.567729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:00.568195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:00.574580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.575072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.575548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.576259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.576717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.577145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.592772 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e HTTP/1.1 Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e'} Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:00.594408 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-88608a04-7e62-4091-8241-b605654380a0 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 404 len: 111 microversion: 2.1 time: 0.033871 Nov 02 14:28:00.600590 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4180/7992] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:28:00 2022] DELETE /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:00.607090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:00.607783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:00.615383 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.615892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.616349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.617135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.618017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.618017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.633749 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e HTTP/1.1 Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e'} Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.635418 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf83682f-f1c8-44fd-bc94-9ba15bbe5e54 tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e" status: 404 len: 111 microversion: 2.1 time: 0.034344 Nov 02 14:28:00.641755 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3813/7993] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:00 2022] GET /compute/v2.1/servers/e0acebc6-ed5f-4d07-ab7f-7e6c94b8231e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:00.646402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:00.646908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:00.653249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.653743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.654189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.654902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.655421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.656037 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.673333 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: request: DELETE /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 HTTP/1.1 Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '620685e8-4d90-42a2-95d1-9bfa3c9b7df0'} Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:00.676318 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-16bc404f-2e3a-45ef-9589-13c4c6c31e5c tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "DELETE /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 404 len: 111 microversion: 2.1 time: 0.036439 Nov 02 14:28:00.681076 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4181/7994] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:28:00 2022] DELETE /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:00.689318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:00.689948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] [instance: 620685e8-4d90-42a2-95d1-9bfa3c9b7df0] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:00.697506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.698024 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.698477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.699240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:00.699716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:00.700161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:00.717181 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] HTTP exception thrown: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Request method failure captured: Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 HTTP/1.1 Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYnxkhOW6xQpK8R9N3XInXa1fFVgo1vIpbsCIRgPkEp6lxLPnLRN5NEEOMoOCTtX9r9QIsPv-c8-e13mZkz7M1wV1xMNuXp9bJCLLPrGAaCY5l-uaSdyO-_Qr1ZrASj_sUREPoNWzyg5m5yUcAAEaAB6VEW4ZGIbfMgTd4_rgmTgmD5w Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/d73c797573fa4bbe9e5ee8afb7ced9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: d73c797573fa4bbe9e5ee8afb7ced9c0 Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServerActionsTestJSON-1703677366 Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 1ee11c6caa3a475b92ce013a5cdb239b Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServerActionsTestJSON-1703677366-project Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '620685e8-4d90-42a2-95d1-9bfa3c9b7df0'} Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:00.718791 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Returning 404 to user: Instance 620685e8-4d90-42a2-95d1-9bfa3c9b7df0 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c61591e3-0fb9-4b97-9ef9-10bbdb37b1ad tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0" status: 404 len: 111 microversion: 2.1 time: 0.034949 Nov 02 14:28:00.723783 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3814/7995] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:00 2022] GET /compute/v2.1/servers/620685e8-4d90-42a2-95d1-9bfa3c9b7df0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:00.729669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7053d690-abce-4559-877d-e30cc6d867ed tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] Calling method '.version_select at 0x7fe787642d30>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:00.755809 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7053d690-abce-4559-877d-e30cc6d867ed tempest-ServerActionsTestJSON-1703677366 tempest-ServerActionsTestJSON-1703677366-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433767863" status: 202 len: 0 microversion: 2.1 time: 0.029978 Nov 02 14:28:00.756590 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4182/7996] 10.222.0.113 () {58 vars in 1226 bytes} [Wed Nov 2 14:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433767863 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:28:10.356831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-208654447", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "c3c2c550-16eb-4516-9034-4416e739dae3"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:10.417110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] validate_networks() for [('c3c2c550-16eb-4516-9034-4416e739dae3', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:28:10.710580 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=53 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:10.803332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:28:10.803775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:28:10.804267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:28:10.804740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:28:10.805117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:28:10.814189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:10.814716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:10.815740 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:10.816687 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:10.817158 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:10.817604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:10.835828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Getting quotas for project cae70a2a93f14571a2579d72c384652a. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:28:10.841411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Getting quotas for user 3081c210a60340dc8cbf23b0abc100a1 and project cae70a2a93f14571a2579d72c384652a. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:28:10.855312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:28:10.857948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:28:10.909892 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fa555da6-59d6-4b5a-bc0b-0b4703ad622f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.696419 Nov 02 14:28:10.919221 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3815/7997] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:28:10 2022] POST /compute/v2.1/servers => generated 382 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:28:10.921683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f88ae53e-c182-4f54-86ca-d5b6c3b376b5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:10.922305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f88ae53e-c182-4f54-86ca-d5b6c3b376b5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:10.926970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:10.928427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:10.992339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f88ae53e-c182-4f54-86ca-d5b6c3b376b5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:10.999745 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f88ae53e-c182-4f54-86ca-d5b6c3b376b5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1220 microversion: 2.1 time: 0.081825 Nov 02 14:28:11.000314 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4183/7998] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:10 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:28:12.024558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:12.025124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:12.032232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:12.032733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:12.033182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:12.033899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:12.035045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:12.035693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:12.117079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:12.126925 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6eb9c06-1281-4aa8-a835-7942c4e04bce tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1272 microversion: 2.1 time: 0.107913 Nov 02 14:28:12.127551 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3816/7999] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:12 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:13.151574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:13.152277 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:13.159989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:13.160802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:13.161246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:13.162209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:13.162734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:13.163270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:13.351450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:13.375391 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-400f2c27-d35a-4821-b07f-fd27fa3e798f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1320 microversion: 2.1 time: 0.227919 Nov 02 14:28:13.376347 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4184/8000] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:13 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1320 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:14.075280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-305b22d1-a0da-480d-8454-f2ead21487be req-38ceb90d-2ecb-40a1-868c-e298ba36be69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0012c5a1-97ac-4287-bd77-a64b26274eca", "tag": "21c4da9c-63ad-4bd5-976b-7944dfab94eb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:14.087433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-305b22d1-a0da-480d-8454-f2ead21487be req-38ceb90d-2ecb-40a1-868c-e298ba36be69 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:14.087952 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-305b22d1-a0da-480d-8454-f2ead21487be req-38ceb90d-2ecb-40a1-868c-e298ba36be69 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:14.088398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-305b22d1-a0da-480d-8454-f2ead21487be req-38ceb90d-2ecb-40a1-868c-e298ba36be69 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:14.100023 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-305b22d1-a0da-480d-8454-f2ead21487be req-38ceb90d-2ecb-40a1-868c-e298ba36be69 service nova] Creating event network-changed:21c4da9c-63ad-4bd5-976b-7944dfab94eb for instance 0012c5a1-97ac-4287-bd77-a64b26274eca on n-h1-858384-19 Nov 02 14:28:14.105196 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-305b22d1-a0da-480d-8454-f2ead21487be req-38ceb90d-2ecb-40a1-868c-e298ba36be69 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033867 Nov 02 14:28:14.106443 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3817/8001] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:14.400593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:14.401132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:14.403391 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:28:14.403534 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:28:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca (ip 10.222.0.113) !!! Nov 02 14:28:14.411890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:14.412389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:14.412840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:14.413570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:14.414040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:14.414481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:14.573169 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:14.581173 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2f50f33d-d386-4df6-9aaf-5b88eb81265a tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1320 microversion: 2.1 time: 0.184713 Nov 02 14:28:14.581797 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4185/8002] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:14 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:15.605897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:15.606623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:15.614208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:15.614703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:15.615170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:15.615883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:15.616345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:15.616787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:15.751033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:15.759532 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-45b9a900-df00-4d07-87e6-7542bbbb016d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1320 microversion: 2.1 time: 0.158926 Nov 02 14:28:15.760119 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3818/8003] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:15 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:16.782103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:16.782728 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:16.790662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:16.791196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:16.791645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:16.792359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:16.792819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:16.793253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:16.927599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:16.935336 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6af35a05-2b9c-4855-9fa5-fc3ea30dbe8d tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1320 microversion: 2.1 time: 0.157299 Nov 02 14:28:16.935932 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4186/8004] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:16 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:17.959721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:17.960256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:17.967215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:17.967716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:17.968167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:17.968883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:17.969350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:17.969792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:18.121666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:18.129958 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f24c0b40-0fdb-44ca-8313-85b6fcab542f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1320 microversion: 2.1 time: 0.174958 Nov 02 14:28:18.130536 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3819/8005] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:17 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1320 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:19.153493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:19.154144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:19.162395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:19.162892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:19.163382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:19.164097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:19.164560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:19.164996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:19.312677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:19.321350 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-62f6952b-26ae-43ab-9db0-6dceebf6fc85 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1320 microversion: 2.1 time: 0.171914 Nov 02 14:28:19.321946 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4187/8006] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:19 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:20.344216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:20.344781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:20.347566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:20.353468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:20.353967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:20.354414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:20.355143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:20.355613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:20.356316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:20.492862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:20.500712 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e13e16b8-8963-4575-8aad-a1760b37f78b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1320 microversion: 2.1 time: 0.160646 Nov 02 14:28:20.501303 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3820/8007] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:20 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:21.389460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3d67238a-d134-4a59-9bd2-0315af603873 req-7e4f2b19-f8ce-4fc3-8517-c4097a51aa0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0012c5a1-97ac-4287-bd77-a64b26274eca", "name": "network-vif-plugged", "status": "completed", "tag": "21c4da9c-63ad-4bd5-976b-7944dfab94eb"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:21.397178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:21.404821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3d67238a-d134-4a59-9bd2-0315af603873 req-7e4f2b19-f8ce-4fc3-8517-c4097a51aa0b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:21.405318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3d67238a-d134-4a59-9bd2-0315af603873 req-7e4f2b19-f8ce-4fc3-8517-c4097a51aa0b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:21.405774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3d67238a-d134-4a59-9bd2-0315af603873 req-7e4f2b19-f8ce-4fc3-8517-c4097a51aa0b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:21.419662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3d67238a-d134-4a59-9bd2-0315af603873 req-7e4f2b19-f8ce-4fc3-8517-c4097a51aa0b service nova] Creating event network-vif-plugged:21c4da9c-63ad-4bd5-976b-7944dfab94eb for instance 0012c5a1-97ac-4287-bd77-a64b26274eca on n-h1-858384-19 Nov 02 14:28:21.425468 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3d67238a-d134-4a59-9bd2-0315af603873 req-7e4f2b19-f8ce-4fc3-8517-c4097a51aa0b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039708 Nov 02 14:28:21.426285 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4188/8008] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:28:21.524455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:21.525189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:21.527498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:21.528654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:21.536971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:21.537476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:21.538124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:21.538847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:21.539349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:21.539790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:21.705395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:21.714306 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e7bd7b9b-0839-4e85-bbea-ef172294e79b tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1320 microversion: 2.1 time: 0.194323 Nov 02 14:28:21.714899 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3821/8009] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:21 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1320 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:22.739032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:22.739838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:22.747983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:22.748471 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:22.748914 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:22.749625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:22.750080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:22.750512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:22.901106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:22.911658 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41d357eb-c666-4773-8375-97a3983494d9 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1320 microversion: 2.1 time: 0.176895 Nov 02 14:28:22.913188 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4189/8010] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:22 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:23.937785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:23.938405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:23.945752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:23.946248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:23.946692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:23.947430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:23.947896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:23.948365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:24.079759 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:24.088920 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e7b35a9-9adb-431b-964d-9d9fc6b22440 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1508 microversion: 2.1 time: 0.155236 Nov 02 14:28:24.089507 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3822/8011] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:23 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:24.152597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1056251909", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "c3c2c550-16eb-4516-9034-4416e739dae3"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:24.208215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] validate_networks() for [('c3c2c550-16eb-4516-9034-4416e739dae3', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:28:24.591749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:28:24.592175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:28:24.592680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:28:24.593094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:28:24.593509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:28:24.606813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:24.607412 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:24.607775 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:24.608509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:24.608961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:24.609388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:24.626149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Getting quotas for project cae70a2a93f14571a2579d72c384652a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:28:24.634842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Getting quotas for user 3081c210a60340dc8cbf23b0abc100a1 and project cae70a2a93f14571a2579d72c384652a. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:28:24.649457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:28:24.651802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:28:24.702753 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0066af4f-0dd2-46e8-a1d9-b2bf29c94074 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.554155 Nov 02 14:28:24.703502 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4190/8012] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:28:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:28:24.715363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-80e1e3ac-c028-4a49-ac57-54975cac3e58 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:24.715985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-80e1e3ac-c028-4a49-ac57-54975cac3e58 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:24.775907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-80e1e3ac-c028-4a49-ac57-54975cac3e58 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:24.784554 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-80e1e3ac-c028-4a49-ac57-54975cac3e58 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1221 microversion: 2.1 time: 0.073058 Nov 02 14:28:24.785503 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3823/8013] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:24 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:25.809204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:25.809832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:25.817280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:25.818159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:25.818875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:25.819704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:25.820391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:25.821249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:25.907476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:25.916226 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfd3d448-4048-4d60-9ef6-60acc8658550 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1291 microversion: 2.1 time: 0.112005 Nov 02 14:28:25.916927 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4191/8014] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:25 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1291 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:26.941530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:26.942135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:26.950072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:26.950573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:26.951028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:26.951867 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:26.952337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:26.952780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:27.089120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:27.097865 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-47ff3b3a-717b-40e8-9395-cfad1643effc tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1321 microversion: 2.1 time: 0.161016 Nov 02 14:28:27.098456 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3824/8015] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:26 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:28:27.207126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-812d5efd-03aa-4129-b363-1f540e655d7b req-177567b9-4411-4bac-8146-c0bcefa16724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0936d30-617f-4bc4-8ecf-bedbd5fc0640", "tag": "7403e300-8f19-4002-a990-0b8041615df7"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:27.218402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-812d5efd-03aa-4129-b363-1f540e655d7b req-177567b9-4411-4bac-8146-c0bcefa16724 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:27.218883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-812d5efd-03aa-4129-b363-1f540e655d7b req-177567b9-4411-4bac-8146-c0bcefa16724 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:27.219356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-812d5efd-03aa-4129-b363-1f540e655d7b req-177567b9-4411-4bac-8146-c0bcefa16724 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:27.232540 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-812d5efd-03aa-4129-b363-1f540e655d7b req-177567b9-4411-4bac-8146-c0bcefa16724 service nova] Creating event network-changed:7403e300-8f19-4002-a990-0b8041615df7 for instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 on n-h2-858384-19 Nov 02 14:28:27.238242 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-812d5efd-03aa-4129-b363-1f540e655d7b req-177567b9-4411-4bac-8146-c0bcefa16724 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034950 Nov 02 14:28:27.238855 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4192/8016] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:28.121961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:28.122584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:28.130079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:28.130572 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:28.131020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:28.131761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:28.132225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:28.132659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:28.269563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:28.277344 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a8c5908b-da46-463a-8152-d2c91c52d747 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1321 microversion: 2.1 time: 0.159354 Nov 02 14:28:28.277920 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3825/8017] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:28 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:29.302615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:29.303399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:29.309840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:29.310336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:29.310787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:29.311541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:29.312007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:29.312445 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:29.444679 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:29.452567 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0a32203e-a60f-4ed0-b7d9-3c4d83370d88 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1321 microversion: 2.1 time: 0.155148 Nov 02 14:28:29.453154 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4193/8018] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:29 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:30.476756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:30.477384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:30.484851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:30.485356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:30.485804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:30.486511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:30.487770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:30.488210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:30.628390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:30.636333 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ede9eb5b-5cdf-435c-a6e9-e657ed63130f tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1321 microversion: 2.1 time: 0.163509 Nov 02 14:28:30.636929 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3826/8019] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:30 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:31.663628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:31.664269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:31.671182 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:31.671671 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:31.672118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:31.672826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:31.673292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:31.673727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:31.808573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:31.817159 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ebb6477d-42c7-42ad-9fdc-346a2dedfb04 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1321 microversion: 2.1 time: 0.158294 Nov 02 14:28:31.817744 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4194/8020] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:31 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:32.840427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:32.841046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:32.848683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:32.849174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:32.849622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:32.850323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:32.850783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:32.851246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:32.982585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:32.991509 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-491bc1f8-65e3-4afd-8ce3-19bc9e1bbc93 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1321 microversion: 2.1 time: 0.154955 Nov 02 14:28:32.992094 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3827/8021] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:32 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:34.014036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:34.014691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:34.022467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:34.022966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:34.023518 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:34.024192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:34.024657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:34.025124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:34.169634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:34.178796 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b68c9b52-19b9-4a77-8a68-d3bb66e0d7db tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1321 microversion: 2.1 time: 0.168206 Nov 02 14:28:34.178986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-868661c9-d125-4b42-abcf-4811ccd89a5f req-38f57002-4958-4d1e-8753-3c0a88770859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0936d30-617f-4bc4-8ecf-bedbd5fc0640", "name": "network-vif-plugged", "status": "completed", "tag": "7403e300-8f19-4002-a990-0b8041615df7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:34.179629 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4195/8022] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:34 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:34.189469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-868661c9-d125-4b42-abcf-4811ccd89a5f req-38f57002-4958-4d1e-8753-3c0a88770859 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:34.190164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-868661c9-d125-4b42-abcf-4811ccd89a5f req-38f57002-4958-4d1e-8753-3c0a88770859 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:34.191167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-868661c9-d125-4b42-abcf-4811ccd89a5f req-38f57002-4958-4d1e-8753-3c0a88770859 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:34.203806 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-868661c9-d125-4b42-abcf-4811ccd89a5f req-38f57002-4958-4d1e-8753-3c0a88770859 service nova] Creating event network-vif-plugged:7403e300-8f19-4002-a990-0b8041615df7 for instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 on n-h2-858384-19 Nov 02 14:28:34.209905 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-868661c9-d125-4b42-abcf-4811ccd89a5f req-38f57002-4958-4d1e-8753-3c0a88770859 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035123 Nov 02 14:28:34.210704 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3828/8023] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:35.202032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:35.202658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:35.204657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:35.206597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:35.213459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:35.213960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:35.214415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:35.215148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:35.215609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:35.216048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:35.353427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:35.362227 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f176a42e-014a-4dc0-973d-0017cad5d9f0 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1321 microversion: 2.1 time: 0.163552 Nov 02 14:28:35.363462 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4196/8024] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:35 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:36.383741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:36.388911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:36.389637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:36.397089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.397592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.398041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.398764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.399261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.399699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.545730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:36.554787 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d476ea5e-2ff4-4c12-ad3e-f0efbf71ff2e tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1509 microversion: 2.1 time: 0.172039 Nov 02 14:28:36.555415 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3829/8025] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:36 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:36.577573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:36.578120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:36.587442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.587935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.588375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.589095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.589554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.589984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.623266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:28:36.714645 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-00a8ec99-faf0-458c-955f-52c21e535158 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 204 len: 0 microversion: 2.1 time: 0.140755 Nov 02 14:28:36.715226 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4197/8026] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:28:36 2022] DELETE /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:28:36.724430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:36.725058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:36.731599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.732092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.732537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.733251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:36.733714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:36.734150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:36.866423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:36.874291 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da6511ad-1460-4dec-99b7-6a03505d2177 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1515 microversion: 2.1 time: 0.154522 Nov 02 14:28:36.874870 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3830/8027] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:36 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:37.898178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:37.898801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:37.906050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:37.906534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:37.906973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:37.907707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:37.908167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:37.908628 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:38.042565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:38.051385 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4cef0c63-a86c-4280-b8fc-ccb2dfcc8aa2 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1515 microversion: 2.1 time: 0.157763 Nov 02 14:28:38.051986 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4198/8028] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:37 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:38.686749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1a901350-6e5e-4538-b9bc-6f0560501b6b req-0af75623-79c4-460e-8384-a9268985dcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0936d30-617f-4bc4-8ecf-bedbd5fc0640", "name": "network-vif-deleted", "tag": "7403e300-8f19-4002-a990-0b8041615df7"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:38.700818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1a901350-6e5e-4538-b9bc-6f0560501b6b req-0af75623-79c4-460e-8384-a9268985dcbb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:38.701330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1a901350-6e5e-4538-b9bc-6f0560501b6b req-0af75623-79c4-460e-8384-a9268985dcbb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:38.702009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1a901350-6e5e-4538-b9bc-6f0560501b6b req-0af75623-79c4-460e-8384-a9268985dcbb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:38.716773 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1a901350-6e5e-4538-b9bc-6f0560501b6b req-0af75623-79c4-460e-8384-a9268985dcbb service nova] Creating event network-vif-deleted:7403e300-8f19-4002-a990-0b8041615df7 for instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 on n-h2-858384-19 Nov 02 14:28:38.724215 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1a901350-6e5e-4538-b9bc-6f0560501b6b req-0af75623-79c4-460e-8384-a9268985dcbb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041886 Nov 02 14:28:38.725173 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3831/8029] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:39.074819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:39.075401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:39.082535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:39.083024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:39.083494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:39.084209 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:39.084669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:39.085103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:39.119009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:39.119536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:39.119993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:39.120451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lazy-loading 'fault' on Instance uuid f0936d30-617f-4bc4-8ecf-bedbd5fc0640 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:28:39.167409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:39.180172 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5467ec26-6533-419f-94aa-833e7d018d34 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 200 len: 1311 microversion: 2.1 time: 0.109204 Nov 02 14:28:39.181343 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4199/8030] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:39 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:40.206414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:40.207318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:40.214195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.214700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.215244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.215996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.216468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.216913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.235202 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] HTTP exception thrown: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Request method failure captured: Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 HTTP/1.1 Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn56BZwi4DlU2w606slsCjMHUCNxodAzT9cbczRlkK5GHw5WZkAOhjGhzSNUUghpYzzquBYYRV7eCdzyS_4-lC7dR5j6BO1eHX8PzxvdVqbWM8qMG4GB6t_sqs7XEEtT5CSxZM2jc9pMbMJUBXJpEvHdZfN-fdgC3GDtMdKXiDjCj_U Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cae70a2a93f14571a2579d72c384652a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 3081c210a60340dc8cbf23b0abc100a1 Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f0936d30-617f-4bc4-8ecf-bedbd5fc0640'} Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:40.238071 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Returning 404 to user: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-daab78ad-6f6b-4007-ba2c-ace911d66548 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 404 len: 111 microversion: 2.1 time: 0.038476 Nov 02 14:28:40.243550 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3832/8031] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:40 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:40.248928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:40.249545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:40.256698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.257184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.257624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.258318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.258774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.259232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.277331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:40.393986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:40.401810 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e02405c1-9f66-445b-badf-00a556b2ca79 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1508 microversion: 2.1 time: 0.156963 Nov 02 14:28:40.402393 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4200/8032] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:40 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:40.425101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad9d4ebd-dc75-4ff6-ad45-50bd92c0d604 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:40.427376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ad9d4ebd-dc75-4ff6-ad45-50bd92c0d604 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 27740e02-2887-46a9-935f-8aff2d43a22d] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:40.433124 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-ad9d4ebd-dc75-4ff6-ad45-50bd92c0d604 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] HTTP exception thrown: Instance 27740e02-2887-46a9-935f-8aff2d43a22d could not be found. Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad9d4ebd-dc75-4ff6-ad45-50bd92c0d604 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Request method failure captured: Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/27740e02-2887-46a9-935f-8aff2d43a22d/action HTTP/1.1 Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 32 Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn56BZwi4DlU2w606slsCjMHUCNxodAzT9cbczRlkK5GHw5WZkAOhjGhzSNUUghpYzzquBYYRV7eCdzyS_4-lC7dR5j6BO1eHX8PzxvdVqbWM8qMG4GB6t_sqs7XEEtT5CSxZM2jc9pMbMJUBXJpEvHdZfN-fdgC3GDtMdKXiDjCj_U Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cae70a2a93f14571a2579d72c384652a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 3081c210a60340dc8cbf23b0abc100a1 Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: {"resize": {"flavorRef": "452"}} Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 27740e02-2887-46a9-935f-8aff2d43a22d could not be found. Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '27740e02-2887-46a9-935f-8aff2d43a22d', 'body': {'resize': {'flavorRef': '452'}}} Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27740e02-2887-46a9-935f-8aff2d43a22d could not be found. Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:40.434680 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27740e02-2887-46a9-935f-8aff2d43a22d could not be found. Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27740e02-2887-46a9-935f-8aff2d43a22d could not be found. Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ad9d4ebd-dc75-4ff6-ad45-50bd92c0d604 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Returning 404 to user: Instance 27740e02-2887-46a9-935f-8aff2d43a22d could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ad9d4ebd-dc75-4ff6-ad45-50bd92c0d604 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "POST /compute/v2.1/servers/27740e02-2887-46a9-935f-8aff2d43a22d/action" status: 404 len: 111 microversion: 2.1 time: 0.015640 Nov 02 14:28:40.439028 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3833/8033] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:28:40 2022] POST /compute/v2.1/servers/27740e02-2887-46a9-935f-8aff2d43a22d/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:40.444689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:40.445306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:40.451320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.451801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.452237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.452929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.453378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.453805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.587214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:40.595141 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-94307f6e-b1b4-4c7a-adaa-c1ff58fedc57 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1508 microversion: 2.1 time: 0.154288 Nov 02 14:28:40.595718 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4201/8034] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:40 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:40.620443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:40.621044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:40.628056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.628535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.628985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.629699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.630161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.630600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.763006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:40.765363 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=87 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:40.773168 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-29179642-b8ea-4f80-8721-0bb975691532 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1508 microversion: 2.1 time: 0.156595 Nov 02 14:28:40.773743 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3834/8035] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:40 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:40.797157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "5d4bafec-2261-4835-8557-7db432effeaa"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:40.799483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:40.805419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.805900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.806340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.807029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.807505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.807935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.852027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:40.857545 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] HTTP exception thrown: Flavor 5d4bafec-2261-4835-8557-7db432effeaa could not be found. Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Request method failure captured: Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: request: POST /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca/action HTTP/1.1 Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 65 Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYn56BZwi4DlU2w606slsCjMHUCNxodAzT9cbczRlkK5GHw5WZkAOhjGhzSNUUghpYzzquBYYRV7eCdzyS_4-lC7dR5j6BO1eHX8PzxvdVqbWM8qMG4GB6t_sqs7XEEtT5CSxZM2jc9pMbMJUBXJpEvHdZfN-fdgC3GDtMdKXiDjCj_U Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cae70a2a93f14571a2579d72c384652a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3081c210a60340dc8cbf23b0abc100a1 Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: {"resize": {"flavorRef": "5d4bafec-2261-4835-8557-7db432effeaa"}} Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: exception: Flavor 5d4bafec-2261-4835-8557-7db432effeaa could not be found. Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0012c5a1-97ac-4287-bd77-a64b26274eca', 'body': {'resize': {'flavorRef': '5d4bafec-2261-4835-8557-7db432effeaa'}}} Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4201, in resize Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:40.859491 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5d4bafec-2261-4835-8557-7db432effeaa could not be found. Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 5d4bafec-2261-4835-8557-7db432effeaa could not be found. Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5d4bafec-2261-4835-8557-7db432effeaa could not be found. Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Returning 400 to user: Flavor 5d4bafec-2261-4835-8557-7db432effeaa could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c8ac195-f4e0-4206-8b3f-572c1b205680 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "POST /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca/action" status: 400 len: 107 microversion: 2.1 time: 0.068484 Nov 02 14:28:40.864617 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4202/8036] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:28:40 2022] POST /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca/action => generated 107 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:28:40.870003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:40.870630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:40.876564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.877089 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.878216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:40.878441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:40.878908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:40.879370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.013300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:41.022091 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eadeae6c-2df4-4172-b18b-4af250da7ef4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1508 microversion: 2.1 time: 0.155920 Nov 02 14:28:41.022665 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3835/8037] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:40 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:41.044674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:41.045284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:41.047151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:28:41.052698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.053122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.053558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.054253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.054702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.055152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.188385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:41.196510 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e583359-836c-4003-a3d8-e8d4f8e455d3 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1508 microversion: 2.1 time: 0.155717 Nov 02 14:28:41.197089 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4203/8038] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:41 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:41.218479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3c64150-496c-43dd-9782-88f5608ecc83 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3c64150-496c-43dd-9782-88f5608ecc83 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Request method failure captured: Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: request: POST /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca/action HTTP/1.1 Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 29 Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn56BZwi4DlU2w606slsCjMHUCNxodAzT9cbczRlkK5GHw5WZkAOhjGhzSNUUghpYzzquBYYRV7eCdzyS_4-lC7dR5j6BO1eHX8PzxvdVqbWM8qMG4GB6t_sqs7XEEtT5CSxZM2jc9pMbMJUBXJpEvHdZfN-fdgC3GDtMdKXiDjCj_U Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cae70a2a93f14571a2579d72c384652a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 3081c210a60340dc8cbf23b0abc100a1 Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: {"resize": {"flavorRef": ""}} Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '0012c5a1-97ac-4287-bd77-a64b26274eca', 'body': {'resize': {'flavorRef': ''}}} Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise error Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi On instance['resize']: Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi '' Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.222588 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3c64150-496c-43dd-9782-88f5608ecc83 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f3c64150-496c-43dd-9782-88f5608ecc83 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "POST /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca/action" status: 400 len: 113 microversion: 2.1 time: 0.009607 Nov 02 14:28:41.227953 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3836/8039] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:28:41 2022] POST /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 14:28:41.232577 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:41.233191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:41.239983 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.240465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.240900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.241595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.242046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.242472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.376173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:41.384838 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d2f80dff-8ba8-4935-a83f-30109770d4b4 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1508 microversion: 2.1 time: 0.156313 Nov 02 14:28:41.385433 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4204/8040] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:41 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:41.413571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:41.414080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:41.423341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.423843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.424354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.425065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.425535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.425977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.439309 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] HTTP exception thrown: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Request method failure captured: Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 HTTP/1.1 Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn56BZwi4DlU2w606slsCjMHUCNxodAzT9cbczRlkK5GHw5WZkAOhjGhzSNUUghpYzzquBYYRV7eCdzyS_4-lC7dR5j6BO1eHX8PzxvdVqbWM8qMG4GB6t_sqs7XEEtT5CSxZM2jc9pMbMJUBXJpEvHdZfN-fdgC3GDtMdKXiDjCj_U Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cae70a2a93f14571a2579d72c384652a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 3081c210a60340dc8cbf23b0abc100a1 Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f0936d30-617f-4bc4-8ecf-bedbd5fc0640'} Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:41.441047 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Returning 404 to user: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-712809c7-398c-45b7-b8e9-9d9e1820cc56 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 404 len: 111 microversion: 2.1 time: 0.034243 Nov 02 14:28:41.445510 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3837/8041] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:28:41 2022] DELETE /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:41.451149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:41.451817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: f0936d30-617f-4bc4-8ecf-bedbd5fc0640] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:41.459317 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.459812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.460262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.460984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.461432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.461870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.476573 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] HTTP exception thrown: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Request method failure captured: Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 HTTP/1.1 Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYn56BZwi4DlU2w606slsCjMHUCNxodAzT9cbczRlkK5GHw5WZkAOhjGhzSNUUghpYzzquBYYRV7eCdzyS_4-lC7dR5j6BO1eHX8PzxvdVqbWM8qMG4GB6t_sqs7XEEtT5CSxZM2jc9pMbMJUBXJpEvHdZfN-fdgC3GDtMdKXiDjCj_U Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cae70a2a93f14571a2579d72c384652a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3081c210a60340dc8cbf23b0abc100a1 Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'f0936d30-617f-4bc4-8ecf-bedbd5fc0640'} Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:41.478125 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Returning 404 to user: Instance f0936d30-617f-4bc4-8ecf-bedbd5fc0640 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11496426-faaf-4f43-a42a-d50e9b41299c tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640" status: 404 len: 111 microversion: 2.1 time: 0.032334 Nov 02 14:28:41.482827 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4205/8042] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:41 2022] GET /compute/v2.1/servers/f0936d30-617f-4bc4-8ecf-bedbd5fc0640 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:28:41.489009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:41.489529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:41.495574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.496074 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.496530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.497240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.497711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.498157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.524804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:28:41.604078 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-13dfeaa0-7289-4929-988e-4374578519d5 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 204 len: 0 microversion: 2.1 time: 0.119166 Nov 02 14:28:41.605023 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3838/8043] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:28:41 2022] DELETE /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:28:41.614193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:41.614888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:41.620938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.621428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.621867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.622559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:41.623010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:41.623462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:41.758155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:41.766181 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-487235f8-da7b-4cb3-976c-6510fa508398 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1514 microversion: 2.1 time: 0.156263 Nov 02 14:28:41.766762 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4206/8044] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:41 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:42.790487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:42.791255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:42.798302 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:42.798802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:42.799546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:42.800467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:42.801147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:42.801147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:42.936006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:42.944697 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee5dd6a8-cc7b-440c-974b-e9a0241a7f38 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1514 microversion: 2.1 time: 0.158532 Nov 02 14:28:42.945282 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3839/8045] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:42 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:43.967901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:43.969154 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:43.976692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:43.977181 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:43.977618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:43.978323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:43.978774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:43.979222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:44.121280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3081c210a60340dc8cbf23b0abc100a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae70a2a93f14571a2579d72c384652a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:28:44.132819 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4c455fdd-2747-4d8a-9fa8-c62ffc0edcbd tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 200 len: 1514 microversion: 2.1 time: 0.168441 Nov 02 14:28:44.133505 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4207/8046] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:43 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:28:44.156941 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-505c7029-6853-471b-83b6-b3817cac45b5 req-a5596705-3d4d-4470-9cdc-a7ddccd8913c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0012c5a1-97ac-4287-bd77-a64b26274eca", "name": "network-vif-deleted", "tag": "21c4da9c-63ad-4bd5-976b-7944dfab94eb"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:28:44.171571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-505c7029-6853-471b-83b6-b3817cac45b5 req-a5596705-3d4d-4470-9cdc-a7ddccd8913c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:44.172070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-505c7029-6853-471b-83b6-b3817cac45b5 req-a5596705-3d4d-4470-9cdc-a7ddccd8913c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:44.172538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-505c7029-6853-471b-83b6-b3817cac45b5 req-a5596705-3d4d-4470-9cdc-a7ddccd8913c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:44.194648 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-505c7029-6853-471b-83b6-b3817cac45b5 req-a5596705-3d4d-4470-9cdc-a7ddccd8913c service nova] Creating event network-vif-deleted:21c4da9c-63ad-4bd5-976b-7944dfab94eb for instance 0012c5a1-97ac-4287-bd77-a64b26274eca on n-h1-858384-19 Nov 02 14:28:44.199832 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-505c7029-6853-471b-83b6-b3817cac45b5 req-a5596705-3d4d-4470-9cdc-a7ddccd8913c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046600 Nov 02 14:28:44.200621 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3840/8047] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:28:45.157665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:28:45.158967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] [instance: 0012c5a1-97ac-4287-bd77-a64b26274eca] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:28:45.165298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:45.165780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:45.166219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:45.166915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:28:45.167393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:28:45.167821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:28:45.186898 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] HTTP exception thrown: Instance 0012c5a1-97ac-4287-bd77-a64b26274eca could not be found. Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Request method failure captured: Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca HTTP/1.1 Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYn56BZwi4DlU2w606slsCjMHUCNxodAzT9cbczRlkK5GHw5WZkAOhjGhzSNUUghpYzzquBYYRV7eCdzyS_4-lC7dR5j6BO1eHX8PzxvdVqbWM8qMG4GB6t_sqs7XEEtT5CSxZM2jc9pMbMJUBXJpEvHdZfN-fdgC3GDtMdKXiDjCj_U Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_cae70a2a93f14571a2579d72c384652a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/cae70a2a93f14571a2579d72c384652a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: cae70a2a93f14571a2579d72c384652a Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-ServersNegativeTestJSON-997886433 Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3081c210a60340dc8cbf23b0abc100a1 Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-ServersNegativeTestJSON-997886433-project Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0012c5a1-97ac-4287-bd77-a64b26274eca could not be found. Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0012c5a1-97ac-4287-bd77-a64b26274eca'} Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0012c5a1-97ac-4287-bd77-a64b26274eca could not be found. Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0012c5a1-97ac-4287-bd77-a64b26274eca could not be found. Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:28:45.190380 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0012c5a1-97ac-4287-bd77-a64b26274eca could not be found. Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] Returning 404 to user: Instance 0012c5a1-97ac-4287-bd77-a64b26274eca could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-19674893-9064-4a93-ba59-c64b1133d526 tempest-ServersNegativeTestJSON-997886433 tempest-ServersNegativeTestJSON-997886433-project] 10.222.0.113 "GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca" status: 404 len: 111 microversion: 2.1 time: 0.039402 Nov 02 14:28:45.194847 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4208/8048] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:28:45 2022] GET /compute/v2.1/servers/0012c5a1-97ac-4287-bd77-a64b26274eca => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:29:17.502930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:17.503809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:17.696282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e9d3e9f-d435-4b6f-9acb-59d87b35b3d6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Action: 'create', calling method: .version_select at 0x7fe78f8631f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2140191489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpM9GBh9uVbe0zDNJaX1HKF/rcwN2ByfDFEfUTAg6msMEmYb804cVHGBzQDQb/r1X4/Dz1+3OKq1lXo06Neqgxb0ANf7oWB3N0jt4m188njSdiu3IqaHlyN+SZnrY+BsA=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:17.713153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-8e9d3e9f-d435-4b6f-9acb-59d87b35b3d6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for project 80dd61660b954a2dbafc08598a17e835. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:29:17.720772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-8e9d3e9f-d435-4b6f-9acb-59d87b35b3d6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for user 35e538d1c6394ba3bfd9921ae3bd6ee1 and project 80dd61660b954a2dbafc08598a17e835. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:29:17.766668 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e9d3e9f-d435-4b6f-9acb-59d87b35b3d6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.269480 Nov 02 14:29:17.768206 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3841/8049] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:29:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:29:17.828369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-780267841", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2140191489", "networks": [{"uuid": "4b314bcc-a521-4244-bf23-e49272875e60"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:17.839001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=11 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:17.839973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=40 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:17.891710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] validate_networks() for [('4b314bcc-a521-4244-bf23-e49272875e60', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:29:18.335253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:29:18.335946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:29:18.336433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:29:18.336849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:29:18.337267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:29:18.347856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:18.348351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:18.348797 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:18.349534 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:18.349996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:18.350428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:18.370321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for project 80dd61660b954a2dbafc08598a17e835. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:29:18.376720 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for user 35e538d1c6394ba3bfd9921ae3bd6ee1 and project 80dd61660b954a2dbafc08598a17e835. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:29:18.390149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:29:18.393253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:29:18.443847 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-02927187-1f4d-4ecc-bb79-a9e3337dd0f7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.621013 Nov 02 14:29:18.444508 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4209/8050] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:29:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:29:18.456387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2284c910-0b30-4009-88f9-6f05a33d0495 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:18.457289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2284c910-0b30-4009-88f9-6f05a33d0495 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:18.514185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2284c910-0b30-4009-88f9-6f05a33d0495 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:18.522622 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2284c910-0b30-4009-88f9-6f05a33d0495 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1266 microversion: 2.1 time: 0.071019 Nov 02 14:29:18.523228 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3842/8051] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:18 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:19.546449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:19.547152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:19.560822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:19.562083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:19.562832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:19.563605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:19.564584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:19.565551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:19.678668 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:19.688336 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fb1b6cdb-dae9-48b4-b70b-517e7f5b9585 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1326 microversion: 2.1 time: 0.145910 Nov 02 14:29:19.688942 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4210/8052] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:19 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1326 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:20.713554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:20.714378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:20.722742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:20.723418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:20.723982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:20.724821 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:20.725398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:20.725949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:20.879358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:20.887409 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bd33b716-b34d-4467-b16f-2eb0cddfb1c8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1366 microversion: 2.1 time: 0.178315 Nov 02 14:29:20.888330 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3843/8053] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:20 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:21.069425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-c249b0eb-4135-442b-a51e-23b58b165093 req-198a4eb8-a011-4d92-a2ae-9f8563321853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2404fada-3957-4812-886e-3f0473dbac20", "tag": "14ec2549-226b-4e60-a3db-e48fe351740b"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:21.080690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c249b0eb-4135-442b-a51e-23b58b165093 req-198a4eb8-a011-4d92-a2ae-9f8563321853 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:21.081189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c249b0eb-4135-442b-a51e-23b58b165093 req-198a4eb8-a011-4d92-a2ae-9f8563321853 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:21.081783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-c249b0eb-4135-442b-a51e-23b58b165093 req-198a4eb8-a011-4d92-a2ae-9f8563321853 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:21.093780 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-c249b0eb-4135-442b-a51e-23b58b165093 req-198a4eb8-a011-4d92-a2ae-9f8563321853 service nova] Creating event network-changed:14ec2549-226b-4e60-a3db-e48fe351740b for instance 2404fada-3957-4812-886e-3f0473dbac20 on n-h2-858384-19 Nov 02 14:29:21.099620 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-c249b0eb-4135-442b-a51e-23b58b165093 req-198a4eb8-a011-4d92-a2ae-9f8563321853 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034023 Nov 02 14:29:21.100789 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4211/8054] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:21.913261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:21.914054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:21.921223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:21.921720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:21.922170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:21.922878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:21.923412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:21.923871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:22.067087 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:22.075377 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6d7cfa2d-6059-4c32-8bb5-c06be4a4f217 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1366 microversion: 2.1 time: 0.165964 Nov 02 14:29:22.075975 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3844/8055] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:21 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:23.101487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:23.102210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:23.110436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:23.111647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:23.112140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:23.113689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:23.113689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:23.114085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:23.276200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:23.284857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f692343c-2c4b-44a4-b629-86ea27ad87c4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1366 microversion: 2.1 time: 0.188589 Nov 02 14:29:23.285454 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4212/8056] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:23 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:24.308888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:24.310288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:24.318063 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:24.318570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:24.319028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:24.319816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:24.320388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:24.320835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:24.574602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:24.582842 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-21119455-79f4-44bb-94dd-0e22df078e43 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1366 microversion: 2.1 time: 0.277964 Nov 02 14:29:24.583453 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3845/8057] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:24 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:25.607290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:25.607869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:25.615588 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:25.616114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:25.616561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:25.617270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:25.617727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:25.618157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:25.803948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:25.811777 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-98099cf9-5b52-4ae0-941e-0cf04983485c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1366 microversion: 2.1 time: 0.209557 Nov 02 14:29:25.812343 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4213/8058] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:25 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:26.379558 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-022f6c00-c254-46a6-8718-d1fd0e2420db req-58d79746-6690-484e-8e1c-5817e24069b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2404fada-3957-4812-886e-3f0473dbac20", "name": "network-vif-plugged", "status": "completed", "tag": "14ec2549-226b-4e60-a3db-e48fe351740b"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:26.391701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-022f6c00-c254-46a6-8718-d1fd0e2420db req-58d79746-6690-484e-8e1c-5817e24069b2 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:26.392878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-022f6c00-c254-46a6-8718-d1fd0e2420db req-58d79746-6690-484e-8e1c-5817e24069b2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:26.393536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-022f6c00-c254-46a6-8718-d1fd0e2420db req-58d79746-6690-484e-8e1c-5817e24069b2 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:26.404780 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-022f6c00-c254-46a6-8718-d1fd0e2420db req-58d79746-6690-484e-8e1c-5817e24069b2 service nova] Creating event network-vif-plugged:14ec2549-226b-4e60-a3db-e48fe351740b for instance 2404fada-3957-4812-886e-3f0473dbac20 on n-h2-858384-19 Nov 02 14:29:26.410997 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-022f6c00-c254-46a6-8718-d1fd0e2420db req-58d79746-6690-484e-8e1c-5817e24069b2 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 Nov 02 14:29:26.411631 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3846/8059] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:26.835945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:26.836573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:26.843881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:26.844387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:26.844836 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:26.845676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:26.846043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:26.846481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:26.975610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:26.983666 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-244d09c7-5283-43ca-8a0f-56ed07448af3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1366 microversion: 2.1 time: 0.151758 Nov 02 14:29:26.984252 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4214/8060] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:26 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:28.008868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:28.009585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:28.015924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.016424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.016879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.017745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.018218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.018662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.155590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:28.163910 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2f078618-ddf4-48f8-8e7b-bdc8450d7ae5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1557 microversion: 2.1 time: 0.160470 Nov 02 14:29:28.164485 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3847/8061] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:28 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:28.187380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:28.188022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:28.195001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.195521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.195966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.196664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:28.197122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:28.197551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:28.331634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:28.339429 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ebf95bb4-9972-4a73-85cd-9db5f1a23323 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1557 microversion: 2.1 time: 0.156038 Nov 02 14:29:28.340006 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4215/8062] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:28 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:29.964044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e3a7656-c534-4836-b77c-134df54ef00c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1772aecd-1afc-484b-a252-a1639fa5d491"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:29.966522 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e3a7656-c534-4836-b77c-134df54ef00c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:29.968540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:29.974809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3a7656-c534-4836-b77c-134df54ef00c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:29.975420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3a7656-c534-4836-b77c-134df54ef00c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:29.975877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3a7656-c534-4836-b77c-134df54ef00c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:29.976596 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3a7656-c534-4836-b77c-134df54ef00c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:29.977067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3a7656-c534-4836-b77c-134df54ef00c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:29.977510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e3a7656-c534-4836-b77c-134df54ef00c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:30.218718 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e3a7656-c534-4836-b77c-134df54ef00c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "POST /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258530 Nov 02 14:29:30.219503 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3848/8063] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 14:29:29 2022] POST /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:40.946749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:40.947316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:40.949301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:40.949987 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:40.951698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:40.952343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=34 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:40.960110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:40.960606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:40.961053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:40.961773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:40.962235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:40.962672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.049545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lazy-loading 'services' on Instance uuid 2404fada-3957-4812-886e-3f0473dbac20 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:29:41.124231 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93f72fc0-4b32-4024-bc60-d36d1046f4ac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments/1772aecd-1afc-484b-a252-a1639fa5d491" status: 202 len: 0 microversion: 2.1 time: 0.181384 Nov 02 14:29:41.125202 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4216/8064] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:29:40 2022] DELETE /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments/1772aecd-1afc-484b-a252-a1639fa5d491 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:29:41.134502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b2fc8fe4-4fa7-4976-b45d-9ad63e30c066 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:41.136962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b2fc8fe4-4fa7-4976-b45d-9ad63e30c066 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:41.139958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:41.140724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:29:41.149681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fc8fe4-4fa7-4976-b45d-9ad63e30c066 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:41.150290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fc8fe4-4fa7-4976-b45d-9ad63e30c066 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:41.150813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fc8fe4-4fa7-4976-b45d-9ad63e30c066 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.151565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fc8fe4-4fa7-4976-b45d-9ad63e30c066 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:41.152035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fc8fe4-4fa7-4976-b45d-9ad63e30c066 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:41.152480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b2fc8fe4-4fa7-4976-b45d-9ad63e30c066 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:41.185296 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b2fc8fe4-4fa7-4976-b45d-9ad63e30c066 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055173 Nov 02 14:29:41.185871 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3849/8065] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:29:41 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:42.198734 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41862523-470e-48e1-9ad1-1a1b7d005eb4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:42.201151 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41862523-470e-48e1-9ad1-1a1b7d005eb4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:42.208347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41862523-470e-48e1-9ad1-1a1b7d005eb4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:42.208842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41862523-470e-48e1-9ad1-1a1b7d005eb4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:42.209284 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41862523-470e-48e1-9ad1-1a1b7d005eb4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:42.209994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41862523-470e-48e1-9ad1-1a1b7d005eb4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:42.210450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41862523-470e-48e1-9ad1-1a1b7d005eb4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:42.210903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41862523-470e-48e1-9ad1-1a1b7d005eb4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:42.243483 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41862523-470e-48e1-9ad1-1a1b7d005eb4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049175 Nov 02 14:29:42.244257 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4217/8066] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:29:42 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:43.256252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74206024-c181-444f-b645-ec48d92b5dc4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:43.258525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74206024-c181-444f-b645-ec48d92b5dc4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:43.265893 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74206024-c181-444f-b645-ec48d92b5dc4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:43.266402 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74206024-c181-444f-b645-ec48d92b5dc4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:43.266862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74206024-c181-444f-b645-ec48d92b5dc4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:43.268197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74206024-c181-444f-b645-ec48d92b5dc4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:43.268712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74206024-c181-444f-b645-ec48d92b5dc4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:43.269262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74206024-c181-444f-b645-ec48d92b5dc4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:43.301320 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74206024-c181-444f-b645-ec48d92b5dc4 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049153 Nov 02 14:29:43.301899 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3850/8067] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:29:43 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:44.314002 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3f1747d5-5dc7-4407-b8ad-3f66eeabd3c5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:44.316490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3f1747d5-5dc7-4407-b8ad-3f66eeabd3c5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:44.323447 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f1747d5-5dc7-4407-b8ad-3f66eeabd3c5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:44.323934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f1747d5-5dc7-4407-b8ad-3f66eeabd3c5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:44.324381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f1747d5-5dc7-4407-b8ad-3f66eeabd3c5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:44.325087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f1747d5-5dc7-4407-b8ad-3f66eeabd3c5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:44.325544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f1747d5-5dc7-4407-b8ad-3f66eeabd3c5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:44.325979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f1747d5-5dc7-4407-b8ad-3f66eeabd3c5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:44.358927 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3f1747d5-5dc7-4407-b8ad-3f66eeabd3c5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048953 Nov 02 14:29:44.359534 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4218/8068] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:29:44 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:45.371503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a4c47a80-e39f-4f59-90be-6c044ddb9017 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:45.373688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a4c47a80-e39f-4f59-90be-6c044ddb9017 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:45.381304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c47a80-e39f-4f59-90be-6c044ddb9017 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:45.381805 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c47a80-e39f-4f59-90be-6c044ddb9017 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:45.382264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c47a80-e39f-4f59-90be-6c044ddb9017 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:45.382982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c47a80-e39f-4f59-90be-6c044ddb9017 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:45.383560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c47a80-e39f-4f59-90be-6c044ddb9017 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:45.383927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a4c47a80-e39f-4f59-90be-6c044ddb9017 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:45.418611 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a4c47a80-e39f-4f59-90be-6c044ddb9017 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051130 Nov 02 14:29:45.419421 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3851/8069] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:29:45 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:46.431742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-68618474-a2a7-470a-8b91-77a95917473f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:46.433932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-68618474-a2a7-470a-8b91-77a95917473f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:46.440876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68618474-a2a7-470a-8b91-77a95917473f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.441361 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68618474-a2a7-470a-8b91-77a95917473f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.441809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68618474-a2a7-470a-8b91-77a95917473f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.442504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68618474-a2a7-470a-8b91-77a95917473f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.442962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68618474-a2a7-470a-8b91-77a95917473f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.443428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-68618474-a2a7-470a-8b91-77a95917473f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.472911 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-68618474-a2a7-470a-8b91-77a95917473f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045657 Nov 02 14:29:46.473478 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4219/8070] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:29:46 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:29:46.484519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:46.485066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:46.492557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.493059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.493516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.494228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:46.494701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:46.495181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:46.572250 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] HTTP exception thrown: Instance 2404fada-3957-4812-886e-3f0473dbac20 is not attached to volume 1772aecd-1afc-484b-a252-a1639fa5d491 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Request method failure captured: Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments/1772aecd-1afc-484b-a252-a1639fa5d491 HTTP/1.1 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn643A6TF89Uk4mq_w36zvrZq0c3LrNLv4Kc2xpQ3Z9zcYi9CO3hu-XjJ9R1DZrYkq_LMTRPPOJiHZGcfVYcJCpqy1jaJuj1GYF3U4FiUmKbbO3gg0jX8rj_BfxGTrzYkA3uIE0RNLPpowyl6PscC1U9ZhQj-O9qHUUbgCQJUBaWHcw Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_80dd61660b954a2dbafc08598a17e835"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 35e538d1c6394ba3bfd9921ae3bd6ee1 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 2404fada-3957-4812-886e-3f0473dbac20 is not attached to volume 1772aecd-1afc-484b-a252-a1639fa5d491 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': '2404fada-3957-4812-886e-3f0473dbac20', 'id': '1772aecd-1afc-484b-a252-a1639fa5d491'} Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1772aecd-1afc-484b-a252-a1639fa5d491. Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2404fada-3957-4812-886e-3f0473dbac20 is not attached to volume 1772aecd-1afc-484b-a252-a1639fa5d491 Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:29:46.586080 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:29:46.591094 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:29:46.591094 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:29:46.591094 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2404fada-3957-4812-886e-3f0473dbac20 is not attached to volume 1772aecd-1afc-484b-a252-a1639fa5d491 Nov 02 14:29:46.591094 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:46.591094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Returning 404 to user: Instance 2404fada-3957-4812-886e-3f0473dbac20 is not attached to volume 1772aecd-1afc-484b-a252-a1639fa5d491 {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:29:46.591094 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b9058c90-d8c4-4588-8da7-fc31747be644 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments/1772aecd-1afc-484b-a252-a1639fa5d491" status: 404 len: 154 microversion: 2.1 time: 0.107387 Nov 02 14:29:46.591094 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3852/8071] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:29:46 2022] DELETE /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20/os-volume_attachments/1772aecd-1afc-484b-a252-a1639fa5d491 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:29:49.938364 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:49.938940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:49.947080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:49.947605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:49.948036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:49.948757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:49.949211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:49.949639 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:49.979672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:29:50.062796 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-392f89c3-f2e7-4677-9235-40a37b9dfef3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 204 len: 0 microversion: 2.1 time: 0.128144 Nov 02 14:29:50.063640 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4220/8072] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:29:49 2022] DELETE /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:29:50.072153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:50.072719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:50.079616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:50.080673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:50.081391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:50.082121 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:50.082598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:50.083048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:50.225422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:50.234179 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d78ceebc-ad03-4c05-a8b8-ef67b980b3a8 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1563 microversion: 2.1 time: 0.166319 Nov 02 14:29:50.234756 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3853/8073] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:50 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:51.259022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:51.259685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:51.266875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:51.267442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:51.267892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:51.268602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:51.269069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:51.269498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:51.401449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:51.409876 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4d164ae1-cdef-4a8f-8cc7-46f4e1a32709 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1563 microversion: 2.1 time: 0.155633 Nov 02 14:29:51.410465 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4221/8074] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:51 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:52.248519 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4a4d1fe1-ab2e-40ca-baa8-7251bb0dd439 req-5dd42cfb-1d22-4b95-ae47-3e874c57b649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2404fada-3957-4812-886e-3f0473dbac20", "name": "network-vif-deleted", "tag": "14ec2549-226b-4e60-a3db-e48fe351740b"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:52.261372 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4a4d1fe1-ab2e-40ca-baa8-7251bb0dd439 req-5dd42cfb-1d22-4b95-ae47-3e874c57b649 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:52.261963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4a4d1fe1-ab2e-40ca-baa8-7251bb0dd439 req-5dd42cfb-1d22-4b95-ae47-3e874c57b649 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:52.262670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4a4d1fe1-ab2e-40ca-baa8-7251bb0dd439 req-5dd42cfb-1d22-4b95-ae47-3e874c57b649 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:52.277186 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4a4d1fe1-ab2e-40ca-baa8-7251bb0dd439 req-5dd42cfb-1d22-4b95-ae47-3e874c57b649 service nova] Creating event network-vif-deleted:14ec2549-226b-4e60-a3db-e48fe351740b for instance 2404fada-3957-4812-886e-3f0473dbac20 on n-h2-858384-19 Nov 02 14:29:52.288775 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4a4d1fe1-ab2e-40ca-baa8-7251bb0dd439 req-5dd42cfb-1d22-4b95-ae47-3e874c57b649 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044068 Nov 02 14:29:52.294166 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3854/8075] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:52.433553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:52.434198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:52.441660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:52.442141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:52.442579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:52.443363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:52.443768 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:52.444198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:52.479632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:52.480119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:52.480561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:52.481009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lazy-loading 'fault' on Instance uuid 2404fada-3957-4812-886e-3f0473dbac20 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:29:52.523468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:52.532248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-11854d83-4165-4b79-9194-f03c6a53257f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 200 len: 1356 microversion: 2.1 time: 0.102590 Nov 02 14:29:52.532854 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4222/8076] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:52 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:53.557091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:53.557815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 2404fada-3957-4812-886e-3f0473dbac20] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:53.565820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:53.566326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:53.566781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:53.567521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:53.567991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:53.568432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:53.583106 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] HTTP exception thrown: Instance 2404fada-3957-4812-886e-3f0473dbac20 could not be found. Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Request method failure captured: Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 HTTP/1.1 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn643A6TF89Uk4mq_w36zvrZq0c3LrNLv4Kc2xpQ3Z9zcYi9CO3hu-XjJ9R1DZrYkq_LMTRPPOJiHZGcfVYcJCpqy1jaJuj1GYF3U4FiUmKbbO3gg0jX8rj_BfxGTrzYkA3uIE0RNLPpowyl6PscC1U9ZhQj-O9qHUUbgCQJUBaWHcw Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_80dd61660b954a2dbafc08598a17e835"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 35e538d1c6394ba3bfd9921ae3bd6ee1 Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 2404fada-3957-4812-886e-3f0473dbac20 could not be found. Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '2404fada-3957-4812-886e-3f0473dbac20'} Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2404fada-3957-4812-886e-3f0473dbac20 could not be found. Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2404fada-3957-4812-886e-3f0473dbac20 could not be found. Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:29:53.584795 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2404fada-3957-4812-886e-3f0473dbac20 could not be found. Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Returning 404 to user: Instance 2404fada-3957-4812-886e-3f0473dbac20 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0025ec67-7c82-459c-b1fd-2f10c6a591de tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20" status: 404 len: 111 microversion: 2.1 time: 0.033507 Nov 02 14:29:53.589491 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3855/8077] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:53 2022] GET /compute/v2.1/servers/2404fada-3957-4812-886e-3f0473dbac20 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:29:53.595386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-842d85ae-aab7-4cc5-a252-562bff8cc081 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '.version_select at 0x7fe787886dc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:53.617658 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-842d85ae-aab7-4cc5-a252-562bff8cc081 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2140191489" status: 202 len: 0 microversion: 2.1 time: 0.026177 Nov 02 14:29:53.618518 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4223/8078] 10.222.0.113 () {58 vars in 1283 bytes} [Wed Nov 2 14:29:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2140191489 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:29:53.638520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f268c4c-e70f-469c-aefc-12414a6cc2a2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Action: 'create', calling method: .version_select at 0x7fe786d1fee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-104406776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY+E2bDeYlDNJTevuXQlJ2jwu9aVdQzwmztBs7wjFuEqr223GeKeetWmXtvJUbTekkD2Xqp5nhteNHgYLmGtY9zzgpiF9MGlqIAMAJgNhhzy+LfHt90qzYzoiq42ayWxQ=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:53.655036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9f268c4c-e70f-469c-aefc-12414a6cc2a2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for project 80dd61660b954a2dbafc08598a17e835. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:29:53.660329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-9f268c4c-e70f-469c-aefc-12414a6cc2a2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for user 35e538d1c6394ba3bfd9921ae3bd6ee1 and project 80dd61660b954a2dbafc08598a17e835. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:29:53.683604 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f268c4c-e70f-469c-aefc-12414a6cc2a2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051668 Nov 02 14:29:53.684251 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3856/8079] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:29:53 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:29:53.738437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-917504078", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-104406776", "networks": [{"uuid": "4b314bcc-a521-4244-bf23-e49272875e60"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:53.794891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] validate_networks() for [('4b314bcc-a521-4244-bf23-e49272875e60', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:29:54.178710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:29:54.179157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:29:54.179643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:29:54.180059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:29:54.180475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:29:54.189540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:54.190022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:54.190465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:54.191228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:54.191689 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:54.192117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:54.208979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for project 80dd61660b954a2dbafc08598a17e835. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:29:54.214318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for user 35e538d1c6394ba3bfd9921ae3bd6ee1 and project 80dd61660b954a2dbafc08598a17e835. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:29:54.227048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:29:54.229397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:29:54.277523 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4595cc07-f454-4776-ad4c-c769ae6ab73f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.544245 Nov 02 14:29:54.278443 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4224/8080] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:29:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:29:54.291043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6bb8ad76-ac71-48fa-9109-9e9d649c2f12 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:54.291706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6bb8ad76-ac71-48fa-9109-9e9d649c2f12 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:54.353791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6bb8ad76-ac71-48fa-9109-9e9d649c2f12 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:54.361165 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6bb8ad76-ac71-48fa-9109-9e9d649c2f12 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1265 microversion: 2.1 time: 0.074734 Nov 02 14:29:54.362259 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3857/8081] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:54 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1265 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:29:55.384906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:55.386333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:55.394744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:55.395264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:55.395706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:55.396415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:55.396871 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:55.397301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:55.474391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:55.482322 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e29cbaa7-1c65-4764-b840-c159f9658738 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1323 microversion: 2.1 time: 0.102036 Nov 02 14:29:55.482907 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4225/8082] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:55 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1323 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:56.506253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:56.506880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:56.513847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:56.514341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:56.514787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:56.515523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:56.515984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:56.516429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:56.639911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7780aa17-0097-42c3-bac4-6b5df687b671 req-2b326e94-f7de-4efd-87bf-888a03a72d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e24ef9f-9021-40ef-939d-8800abe41184", "tag": "4e85b430-9e54-48af-bac2-c11fc1481ace"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:29:56.652866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7780aa17-0097-42c3-bac4-6b5df687b671 req-2b326e94-f7de-4efd-87bf-888a03a72d33 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:56.653769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7780aa17-0097-42c3-bac4-6b5df687b671 req-2b326e94-f7de-4efd-87bf-888a03a72d33 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:56.654453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7780aa17-0097-42c3-bac4-6b5df687b671 req-2b326e94-f7de-4efd-87bf-888a03a72d33 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:56.660635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:56.668289 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7780aa17-0097-42c3-bac4-6b5df687b671 req-2b326e94-f7de-4efd-87bf-888a03a72d33 service nova] Creating event network-changed:4e85b430-9e54-48af-bac2-c11fc1481ace for instance 0e24ef9f-9021-40ef-939d-8800abe41184 on n-h2-858384-19 Nov 02 14:29:56.671054 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e0dcf372-d8cc-4afa-8193-dfdce22f8f2a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1365 microversion: 2.1 time: 0.169035 Nov 02 14:29:56.673316 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7780aa17-0097-42c3-bac4-6b5df687b671 req-2b326e94-f7de-4efd-87bf-888a03a72d33 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037347 Nov 02 14:29:56.674369 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4226/8083] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:29:56.675448 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3858/8084] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:56 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:57.697511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:57.698242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:57.704441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:57.705437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:57.705873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:57.706561 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:57.707011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:57.707465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:57.846452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:57.854366 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f09ca8e3-6ce9-452f-a9e4-33f7ebfad2ca tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1365 microversion: 2.1 time: 0.162012 Nov 02 14:29:57.854946 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4227/8085] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:57 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:29:58.877698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:29:58.878251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:29:58.885336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:58.885828 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:58.886271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:58.886973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:29:58.887464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:29:58.887901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:29:59.019261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:29:59.026548 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a7f9d927-67c7-443f-b90a-d417f8f7ca7f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1365 microversion: 2.1 time: 0.153563 Nov 02 14:29:59.027141 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3859/8086] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:29:58 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:00.050171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:00.050790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:00.057982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:00.058483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:00.058931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:00.059694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:00.060161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:00.060600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:00.191140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:00.198861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3f7efaea-5019-4ca0-9887-e52b5163503a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1365 microversion: 2.1 time: 0.152798 Nov 02 14:30:00.199488 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4228/8087] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:00 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:01.222474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:01.223335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:01.230422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:01.231049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:01.231818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:01.232540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:01.233007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:01.233484 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:01.374306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:01.382871 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee9b55ee-1fae-4c6f-8dbc-4b52302a7904 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1365 microversion: 2.1 time: 0.164918 Nov 02 14:30:01.383500 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3860/8088] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:01 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:02.405958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:02.406575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:02.413504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:02.413990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:02.414429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:02.415146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:02.415608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:02.416036 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:02.567622 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e235a970-3e2a-4a1f-b192-c95b812a6a63 req-a65ab2b7-f9e5-466e-a324-c6b63d142afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e24ef9f-9021-40ef-939d-8800abe41184", "name": "network-vif-plugged", "status": "completed", "tag": "4e85b430-9e54-48af-bac2-c11fc1481ace"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:02.569035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:02.577336 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-37b8092e-0dc7-48c9-ad25-86da88c2f661 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1365 microversion: 2.1 time: 0.175251 Nov 02 14:30:02.577757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e235a970-3e2a-4a1f-b192-c95b812a6a63 req-a65ab2b7-f9e5-466e-a324-c6b63d142afe service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:02.577939 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4229/8089] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:02 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:02.578257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e235a970-3e2a-4a1f-b192-c95b812a6a63 req-a65ab2b7-f9e5-466e-a324-c6b63d142afe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:02.578833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e235a970-3e2a-4a1f-b192-c95b812a6a63 req-a65ab2b7-f9e5-466e-a324-c6b63d142afe service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:02.592811 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e235a970-3e2a-4a1f-b192-c95b812a6a63 req-a65ab2b7-f9e5-466e-a324-c6b63d142afe service nova] Creating event network-vif-plugged:4e85b430-9e54-48af-bac2-c11fc1481ace for instance 0e24ef9f-9021-40ef-939d-8800abe41184 on n-h2-858384-19 Nov 02 14:30:02.598434 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e235a970-3e2a-4a1f-b192-c95b812a6a63 req-a65ab2b7-f9e5-466e-a324-c6b63d142afe service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102089 Nov 02 14:30:02.599032 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3861/8090] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:03.601356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:03.601894 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:03.609096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:03.609620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:03.610124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:03.610766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:03.611269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:03.611746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:03.748252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:03.756066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-52d279a4-799e-4dd2-bf35-ef3d8db1393e tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1365 microversion: 2.1 time: 0.158745 Nov 02 14:30:03.756671 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4230/8091] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:03 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:30:04.777977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:04.782162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:04.783064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:04.789938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:04.790429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:04.790873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:04.791606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:04.792068 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:04.792509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:04.924405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:04.932161 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4193797d-3416-4393-ac40-0bd6bc1ad726 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1556 microversion: 2.1 time: 0.155992 Nov 02 14:30:04.932733 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3862/8092] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:04 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:04.955212 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:04.956477 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:04.958464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:04.959161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:04.966224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:04.966727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:04.967211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:04.967938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:04.968401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:04.968843 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:05.105511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:05.114115 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-825703d5-87d1-4cd5-954e-1dc103ec8ec3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1556 microversion: 2.1 time: 0.162887 Nov 02 14:30:05.114693 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4231/8093] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:04 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:06.620496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2cb6ade1-ade7-4566-962e-7191a63ca53f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e414daac-e34c-446b-8f1f-fc19d09343aa"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:06.622844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2cb6ade1-ade7-4566-962e-7191a63ca53f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:06.630368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cb6ade1-ade7-4566-962e-7191a63ca53f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:06.630860 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cb6ade1-ade7-4566-962e-7191a63ca53f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:06.631336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cb6ade1-ade7-4566-962e-7191a63ca53f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:06.632043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cb6ade1-ade7-4566-962e-7191a63ca53f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:06.632502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cb6ade1-ade7-4566-962e-7191a63ca53f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:06.632934 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2cb6ade1-ade7-4566-962e-7191a63ca53f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:06.874481 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2cb6ade1-ade7-4566-962e-7191a63ca53f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "POST /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258074 Nov 02 14:30:06.875006 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3863/8094] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 14:30:06 2022] POST /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:17.594814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:17.595373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:17.598309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:17.599202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:17.605108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:17.605603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:17.606050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:17.607038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:17.607531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:17.607965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:17.692597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lazy-loading 'services' on Instance uuid 0e24ef9f-9021-40ef-939d-8800abe41184 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:30:17.764934 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7b6558de-abaf-463d-a4c7-0526659cff60 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments/e414daac-e34c-446b-8f1f-fc19d09343aa" status: 202 len: 0 microversion: 2.1 time: 0.174069 Nov 02 14:30:17.765621 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4232/8095] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:30:17 2022] DELETE /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments/e414daac-e34c-446b-8f1f-fc19d09343aa => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:30:17.772977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:17.773761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:17.777996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b81361bb-36b1-44ed-9765-012699d08b92 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:17.780316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b81361bb-36b1-44ed-9765-012699d08b92 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:17.788499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b81361bb-36b1-44ed-9765-012699d08b92 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:17.788998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b81361bb-36b1-44ed-9765-012699d08b92 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:17.789444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b81361bb-36b1-44ed-9765-012699d08b92 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:17.790151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b81361bb-36b1-44ed-9765-012699d08b92 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:17.790623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b81361bb-36b1-44ed-9765-012699d08b92 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:17.791061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b81361bb-36b1-44ed-9765-012699d08b92 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:17.822312 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b81361bb-36b1-44ed-9765-012699d08b92 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051317 Nov 02 14:30:17.825818 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3864/8096] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:17 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:18.837937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c8c0d117-2dcc-4495-94d3-d09de85b5294 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:18.840506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c8c0d117-2dcc-4495-94d3-d09de85b5294 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:18.846879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8c0d117-2dcc-4495-94d3-d09de85b5294 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:18.847650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8c0d117-2dcc-4495-94d3-d09de85b5294 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:18.848303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8c0d117-2dcc-4495-94d3-d09de85b5294 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:18.849020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8c0d117-2dcc-4495-94d3-d09de85b5294 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:18.849486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8c0d117-2dcc-4495-94d3-d09de85b5294 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:18.849962 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c8c0d117-2dcc-4495-94d3-d09de85b5294 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:18.884177 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c8c0d117-2dcc-4495-94d3-d09de85b5294 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052312 Nov 02 14:30:18.884177 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4233/8097] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:18 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:19.897947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-2ca999ec-1142-4dec-8220-b3fdd7c0a0a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:19.900156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-2ca999ec-1142-4dec-8220-b3fdd7c0a0a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:19.906914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca999ec-1142-4dec-8220-b3fdd7c0a0a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:19.907445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca999ec-1142-4dec-8220-b3fdd7c0a0a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:19.907902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca999ec-1142-4dec-8220-b3fdd7c0a0a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:19.908631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca999ec-1142-4dec-8220-b3fdd7c0a0a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:19.909104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca999ec-1142-4dec-8220-b3fdd7c0a0a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:19.909556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-2ca999ec-1142-4dec-8220-b3fdd7c0a0a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:19.943279 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-2ca999ec-1142-4dec-8220-b3fdd7c0a0a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050380 Nov 02 14:30:19.944079 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3865/8098] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:19 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:20.956028 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-231f35be-36ea-4b0e-a636-01913f7864f9 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:20.958801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-231f35be-36ea-4b0e-a636-01913f7864f9 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:20.966730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231f35be-36ea-4b0e-a636-01913f7864f9 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:20.967247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231f35be-36ea-4b0e-a636-01913f7864f9 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:20.967698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231f35be-36ea-4b0e-a636-01913f7864f9 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:20.968407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231f35be-36ea-4b0e-a636-01913f7864f9 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:20.968870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231f35be-36ea-4b0e-a636-01913f7864f9 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:20.969310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-231f35be-36ea-4b0e-a636-01913f7864f9 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:21.001520 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-231f35be-36ea-4b0e-a636-01913f7864f9 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049666 Nov 02 14:30:21.002108 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4234/8099] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:20 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:22.015520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1ed0e49b-5fc3-4968-b4e2-4e321bf0b3fd tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:22.017615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1ed0e49b-5fc3-4968-b4e2-4e321bf0b3fd tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:22.024758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ed0e49b-5fc3-4968-b4e2-4e321bf0b3fd tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:22.025255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ed0e49b-5fc3-4968-b4e2-4e321bf0b3fd tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:22.025704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ed0e49b-5fc3-4968-b4e2-4e321bf0b3fd tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:22.026421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ed0e49b-5fc3-4968-b4e2-4e321bf0b3fd tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:22.026877 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ed0e49b-5fc3-4968-b4e2-4e321bf0b3fd tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:22.027342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1ed0e49b-5fc3-4968-b4e2-4e321bf0b3fd tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:22.058545 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1ed0e49b-5fc3-4968-b4e2-4e321bf0b3fd tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047129 Nov 02 14:30:22.059141 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3866/8100] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:22 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:23.071822 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c9c37ea9-17d5-4b56-840f-c6aa7cc630c0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:23.074039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c9c37ea9-17d5-4b56-840f-c6aa7cc630c0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:23.081059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9c37ea9-17d5-4b56-840f-c6aa7cc630c0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:23.081541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9c37ea9-17d5-4b56-840f-c6aa7cc630c0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:23.082307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9c37ea9-17d5-4b56-840f-c6aa7cc630c0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:23.083010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9c37ea9-17d5-4b56-840f-c6aa7cc630c0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:23.083496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9c37ea9-17d5-4b56-840f-c6aa7cc630c0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:23.083928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c9c37ea9-17d5-4b56-840f-c6aa7cc630c0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:23.113695 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c9c37ea9-17d5-4b56-840f-c6aa7cc630c0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045546 Nov 02 14:30:23.114263 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4235/8101] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:23 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:30:23.124963 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:23.125504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:23.133345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:23.133843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:23.134298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:23.135005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:23.135508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:23.135951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:23.214078 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] HTTP exception thrown: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 is not attached to volume e414daac-e34c-446b-8f1f-fc19d09343aa Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Request method failure captured: Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments/e414daac-e34c-446b-8f1f-fc19d09343aa HTTP/1.1 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn643A6TF89Uk4mq_w36zvrZq0c3LrNLv4Kc2xpQ3Z9zcYi9CO3hu-XjJ9R1DZrYkq_LMTRPPOJiHZGcfVYcJCpqy1jaJuj1GYF3U4FiUmKbbO3gg0jX8rj_BfxGTrzYkA3uIE0RNLPpowyl6PscC1U9ZhQj-O9qHUUbgCQJUBaWHcw Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_80dd61660b954a2dbafc08598a17e835"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 35e538d1c6394ba3bfd9921ae3bd6ee1 Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 is not attached to volume e414daac-e34c-446b-8f1f-fc19d09343aa Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': '0e24ef9f-9021-40ef-939d-8800abe41184', 'id': 'e414daac-e34c-446b-8f1f-fc19d09343aa'} Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e414daac-e34c-446b-8f1f-fc19d09343aa. Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 is not attached to volume e414daac-e34c-446b-8f1f-fc19d09343aa Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:23.215728 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:23.220319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:30:23.220319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:30:23.220319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 is not attached to volume e414daac-e34c-446b-8f1f-fc19d09343aa Nov 02 14:30:23.220319 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:23.220319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Returning 404 to user: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 is not attached to volume e414daac-e34c-446b-8f1f-fc19d09343aa {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:30:23.220319 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9716a238-8346-4347-a9ba-8c49638bade1 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments/e414daac-e34c-446b-8f1f-fc19d09343aa" status: 404 len: 154 microversion: 2.1 time: 0.096329 Nov 02 14:30:23.220319 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3867/8102] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:30:23 2022] DELETE /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184/os-volume_attachments/e414daac-e34c-446b-8f1f-fc19d09343aa => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:30:26.581778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:26.582358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:26.589573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:26.590060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:26.590504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:26.591236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:26.591691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:26.592121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:26.623527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:30:26.706321 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-50bbb4ac-8bea-487f-a7b5-b6ab1a2722e7 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 204 len: 0 microversion: 2.1 time: 0.128068 Nov 02 14:30:26.707867 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4236/8103] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:30:26 2022] DELETE /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:30:26.716205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:26.717004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:26.724426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:26.724930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:26.725380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:26.726098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:26.726561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:26.727032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:26.868242 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:26.876288 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aa9990f5-bc1f-469b-a5a3-ad6d2dc784d3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1562 microversion: 2.1 time: 0.164163 Nov 02 14:30:26.876868 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3868/8104] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:26 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:27.900643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:27.901281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:27.908255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:27.908743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:27.909189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:27.910571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:27.911055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:27.911523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:28.042722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:28.050735 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90198eea-8324-4b36-98fa-a14573156a47 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1562 microversion: 2.1 time: 0.154540 Nov 02 14:30:28.051396 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4237/8105] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:27 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:29.074863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:29.075531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:29.094047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:29.094651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:29.095281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:29.096095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:29.096745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:29.098067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:29.116893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3b965579-53ba-4a61-a4b2-a85d2161b589 req-dcc7995e-3cff-44e9-8401-6b21009d7b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e24ef9f-9021-40ef-939d-8800abe41184", "name": "network-vif-deleted", "tag": "4e85b430-9e54-48af-bac2-c11fc1481ace"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:29.132366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3b965579-53ba-4a61-a4b2-a85d2161b589 req-dcc7995e-3cff-44e9-8401-6b21009d7b62 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:29.133647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3b965579-53ba-4a61-a4b2-a85d2161b589 req-dcc7995e-3cff-44e9-8401-6b21009d7b62 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:29.134303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3b965579-53ba-4a61-a4b2-a85d2161b589 req-dcc7995e-3cff-44e9-8401-6b21009d7b62 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:29.173874 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3b965579-53ba-4a61-a4b2-a85d2161b589 req-dcc7995e-3cff-44e9-8401-6b21009d7b62 service nova] Creating event network-vif-deleted:4e85b430-9e54-48af-bac2-c11fc1481ace for instance 0e24ef9f-9021-40ef-939d-8800abe41184 on n-h2-858384-19 Nov 02 14:30:29.179813 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3b965579-53ba-4a61-a4b2-a85d2161b589 req-dcc7995e-3cff-44e9-8401-6b21009d7b62 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070673 Nov 02 14:30:29.181140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4238/8106] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:29.185235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:29.198669 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7fbd2837-e134-4692-8335-b9790ae1a164 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 200 len: 1520 microversion: 2.1 time: 0.127726 Nov 02 14:30:29.199309 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3869/8107] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:29 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 1520 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:30.229070 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:30.229845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: 0e24ef9f-9021-40ef-939d-8800abe41184] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:30.236402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:30.236881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:30.237318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:30.238014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:30.238618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:30.239042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:30.252292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] HTTP exception thrown: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 could not be found. Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Request method failure captured: Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 HTTP/1.1 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYn643A6TF89Uk4mq_w36zvrZq0c3LrNLv4Kc2xpQ3Z9zcYi9CO3hu-XjJ9R1DZrYkq_LMTRPPOJiHZGcfVYcJCpqy1jaJuj1GYF3U4FiUmKbbO3gg0jX8rj_BfxGTrzYkA3uIE0RNLPpowyl6PscC1U9ZhQj-O9qHUUbgCQJUBaWHcw Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_80dd61660b954a2dbafc08598a17e835"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 35e538d1c6394ba3bfd9921ae3bd6ee1 Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 could not be found. Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '0e24ef9f-9021-40ef-939d-8800abe41184'} Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 could not be found. Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 could not be found. Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:30.254591 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 could not be found. Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Returning 404 to user: Instance 0e24ef9f-9021-40ef-939d-8800abe41184 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-db006235-80ff-4c71-8c32-0c0bc22c853b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184" status: 404 len: 111 microversion: 2.1 time: 0.032399 Nov 02 14:30:30.262896 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4239/8108] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:30 2022] GET /compute/v2.1/servers/0e24ef9f-9021-40ef-939d-8800abe41184 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:30:30.266765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d9aeeb4d-d712-4a7f-bb04-992014781944 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '.version_select at 0x7fe786954ca0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:30.288060 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d9aeeb4d-d712-4a7f-bb04-992014781944 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-104406776" status: 202 len: 0 microversion: 2.1 time: 0.026606 Nov 02 14:30:30.288655 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3870/8109] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 14:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-104406776 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:30:30.306878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47ccccbf-b756-4e09-8088-9ea0c80692a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Action: 'create', calling method: .version_select at 0x7fe786ee9c10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-350405253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvKsTQV2JZcQdG91BH+ESjfL7vepomPUYkFlKkV5VvE6J2EAjdpgQUghNhlLazM81+E2PMWtS16xoRyQA8EMx9tEdyq7MgdIo2qswI9b0Al4tK3c6owgOVNmkqNxcag7g=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:30.323278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-47ccccbf-b756-4e09-8088-9ea0c80692a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for project 80dd61660b954a2dbafc08598a17e835. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:30:30.328379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-47ccccbf-b756-4e09-8088-9ea0c80692a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for user 35e538d1c6394ba3bfd9921ae3bd6ee1 and project 80dd61660b954a2dbafc08598a17e835. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:30:30.352270 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47ccccbf-b756-4e09-8088-9ea0c80692a6 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049624 Nov 02 14:30:30.352910 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4240/8110] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:30:30 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:30.403260 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1222518131", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-350405253", "networks": [{"uuid": "4b314bcc-a521-4244-bf23-e49272875e60"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:30.459494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] validate_networks() for [('4b314bcc-a521-4244-bf23-e49272875e60', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:30:30.836529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:30:30.836953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:30:30.837442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:30:30.837868 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:30:30.838300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:30:30.847175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:30.847676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:30.848128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:30.848872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:30.849339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:30.849780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:30.867851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for project 80dd61660b954a2dbafc08598a17e835. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:30:30.873296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Getting quotas for user 35e538d1c6394ba3bfd9921ae3bd6ee1 and project 80dd61660b954a2dbafc08598a17e835. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:30:30.886328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:30:30.888666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:30:30.935764 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0b454229-0c6f-4138-8082-b88a34094611 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.536513 Nov 02 14:30:30.936415 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3871/8111] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:30:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:30:30.948444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0a33b193-44c3-4e9d-b8aa-c003519c59b5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:30.949059 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0a33b193-44c3-4e9d-b8aa-c003519c59b5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:31.007870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0a33b193-44c3-4e9d-b8aa-c003519c59b5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:31.014774 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0a33b193-44c3-4e9d-b8aa-c003519c59b5 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1266 microversion: 2.1 time: 0.070345 Nov 02 14:30:31.015394 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4241/8112] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:30 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:32.039216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:32.040473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:32.048386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:32.048894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:32.049349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:32.050066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:32.051285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:32.051733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:32.114889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:32.122552 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-999052c3-c70e-4325-845d-9cb693a9bf90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1324 microversion: 2.1 time: 0.088915 Nov 02 14:30:32.123147 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3872/8113] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:32 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1324 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:33.145961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:33.146578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:33.153415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:33.153900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:33.154340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:33.155043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:33.155523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:33.155954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:33.324103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-afe9b15b-d945-4dad-87b7-a3f06643292d req-4f15d93b-8726-4f94-b520-90c4cd9b52d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20959bd-b82a-4057-b9f0-66cb5c079278", "tag": "72abe312-dca5-4ce9-8d41-ec37676c6959"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:33.336537 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-afe9b15b-d945-4dad-87b7-a3f06643292d req-4f15d93b-8726-4f94-b520-90c4cd9b52d5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:33.337038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-afe9b15b-d945-4dad-87b7-a3f06643292d req-4f15d93b-8726-4f94-b520-90c4cd9b52d5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:33.337529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-afe9b15b-d945-4dad-87b7-a3f06643292d req-4f15d93b-8726-4f94-b520-90c4cd9b52d5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:33.350457 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-afe9b15b-d945-4dad-87b7-a3f06643292d req-4f15d93b-8726-4f94-b520-90c4cd9b52d5 service nova] Creating event network-changed:72abe312-dca5-4ce9-8d41-ec37676c6959 for instance f20959bd-b82a-4057-b9f0-66cb5c079278 on n-h2-858384-19 Nov 02 14:30:33.355601 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-afe9b15b-d945-4dad-87b7-a3f06643292d req-4f15d93b-8726-4f94-b520-90c4cd9b52d5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035406 Nov 02 14:30:33.356218 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3873/8114] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:33.411807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:33.420064 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c3a1eb07-bde2-49ca-87bf-6f3dba0092f2 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1366 microversion: 2.1 time: 0.278352 Nov 02 14:30:33.420663 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4242/8115] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:33 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:34.445609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:34.446327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:34.452577 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:34.453081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:34.453536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:34.454236 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:34.454703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:34.455168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:34.593954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:34.602418 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-83992a4c-1ad3-4ab0-a3f4-ba1bc4ee0696 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1366 microversion: 2.1 time: 0.162688 Nov 02 14:30:34.603006 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3874/8116] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:34 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:35.626450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:35.626994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:35.634507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:35.635046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:35.635526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:35.636229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:35.636688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:35.637123 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:35.767997 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:35.776906 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8bb0db95-0386-4522-9c2e-1f8fc8a94673 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1366 microversion: 2.1 time: 0.154533 Nov 02 14:30:35.777496 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4243/8117] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:35 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:36.800983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:36.801619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:36.808506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:36.808990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:36.809435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:36.810139 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:36.810604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:36.811042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:36.944044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:36.951694 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4d541d5e-50f4-497f-9feb-1e0424a61730 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1366 microversion: 2.1 time: 0.154669 Nov 02 14:30:36.952276 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3875/8118] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:36 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:30:37.976645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:37.977289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:37.984747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:37.985233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:37.985674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:37.986393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:37.986851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:37.987314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:38.132473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:38.140669 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce372c49-82d0-44b0-8459-5018b5b84404 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1366 microversion: 2.1 time: 0.168183 Nov 02 14:30:38.141278 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4244/8119] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:37 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:38.672654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6415ec9a-e639-486f-89e0-d170e52f1f7d req-61e97d6d-b600-4e0f-a5a6-ff7a0948c22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20959bd-b82a-4057-b9f0-66cb5c079278", "name": "network-vif-plugged", "status": "completed", "tag": "72abe312-dca5-4ce9-8d41-ec37676c6959"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:38.685566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6415ec9a-e639-486f-89e0-d170e52f1f7d req-61e97d6d-b600-4e0f-a5a6-ff7a0948c22c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:38.686272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6415ec9a-e639-486f-89e0-d170e52f1f7d req-61e97d6d-b600-4e0f-a5a6-ff7a0948c22c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:38.686762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6415ec9a-e639-486f-89e0-d170e52f1f7d req-61e97d6d-b600-4e0f-a5a6-ff7a0948c22c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:38.699219 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6415ec9a-e639-486f-89e0-d170e52f1f7d req-61e97d6d-b600-4e0f-a5a6-ff7a0948c22c service nova] Creating event network-vif-plugged:72abe312-dca5-4ce9-8d41-ec37676c6959 for instance f20959bd-b82a-4057-b9f0-66cb5c079278 on n-h2-858384-19 Nov 02 14:30:38.704160 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6415ec9a-e639-486f-89e0-d170e52f1f7d req-61e97d6d-b600-4e0f-a5a6-ff7a0948c22c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035266 Nov 02 14:30:38.704764 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3876/8120] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:39.164325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:39.164946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:39.171850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:39.172337 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:39.172781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:39.173478 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:39.173933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:39.174368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:39.306082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:39.313823 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-273e8910-7486-4ea5-8bef-0aa3c7c19333 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1366 microversion: 2.1 time: 0.154008 Nov 02 14:30:39.314375 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4245/8121] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:39 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:40.337138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:40.337864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:40.344632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:40.345162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:40.345611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:40.346320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:40.346786 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:40.347262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:40.477907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:40.486044 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5d10d4a8-d552-4654-b7cb-b09940ac5193 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1557 microversion: 2.1 time: 0.153445 Nov 02 14:30:40.486622 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3877/8122] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:40 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:40.509466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:40.510086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:40.517066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:40.517552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:40.517995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:40.518694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:40.519172 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:40.519610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:40.653557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:30:40.661857 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-663f4f41-4d8d-4c4d-8eda-622ed53209f3 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1557 microversion: 2.1 time: 0.156482 Nov 02 14:30:40.662463 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4246/8123] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:30:40 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:30:42.158944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9937feb8-efb2-405f-8b1d-f6d66d85aa1a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5fa16bd-5e8f-4326-b498-0ad593fda3b1"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:30:42.161507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9937feb8-efb2-405f-8b1d-f6d66d85aa1a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:42.163501 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:42.164193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:42.171101 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9937feb8-efb2-405f-8b1d-f6d66d85aa1a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:42.171618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9937feb8-efb2-405f-8b1d-f6d66d85aa1a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:42.172075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9937feb8-efb2-405f-8b1d-f6d66d85aa1a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:42.172905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9937feb8-efb2-405f-8b1d-f6d66d85aa1a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:42.173378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9937feb8-efb2-405f-8b1d-f6d66d85aa1a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:42.173818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9937feb8-efb2-405f-8b1d-f6d66d85aa1a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:42.407846 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9937feb8-efb2-405f-8b1d-f6d66d85aa1a tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "POST /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252804 Nov 02 14:30:42.408775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3878/8124] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 14:30:42 2022] POST /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:53.331097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:53.331670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:53.334583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:53.335423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:53.336211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:53.342525 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:53.343206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:53.343486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:53.344199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:53.344652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:53.345083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:53.435976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lazy-loading 'services' on Instance uuid f20959bd-b82a-4057-b9f0-66cb5c079278 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:30:53.510618 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3a2313ef-a98f-46a6-a0c3-683736271ebc tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments/b5fa16bd-5e8f-4326-b498-0ad593fda3b1" status: 202 len: 0 microversion: 2.1 time: 0.183267 Nov 02 14:30:53.511379 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4247/8125] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:30:53 2022] DELETE /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments/b5fa16bd-5e8f-4326-b498-0ad593fda3b1 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:30:53.520192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-15c6cf27-0123-43f6-977e-ca59bef55341 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:53.522564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-15c6cf27-0123-43f6-977e-ca59bef55341 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:53.526641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:53.527474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:30:53.531276 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf27-0123-43f6-977e-ca59bef55341 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:53.531780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf27-0123-43f6-977e-ca59bef55341 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:53.532231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf27-0123-43f6-977e-ca59bef55341 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:53.532947 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf27-0123-43f6-977e-ca59bef55341 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:53.533670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf27-0123-43f6-977e-ca59bef55341 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:53.534340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-15c6cf27-0123-43f6-977e-ca59bef55341 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:53.572904 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-15c6cf27-0123-43f6-977e-ca59bef55341 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056964 Nov 02 14:30:53.578133 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3879/8126] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:53 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:54.588449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ea9fb910-6174-4d1c-893f-e95c181d6ef0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:54.590847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ea9fb910-6174-4d1c-893f-e95c181d6ef0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:54.597207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea9fb910-6174-4d1c-893f-e95c181d6ef0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:54.597682 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea9fb910-6174-4d1c-893f-e95c181d6ef0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:54.598760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea9fb910-6174-4d1c-893f-e95c181d6ef0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:54.599569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea9fb910-6174-4d1c-893f-e95c181d6ef0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:54.599953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea9fb910-6174-4d1c-893f-e95c181d6ef0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:54.600382 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ea9fb910-6174-4d1c-893f-e95c181d6ef0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:54.633027 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ea9fb910-6174-4d1c-893f-e95c181d6ef0 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050869 Nov 02 14:30:54.633622 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4248/8127] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:54 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:55.647092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cce1bd72-4345-4500-ad71-06d109890a74 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:55.649552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cce1bd72-4345-4500-ad71-06d109890a74 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:55.656833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cce1bd72-4345-4500-ad71-06d109890a74 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:55.657340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cce1bd72-4345-4500-ad71-06d109890a74 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:55.657793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cce1bd72-4345-4500-ad71-06d109890a74 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:55.658513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cce1bd72-4345-4500-ad71-06d109890a74 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:55.658981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cce1bd72-4345-4500-ad71-06d109890a74 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:55.659454 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cce1bd72-4345-4500-ad71-06d109890a74 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:55.693592 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cce1bd72-4345-4500-ad71-06d109890a74 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052165 Nov 02 14:30:55.694201 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3880/8128] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:55 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:56.706248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c45a9a0-b49d-4f4c-8f68-f4a01de91455 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:56.708436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0c45a9a0-b49d-4f4c-8f68-f4a01de91455 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:56.715349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c45a9a0-b49d-4f4c-8f68-f4a01de91455 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:56.715838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c45a9a0-b49d-4f4c-8f68-f4a01de91455 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:56.716281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c45a9a0-b49d-4f4c-8f68-f4a01de91455 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:56.717098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c45a9a0-b49d-4f4c-8f68-f4a01de91455 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:56.717562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c45a9a0-b49d-4f4c-8f68-f4a01de91455 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:56.717996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c45a9a0-b49d-4f4c-8f68-f4a01de91455 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:56.749309 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c45a9a0-b49d-4f4c-8f68-f4a01de91455 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047214 Nov 02 14:30:56.750127 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4249/8129] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:56 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:57.762100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f7aaeb5e-72e6-46cd-a491-0d06ad37e087 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:57.764336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f7aaeb5e-72e6-46cd-a491-0d06ad37e087 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:57.771463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7aaeb5e-72e6-46cd-a491-0d06ad37e087 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:57.771962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7aaeb5e-72e6-46cd-a491-0d06ad37e087 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:57.772443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7aaeb5e-72e6-46cd-a491-0d06ad37e087 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:57.773557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7aaeb5e-72e6-46cd-a491-0d06ad37e087 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:57.774034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7aaeb5e-72e6-46cd-a491-0d06ad37e087 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:57.774473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7aaeb5e-72e6-46cd-a491-0d06ad37e087 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:57.810305 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f7aaeb5e-72e6-46cd-a491-0d06ad37e087 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052354 Nov 02 14:30:57.810879 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3881/8130] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:57 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:30:58.822373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-66d87d15-f9e6-4dec-a85b-61570544cf41 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:58.824550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-66d87d15-f9e6-4dec-a85b-61570544cf41 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:58.831500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d87d15-f9e6-4dec-a85b-61570544cf41 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:58.831993 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d87d15-f9e6-4dec-a85b-61570544cf41 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:58.832459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d87d15-f9e6-4dec-a85b-61570544cf41 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:58.833235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d87d15-f9e6-4dec-a85b-61570544cf41 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:58.833753 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d87d15-f9e6-4dec-a85b-61570544cf41 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:58.834126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66d87d15-f9e6-4dec-a85b-61570544cf41 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:58.867871 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-66d87d15-f9e6-4dec-a85b-61570544cf41 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049555 Nov 02 14:30:58.868391 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4250/8131] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:30:58 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 14:30:58.879092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:30:58.879751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:30:58.886496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:58.886987 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:58.887471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:58.888172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:30:58.888636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:30:58.889075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:30:58.966282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] HTTP exception thrown: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 is not attached to volume b5fa16bd-5e8f-4326-b498-0ad593fda3b1 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Request method failure captured: Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments/b5fa16bd-5e8f-4326-b498-0ad593fda3b1 HTTP/1.1 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn643A6TF89Uk4mq_w36zvrZq0c3LrNLv4Kc2xpQ3Z9zcYi9CO3hu-XjJ9R1DZrYkq_LMTRPPOJiHZGcfVYcJCpqy1jaJuj1GYF3U4FiUmKbbO3gg0jX8rj_BfxGTrzYkA3uIE0RNLPpowyl6PscC1U9ZhQj-O9qHUUbgCQJUBaWHcw Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_80dd61660b954a2dbafc08598a17e835"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 35e538d1c6394ba3bfd9921ae3bd6ee1 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 is not attached to volume b5fa16bd-5e8f-4326-b498-0ad593fda3b1 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': 'f20959bd-b82a-4057-b9f0-66cb5c079278', 'id': 'b5fa16bd-5e8f-4326-b498-0ad593fda3b1'} Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b5fa16bd-5e8f-4326-b498-0ad593fda3b1. Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 is not attached to volume b5fa16bd-5e8f-4326-b498-0ad593fda3b1 Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:30:58.967922 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:30:58.972499 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:30:58.972499 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:30:58.972499 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 is not attached to volume b5fa16bd-5e8f-4326-b498-0ad593fda3b1 Nov 02 14:30:58.972499 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:30:58.972499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Returning 404 to user: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 is not attached to volume b5fa16bd-5e8f-4326-b498-0ad593fda3b1 {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:30:58.972499 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c4c9cc18-61cf-47ca-bbdf-ed8c54fccd90 tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments/b5fa16bd-5e8f-4326-b498-0ad593fda3b1" status: 404 len: 154 microversion: 2.1 time: 0.094409 Nov 02 14:30:58.972499 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3882/8132] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:30:58 2022] DELETE /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278/os-volume_attachments/b5fa16bd-5e8f-4326-b498-0ad593fda3b1 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:31:02.317854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:02.318386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:02.325262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:02.325752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:02.326200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:02.326909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:02.327400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:02.327839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:02.355578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:31:02.442935 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8a02087d-031d-413f-93ff-28d2be39684f tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 204 len: 0 microversion: 2.1 time: 0.129285 Nov 02 14:31:02.443607 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4251/8133] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:31:02 2022] DELETE /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:31:02.452290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:02.452814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:02.461213 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:02.461911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:02.462164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:02.462886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:02.463380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:02.463830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:02.612843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:02.622143 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-38150358-335f-4edd-b4c6-664b2109afde tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1563 microversion: 2.1 time: 0.173853 Nov 02 14:31:02.622826 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3883/8134] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:02 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:03.648100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:03.648745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:03.655975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:03.656469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:03.656920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:03.657632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:03.658095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:03.658535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:03.791491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:03.799399 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6db27e6f-f9ec-4b91-9380-e6dba38d6aac tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1563 microversion: 2.1 time: 0.157297 Nov 02 14:31:03.799982 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4252/8135] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:03 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:04.702327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-bf1d12aa-cfb5-49d3-8817-971fc4ae319f req-67af4587-698b-4a3f-b5be-d72f5f2510ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20959bd-b82a-4057-b9f0-66cb5c079278", "name": "network-vif-deleted", "tag": "72abe312-dca5-4ce9-8d41-ec37676c6959"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:04.714839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bf1d12aa-cfb5-49d3-8817-971fc4ae319f req-67af4587-698b-4a3f-b5be-d72f5f2510ba service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.715366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bf1d12aa-cfb5-49d3-8817-971fc4ae319f req-67af4587-698b-4a3f-b5be-d72f5f2510ba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.715817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bf1d12aa-cfb5-49d3-8817-971fc4ae319f req-67af4587-698b-4a3f-b5be-d72f5f2510ba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.728551 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-bf1d12aa-cfb5-49d3-8817-971fc4ae319f req-67af4587-698b-4a3f-b5be-d72f5f2510ba service nova] Creating event network-vif-deleted:72abe312-dca5-4ce9-8d41-ec37676c6959 for instance f20959bd-b82a-4057-b9f0-66cb5c079278 on n-h2-858384-19 Nov 02 14:31:04.734139 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-bf1d12aa-cfb5-49d3-8817-971fc4ae319f req-67af4587-698b-4a3f-b5be-d72f5f2510ba service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035507 Nov 02 14:31:04.734760 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3884/8136] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:31:04.826940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:04.831387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:04.839383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.839873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.840513 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.841242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.841702 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.842145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.874824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:04.875343 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:04.875782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:04.876408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lazy-loading 'fault' on Instance uuid f20959bd-b82a-4057-b9f0-66cb5c079278 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:31:04.918216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e538d1c6394ba3bfd9921ae3bd6ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dd61660b954a2dbafc08598a17e835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:04.926516 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e5b49730-30cb-4346-bec3-1538cab8373c tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 200 len: 1356 microversion: 2.1 time: 0.107160 Nov 02 14:31:04.927336 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4253/8137] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:04 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:05.951691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:05.952309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] [instance: f20959bd-b82a-4057-b9f0-66cb5c079278] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:05.958769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:05.959293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:05.959750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:05.960458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:05.960924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:05.961368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:05.974816 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] HTTP exception thrown: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 could not be found. Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Request method failure captured: Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 HTTP/1.1 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn643A6TF89Uk4mq_w36zvrZq0c3LrNLv4Kc2xpQ3Z9zcYi9CO3hu-XjJ9R1DZrYkq_LMTRPPOJiHZGcfVYcJCpqy1jaJuj1GYF3U4FiUmKbbO3gg0jX8rj_BfxGTrzYkA3uIE0RNLPpowyl6PscC1U9ZhQj-O9qHUUbgCQJUBaWHcw Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_80dd61660b954a2dbafc08598a17e835"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/80dd61660b954a2dbafc08598a17e835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 80dd61660b954a2dbafc08598a17e835 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-58092218 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 35e538d1c6394ba3bfd9921ae3bd6ee1 Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestEncryptedCinderVolumes-58092218-project Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 could not be found. Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'f20959bd-b82a-4057-b9f0-66cb5c079278'} Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 could not be found. Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 could not be found. Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:31:05.976476 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 could not be found. Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Returning 404 to user: Instance f20959bd-b82a-4057-b9f0-66cb5c079278 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc2f602c-6c35-43ec-9971-1b0dd8158e7d tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278" status: 404 len: 111 microversion: 2.1 time: 0.031581 Nov 02 14:31:05.981371 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3885/8138] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:05 2022] GET /compute/v2.1/servers/f20959bd-b82a-4057-b9f0-66cb5c079278 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 14:31:05.987306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f8789f8-ef23-4971-ab83-02e12937cd1b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] Calling method '.version_select at 0x7fe786e273a0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:06.009134 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f8789f8-ef23-4971-ab83-02e12937cd1b tempest-TestEncryptedCinderVolumes-58092218 tempest-TestEncryptedCinderVolumes-58092218-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-350405253" status: 202 len: 0 microversion: 2.1 time: 0.025816 Nov 02 14:31:06.009726 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4254/8139] 10.222.0.113 () {58 vars in 1280 bytes} [Wed Nov 2 14:31:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-350405253 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:31:33.366943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-044dc92c-7a21-48f6-97c4-21b61429c2c4 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'create', calling method: .version_select at 0x7fe78773d700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1351502163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLd2Ms1Vk0vt4aCJMDcxMC1cwJhf9ZYTVwCTPuXlp+EbG8PTSivL02UWZ3iONev+ry+CH3zF77+vPsgBned+3/9GKMixBwq+FkI6r+2/ziwDYRxdQwV1QzxKUsB4uAXQ5A=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:33.373157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=14 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:33.374061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=34 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:33.388897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-044dc92c-7a21-48f6-97c4-21b61429c2c4 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Getting quotas for project 6d9f20a73f81462da2fdae7f399e2718. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:31:33.395815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-044dc92c-7a21-48f6-97c4-21b61429c2c4 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Getting quotas for user 9a5330233ec84853b4b3a7d88dba073a and project 6d9f20a73f81462da2fdae7f399e2718. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:31:33.420142 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-044dc92c-7a21-48f6-97c4-21b61429c2c4 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058635 Nov 02 14:31:33.420682 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3886/8140] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:31:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:33.469932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:33.470695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:33.476446 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-645851737", "imageRef": "7a936fb4-13c3-4f6c-aade-f002b7dfa77c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1351502163", "networks": [{"uuid": "3b80a2f8-5610-4c16-a743-67767085bad5"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:33.532608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] validate_networks() for [('3b80a2f8-5610-4c16-a743-67767085bad5', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:31:34.003851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:31:34.004376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:31:34.004853 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:31:34.005264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:31:34.005683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:31:34.014696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:34.015196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:34.015643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:34.016380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:34.016837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:34.017275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:34.035940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Getting quotas for project 6d9f20a73f81462da2fdae7f399e2718. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:31:34.041378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Getting quotas for user 9a5330233ec84853b4b3a7d88dba073a and project 6d9f20a73f81462da2fdae7f399e2718. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:31:34.054315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:31:34.056572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a936fb4-13c3-4f6c-aade-f002b7dfa77c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:31:34.103982 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5737089a-6ac3-4705-812d-56d71f4cac17 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.636202 Nov 02 14:31:34.104682 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4255/8141] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:31:33 2022] POST /compute/v2.1/servers => generated 382 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:31:34.116978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dba3a881-2477-4313-a60c-e2328605ecfa tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:34.117601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dba3a881-2477-4313-a60c-e2328605ecfa tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:34.172262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dba3a881-2477-4313-a60c-e2328605ecfa tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:34.179428 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dba3a881-2477-4313-a60c-e2328605ecfa tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1262 microversion: 2.1 time: 0.067253 Nov 02 14:31:34.179999 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3887/8142] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:34 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1262 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:35.202204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:35.203493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:35.211301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:35.211788 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:35.212228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:35.213120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:35.214047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:35.214443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:35.318301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:35.327289 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8596c9e8-cf85-4d5b-bd22-b73f52a360ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1332 microversion: 2.1 time: 0.128998 Nov 02 14:31:35.328028 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4256/8143] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:35 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1332 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:36.351978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:36.352626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:36.362592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:36.363329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:36.363946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:36.364530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:36.365479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:36.365933 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:36.510407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:36.518389 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-949bd4d8-ec2b-49c4-8358-acf80d3668a7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.170466 Nov 02 14:31:36.519804 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3888/8144] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:36 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:37.543906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:37.545451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:37.554124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:37.555262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:37.556813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:37.557652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:37.558141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:37.558630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:37.707430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:37.716420 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3d8553b0-0e14-42b7-b53f-207835679616 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.177307 Nov 02 14:31:37.717031 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4257/8145] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:37 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:38.740516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:38.741115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:38.747975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:38.748481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:38.748923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:38.749634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:38.750102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:38.750539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:38.902136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:38.910022 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a9ba5ea-54fe-4e33-af77-f839f1c045ed tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.174090 Nov 02 14:31:38.911250 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3889/8146] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:38 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:39.934982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:39.935945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:39.944868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:39.945422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:39.945865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:39.946581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:39.947040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:39.947499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:40.092547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:40.100922 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6083de1a-8b69-4308-b22c-8a1cd3eecab8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.169986 Nov 02 14:31:40.101731 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4258/8147] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:39 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:41.125438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:41.126171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:41.134244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:41.134871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:41.135397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:41.136184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:41.136758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:41.137263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:41.283917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:41.292136 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-55ce3640-5f84-446d-84e9-3a5959c7aa4e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.170683 Nov 02 14:31:41.292944 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3890/8148] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:41 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:42.315318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:42.317522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:42.324550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:42.325046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:42.325499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:42.326254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:42.326718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:42.327371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:42.467601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:42.476141 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a47678f3-ec16-4e84-8d0d-4a9da6528310 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.164735 Nov 02 14:31:42.476741 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4259/8149] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:42 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:43.500741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:43.501365 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:43.509411 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:43.509839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:43.510286 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:43.511029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:43.511523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:43.511965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:43.647491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:43.655207 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9b66ee4d-5d8d-4841-ad96-431601152e7a tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.158747 Nov 02 14:31:43.655783 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3891/8150] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:43 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:44.679171 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:44.679805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:44.681737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:44.682411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:44.688468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:44.688957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:44.689400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:44.690108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:44.690564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:44.690998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:44.824888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:44.833664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-72f3e535-116c-4691-bd6a-b8fbe0608aa1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.158831 Nov 02 14:31:44.834248 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4260/8151] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:44 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:45.857534 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:45.858085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:45.859958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:31:45.866880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:45.867412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:45.867871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:45.868589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:45.869075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:45.869516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:46.001514 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:46.009282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c89948b7-b353-4ebe-97ab-e8314b8633d7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.156032 Nov 02 14:31:46.009866 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3892/8152] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:45 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:47.032452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:47.033141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:47.040831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:47.041322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:47.041769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:47.042479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:47.042938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:47.043398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:47.174760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:47.183544 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-159b75e7-3f57-4b5b-a611-7cc576697527 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.155111 Nov 02 14:31:47.184145 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4261/8153] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:47 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:31:48.208355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:48.208996 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:48.215699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:48.216198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:48.216720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:48.217441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:48.217910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:48.218353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:48.352184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:48.359265 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-10fcd5c7-5ee8-4f6a-ab0e-086a8b5b0596 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.155192 Nov 02 14:31:48.359847 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3893/8154] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:48 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:48.693765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-4c17bf36-2c4c-4430-bd15-ed15b10a0829 req-bda0f7e1-a704-4274-94b5-657219820ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0112b3-218c-4028-ac17-ce4b55ce1217", "tag": "ca184c69-8d85-48fd-ab9d-71e1f0128ee3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:48.705106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4c17bf36-2c4c-4430-bd15-ed15b10a0829 req-bda0f7e1-a704-4274-94b5-657219820ddc service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:48.705691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4c17bf36-2c4c-4430-bd15-ed15b10a0829 req-bda0f7e1-a704-4274-94b5-657219820ddc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:48.706225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4c17bf36-2c4c-4430-bd15-ed15b10a0829 req-bda0f7e1-a704-4274-94b5-657219820ddc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:48.718366 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-4c17bf36-2c4c-4430-bd15-ed15b10a0829 req-bda0f7e1-a704-4274-94b5-657219820ddc service nova] Creating event network-changed:ca184c69-8d85-48fd-ab9d-71e1f0128ee3 for instance cc0112b3-218c-4028-ac17-ce4b55ce1217 on n-h2-858384-19 Nov 02 14:31:48.723620 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-4c17bf36-2c4c-4430-bd15-ed15b10a0829 req-bda0f7e1-a704-4274-94b5-657219820ddc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034748 Nov 02 14:31:48.724451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4262/8155] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:49.383458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:49.384085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:49.391104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:49.391632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:49.392081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:49.392785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:49.393253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:49.393695 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:49.528229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:49.536855 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-974ded32-ed5b-4e1f-86a6-4f0b0e2cc8ca tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.157312 Nov 02 14:31:49.537455 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3894/8156] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:49 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:50.561782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:50.562771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:50.569195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:50.569762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:50.570965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:50.571900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:50.572368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:50.572803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:50.713766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:50.721545 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9c9b0763-a2f3-45c6-beee-ff6b1cfb9795 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.164996 Nov 02 14:31:50.722129 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4263/8157] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:50 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:51.746170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:51.746803 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:51.754673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:51.755209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:51.755697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:51.756417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:51.756892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:51.757339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:51.887271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:51.894898 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc9e2d87-b376-4b6d-935a-fac40110913c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.152900 Nov 02 14:31:51.895501 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3895/8158] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:51 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:52.917860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:52.918482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:52.925264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:52.925771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:52.926210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:52.926920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:52.927404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:52.927833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:53.076839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:53.085377 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edf20dc7-1c56-4807-a0ef-d3d4f9772d3d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.171557 Nov 02 14:31:53.085974 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4264/8159] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:52 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:54.109208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:54.109838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:54.117599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:54.118100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:54.118543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:54.119280 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:54.119746 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:54.120189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:54.253912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:54.262189 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9dc6dae-c729-4986-82e9-dfa8a73c708e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.157111 Nov 02 14:31:54.262815 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3896/8160] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:54 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:55.120274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6bfc4b74-d9a1-4241-8c73-26074568e8ab req-ea5b9de0-e01b-4492-8bfa-fb031dddeeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0112b3-218c-4028-ac17-ce4b55ce1217", "name": "network-vif-plugged", "status": "completed", "tag": "ca184c69-8d85-48fd-ab9d-71e1f0128ee3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:55.133122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6bfc4b74-d9a1-4241-8c73-26074568e8ab req-ea5b9de0-e01b-4492-8bfa-fb031dddeeb9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:55.133618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6bfc4b74-d9a1-4241-8c73-26074568e8ab req-ea5b9de0-e01b-4492-8bfa-fb031dddeeb9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:55.134065 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6bfc4b74-d9a1-4241-8c73-26074568e8ab req-ea5b9de0-e01b-4492-8bfa-fb031dddeeb9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:55.146378 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6bfc4b74-d9a1-4241-8c73-26074568e8ab req-ea5b9de0-e01b-4492-8bfa-fb031dddeeb9 service nova] Creating event network-vif-plugged:ca184c69-8d85-48fd-ab9d-71e1f0128ee3 for instance cc0112b3-218c-4028-ac17-ce4b55ce1217 on n-h2-858384-19 Nov 02 14:31:55.151525 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6bfc4b74-d9a1-4241-8c73-26074568e8ab req-ea5b9de0-e01b-4492-8bfa-fb031dddeeb9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035040 Nov 02 14:31:55.152147 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4265/8161] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:55.284907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:55.286187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:55.293309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:55.293808 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:55.294262 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:55.294971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:55.295466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:55.295903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:55.685655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:55.694457 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9c6b79e1-7bf0-4aa5-bea2-75bc1da6dc6e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1362 microversion: 2.1 time: 0.413438 Nov 02 14:31:55.695042 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3897/8162] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:55 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:56.718649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:56.719991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:56.727406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:56.727898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:56.728444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:56.729185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:56.729645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:56.730080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:56.866906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:56.874782 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06d73573-b4fb-4b62-9f3a-5d529effbd9d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1553 microversion: 2.1 time: 0.160601 Nov 02 14:31:56.875396 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4266/8163] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:56 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:56.898336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:56.898994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:56.905904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:56.906397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:56.906848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:56.907584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:56.908052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:56.908495 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:57.037281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:57.045096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dc2ba9cd-26eb-430b-9fe8-79efee6be1ff tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1553 microversion: 2.1 time: 0.150934 Nov 02 14:31:57.045663 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3898/8164] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:56 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:57.068287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:57.073135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:57.073896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Searching by: {'deleted': False, 'project_id': '6d9f20a73f81462da2fdae7f399e2718'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:31:57.079238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:57.079722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:57.080163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:57.080898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:57.081354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:57.081972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:57.106051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:31:57.133492 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-273e0b5f-e134-4218-ad19-bcd9af11b392 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.069413 Nov 02 14:31:57.134102 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4267/8165] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 14:31:57 2022] GET /compute/v2.1/servers => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:31:57.145730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:31:57.146380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:57.152529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:57.153016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:57.153459 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:57.154155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:57.154614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:57.155045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:57.292521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:31:57.300281 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e9725751-846d-45fe-808b-67b0e6e1ae0e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1553 microversion: 2.1 time: 0.158456 Nov 02 14:31:57.301580 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3899/8166] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:31:57 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:31:58.855339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3ca0a629-e335-4c1b-b445-8307498acaeb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "371cf128-6c1e-4498-a67c-3aca6194327a"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:31:58.858131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3ca0a629-e335-4c1b-b445-8307498acaeb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:31:58.865830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca0a629-e335-4c1b-b445-8307498acaeb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:58.866312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca0a629-e335-4c1b-b445-8307498acaeb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:58.866752 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca0a629-e335-4c1b-b445-8307498acaeb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:58.868143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca0a629-e335-4c1b-b445-8307498acaeb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:31:58.868583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca0a629-e335-4c1b-b445-8307498acaeb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:31:58.869015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3ca0a629-e335-4c1b-b445-8307498acaeb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:31:59.108042 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3ca0a629-e335-4c1b-b445-8307498acaeb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256305 Nov 02 14:31:59.108964 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4268/8167] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 14:31:58 2022] POST /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:12.163658 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:12.164287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:12.166807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:12.167716 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=72 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:12.173602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:12.174110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:12.174570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:12.175328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:12.176453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:12.176904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:12.309738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:12.318019 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d1e02ecf-6c44-4b07-88bf-2216fc8c26a6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1599 microversion: 2.1 time: 0.158995 Nov 02 14:32:12.318587 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3900/8168] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:32:12 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:13.995677 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:14.004131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:14.005358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:32:14.168303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-3e652770-38cf-4c5c-a5b9-0ef00f0d7ece req-49becc30-1fd0-406c-a75b-4e42122b48ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0112b3-218c-4028-ac17-ce4b55ce1217", "tag": "ca184c69-8d85-48fd-ab9d-71e1f0128ee3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:14.184978 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3e652770-38cf-4c5c-a5b9-0ef00f0d7ece req-49becc30-1fd0-406c-a75b-4e42122b48ec service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:14.185827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3e652770-38cf-4c5c-a5b9-0ef00f0d7ece req-49becc30-1fd0-406c-a75b-4e42122b48ec service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:14.186422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-3e652770-38cf-4c5c-a5b9-0ef00f0d7ece req-49becc30-1fd0-406c-a75b-4e42122b48ec service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:14.201759 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-3e652770-38cf-4c5c-a5b9-0ef00f0d7ece req-49becc30-1fd0-406c-a75b-4e42122b48ec service nova] Creating event network-changed:ca184c69-8d85-48fd-ab9d-71e1f0128ee3 for instance cc0112b3-218c-4028-ac17-ce4b55ce1217 on n-h2-858384-19 Nov 02 14:32:14.209453 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-3e652770-38cf-4c5c-a5b9-0ef00f0d7ece req-49becc30-1fd0-406c-a75b-4e42122b48ec service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215347 Nov 02 14:32:14.210554 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4269/8169] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:32:15.042515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1535023010"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:15.043206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:15.050305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:15.051124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:15.051789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:15.052600 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:15.053155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:15.053677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:15.187175 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.network.security_group_api [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Adding security group 58750c45-690b-40fb-8225-c5d612e1c22d to port ca184c69-8d85-48fd-ab9d-71e1f0128ee3 Nov 02 14:32:15.505910 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f3b6af85-c63e-4fec-8ee3-4d27de4e019f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/action" status: 202 len: 0 microversion: 2.1 time: 0.467363 Nov 02 14:32:15.509830 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3901/8170] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:32:15 2022] POST /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:32:15.516666 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:32:15.517521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:32:15.524079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:15.524650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:15.525167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:15.525951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:15.526485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:15.527007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:15.684164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:32:15.693292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-08131d7f-359b-4093-a15c-f976790f5e33 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1764 microversion: 2.1 time: 0.181969 Nov 02 14:32:15.693912 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4270/8171] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:32:15 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1764 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:32:16.226829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-1d3db4ad-5a17-49ea-8369-29f193a8bd41 req-c8f0dd28-beb1-4393-928e-0009bc8fb2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0112b3-218c-4028-ac17-ce4b55ce1217", "tag": "ca184c69-8d85-48fd-ab9d-71e1f0128ee3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:32:16.236685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1d3db4ad-5a17-49ea-8369-29f193a8bd41 req-c8f0dd28-beb1-4393-928e-0009bc8fb2d1 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:32:16.237177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1d3db4ad-5a17-49ea-8369-29f193a8bd41 req-c8f0dd28-beb1-4393-928e-0009bc8fb2d1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:32:16.237623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-1d3db4ad-5a17-49ea-8369-29f193a8bd41 req-c8f0dd28-beb1-4393-928e-0009bc8fb2d1 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:32:16.248366 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-1d3db4ad-5a17-49ea-8369-29f193a8bd41 req-c8f0dd28-beb1-4393-928e-0009bc8fb2d1 service nova] Creating event network-changed:ca184c69-8d85-48fd-ab9d-71e1f0128ee3 for instance cc0112b3-218c-4028-ac17-ce4b55ce1217 on n-h2-858384-19 Nov 02 14:32:16.253366 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-1d3db4ad-5a17-49ea-8369-29f193a8bd41 req-c8f0dd28-beb1-4393-928e-0009bc8fb2d1 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031853 Nov 02 14:32:16.253991 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3902/8172] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:34:36.893171 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:34:36.894096 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:34:36.894838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:36.895626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:36.896843 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:34:36.896975 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:34:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/action (ip 10.222.0.113) !!! Nov 02 14:34:36.897844 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:34:36.898054 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:34:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/action (ip 10.222.0.113) !!! Nov 02 14:34:36.903197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9f4cbbc5-5972-46c1-9181-6d07a6cc6a9e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:34:36.905503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9f4cbbc5-5972-46c1-9181-6d07a6cc6a9e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:36.914241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f4cbbc5-5972-46c1-9181-6d07a6cc6a9e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:36.914729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f4cbbc5-5972-46c1-9181-6d07a6cc6a9e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:36.915587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f4cbbc5-5972-46c1-9181-6d07a6cc6a9e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:36.916316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f4cbbc5-5972-46c1-9181-6d07a6cc6a9e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:36.916773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f4cbbc5-5972-46c1-9181-6d07a6cc6a9e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:36.917206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9f4cbbc5-5972-46c1-9181-6d07a6cc6a9e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:36.992543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9f4cbbc5-5972-46c1-9181-6d07a6cc6a9e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/action" status: 202 len: 0 microversion: 2.1 time: 0.101154 Nov 02 14:34:36.993596 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4271/8173] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:34:36 2022] POST /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:34:37.000719 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:34:37.001556 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:34:37.002133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:37.003072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:34:37.004462 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:34:37.004590 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 (ip 10.222.0.113) !!! Nov 02 14:34:37.007103 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:34:37.007255 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 (ip 10.222.0.113) !!! Nov 02 14:34:37.028409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:37.029131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:37.036948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:37.037449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:37.037905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:37.038613 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:37.039079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:37.039540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:37.284835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:37.293865 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0fbef6fa-65f2-4f2f-b144-e4c317448bad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1766 microversion: 2.1 time: 0.296045 Nov 02 14:34:37.307135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3903/8174] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:34:36 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1766 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:34:38.320183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:34:38.320910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:34:38.330091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:38.330575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:38.331012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:38.331733 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:34:38.332187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:34:38.332615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:34:38.337924 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 44914. Nov 02 14:34:38.340977 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 44916. Nov 02 14:34:38.527299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:34:38.536794 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-22a22fd2-15f7-4e08-b4c8-0ba599144680 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1764 microversion: 2.1 time: 0.222636 Nov 02 14:34:38.537380 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4272/8175] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:34:38 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1764 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:18.393683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:18.394378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:18.395574 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:36:18.395729 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/action (ip 10.222.0.113) !!! Nov 02 14:36:18.400377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1535023010"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:18.400923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:18.412426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:18.412926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:18.413380 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:18.414120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:18.414585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:18.415027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:18.419145 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 44956. Nov 02 14:36:18.420378 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 44954. Nov 02 14:36:18.549992 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.network.security_group_api [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Removing security group 58750c45-690b-40fb-8225-c5d612e1c22d from port ca184c69-8d85-48fd-ab9d-71e1f0128ee3 Nov 02 14:36:18.856055 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-17c033fc-86e4-4380-a238-2f312a7dec71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/action" status: 202 len: 0 microversion: 2.1 time: 0.464866 Nov 02 14:36:18.857124 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3904/8176] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:36:18 2022] POST /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:36:18.868950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:18.870007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:18.876149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-62b255c1-801f-406f-8a4d-04c1adddb38a req-46ef1fc4-5a8c-4d34-87db-fbee90bbd20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0112b3-218c-4028-ac17-ce4b55ce1217", "tag": "ca184c69-8d85-48fd-ab9d-71e1f0128ee3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:18.888548 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-62b255c1-801f-406f-8a4d-04c1adddb38a req-46ef1fc4-5a8c-4d34-87db-fbee90bbd20f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:18.889145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-62b255c1-801f-406f-8a4d-04c1adddb38a req-46ef1fc4-5a8c-4d34-87db-fbee90bbd20f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:18.889802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-62b255c1-801f-406f-8a4d-04c1adddb38a req-46ef1fc4-5a8c-4d34-87db-fbee90bbd20f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:18.906686 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-62b255c1-801f-406f-8a4d-04c1adddb38a req-46ef1fc4-5a8c-4d34-87db-fbee90bbd20f service nova] Creating event network-changed:ca184c69-8d85-48fd-ab9d-71e1f0128ee3 for instance cc0112b3-218c-4028-ac17-ce4b55ce1217 on n-h2-858384-19 Nov 02 14:36:18.912603 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-62b255c1-801f-406f-8a4d-04c1adddb38a req-46ef1fc4-5a8c-4d34-87db-fbee90bbd20f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045765 Nov 02 14:36:18.913769 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4273/8177] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:20.328891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:20.329483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:20.335556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:20.336070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:20.336521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:20.337256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:20.337711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:20.338155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:20.421552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lazy-loading 'services' on Instance uuid cc0112b3-218c-4028-ac17-ce4b55ce1217 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:36:20.494706 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da642593-3d4a-4446-bf2e-99c4e3637f03 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "DELETE /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments/371cf128-6c1e-4498-a67c-3aca6194327a" status: 202 len: 0 microversion: 2.1 time: 0.171756 Nov 02 14:36:20.495429 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3905/8178] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:36:20 2022] DELETE /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments/371cf128-6c1e-4498-a67c-3aca6194327a => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:36:20.505979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-283a47ea-01bd-4a05-9afe-6094ecec5c76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:20.509121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-283a47ea-01bd-4a05-9afe-6094ecec5c76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:20.518630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-283a47ea-01bd-4a05-9afe-6094ecec5c76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:20.519178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-283a47ea-01bd-4a05-9afe-6094ecec5c76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:20.519642 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-283a47ea-01bd-4a05-9afe-6094ecec5c76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:20.520370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-283a47ea-01bd-4a05-9afe-6094ecec5c76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:20.520828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-283a47ea-01bd-4a05-9afe-6094ecec5c76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:20.521470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-283a47ea-01bd-4a05-9afe-6094ecec5c76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:20.556788 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-283a47ea-01bd-4a05-9afe-6094ecec5c76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056114 Nov 02 14:36:20.562325 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4274/8179] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:36:20 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:20.929307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-b72b94aa-b234-45e9-a9fa-b5a569f30374 req-28963861-789b-400b-a78a-7ff54ff17bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0112b3-218c-4028-ac17-ce4b55ce1217", "tag": "ca184c69-8d85-48fd-ab9d-71e1f0128ee3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:20.940646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b72b94aa-b234-45e9-a9fa-b5a569f30374 req-28963861-789b-400b-a78a-7ff54ff17bfd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:20.941258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b72b94aa-b234-45e9-a9fa-b5a569f30374 req-28963861-789b-400b-a78a-7ff54ff17bfd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:20.941781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-b72b94aa-b234-45e9-a9fa-b5a569f30374 req-28963861-789b-400b-a78a-7ff54ff17bfd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:20.954505 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-b72b94aa-b234-45e9-a9fa-b5a569f30374 req-28963861-789b-400b-a78a-7ff54ff17bfd service nova] Creating event network-changed:ca184c69-8d85-48fd-ab9d-71e1f0128ee3 for instance cc0112b3-218c-4028-ac17-ce4b55ce1217 on n-h2-858384-19 Nov 02 14:36:20.959750 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-b72b94aa-b234-45e9-a9fa-b5a569f30374 req-28963861-789b-400b-a78a-7ff54ff17bfd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034743 Nov 02 14:36:20.960683 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3906/8180] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:21.570139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8df10a5a-968a-4768-87ea-6324ef654e52 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:21.572379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8df10a5a-968a-4768-87ea-6324ef654e52 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:21.579961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df10a5a-968a-4768-87ea-6324ef654e52 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:21.580443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df10a5a-968a-4768-87ea-6324ef654e52 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:21.580878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df10a5a-968a-4768-87ea-6324ef654e52 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:21.581574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df10a5a-968a-4768-87ea-6324ef654e52 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:21.582024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df10a5a-968a-4768-87ea-6324ef654e52 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:21.582451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8df10a5a-968a-4768-87ea-6324ef654e52 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:21.613492 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8df10a5a-968a-4768-87ea-6324ef654e52 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047397 Nov 02 14:36:21.614075 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4275/8181] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:36:21 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:22.628390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cf3bb1a3-9ddd-402a-b150-baedbbdc79a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:22.630677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cf3bb1a3-9ddd-402a-b150-baedbbdc79a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:22.637254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3bb1a3-9ddd-402a-b150-baedbbdc79a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:22.637798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3bb1a3-9ddd-402a-b150-baedbbdc79a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:22.638255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3bb1a3-9ddd-402a-b150-baedbbdc79a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:22.639900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3bb1a3-9ddd-402a-b150-baedbbdc79a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:22.640614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3bb1a3-9ddd-402a-b150-baedbbdc79a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:22.640908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cf3bb1a3-9ddd-402a-b150-baedbbdc79a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:22.673960 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cf3bb1a3-9ddd-402a-b150-baedbbdc79a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051591 Nov 02 14:36:22.674540 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3907/8182] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:36:22 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:23.687153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a72c7330-2bb7-4784-a065-fd995821cf59 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:23.689292 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a72c7330-2bb7-4784-a065-fd995821cf59 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:23.696236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a72c7330-2bb7-4784-a065-fd995821cf59 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:23.696726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a72c7330-2bb7-4784-a065-fd995821cf59 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:23.697175 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a72c7330-2bb7-4784-a065-fd995821cf59 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:23.697882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a72c7330-2bb7-4784-a065-fd995821cf59 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:23.698345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a72c7330-2bb7-4784-a065-fd995821cf59 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:23.698785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a72c7330-2bb7-4784-a065-fd995821cf59 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:23.733467 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a72c7330-2bb7-4784-a065-fd995821cf59 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050490 Nov 02 14:36:23.734036 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4276/8183] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:36:23 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:24.799738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-74423b79-b337-4c16-91d5-9c928ab3f86d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:24.801945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-74423b79-b337-4c16-91d5-9c928ab3f86d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:24.808070 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74423b79-b337-4c16-91d5-9c928ab3f86d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:24.808546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74423b79-b337-4c16-91d5-9c928ab3f86d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:24.809000 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74423b79-b337-4c16-91d5-9c928ab3f86d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:24.809712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74423b79-b337-4c16-91d5-9c928ab3f86d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:24.810714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74423b79-b337-4c16-91d5-9c928ab3f86d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:24.811187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-74423b79-b337-4c16-91d5-9c928ab3f86d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:24.841303 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-74423b79-b337-4c16-91d5-9c928ab3f86d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099243 Nov 02 14:36:24.842271 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3908/8184] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:36:24 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:25.853667 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4a0c0c03-5e7d-4ab8-b311-4a3b3d62360c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:25.855794 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4a0c0c03-5e7d-4ab8-b311-4a3b3d62360c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:25.863410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a0c0c03-5e7d-4ab8-b311-4a3b3d62360c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:25.863896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a0c0c03-5e7d-4ab8-b311-4a3b3d62360c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:25.864340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a0c0c03-5e7d-4ab8-b311-4a3b3d62360c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:25.865039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a0c0c03-5e7d-4ab8-b311-4a3b3d62360c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:25.865489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a0c0c03-5e7d-4ab8-b311-4a3b3d62360c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:25.865918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4a0c0c03-5e7d-4ab8-b311-4a3b3d62360c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:25.894722 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4a0c0c03-5e7d-4ab8-b311-4a3b3d62360c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045250 Nov 02 14:36:25.895308 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4277/8185] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:36:25 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:36:25.906333 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:25.906836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:25.913489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:25.913982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:25.914452 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:25.915184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:25.915651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:25.916092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:25.991352 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] HTTP exception thrown: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 is not attached to volume 371cf128-6c1e-4498-a67c-3aca6194327a Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Request method failure captured: Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments/371cf128-6c1e-4498-a67c-3aca6194327a HTTP/1.1 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn827XgbgU4_w5r4L8OouswwKHMzfEdrixTUprFH1gU3S3oyv0wa9JdY5SQya_hkY7OZD5zXf8a4KbT6h7881sEPBJP-0182XBnHNR50RzOTIADG_cqEsS-5cxY5bzrIv9ho7NDfGQaDWL1y8ynnNt4igkPR0EYQa94z3iy09DLwG24 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 6d9f20a73f81462da2fdae7f399e2718 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 6d9f20a73f81462da2fdae7f399e2718 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestMinimumBasicScenario-2103585067-project Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 9a5330233ec84853b4b3a7d88dba073a Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestMinimumBasicScenario-2103585067-project Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 is not attached to volume 371cf128-6c1e-4498-a67c-3aca6194327a Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': 'cc0112b3-218c-4028-ac17-ce4b55ce1217', 'id': '371cf128-6c1e-4498-a67c-3aca6194327a'} Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 371cf128-6c1e-4498-a67c-3aca6194327a. Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 is not attached to volume 371cf128-6c1e-4498-a67c-3aca6194327a Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:25.992968 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:25.998340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:36:25.998340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:36:25.998340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 is not attached to volume 371cf128-6c1e-4498-a67c-3aca6194327a Nov 02 14:36:25.998340 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:25.998340 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Returning 404 to user: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 is not attached to volume 371cf128-6c1e-4498-a67c-3aca6194327a {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:36:25.998340 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-274fa538-9e44-4629-9dc6-b7562d3fa06b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "DELETE /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments/371cf128-6c1e-4498-a67c-3aca6194327a" status: 404 len: 154 microversion: 2.1 time: 0.092452 Nov 02 14:36:25.998340 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3909/8186] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:36:25 2022] DELETE /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217/os-volume_attachments/371cf128-6c1e-4498-a67c-3aca6194327a => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:36:29.250831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:29.251415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:29.258886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:29.259404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:29.259848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:29.260560 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:29.261022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:29.261469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:29.292255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:36:29.387391 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-34faa216-5dbf-45ad-8530-09a8f2f6b6e8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "DELETE /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 204 len: 0 microversion: 2.1 time: 0.140886 Nov 02 14:36:29.388458 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4278/8187] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:36:29 2022] DELETE /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:36:29.399439 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:29.400108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:29.411309 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:29.411822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:29.412285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:29.413165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:29.413652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:29.414106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:29.569232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:29.577829 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aef1d3c4-b5fd-4930-b9a8-3e7e21323c71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1559 microversion: 2.1 time: 0.183123 Nov 02 14:36:29.578425 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3910/8188] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:29 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:30.610136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:30.610891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:30.617884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:30.618375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:30.618824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:30.619572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:30.620038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:30.620476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:30.755945 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:30.763719 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8555c3d5-03c6-4f9a-9d8e-2cd9598af75f tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1559 microversion: 2.1 time: 0.159188 Nov 02 14:36:30.764293 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4279/8189] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:30 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:31.787565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:31.788171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:31.795376 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:31.796394 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:31.796853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:31.797571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:31.798032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:31.798468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:31.933442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:31.942448 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-32020026-ac61-4e93-95aa-b914b11a62e3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 200 len: 1559 microversion: 2.1 time: 0.158866 Nov 02 14:36:31.943041 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3911/8190] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:31 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:32.252393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7f7b427e-4804-43d4-b336-94edf241aec7 req-0736b09b-22d8-4c09-8c91-a9f21b0c8f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0112b3-218c-4028-ac17-ce4b55ce1217", "name": "network-vif-deleted", "tag": "ca184c69-8d85-48fd-ab9d-71e1f0128ee3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:32.263247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7f7b427e-4804-43d4-b336-94edf241aec7 req-0736b09b-22d8-4c09-8c91-a9f21b0c8f74 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:32.263790 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7f7b427e-4804-43d4-b336-94edf241aec7 req-0736b09b-22d8-4c09-8c91-a9f21b0c8f74 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:32.264233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7f7b427e-4804-43d4-b336-94edf241aec7 req-0736b09b-22d8-4c09-8c91-a9f21b0c8f74 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:32.277778 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7f7b427e-4804-43d4-b336-94edf241aec7 req-0736b09b-22d8-4c09-8c91-a9f21b0c8f74 service nova] Creating event network-vif-deleted:ca184c69-8d85-48fd-ab9d-71e1f0128ee3 for instance cc0112b3-218c-4028-ac17-ce4b55ce1217 on n-h2-858384-19 Nov 02 14:36:32.283693 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7f7b427e-4804-43d4-b336-94edf241aec7 req-0736b09b-22d8-4c09-8c91-a9f21b0c8f74 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092596 Nov 02 14:36:32.284534 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4280/8191] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:36:32.966430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:32.966975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: cc0112b3-218c-4028-ac17-ce4b55ce1217] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:32.974360 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:32.974866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:32.975358 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:32.976076 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:32.976552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:32.976999 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:32.991381 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] HTTP exception thrown: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 could not be found. Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Request method failure captured: Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 HTTP/1.1 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn827XgbgU4_w5r4L8OouswwKHMzfEdrixTUprFH1gU3S3oyv0wa9JdY5SQya_hkY7OZD5zXf8a4KbT6h7881sEPBJP-0182XBnHNR50RzOTIADG_cqEsS-5cxY5bzrIv9ho7NDfGQaDWL1y8ynnNt4igkPR0EYQa94z3iy09DLwG24 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 6d9f20a73f81462da2fdae7f399e2718 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 6d9f20a73f81462da2fdae7f399e2718 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestMinimumBasicScenario-2103585067-project Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 9a5330233ec84853b4b3a7d88dba073a Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestMinimumBasicScenario-2103585067-project Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 could not be found. Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'cc0112b3-218c-4028-ac17-ce4b55ce1217'} Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 could not be found. Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 could not be found. Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:36:32.992929 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 could not be found. Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Returning 404 to user: Instance cc0112b3-218c-4028-ac17-ce4b55ce1217 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d1ccc31e-3417-4465-b492-cdc6b307da63 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217" status: 404 len: 111 microversion: 2.1 time: 0.032058 Nov 02 14:36:32.998125 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3912/8192] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:32 2022] GET /compute/v2.1/servers/cc0112b3-218c-4028-ac17-ce4b55ce1217 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:36:33.004547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2fe8a3f5-5f91-4889-9e56-ce7cf7277e71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '.version_select at 0x7fe787c16940>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:33.028151 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2fe8a3f5-5f91-4889-9e56-ce7cf7277e71 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1351502163" status: 202 len: 0 microversion: 2.1 time: 0.027883 Nov 02 14:36:33.028741 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4281/8193] 10.222.0.113 () {58 vars in 1277 bytes} [Wed Nov 2 14:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1351502163 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:36:42.301546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4f08341b-e7b5-4aed-b2c1-991c6e464f32 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'create', calling method: .version_select at 0x7fe7843eb550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-895262404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhaN3HfuAzUXOld1HtC9qPfsWe22Gsi1JsPvnC1UhbUpbcruMqZ3kcTk8xQZmg/hSKcY4sMGOCdlH1d5850IgullHleBLrV2x+rpgNqt6yIKGWOBS9VWwJWh5aPUjVC0Q=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:42.318338 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4f08341b-e7b5-4aed-b2c1-991c6e464f32 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Getting quotas for project 6d9f20a73f81462da2fdae7f399e2718. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:36:42.324422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4f08341b-e7b5-4aed-b2c1-991c6e464f32 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Getting quotas for user 9a5330233ec84853b4b3a7d88dba073a and project 6d9f20a73f81462da2fdae7f399e2718. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:36:42.351379 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4f08341b-e7b5-4aed-b2c1-991c6e464f32 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053809 Nov 02 14:36:42.351972 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3913/8194] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:36:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:36:42.400842 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:42.405867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-882735824", "imageRef": "d5d53715-bf75-4594-80b3-7a5a5814d044", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-895262404", "networks": [{"uuid": "3b80a2f8-5610-4c16-a743-67767085bad5"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:36:42.458932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] validate_networks() for [('3b80a2f8-5610-4c16-a743-67767085bad5', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:36:42.880821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:36:42.881256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:36:42.881742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:36:42.882163 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:36:42.882584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:36:42.892079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:42.892567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:42.893015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:42.893756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:42.894219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:42.894654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:42.911985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Getting quotas for project 6d9f20a73f81462da2fdae7f399e2718. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:36:42.917204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Getting quotas for user 9a5330233ec84853b4b3a7d88dba073a and project 6d9f20a73f81462da2fdae7f399e2718. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:36:42.930006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:36:42.932353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5d53715-bf75-4594-80b3-7a5a5814d044',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:36:42.979656 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-be22ca57-e575-4445-8ca2-876f15767010 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.580661 Nov 02 14:36:42.980600 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4282/8195] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:36:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:36:42.988849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:42.993031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-977a3c52-d80d-4148-aeaa-693f1362cba5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:42.993660 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-977a3c52-d80d-4148-aeaa-693f1362cba5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:43.047854 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-977a3c52-d80d-4148-aeaa-693f1362cba5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:43.054749 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-977a3c52-d80d-4148-aeaa-693f1362cba5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1261 microversion: 2.1 time: 0.066772 Nov 02 14:36:43.055346 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3914/8196] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:42 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:44.078839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e44a4f65-6058-4b5f-a2af-9dc58bed8582 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:44.079480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e44a4f65-6058-4b5f-a2af-9dc58bed8582 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:44.133903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e44a4f65-6058-4b5f-a2af-9dc58bed8582 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:44.141647 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e44a4f65-6058-4b5f-a2af-9dc58bed8582 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1261 microversion: 2.1 time: 0.067681 Nov 02 14:36:44.142237 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4283/8197] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:44 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:45.165037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bb67477c-0317-477e-952c-a76f89b4df19 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:45.165674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bb67477c-0317-477e-952c-a76f89b4df19 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:45.226249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bb67477c-0317-477e-952c-a76f89b4df19 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:45.234243 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bb67477c-0317-477e-952c-a76f89b4df19 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1261 microversion: 2.1 time: 0.073114 Nov 02 14:36:45.234805 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3915/8198] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:45 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1261 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:46.257931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-57bccae7-5bd8-4cc6-8548-3c05f0615046 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:46.258549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57bccae7-5bd8-4cc6-8548-3c05f0615046 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:46.313273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57bccae7-5bd8-4cc6-8548-3c05f0615046 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:46.320218 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-57bccae7-5bd8-4cc6-8548-3c05f0615046 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1261 microversion: 2.1 time: 0.066218 Nov 02 14:36:46.320805 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4284/8199] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:46 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1261 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:47.343983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:47.344595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:47.351503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:47.352008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:47.352458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:47.353176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:47.353651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:47.354092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:47.415578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:47.423230 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0a666337-a626-490a-81da-5a3319f7abcd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1265 microversion: 2.1 time: 0.083377 Nov 02 14:36:47.423803 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3916/8200] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:47 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:48.447220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:48.449264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:48.464929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:48.469690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:48.470356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:48.471314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:48.475509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:48.476233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:48.702681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:48.712232 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-28b04626-4362-4b3b-8c50-4bd9fc8e1fea tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1319 microversion: 2.1 time: 0.269540 Nov 02 14:36:48.712952 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4285/8201] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:48 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:49.738263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:49.739092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:49.740792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:49.747612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:49.747612 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:49.748114 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:49.749700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:49.749958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:49.750401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:49.892719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:49.900580 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a733535-7c13-447b-ae5c-3ca0596dbc76 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.166629 Nov 02 14:36:49.901161 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3917/8202] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:49 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:50.923662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:50.924246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:50.927389 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:50.939781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:50.940339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:50.941044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:50.942280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:50.942743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:50.943453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:51.094683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:51.104936 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ddad5912-035c-4988-9f69-8f3e8f63f3d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.185141 Nov 02 14:36:51.106016 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4286/8203] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:50 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:52.130197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:52.131743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:52.139590 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:52.140431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:52.140943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:52.141673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:52.142147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:52.142588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:52.285096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:52.293303 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9e5bd3ba-520a-4995-9ccf-d9d41d7aadfd tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.167122 Nov 02 14:36:52.293904 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3918/8204] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:52 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:53.317703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:53.318350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:53.321041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:53.328503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:53.329143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:53.329833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:53.330670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:53.331146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:53.331662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:53.481443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:53.502281 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-63fadf3f-9371-4822-87ea-38e409efa7fb tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.188532 Nov 02 14:36:53.503333 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4287/8205] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:53 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:54.534430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:54.536623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:54.546218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:54.546865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:54.547424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:54.551866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:54.552422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:54.552844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:54.694657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:54.703874 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22d8255f-1380-41c5-aaef-1e425ff62907 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.179859 Nov 02 14:36:54.704527 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3919/8206] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:54 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:36:55.727704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:55.728465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:55.736400 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:55.736901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:55.737351 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:55.738093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:55.738553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:55.738991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:55.879891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:55.888314 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09a89e99-91b1-445c-aa03-49fff98c6760 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.164528 Nov 02 14:36:55.888925 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4288/8207] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:55 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:56.911713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:56.912314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:56.914288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:56.920932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:56.921593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:56.922056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:56.922790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:56.923300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:56.923752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:57.054445 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:57.062620 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-363dac10-12a1-408a-a63e-c97c365bd6dc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.154747 Nov 02 14:36:57.064384 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3920/8208] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:56 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:58.086246 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:58.086865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:58.088747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=10 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:36:58.095491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:58.095979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:58.096427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:58.097132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:58.097592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:58.098024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:58.225467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:58.233614 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d096379d-c7a1-4e87-9699-a641961d44b7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.151391 Nov 02 14:36:58.234487 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4289/8209] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:58 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:36:59.256440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:36:59.257002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:36:59.264113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:59.264615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:59.265102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:59.265989 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:36:59.266517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:36:59.266961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:36:59.397278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:36:59.404951 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aa3edc6c-ec2b-41f6-b8ea-34eb0002dae1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.152524 Nov 02 14:36:59.406031 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3921/8210] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:36:59 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:00.428430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:00.429076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:00.435904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:00.436409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:00.437449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:00.438356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:00.438819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:00.439281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:00.650241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:00.658711 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f7bd387b-3c68-4c0a-be11-4121b1146005 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.234270 Nov 02 14:37:00.659527 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4290/8211] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:00 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:01.174492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7c035748-2473-41b8-bea8-4d4d68c30478 req-6ee196fe-20a8-431c-a398-1234dd361c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd73098b-1eef-4aa8-b304-e6af5a8b2471", "tag": "5266fbe4-b303-4df0-9836-2e9af6f86cff"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:01.185044 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7c035748-2473-41b8-bea8-4d4d68c30478 req-6ee196fe-20a8-431c-a398-1234dd361c60 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:01.185544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7c035748-2473-41b8-bea8-4d4d68c30478 req-6ee196fe-20a8-431c-a398-1234dd361c60 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:01.186069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7c035748-2473-41b8-bea8-4d4d68c30478 req-6ee196fe-20a8-431c-a398-1234dd361c60 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:01.197721 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7c035748-2473-41b8-bea8-4d4d68c30478 req-6ee196fe-20a8-431c-a398-1234dd361c60 service nova] Creating event network-changed:5266fbe4-b303-4df0-9836-2e9af6f86cff for instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 on n-h2-858384-19 Nov 02 14:37:01.203198 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7c035748-2473-41b8-bea8-4d4d68c30478 req-6ee196fe-20a8-431c-a398-1234dd361c60 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032309 Nov 02 14:37:01.204169 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3922/8212] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:01.682205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:01.682838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:01.690814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:01.691335 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:01.691784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:01.692495 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:01.692960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:01.693399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:01.828479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:01.836272 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-28ca9d04-779e-4081-bea2-b6af5d1c1459 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.158089 Nov 02 14:37:01.836870 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4291/8213] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:01 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:02.861873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:02.862594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:02.868918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:02.869429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:02.869886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:02.870592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:02.871061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:02.871550 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:03.004990 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:03.012750 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b4bc83fe-72c4-4986-86c6-16e1c86613d6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.156551 Nov 02 14:37:03.013328 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3923/8214] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:02 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:04.037798 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:04.038421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:04.045397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:04.045882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:04.046862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:04.047635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:04.048097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:04.048533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:04.263992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:04.272321 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-092ddcda-fc6b-416b-a84a-609759689f29 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.238557 Nov 02 14:37:04.272916 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4292/8215] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:04 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:05.296033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:05.296779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:05.303539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:05.304029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:05.304476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:05.305176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:05.305640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:05.306077 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:05.440235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:05.447961 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1d6a5622-e490-46cb-8db8-8f41c3b01448 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.155878 Nov 02 14:37:05.448534 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3924/8216] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:05 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:06.471982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:06.472599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:06.479390 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:06.479872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:06.480319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:06.481006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:06.481457 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:06.481881 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:06.613349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:06.621314 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01753f88-e3af-44c4-bfec-be81faf261e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.153951 Nov 02 14:37:06.621888 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4293/8217] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:06 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:07.645663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:07.646320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:07.653438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:07.653932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:07.654384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:07.655091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:07.655633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:07.656069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:07.787275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:07.795063 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3375fd14-c45a-40d8-9f6e-74cba1193cb7 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.153708 Nov 02 14:37:07.795659 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3925/8218] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:07 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:08.398719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7b430e08-6cd9-4f85-9791-5f216a8d30a4 req-4b1f13cd-b532-4965-8ddf-9df9c018f9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd73098b-1eef-4aa8-b304-e6af5a8b2471", "name": "network-vif-plugged", "status": "completed", "tag": "5266fbe4-b303-4df0-9836-2e9af6f86cff"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:08.410593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7b430e08-6cd9-4f85-9791-5f216a8d30a4 req-4b1f13cd-b532-4965-8ddf-9df9c018f9be service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:08.411084 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7b430e08-6cd9-4f85-9791-5f216a8d30a4 req-4b1f13cd-b532-4965-8ddf-9df9c018f9be service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:08.411551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7b430e08-6cd9-4f85-9791-5f216a8d30a4 req-4b1f13cd-b532-4965-8ddf-9df9c018f9be service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:08.423515 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7b430e08-6cd9-4f85-9791-5f216a8d30a4 req-4b1f13cd-b532-4965-8ddf-9df9c018f9be service nova] Creating event network-vif-plugged:5266fbe4-b303-4df0-9836-2e9af6f86cff for instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 on n-h2-858384-19 Nov 02 14:37:08.428666 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7b430e08-6cd9-4f85-9791-5f216a8d30a4 req-4b1f13cd-b532-4965-8ddf-9df9c018f9be service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092171 Nov 02 14:37:08.429396 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4294/8219] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:08.819354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:08.819897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:08.826667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:08.827707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:08.828171 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:08.828886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:08.829370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:08.829818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:08.966602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:08.974922 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5bbd40df-7b5d-43e2-b138-48a5dd4dd2d9 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1361 microversion: 2.1 time: 0.159676 Nov 02 14:37:08.975551 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3926/8220] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:08 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:09.999864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:10.000592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:10.007674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.008168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.008617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.009324 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.009784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.010222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.140576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:10.148427 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5eef4a13-84c9-4722-b1ef-1c697696f015 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1551 microversion: 2.1 time: 0.153780 Nov 02 14:37:10.149011 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4295/8221] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:09 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:10.171229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:10.171866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:10.178624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.179143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.179657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.180362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.180831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.181273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.308091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:10.316474 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4ee89e1d-5d59-4e86-bb6e-7d9c8c3dbe62 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1551 microversion: 2.1 time: 0.149251 Nov 02 14:37:10.317063 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3927/8222] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:10 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:10.339034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:10.345108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:10.345883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Searching by: {'deleted': False, 'project_id': '6d9f20a73f81462da2fdae7f399e2718'} {{(pid=120928) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 14:37:10.351231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.351721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.352167 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.352906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.353375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.353811 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.378354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.multi_cell_list [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 14:37:10.406967 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f86a6b8b-07b3-4639-af03-25bfcd1e43d0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.071731 Nov 02 14:37:10.407511 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4296/8223] 10.222.0.113 () {58 vars in 1130 bytes} [Wed Nov 2 14:37:10 2022] GET /compute/v2.1/servers => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:10.419487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:10.420111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:10.426339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.426827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.427304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.428002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:10.428466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:10.428905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:10.562546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:10.570529 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-73580d42-0d6d-4ca8-a5fe-3544b3f7c1e2 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1551 microversion: 2.1 time: 0.154976 Nov 02 14:37:10.571131 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3928/8224] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:10 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:12.080452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a1fc3640-8d56-4d7e-98e0-815c0935d5e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6565c5e3-5dcd-47f2-8a23-d8274c1ed51d"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:12.082872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a1fc3640-8d56-4d7e-98e0-815c0935d5e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:12.089776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1fc3640-8d56-4d7e-98e0-815c0935d5e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:12.090270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1fc3640-8d56-4d7e-98e0-815c0935d5e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:12.090722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1fc3640-8d56-4d7e-98e0-815c0935d5e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:12.091473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1fc3640-8d56-4d7e-98e0-815c0935d5e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:12.091938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1fc3640-8d56-4d7e-98e0-815c0935d5e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:12.092381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a1fc3640-8d56-4d7e-98e0-815c0935d5e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:12.325908 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a1fc3640-8d56-4d7e-98e0-815c0935d5e1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250134 Nov 02 14:37:12.326584 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4297/8225] 10.222.0.113 () {60 vars in 1328 bytes} [Wed Nov 2 14:37:12 2022] POST /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:23.273487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:23.274239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:23.276636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=23 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:23.277319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=74 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:23.283651 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:23.284156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:23.284615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:23.285332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:23.285810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:23.286258 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:23.417203 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:23.426732 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f96607da-9f65-4888-9ae7-ac8f5cf1b14e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1597 microversion: 2.1 time: 0.157419 Nov 02 14:37:23.427338 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3929/8226] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:23 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:37:25.080593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:25.081492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=23 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:25.082038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:37:25.142939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-8dd5427e-6fa1-4797-af34-c0b19505abc6 req-baab4c2c-f861-4008-960a-f440e659a62b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd73098b-1eef-4aa8-b304-e6af5a8b2471", "tag": "5266fbe4-b303-4df0-9836-2e9af6f86cff"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:25.154537 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8dd5427e-6fa1-4797-af34-c0b19505abc6 req-baab4c2c-f861-4008-960a-f440e659a62b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:25.155344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8dd5427e-6fa1-4797-af34-c0b19505abc6 req-baab4c2c-f861-4008-960a-f440e659a62b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:25.156295 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-8dd5427e-6fa1-4797-af34-c0b19505abc6 req-baab4c2c-f861-4008-960a-f440e659a62b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:25.169300 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-8dd5427e-6fa1-4797-af34-c0b19505abc6 req-baab4c2c-f861-4008-960a-f440e659a62b service nova] Creating event network-changed:5266fbe4-b303-4df0-9836-2e9af6f86cff for instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 on n-h2-858384-19 Nov 02 14:37:25.176814 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-8dd5427e-6fa1-4797-af34-c0b19505abc6 req-baab4c2c-f861-4008-960a-f440e659a62b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098475 Nov 02 14:37:25.177705 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4298/8227] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:37:26.275712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2029106465"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:26.276274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:26.283512 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:26.284017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:26.284477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:26.285189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:26.285661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:26.286104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:26.417662 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.network.security_group_api [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Adding security group 82cead68-9819-413c-bd54-128c44c98ca1 to port 5266fbe4-b303-4df0-9836-2e9af6f86cff Nov 02 14:37:26.737503 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d6a9c0b4-1700-4a2e-9dab-5c8e3d3c299b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/action" status: 202 len: 0 microversion: 2.1 time: 0.465961 Nov 02 14:37:26.743589 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3930/8228] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:37:26 2022] POST /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:37:26.750564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:37:26.751238 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:37:26.757599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:26.758086 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:26.758745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:26.759476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:26.759933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:26.760363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:26.923224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:37:26.931707 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7edee0c6-e8de-484d-8d85-20faf33981d3 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1763 microversion: 2.1 time: 0.186671 Nov 02 14:37:26.932304 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4299/8229] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:37:26 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1763 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:37:27.192834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-87b7d1ee-65d9-4389-9058-c5fd0df35c43 req-b38f7b29-be28-487c-a3c7-5716af4f214c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd73098b-1eef-4aa8-b304-e6af5a8b2471", "tag": "5266fbe4-b303-4df0-9836-2e9af6f86cff"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:37:27.202681 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-87b7d1ee-65d9-4389-9058-c5fd0df35c43 req-b38f7b29-be28-487c-a3c7-5716af4f214c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:37:27.204010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-87b7d1ee-65d9-4389-9058-c5fd0df35c43 req-b38f7b29-be28-487c-a3c7-5716af4f214c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:37:27.204465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-87b7d1ee-65d9-4389-9058-c5fd0df35c43 req-b38f7b29-be28-487c-a3c7-5716af4f214c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:37:27.215798 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-87b7d1ee-65d9-4389-9058-c5fd0df35c43 req-b38f7b29-be28-487c-a3c7-5716af4f214c service nova] Creating event network-changed:5266fbe4-b303-4df0-9836-2e9af6f86cff for instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 on n-h2-858384-19 Nov 02 14:37:27.221381 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-87b7d1ee-65d9-4389-9058-c5fd0df35c43 req-b38f7b29-be28-487c-a3c7-5716af4f214c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032326 Nov 02 14:37:27.222473 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3931/8230] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:38:25.432661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f83eb76e-ee7d-4598-8244-202357c5aa36 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:38:25.435011 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f83eb76e-ee7d-4598-8244-202357c5aa36 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:25.437198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:25.437864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:25.444634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83eb76e-ee7d-4598-8244-202357c5aa36 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:25.445122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83eb76e-ee7d-4598-8244-202357c5aa36 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:25.445567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83eb76e-ee7d-4598-8244-202357c5aa36 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:25.446271 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83eb76e-ee7d-4598-8244-202357c5aa36 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:25.446731 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83eb76e-ee7d-4598-8244-202357c5aa36 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:25.447196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f83eb76e-ee7d-4598-8244-202357c5aa36 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:25.519393 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f83eb76e-ee7d-4598-8244-202357c5aa36 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/action" status: 202 len: 0 microversion: 2.1 time: 0.090876 Nov 02 14:38:25.520055 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4300/8231] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:38:25 2022] POST /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:38:25.526500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:25.527724 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:38:25.528784 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:38:25.529206 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:38:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 (ip 10.222.0.113) !!! Nov 02 14:38:25.536215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:25.537001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:25.545248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:25.546506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:25.546967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:25.548462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:25.548696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:25.549090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:25.702861 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:25.711602 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-08353a4d-066a-4580-a113-1454ca70664d tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1755 microversion: 2.1 time: 0.187032 Nov 02 14:38:25.712263 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3932/8232] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:25 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:26.737570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:26.738281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:26.745530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:26.746017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:26.746461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:26.747199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:26.747664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:26.748098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:26.893819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:26.902177 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cddfa095-b5c9-4210-a2b5-f103806705fc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1760 microversion: 2.1 time: 0.169786 Nov 02 14:38:26.902749 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4301/8233] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:26 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:27.927095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:27.927696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:27.934523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:27.935015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:27.935500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:27.936205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:27.936783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:27.937229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:28.082092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:28.090337 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0dab0439-3379-4d57-b48a-24a3b38c276e tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1760 microversion: 2.1 time: 0.167336 Nov 02 14:38:28.090914 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3933/8234] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:27 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:29.115040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:29.115684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:29.122536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:29.122999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:29.123472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:29.124415 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:29.124765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:29.125193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:29.268936 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:29.277204 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cd4a7c0f-7efd-4f90-acd8-67f5f4874c23 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1760 microversion: 2.1 time: 0.166116 Nov 02 14:38:29.277772 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4302/8235] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:29 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:30.302035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:30.302714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:30.310414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:30.310602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:30.310894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:30.311634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:30.312099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:30.312845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:30.472440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:30.481251 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7da79223-6b77-45fc-a7ad-511604e854f5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1760 microversion: 2.1 time: 0.184356 Nov 02 14:38:30.481851 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3934/8236] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:30 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1760 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:31.506267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:31.506893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:31.513748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:31.514239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:31.514688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:31.516180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:31.516180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:31.516969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:31.662573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:31.670941 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-47472be0-a868-4ceb-8aa5-b160a97870a8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1760 microversion: 2.1 time: 0.168723 Nov 02 14:38:31.672085 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4303/8237] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:31 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:32.695820 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:32.696403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:32.703341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:32.703837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:32.704293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:32.705006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:32.705477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:32.705925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:32.847313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:32.855609 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05a403ba-94f9-49ee-87dd-1effc0b605c5 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1760 microversion: 2.1 time: 0.163799 Nov 02 14:38:32.856188 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3935/8238] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:32 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:33.880573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:33.881101 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:33.887889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:33.888366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:33.888801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:33.889490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:33.889939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:33.890363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:34.042492 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:34.050963 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d51adf8c-fab1-49f2-be78-44b0b78a0b61 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1760 microversion: 2.1 time: 0.174478 Nov 02 14:38:34.051577 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4304/8239] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:33 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:38:35.074818 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:35.075465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:35.082275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:35.082765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:35.083240 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:35.083943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:35.084404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:35.084839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:35.228528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:35.238264 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-089c8139-335f-46e2-80d2-342be5084804 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1760 microversion: 2.1 time: 0.167442 Nov 02 14:38:35.238873 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3936/8240] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:35 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:36.262196 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:36.262745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:36.270143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:36.270635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:36.271138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:36.271849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:36.272311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:36.272746 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:36.418891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:36.427647 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3aad5af4-d1bb-4d03-a3ae-976cf05c91c0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1760 microversion: 2.1 time: 0.169549 Nov 02 14:38:36.428221 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4305/8241] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:36 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:38:37.449958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:38:37.450594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:38:37.458696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:37.459218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:37.459673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:37.460381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:38:37.460849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:38:37.461296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:38:37.604513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:38:37.613449 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c8b506c1-e036-4adc-8d2d-ab6028d0e08c tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1763 microversion: 2.1 time: 0.167529 Nov 02 14:38:37.614043 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3937/8242] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:38:37 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1763 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:40.946058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:40.946792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:40.951224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2029106465"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:40.951906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:40.958971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:40.959521 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:40.959967 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:40.960661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:40.961120 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:40.961581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.137193 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.network.security_group_api [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Removing security group 82cead68-9819-413c-bd54-128c44c98ca1 from port 5266fbe4-b303-4df0-9836-2e9af6f86cff Nov 02 14:39:41.771292 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2aa043d1-b98a-4a8d-b69e-6bace5efb1d8 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "POST /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/action" status: 202 len: 0 microversion: 2.1 time: 0.826451 Nov 02 14:39:41.776182 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4306/8243] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:39:40 2022] POST /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/action => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:39:41.792449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-5747d947-c1b2-46b9-83cb-feee8b2b6e10 req-ed62c985-f1cf-49e6-9156-c3f264a3929a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd73098b-1eef-4aa8-b304-e6af5a8b2471", "tag": "5266fbe4-b303-4df0-9836-2e9af6f86cff"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:41.803819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:41.808921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=36 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:39:41.819636 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5747d947-c1b2-46b9-83cb-feee8b2b6e10 req-ed62c985-f1cf-49e6-9156-c3f264a3929a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:41.823065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5747d947-c1b2-46b9-83cb-feee8b2b6e10 req-ed62c985-f1cf-49e6-9156-c3f264a3929a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:41.823825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-5747d947-c1b2-46b9-83cb-feee8b2b6e10 req-ed62c985-f1cf-49e6-9156-c3f264a3929a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:41.856124 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-5747d947-c1b2-46b9-83cb-feee8b2b6e10 req-ed62c985-f1cf-49e6-9156-c3f264a3929a service nova] Creating event network-changed:5266fbe4-b303-4df0-9836-2e9af6f86cff for instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 on n-h2-858384-19 Nov 02 14:39:41.861792 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-5747d947-c1b2-46b9-83cb-feee8b2b6e10 req-ed62c985-f1cf-49e6-9156-c3f264a3929a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083006 Nov 02 14:39:41.862620 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3938/8244] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:43.192050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:43.192627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:43.193346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-31570026-14da-4544-8e48-a935dafc5c00 req-a997a3e7-4e1e-40ca-ba54-44b96d1bab24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd73098b-1eef-4aa8-b304-e6af5a8b2471", "tag": "5266fbe4-b303-4df0-9836-2e9af6f86cff"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:43.199620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:43.200370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:43.200826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:43.201555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:43.202193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:43.202636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:43.206205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-31570026-14da-4544-8e48-a935dafc5c00 req-a997a3e7-4e1e-40ca-ba54-44b96d1bab24 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:43.208200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-31570026-14da-4544-8e48-a935dafc5c00 req-a997a3e7-4e1e-40ca-ba54-44b96d1bab24 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:43.208767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-31570026-14da-4544-8e48-a935dafc5c00 req-a997a3e7-4e1e-40ca-ba54-44b96d1bab24 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:43.220851 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-31570026-14da-4544-8e48-a935dafc5c00 req-a997a3e7-4e1e-40ca-ba54-44b96d1bab24 service nova] Creating event network-changed:5266fbe4-b303-4df0-9836-2e9af6f86cff for instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 on n-h2-858384-19 Nov 02 14:39:43.226411 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-31570026-14da-4544-8e48-a935dafc5c00 req-a997a3e7-4e1e-40ca-ba54-44b96d1bab24 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037836 Nov 02 14:39:43.227872 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3939/8245] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:39:43.296464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lazy-loading 'services' on Instance uuid bd73098b-1eef-4aa8-b304-e6af5a8b2471 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:39:43.373934 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c4427aba-ab44-4362-b420-b5e4f89d89c6 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "DELETE /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments/6565c5e3-5dcd-47f2-8a23-d8274c1ed51d" status: 202 len: 0 microversion: 2.1 time: 0.186961 Nov 02 14:39:43.374859 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4307/8246] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:39:43 2022] DELETE /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments/6565c5e3-5dcd-47f2-8a23-d8274c1ed51d => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:39:43.386041 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bfbb61a2-9e97-4966-a7fb-32f883957423 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:43.389173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bfbb61a2-9e97-4966-a7fb-32f883957423 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:43.396336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfbb61a2-9e97-4966-a7fb-32f883957423 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:43.397004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfbb61a2-9e97-4966-a7fb-32f883957423 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:43.397575 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfbb61a2-9e97-4966-a7fb-32f883957423 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:43.398404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfbb61a2-9e97-4966-a7fb-32f883957423 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:43.398985 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfbb61a2-9e97-4966-a7fb-32f883957423 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:43.399561 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bfbb61a2-9e97-4966-a7fb-32f883957423 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:43.436363 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bfbb61a2-9e97-4966-a7fb-32f883957423 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056623 Nov 02 14:39:43.441832 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3940/8247] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:39:43 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:44.451727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c969c692-ad00-413c-ae68-6a5dc6b0caad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:44.454142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c969c692-ad00-413c-ae68-6a5dc6b0caad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:44.460488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c969c692-ad00-413c-ae68-6a5dc6b0caad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.460980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c969c692-ad00-413c-ae68-6a5dc6b0caad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.461574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c969c692-ad00-413c-ae68-6a5dc6b0caad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:44.462880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c969c692-ad00-413c-ae68-6a5dc6b0caad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:44.463410 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c969c692-ad00-413c-ae68-6a5dc6b0caad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:44.463855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c969c692-ad00-413c-ae68-6a5dc6b0caad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:44.496697 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c969c692-ad00-413c-ae68-6a5dc6b0caad tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051039 Nov 02 14:39:44.497284 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4308/8248] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:39:44 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:45.510366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-66bcc4c1-c6a7-4ce3-9246-f2a7b337d964 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:45.512654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-66bcc4c1-c6a7-4ce3-9246-f2a7b337d964 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:45.519741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66bcc4c1-c6a7-4ce3-9246-f2a7b337d964 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:45.520246 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66bcc4c1-c6a7-4ce3-9246-f2a7b337d964 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:45.520697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66bcc4c1-c6a7-4ce3-9246-f2a7b337d964 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:45.521423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66bcc4c1-c6a7-4ce3-9246-f2a7b337d964 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:45.521885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66bcc4c1-c6a7-4ce3-9246-f2a7b337d964 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:45.522316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-66bcc4c1-c6a7-4ce3-9246-f2a7b337d964 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:45.559801 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-66bcc4c1-c6a7-4ce3-9246-f2a7b337d964 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054350 Nov 02 14:39:45.560386 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3941/8249] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:39:45 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:39:46.573146 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2b661513-0ecc-4def-be09-ca7d67ce814b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:46.575520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2b661513-0ecc-4def-be09-ca7d67ce814b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:46.582466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b661513-0ecc-4def-be09-ca7d67ce814b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:46.582960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b661513-0ecc-4def-be09-ca7d67ce814b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:46.583432 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b661513-0ecc-4def-be09-ca7d67ce814b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:46.584148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b661513-0ecc-4def-be09-ca7d67ce814b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:46.584603 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b661513-0ecc-4def-be09-ca7d67ce814b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:46.585039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2b661513-0ecc-4def-be09-ca7d67ce814b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:46.618797 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2b661513-0ecc-4def-be09-ca7d67ce814b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050343 Nov 02 14:39:46.619400 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4309/8250] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:39:46 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:47.633078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8d093c1c-4d2e-457b-ae73-69ef320ccbfc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:47.635798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8d093c1c-4d2e-457b-ae73-69ef320ccbfc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:47.642919 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d093c1c-4d2e-457b-ae73-69ef320ccbfc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:47.643434 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d093c1c-4d2e-457b-ae73-69ef320ccbfc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:47.643925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d093c1c-4d2e-457b-ae73-69ef320ccbfc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:47.646020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d093c1c-4d2e-457b-ae73-69ef320ccbfc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:47.646500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d093c1c-4d2e-457b-ae73-69ef320ccbfc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:47.646950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8d093c1c-4d2e-457b-ae73-69ef320ccbfc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:47.680651 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8d093c1c-4d2e-457b-ae73-69ef320ccbfc tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051605 Nov 02 14:39:47.687572 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3942/8251] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:39:47 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:48.700085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e467d87-118f-4ab8-9037-251630a4c0b0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:48.702291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e467d87-118f-4ab8-9037-251630a4c0b0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:48.709253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e467d87-118f-4ab8-9037-251630a4c0b0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:48.709738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e467d87-118f-4ab8-9037-251630a4c0b0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:48.710184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e467d87-118f-4ab8-9037-251630a4c0b0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:48.710886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e467d87-118f-4ab8-9037-251630a4c0b0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:48.711379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e467d87-118f-4ab8-9037-251630a4c0b0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:48.711818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e467d87-118f-4ab8-9037-251630a4c0b0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:48.741683 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e467d87-118f-4ab8-9037-251630a4c0b0 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046263 Nov 02 14:39:48.742237 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4310/8252] 10.222.0.113 () {58 vars in 1307 bytes} [Wed Nov 2 14:39:48 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 14:39:48.753955 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:48.754468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:48.760798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:48.761606 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:48.762067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:48.762777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:48.763277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:48.763721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:48.952492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] HTTP exception thrown: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 is not attached to volume 6565c5e3-5dcd-47f2-8a23-d8274c1ed51d Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Request method failure captured: Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: request: DELETE /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments/6565c5e3-5dcd-47f2-8a23-d8274c1ed51d HTTP/1.1 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn827XgbgU4_w5r4L8OouswwKHMzfEdrixTUprFH1gU3S3oyv0wa9JdY5SQya_hkY7OZD5zXf8a4KbT6h7881sEPBJP-0182XBnHNR50RzOTIADG_cqEsS-5cxY5bzrIv9ho7NDfGQaDWL1y8ynnNt4igkPR0EYQa94z3iy09DLwG24 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 6d9f20a73f81462da2fdae7f399e2718 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 6d9f20a73f81462da2fdae7f399e2718 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestMinimumBasicScenario-2103585067-project Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 9a5330233ec84853b4b3a7d88dba073a Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestMinimumBasicScenario-2103585067-project Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 is not attached to volume 6565c5e3-5dcd-47f2-8a23-d8274c1ed51d Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'server_id': 'bd73098b-1eef-4aa8-b304-e6af5a8b2471', 'id': '6565c5e3-5dcd-47f2-8a23-d8274c1ed51d'} Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6565c5e3-5dcd-47f2-8a23-d8274c1ed51d. Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 is not attached to volume 6565c5e3-5dcd-47f2-8a23-d8274c1ed51d Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:48.954130 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:48.958800 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:39:48.958800 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:39:48.958800 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 is not attached to volume 6565c5e3-5dcd-47f2-8a23-d8274c1ed51d Nov 02 14:39:48.958800 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:48.958800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Returning 404 to user: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 is not attached to volume 6565c5e3-5dcd-47f2-8a23-d8274c1ed51d {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:39:48.958800 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-05d2a0b8-228d-4211-a8db-b2a631abb21b tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "DELETE /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments/6565c5e3-5dcd-47f2-8a23-d8274c1ed51d" status: 404 len: 154 microversion: 2.1 time: 0.206012 Nov 02 14:39:48.958800 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3943/8253] 10.222.0.113 () {58 vars in 1421 bytes} [Wed Nov 2 14:39:48 2022] DELETE /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471/os-volume_attachments/6565c5e3-5dcd-47f2-8a23-d8274c1ed51d => generated 154 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:39:52.206391 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:52.206949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:52.214452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.214951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.215423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:52.216143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.216600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.217033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:52.242937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:39:52.317443 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-64a1386f-d423-480d-a065-8e669f97da96 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "DELETE /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 204 len: 0 microversion: 2.1 time: 0.114601 Nov 02 14:39:52.318323 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4311/8254] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:39:52 2022] DELETE /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:39:52.327922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:52.328663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:52.336543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.337176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.337713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:52.338563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:52.339207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:52.339713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:52.475726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:52.484739 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e36e5b64-3d78-46c0-a876-8ac709d1e055 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1557 microversion: 2.1 time: 0.161971 Nov 02 14:39:52.485423 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3944/8255] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:39:52 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:53.509107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:53.509812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:53.516938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:53.517420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:53.517858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:53.518556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:53.519009 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:53.519464 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:53.656224 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:53.664847 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bfa49372-a59b-4240-81c8-1995663e2186 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1557 microversion: 2.1 time: 0.160094 Nov 02 14:39:53.665451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4312/8256] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:39:53 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:54.642184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d3bf59c4-a1d5-430e-9584-0ae373f3586a req-6db6fafd-0715-400a-9e17-a4cc0f5d849b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd73098b-1eef-4aa8-b304-e6af5a8b2471", "name": "network-vif-deleted", "tag": "5266fbe4-b303-4df0-9836-2e9af6f86cff"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:39:54.654960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3bf59c4-a1d5-430e-9584-0ae373f3586a req-6db6fafd-0715-400a-9e17-a4cc0f5d849b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:54.655417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3bf59c4-a1d5-430e-9584-0ae373f3586a req-6db6fafd-0715-400a-9e17-a4cc0f5d849b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:54.655881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d3bf59c4-a1d5-430e-9584-0ae373f3586a req-6db6fafd-0715-400a-9e17-a4cc0f5d849b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:54.668216 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d3bf59c4-a1d5-430e-9584-0ae373f3586a req-6db6fafd-0715-400a-9e17-a4cc0f5d849b service nova] Creating event network-vif-deleted:5266fbe4-b303-4df0-9836-2e9af6f86cff for instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 on n-h2-858384-19 Nov 02 14:39:54.673160 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d3bf59c4-a1d5-430e-9584-0ae373f3586a req-6db6fafd-0715-400a-9e17-a4cc0f5d849b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034827 Nov 02 14:39:54.674252 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3945/8257] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:39:54.688865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:54.689491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:54.696499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:54.697007 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:54.697451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:54.698943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:54.699448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:54.699891 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:54.772072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5330233ec84853b4b3a7d88dba073a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d9f20a73f81462da2fdae7f399e2718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:39:54.781087 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2cf82728-6241-47cf-8201-24637171d631 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 200 len: 1346 microversion: 2.1 time: 0.096399 Nov 02 14:39:54.781682 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4313/8258] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:39:54 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:39:55.805661 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:55.806382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [instance: bd73098b-1eef-4aa8-b304-e6af5a8b2471] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:39:55.813167 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:55.813665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:55.814120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:55.814830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:39:55.815329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:39:55.815775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:39:55.829131 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] HTTP exception thrown: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 could not be found. Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Request method failure captured: Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 HTTP/1.1 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYn827XgbgU4_w5r4L8OouswwKHMzfEdrixTUprFH1gU3S3oyv0wa9JdY5SQya_hkY7OZD5zXf8a4KbT6h7881sEPBJP-0182XBnHNR50RzOTIADG_cqEsS-5cxY5bzrIv9ho7NDfGQaDWL1y8ynnNt4igkPR0EYQa94z3iy09DLwG24 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 6d9f20a73f81462da2fdae7f399e2718 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/6d9f20a73f81462da2fdae7f399e2718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 6d9f20a73f81462da2fdae7f399e2718 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2103585067 Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestMinimumBasicScenario-2103585067-project Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 9a5330233ec84853b4b3a7d88dba073a Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestMinimumBasicScenario-2103585067-project Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 could not be found. Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'bd73098b-1eef-4aa8-b304-e6af5a8b2471'} Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 could not be found. Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 could not be found. Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:39:55.830749 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 could not be found. Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Returning 404 to user: Instance bd73098b-1eef-4aa8-b304-e6af5a8b2471 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6ff5299-6c8c-48b0-a9c3-8bb0fdc659a1 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471" status: 404 len: 111 microversion: 2.1 time: 0.031781 Nov 02 14:39:55.835775 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3946/8259] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:39:55 2022] GET /compute/v2.1/servers/bd73098b-1eef-4aa8-b304-e6af5a8b2471 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:39:55.841751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e5578581-5031-450d-977c-b1eab9bfdc84 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] Calling method '.version_select at 0x7fe78772c4c0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:39:55.846421 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5578581-5031-450d-977c-b1eab9bfdc84 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [502537fa-e8ab-4b94-bfc3-a3d2264ac5f5] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:39:56.855820 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5578581-5031-450d-977c-b1eab9bfdc84 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] [502537fa-e8ab-4b94-bfc3-a3d2264ac5f5] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 45442. Nov 02 14:39:56.876650 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e5578581-5031-450d-977c-b1eab9bfdc84 tempest-TestMinimumBasicScenario-2103585067 tempest-TestMinimumBasicScenario-2103585067-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-895262404" status: 202 len: 0 microversion: 2.1 time: 1.039517 Nov 02 14:39:56.877248 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4314/8260] 10.222.0.113 () {58 vars in 1274 bytes} [Wed Nov 2 14:39:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-895262404 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:40:05.539901 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:40:05.540470 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:40:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.113) !!! Nov 02 14:40:05.687738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e66d68b3-fccc-4df8-8f9b-18932d5f785a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: .version_select at 0x7fe7866ed1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-691890711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr1NZGzkZITb7af/S668Xyatd3GqpMlbpUTHMZ/doJeoVMKJSgizv6RHoqlTOicIR4SfE9UrUOZhesGJ8cRzpmXTv/k3+2h9rk30ypW41fhjdkL9ZYyVpFTkWcycWSSxw=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:05.704565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-e66d68b3-fccc-4df8-8f9b-18932d5f785a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:40:05.709675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-e66d68b3-fccc-4df8-8f9b-18932d5f785a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:40:05.740878 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e66d68b3-fccc-4df8-8f9b-18932d5f785a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.229300 Nov 02 14:40:05.741685 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3947/8261] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:40:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:11.708552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:11.709481 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:40:11.709673 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:40:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.113) !!! Nov 02 14:40:11.712780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:11.719614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1487054769", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "1099fc6f-11bc-4e75-a855-9a6e93394300"}], "key_name": "tempest-TestNetworkAdvancedServerOps-691890711", "security_groups": [{"name": "tempest-secgroup-smoke-1882917151"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:11.849888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] validate_networks() for [('1099fc6f-11bc-4e75-a855-9a6e93394300', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:40:12.310725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:40:12.311223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:40:12.311762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:40:12.312621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:40:12.313198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:40:12.329119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:12.329751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:12.330980 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:12.331996 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:12.332583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:12.333126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:12.353899 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:40:12.360476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:40:12.381989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:40:12.384363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:40:12.450387 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-580950ba-4e46-4d89-a616-88c802e604c4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.743951 Nov 02 14:40:12.451785 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4315/8262] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:40:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:40:12.462897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62f6cce7-6b02-4c11-beab-bb19bd6b8f78 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:12.463599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-62f6cce7-6b02-4c11-beab-bb19bd6b8f78 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:12.475654 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=38 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:12.480390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:12.571873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-62f6cce7-6b02-4c11-beab-bb19bd6b8f78 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:12.581701 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62f6cce7-6b02-4c11-beab-bb19bd6b8f78 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1270 microversion: 2.1 time: 0.122641 Nov 02 14:40:12.582692 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3948/8263] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:12 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1270 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:13.608785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-405d8e2b-94e9-4e59-b6cf-4c0fbee23b7b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:13.610006 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-405d8e2b-94e9-4e59-b6cf-4c0fbee23b7b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:13.673350 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-405d8e2b-94e9-4e59-b6cf-4c0fbee23b7b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:13.680449 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-405d8e2b-94e9-4e59-b6cf-4c0fbee23b7b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1270 microversion: 2.1 time: 0.076535 Nov 02 14:40:13.681147 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4316/8264] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:13 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1270 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:14.704713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b99164c1-b2eb-4667-9445-e166101d4412 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:14.708722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b99164c1-b2eb-4667-9445-e166101d4412 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:14.767863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b99164c1-b2eb-4667-9445-e166101d4412 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:14.776367 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b99164c1-b2eb-4667-9445-e166101d4412 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1270 microversion: 2.1 time: 0.075548 Nov 02 14:40:14.777630 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3949/8265] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:14 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1270 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:15.800330 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:15.801717 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:15.809078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:15.809568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:15.810018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:15.810735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:15.811253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:15.811690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:15.874467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:15.882307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-97e53824-1c1e-4ad3-9627-e5a33ba9b89b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1274 microversion: 2.1 time: 0.085949 Nov 02 14:40:15.882899 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4317/8266] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:15 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:16.906283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:16.907194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:16.914081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:16.914574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:16.915025 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:16.915758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:16.916223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:16.916664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:16.996427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:17.004512 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f165eacc-6310-4f19-ba63-cb43287fd68b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1328 microversion: 2.1 time: 0.102096 Nov 02 14:40:17.005100 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3950/8267] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:16 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:18.028646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:18.030485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:18.037553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:18.038128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:18.038760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:18.039500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:18.039956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:18.040384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:18.176055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:18.185767 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-58471939-2158-49fe-9daf-385574ebb025 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1396 microversion: 2.1 time: 0.161967 Nov 02 14:40:18.186754 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4318/8268] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:18 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:18.549647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e6b83acd-70bd-42f2-b08c-3d537be409aa req-cd12e65a-f008-4e46-8746-b0a45eb0deae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ccd664-93d0-4c40-90e6-f88230a60abf", "tag": "65a7e966-b7b6-477c-89ca-982a74d3c523"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:18.560747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e6b83acd-70bd-42f2-b08c-3d537be409aa req-cd12e65a-f008-4e46-8746-b0a45eb0deae service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:18.561253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e6b83acd-70bd-42f2-b08c-3d537be409aa req-cd12e65a-f008-4e46-8746-b0a45eb0deae service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:18.561706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e6b83acd-70bd-42f2-b08c-3d537be409aa req-cd12e65a-f008-4e46-8746-b0a45eb0deae service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:18.574736 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e6b83acd-70bd-42f2-b08c-3d537be409aa req-cd12e65a-f008-4e46-8746-b0a45eb0deae service nova] Creating event network-changed:65a7e966-b7b6-477c-89ca-982a74d3c523 for instance 98ccd664-93d0-4c40-90e6-f88230a60abf on n-h1-858384-19 Nov 02 14:40:18.580480 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e6b83acd-70bd-42f2-b08c-3d537be409aa req-cd12e65a-f008-4e46-8746-b0a45eb0deae service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035094 Nov 02 14:40:18.581111 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3951/8269] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:19.209969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:19.210633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:19.218259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.218758 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.219231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.219960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:19.220427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:19.220869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:19.360126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:19.368307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1bbe0d1f-d1ca-4477-af67-7d1698f84f6d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1396 microversion: 2.1 time: 0.162302 Nov 02 14:40:19.369031 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4319/8270] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:19 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:20.393664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:20.394391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:20.400713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:20.401817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:20.402359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:20.403090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:20.403592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:20.404047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:20.540322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:20.548744 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-953b722a-6293-41ad-8c8c-a5b60dadd915 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1396 microversion: 2.1 time: 0.160172 Nov 02 14:40:20.549344 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3952/8271] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:20 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:21.572940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:21.573594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:21.580473 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:21.580966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:21.581421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:21.582131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:21.582594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:21.583035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:21.718951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:21.727076 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f90ee252-4c28-422c-8d70-16f5ca3a41a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1396 microversion: 2.1 time: 0.158111 Nov 02 14:40:21.727693 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4320/8272] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:21 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:22.750945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:22.751521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:22.758341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:22.758831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:22.759313 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:22.760018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:22.760528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:22.761112 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:22.891659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:22.899372 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5cf07945-b90b-42ac-afd1-366301faa4bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1396 microversion: 2.1 time: 0.152421 Nov 02 14:40:22.899954 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3953/8273] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:22 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:23.922491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:23.923106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:23.925017 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:23.926625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:23.934545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:23.935026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:23.935490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:23.936184 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:23.936635 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:23.937062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:24.071620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:24.080284 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ecec8e49-aa90-4518-958b-f59ceca148ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1396 microversion: 2.1 time: 0.161718 Nov 02 14:40:24.080869 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4321/8274] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:23 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:40:24.584320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a429b650-ff36-4bc9-9aac-406b098bb841 req-904aa06a-3f9b-4d71-9368-ba97ff83a294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ccd664-93d0-4c40-90e6-f88230a60abf", "name": "network-vif-plugged", "status": "completed", "tag": "65a7e966-b7b6-477c-89ca-982a74d3c523"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:24.594856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a429b650-ff36-4bc9-9aac-406b098bb841 req-904aa06a-3f9b-4d71-9368-ba97ff83a294 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:24.595409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a429b650-ff36-4bc9-9aac-406b098bb841 req-904aa06a-3f9b-4d71-9368-ba97ff83a294 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:24.595844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a429b650-ff36-4bc9-9aac-406b098bb841 req-904aa06a-3f9b-4d71-9368-ba97ff83a294 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:24.607079 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a429b650-ff36-4bc9-9aac-406b098bb841 req-904aa06a-3f9b-4d71-9368-ba97ff83a294 service nova] Creating event network-vif-plugged:65a7e966-b7b6-477c-89ca-982a74d3c523 for instance 98ccd664-93d0-4c40-90e6-f88230a60abf on n-h1-858384-19 Nov 02 14:40:24.612379 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a429b650-ff36-4bc9-9aac-406b098bb841 req-904aa06a-3f9b-4d71-9368-ba97ff83a294 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031865 Nov 02 14:40:24.613006 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3954/8275] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:40:25.103266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:25.103880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:25.111105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:25.111613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:25.112052 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:25.112749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:25.113200 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:25.113658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:25.247661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:25.255342 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9846e28c-3afb-4111-9522-646616172d24 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1396 microversion: 2.1 time: 0.156033 Nov 02 14:40:25.255925 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4322/8276] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:25 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1396 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:26.275194 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:40:26.281880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:26.282599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:26.288928 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:26.289431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:26.289888 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:26.290603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:26.291075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:26.291631 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:26.428164 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:26.435889 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9da819ab-d4a9-44ac-b7b3-7e91a804b684 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1568 microversion: 2.1 time: 0.161791 Nov 02 14:40:26.436472 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3955/8277] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:26 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:26.458339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:26.458954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:26.466422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:26.466919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:26.467434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:26.468157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:26.468610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:26.469038 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:26.606226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:26.614168 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c5a2b101-abd8-4056-8989-5dac65181faf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1568 microversion: 2.1 time: 0.159732 Nov 02 14:40:26.614742 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4323/8278] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:26 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:40:28.541172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:40:28.542361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:40:28.544367 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-23fc83b4-b56e-4ed6-a626-3ed434de3f00 req-83e0f43d-1aa9-4ec8-8fe7-651cb9898fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ccd664-93d0-4c40-90e6-f88230a60abf", "tag": "65a7e966-b7b6-477c-89ca-982a74d3c523"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:40:28.549811 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:28.550316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:28.550822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:28.551620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:28.552480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:28.552842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:28.564207 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-23fc83b4-b56e-4ed6-a626-3ed434de3f00 req-83e0f43d-1aa9-4ec8-8fe7-651cb9898fb8 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:40:28.564773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-23fc83b4-b56e-4ed6-a626-3ed434de3f00 req-83e0f43d-1aa9-4ec8-8fe7-651cb9898fb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:40:28.565371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-23fc83b4-b56e-4ed6-a626-3ed434de3f00 req-83e0f43d-1aa9-4ec8-8fe7-651cb9898fb8 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:40:28.578256 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-23fc83b4-b56e-4ed6-a626-3ed434de3f00 req-83e0f43d-1aa9-4ec8-8fe7-651cb9898fb8 service nova] Creating event network-changed:65a7e966-b7b6-477c-89ca-982a74d3c523 for instance 98ccd664-93d0-4c40-90e6-f88230a60abf on n-h1-858384-19 Nov 02 14:40:28.583572 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-23fc83b4-b56e-4ed6-a626-3ed434de3f00 req-83e0f43d-1aa9-4ec8-8fe7-651cb9898fb8 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043756 Nov 02 14:40:28.584192 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4324/8279] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:40:28.747206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:40:28.755962 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20c75e44-08ba-47a3-bd1e-6bf3e937dd01 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1568 microversion: 2.1 time: 0.218690 Nov 02 14:40:28.756758 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3956/8280] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:40:28 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:04.074064 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:04.075341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=46 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:04.079959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5870479b-bd78-4f7e-81a1-fddcb470393f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:04.082313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5870479b-bd78-4f7e-81a1-fddcb470393f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:04.089990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5870479b-bd78-4f7e-81a1-fddcb470393f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:04.091025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5870479b-bd78-4f7e-81a1-fddcb470393f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:04.091531 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5870479b-bd78-4f7e-81a1-fddcb470393f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:04.092234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5870479b-bd78-4f7e-81a1-fddcb470393f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:04.092695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5870479b-bd78-4f7e-81a1-fddcb470393f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:04.093134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5870479b-bd78-4f7e-81a1-fddcb470393f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:04.166781 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5870479b-bd78-4f7e-81a1-fddcb470393f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action" status: 200 len: 24563 microversion: 2.1 time: 0.094750 Nov 02 14:41:04.167463 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4325/8281] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:41:04 2022] POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action => generated 24563 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:41:34.608742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=21 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:34.609708 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=34 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:34.614232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8836020f-6343-4a43-90e2-aceb3416d8e6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:34.614779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8836020f-6343-4a43-90e2-aceb3416d8e6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:34.621443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8836020f-6343-4a43-90e2-aceb3416d8e6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:34.621937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8836020f-6343-4a43-90e2-aceb3416d8e6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:34.622447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8836020f-6343-4a43-90e2-aceb3416d8e6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.623347 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8836020f-6343-4a43-90e2-aceb3416d8e6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:34.623844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8836020f-6343-4a43-90e2-aceb3416d8e6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:34.624285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8836020f-6343-4a43-90e2-aceb3416d8e6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.690284 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8836020f-6343-4a43-90e2-aceb3416d8e6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action" status: 202 len: 0 microversion: 2.1 time: 0.083661 Nov 02 14:41:34.691646 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3957/8282] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:41:34 2022] POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:41:34.701514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:34.702398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:34.704814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:34.705458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:34.712334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:34.712821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:34.713265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.713969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:34.714423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:34.714852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:34.855371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:34.863592 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a2061b5e-b81d-4faa-9b3d-e9a57bc0d487 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1691 microversion: 2.1 time: 0.167185 Nov 02 14:41:34.864167 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4326/8283] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:34 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:35.887722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:35.888438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:35.895755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.896243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.896691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:35.897764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:35.898328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:35.898772 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:36.040097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:36.048552 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5ef31efd-6a36-4eae-a2f1-0287ef8129d2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1671 microversion: 2.1 time: 0.165186 Nov 02 14:41:36.049128 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3958/8284] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:35 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:37.145909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a3f7ef0a-879c-4f12-b667-a7c95e268102 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:37.148327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a3f7ef0a-879c-4f12-b667-a7c95e268102 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:37.157105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3f7ef0a-879c-4f12-b667-a7c95e268102 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.157594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3f7ef0a-879c-4f12-b667-a7c95e268102 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.158040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3f7ef0a-879c-4f12-b667-a7c95e268102 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.158748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3f7ef0a-879c-4f12-b667-a7c95e268102 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.159268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3f7ef0a-879c-4f12-b667-a7c95e268102 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.159710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a3f7ef0a-879c-4f12-b667-a7c95e268102 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.226327 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a3f7ef0a-879c-4f12-b667-a7c95e268102 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action" status: 200 len: 32627 microversion: 2.1 time: 0.084307 Nov 02 14:41:37.226977 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4327/8285] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:41:37 2022] POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action => generated 32627 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:41:37.238953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-48e1c6ef-9c88-4c01-8fc1-4b86c16d83b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:37.239616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-48e1c6ef-9c88-4c01-8fc1-4b86c16d83b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:37.246464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e1c6ef-9c88-4c01-8fc1-4b86c16d83b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.246966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e1c6ef-9c88-4c01-8fc1-4b86c16d83b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.247446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e1c6ef-9c88-4c01-8fc1-4b86c16d83b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.248155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e1c6ef-9c88-4c01-8fc1-4b86c16d83b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.248626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e1c6ef-9c88-4c01-8fc1-4b86c16d83b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.249115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-48e1c6ef-9c88-4c01-8fc1-4b86c16d83b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.316587 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-48e1c6ef-9c88-4c01-8fc1-4b86c16d83b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action" status: 202 len: 0 microversion: 2.1 time: 0.081340 Nov 02 14:41:37.317261 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3959/8286] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:41:37 2022] POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:41:37.328041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:37.328687 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:37.336535 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.337106 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.338274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.339368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:37.340187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:37.340653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:37.481648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:37.489760 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-feb88be2-367a-4013-8f17-4601c81dfee6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1678 microversion: 2.1 time: 0.166940 Nov 02 14:41:37.490341 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4328/8287] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:37 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:38.514787 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:38.515544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:38.524450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.524960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.525422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.526174 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.526650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.527098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.663921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:38.672373 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a337dc68-0bd1-4ec5-9410-922765127783 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1686 microversion: 2.1 time: 0.161979 Nov 02 14:41:38.672953 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3960/8288] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:38 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:38.773329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6ecc520f-ee87-459a-ae48-ed6eb914ae71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:38.775551 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6ecc520f-ee87-459a-ae48-ed6eb914ae71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:38.783648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ecc520f-ee87-459a-ae48-ed6eb914ae71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.784139 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ecc520f-ee87-459a-ae48-ed6eb914ae71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.784591 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ecc520f-ee87-459a-ae48-ed6eb914ae71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.785293 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ecc520f-ee87-459a-ae48-ed6eb914ae71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:38.785755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ecc520f-ee87-459a-ae48-ed6eb914ae71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:38.786204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6ecc520f-ee87-459a-ae48-ed6eb914ae71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:38.859893 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6ecc520f-ee87-459a-ae48-ed6eb914ae71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action" status: 200 len: 37139 microversion: 2.1 time: 0.089563 Nov 02 14:41:38.860578 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4329/8289] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:41:38 2022] POST /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf/action => generated 37139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:41:39.844726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-79ceb81b-7290-4bb4-b6b5-f8239db2e90e req-8c28d6f3-5354-489c-a343-896cadbd1f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ccd664-93d0-4c40-90e6-f88230a60abf", "tag": "65a7e966-b7b6-477c-89ca-982a74d3c523"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:39.855399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:39.856042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:39.863198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:39.863697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:39.864149 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.864870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:39.865336 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:39.865802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.866606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-79ceb81b-7290-4bb4-b6b5-f8239db2e90e req-8c28d6f3-5354-489c-a343-896cadbd1f9e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:39.867091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-79ceb81b-7290-4bb4-b6b5-f8239db2e90e req-8c28d6f3-5354-489c-a343-896cadbd1f9e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:39.867763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-79ceb81b-7290-4bb4-b6b5-f8239db2e90e req-8c28d6f3-5354-489c-a343-896cadbd1f9e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:39.885875 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-79ceb81b-7290-4bb4-b6b5-f8239db2e90e req-8c28d6f3-5354-489c-a343-896cadbd1f9e service nova] Creating event network-changed:65a7e966-b7b6-477c-89ca-982a74d3c523 for instance 98ccd664-93d0-4c40-90e6-f88230a60abf on n-h1-858384-19 Nov 02 14:41:39.892519 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-79ceb81b-7290-4bb4-b6b5-f8239db2e90e req-8c28d6f3-5354-489c-a343-896cadbd1f9e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052257 Nov 02 14:41:39.893353 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4330/8290] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:39.893591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:41:39.980965 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-08d52273-8de2-492c-b4c2-5c1124e472e2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 204 len: 0 microversion: 2.1 time: 0.141827 Nov 02 14:41:39.987207 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3961/8291] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:41:39 2022] DELETE /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:41:39.993550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:39.994376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:40.001429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.002204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.002724 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:40.003546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:40.004075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:40.004578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:40.148267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:40.156881 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-41f0d38e-d81b-4945-8ee3-47ddc8081fab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1692 microversion: 2.1 time: 0.168177 Nov 02 14:41:40.157462 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4331/8292] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:39 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:41:41.182399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:41.183047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:41.189992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:41.190497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:41.190959 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:41.191707 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:41.192190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:41.192635 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:41.328265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:41.336000 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a58a46ef-f2ad-4391-b956-a35e1766c3cd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1692 microversion: 2.1 time: 0.158317 Nov 02 14:41:41.336609 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3962/8293] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:41 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:42.362296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:42.362925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:42.369777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.370283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.370714 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.371451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.371908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.372342 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.464772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:42.474978 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8ff57c5d-5a47-47e5-bce8-8bed994475d4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 200 len: 1506 microversion: 2.1 time: 0.117962 Nov 02 14:41:42.475777 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4332/8294] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:42 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 1506 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:42.537645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-9d7f3d85-acce-432d-a93a-739d8b0f6cdc req-a8e45408-2356-4b65-b0ee-fd2d0e444535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ccd664-93d0-4c40-90e6-f88230a60abf", "name": "network-vif-deleted", "tag": "65a7e966-b7b6-477c-89ca-982a74d3c523"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:42.548168 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9d7f3d85-acce-432d-a93a-739d8b0f6cdc req-a8e45408-2356-4b65-b0ee-fd2d0e444535 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:42.548699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9d7f3d85-acce-432d-a93a-739d8b0f6cdc req-a8e45408-2356-4b65-b0ee-fd2d0e444535 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:42.549147 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-9d7f3d85-acce-432d-a93a-739d8b0f6cdc req-a8e45408-2356-4b65-b0ee-fd2d0e444535 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:42.562383 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-9d7f3d85-acce-432d-a93a-739d8b0f6cdc req-a8e45408-2356-4b65-b0ee-fd2d0e444535 service nova] Creating event network-vif-deleted:65a7e966-b7b6-477c-89ca-982a74d3c523 for instance 98ccd664-93d0-4c40-90e6-f88230a60abf on n-h1-858384-19 Nov 02 14:41:42.567289 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-9d7f3d85-acce-432d-a93a-739d8b0f6cdc req-a8e45408-2356-4b65-b0ee-fd2d0e444535 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093413 Nov 02 14:41:42.567972 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3963/8295] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:41:43.500326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:43.501004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 98ccd664-93d0-4c40-90e6-f88230a60abf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:43.507838 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.508329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.508776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.509479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:43.509942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:43.510379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:43.524237 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] HTTP exception thrown: Instance 98ccd664-93d0-4c40-90e6-f88230a60abf could not be found. Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Request method failure captured: Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf HTTP/1.1 Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYoFE8pUKf1IQIXfe6OlaOFnphQveAO1NwDWjLgi2hZ7y5Gm4RyxXF5nGHQKehOPYXCfevyjn2amLxRoJ96_g4j_N5gIikntXEZTbn8BP2DOM5zeZofusMmRKimgZIlTopOCkHYes3PD76hpMowtTP4oUvGNzdBmoQF6NeAikekXMr04 Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3c603b713fd14a0d98447bc1e1bc475d Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 98ccd664-93d0-4c40-90e6-f88230a60abf could not be found. Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '98ccd664-93d0-4c40-90e6-f88230a60abf'} Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ccd664-93d0-4c40-90e6-f88230a60abf could not be found. Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ccd664-93d0-4c40-90e6-f88230a60abf could not be found. Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:41:43.525889 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ccd664-93d0-4c40-90e6-f88230a60abf could not be found. Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Returning 404 to user: Instance 98ccd664-93d0-4c40-90e6-f88230a60abf could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-74b1c77d-ddb3-4729-b3de-492860062cb3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf" status: 404 len: 111 microversion: 2.1 time: 0.031546 Nov 02 14:41:43.530555 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4333/8296] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:43 2022] GET /compute/v2.1/servers/98ccd664-93d0-4c40-90e6-f88230a60abf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:41:46.577207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e85df09-3c26-444e-aa40-a6a510aa6208 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '.version_select at 0x7fe78697bca0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:46.583930 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:41:46.584093 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-691890711 (ip 10.222.0.113) !!! Nov 02 14:41:46.610069 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e85df09-3c26-444e-aa40-a6a510aa6208 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-691890711" status: 202 len: 0 microversion: 2.1 time: 0.037270 Nov 02 14:41:46.610655 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3964/8297] 10.222.0.113 () {58 vars in 1286 bytes} [Wed Nov 2 14:41:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-691890711 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:41:46.641301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-61f3adb3-4cd8-4a26-a9b6-ef6228aa0734 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: .version_select at 0x7fe78f98e160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-455303819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwZTM8Eld7fd40ZWcBHztC1qUecdqGFgTGHeCYD2zrZ+3pG2AgkVmGp9smejRGDWKkDoJS5zq9alNny4grRlwC+dfBQmqqkjtsF1EPQIOxIuoMbz58pmcJqSCZqYHsIaw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:46.659863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-61f3adb3-4cd8-4a26-a9b6-ef6228aa0734 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:41:46.665149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-61f3adb3-4cd8-4a26-a9b6-ef6228aa0734 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:41:46.694783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-61f3adb3-4cd8-4a26-a9b6-ef6228aa0734 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058219 Nov 02 14:41:46.695467 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4334/8298] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:41:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:52.380030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-889505672", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "a8936786-1717-4c22-b762-f0a32ee4d0f8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-455303819", "security_groups": [{"name": "tempest-secgroup-smoke-1553141657"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:52.513925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] validate_networks() for [('a8936786-1717-4c22-b762-f0a32ee4d0f8', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:41:52.554361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:53.056327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:41:53.057199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:41:53.057705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:41:53.058135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:41:53.058566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:41:53.070978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:53.071506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:53.071957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:53.072767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:53.073416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:53.074116 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:53.098586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:41:53.105273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:41:53.120046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:41:53.122598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:41:53.175845 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b963d4d-d5e4-4afb-aff4-7f3244383e03 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.800228 Nov 02 14:41:53.176498 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3965/8299] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:41:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:41:53.190312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-096ad7d5-bb90-48d8-ac7f-e1cc9cb8d4e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:53.193786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-096ad7d5-bb90-48d8-ac7f-e1cc9cb8d4e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:53.263541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-096ad7d5-bb90-48d8-ac7f-e1cc9cb8d4e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:53.272337 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-096ad7d5-bb90-48d8-ac7f-e1cc9cb8d4e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1269 microversion: 2.1 time: 0.088344 Nov 02 14:41:53.272935 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4335/8300] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:53 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1269 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:54.298210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-45c71807-f89a-4345-939d-7953309984b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:54.298844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-45c71807-f89a-4345-939d-7953309984b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:54.367161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-45c71807-f89a-4345-939d-7953309984b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:54.375427 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-45c71807-f89a-4345-939d-7953309984b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1269 microversion: 2.1 time: 0.083234 Nov 02 14:41:54.376029 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3966/8301] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:54 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:55.398251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4be83189-b5d1-4fa8-821c-9188afe832c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:55.398875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4be83189-b5d1-4fa8-821c-9188afe832c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:55.401096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=36 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:41:55.466362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4be83189-b5d1-4fa8-821c-9188afe832c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:55.474182 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4be83189-b5d1-4fa8-821c-9188afe832c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1269 microversion: 2.1 time: 0.080004 Nov 02 14:41:55.474776 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4336/8302] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:55 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1269 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:56.497604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:56.498237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:56.507027 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:56.507569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:56.508029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.508750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:56.509226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:56.509674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:56.573124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:56.581096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed2d07be-f36c-4f04-a1b0-92c43e6bff95 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1273 microversion: 2.1 time: 0.087519 Nov 02 14:41:56.581676 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3967/8303] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:56 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:57.605606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:57.606218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:57.614658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.615168 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.615617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.616320 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:57.616778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:57.617205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:57.707683 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:57.715945 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e50ee2d9-5104-4b3b-a7ed-bbdbbd48d6f9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1327 microversion: 2.1 time: 0.115005 Nov 02 14:41:57.716129 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4337/8304] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:57 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:41:58.707272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ba6e27e7-1405-4398-bade-5b34081ed561 req-d1925382-e0e9-4173-841d-121dd1c36f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c27f94-c452-4008-a42e-f8ac0db9477e", "tag": "cedf9db1-745d-4f22-a283-3c00c856c9d3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:41:58.718792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ba6e27e7-1405-4398-bade-5b34081ed561 req-d1925382-e0e9-4173-841d-121dd1c36f70 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:58.719619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ba6e27e7-1405-4398-bade-5b34081ed561 req-d1925382-e0e9-4173-841d-121dd1c36f70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:58.720072 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ba6e27e7-1405-4398-bade-5b34081ed561 req-d1925382-e0e9-4173-841d-121dd1c36f70 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:58.731627 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ba6e27e7-1405-4398-bade-5b34081ed561 req-d1925382-e0e9-4173-841d-121dd1c36f70 service nova] Creating event network-changed:cedf9db1-745d-4f22-a283-3c00c856c9d3 for instance 92c27f94-c452-4008-a42e-f8ac0db9477e on n-h2-858384-19 Nov 02 14:41:58.738049 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ba6e27e7-1405-4398-bade-5b34081ed561 req-d1925382-e0e9-4173-841d-121dd1c36f70 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034722 Nov 02 14:41:58.738946 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3968/8305] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:41:58.741481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:41:58.742125 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:41:58.749943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:58.750428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:58.750865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:58.751849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:41:58.752307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:41:58.752924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:41:58.992878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:41:59.001150 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-98e630c9-e60f-4e06-907e-e88bd15268ac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1395 microversion: 2.1 time: 0.263914 Nov 02 14:41:59.001755 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4338/8306] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:41:58 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1395 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:00.025880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:00.026607 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:00.033882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:00.034387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:00.034846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:00.035602 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:00.036079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:00.036527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:00.169798 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:00.178203 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-94cfc9e8-f934-476a-886b-5d83cdc684ff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1395 microversion: 2.1 time: 0.157564 Nov 02 14:42:00.178784 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3969/8307] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:00 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:01.202413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:01.203208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:01.210081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.210573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.211024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:01.211757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:01.212222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:01.212664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:01.344636 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:01.352490 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce8e447a-38ba-45d8-8614-cdda4b290193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1395 microversion: 2.1 time: 0.154558 Nov 02 14:42:01.353089 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4339/8308] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:01 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1395 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:02.378006 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:02.378641 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:02.385614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:02.386109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:02.386563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:02.387305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:02.387774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:02.388217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:02.527278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:02.536053 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cfad45e1-6c10-4445-a2fd-eca21372899d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1395 microversion: 2.1 time: 0.162417 Nov 02 14:42:02.536638 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3970/8309] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:02 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1395 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:42:03.559294 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:03.559924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:03.566879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:03.567399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:03.567854 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:03.568562 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:03.569027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:03.569468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:03.706830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:03.715300 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5dabe392-9909-4c15-a751-e1fef4bb2bcb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1395 microversion: 2.1 time: 0.160043 Nov 02 14:42:03.715967 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4340/8310] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:03 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:04.739417 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:04.740028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:04.742001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:04.743565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=8 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:04.744304 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:04.751186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:04.751688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:04.752144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:04.752852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:04.753318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:04.753756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:04.888846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:04.897002 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-68eb83a3-de66-43c6-90ab-6da3cf32a241 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1395 microversion: 2.1 time: 0.161608 Nov 02 14:42:04.897577 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3971/8311] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:04 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:05.790131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9866fa6b-c7e9-4f45-89e6-61eead990669 req-b339c479-eb0f-442a-b9ea-0f3d9390b860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c27f94-c452-4008-a42e-f8ac0db9477e", "name": "network-vif-plugged", "status": "completed", "tag": "cedf9db1-745d-4f22-a283-3c00c856c9d3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:05.796208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:05.796974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:05.803692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9866fa6b-c7e9-4f45-89e6-61eead990669 req-b339c479-eb0f-442a-b9ea-0f3d9390b860 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.804226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9866fa6b-c7e9-4f45-89e6-61eead990669 req-b339c479-eb0f-442a-b9ea-0f3d9390b860 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.804617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9866fa6b-c7e9-4f45-89e6-61eead990669 req-b339c479-eb0f-442a-b9ea-0f3d9390b860 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.820157 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9866fa6b-c7e9-4f45-89e6-61eead990669 req-b339c479-eb0f-442a-b9ea-0f3d9390b860 service nova] Creating event network-vif-plugged:cedf9db1-745d-4f22-a283-3c00c856c9d3 for instance 92c27f94-c452-4008-a42e-f8ac0db9477e on n-h2-858384-19 Nov 02 14:42:05.825246 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9866fa6b-c7e9-4f45-89e6-61eead990669 req-b339c479-eb0f-442a-b9ea-0f3d9390b860 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038922 Nov 02 14:42:05.825850 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4341/8312] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:05.920993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:05.921704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:05.928872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.929497 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.929953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:05.930670 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:05.931157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:05.931599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:06.068545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:06.076282 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8f7f66f6-44ca-4aea-89a8-0bccdff7053d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1395 microversion: 2.1 time: 0.159617 Nov 02 14:42:06.077580 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3972/8313] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:05 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1395 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:07.101357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:07.102069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:07.108832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.109315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.109765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.110489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:07.110934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:07.111416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:07.243915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:07.253177 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-cb2e9129-2884-424b-b182-6aeb30108de6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1395 microversion: 2.1 time: 0.156976 Nov 02 14:42:07.253792 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4342/8314] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:07 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:08.278891 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:08.279556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:08.287527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.288038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.288496 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.289220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.289703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.290152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.432043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:08.439765 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-108534f8-4f34-4b15-b6bf-d0b7b68c2276 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1568 microversion: 2.1 time: 0.164919 Nov 02 14:42:08.440361 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3973/8315] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:08 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:08.462678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:08.463334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:08.470708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.471225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.471674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.472384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:08.472845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:08.473285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:08.605690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:08.613960 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29952cdc-ec36-4d8c-b483-7d89c3ee0534 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1568 microversion: 2.1 time: 0.155469 Nov 02 14:42:08.614547 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4343/8316] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:08 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:10.514543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-a8050af7-5c7a-409f-98fb-89c889027e5c req-fa5dc2ad-8898-4f26-91f6-56a55636a36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c27f94-c452-4008-a42e-f8ac0db9477e", "tag": "cedf9db1-745d-4f22-a283-3c00c856c9d3"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:10.518777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:42:10.519923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:10.527222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:10.527752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:10.528210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:10.528936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:10.529518 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:10.530485 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:10.544742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a8050af7-5c7a-409f-98fb-89c889027e5c req-fa5dc2ad-8898-4f26-91f6-56a55636a36f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:10.546071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a8050af7-5c7a-409f-98fb-89c889027e5c req-fa5dc2ad-8898-4f26-91f6-56a55636a36f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:10.546858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-a8050af7-5c7a-409f-98fb-89c889027e5c req-fa5dc2ad-8898-4f26-91f6-56a55636a36f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:10.559264 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-a8050af7-5c7a-409f-98fb-89c889027e5c req-fa5dc2ad-8898-4f26-91f6-56a55636a36f service nova] Creating event network-changed:cedf9db1-745d-4f22-a283-3c00c856c9d3 for instance 92c27f94-c452-4008-a42e-f8ac0db9477e on n-h2-858384-19 Nov 02 14:42:10.564709 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-a8050af7-5c7a-409f-98fb-89c889027e5c req-fa5dc2ad-8898-4f26-91f6-56a55636a36f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054126 Nov 02 14:42:10.565675 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4344/8317] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:42:10.680398 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:42:10.689022 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-88886c3a-b819-4ad9-99c1-87c9deeefba7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1568 microversion: 2.1 time: 0.180378 Nov 02 14:42:10.689774 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3974/8318] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:42:10 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:42:45.979920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:45.980595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=40 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:42:45.985143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-100678b8-4b1d-4d0b-99ca-74ab28ecb0b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:42:45.987601 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-100678b8-4b1d-4d0b-99ca-74ab28ecb0b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:42:45.994618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100678b8-4b1d-4d0b-99ca-74ab28ecb0b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.995127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100678b8-4b1d-4d0b-99ca-74ab28ecb0b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.995590 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100678b8-4b1d-4d0b-99ca-74ab28ecb0b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:45.996296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100678b8-4b1d-4d0b-99ca-74ab28ecb0b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:42:45.996759 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100678b8-4b1d-4d0b-99ca-74ab28ecb0b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:42:45.997197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-100678b8-4b1d-4d0b-99ca-74ab28ecb0b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:42:46.052806 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-100678b8-4b1d-4d0b-99ca-74ab28ecb0b5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e/action" status: 200 len: 24572 microversion: 2.1 time: 0.074993 Nov 02 14:42:46.053477 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4345/8319] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:42:45 2022] POST /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e/action => generated 24572 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:43:16.473124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=7 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:16.473912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=46 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:16.478511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b79a502d-aa8a-4d2f-be71-b1d103249b52 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:43:16.480850 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b79a502d-aa8a-4d2f-be71-b1d103249b52 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:16.487925 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b79a502d-aa8a-4d2f-be71-b1d103249b52 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.488438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b79a502d-aa8a-4d2f-be71-b1d103249b52 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.488889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b79a502d-aa8a-4d2f-be71-b1d103249b52 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.489599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b79a502d-aa8a-4d2f-be71-b1d103249b52 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.491078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b79a502d-aa8a-4d2f-be71-b1d103249b52 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.491556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b79a502d-aa8a-4d2f-be71-b1d103249b52 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.566253 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b79a502d-aa8a-4d2f-be71-b1d103249b52 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e/action" status: 202 len: 0 microversion: 2.1 time: 0.094809 Nov 02 14:43:16.568872 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3975/8320] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:43:16 2022] POST /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:43:16.576632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:16.577439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:16.580268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:16.581060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:43:16.587414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.587897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.588401 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.589041 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:16.589502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:16.589931 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:16.812821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:16.820987 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d387675c-ff98-4589-b250-db4e5ce159be tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1678 microversion: 2.1 time: 0.248605 Nov 02 14:43:16.821568 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4346/8321] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:16 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:17.845833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:17.846563 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:17.853269 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:17.853770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:17.854227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:17.854944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:17.855447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:17.855898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:17.988889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:17.997616 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-050e6f5f-c7c6-4901-9161-dd91a0649d6b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1683 microversion: 2.1 time: 0.157531 Nov 02 14:43:17.998192 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3976/8322] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:17 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:19.023297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:19.023908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:19.030598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:19.031078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:19.031556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:19.032255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:19.032760 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:19.033191 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:19.167093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:19.174880 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f6f4df01-131c-4e3f-a6f2-e723f5f4daee tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1683 microversion: 2.1 time: 0.156463 Nov 02 14:43:19.175502 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4347/8323] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:19 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:20.198793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:20.199391 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:20.205441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:20.205958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:20.206405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:20.207103 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:20.207588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:20.208053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:20.341964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:20.350454 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51660945-ece1-4ff1-8c9f-ab5e55305359 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1683 microversion: 2.1 time: 0.156084 Nov 02 14:43:20.351027 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3977/8324] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:20 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:21.374050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:21.374604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:21.381807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:21.382297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:21.382747 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:21.383489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:21.383969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:21.384394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:21.518363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:21.526686 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-92c3f0af-7069-429c-a338-92072d5c1bff tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1683 microversion: 2.1 time: 0.156746 Nov 02 14:43:21.527337 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4348/8325] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:21 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:22.549927 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:22.550548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:22.557756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:22.558249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:22.558698 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:22.559440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:22.559904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:22.560341 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:22.697013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:22.704896 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5a7b1fe3-5ab1-495e-8e9f-c0debf18aaa3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1683 microversion: 2.1 time: 0.158974 Nov 02 14:43:22.705470 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3978/8326] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:22 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:23.728159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:23.728784 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:23.736352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:23.736837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:23.737279 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:23.737975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:23.738430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:23.738860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:23.868326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:23.876246 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c863f39a-2745-4301-82fb-77d74cf719da tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1683 microversion: 2.1 time: 0.152099 Nov 02 14:43:23.876831 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4349/8327] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:23 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:24.900926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:24.901464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:24.908378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:24.908874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:24.909329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:24.910034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:24.910510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:24.910950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:25.047021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:25.054962 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-71f6df54-64e9-4297-a09d-1e54f0c35b56 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1683 microversion: 2.1 time: 0.158168 Nov 02 14:43:25.055577 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3979/8328] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:24 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:26.078777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:26.079433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:26.086225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:26.086703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:26.087161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:26.087855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:26.088310 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:26.088738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:26.225509 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:26.233613 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-264a17a4-3330-4896-9cb6-aeb6a160b554 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1683 microversion: 2.1 time: 0.158762 Nov 02 14:43:26.234183 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4350/8329] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:26 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:27.257876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:27.258507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:27.266198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:27.266701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:27.267178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:27.267901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:27.268370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:27.268814 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:27.405029 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:27.413479 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ee7b2c51-453b-4756-bc1e-d8ae2925e0f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1683 microversion: 2.1 time: 0.160280 Nov 02 14:43:27.414048 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3980/8330] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:27 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:43:28.436646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:43:28.437268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:43:28.445813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:28.446339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:28.446721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:28.447451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:43:28.447915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:43:28.448349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:43:28.582276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:43:28.590650 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91ff482e-1c5a-4125-90dc-093cded04bf8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1686 microversion: 2.1 time: 0.158017 Nov 02 14:43:28.591283 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4351/8331] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:43:28 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:44:02.823911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a7d4d09d-c22f-4fd9-a678-93a16d44190d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:02.826125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a7d4d09d-c22f-4fd9-a678-93a16d44190d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:02.828420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:02.829300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:02.835958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d4d09d-c22f-4fd9-a678-93a16d44190d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:02.836464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d4d09d-c22f-4fd9-a678-93a16d44190d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:02.836951 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d4d09d-c22f-4fd9-a678-93a16d44190d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:02.837672 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d4d09d-c22f-4fd9-a678-93a16d44190d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:02.838144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d4d09d-c22f-4fd9-a678-93a16d44190d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:02.838591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a7d4d09d-c22f-4fd9-a678-93a16d44190d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:02.903881 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a7d4d09d-c22f-4fd9-a678-93a16d44190d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e/action" status: 200 len: 69092 microversion: 2.1 time: 0.084686 Nov 02 14:44:02.904550 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3981/8332] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:44:02 2022] POST /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e/action => generated 69092 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:44:26.445933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:26.446465 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:26.449090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-def3cdfb-2138-4b6e-9008-e3d82c5bea90 req-80568b55-8ec7-4ecd-be32-7a963f02d212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c27f94-c452-4008-a42e-f8ac0db9477e", "tag": "cedf9db1-745d-4f22-a283-3c00c856c9d3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:26.449534 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:44:26.449534 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:44:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e (ip 10.222.0.113) !!! Nov 02 14:44:26.450455 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:44:26.450568 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:44:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e (ip 10.222.0.113) !!! Nov 02 14:44:26.451558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:26.452262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=36 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:26.459204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:26.459676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:26.459812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:26.460333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:26.460706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:26.460841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:26.461556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:26.461977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:26.472647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-def3cdfb-2138-4b6e-9008-e3d82c5bea90 req-80568b55-8ec7-4ecd-be32-7a963f02d212 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:26.473199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-def3cdfb-2138-4b6e-9008-e3d82c5bea90 req-80568b55-8ec7-4ecd-be32-7a963f02d212 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:26.473655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-def3cdfb-2138-4b6e-9008-e3d82c5bea90 req-80568b55-8ec7-4ecd-be32-7a963f02d212 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:26.486575 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-def3cdfb-2138-4b6e-9008-e3d82c5bea90 req-80568b55-8ec7-4ecd-be32-7a963f02d212 service nova] Creating event network-changed:cedf9db1-745d-4f22-a283-3c00c856c9d3 for instance 92c27f94-c452-4008-a42e-f8ac0db9477e on n-h2-858384-19 Nov 02 14:44:26.492779 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-def3cdfb-2138-4b6e-9008-e3d82c5bea90 req-80568b55-8ec7-4ecd-be32-7a963f02d212 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048685 Nov 02 14:44:26.493947 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3982/8333] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:26.496085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:44:26.593367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d56cac40-a957-41f0-bf3c-0c061dea4b7f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 204 len: 0 microversion: 2.1 time: 0.152035 Nov 02 14:44:26.594282 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4352/8334] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:44:26 2022] DELETE /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:44:26.605632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:26.605984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:26.612682 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:26.613186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:26.613779 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:26.614355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:26.614827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:26.615315 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:26.756196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:26.764095 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fe4f2b77-45ed-43ee-9f6f-a2993e3f617c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1692 microversion: 2.1 time: 0.164294 Nov 02 14:44:26.764872 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3983/8335] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:26 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:27.790418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:27.791180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:27.798739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:27.799275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:27.799726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:27.800427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:27.800888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:27.801321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:28.013737 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:28.021487 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b09a5659-451b-4a28-b796-04072ac917f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1692 microversion: 2.1 time: 0.236079 Nov 02 14:44:28.022063 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4353/8336] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:27 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1692 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:44:28.979874 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6fa9e562-3572-485a-a622-04c63267ec30 req-6e38b6fe-7dc8-4a1f-8e6f-7a1871faa379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c27f94-c452-4008-a42e-f8ac0db9477e", "name": "network-vif-deleted", "tag": "cedf9db1-745d-4f22-a283-3c00c856c9d3"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:28.994182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6fa9e562-3572-485a-a622-04c63267ec30 req-6e38b6fe-7dc8-4a1f-8e6f-7a1871faa379 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:28.994680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6fa9e562-3572-485a-a622-04c63267ec30 req-6e38b6fe-7dc8-4a1f-8e6f-7a1871faa379 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:28.995160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6fa9e562-3572-485a-a622-04c63267ec30 req-6e38b6fe-7dc8-4a1f-8e6f-7a1871faa379 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:29.009520 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6fa9e562-3572-485a-a622-04c63267ec30 req-6e38b6fe-7dc8-4a1f-8e6f-7a1871faa379 service nova] Creating event network-vif-deleted:cedf9db1-745d-4f22-a283-3c00c856c9d3 for instance 92c27f94-c452-4008-a42e-f8ac0db9477e on n-h2-858384-19 Nov 02 14:44:29.017268 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6fa9e562-3572-485a-a622-04c63267ec30 req-6e38b6fe-7dc8-4a1f-8e6f-7a1871faa379 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041835 Nov 02 14:44:29.017988 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3984/8337] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:44:29.045385 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:29.046248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:29.053489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:29.054581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:29.055043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:29.055792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:29.056657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:29.057104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:29.091042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:29.091559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:29.092004 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:29.092705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lazy-loading 'fault' on Instance uuid 92c27f94-c452-4008-a42e-f8ac0db9477e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:44:29.135809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:29.143905 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-46bb025b-de42-4839-81a0-805482f8fd13 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 200 len: 1359 microversion: 2.1 time: 0.102432 Nov 02 14:44:29.144443 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4354/8338] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:29 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 1359 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:30.168720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:30.169482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c27f94-c452-4008-a42e-f8ac0db9477e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:30.176478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:30.176971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:30.177419 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:30.178120 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:30.178616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:30.179584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:30.192752 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] HTTP exception thrown: Instance 92c27f94-c452-4008-a42e-f8ac0db9477e could not be found. Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Request method failure captured: Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e HTTP/1.1 Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYoFE8pUKf1IQIXfe6OlaOFnphQveAO1NwDWjLgi2hZ7y5Gm4RyxXF5nGHQKehOPYXCfevyjn2amLxRoJ96_g4j_N5gIikntXEZTbn8BP2DOM5zeZofusMmRKimgZIlTopOCkHYes3PD76hpMowtTP4oUvGNzdBmoQF6NeAikekXMr04 Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 3c603b713fd14a0d98447bc1e1bc475d Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 92c27f94-c452-4008-a42e-f8ac0db9477e could not be found. Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '92c27f94-c452-4008-a42e-f8ac0db9477e'} Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c27f94-c452-4008-a42e-f8ac0db9477e could not be found. Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c27f94-c452-4008-a42e-f8ac0db9477e could not be found. Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:44:30.195014 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c27f94-c452-4008-a42e-f8ac0db9477e could not be found. Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Returning 404 to user: Instance 92c27f94-c452-4008-a42e-f8ac0db9477e could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-641731f2-ce22-4a05-af74-95350f2b3b3e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e" status: 404 len: 111 microversion: 2.1 time: 0.032072 Nov 02 14:44:30.200690 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3985/8339] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:30 2022] GET /compute/v2.1/servers/92c27f94-c452-4008-a42e-f8ac0db9477e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:44:33.577230 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-447d3cc3-68a9-41d7-90d8-be7c17c5add9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '.version_select at 0x7fe78f952310>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:33.604691 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-447d3cc3-68a9-41d7-90d8-be7c17c5add9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-455303819" status: 202 len: 0 microversion: 2.1 time: 0.031512 Nov 02 14:44:33.605303 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4355/8340] 10.222.0.113 () {58 vars in 1286 bytes} [Wed Nov 2 14:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-455303819 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:44:33.635408 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-0092e7c1-f21d-47b4-a2cb-798e7422fd30 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: .version_select at 0x7fe7869061f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-528098166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZIOxit708w9kOqeQEHdPjDXh6pyZEjccYJTXU4sgSElj2ktZN253pewT4te2cdo4LCfcioRVo61nSvWkol1nLDnybRecc2qPZHhvVNvV7Nw/o7edgIPLk05OKK/doZfQ=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:33.652693 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0092e7c1-f21d-47b4-a2cb-798e7422fd30 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:44:33.657768 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-0092e7c1-f21d-47b4-a2cb-798e7422fd30 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:44:33.671388 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0092e7c1-f21d-47b4-a2cb-798e7422fd30 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [5634e798-45da-4415-a7fa-7f9b15ccaa68] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:44:34.677539 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [None req-0092e7c1-f21d-47b4-a2cb-798e7422fd30 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [5634e798-45da-4415-a7fa-7f9b15ccaa68] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 45986. Nov 02 14:44:34.693310 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-0092e7c1-f21d-47b4-a2cb-798e7422fd30 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.062473 Nov 02 14:44:34.693928 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3986/8341] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:44:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:40.485808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1051612715", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "b53b351d-9b8c-462e-ae47-8d2e8dd557c2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-528098166", "security_groups": [{"name": "tempest-secgroup-smoke-665633231"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:40.495732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:40.610765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] validate_networks() for [('b53b351d-9b8c-462e-ae47-8d2e8dd557c2', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:44:41.235876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:44:41.236380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:44:41.237055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:44:41.237652 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:44:41.238082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:44:41.248868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:41.249357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:41.249800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:41.250526 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:41.250982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:41.251440 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:41.270366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:44:41.276698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:44:41.290710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:44:41.293302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:44:41.341686 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-640d3adb-75bf-4ef4-8aec-9ad2e51bbd71 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.860347 Nov 02 14:44:41.348803 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4356/8342] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:44:40 2022] POST /compute/v2.1/servers => generated 407 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:44:41.352778 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:41.358474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8c4ed039-ae80-478f-8a5a-08baa936fb3d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:41.360042 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8c4ed039-ae80-478f-8a5a-08baa936fb3d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:41.428150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8c4ed039-ae80-478f-8a5a-08baa936fb3d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:41.436263 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8c4ed039-ae80-478f-8a5a-08baa936fb3d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1270 microversion: 2.1 time: 0.086163 Nov 02 14:44:41.436831 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3987/8343] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:41 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:42.461946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af8d022f-c2a0-4092-ac1b-43124088d70d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:42.463312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af8d022f-c2a0-4092-ac1b-43124088d70d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:42.532220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af8d022f-c2a0-4092-ac1b-43124088d70d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:42.541548 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af8d022f-c2a0-4092-ac1b-43124088d70d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1270 microversion: 2.1 time: 0.084723 Nov 02 14:44:42.542523 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4357/8344] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:42 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:43.569618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:43.570241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:43.577155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:43.577586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:43.578032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:43.578737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:43.579225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:43.579668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:43.642634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:43.652357 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-53533ede-49e7-43bd-a5cb-e878a90ff99b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1274 microversion: 2.1 time: 0.086802 Nov 02 14:44:43.652943 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3988/8345] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:43 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:44.675924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:44.676681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:44.686616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:44.686834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:44.687152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:44.687860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:44.688315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:44.688744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:44.765319 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:44.773468 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-efad37e4-5c64-44cd-a598-adb7b67920fd tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1328 microversion: 2.1 time: 0.101374 Nov 02 14:44:44.773962 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4358/8346] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:44 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:45.797980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:45.798733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:45.805816 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:45.806317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:45.806767 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:45.807513 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:45.807982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:45.808424 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:45.845010 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-35e28e9c-29b2-4844-abb5-9bd827443521 req-2b423db8-90af-4269-981f-0af499066842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8f2ebe-26b7-47f9-91bb-028d235cc049", "tag": "e5db53a8-5df8-42d4-9200-d1504c91c905"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:45.863544 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-35e28e9c-29b2-4844-abb5-9bd827443521 req-2b423db8-90af-4269-981f-0af499066842 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:45.864504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-35e28e9c-29b2-4844-abb5-9bd827443521 req-2b423db8-90af-4269-981f-0af499066842 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:45.865268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-35e28e9c-29b2-4844-abb5-9bd827443521 req-2b423db8-90af-4269-981f-0af499066842 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:45.894794 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-35e28e9c-29b2-4844-abb5-9bd827443521 req-2b423db8-90af-4269-981f-0af499066842 service nova] Creating event network-changed:e5db53a8-5df8-42d4-9200-d1504c91c905 for instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 on n-h2-858384-19 Nov 02 14:44:45.901511 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-35e28e9c-29b2-4844-abb5-9bd827443521 req-2b423db8-90af-4269-981f-0af499066842 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061217 Nov 02 14:44:45.902824 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4359/8347] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:45.962870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:45.971686 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-845557c2-1a76-42b8-b703-192cea926844 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1395 microversion: 2.1 time: 0.177645 Nov 02 14:44:45.972483 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3989/8348] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:45 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1395 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:46.997122 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:46.997735 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:47.003977 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:47.004462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:47.004897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:47.005586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:47.006039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:47.007088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:47.142910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:47.150604 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ee97b19c-88d0-44ed-8d30-0a17b4e6e0a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1395 microversion: 2.1 time: 0.158667 Nov 02 14:44:47.151196 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4360/8349] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:46 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:48.173257 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:48.173815 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:48.181033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:48.181529 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:48.181979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:48.182684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:48.183249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:48.183692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:48.316569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:48.325328 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d15d05f1-60b4-4d34-bb5c-ef92b1bff671 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1395 microversion: 2.1 time: 0.156149 Nov 02 14:44:48.325916 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3990/8350] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:48 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1395 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:49.347999 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:49.348630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:49.356334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:49.356832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:49.357586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:49.358301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:49.358767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:49.359232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:49.495329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:49.503143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d313c7f6-d4ba-458c-9330-0d9e370c770b tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1395 microversion: 2.1 time: 0.159084 Nov 02 14:44:49.503738 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4361/8351] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:49 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:50.526566 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:50.527301 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:50.533474 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:50.533965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:50.534413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.535140 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:50.535609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:50.536043 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:50.717599 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:50.725962 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9a8c69c1-05d0-45fc-98ef-014bef31e3db tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1395 microversion: 2.1 time: 0.203411 Nov 02 14:44:50.726541 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3991/8352] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:50 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1395 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:51.751787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:51.752405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:51.755251 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:51.761681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:51.762173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:51.762655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:51.763399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:51.763861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:51.764297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:51.897205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:51.904721 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3eb10b14-6c67-48ef-84f3-9efb35148371 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1395 microversion: 2.1 time: 0.156916 Nov 02 14:44:51.905306 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4362/8353] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:51 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:52.453973 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:52.511441 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-51de91c3-0116-4b26-9c34-4a0310cfc7af req-d1fa8102-e945-4a9f-8d1f-5122d2367c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8f2ebe-26b7-47f9-91bb-028d235cc049", "name": "network-vif-plugged", "status": "completed", "tag": "e5db53a8-5df8-42d4-9200-d1504c91c905"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:52.522098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-51de91c3-0116-4b26-9c34-4a0310cfc7af req-d1fa8102-e945-4a9f-8d1f-5122d2367c40 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:52.523153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-51de91c3-0116-4b26-9c34-4a0310cfc7af req-d1fa8102-e945-4a9f-8d1f-5122d2367c40 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:52.523701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-51de91c3-0116-4b26-9c34-4a0310cfc7af req-d1fa8102-e945-4a9f-8d1f-5122d2367c40 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:52.535362 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-51de91c3-0116-4b26-9c34-4a0310cfc7af req-d1fa8102-e945-4a9f-8d1f-5122d2367c40 service nova] Creating event network-vif-plugged:e5db53a8-5df8-42d4-9200-d1504c91c905 for instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 on n-h2-858384-19 Nov 02 14:44:52.541762 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-51de91c3-0116-4b26-9c34-4a0310cfc7af req-d1fa8102-e945-4a9f-8d1f-5122d2367c40 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092333 Nov 02 14:44:52.542509 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3992/8354] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:44:52.927697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:52.928359 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:52.930321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=8 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:44:52.936630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:52.937124 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:52.937576 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:52.938291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:52.938764 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:52.939233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:53.079053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:53.087211 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6fe1088f-2c4e-4ca7-b68f-3556cd06b4b2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1395 microversion: 2.1 time: 0.163536 Nov 02 14:44:53.087814 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4363/8355] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:52 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1395 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:54.111977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:54.112696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:54.119517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:54.120016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:54.120748 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:54.121197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:54.121755 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:54.122219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:54.254954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:54.263046 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aecce8c1-a358-4961-b9e0-68be2cd56438 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1568 microversion: 2.1 time: 0.156889 Nov 02 14:44:54.263652 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3993/8356] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:54 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:54.285259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:54.285984 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:54.293650 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:54.294115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:54.294583 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:54.295315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:54.295771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:54.296202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:54.426711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:54.434958 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-89f5219d-b753-41bc-b223-fb2bcd1870f4 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1568 microversion: 2.1 time: 0.153580 Nov 02 14:44:54.435603 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4364/8357] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:54 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:44:56.006465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:44:56.012541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-340e2d66-eb0c-4b8e-ac28-72acd20e26df req-f906c2dc-f093-4f96-b657-78c1e5a037e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8f2ebe-26b7-47f9-91bb-028d235cc049", "tag": "e5db53a8-5df8-42d4-9200-d1504c91c905"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:44:56.015994 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:44:56.023261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:56.024028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:56.024706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:56.025773 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:56.026455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:56.026957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:56.030261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-340e2d66-eb0c-4b8e-ac28-72acd20e26df req-f906c2dc-f093-4f96-b657-78c1e5a037e0 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:44:56.030743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-340e2d66-eb0c-4b8e-ac28-72acd20e26df req-f906c2dc-f093-4f96-b657-78c1e5a037e0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:44:56.031201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-340e2d66-eb0c-4b8e-ac28-72acd20e26df req-f906c2dc-f093-4f96-b657-78c1e5a037e0 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:44:56.043066 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-340e2d66-eb0c-4b8e-ac28-72acd20e26df req-f906c2dc-f093-4f96-b657-78c1e5a037e0 service nova] Creating event network-changed:e5db53a8-5df8-42d4-9200-d1504c91c905 for instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 on n-h2-858384-19 Nov 02 14:44:56.048395 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-340e2d66-eb0c-4b8e-ac28-72acd20e26df req-f906c2dc-f093-4f96-b657-78c1e5a037e0 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039515 Nov 02 14:44:56.049456 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4365/8358] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:44:56.176833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:44:56.187191 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-51752b25-03ad-4123-aed1-49161b640f19 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1568 microversion: 2.1 time: 0.184724 Nov 02 14:44:56.187789 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3994/8359] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:44:56 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:45:29.477239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:29.477990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=42 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:45:29.533932 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-934f01d5-98ad-4127-861b-a61c91da83df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:45:29.536480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-934f01d5-98ad-4127-861b-a61c91da83df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:45:29.543565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934f01d5-98ad-4127-861b-a61c91da83df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:29.544056 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934f01d5-98ad-4127-861b-a61c91da83df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:29.544501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934f01d5-98ad-4127-861b-a61c91da83df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:29.545210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934f01d5-98ad-4127-861b-a61c91da83df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:45:29.545669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934f01d5-98ad-4127-861b-a61c91da83df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:45:29.546103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-934f01d5-98ad-4127-861b-a61c91da83df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:45:29.603437 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-934f01d5-98ad-4127-861b-a61c91da83df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049/action" status: 200 len: 24569 microversion: 2.1 time: 0.128247 Nov 02 14:45:29.604720 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4366/8360] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:45:29 2022] POST /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049/action => generated 24569 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:46:00.018790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:00.019585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=38 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:00.020964 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:46:00.021121 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:46:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049/action (ip 10.222.0.113) !!! Nov 02 14:46:00.026382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:00.029389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:00.038038 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:00.038540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:00.038992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:00.039731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:00.040223 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:00.040647 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:00.084802 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:00.090870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Old instance type m1.heat2, new instance type m1.heat {{(pid=120929) resize /opt/stack/nova/nova/compute/api.py:4221}} Nov 02 14:46:00.098117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:46:00.098551 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:46:00.099036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:46:00.099487 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:46:00.099914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:46:00.163154 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d848e2ee-dde8-4db1-8475-3cdbec2bf8b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049/action" status: 202 len: 0 microversion: 2.1 time: 0.146235 Nov 02 14:46:00.163718 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3995/8361] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:46:00 2022] POST /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:46:00.172777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:00.173489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:00.176211 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:00.176938 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:00.183298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:00.183796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:00.184244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:00.185197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:00.185656 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:00.186095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:00.332118 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:00.340099 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-09424713-c2a6-452e-818e-92b56b7754cc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1695 microversion: 2.1 time: 0.171931 Nov 02 14:46:00.340689 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4367/8362] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:00 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:01.366680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:01.367311 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:01.374404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:01.374903 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:01.375388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:01.376093 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:01.376557 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:01.376995 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:01.512184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:01.520599 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-af56f217-1eee-4ec5-a397-e79ff76e57d1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1695 microversion: 2.1 time: 0.158931 Nov 02 14:46:01.521173 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3996/8363] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:01 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:02.543815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:02.544609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:02.551605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:02.552093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:02.552546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:02.553252 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:02.553710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:02.554144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:02.693690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:02.702735 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6edeecfc-0830-4fa8-b72c-5e58b28fde9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1695 microversion: 2.1 time: 0.162964 Nov 02 14:46:02.703358 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4368/8364] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:02 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:03.726297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:03.727615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:03.736446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:03.737039 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:03.737502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:03.738235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:03.738709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:03.739273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:03.874221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:03.882767 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4f7c784-c3b8-42da-b998-1d29b9bd578a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1695 microversion: 2.1 time: 0.160768 Nov 02 14:46:03.883389 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3997/8365] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:03 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:04.912694 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:04.913256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:04.920732 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:04.921216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:04.921653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:04.922354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:04.922992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:04.923451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:05.066170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:05.074069 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6a6372b4-0edc-4dc1-9e5f-a657c8688c25 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.169766 Nov 02 14:46:05.075049 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4369/8366] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:04 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:06.098202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:06.098837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:06.105701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:06.106200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:06.107440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:06.108306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:06.108809 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:06.109254 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:06.243369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:06.251894 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f9ea4f0-9f5e-417e-b0a1-63db58311b06 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.157715 Nov 02 14:46:06.252480 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3998/8367] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:06 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:07.275479 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:07.276097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:07.284358 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:07.284844 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:07.285288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:07.286000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:07.286792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:07.286933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:07.435469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:07.443431 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-508bbe07-2a11-427e-8934-8307d41f1585 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.171945 Nov 02 14:46:07.444035 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4370/8368] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:07 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:08.468266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:08.468895 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:08.475751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:08.476249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:08.476699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:08.477414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:08.477881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:08.478323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:08.611294 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:08.619224 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-79b00c9c-d5b7-4f50-bdfa-318bfb45641a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.155111 Nov 02 14:46:08.619806 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 3999/8369] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:08 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:09.643594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:09.644239 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:09.650356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:09.650837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:09.651309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:09.652000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:09.652453 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:09.652884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:09.791008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:09.799310 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4bb3e7b3-8e5a-4c3a-817b-adaa2b17715f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.159917 Nov 02 14:46:09.799888 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4371/8370] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:09 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:10.824756 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:10.825420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:10.833128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:10.833625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:10.834081 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:10.834789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:10.835295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:10.835743 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:10.969476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:10.977376 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9140381a-01e6-4e1d-87be-be68369bdb2f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.156608 Nov 02 14:46:10.977956 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4000/8371] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:10 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:12.002142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:12.002762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:12.009710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:12.010195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:12.010637 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:12.011357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:12.011833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:12.012249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:12.145986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:12.153850 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-340fbbce-cc9e-47e3-be91-e6c7b841216f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.156278 Nov 02 14:46:12.154434 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4372/8372] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:11 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:13.177696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:13.178334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:13.185189 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:13.185690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:13.187178 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:13.187902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:13.188377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:13.188858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:13.330472 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:13.338253 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5d4d8852-3e07-44ab-9002-f4d3b930b356 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.164557 Nov 02 14:46:13.338879 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4001/8373] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:13 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:14.362216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:14.362824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:14.369625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:14.370105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:14.370539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:14.371258 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:14.371711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:14.372138 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:14.505645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:14.513397 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8af57991-625a-41e6-9bb9-627dbaa374a3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.155145 Nov 02 14:46:14.514478 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4373/8374] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:14 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:15.536819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:15.537450 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:15.544346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:15.544846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:15.546218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:15.546739 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:15.547233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:15.547680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:15.681238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:15.689854 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-23854a10-bf56-44e6-b29f-5e647de9d7b3 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1700 microversion: 2.1 time: 0.156954 Nov 02 14:46:15.690528 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4002/8375] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:15 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:16.713276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:16.713880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:16.720749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:16.721248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:16.721727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:16.722452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:16.722902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:16.723370 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:16.940051 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:16.947789 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-387f217b-edc8-4300-818e-92d3d9480445 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1699 microversion: 2.1 time: 0.238547 Nov 02 14:46:16.948380 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4374/8376] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:16 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1699 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:17.008685 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-556b1c65-52dc-45de-b5e5-fab37b80d4a4 req-aa5aefc6-24a7-4d0c-a024-06ad75ca5e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8f2ebe-26b7-47f9-91bb-028d235cc049", "name": "network-vif-unplugged", "status": "completed", "tag": "e5db53a8-5df8-42d4-9200-d1504c91c905"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:17.020689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-556b1c65-52dc-45de-b5e5-fab37b80d4a4 req-aa5aefc6-24a7-4d0c-a024-06ad75ca5e40 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:17.021148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-556b1c65-52dc-45de-b5e5-fab37b80d4a4 req-aa5aefc6-24a7-4d0c-a024-06ad75ca5e40 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:17.021592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-556b1c65-52dc-45de-b5e5-fab37b80d4a4 req-aa5aefc6-24a7-4d0c-a024-06ad75ca5e40 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:17.034369 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-556b1c65-52dc-45de-b5e5-fab37b80d4a4 req-aa5aefc6-24a7-4d0c-a024-06ad75ca5e40 service nova] Creating event network-vif-unplugged:e5db53a8-5df8-42d4-9200-d1504c91c905 for instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 on n-h1-858384-19 Nov 02 14:46:17.039863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-556b1c65-52dc-45de-b5e5-fab37b80d4a4 req-aa5aefc6-24a7-4d0c-a024-06ad75ca5e40 service nova] Instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:46:17.051764 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-556b1c65-52dc-45de-b5e5-fab37b80d4a4 req-aa5aefc6-24a7-4d0c-a024-06ad75ca5e40 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046735 Nov 02 14:46:17.052317 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4003/8377] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:17.976045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:17.976672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:17.985187 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:17.985680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:17.986136 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:17.987949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:17.988420 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:17.989205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:18.132158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:18.140627 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0609d7b5-105d-4b12-9fb3-0f34d6d069b9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1699 microversion: 2.1 time: 0.168764 Nov 02 14:46:18.141211 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4375/8378] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:17 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:46:19.093548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-82c65996-d7b9-4268-92b0-e878e5c472ee req-7bef9894-76d2-4201-8138-9bbd83ec9d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8f2ebe-26b7-47f9-91bb-028d235cc049", "tag": "e5db53a8-5df8-42d4-9200-d1504c91c905"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:19.103055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82c65996-d7b9-4268-92b0-e878e5c472ee req-7bef9894-76d2-4201-8138-9bbd83ec9d5e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:19.103583 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82c65996-d7b9-4268-92b0-e878e5c472ee req-7bef9894-76d2-4201-8138-9bbd83ec9d5e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:19.104034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-82c65996-d7b9-4268-92b0-e878e5c472ee req-7bef9894-76d2-4201-8138-9bbd83ec9d5e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:19.115806 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-82c65996-d7b9-4268-92b0-e878e5c472ee req-7bef9894-76d2-4201-8138-9bbd83ec9d5e service nova] Creating event network-changed:e5db53a8-5df8-42d4-9200-d1504c91c905 for instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 on n-h1-858384-19 Nov 02 14:46:19.121091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [req-82c65996-d7b9-4268-92b0-e878e5c472ee req-7bef9894-76d2-4201-8138-9bbd83ec9d5e service nova] Instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-19', 'n-h2-858384-19'} {{(pid=120929) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Nov 02 14:46:19.132640 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-82c65996-d7b9-4268-92b0-e878e5c472ee req-7bef9894-76d2-4201-8138-9bbd83ec9d5e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044376 Nov 02 14:46:19.133228 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4004/8379] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:19.164450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:19.165214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:19.172308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:19.172880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:19.173409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:19.174247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:19.174782 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:19.175347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:19.412210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:19.420052 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f34fb915-d9fa-4bca-9c8a-99f594509e62 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1697 microversion: 2.1 time: 0.259580 Nov 02 14:46:19.420715 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4376/8380] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:19 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1697 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:20.447021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:20.447769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:20.454150 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:20.454648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:20.455099 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:20.455827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:20.456299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:20.456742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:20.594017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:20.601875 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-adaf08a8-5f9c-4b44-a719-28bb8aad127f tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1697 microversion: 2.1 time: 0.160032 Nov 02 14:46:20.602453 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4005/8381] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:20 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:21.626047 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:21.626669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:21.633658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.634144 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.634589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.635321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.635783 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.636225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.830827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:21.838829 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-93334804-36a0-4c5d-a591-ec0ffd3c5a45 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1694 microversion: 2.1 time: 0.216807 Nov 02 14:46:21.839371 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4377/8382] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:21 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1694 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:21.862574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-999dc74c-726e-4ab3-b493-4d913568f65a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:21.863179 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-999dc74c-726e-4ab3-b493-4d913568f65a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:21.870323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999dc74c-726e-4ab3-b493-4d913568f65a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.870621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999dc74c-726e-4ab3-b493-4d913568f65a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.871065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999dc74c-726e-4ab3-b493-4d913568f65a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.871797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999dc74c-726e-4ab3-b493-4d913568f65a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.872264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999dc74c-726e-4ab3-b493-4d913568f65a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.872701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-999dc74c-726e-4ab3-b493-4d913568f65a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.934421 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-999dc74c-726e-4ab3-b493-4d913568f65a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049/action" status: 204 len: 0 microversion: 2.1 time: 0.075955 Nov 02 14:46:21.935456 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4006/8383] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:46:21 2022] POST /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:46:21.945134 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:21.945507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:21.954568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.955069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.955649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:21.957112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:21.957571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:21.958336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:22.176973 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:22.184789 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4db4af01-d555-419f-b5da-e92c433d7590 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1694 microversion: 2.1 time: 0.245086 Nov 02 14:46:22.185383 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4378/8384] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:21 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:22.209667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:22.210420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:22.217399 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:22.217938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:22.218699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:22.219449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:22.220003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:22.220451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:22.359098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:22.368574 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e60769fb-7527-4cec-ac6c-2d598f906927 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1694 microversion: 2.1 time: 0.163189 Nov 02 14:46:22.369234 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4007/8385] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:22 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:23.393243 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:46:23.393873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:23.400748 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:23.401234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:23.401686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:23.402387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:23.402850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:23.403334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:23.536672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:46:23.544719 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c6b5d7db-82c1-4d9c-8164-754ec1b91dc9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1686 microversion: 2.1 time: 0.156023 Nov 02 14:46:23.545307 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4379/8386] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:46:23 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:46:24.080217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4bdbfbff-9b20-43a1-b41d-51c66954d024 req-4b7ebb1a-8854-432d-8218-e3ad35b68aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8f2ebe-26b7-47f9-91bb-028d235cc049", "name": "network-vif-plugged", "status": "completed", "tag": "e5db53a8-5df8-42d4-9200-d1504c91c905"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:24.092416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4bdbfbff-9b20-43a1-b41d-51c66954d024 req-4b7ebb1a-8854-432d-8218-e3ad35b68aba service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:24.093259 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4bdbfbff-9b20-43a1-b41d-51c66954d024 req-4b7ebb1a-8854-432d-8218-e3ad35b68aba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:24.093712 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4bdbfbff-9b20-43a1-b41d-51c66954d024 req-4b7ebb1a-8854-432d-8218-e3ad35b68aba service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:24.109298 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4bdbfbff-9b20-43a1-b41d-51c66954d024 req-4b7ebb1a-8854-432d-8218-e3ad35b68aba service nova] Creating event network-vif-plugged:e5db53a8-5df8-42d4-9200-d1504c91c905 for instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 on n-h1-858384-19 Nov 02 14:46:24.115344 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4bdbfbff-9b20-43a1-b41d-51c66954d024 req-4b7ebb1a-8854-432d-8218-e3ad35b68aba service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039055 Nov 02 14:46:24.115920 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4008/8387] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:46:55.771198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3bf35801-afc2-4f24-83bd-0ea68ff4a119 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:46:55.773414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3bf35801-afc2-4f24-83bd-0ea68ff4a119 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:46:55.775571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=26 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:55.776377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=78 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:46:55.782109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf35801-afc2-4f24-83bd-0ea68ff4a119 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:55.782605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf35801-afc2-4f24-83bd-0ea68ff4a119 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:55.783691 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf35801-afc2-4f24-83bd-0ea68ff4a119 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:55.784403 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf35801-afc2-4f24-83bd-0ea68ff4a119 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:46:55.784869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf35801-afc2-4f24-83bd-0ea68ff4a119 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:46:55.785307 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3bf35801-afc2-4f24-83bd-0ea68ff4a119 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:46:55.855143 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3bf35801-afc2-4f24-83bd-0ea68ff4a119 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049/action" status: 200 len: 24576 microversion: 2.1 time: 0.088872 Nov 02 14:46:55.855798 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4380/8388] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:46:55 2022] POST /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049/action => generated 24576 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:47:12.879721 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:12.880356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:12.883156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=32 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:12.883842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:12.884974 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:12.885829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:12.889614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:12.890152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:12.890610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:12.891984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:12.891984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:12.892381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:12.922319 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:47:12.945418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-4b78c700-f006-4aec-b8d7-edadb7be1439 req-798b3657-fbb3-49b8-ad94-e7104ef374cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8f2ebe-26b7-47f9-91bb-028d235cc049", "tag": "e5db53a8-5df8-42d4-9200-d1504c91c905"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:12.958482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4b78c700-f006-4aec-b8d7-edadb7be1439 req-798b3657-fbb3-49b8-ad94-e7104ef374cd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:12.958482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4b78c700-f006-4aec-b8d7-edadb7be1439 req-798b3657-fbb3-49b8-ad94-e7104ef374cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:12.958812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-4b78c700-f006-4aec-b8d7-edadb7be1439 req-798b3657-fbb3-49b8-ad94-e7104ef374cd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:12.972367 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-4b78c700-f006-4aec-b8d7-edadb7be1439 req-798b3657-fbb3-49b8-ad94-e7104ef374cd service nova] Creating event network-changed:e5db53a8-5df8-42d4-9200-d1504c91c905 for instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 on n-h1-858384-19 Nov 02 14:47:12.977880 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-4b78c700-f006-4aec-b8d7-edadb7be1439 req-798b3657-fbb3-49b8-ad94-e7104ef374cd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100983 Nov 02 14:47:12.978789 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4381/8389] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:47:13.005026 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-31e023b6-44c1-42e7-8d31-5ec621d72d81 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 204 len: 0 microversion: 2.1 time: 0.130240 Nov 02 14:47:13.005629 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4009/8390] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:47:12 2022] DELETE /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:47:13.015563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:13.016274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:13.023444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:13.023940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:13.024387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:13.025121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:13.025567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:13.026216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:13.166441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:13.175416 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c566564d-9372-48e4-803a-460a3e7697e8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1692 microversion: 2.1 time: 0.164139 Nov 02 14:47:13.176017 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4382/8391] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:13 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:14.203542 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:14.204265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:14.212141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:14.212652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:14.213115 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:14.213838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:14.214314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:14.214761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:14.353830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:14.363650 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f7fa285e-b88b-41d1-9114-344c6c1471ed tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1692 microversion: 2.1 time: 0.164512 Nov 02 14:47:14.364445 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4010/8392] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:14 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:15.126228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f8643433-0e59-4933-a960-a0b6b7b999e2 req-f18ec6e5-80ee-4829-9ff2-ddae1bfcc7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8f2ebe-26b7-47f9-91bb-028d235cc049", "name": "network-vif-deleted", "tag": "e5db53a8-5df8-42d4-9200-d1504c91c905"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:15.137727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f8643433-0e59-4933-a960-a0b6b7b999e2 req-f18ec6e5-80ee-4829-9ff2-ddae1bfcc7f7 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:15.138202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f8643433-0e59-4933-a960-a0b6b7b999e2 req-f18ec6e5-80ee-4829-9ff2-ddae1bfcc7f7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:15.138710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f8643433-0e59-4933-a960-a0b6b7b999e2 req-f18ec6e5-80ee-4829-9ff2-ddae1bfcc7f7 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:15.151886 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-f8643433-0e59-4933-a960-a0b6b7b999e2 req-f18ec6e5-80ee-4829-9ff2-ddae1bfcc7f7 service nova] Creating event network-vif-deleted:e5db53a8-5df8-42d4-9200-d1504c91c905 for instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 on n-h1-858384-19 Nov 02 14:47:15.158571 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f8643433-0e59-4933-a960-a0b6b7b999e2 req-f18ec6e5-80ee-4829-9ff2-ddae1bfcc7f7 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035794 Nov 02 14:47:15.159634 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4383/8393] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:47:15.389108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:15.389774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:15.398356 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:15.398859 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:15.399369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:15.400100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:15.400598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:15.401053 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:15.436047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:15.436833 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:15.437293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:15.437762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lazy-loading 'fault' on Instance uuid ff8f2ebe-26b7-47f9-91bb-028d235cc049 {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:47:15.481130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:15.489918 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e772f9e2-fc08-46ed-9049-978945ebdddf tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 200 len: 1360 microversion: 2.1 time: 0.104784 Nov 02 14:47:15.490647 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4011/8394] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:15 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 1360 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:16.514022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:16.514719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: ff8f2ebe-26b7-47f9-91bb-028d235cc049] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:16.521750 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:16.522226 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:16.522663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:16.523387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:16.523840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:16.524266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:16.538389 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] HTTP exception thrown: Instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 could not be found. Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Request method failure captured: Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 HTTP/1.1 Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYoFE8pUKf1IQIXfe6OlaOFnphQveAO1NwDWjLgi2hZ7y5Gm4RyxXF5nGHQKehOPYXCfevyjn2amLxRoJ96_g4j_N5gIikntXEZTbn8BP2DOM5zeZofusMmRKimgZIlTopOCkHYes3PD76hpMowtTP4oUvGNzdBmoQF6NeAikekXMr04 Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3c603b713fd14a0d98447bc1e1bc475d Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 could not be found. Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'ff8f2ebe-26b7-47f9-91bb-028d235cc049'} Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 could not be found. Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 could not be found. Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:47:16.540077 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 could not be found. Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Returning 404 to user: Instance ff8f2ebe-26b7-47f9-91bb-028d235cc049 could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ca4f7eae-ea3a-436c-b692-c6f97d629e58 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049" status: 404 len: 111 microversion: 2.1 time: 0.031737 Nov 02 14:47:16.545710 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4384/8395] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:16 2022] GET /compute/v2.1/servers/ff8f2ebe-26b7-47f9-91bb-028d235cc049 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:47:19.875368 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-fef4bf87-27fe-432f-9e8c-92930ae9ba9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '.version_select at 0x7fe78f8df4c0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:19.912787 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-fef4bf87-27fe-432f-9e8c-92930ae9ba9c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-528098166" status: 202 len: 0 microversion: 2.1 time: 0.041435 Nov 02 14:47:19.913570 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4012/8396] 10.222.0.113 () {58 vars in 1286 bytes} [Wed Nov 2 14:47:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-528098166 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:47:19.944645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2d59b664-e17c-43ba-ae16-383ee301cef9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: .version_select at 0x7fe787547d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1875491917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN09E3IieXXGCAjnViLwn537jheGF9k4no8p7/A/Qy9sHJ6uH7H5CclH4OAVOu+MgrqqyZQh3I/gOTJ00WXdPXBowgKxnSXadpkq+wxDGNU3D3ykYXZA3sbPsaDLmGf6bQ=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:19.964018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2d59b664-e17c-43ba-ae16-383ee301cef9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:47:19.969800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-2d59b664-e17c-43ba-ae16-383ee301cef9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:47:19.995279 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2d59b664-e17c-43ba-ae16-383ee301cef9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054643 Nov 02 14:47:19.995883 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4385/8397] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:47:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:25.766463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:25.772054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-198705043", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "2285c3b2-a9e4-4e0e-a459-d2819f107f55"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1875491917", "security_groups": [{"name": "tempest-secgroup-smoke-1868883005"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:25.899261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] validate_networks() for [('2285c3b2-a9e4-4e0e-a459-d2819f107f55', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:47:26.344444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:47:26.344914 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:47:26.345427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:47:26.345822 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:47:26.346282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:47:26.355233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:26.355731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:26.356183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:26.357196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:26.357664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:26.358241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:26.375469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:47:26.381332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:47:26.394986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:47:26.397388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:47:26.448370 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c9a93396-7863-4313-93ce-48dddaa67233 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.683692 Nov 02 14:47:26.449135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4013/8398] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:47:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:47:26.469240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-24c843e4-d472-4917-947a-dcd4cb41a9b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:26.470500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-24c843e4-d472-4917-947a-dcd4cb41a9b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:26.529000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:26.540133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-24c843e4-d472-4917-947a-dcd4cb41a9b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:26.549189 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-24c843e4-d472-4917-947a-dcd4cb41a9b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1270 microversion: 2.1 time: 0.084833 Nov 02 14:47:26.566998 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4386/8399] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:26 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:27.575105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:27.575882 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:27.583871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:27.584615 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:27.585325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:27.586117 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:27.588299 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:27.591143 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:27.670354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:27.679718 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b42680b8-29a0-451b-a9b2-72dce637411a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1330 microversion: 2.1 time: 0.109518 Nov 02 14:47:27.680563 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4014/8400] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:27 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:28.705352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:28.706348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:28.714366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:28.715188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:28.715578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:28.716326 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:28.716786 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:28.717221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:28.986804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:28.994889 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f64f1698-0fab-40ee-9375-72a00618fa3a tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1396 microversion: 2.1 time: 0.294538 Nov 02 14:47:28.995931 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4387/8401] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:28 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1396 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:29.246657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-f0aec6f0-a0d9-45f6-a847-ebbb6ac07cbc req-96f0f52b-fc71-441a-a076-e1c7c9793bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c0510c-9081-46dd-8bd8-7851bd698dea", "tag": "3e612c1c-43aa-4c46-a71a-90fbfcd25cac"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:29.256676 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f0aec6f0-a0d9-45f6-a847-ebbb6ac07cbc req-96f0f52b-fc71-441a-a076-e1c7c9793bbc service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:29.257279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f0aec6f0-a0d9-45f6-a847-ebbb6ac07cbc req-96f0f52b-fc71-441a-a076-e1c7c9793bbc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:29.257869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-f0aec6f0-a0d9-45f6-a847-ebbb6ac07cbc req-96f0f52b-fc71-441a-a076-e1c7c9793bbc service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:29.277844 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-f0aec6f0-a0d9-45f6-a847-ebbb6ac07cbc req-96f0f52b-fc71-441a-a076-e1c7c9793bbc service nova] Creating event network-changed:3e612c1c-43aa-4c46-a71a-90fbfcd25cac for instance 92c0510c-9081-46dd-8bd8-7851bd698dea on n-h2-858384-19 Nov 02 14:47:29.283633 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-f0aec6f0-a0d9-45f6-a847-ebbb6ac07cbc req-96f0f52b-fc71-441a-a076-e1c7c9793bbc service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098525 Nov 02 14:47:29.284189 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4015/8402] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:30.018622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:30.019302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:30.026875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:30.027443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:30.027880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:30.028607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:30.029071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:30.029510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:30.169379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:30.178432 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c66087d-b83b-4e4d-b1e5-91a929c31e50 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1396 microversion: 2.1 time: 0.164251 Nov 02 14:47:30.179218 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4388/8403] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:30 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:31.203040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:31.203706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:31.210011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:31.210508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:31.210966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:31.211699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:31.212170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:31.212614 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:31.349812 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:31.357756 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d1bbf930-3698-44b5-bf8d-a1e5accb089c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1396 microversion: 2.1 time: 0.160014 Nov 02 14:47:31.358342 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4016/8404] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:31 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1396 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:32.380623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:32.381205 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:32.388128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:32.388622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:32.389071 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:32.389787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:32.390254 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:32.390693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:32.522149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:32.529956 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2200eda9-bc86-4460-82f4-d5dbeb3afde8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1396 microversion: 2.1 time: 0.153475 Nov 02 14:47:32.530548 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4389/8405] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:32 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:33.553848 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:33.556055 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:33.563005 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:33.563528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:33.563975 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:33.565388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:33.565853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:33.566287 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:33.708015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:33.715858 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d07a3238-b7e4-405a-9d1c-6179c49dae11 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1396 microversion: 2.1 time: 0.166104 Nov 02 14:47:33.716521 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4017/8406] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:33 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:34.739247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:34.739888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:34.746807 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:34.747318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:34.747757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:34.748449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:34.748904 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:34.749333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:34.883943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:34.891703 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3f107ede-5de6-4175-91e3-368f5fef5b93 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1396 microversion: 2.1 time: 0.156602 Nov 02 14:47:34.892832 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4390/8407] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:34 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1396 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:35.176033 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-069c1b50-d8a0-4ebf-ae84-a59577fb3f47 req-ce02753d-dcc3-45b9-ac66-c06477dfbf24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c0510c-9081-46dd-8bd8-7851bd698dea", "name": "network-vif-plugged", "status": "completed", "tag": "3e612c1c-43aa-4c46-a71a-90fbfcd25cac"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:35.187420 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-069c1b50-d8a0-4ebf-ae84-a59577fb3f47 req-ce02753d-dcc3-45b9-ac66-c06477dfbf24 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:35.187910 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-069c1b50-d8a0-4ebf-ae84-a59577fb3f47 req-ce02753d-dcc3-45b9-ac66-c06477dfbf24 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:35.188352 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-069c1b50-d8a0-4ebf-ae84-a59577fb3f47 req-ce02753d-dcc3-45b9-ac66-c06477dfbf24 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:35.200273 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-069c1b50-d8a0-4ebf-ae84-a59577fb3f47 req-ce02753d-dcc3-45b9-ac66-c06477dfbf24 service nova] Creating event network-vif-plugged:3e612c1c-43aa-4c46-a71a-90fbfcd25cac for instance 92c0510c-9081-46dd-8bd8-7851bd698dea on n-h2-858384-19 Nov 02 14:47:35.205989 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-069c1b50-d8a0-4ebf-ae84-a59577fb3f47 req-ce02753d-dcc3-45b9-ac66-c06477dfbf24 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033122 Nov 02 14:47:35.206592 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4018/8408] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:35.914555 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:35.915302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:35.922269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:35.922773 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:35.923256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:35.924566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:35.925026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:35.925461 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:36.056018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:36.063693 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-931f501e-03b0-4297-854e-d2ca8c34e9ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1396 microversion: 2.1 time: 0.153070 Nov 02 14:47:36.064304 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4391/8409] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:35 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:37.085206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:37.086104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:37.090193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:37.090917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:37.098084 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:37.098587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:37.099047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:37.099790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:37.100263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:37.100709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:37.242516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:37.250402 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20a80199-48af-4070-a6dc-3533275d63de tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1567 microversion: 2.1 time: 0.167067 Nov 02 14:47:37.250985 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4019/8410] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:37 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:37.274095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:37.274721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:37.276661 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:47:37.283706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:37.284480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:37.285152 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:37.285880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:37.286341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:37.286776 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:37.423532 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:37.431511 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-366c84d6-133f-4486-bb18-c7f0cbc166b6 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1567 microversion: 2.1 time: 0.161222 Nov 02 14:47:37.432091 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4392/8411] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:37 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:47:39.483267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:47:39.483905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:47:39.490347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-12438566-c4ea-4260-8c9b-1061746cd579 req-c0dc23f1-d49c-4811-a5fe-f9ad96114ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c0510c-9081-46dd-8bd8-7851bd698dea", "tag": "3e612c1c-43aa-4c46-a71a-90fbfcd25cac"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:47:39.497476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:39.497982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:39.498436 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:39.499181 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:39.499652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:39.506361 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:39.509870 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-12438566-c4ea-4260-8c9b-1061746cd579 req-c0dc23f1-d49c-4811-a5fe-f9ad96114ef5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:47:39.510688 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-12438566-c4ea-4260-8c9b-1061746cd579 req-c0dc23f1-d49c-4811-a5fe-f9ad96114ef5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:47:39.511281 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-12438566-c4ea-4260-8c9b-1061746cd579 req-c0dc23f1-d49c-4811-a5fe-f9ad96114ef5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:47:39.522998 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-12438566-c4ea-4260-8c9b-1061746cd579 req-c0dc23f1-d49c-4811-a5fe-f9ad96114ef5 service nova] Creating event network-changed:3e612c1c-43aa-4c46-a71a-90fbfcd25cac for instance 92c0510c-9081-46dd-8bd8-7851bd698dea on n-h2-858384-19 Nov 02 14:47:39.528476 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-12438566-c4ea-4260-8c9b-1061746cd579 req-c0dc23f1-d49c-4811-a5fe-f9ad96114ef5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042720 Nov 02 14:47:39.529431 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4393/8412] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:47:39.659921 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:47:39.667895 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d3c8a53f-3063-4039-a8e3-d89d42d2b4c7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1567 microversion: 2.1 time: 0.188866 Nov 02 14:47:39.668652 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4020/8413] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:47:39 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:12.970864 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:48:12.971483 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action (ip 10.222.0.113) !!! Nov 02 14:48:12.972024 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:12.972852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=38 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:12.978143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-69b12e8b-fda5-4830-ac48-c90c437cb4c9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:12.980441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-69b12e8b-fda5-4830-ac48-c90c437cb4c9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:12.990256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b12e8b-fda5-4830-ac48-c90c437cb4c9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:12.990869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b12e8b-fda5-4830-ac48-c90c437cb4c9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:12.991341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b12e8b-fda5-4830-ac48-c90c437cb4c9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:12.992040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b12e8b-fda5-4830-ac48-c90c437cb4c9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:12.992491 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b12e8b-fda5-4830-ac48-c90c437cb4c9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:12.992921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-69b12e8b-fda5-4830-ac48-c90c437cb4c9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:13.053379 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-69b12e8b-fda5-4830-ac48-c90c437cb4c9 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action" status: 200 len: 24543 microversion: 2.1 time: 0.084880 Nov 02 14:48:13.054058 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4394/8414] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:48:12 2022] POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action => generated 24543 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:48:52.213517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:52.214314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=36 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:52.218727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ed23122-3635-47f4-84dd-9e7f9c16d806 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:48:52.227422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ed23122-3635-47f4-84dd-9e7f9c16d806 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:52.227926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ed23122-3635-47f4-84dd-9e7f9c16d806 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:52.228381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ed23122-3635-47f4-84dd-9e7f9c16d806 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:52.253499 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ed23122-3635-47f4-84dd-9e7f9c16d806 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Going to try to stop instance {{(pid=120929) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 14:48:52.295337 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ed23122-3635-47f4-84dd-9e7f9c16d806 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action" status: 202 len: 0 microversion: 2.1 time: 0.084388 Nov 02 14:48:52.295939 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4021/8415] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:48:52 2022] POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:48:52.305442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:52.306159 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:52.308934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:52.309740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:48:52.316910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:52.317565 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:52.318031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:52.318749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:52.319249 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:52.319695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:52.456961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:52.464852 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8cd4890b-f85c-46d1-ac6c-6fe7a80fabac tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1696 microversion: 2.1 time: 0.163711 Nov 02 14:48:52.465371 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4395/8416] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:48:52 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:53.491932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:53.492652 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:53.498942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:53.499479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:53.499931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:53.500642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:53.501113 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:53.501554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:53.639585 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:53.648102 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a57fd34d-f41a-4930-be3f-9ab38e269e49 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1696 microversion: 2.1 time: 0.161500 Nov 02 14:48:53.648692 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4022/8417] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:48:53 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:54.671515 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:54.672135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:54.680276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:54.680763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:54.681210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:54.681907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:54.682365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:54.682799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:54.815780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:54.823664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f874b17d-1933-423c-81b3-3468f53492bb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1696 microversion: 2.1 time: 0.156206 Nov 02 14:48:54.824246 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4396/8418] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:48:54 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:55.847509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:55.848100 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:55.854851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:55.855369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:55.855819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:55.856785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:55.857253 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:55.857690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:55.996282 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:56.004709 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-96c1dab8-df5b-4702-b95d-8c5282caac68 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1696 microversion: 2.1 time: 0.161430 Nov 02 14:48:56.005302 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4023/8419] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:48:55 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:57.028121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:57.028742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:57.035632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:57.036097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:57.036547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:57.037233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:57.037686 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:57.038130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:57.172450 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:57.180994 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-ce74af6c-6eef-491e-9baf-1f43ef5095ab tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1696 microversion: 2.1 time: 0.156797 Nov 02 14:48:57.181585 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4397/8420] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:48:57 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:58.204700 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:58.206375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:58.213297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:58.213799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:58.214265 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:58.214981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:58.215480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:58.215931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:58.349720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:58.357798 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6acb5c12-f8cf-4bdb-8098-949c1cef70fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1696 microversion: 2.1 time: 0.157257 Nov 02 14:48:58.358375 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4024/8421] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:48:58 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:48:59.381849 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:48:59.382470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:48:59.389439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:59.389924 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:59.390366 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:59.391061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:48:59.391554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:48:59.391985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:48:59.527248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:48:59.536071 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-873f6c74-941e-4514-b93f-9fbe32c53651 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1696 microversion: 2.1 time: 0.158284 Nov 02 14:48:59.536659 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4398/8422] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:48:59 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:00.558983 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:00.559668 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:00.566965 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:00.567502 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:00.567961 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:00.568684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:00.569159 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:00.569616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:00.700386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:00.708793 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8ea44b2e-d85c-4f4c-a723-76f8e2548040 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1696 microversion: 2.1 time: 0.153869 Nov 02 14:49:00.709372 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4025/8423] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:49:00 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:01.733026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:01.733604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:01.741630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:01.742121 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:01.742570 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:01.743311 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:01.743779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:01.744215 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:01.879703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:01.887419 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-31523326-b6e0-4faa-83a2-8cdf4b6762e7 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1696 microversion: 2.1 time: 0.158726 Nov 02 14:49:01.888014 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4399/8424] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:49:01 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:02.911161 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:02.911794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:02.918741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:02.919261 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:02.919714 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:02.920415 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:02.920880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:02.921318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:03.056323 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:03.064881 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3544b0e3-06c9-42d0-95c2-06cdb2d9200c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1673 microversion: 2.1 time: 0.157102 Nov 02 14:49:03.065961 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4026/8425] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:49:02 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:04.160772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8f0b05c4-de0f-4bb4-824b-577839193770 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:04.163039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-8f0b05c4-de0f-4bb4-824b-577839193770 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:04.170082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b05c4-de0f-4bb4-824b-577839193770 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:04.171352 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b05c4-de0f-4bb4-824b-577839193770 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:04.171816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b05c4-de0f-4bb4-824b-577839193770 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:04.172723 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b05c4-de0f-4bb4-824b-577839193770 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:04.173190 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b05c4-de0f-4bb4-824b-577839193770 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:04.173948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-8f0b05c4-de0f-4bb4-824b-577839193770 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:04.232989 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8f0b05c4-de0f-4bb4-824b-577839193770 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action" status: 200 len: 38435 microversion: 2.1 time: 0.077143 Nov 02 14:49:04.233570 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4400/8426] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:49:04 2022] POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action => generated 38435 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:49:04.245665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a6bc1bcc-1495-4e74-ad4f-83644f4cece1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:04.252817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6bc1bcc-1495-4e74-ad4f-83644f4cece1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:04.253326 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6bc1bcc-1495-4e74-ad4f-83644f4cece1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:04.253789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a6bc1bcc-1495-4e74-ad4f-83644f4cece1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:04.276968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a6bc1bcc-1495-4e74-ad4f-83644f4cece1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Going to try to start instance {{(pid=120929) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 14:49:04.319743 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a6bc1bcc-1495-4e74-ad4f-83644f4cece1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action" status: 202 len: 0 microversion: 2.1 time: 0.077819 Nov 02 14:49:04.320350 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4027/8427] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:49:04 2022] POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:49:04.329460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:04.331587 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:04.338670 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:04.339185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:04.339633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:04.340355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:04.340833 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:04.341267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:04.573552 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:04.581951 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1c035722-7015-44c1-b69e-54b9c0c430fb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1682 microversion: 2.1 time: 0.256995 Nov 02 14:49:04.582540 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4401/8428] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:49:04 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1682 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:05.607846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:49:05.608578 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:05.616298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:05.616810 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:05.617285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:05.617997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:05.618478 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:05.618920 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:05.765538 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:49:05.774359 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c7cb28e1-1d05-40d1-b2a5-37b23079ec39 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1686 microversion: 2.1 time: 0.172086 Nov 02 14:49:05.775062 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4028/8429] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:49:05 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:49:40.013641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d3a3cb7e-9e75-4925-9c98-ae9350065bdb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:49:40.016068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d3a3cb7e-9e75-4925-9c98-ae9350065bdb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:49:40.019693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=14 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:40.020369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=40 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:49:40.028840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3a3cb7e-9e75-4925-9c98-ae9350065bdb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:40.029613 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3a3cb7e-9e75-4925-9c98-ae9350065bdb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:40.030210 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3a3cb7e-9e75-4925-9c98-ae9350065bdb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:40.031165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3a3cb7e-9e75-4925-9c98-ae9350065bdb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:49:40.031633 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3a3cb7e-9e75-4925-9c98-ae9350065bdb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:49:40.032069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d3a3cb7e-9e75-4925-9c98-ae9350065bdb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:49:40.098222 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d3a3cb7e-9e75-4925-9c98-ae9350065bdb tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action" status: 200 len: 62996 microversion: 2.1 time: 0.087439 Nov 02 14:49:40.099374 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4402/8430] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:49:40 2022] POST /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea/action => generated 62996 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:50:04.318163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:04.318741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:04.320852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-351c28f7-a501-4f62-971c-2176bae51c1e req-2be37581-d77f-4bbb-a6a7-9611a4562706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c0510c-9081-46dd-8bd8-7851bd698dea", "tag": "3e612c1c-43aa-4c46-a71a-90fbfcd25cac"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:04.323293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=16 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:04.324144 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:04.327949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:04.328630 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:04.328885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:04.329458 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:04.329677 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:50:04.329863 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:50:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.113) !!! Nov 02 14:50:04.329981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:04.330796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:04.331653 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:04.334354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:04.342314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-351c28f7-a501-4f62-971c-2176bae51c1e req-2be37581-d77f-4bbb-a6a7-9611a4562706 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:04.342832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-351c28f7-a501-4f62-971c-2176bae51c1e req-2be37581-d77f-4bbb-a6a7-9611a4562706 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:04.343278 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-351c28f7-a501-4f62-971c-2176bae51c1e req-2be37581-d77f-4bbb-a6a7-9611a4562706 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:04.356895 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-351c28f7-a501-4f62-971c-2176bae51c1e req-2be37581-d77f-4bbb-a6a7-9611a4562706 service nova] Creating event network-changed:3e612c1c-43aa-4c46-a71a-90fbfcd25cac for instance 92c0510c-9081-46dd-8bd8-7851bd698dea on n-h2-858384-19 Nov 02 14:50:04.363307 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-351c28f7-a501-4f62-971c-2176bae51c1e req-2be37581-d77f-4bbb-a6a7-9611a4562706 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045249 Nov 02 14:50:04.364297 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4403/8431] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:50:04.374177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:50:04.478291 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-70ebbfac-b6d2-49d6-ad7f-2cdf3f382f87 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 204 len: 0 microversion: 2.1 time: 0.163876 Nov 02 14:50:04.479174 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4029/8432] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:50:04 2022] DELETE /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:50:04.489439 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:04.490155 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:04.496458 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:04.496953 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:04.497402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:04.498119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:04.498584 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:04.499023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:04.700442 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:04.709248 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ec23384-3785-4a0a-89ce-33f61d84fe97 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1692 microversion: 2.1 time: 0.225278 Nov 02 14:50:04.710022 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4404/8433] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:04 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1692 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:05.734849 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:05.735609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:05.744908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:05.745412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:05.745872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:05.746589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:05.747056 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:05.747525 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:06.009981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:06.017875 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ccafec2c-7cc7-4d82-b7e7-5c0e685470bc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1692 microversion: 2.1 time: 0.287699 Nov 02 14:50:06.018748 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4030/8434] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:05 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1692 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:06.587287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-96fb0d5f-133d-4fed-9bbb-4ea88d9c9cf1 req-749ab864-ab66-400c-94e7-4be220433b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c0510c-9081-46dd-8bd8-7851bd698dea", "name": "network-vif-deleted", "tag": "3e612c1c-43aa-4c46-a71a-90fbfcd25cac"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:06.598496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-96fb0d5f-133d-4fed-9bbb-4ea88d9c9cf1 req-749ab864-ab66-400c-94e7-4be220433b8a service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:06.598879 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-96fb0d5f-133d-4fed-9bbb-4ea88d9c9cf1 req-749ab864-ab66-400c-94e7-4be220433b8a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:06.599348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-96fb0d5f-133d-4fed-9bbb-4ea88d9c9cf1 req-749ab864-ab66-400c-94e7-4be220433b8a service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:06.611682 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-96fb0d5f-133d-4fed-9bbb-4ea88d9c9cf1 req-749ab864-ab66-400c-94e7-4be220433b8a service nova] Creating event network-vif-deleted:3e612c1c-43aa-4c46-a71a-90fbfcd25cac for instance 92c0510c-9081-46dd-8bd8-7851bd698dea on n-h2-858384-19 Nov 02 14:50:06.617438 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-96fb0d5f-133d-4fed-9bbb-4ea88d9c9cf1 req-749ab864-ab66-400c-94e7-4be220433b8a service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033969 Nov 02 14:50:06.618021 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4405/8435] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:50:07.042016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:07.042879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:07.050345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:07.050894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:07.051427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:07.052128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:07.052697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:07.053284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:07.087335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:07.087894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:07.088401 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:07.088871 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lazy-loading 'fault' on Instance uuid 92c0510c-9081-46dd-8bd8-7851bd698dea {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:50:07.132697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:07.139837 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-784b12c6-51ba-4233-a289-f56719ccc506 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 200 len: 1360 microversion: 2.1 time: 0.101814 Nov 02 14:50:07.140415 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4031/8436] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:07 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 1360 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:08.166539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:08.167269 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: 92c0510c-9081-46dd-8bd8-7851bd698dea] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:08.173809 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:08.175042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:08.175528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:08.176233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:08.176695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:08.177132 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:08.190502 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] HTTP exception thrown: Instance 92c0510c-9081-46dd-8bd8-7851bd698dea could not be found. Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Request method failure captured: Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea HTTP/1.1 Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYoFE8pUKf1IQIXfe6OlaOFnphQveAO1NwDWjLgi2hZ7y5Gm4RyxXF5nGHQKehOPYXCfevyjn2amLxRoJ96_g4j_N5gIikntXEZTbn8BP2DOM5zeZofusMmRKimgZIlTopOCkHYes3PD76hpMowtTP4oUvGNzdBmoQF6NeAikekXMr04 Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3c603b713fd14a0d98447bc1e1bc475d Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance 92c0510c-9081-46dd-8bd8-7851bd698dea could not be found. Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': '92c0510c-9081-46dd-8bd8-7851bd698dea'} Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92c0510c-9081-46dd-8bd8-7851bd698dea could not be found. Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92c0510c-9081-46dd-8bd8-7851bd698dea could not be found. Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:50:08.192180 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92c0510c-9081-46dd-8bd8-7851bd698dea could not be found. Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Returning 404 to user: Instance 92c0510c-9081-46dd-8bd8-7851bd698dea could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-13114e50-5f68-406c-8379-c2289455ddc8 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea" status: 404 len: 111 microversion: 2.1 time: 0.032344 Nov 02 14:50:08.197956 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4406/8437] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:08 2022] GET /compute/v2.1/servers/92c0510c-9081-46dd-8bd8-7851bd698dea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:50:11.249463 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4dedb105-1865-4795-8f24-c2850bfdaf28 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '.version_select at 0x7fe78f90c0d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:11.254918 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4dedb105-1865-4795-8f24-c2850bfdaf28 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [5634e798-45da-4415-a7fa-7f9b15ccaa68] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:50:12.263210 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [None req-4dedb105-1865-4795-8f24-c2850bfdaf28 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [5634e798-45da-4415-a7fa-7f9b15ccaa68] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 46494. Nov 02 14:50:12.284959 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4dedb105-1865-4795-8f24-c2850bfdaf28 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1875491917" status: 202 len: 0 microversion: 2.1 time: 1.039339 Nov 02 14:50:12.285548 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4032/8438] 10.222.0.113 () {58 vars in 1289 bytes} [Wed Nov 2 14:50:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1875491917 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:50:12.317777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-846815d4-f0a9-4e5e-920a-7f8da1f34b35 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: .version_select at 0x7fe78756c700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1120055442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXGNNLx6W/j9PIA8igkXod0xdfWfSNtmd6Xn9FUBjeERS/tnMZFxrcw1mcAVSVlzEAyEyG3vac/jkYEKY01Abb9WgQNCTepIcWj13lu8XZ4P1Ml/GC4yBOb71beJlCa/Q=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:12.334176 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-846815d4-f0a9-4e5e-920a-7f8da1f34b35 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:50:12.340185 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-846815d4-f0a9-4e5e-920a-7f8da1f34b35 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:50:12.367304 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-846815d4-f0a9-4e5e-920a-7f8da1f34b35 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053694 Nov 02 14:50:12.367912 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4407/8439] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:50:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:50:18.468430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:18.473964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1357454800", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "networks": [{"uuid": "5b850eb0-ad77-414e-8423-81b402a9f12c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1120055442", "security_groups": [{"name": "tempest-secgroup-smoke-1990411408"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:18.609367 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] validate_networks() for [('5b850eb0-ad77-414e-8423-81b402a9f12c', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:50:19.070896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:50:19.072104 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:50:19.072618 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:50:19.073241 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:50:19.073783 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:50:19.085238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:19.086108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:19.086628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:19.087581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:19.088004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:19.088656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:19.115629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:50:19.121633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Getting quotas for user 3c603b713fd14a0d98447bc1e1bc475d and project 7e5df7c918cd42af842c12a999d7094b. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:50:19.136069 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:50:19.138517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:50:19.190919 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [47ea6434-e0ae-4224-b6a5-a3168bce624c] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:50:20.199006 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [47ea6434-e0ae-4224-b6a5-a3168bce624c] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 46552. Nov 02 14:50:20.204121 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ed9ac3be-9b6f-4c37-8762-b1180710ae2d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.737614 Nov 02 14:50:20.204824 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4033/8440] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:50:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:50:20.213902 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:20.223393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0d6a040f-a028-4e27-b5c2-2f92cc7d9ef5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:20.224018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0d6a040f-a028-4e27-b5c2-2f92cc7d9ef5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:20.343578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0d6a040f-a028-4e27-b5c2-2f92cc7d9ef5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:20.351148 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0d6a040f-a028-4e27-b5c2-2f92cc7d9ef5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1271 microversion: 2.1 time: 0.138967 Nov 02 14:50:20.351765 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4408/8441] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:20 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:21.374880 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:21.376177 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:21.383559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:21.384305 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:21.384760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:21.385492 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:21.385962 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:21.386405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:21.460634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:21.468638 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-24ceea62-3846-491f-b214-98014c38090c tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1323 microversion: 2.1 time: 0.098645 Nov 02 14:50:21.469771 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4034/8442] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:21 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:22.492621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:22.493233 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:22.500726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:22.501220 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:22.502227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:22.503033 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:22.503520 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:22.503957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:22.639437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:22.649888 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-bcd8fabb-2813-4517-9776-36711878f68d tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1397 microversion: 2.1 time: 0.161282 Nov 02 14:50:22.650490 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4409/8443] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:22 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1397 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:22.935598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-ab56aaf2-249b-4a3c-b186-167def4ff7c1 req-2dee045f-e88b-403d-9ef9-188aecc53b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b515c783-bfb2-4eea-8684-529d425a706e", "tag": "4a2af11e-7f9f-4730-91e9-64a18e92cd76"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:22.947228 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ab56aaf2-249b-4a3c-b186-167def4ff7c1 req-2dee045f-e88b-403d-9ef9-188aecc53b75 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:22.947909 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ab56aaf2-249b-4a3c-b186-167def4ff7c1 req-2dee045f-e88b-403d-9ef9-188aecc53b75 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:22.948466 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-ab56aaf2-249b-4a3c-b186-167def4ff7c1 req-2dee045f-e88b-403d-9ef9-188aecc53b75 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:22.959879 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-ab56aaf2-249b-4a3c-b186-167def4ff7c1 req-2dee045f-e88b-403d-9ef9-188aecc53b75 service nova] Creating event network-changed:4a2af11e-7f9f-4730-91e9-64a18e92cd76 for instance b515c783-bfb2-4eea-8684-529d425a706e on n-h1-858384-19 Nov 02 14:50:22.964847 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-ab56aaf2-249b-4a3c-b186-167def4ff7c1 req-2dee045f-e88b-403d-9ef9-188aecc53b75 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033169 Nov 02 14:50:22.965765 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4035/8444] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:50:23.673110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:23.674369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:23.681388 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:23.681866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:23.682302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:23.683022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:23.683530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:23.683957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:23.817569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:23.825424 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1036adfe-3177-48f5-bf13-4d454e5afcda tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1397 microversion: 2.1 time: 0.156295 Nov 02 14:50:23.826026 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4410/8445] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:23 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1397 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:24.851490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:24.852126 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:24.858570 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:24.859067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:24.859541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:24.860250 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:24.860719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:24.861215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:24.997348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:25.005163 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8413d086-3d37-4b13-9beb-93af619269fa tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1397 microversion: 2.1 time: 0.159599 Nov 02 14:50:25.005754 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4036/8446] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:24 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1397 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:26.028627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:26.029247 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:26.036296 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:26.036785 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:26.037227 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:26.037951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:26.038408 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:26.038840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:26.178409 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:26.186109 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-86003360-dbb1-4c32-9ed1-3735bcc57982 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1397 microversion: 2.1 time: 0.161458 Nov 02 14:50:26.186683 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4411/8447] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:26 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1397 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:27.209866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:27.210521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:27.217339 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:27.217837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:27.218288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:27.218997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:27.219547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:27.219984 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:27.360711 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:27.368801 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7a455845-426e-46f1-b8fe-a01051f0cbe2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1397 microversion: 2.1 time: 0.163016 Nov 02 14:50:27.369380 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4037/8448] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:27 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1397 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:28.393112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:28.393730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:28.400616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:28.401103 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:28.401546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:28.402241 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:28.402695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:28.403143 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:28.536600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:28.544641 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d5afdc8e-6c02-45c8-a1a3-05055ac6d816 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1397 microversion: 2.1 time: 0.156206 Nov 02 14:50:28.545232 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4412/8449] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:28 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1397 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:29.216255 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:29.217059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:29.290982 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-d35422ad-9ce6-4d7b-9e74-ab2ce9f84b58 req-3209aa3e-ccfc-429a-9588-43ae0a55842c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b515c783-bfb2-4eea-8684-529d425a706e", "name": "network-vif-plugged", "status": "completed", "tag": "4a2af11e-7f9f-4730-91e9-64a18e92cd76"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:29.301206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d35422ad-9ce6-4d7b-9e74-ab2ce9f84b58 req-3209aa3e-ccfc-429a-9588-43ae0a55842c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:29.301696 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d35422ad-9ce6-4d7b-9e74-ab2ce9f84b58 req-3209aa3e-ccfc-429a-9588-43ae0a55842c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:29.302142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-d35422ad-9ce6-4d7b-9e74-ab2ce9f84b58 req-3209aa3e-ccfc-429a-9588-43ae0a55842c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:29.313123 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-d35422ad-9ce6-4d7b-9e74-ab2ce9f84b58 req-3209aa3e-ccfc-429a-9588-43ae0a55842c service nova] Creating event network-vif-plugged:4a2af11e-7f9f-4730-91e9-64a18e92cd76 for instance b515c783-bfb2-4eea-8684-529d425a706e on n-h1-858384-19 Nov 02 14:50:29.318151 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-d35422ad-9ce6-4d7b-9e74-ab2ce9f84b58 req-3209aa3e-ccfc-429a-9588-43ae0a55842c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107351 Nov 02 14:50:29.318743 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4038/8450] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:50:29.619711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:29.620261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:29.626867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:29.627490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:29.627942 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:29.628651 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:29.629110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:29.629543 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:29.769153 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:29.777182 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f5ef6122-7b04-4593-a0e4-318fe63e8193 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1397 microversion: 2.1 time: 0.212799 Nov 02 14:50:29.777909 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4413/8451] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:29 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1397 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:30.802917 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:30.803663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:30.809980 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:30.810488 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:30.810946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:30.811697 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:30.812173 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:30.812623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:30.950298 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:30.960352 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-800cec2e-17fc-4f48-acbf-3fdfcace9582 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1397 microversion: 2.1 time: 0.163743 Nov 02 14:50:30.961241 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4039/8452] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:30 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1397 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:50:31.989617 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:31.990255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:31.992276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:50:31.998476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:31.998960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:31.999422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:32.000119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:32.000569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:32.000995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:32.131202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:32.138984 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-83492935-2baa-4138-8099-344dad6317d0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1569 microversion: 2.1 time: 0.154460 Nov 02 14:50:32.139584 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4414/8453] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:31 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:32.161637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:32.162279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:32.169095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:32.169595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:32.170054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:32.170770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:32.171283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:32.171733 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:32.308491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:32.316485 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f8814140-a190-4689-9812-9177d82ef4a1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1569 microversion: 2.1 time: 0.159436 Nov 02 14:50:32.317069 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4040/8454] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:32 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:50:34.218922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:50:34.219645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:50:34.221726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-782bf04e-b109-450a-97d7-ecfd7d90501e req-be3b7137-eaee-4241-a39b-2da93f3572d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b515c783-bfb2-4eea-8684-529d425a706e", "tag": "4a2af11e-7f9f-4730-91e9-64a18e92cd76"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:50:34.227837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:34.228616 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:34.229131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:34.229921 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:34.230508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:34.231404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:34.235188 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-782bf04e-b109-450a-97d7-ecfd7d90501e req-be3b7137-eaee-4241-a39b-2da93f3572d4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:50:34.235769 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-782bf04e-b109-450a-97d7-ecfd7d90501e req-be3b7137-eaee-4241-a39b-2da93f3572d4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:50:34.236968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-782bf04e-b109-450a-97d7-ecfd7d90501e req-be3b7137-eaee-4241-a39b-2da93f3572d4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:50:34.249264 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-782bf04e-b109-450a-97d7-ecfd7d90501e req-be3b7137-eaee-4241-a39b-2da93f3572d4 service nova] Creating event network-changed:4a2af11e-7f9f-4730-91e9-64a18e92cd76 for instance b515c783-bfb2-4eea-8684-529d425a706e on n-h1-858384-19 Nov 02 14:50:34.256070 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-782bf04e-b109-450a-97d7-ecfd7d90501e req-be3b7137-eaee-4241-a39b-2da93f3572d4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037862 Nov 02 14:50:34.257377 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4041/8455] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:50:34.377772 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:50:34.386770 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f435ab7e-0e67-413e-a694-d175d59df8f2 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1569 microversion: 2.1 time: 0.172617 Nov 02 14:50:34.387652 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4415/8456] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:50:34 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:07.683571 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9c1b75dc-822e-4d37-8779-e05cdd99416e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:07.685785 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9c1b75dc-822e-4d37-8779-e05cdd99416e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:07.688307 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:07.689377 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=38 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:07.695992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c1b75dc-822e-4d37-8779-e05cdd99416e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:07.696491 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c1b75dc-822e-4d37-8779-e05cdd99416e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:07.696946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c1b75dc-822e-4d37-8779-e05cdd99416e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:07.697665 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c1b75dc-822e-4d37-8779-e05cdd99416e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:07.698141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c1b75dc-822e-4d37-8779-e05cdd99416e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:07.698586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9c1b75dc-822e-4d37-8779-e05cdd99416e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:07.769405 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9c1b75dc-822e-4d37-8779-e05cdd99416e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action" status: 200 len: 24569 microversion: 2.1 time: 0.090282 Nov 02 14:51:07.770301 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4042/8457] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:51:07 2022] POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action => generated 24569 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 14:51:38.218840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:38.220158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=42 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:38.224950 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:38.225476 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:38.232930 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:38.233414 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:38.233873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:38.234571 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:38.235060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:38.236274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:38.262341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lazy-loading 'flavor' on Instance uuid b515c783-bfb2-4eea-8684-529d425a706e {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:51:38.328157 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-49eda51f-d89a-4f94-a2ac-e69a582f6104 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action" status: 202 len: 0 microversion: 2.1 time: 0.111056 Nov 02 14:51:38.329236 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4416/8458] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:51:38 2022] POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:51:38.338013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:38.338728 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:38.344510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=4 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:38.345702 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:51:38.348423 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:38.349049 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:38.349504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:38.350275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:38.350762 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:38.351229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:38.490124 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:38.497992 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-24c5a1b0-268c-4ad7-86e6-f47e05a1fbcc tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1695 microversion: 2.1 time: 0.164179 Nov 02 14:51:38.498573 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4043/8459] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:38 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:39.524072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:39.524708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:39.530928 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:39.531431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:39.531900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:39.532627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:39.533094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:39.533517 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:39.669392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:39.678210 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5a630c6d-56cb-429d-9e14-c312cf5e47df tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1695 microversion: 2.1 time: 0.159699 Nov 02 14:51:39.678795 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4417/8460] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:39 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:40.703138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:40.703770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:40.711552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:40.712050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:40.712506 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:40.713219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:40.713691 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:40.714138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:40.848125 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:40.856187 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7578a8f3-98f1-4a58-ad7f-02ec743d889e tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1678 microversion: 2.1 time: 0.157038 Nov 02 14:51:40.856791 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4044/8461] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:40 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:41.956043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dd89aa28-5105-44da-9a94-ace5fcd68c04 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:41.958308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dd89aa28-5105-44da-9a94-ace5fcd68c04 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:41.965262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd89aa28-5105-44da-9a94-ace5fcd68c04 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:41.965749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd89aa28-5105-44da-9a94-ace5fcd68c04 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:41.966195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd89aa28-5105-44da-9a94-ace5fcd68c04 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:41.966895 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd89aa28-5105-44da-9a94-ace5fcd68c04 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:41.967380 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd89aa28-5105-44da-9a94-ace5fcd68c04 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:41.967814 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dd89aa28-5105-44da-9a94-ace5fcd68c04 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:42.029468 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dd89aa28-5105-44da-9a94-ace5fcd68c04 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action" status: 200 len: 37185 microversion: 2.1 time: 0.078469 Nov 02 14:51:42.030126 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4418/8462] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:51:41 2022] POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action => generated 37185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:51:42.041978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-466c3247-8458-473b-aa3e-02d6648425ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:42.042535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-466c3247-8458-473b-aa3e-02d6648425ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:42.050774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-466c3247-8458-473b-aa3e-02d6648425ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:42.051324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-466c3247-8458-473b-aa3e-02d6648425ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:42.051789 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-466c3247-8458-473b-aa3e-02d6648425ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:42.052507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-466c3247-8458-473b-aa3e-02d6648425ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:42.053014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-466c3247-8458-473b-aa3e-02d6648425ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:42.053461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-466c3247-8458-473b-aa3e-02d6648425ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:42.121759 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-466c3247-8458-473b-aa3e-02d6648425ea tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action" status: 202 len: 0 microversion: 2.1 time: 0.083578 Nov 02 14:51:42.122411 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4045/8463] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:51:42 2022] POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:51:42.131888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:42.132623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:42.139929 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:42.140419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:42.140864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:42.141729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:42.142219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:42.142659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:42.287680 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:42.295500 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-279c3d03-ddfd-4208-95e7-e1694067b4b0 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1684 microversion: 2.1 time: 0.167884 Nov 02 14:51:42.296081 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4419/8464] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:42 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:43.321462 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:43.322185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:43.328422 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:43.329720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:43.330175 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:43.330884 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:43.331384 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:43.331830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:43.463215 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:43.471299 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-da37eb11-9aa9-48a0-bf49-b82343615309 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1684 microversion: 2.1 time: 0.155946 Nov 02 14:51:43.471886 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4046/8465] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:43 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:44.496340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:44.496911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:44.499956 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:51:44.500099 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:51:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e (ip 10.222.0.113) !!! Nov 02 14:51:44.506985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:44.507505 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:44.507951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:44.508653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:44.509112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:44.509546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:44.643739 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:44.651590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c634e636-b67d-4faa-8616-d94081e36fe1 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1687 microversion: 2.1 time: 0.159348 Nov 02 14:51:44.652170 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4420/8466] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:44 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:44.753088 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f4103ca2-eee1-499c-8604-6b1b47a2fe10 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:44.755328 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f4103ca2-eee1-499c-8604-6b1b47a2fe10 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:44.762136 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4103ca2-eee1-499c-8604-6b1b47a2fe10 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:44.762637 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4103ca2-eee1-499c-8604-6b1b47a2fe10 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:44.763091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4103ca2-eee1-499c-8604-6b1b47a2fe10 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:44.763865 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4103ca2-eee1-499c-8604-6b1b47a2fe10 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:44.764335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4103ca2-eee1-499c-8604-6b1b47a2fe10 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:44.764777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f4103ca2-eee1-499c-8604-6b1b47a2fe10 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:44.831410 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f4103ca2-eee1-499c-8604-6b1b47a2fe10 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action" status: 200 len: 37185 microversion: 2.1 time: 0.082884 Nov 02 14:51:44.832064 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4047/8467] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:51:44 2022] POST /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e/action => generated 37185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 14:51:46.205877 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:46.206435 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:46.209680 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-a43dc234-a449-4198-8542-171fa98fa496 req-ef047c57-5907-4f99-8a87-52ad2636b723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b515c783-bfb2-4eea-8684-529d425a706e", "tag": "4a2af11e-7f9f-4730-91e9-64a18e92cd76"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:46.213467 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:46.213955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:46.214393 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:46.215369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:46.216044 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:46.216482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:46.222699 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a43dc234-a449-4198-8542-171fa98fa496 req-ef047c57-5907-4f99-8a87-52ad2636b723 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:46.223620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a43dc234-a449-4198-8542-171fa98fa496 req-ef047c57-5907-4f99-8a87-52ad2636b723 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:46.224192 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-a43dc234-a449-4198-8542-171fa98fa496 req-ef047c57-5907-4f99-8a87-52ad2636b723 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:46.239280 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-a43dc234-a449-4198-8542-171fa98fa496 req-ef047c57-5907-4f99-8a87-52ad2636b723 service nova] Creating event network-changed:4a2af11e-7f9f-4730-91e9-64a18e92cd76 for instance b515c783-bfb2-4eea-8684-529d425a706e on n-h1-858384-19 Nov 02 14:51:46.244802 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-a43dc234-a449-4198-8542-171fa98fa496 req-ef047c57-5907-4f99-8a87-52ad2636b723 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041123 Nov 02 14:51:46.245105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:51:46.246296 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4048/8468] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:46.335541 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-66f252dd-0e14-4884-88a8-42b7440d0d23 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 204 len: 0 microversion: 2.1 time: 0.134354 Nov 02 14:51:46.336469 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4421/8469] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:51:46 2022] DELETE /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:51:46.346469 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:46.347225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:46.354012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:46.354516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:46.354972 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:46.355992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:46.356464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:46.356912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:46.496479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:46.504489 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-14340409-7212-4342-a609-f3761aaacaae tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1693 microversion: 2.1 time: 0.163403 Nov 02 14:51:46.505105 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4049/8470] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:46 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:47.529069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:47.529778 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:47.537021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:47.537507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:47.537954 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:47.538653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:47.539130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:47.539559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:47.676046 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:47.683917 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6fc65452-ae48-41dc-830b-8c06640c1d43 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1693 microversion: 2.1 time: 0.159201 Nov 02 14:51:47.684511 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4422/8471] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:47 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:48.707170 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:48.707896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:48.714782 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:48.715393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:48.715944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:48.716663 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:48.717196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:48.717584 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:48.742426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-0a54aed9-f416-4653-9004-50afe0a44d4f req-5dce2904-1c99-4eeb-8266-5f8c2e911991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b515c783-bfb2-4eea-8684-529d425a706e", "name": "network-vif-deleted", "tag": "4a2af11e-7f9f-4730-91e9-64a18e92cd76"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:51:48.755621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0a54aed9-f416-4653-9004-50afe0a44d4f req-5dce2904-1c99-4eeb-8266-5f8c2e911991 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:48.756194 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0a54aed9-f416-4653-9004-50afe0a44d4f req-5dce2904-1c99-4eeb-8266-5f8c2e911991 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:48.756705 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-0a54aed9-f416-4653-9004-50afe0a44d4f req-5dce2904-1c99-4eeb-8266-5f8c2e911991 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:48.770211 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-0a54aed9-f416-4653-9004-50afe0a44d4f req-5dce2904-1c99-4eeb-8266-5f8c2e911991 service nova] Creating event network-vif-deleted:4a2af11e-7f9f-4730-91e9-64a18e92cd76 for instance b515c783-bfb2-4eea-8684-529d425a706e on n-h1-858384-19 Nov 02 14:51:48.775546 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-0a54aed9-f416-4653-9004-50afe0a44d4f req-5dce2904-1c99-4eeb-8266-5f8c2e911991 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038517 Nov 02 14:51:48.776241 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4423/8472] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:51:48.794071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c603b713fd14a0d98447bc1e1bc475d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5df7c918cd42af842c12a999d7094b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:51:48.802895 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-026fb4e3-8806-4d02-a313-cd22d17ea152 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 200 len: 1507 microversion: 2.1 time: 0.099862 Nov 02 14:51:48.803531 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4050/8473] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:48 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 1507 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:51:49.827480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:49.828105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] [instance: b515c783-bfb2-4eea-8684-529d425a706e] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:51:49.834407 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:49.834890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:49.835357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:49.836053 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:51:49.836507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:51:49.836939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:51:49.849910 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] HTTP exception thrown: Instance b515c783-bfb2-4eea-8684-529d425a706e could not be found. Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Request method failure captured: Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e HTTP/1.1 Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYoFE8pUKf1IQIXfe6OlaOFnphQveAO1NwDWjLgi2hZ7y5Gm4RyxXF5nGHQKehOPYXCfevyjn2amLxRoJ96_g4j_N5gIikntXEZTbn8BP2DOM5zeZofusMmRKimgZIlTopOCkHYes3PD76hpMowtTP4oUvGNzdBmoQF6NeAikekXMr04 Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/7e5df7c918cd42af842c12a999d7094b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 7e5df7c918cd42af842c12a999d7094b Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1044677952 Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 3c603b713fd14a0d98447bc1e1bc475d Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1044677952-project Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance b515c783-bfb2-4eea-8684-529d425a706e could not be found. Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'b515c783-bfb2-4eea-8684-529d425a706e'} Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b515c783-bfb2-4eea-8684-529d425a706e could not be found. Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b515c783-bfb2-4eea-8684-529d425a706e could not be found. Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:51:49.851586 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b515c783-bfb2-4eea-8684-529d425a706e could not be found. Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Returning 404 to user: Instance b515c783-bfb2-4eea-8684-529d425a706e could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-344b3513-a193-4b23-95de-7ba85fea2212 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e" status: 404 len: 111 microversion: 2.1 time: 0.030769 Nov 02 14:51:49.857887 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4424/8474] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:51:49 2022] GET /compute/v2.1/servers/b515c783-bfb2-4eea-8684-529d425a706e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:51:52.941331 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aeb35894-319b-4e23-875f-5402ffe959a5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] Calling method '.version_select at 0x7fe78fa92040>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:51:52.975583 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aeb35894-319b-4e23-875f-5402ffe959a5 tempest-TestNetworkAdvancedServerOps-1044677952 tempest-TestNetworkAdvancedServerOps-1044677952-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1120055442" status: 202 len: 0 microversion: 2.1 time: 0.039017 Nov 02 14:51:52.985560 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4051/8475] 10.222.0.113 () {58 vars in 1289 bytes} [Wed Nov 2 14:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1120055442 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 14:52:04.584774 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:04.586160 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:04.780244 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a008ad87-b5b5-4274-91e0-61b7c44fa206 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Action: 'create', calling method: .version_select at 0x7fe78626c430>, body: {"keypair": {"name": "tempest-TestShelveInstance-184131039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyyUGahDAuEXIS3gDybFiL15k4pRFMXC7dP39s5/qlCLufv0QCPA363smFVC5nS2auwoZfOddclcD1GdK8uN1kU9zxAEnOEbJIZANYXesLt/Zk3UEbeVlKXjI0vhiE1pw=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:04.799860 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a008ad87-b5b5-4274-91e0-61b7c44fa206 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Getting quotas for project 3f3dfb2b8d0f4798b712bad7edc94410. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:52:04.809696 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-a008ad87-b5b5-4274-91e0-61b7c44fa206 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Getting quotas for user 69f44583a4b346e09a6301e1f405d1a8 and project 3f3dfb2b8d0f4798b712bad7edc94410. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:52:04.842218 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a008ad87-b5b5-4274-91e0-61b7c44fa206 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.263257 Nov 02 14:52:04.843358 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4425/8476] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:52:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:05.813729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:05.814435 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:05.818873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1227009376", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-184131039", "security_groups": [{"name": "tempest-secgroup-smoke-583806589"}], "networks": [{"uuid": "f992a288-1ffd-4b56-95f4-e8875f4ea672"}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:05.929097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] validate_networks() for [('f992a288-1ffd-4b56-95f4-e8875f4ea672', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:52:06.337425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:52:06.337864 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:52:06.338355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:52:06.338780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:52:06.339233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:52:06.349956 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:06.350649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:06.351238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:06.352273 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:06.352911 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:06.353407 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:06.379447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Getting quotas for project 3f3dfb2b8d0f4798b712bad7edc94410. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:52:06.385185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Getting quotas for user 69f44583a4b346e09a6301e1f405d1a8 and project 3f3dfb2b8d0f4798b712bad7edc94410. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:52:06.398841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:52:06.401543 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:52:06.465194 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b4641e3f-6505-4a0a-94bf-33c7759e9926 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.653981 Nov 02 14:52:06.466494 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4052/8477] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:52:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:52:06.484221 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e60236b7-d203-44e1-bb04-4cde5f27e8fe tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:06.484923 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e60236b7-d203-44e1-bb04-4cde5f27e8fe tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:06.568302 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e60236b7-d203-44e1-bb04-4cde5f27e8fe tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:06.575346 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e60236b7-d203-44e1-bb04-4cde5f27e8fe tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1250 microversion: 2.1 time: 0.099557 Nov 02 14:52:06.575936 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4426/8478] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:06 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1250 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:07.601196 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:07.603198 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:07.610886 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:07.611757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:07.612405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:07.613556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:07.614200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:07.615026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:07.712902 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:07.728188 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1b502a48-8162-4a4e-94fd-aec6d7c11b76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1310 microversion: 2.1 time: 0.132135 Nov 02 14:52:07.743477 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4053/8479] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:07 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1310 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:08.752528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:08.753135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:08.760288 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:08.760767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:08.761204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:08.761901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:08.762355 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:08.762781 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:08.988225 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:08.995959 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-20bd873a-7cba-4730-9ef2-9b99b498e628 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1375 microversion: 2.1 time: 0.248076 Nov 02 14:52:08.996538 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4427/8480] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:08 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1375 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:09.168324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-901630a7-b974-4c66-a084-f7817a2721b8 req-1367dff8-aa55-4351-bd6b-20907ef99f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db965530-6ab6-4f7e-b445-ff29cc51f1ae", "tag": "ac5f2c82-4fd6-4d9c-96e0-d0306c83a800"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:09.181289 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-901630a7-b974-4c66-a084-f7817a2721b8 req-1367dff8-aa55-4351-bd6b-20907ef99f8f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:09.181872 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-901630a7-b974-4c66-a084-f7817a2721b8 req-1367dff8-aa55-4351-bd6b-20907ef99f8f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:09.182382 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-901630a7-b974-4c66-a084-f7817a2721b8 req-1367dff8-aa55-4351-bd6b-20907ef99f8f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:09.194621 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-901630a7-b974-4c66-a084-f7817a2721b8 req-1367dff8-aa55-4351-bd6b-20907ef99f8f service nova] Creating event network-changed:ac5f2c82-4fd6-4d9c-96e0-d0306c83a800 for instance db965530-6ab6-4f7e-b445-ff29cc51f1ae on n-h2-858384-19 Nov 02 14:52:09.199528 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-901630a7-b974-4c66-a084-f7817a2721b8 req-1367dff8-aa55-4351-bd6b-20907ef99f8f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035848 Nov 02 14:52:09.200282 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4054/8481] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:52:10.019298 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:10.019896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:10.027050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:10.027907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:10.028554 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:10.029365 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:10.029912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:10.030394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:10.181008 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:10.190320 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-79d20b3c-8c97-48b2-9e79-10589f8ffff4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1375 microversion: 2.1 time: 0.175146 Nov 02 14:52:10.190910 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4428/8482] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:10 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:11.215409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:11.216128 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:11.223351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:11.223845 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:11.224297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:11.225003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:11.225471 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:11.225912 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:11.694486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:11.702477 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ae128ee6-4911-4c3d-a4cb-319aa29a61d0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1375 microversion: 2.1 time: 0.492236 Nov 02 14:52:11.704382 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4055/8483] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:11 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1375 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:12.727692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:12.728318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:12.735976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:12.736470 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:12.736913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:12.737622 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:12.738078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:12.738510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:12.874927 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:12.882861 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0ed46db7-e3c7-41db-aa83-807c1a9ba4cc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1375 microversion: 2.1 time: 0.159124 Nov 02 14:52:12.883482 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4429/8484] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:12 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:13.907465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:13.908061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:13.915314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:13.915804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:13.916247 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:13.916949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:13.917412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:13.917847 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:14.048165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:14.055932 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-872becb8-891e-4719-b637-f0d599bbea2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1375 microversion: 2.1 time: 0.153471 Nov 02 14:52:14.056515 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4056/8485] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:13 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:14.286383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-897b73bd-dcdc-46aa-b139-8807fd1b3104 req-81778745-a260-45b5-bc71-738148552777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db965530-6ab6-4f7e-b445-ff29cc51f1ae", "name": "network-vif-plugged", "status": "completed", "tag": "ac5f2c82-4fd6-4d9c-96e0-d0306c83a800"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:14.297444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-897b73bd-dcdc-46aa-b139-8807fd1b3104 req-81778745-a260-45b5-bc71-738148552777 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:14.298066 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-897b73bd-dcdc-46aa-b139-8807fd1b3104 req-81778745-a260-45b5-bc71-738148552777 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:14.298503 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-897b73bd-dcdc-46aa-b139-8807fd1b3104 req-81778745-a260-45b5-bc71-738148552777 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:14.312766 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-897b73bd-dcdc-46aa-b139-8807fd1b3104 req-81778745-a260-45b5-bc71-738148552777 service nova] Creating event network-vif-plugged:ac5f2c82-4fd6-4d9c-96e0-d0306c83a800 for instance db965530-6ab6-4f7e-b445-ff29cc51f1ae on n-h2-858384-19 Nov 02 14:52:14.317688 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-897b73bd-dcdc-46aa-b139-8807fd1b3104 req-81778745-a260-45b5-bc71-738148552777 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 Nov 02 14:52:14.318507 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4430/8486] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:52:15.078387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:15.079026 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:15.085944 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:15.086447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:15.086904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:15.087645 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:15.088122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:15.088573 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:15.224544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:15.232627 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dbf84b63-a1b4-4ade-b304-bb16042f55d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1375 microversion: 2.1 time: 0.158691 Nov 02 14:52:15.233221 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4057/8487] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:15 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:16.258419 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:16.259128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:16.266026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:16.266523 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:16.266959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:16.267690 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:16.268140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:16.268564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:16.402779 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:16.410675 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-35e9fd87-398c-4fd8-9f0c-c596e2f48d81 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1559 microversion: 2.1 time: 0.157582 Nov 02 14:52:16.411292 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4431/8488] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:16 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:16.434526 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:52:16.435180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:52:16.438593 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:16.439433 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:16.445337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:16.445838 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:16.446295 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:16.447004 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:16.447504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:16.447949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:16.581923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:52:16.589802 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f2dc2aeb-8ec3-4cc7-85db-415172d3a11c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1559 microversion: 2.1 time: 0.159179 Nov 02 14:52:16.590383 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4058/8489] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:52:16 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:52:18.298341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:52:18.355026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1581ad43-4c84-458e-ae07-a1991e1fd2d7 req-3418a60d-c7c4-4a32-8ed2-54d8a1997274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db965530-6ab6-4f7e-b445-ff29cc51f1ae", "tag": "ac5f2c82-4fd6-4d9c-96e0-d0306c83a800"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:52:18.369488 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1581ad43-4c84-458e-ae07-a1991e1fd2d7 req-3418a60d-c7c4-4a32-8ed2-54d8a1997274 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:52:18.369971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1581ad43-4c84-458e-ae07-a1991e1fd2d7 req-3418a60d-c7c4-4a32-8ed2-54d8a1997274 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:52:18.370404 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1581ad43-4c84-458e-ae07-a1991e1fd2d7 req-3418a60d-c7c4-4a32-8ed2-54d8a1997274 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:52:18.382316 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1581ad43-4c84-458e-ae07-a1991e1fd2d7 req-3418a60d-c7c4-4a32-8ed2-54d8a1997274 service nova] Creating event network-changed:ac5f2c82-4fd6-4d9c-96e0-d0306c83a800 for instance db965530-6ab6-4f7e-b445-ff29cc51f1ae on n-h2-858384-19 Nov 02 14:52:18.387481 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1581ad43-4c84-458e-ae07-a1991e1fd2d7 req-3418a60d-c7c4-4a32-8ed2-54d8a1997274 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094328 Nov 02 14:52:18.388110 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4432/8490] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:54:55.189838 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:54:55.191075 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 14:54:55.191565 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:55.192431 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=34 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:55.193247 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:54:55.193386 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:54:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae/action (ip 10.222.0.113) !!! Nov 02 14:54:55.194412 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:54:55.194581 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:54:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae/action (ip 10.222.0.113) !!! Nov 02 14:54:55.195537 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:54:55.195675 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 14:54:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae/action (ip 10.222.0.113) !!! Nov 02 14:54:55.201761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:54:55.202316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:55.214085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:55.214586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:55.215047 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:55.215796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:55.216266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:55.216709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:55.241022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.objects.instance [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lazy-loading 'flavor' on Instance uuid db965530-6ab6-4f7e-b445-ff29cc51f1ae {{(pid=120929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 14:54:55.429820 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a574e3b8-dd5f-42ac-962e-7df431a0d498 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "POST /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae/action" status: 202 len: 0 microversion: 2.1 time: 0.241605 Nov 02 14:54:55.430432 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4059/8491] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:54:55 2022] POST /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:54:55.437209 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:54:55.438021 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 14:54:55.438643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:55.439599 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=28 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:54:55.440414 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:54:55.440649 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:54:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae (ip 10.222.0.113) !!! Nov 02 14:54:55.442121 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 14:54:55.442265 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:54:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae (ip 10.222.0.113) !!! Nov 02 14:54:55.449323 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:55.450083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:55.462055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:55.462605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:55.463632 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:55.464527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:55.464989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:55.465422 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:55.605383 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:55.613233 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d15b1742-f561-45df-bfc2-50c52ec2fd5e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.177935 Nov 02 14:54:55.613821 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4433/8492] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:54:55 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:54:56.640312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:56.641034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:56.655510 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:56.656011 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:56.656467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:56.657296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:56.657770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:56.658214 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:56.658956 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 46914. Nov 02 14:54:56.662729 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 46916. Nov 02 14:54:56.797350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:56.805234 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-47955379-f31b-4904-b423-9a0ed1caa6a1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.171642 Nov 02 14:54:56.805752 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4060/8493] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:54:56 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:57.829765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:57.830384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:57.839963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:57.840452 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:57.840901 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:57.841614 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:57.842077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:57.842514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:57.848591 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 46924. Nov 02 14:54:57.860570 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 46922. Nov 02 14:54:57.976336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:57.984487 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0e87c9a9-942c-45d6-b32f-4d1f4d3a4def tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.158661 Nov 02 14:54:57.985071 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4434/8494] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:54:57 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:54:59.008378 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:54:59.008968 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:54:59.015924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:59.016409 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:59.016852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:59.017545 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:54:59.018008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:54:59.018443 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:54:59.159083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:54:59.167472 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-69c1773c-4902-4c30-a45f-1ea3bafe3a13 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.163136 Nov 02 14:54:59.168050 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4061/8495] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:54:59 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:55:00.191368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:00.192014 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:00.199792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:00.200285 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:00.200730 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:00.201444 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:00.202102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:00.202609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:00.342885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:00.350942 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f1866b1c-f963-4799-ad01-e9f03c5507f4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.163611 Nov 02 14:55:00.351595 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4435/8496] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:00 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:01.375834 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:01.376460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:01.383498 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:01.383992 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:01.384432 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:01.385634 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:01.386097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:01.386531 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:01.516165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:01.523983 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-79aacbb4-f956-4290-ab78-3955d4b78c69 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.152165 Nov 02 14:55:01.524570 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4062/8497] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:01 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:02.548605 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:02.549222 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:02.556336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:02.556835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:02.557955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:02.558698 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:02.559214 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:02.559649 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:02.696657 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:02.704421 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-10c380f8-90fb-4530-8b62-c25cbef24729 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.159823 Nov 02 14:55:02.705002 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4436/8498] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:02 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:03.727876 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:03.728535 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:03.736278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:03.736777 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:03.737237 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:03.737953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:03.738429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:03.738879 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:03.876249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:03.884099 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7e0f8450-793f-4cc6-b195-ac4aef3ded1f tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.160246 Nov 02 14:55:03.884689 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4063/8499] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:03 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:04.908273 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:04.908829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:04.915726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:04.916896 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:04.917399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:04.918087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:04.918538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:04.918963 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:05.149606 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:05.158399 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2ddf786d-f4d7-435f-9bf1-725c13700d9a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.254066 Nov 02 14:55:05.158918 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4437/8500] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:04 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:55:06.181732 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:06.182866 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:06.189851 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:06.190346 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:06.190800 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:06.191530 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:06.192003 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:06.192447 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:06.385791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:06.393564 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-128bf41c-3d42-4662-b25b-ab9a331fe92c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.215850 Nov 02 14:55:06.394148 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4064/8501] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:06 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:07.418061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:07.418676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:07.425712 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:07.426180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:07.426620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:07.427346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:07.427801 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:07.428232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:07.563082 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:07.571073 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c28a6c46-b5d1-4e41-9583-1f5f6e173ee9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1704 microversion: 2.1 time: 0.157472 Nov 02 14:55:07.571703 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4438/8502] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:07 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1704 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:08.595493 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:08.596244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:08.603094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:08.603621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:08.604109 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:08.605078 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:08.605544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:08.605988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:08.738032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:08.746393 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-de523160-a204-48c3-977e-d1e90294564c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1704 microversion: 2.1 time: 0.154910 Nov 02 14:55:08.746976 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4065/8503] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:08 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1704 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:09.769903 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:09.770514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:09.778119 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:09.778602 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:09.779039 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:09.779751 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:09.780236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:09.780662 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:09.913327 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:09.921859 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9d6ea701-4cd5-463a-9597-21c26c490637 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1704 microversion: 2.1 time: 0.155977 Nov 02 14:55:09.922430 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4439/8504] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:09 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1704 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:10.945249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:10.945966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:10.955604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:10.956306 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:10.956775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:10.957509 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:10.958064 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:10.958427 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:11.002793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-1a772d63-57bf-4118-93db-2a3c4ba06d43 req-a4cb0164-9ebd-4ee0-852e-cde7c43b49b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db965530-6ab6-4f7e-b445-ff29cc51f1ae", "name": "network-vif-plugged", "status": "completed", "tag": "ac5f2c82-4fd6-4d9c-96e0-d0306c83a800"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:11.014353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1a772d63-57bf-4118-93db-2a3c4ba06d43 req-a4cb0164-9ebd-4ee0-852e-cde7c43b49b6 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:11.014841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1a772d63-57bf-4118-93db-2a3c4ba06d43 req-a4cb0164-9ebd-4ee0-852e-cde7c43b49b6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:11.015305 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-1a772d63-57bf-4118-93db-2a3c4ba06d43 req-a4cb0164-9ebd-4ee0-852e-cde7c43b49b6 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:11.028313 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-1a772d63-57bf-4118-93db-2a3c4ba06d43 req-a4cb0164-9ebd-4ee0-852e-cde7c43b49b6 service nova] Creating event network-vif-plugged:ac5f2c82-4fd6-4d9c-96e0-d0306c83a800 for instance db965530-6ab6-4f7e-b445-ff29cc51f1ae on n-h2-858384-19 Nov 02 14:55:11.034988 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-1a772d63-57bf-4118-93db-2a3c4ba06d43 req-a4cb0164-9ebd-4ee0-852e-cde7c43b49b6 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036111 Nov 02 14:55:11.035648 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4440/8505] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:55:11.105470 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:11.113446 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ba832572-5c6b-4aee-aff4-cd626d0f3211 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1704 microversion: 2.1 time: 0.172277 Nov 02 14:55:11.114015 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4066/8506] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:10 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1704 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:12.140090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:12.140855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:12.147248 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:12.147663 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:12.148097 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:12.148793 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:12.149165 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:12.149589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:12.293012 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:12.301144 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-82870088-8766-46b9-be73-9623b5960f3b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1699 microversion: 2.1 time: 0.167995 Nov 02 14:55:12.301905 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4441/8507] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:12 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:13.327337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:13.329374 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:13.336918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:13.337536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:13.338958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:13.339926 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:13.343037 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:13.344353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:13.503008 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:13.512296 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6c1914ad-4f8b-40c6-93ba-e5246e726fc0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1699 microversion: 2.1 time: 0.191505 Nov 02 14:55:13.513145 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4067/8508] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:13 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1699 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:14.537072 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:14.538519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:14.546612 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:14.547102 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:14.547580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:14.548297 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:14.548756 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:14.549188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:14.707610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:14.716498 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b0450b21-763b-4015-aa6e-0c39cae699cd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1699 microversion: 2.1 time: 0.183542 Nov 02 14:55:14.717103 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4442/8509] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:14 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1699 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:15.743418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:15.745083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:15.752187 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:15.752713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:15.753162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:15.753908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:15.754369 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:15.754875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:15.918898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:15.927425 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3f36bb6e-d121-46ee-acb4-c6f1ada7f809 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1699 microversion: 2.1 time: 0.188349 Nov 02 14:55:15.943702 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4068/8510] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:15 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1699 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:16.952417 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:16.953088 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:16.960377 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:16.960946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:16.961481 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:16.962262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:16.963729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:16.964454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:17.113416 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:17.122711 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-29686213-cc7c-4ecc-95a3-1e491a926daf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1699 microversion: 2.1 time: 0.174104 Nov 02 14:55:17.124427 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4443/8511] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:16 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1699 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:18.151227 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:18.152991 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:18.166795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:18.166795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:18.166795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:18.166795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:18.166795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:18.167489 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:18.326678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:18.334995 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5e94aefa-41da-44c9-a6ea-9b5bb741c1fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1699 microversion: 2.1 time: 0.190019 Nov 02 14:55:18.336776 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4069/8512] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:18 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1699 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:19.360462 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:19.361306 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:19.368882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:19.369573 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:19.370267 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:19.371083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:19.371627 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:19.372322 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:19.520108 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:19.532082 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-39a2c6ad-8a6e-43c7-b8a1-310d42237164 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1699 microversion: 2.1 time: 0.175619 Nov 02 14:55:19.532763 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4444/8513] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:19 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1699 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:20.555633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:20.557272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:20.565451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:20.565451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:20.565451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:20.565938 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:20.566342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:20.566873 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:20.720977 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:20.730318 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-6f924b5d-2cdb-4f45-8b75-fc8092441ecd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1699 microversion: 2.1 time: 0.178368 Nov 02 14:55:20.743403 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4070/8514] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:20 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1699 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:21.753943 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:21.754557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:21.762096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:21.762578 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:21.763022 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:21.763749 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:21.764208 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:21.764640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:21.947695 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:21.955503 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4d1db2f6-6c60-4e90-ad58-16f603d1f49e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1699 microversion: 2.1 time: 0.205559 Nov 02 14:55:21.956116 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4445/8515] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:21 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1699 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:22.979251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:22.980107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:22.986899 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:22.987428 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:22.987883 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:22.988591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:22.989061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:22.989504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:23.130795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:23.139168 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-30b86b0d-bb2d-4141-afab-80cd84eefd8a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1681 microversion: 2.1 time: 0.164106 Nov 02 14:55:23.139752 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4071/8516] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:22 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:24.161837 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:24.162466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:24.169433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:24.169910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:24.170344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:24.171029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:24.171506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:24.171933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:24.307568 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:24.315435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4ade03d9-2521-455c-b9b2-1b90bb7327c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1681 microversion: 2.1 time: 0.157542 Nov 02 14:55:24.316018 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4446/8517] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:24 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:25.015734 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4ec5394c-960b-47ae-86d7-4bc4521812a8 req-a6f595d9-9426-4afc-8056-45db771d600c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db965530-6ab6-4f7e-b445-ff29cc51f1ae", "name": "network-vif-unplugged", "status": "completed", "tag": "ac5f2c82-4fd6-4d9c-96e0-d0306c83a800"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:25.029684 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4ec5394c-960b-47ae-86d7-4bc4521812a8 req-a6f595d9-9426-4afc-8056-45db771d600c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:25.030410 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4ec5394c-960b-47ae-86d7-4bc4521812a8 req-a6f595d9-9426-4afc-8056-45db771d600c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:25.031218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4ec5394c-960b-47ae-86d7-4bc4521812a8 req-a6f595d9-9426-4afc-8056-45db771d600c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:25.044723 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.compute.server_external_events [req-4ec5394c-960b-47ae-86d7-4bc4521812a8 req-a6f595d9-9426-4afc-8056-45db771d600c service nova] Unable to find a host for instance db965530-6ab6-4f7e-b445-ff29cc51f1ae. Dropping event network-vif-unplugged {{(pid=120929) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 14:55:25.045606 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4ec5394c-960b-47ae-86d7-4bc4521812a8 req-a6f595d9-9426-4afc-8056-45db771d600c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034406 Nov 02 14:55:25.046206 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4072/8518] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 14:55:25.337855 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:25.339437 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:25.346023 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:25.346506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:25.346944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:25.347674 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:25.348131 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:25.348559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:25.480031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:25.482321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=85 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:25.489435 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90d25df7-2c6d-40cc-a4d5-b33da1c9323a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1624 microversion: 2.1 time: 0.155494 Nov 02 14:55:25.490062 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4447/8519] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:25 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1624 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:25.513243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:25.513889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:25.515799 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=29 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:25.521359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:25.521857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:25.522314 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:25.523020 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:25.523515 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:25.523986 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:25.527152 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:25.612528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120929) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Nov 02 14:55:25.679627 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8a4205ce-a658-4ae7-b2fa-008a22e386f7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "POST /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae/action" status: 202 len: 0 microversion: 2.1 time: 0.170969 Nov 02 14:55:25.680433 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4073/8520] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 14:55:25 2022] POST /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:55:25.688436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:25.689105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:25.690948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=31 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:55:25.696399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:25.696886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:25.697333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:25.698848 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:25.699079 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:25.699454 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:25.837090 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:25.845305 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-145c25aa-f217-42c4-9955-85ad8c3df9d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1632 microversion: 2.1 time: 0.160742 Nov 02 14:55:25.846019 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4448/8521] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:25 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1632 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:26.870598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:26.871375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:26.877892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:26.878400 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:26.878858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:26.879633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:26.880106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:26.880554 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:27.018981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:27.027004 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-dd819a50-c7e4-44ec-9e5c-7d35befb8fa2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.162022 Nov 02 14:55:27.027634 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4074/8522] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:26 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:28.051350 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:28.052827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:28.061153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:28.061686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:28.062107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:28.062839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:28.063343 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:28.063795 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:28.084802 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7e2d1bee-6543-4944-908c-c138b5763fd0 req-0887031a-43ca-42bf-bff2-ae5278f10340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db965530-6ab6-4f7e-b445-ff29cc51f1ae", "tag": "ac5f2c82-4fd6-4d9c-96e0-d0306c83a800"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:28.101498 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7e2d1bee-6543-4944-908c-c138b5763fd0 req-0887031a-43ca-42bf-bff2-ae5278f10340 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:28.102594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7e2d1bee-6543-4944-908c-c138b5763fd0 req-0887031a-43ca-42bf-bff2-ae5278f10340 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:28.103060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7e2d1bee-6543-4944-908c-c138b5763fd0 req-0887031a-43ca-42bf-bff2-ae5278f10340 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:28.115214 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7e2d1bee-6543-4944-908c-c138b5763fd0 req-0887031a-43ca-42bf-bff2-ae5278f10340 service nova] Creating event network-changed:ac5f2c82-4fd6-4d9c-96e0-d0306c83a800 for instance db965530-6ab6-4f7e-b445-ff29cc51f1ae on n-h1-858384-19 Nov 02 14:55:28.120662 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7e2d1bee-6543-4944-908c-c138b5763fd0 req-0887031a-43ca-42bf-bff2-ae5278f10340 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115176 Nov 02 14:55:28.121444 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4449/8523] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:55:28.202429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:28.210412 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d16af0b4-dcc5-45bc-8fba-6d59aa781ebd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.163099 Nov 02 14:55:28.211101 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4075/8524] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:28 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:55:29.236472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:29.237188 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:29.249480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:29.249912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:29.255852 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:29.256867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:29.257514 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:29.258262 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:29.502529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:29.510946 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eeae1653-08ad-44fb-88e3-29b5573a59bc tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.279770 Nov 02 14:55:29.527624 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4450/8525] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:29 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:30.536949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:30.537900 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:30.545726 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:30.546978 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:30.548385 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:30.549353 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:30.550030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:30.550683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:30.702857 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:30.711144 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-3968f55a-98e2-4b32-b2d2-a236bd9229e4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.178377 Nov 02 14:55:30.711896 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4076/8526] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:30 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:31.736545 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:31.737161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:31.744126 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:31.744610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:31.745812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:31.746522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:31.746972 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:31.747427 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:31.897718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:31.906653 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a018dd89-a08a-4bc8-85f2-22f287d9aa50 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.174018 Nov 02 14:55:31.907662 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4451/8527] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:31 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:55:32.931823 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:32.933335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:32.940657 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:32.941221 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:32.941625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:32.942359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:32.943154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:32.943603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:33.096106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:33.104272 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-9f2dd8fe-5291-4166-a2ea-5415fa422a6e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.176656 Nov 02 14:55:33.105666 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4077/8528] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:32 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:34.129888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:34.130574 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:34.138321 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:34.139032 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:34.139536 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:34.140276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:34.140744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:34.141178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:34.304332 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:34.313702 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d79c5d10-9161-4425-a278-709f02421800 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.187976 Nov 02 14:55:34.327140 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4452/8529] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:34 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:35.340898 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:35.342960 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:35.350320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:35.350819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:35.351308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:35.352086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:35.352559 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:35.353107 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:35.499303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:35.507884 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a39a175e-7bc8-4e31-9613-4ba832378cec tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.172501 Nov 02 14:55:35.508482 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4078/8530] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:35 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:36.533107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:36.534771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:36.542743 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:36.543460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:36.543946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:36.544765 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:36.545314 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:36.545806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:36.686411 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:36.695264 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-48add906-1fab-41f1-981b-ce0fb937be37 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.166128 Nov 02 14:55:36.696061 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4453/8531] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:36 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:37.724451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:37.725111 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:37.733016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:37.733520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:37.733979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:37.734690 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:37.735191 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:37.735640 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:37.871527 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:37.879348 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a73ded20-51a1-491b-a7b6-ab6a2e155700 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.159330 Nov 02 14:55:37.879933 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4079/8532] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:37 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:38.903232 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:38.903845 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:38.910862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:38.911374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:38.911812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:38.912506 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:38.912955 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:38.913373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:39.047621 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:39.055290 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9904cc09-e2a3-483c-ab7e-179c87213824 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.156347 Nov 02 14:55:39.055868 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4454/8533] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:38 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:40.079621 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:40.080264 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:40.087366 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:40.087869 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:40.088330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:40.089523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:40.090001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:40.090453 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:40.224426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:40.233088 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-a9871cb7-42f7-4c90-97c6-5cf913f8b80e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.157598 Nov 02 14:55:40.233668 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4080/8534] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:40 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:41.256684 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:41.257301 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:41.265557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:41.266045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:41.266490 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:41.267218 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:41.267681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:41.268114 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:41.397819 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:41.405696 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7bdaf206-e225-491c-8665-ce5fcebcdc17 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.153032 Nov 02 14:55:41.406288 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4455/8535] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:41 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:42.435852 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:42.436416 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:42.443664 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:42.444160 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:42.444609 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:42.445318 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:42.445780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:42.446219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:42.582829 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:42.591378 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1fe2a31f-4d32-4cb4-a6ed-0d3eec4200ad tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.165280 Nov 02 14:55:42.591971 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4081/8536] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:42 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:43.615140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:43.615742 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:43.623282 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:43.623762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:43.624198 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:43.624883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:43.625334 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:43.625754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:43.764157 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:43.771977 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-87b27d97-a64d-41ed-88f3-caa461f23c2a tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.160812 Nov 02 14:55:43.772572 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4456/8537] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:43 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:44.796256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:44.797023 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:44.803881 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:44.804320 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:44.804774 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:44.805486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:44.805957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:44.806395 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:44.945574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:44.954133 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d28e1b9f-311d-40e4-ba99-348eb7bbde0e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.162332 Nov 02 14:55:44.954828 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4082/8538] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:44 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:45.977834 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:45.978418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:45.986043 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:45.986539 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:45.986989 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:45.987715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:45.988178 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:45.988615 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:46.120223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:46.127985 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-90e6643c-6bdd-4640-8364-e6dd3e375c06 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.154189 Nov 02 14:55:46.128571 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4457/8539] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:45 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:46.776381 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6108b054-1519-454f-b2b7-55e34a21a697 req-60fefc8d-2c3b-45d6-a16f-7cb1f12fc799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db965530-6ab6-4f7e-b445-ff29cc51f1ae", "name": "network-vif-plugged", "status": "completed", "tag": "ac5f2c82-4fd6-4d9c-96e0-d0306c83a800"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:55:46.786046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6108b054-1519-454f-b2b7-55e34a21a697 req-60fefc8d-2c3b-45d6-a16f-7cb1f12fc799 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:46.786533 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6108b054-1519-454f-b2b7-55e34a21a697 req-60fefc8d-2c3b-45d6-a16f-7cb1f12fc799 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:46.786971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6108b054-1519-454f-b2b7-55e34a21a697 req-60fefc8d-2c3b-45d6-a16f-7cb1f12fc799 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:46.799839 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6108b054-1519-454f-b2b7-55e34a21a697 req-60fefc8d-2c3b-45d6-a16f-7cb1f12fc799 service nova] Creating event network-vif-plugged:ac5f2c82-4fd6-4d9c-96e0-d0306c83a800 for instance db965530-6ab6-4f7e-b445-ff29cc51f1ae on n-h1-858384-19 Nov 02 14:55:46.806607 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6108b054-1519-454f-b2b7-55e34a21a697 req-60fefc8d-2c3b-45d6-a16f-7cb1f12fc799 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097504 Nov 02 14:55:46.807268 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4083/8540] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:55:47.152646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:47.153270 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:47.160280 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:47.160769 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:47.161216 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:47.161922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:47.162399 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:47.162816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:47.298889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:47.306813 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-51a9c7cb-2790-4eb3-88a7-a2bbaf1a9534 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.158693 Nov 02 14:55:47.308558 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4458/8541] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:47 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:48.333095 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:48.333843 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:48.340667 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:48.341155 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:48.341601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:48.342300 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:48.342761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:48.343224 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:48.477013 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:48.485216 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7da57446-2080-49d5-ae47-666ddc78e7df tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1690 microversion: 2.1 time: 0.157214 Nov 02 14:55:48.485798 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4084/8542] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:48 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:55:49.509192 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:55:49.509803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:55:49.517283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:49.517762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:49.518197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:49.518888 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:55:49.519369 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:55:49.519795 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:55:49.653434 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:55:49.661221 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7ded5a41-ddcc-4522-9fbc-8ef29deb3621 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1677 microversion: 2.1 time: 0.156099 Nov 02 14:55:49.661805 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4459/8543] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:55:49 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:28.268202 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:28.269050 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:28.274511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:28.274678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=23 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:28.275090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:28.275620 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=69 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:28.276870 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 14:57:28.276870 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 14:57:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.113) !!! Nov 02 14:57:28.288016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:28.288674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:28.289190 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:28.289954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:28.290425 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:28.291014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:28.318650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Going to try to terminate instance {{(pid=120929) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 14:57:28.340180 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-7a792e1f-5d45-40ce-8cdb-0664b5575838 req-32099d7b-e2a4-45e9-a0db-42ce957f5dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db965530-6ab6-4f7e-b445-ff29cc51f1ae", "tag": "ac5f2c82-4fd6-4d9c-96e0-d0306c83a800"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:28.350874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7a792e1f-5d45-40ce-8cdb-0664b5575838 req-32099d7b-e2a4-45e9-a0db-42ce957f5dc9 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:28.351510 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7a792e1f-5d45-40ce-8cdb-0664b5575838 req-32099d7b-e2a4-45e9-a0db-42ce957f5dc9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:28.352021 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-7a792e1f-5d45-40ce-8cdb-0664b5575838 req-32099d7b-e2a4-45e9-a0db-42ce957f5dc9 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:28.365590 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-7a792e1f-5d45-40ce-8cdb-0664b5575838 req-32099d7b-e2a4-45e9-a0db-42ce957f5dc9 service nova] Creating event network-changed:ac5f2c82-4fd6-4d9c-96e0-d0306c83a800 for instance db965530-6ab6-4f7e-b445-ff29cc51f1ae on n-h1-858384-19 Nov 02 14:57:28.370969 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-7a792e1f-5d45-40ce-8cdb-0664b5575838 req-32099d7b-e2a4-45e9-a0db-42ce957f5dc9 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103027 Nov 02 14:57:28.371922 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4460/8544] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:28.401291 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-16c49dbe-e84d-488d-aaba-0039cdf86ffa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "DELETE /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 204 len: 0 microversion: 2.1 time: 0.135917 Nov 02 14:57:28.401894 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4085/8545] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 14:57:28 2022] DELETE /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 14:57:28.412812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:28.414099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:28.424085 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:28.424658 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:28.425098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:28.425818 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:28.426286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:28.426806 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:28.572754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:28.581210 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1caee68f-d4da-44cf-b3f5-06d3bddd12b6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.173208 Nov 02 14:57:28.581792 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4461/8546] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:28 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:29.606801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:29.607552 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:29.615747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:29.616248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:29.616703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:29.617421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:29.617892 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:29.618342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:29.761766 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:29.769888 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-bafba4fc-3ae9-4c04-b588-9f7d1a8e529e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1683 microversion: 2.1 time: 0.167744 Nov 02 14:57:29.770484 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4086/8547] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:29 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:30.733916 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-9353758c-90b8-492f-b477-76170789cc8e req-38abdf9f-ea8e-4c51-be44-5dabae384955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db965530-6ab6-4f7e-b445-ff29cc51f1ae", "name": "network-vif-deleted", "tag": "ac5f2c82-4fd6-4d9c-96e0-d0306c83a800"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:30.746055 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9353758c-90b8-492f-b477-76170789cc8e req-38abdf9f-ea8e-4c51-be44-5dabae384955 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:30.746567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9353758c-90b8-492f-b477-76170789cc8e req-38abdf9f-ea8e-4c51-be44-5dabae384955 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:30.747089 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-9353758c-90b8-492f-b477-76170789cc8e req-38abdf9f-ea8e-4c51-be44-5dabae384955 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:30.760035 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-9353758c-90b8-492f-b477-76170789cc8e req-38abdf9f-ea8e-4c51-be44-5dabae384955 service nova] Creating event network-vif-deleted:ac5f2c82-4fd6-4d9c-96e0-d0306c83a800 for instance db965530-6ab6-4f7e-b445-ff29cc51f1ae on n-h1-858384-19 Nov 02 14:57:30.767007 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-9353758c-90b8-492f-b477-76170789cc8e req-38abdf9f-ea8e-4c51-be44-5dabae384955 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036863 Nov 02 14:57:30.767656 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4462/8548] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 14:57:30.793719 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:30.794465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:30.803248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:30.803754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:30.804210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:30.804929 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:30.805403 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:30.805846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:30.872153 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:30.882514 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-21aba810-1f7d-495f-ad2c-8fc9ec03932d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 200 len: 1335 microversion: 2.1 time: 0.092755 Nov 02 14:57:30.883141 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4087/8549] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:30 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 1335 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:31.908257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:31.908878 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: db965530-6ab6-4f7e-b445-ff29cc51f1ae] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:31.915937 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:31.916426 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:31.916865 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:31.917563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:31.918016 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:31.918448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:31.934604 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] HTTP exception thrown: Instance db965530-6ab6-4f7e-b445-ff29cc51f1ae could not be found. Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Request method failure captured: Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae HTTP/1.1 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYoQPQFhPhXPCarySqm8SQ_-bDxr5hoTdjPo4jmn8hj-07weMS_NAgvZQ72UWdDOs0EgeKyNOVjcm8d0FOHRb6j73lC4hglYqPCyUt1o_Eh_XsXvxgg8nNuXlPI3-NzGksD0bg9nOFDFLvC3O8USaIWcdwRW1E2n-nyUNpKBIDh9V6ms Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: 3f3dfb2b8d0f4798b712bad7edc94410 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestShelveInstance-801972837 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f3dfb2b8d0f4798b712bad7edc94410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f3dfb2b8d0f4798b712bad7edc94410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3f3dfb2b8d0f4798b712bad7edc94410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3f3dfb2b8d0f4798b712bad7edc94410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestShelveInstance-801972837 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: 3f3dfb2b8d0f4798b712bad7edc94410 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestShelveInstance-801972837 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestShelveInstance-801972837-project Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: 69f44583a4b346e09a6301e1f405d1a8 Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestShelveInstance-801972837-project Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance db965530-6ab6-4f7e-b445-ff29cc51f1ae could not be found. Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'db965530-6ab6-4f7e-b445-ff29cc51f1ae'} Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db965530-6ab6-4f7e-b445-ff29cc51f1ae could not be found. Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db965530-6ab6-4f7e-b445-ff29cc51f1ae could not be found. Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 14:57:31.936266 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db965530-6ab6-4f7e-b445-ff29cc51f1ae could not be found. Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Returning 404 to user: Instance db965530-6ab6-4f7e-b445-ff29cc51f1ae could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a04ebeb7-adf6-45e9-a5ef-fcdaca13db7b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae" status: 404 len: 111 microversion: 2.1 time: 0.035044 Nov 02 14:57:31.943237 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4463/8550] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:31 2022] GET /compute/v2.1/servers/db965530-6ab6-4f7e-b445-ff29cc51f1ae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 14:57:32.103233 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-905918dd-2935-4bb2-8d75-096d3d7a9969 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '.version_select at 0x7fe786fd60d0>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:32.131013 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-905918dd-2935-4bb2-8d75-096d3d7a9969 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-184131039" status: 202 len: 0 microversion: 2.1 time: 0.031103 Nov 02 14:57:32.131762 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4088/8551] 10.222.0.113 () {58 vars in 1256 bytes} [Wed Nov 2 14:57:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-184131039 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 14:57:32.157889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-95fe3962-77c3-4ff4-a86e-9fbbef35ba9c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Action: 'create', calling method: .version_select at 0x7fe785f6b040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1020357883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFr10vGh55V1vV9Q4wSi1eAUSAhnWQVP3yFk1S7XLNIGBLs5EzPNqfVMAO0qUHJvK91F+wWjhEjXesALznmPQUIrnKdpPPmlICbXZz905XxtYLy1s1OVzzx0hvOE87b00A=="}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:32.173817 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-95fe3962-77c3-4ff4-a86e-9fbbef35ba9c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Getting quotas for project 3f3dfb2b8d0f4798b712bad7edc94410. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:57:32.178958 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-95fe3962-77c3-4ff4-a86e-9fbbef35ba9c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Getting quotas for user 69f44583a4b346e09a6301e1f405d1a8 and project 3f3dfb2b8d0f4798b712bad7edc94410. Resources: {'key_pairs'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:57:32.209512 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-95fe3962-77c3-4ff4-a86e-9fbbef35ba9c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.055202 Nov 02 14:57:32.210260 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4464/8552] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 14:57:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:48.397688 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:48.398446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:48.403303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1229384715", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1020357883", "security_groups": [{"name": "tempest-secgroup-smoke-340411724"}], "networks": [{"uuid": "f992a288-1ffd-4b56-95f4-e8875f4ea672"}], "block_device_mapping_v2": [{"uuid": "dbe43a79-fad9-484a-845e-da9fe845c8df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:48.516625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.network.neutron [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] validate_networks() for [('f992a288-1ffd-4b56-95f4-e8875f4ea672', None, None, None, None, None)] {{(pid=120929) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 14:57:48.887626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Flavor limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 14:57:48.888061 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Image limits 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 14:57:48.888548 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Flavor pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 14:57:48.888967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Image pref 0:0:0 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 14:57:48.889392 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.virt.hardware [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 14:57:48.899207 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:48.899824 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:48.900275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:48.901014 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:48.901481 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:48.902030 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:48.923757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Getting quotas for project 3f3dfb2b8d0f4798b712bad7edc94410. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 14:57:48.928946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Getting quotas for user 69f44583a4b346e09a6301e1f405d1a8 and project 3f3dfb2b8d0f4798b712bad7edc94410. Resources: {'ram', 'instances', 'cores'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 14:57:48.988156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Going to run 1 instances... {{(pid=120929) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 14:57:48.990322 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dbe43a79-fad9-484a-845e-da9fe845c8df',volume_size=None,volume_type=None)] {{(pid=120929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 14:57:49.121707 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-7ee1929e-0e9a-443b-83ae-929269b7c3d4 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.725529 Nov 02 14:57:49.122371 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4089/8553] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 14:57:48 2022] POST /compute/v2.1/servers => generated 407 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 14:57:49.131641 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=12 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:49.132406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=4 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:49.133202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:49.137289 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-d160da72-c775-4223-b804-bbedb5466cf3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:49.137910 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-d160da72-c775-4223-b804-bbedb5466cf3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:49.203081 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-d160da72-c775-4223-b804-bbedb5466cf3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:49.210210 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-d160da72-c775-4223-b804-bbedb5466cf3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1092 microversion: 2.1 time: 0.080338 Nov 02 14:57:49.210778 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4465/8554] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:49 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1092 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:57:50.235075 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:50.235842 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:50.243012 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:50.243623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:50.244090 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:50.244817 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:50.245288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:50.245736 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:50.320494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:50.330953 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ea1def6a-05e0-4967-b6d3-adcab905e8bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1198 microversion: 2.1 time: 0.101724 Nov 02 14:57:50.331521 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4090/8555] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:50 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1198 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:51.356915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:51.358158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:51.366986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:51.367502 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:51.368158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:51.368882 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:51.369348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:51.369796 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:51.608261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:51.616844 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-51ee6430-6bbc-4a50-8e85-20d7e0f45335 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1275 microversion: 2.1 time: 0.264268 Nov 02 14:57:51.618040 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4466/8556] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:51 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:51.826234 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-da6a4f51-b54e-4cac-9d69-0d6a6da923e2 req-723ad8d2-3c8e-44f8-a976-7286384202d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23d5313-bd7b-45b0-b246-e360b2a06214", "tag": "2131d039-363c-4cfc-8ed6-e112841a6dd8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:57:51.840720 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-da6a4f51-b54e-4cac-9d69-0d6a6da923e2 req-723ad8d2-3c8e-44f8-a976-7286384202d4 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:51.841248 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-da6a4f51-b54e-4cac-9d69-0d6a6da923e2 req-723ad8d2-3c8e-44f8-a976-7286384202d4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:51.842308 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-da6a4f51-b54e-4cac-9d69-0d6a6da923e2 req-723ad8d2-3c8e-44f8-a976-7286384202d4 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:51.857466 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-da6a4f51-b54e-4cac-9d69-0d6a6da923e2 req-723ad8d2-3c8e-44f8-a976-7286384202d4 service nova] Creating event network-changed:2131d039-363c-4cfc-8ed6-e112841a6dd8 for instance e23d5313-bd7b-45b0-b246-e360b2a06214 on n-h2-858384-19 Nov 02 14:57:51.865096 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-da6a4f51-b54e-4cac-9d69-0d6a6da923e2 req-723ad8d2-3c8e-44f8-a976-7286384202d4 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042495 Nov 02 14:57:51.866035 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4091/8557] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:57:52.641745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:52.642313 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:52.649669 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:52.650166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:52.650608 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:52.651373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:52.651829 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:52.652275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:52.873331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:52.882137 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-01bc57d6-9351-4b54-b785-756637c31032 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1275 microversion: 2.1 time: 0.244994 Nov 02 14:57:52.883473 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4467/8558] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:52 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:53.906942 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:53.907753 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:53.914885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:53.915430 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:53.915887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:53.916601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:53.917073 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:53.917517 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:54.059781 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:54.068904 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-63b9c05b-e6bc-474b-85ba-c455fd19cc63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1275 microversion: 2.1 time: 0.166485 Nov 02 14:57:54.069548 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4092/8559] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:53 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:55.092387 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:55.093067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:55.100541 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:55.101045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:55.101485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:55.102197 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:55.102659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:55.103094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:55.242944 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:55.250957 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-25f729fe-7bc6-43ce-8747-c011c665ec25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1275 microversion: 2.1 time: 0.162606 Nov 02 14:57:55.251576 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4468/8560] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:55 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:56.274967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:56.275648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:56.283137 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:56.283648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:56.284098 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:56.284807 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:56.285272 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:56.285713 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:56.416524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:56.425556 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4a16f9e8-f866-42df-b059-a0e1ac161081 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.154543 Nov 02 14:57:56.426146 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4093/8561] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:56 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:57.447763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:57.448373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:57.455349 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:57.455824 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:57.456256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:57.456970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:57.457418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:57.457841 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:57.593700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:57.604954 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-114091de-5af9-4637-8e64-d81027b12440 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.161102 Nov 02 14:57:57.605570 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4469/8562] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:57 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:58.629310 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:58.629950 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:58.636035 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:58.636539 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:58.636993 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:58.637704 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:58.638176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:58.638623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:58.771932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:58.779795 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-906bd355-c4db-4656-afec-acb54882d1e8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.155706 Nov 02 14:57:58.780426 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4094/8563] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:58 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:57:59.802755 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:57:59.803398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:57:59.805480 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:57:59.811027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:59.811556 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:59.812647 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:59.813363 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:57:59.813847 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:57:59.814287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:57:59.946547 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:57:59.954445 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-67a6d110-cff6-434f-b204-664e18f27c4d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.155922 Nov 02 14:57:59.955029 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4470/8564] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:57:59 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:00.978009 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:00.978589 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:00.980813 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:58:00.981619 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 14:58:00.989390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:00.989885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:00.990334 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:00.991040 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:00.991541 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:00.991979 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:01.121930 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:01.130242 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1a69cd66-1183-4b71-9b44-c1b0b4509ad6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.156340 Nov 02 14:58:01.130831 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4095/8565] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:58:00 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:02.152744 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:02.153344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:02.160430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:02.160912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:02.161354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:02.162048 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:02.162504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:02.162934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:02.302345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:02.310406 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-2006950e-d729-4541-8771-7b506c42b9a6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.161647 Nov 02 14:58:02.311149 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4471/8566] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:58:02 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:03.333837 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:03.334464 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:03.341438 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:03.341936 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:03.342388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:03.343219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:03.343601 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:03.344048 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:03.477482 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:03.486606 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1744932c-73bf-4042-b41e-4a7efb9de4d6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.156790 Nov 02 14:58:03.487225 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4096/8567] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:58:03 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:04.510308 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:04.510861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:04.517868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:04.518353 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:04.518791 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:04.519519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:04.520003 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:04.520431 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:04.652740 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:04.661146 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-149b8bd2-7aa2-4d09-a6ee-d9a71bbcea6d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.154883 Nov 02 14:58:04.661729 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4472/8568] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:58:04 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:05.684706 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:05.685332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:05.692796 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:05.693292 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:05.693742 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:05.694457 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:05.694923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:05.695389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:05.831662 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:05.839386 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e7afba39-3907-4160-aa3c-56e0222cc322 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.158718 Nov 02 14:58:05.839957 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4097/8569] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:58:05 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:06.863507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:06.864042 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:06.870789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:06.871374 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:06.871812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:06.872500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:06.872949 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:06.873376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:07.001913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:07.009756 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-af2e32e8-4d09-4e28-af0e-5429c4da6ad0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.151215 Nov 02 14:58:07.010338 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4473/8570] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:58:06 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:07.623184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-44c1812d-bdb9-44b3-9b57-df3384068571 req-da1d0b3e-17c0-4abc-b197-bc2c2de08c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23d5313-bd7b-45b0-b246-e360b2a06214", "name": "network-vif-plugged", "status": "completed", "tag": "2131d039-363c-4cfc-8ed6-e112841a6dd8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:58:07.634180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-44c1812d-bdb9-44b3-9b57-df3384068571 req-da1d0b3e-17c0-4abc-b197-bc2c2de08c9c service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:07.634683 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-44c1812d-bdb9-44b3-9b57-df3384068571 req-da1d0b3e-17c0-4abc-b197-bc2c2de08c9c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:07.635154 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-44c1812d-bdb9-44b3-9b57-df3384068571 req-da1d0b3e-17c0-4abc-b197-bc2c2de08c9c service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:07.647030 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-44c1812d-bdb9-44b3-9b57-df3384068571 req-da1d0b3e-17c0-4abc-b197-bc2c2de08c9c service nova] Creating event network-vif-plugged:2131d039-363c-4cfc-8ed6-e112841a6dd8 for instance e23d5313-bd7b-45b0-b246-e360b2a06214 on n-h2-858384-19 Nov 02 14:58:07.652030 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-44c1812d-bdb9-44b3-9b57-df3384068571 req-da1d0b3e-17c0-4abc-b197-bc2c2de08c9c service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032729 Nov 02 14:58:07.652632 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4098/8571] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 14:58:08.033864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:08.034489 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:08.041678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:08.042174 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:08.042626 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:08.043368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:08.043831 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:08.044268 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:08.177874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:08.185594 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7d8e7b4b-8e7d-44ad-9cc4-e50db3aefbe7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1263 microversion: 2.1 time: 0.156240 Nov 02 14:58:08.186188 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4474/8572] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:58:08 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:09.209948 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:09.210610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:09.217148 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:09.218186 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:09.218671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:09.219532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:09.220054 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:09.220494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:09.360256 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:09.368185 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5f42eeb7-2a6e-40c7-aad6-31bbae1d6409 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1448 microversion: 2.1 time: 0.163611 Nov 02 14:58:09.368765 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4099/8573] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:58:09 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 14:58:09.391371 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 14:58:09.392594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 14:58:09.399595 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:09.400076 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:09.400511 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:09.401199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:09.401648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:09.402080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:09.539501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 14:58:09.548054 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-922108a0-2be7-4fde-b83d-47588b631901 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1448 microversion: 2.1 time: 0.160740 Nov 02 14:58:09.548676 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4475/8574] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 14:58:09 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 14:58:11.497079 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3dbb322d-53c8-4471-bae4-7342c725db46 req-d43c004b-fd83-48a9-8ebd-01913cae7b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23d5313-bd7b-45b0-b246-e360b2a06214", "tag": "2131d039-363c-4cfc-8ed6-e112841a6dd8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 14:58:11.507348 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3dbb322d-53c8-4471-bae4-7342c725db46 req-d43c004b-fd83-48a9-8ebd-01913cae7b6e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 14:58:11.507836 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3dbb322d-53c8-4471-bae4-7342c725db46 req-d43c004b-fd83-48a9-8ebd-01913cae7b6e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 14:58:11.508274 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3dbb322d-53c8-4471-bae4-7342c725db46 req-d43c004b-fd83-48a9-8ebd-01913cae7b6e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 14:58:11.519551 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3dbb322d-53c8-4471-bae4-7342c725db46 req-d43c004b-fd83-48a9-8ebd-01913cae7b6e service nova] Creating event network-changed:2131d039-363c-4cfc-8ed6-e112841a6dd8 for instance e23d5313-bd7b-45b0-b246-e360b2a06214 on n-h2-858384-19 Nov 02 14:58:11.525002 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3dbb322d-53c8-4471-bae4-7342c725db46 req-d43c004b-fd83-48a9-8ebd-01913cae7b6e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031419 Nov 02 14:58:11.525607 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4100/8575] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 14:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:00:09.148469 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:00:09.149639 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:00:09.150202 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=24 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:09.150940 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=60 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:09.151963 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:00:09.152171 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 15:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214/action (ip 10.222.0.113) !!! Nov 02 15:00:09.153231 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:00:09.153384 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 15:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214/action (ip 10.222.0.113) !!! Nov 02 15:00:09.159253 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:00:09.159792 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:09.168553 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:09.168971 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:09.169406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:09.170095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:09.170542 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:09.170966 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:09.194522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lazy-loading 'flavor' on Instance uuid e23d5313-bd7b-45b0-b246-e360b2a06214 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 15:00:09.267663 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7f7f999f-6447-4e36-868d-f1c37d1df808 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "POST /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214/action" status: 202 len: 0 microversion: 2.1 time: 0.120686 Nov 02 15:00:09.268284 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4476/8576] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 15:00:09 2022] POST /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:00:09.275677 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:00:09.276516 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:00:09.277225 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:09.278052 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=56 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:09.278970 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:00:09.279251 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 15:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 (ip 10.222.0.113) !!! Nov 02 15:00:09.280745 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:00:09.280745 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 15:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 (ip 10.222.0.113) !!! Nov 02 15:00:09.289918 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:09.290649 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:09.306544 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:09.307067 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:09.307546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:09.308277 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:09.308754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:09.309205 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:09.551686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:09.560918 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-62c698e1-add0-41a5-a46e-57f64816b44e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.287156 Nov 02 15:00:09.561391 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4101/8577] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:09 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:10.587201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:10.587913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:10.602068 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 47510. Nov 02 15:00:10.606640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:10.607150 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:10.607594 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:10.608318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:10.608754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:10.609189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:10.613714 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 47512. Nov 02 15:00:10.830872 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:10.838775 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-444f6b25-6575-41a1-951a-e5542eb6286d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.256963 Nov 02 15:00:10.839369 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4477/8578] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:10 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:11.862413 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:11.863568 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:11.872630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:11.873133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:11.873586 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:11.874303 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:11.874770 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:11.875239 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:11.884750 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 47522. Nov 02 15:00:11.894902 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 47520. Nov 02 15:00:12.013329 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:12.021228 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c16ac8d4-5574-4cae-9d3e-001091cfb51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.162914 Nov 02 15:00:12.021812 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4102/8579] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:11 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:13.045069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:13.045659 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:13.052475 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:13.052952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:13.053384 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:13.054067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:13.054516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:13.054948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:13.185142 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:13.193391 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-67c8acf5-5f7a-413a-af86-c4244215cfc9 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.152284 Nov 02 15:00:13.193980 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4478/8580] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:13 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:14.217638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:14.218342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:14.226245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:14.226792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:14.227375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:14.228477 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:14.229017 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:14.229547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:14.366722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:14.374428 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-98d0e142-dec6-42a0-9f62-073e2180da4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.160787 Nov 02 15:00:14.375022 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4103/8581] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:14 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:15.397333 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:15.397979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:15.404876 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:15.405357 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:15.405799 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:15.406493 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:15.406948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:15.407405 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:15.540000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:15.547779 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-43716936-8959-4119-a164-b79057f3df27 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.155001 Nov 02 15:00:15.548366 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4479/8582] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:15 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:16.572086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:16.572703 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:16.579523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:16.580016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:16.580461 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:16.581163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:16.581626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:16.582065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:16.715887 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:16.724268 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e60d121e-cd3d-4df0-bb54-9be62e8fd982 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.156369 Nov 02 15:00:16.724859 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4104/8583] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:16 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:17.747866 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:17.748484 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:17.755424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:17.755907 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:17.756348 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:17.757061 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:17.757496 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:17.757926 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:17.892287 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:17.901241 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0afd7cdc-6686-4fec-8ff8-2ea6bd264deb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.157269 Nov 02 15:00:17.901829 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4480/8584] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:17 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:18.924967 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:18.925605 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:18.932981 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:18.933486 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:18.933946 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:18.934655 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:18.935195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:18.935642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:19.068440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:19.076939 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1c8650d5-6a3a-466c-93d5-08730369a913 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.155935 Nov 02 15:00:19.077510 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4105/8585] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:18 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:20.100892 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:20.101580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:20.108721 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:20.109206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:20.109648 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:20.110345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:20.110800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:20.111259 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:20.243830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:20.251716 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-dc3eb4e7-c25a-4dad-9942-496aba23b8b0 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.155631 Nov 02 15:00:20.252306 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4481/8586] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:20 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:21.276475 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:21.277118 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:21.284151 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:21.284650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:21.285108 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:21.287071 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:21.287592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:21.288036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:21.424106 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:21.431790 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d3e38285-68c5-432d-b9ec-0f0decaf69c2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.159282 Nov 02 15:00:21.432508 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4106/8587] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:21 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:22.455195 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:22.455828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:22.463433 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:22.463913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:22.464346 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:22.465045 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:22.465494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:22.465918 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:22.604234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:22.612106 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4d45eaa2-9c1f-4f8e-a975-5f267ca0eef6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.161035 Nov 02 15:00:22.612694 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4482/8588] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:22 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:23.636229 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:23.636894 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:23.644284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:23.645097 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:23.645628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:23.645628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:23.645628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:23.645628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:23.793974 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:23.802332 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-06d579ad-e5ae-4c30-ade3-40daa5d55564 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1513 microversion: 2.1 time: 0.170128 Nov 02 15:00:23.802914 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4107/8589] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:23 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:23.825340 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:00:23.825874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:23.833080 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:23.833566 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:23.834091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:23.834800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:23.835290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:23.835725 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:23.923345 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120928) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Nov 02 15:00:23.993098 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-57db7d31-cb33-45ea-9b8f-7b0ae2ff99f8 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "POST /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214/action" status: 202 len: 0 microversion: 2.1 time: 0.171756 Nov 02 15:00:23.993746 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4483/8590] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 15:00:23 2022] POST /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:00:24.002244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:24.002885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:24.009604 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:24.010119 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:24.010574 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:24.011324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:24.011801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:24.012249 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:24.213504 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:24.221971 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-8e2ca51a-7f07-49fb-b469-ae3d78cf8cb7 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1521 microversion: 2.1 time: 0.223952 Nov 02 15:00:24.223406 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4108/8591] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:23 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:00:24.291592 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-f6544317-fad0-4216-bec9-059ee61a1ff2 req-93589981-0a85-4513-ad53-f16349166eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23d5313-bd7b-45b0-b246-e360b2a06214", "name": "network-vif-unplugged", "status": "completed", "tag": "2131d039-363c-4cfc-8ed6-e112841a6dd8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:00:24.301982 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f6544317-fad0-4216-bec9-059ee61a1ff2 req-93589981-0a85-4513-ad53-f16349166eed service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:24.302469 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f6544317-fad0-4216-bec9-059ee61a1ff2 req-93589981-0a85-4513-ad53-f16349166eed service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:24.303100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-f6544317-fad0-4216-bec9-059ee61a1ff2 req-93589981-0a85-4513-ad53-f16349166eed service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:24.317312 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.compute.server_external_events [req-f6544317-fad0-4216-bec9-059ee61a1ff2 req-93589981-0a85-4513-ad53-f16349166eed service nova] Unable to find a host for instance e23d5313-bd7b-45b0-b246-e360b2a06214. Dropping event network-vif-unplugged {{(pid=120928) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 15:00:24.318262 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-f6544317-fad0-4216-bec9-059ee61a1ff2 req-93589981-0a85-4513-ad53-f16349166eed service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030576 Nov 02 15:00:24.319153 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4484/8592] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 15:00:25.247330 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:25.247907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:25.254790 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:25.255335 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:25.255792 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:25.256503 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:25.256976 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:25.257421 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:25.394092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:25.402775 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-92759a0c-0209-453f-a366-f8098c2be51e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1523 microversion: 2.1 time: 0.159533 Nov 02 15:00:25.403426 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4109/8593] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:25 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:26.427261 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:26.427869 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:26.434816 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:26.435354 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:26.435800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:26.436508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:26.436969 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:26.437436 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:26.577201 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:26.585676 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c40bb5b-2213-4a7d-9f03-621d4c8af7be tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1523 microversion: 2.1 time: 0.162806 Nov 02 15:00:26.586250 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4485/8594] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:26 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:00:27.609650 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:27.610412 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:27.618244 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:27.618788 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:27.619220 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:27.619931 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:27.620396 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:27.620832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:27.761345 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:27.771287 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-530d13ba-994f-4eb1-bdcb-20bf674d388e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1523 microversion: 2.1 time: 0.164866 Nov 02 15:00:27.772030 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4110/8595] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:27 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:28.795100 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:28.795868 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:28.802858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:28.803375 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:28.803821 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:28.804522 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:28.804979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:28.805413 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:28.939908 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:28.947908 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-57ae1588-cb37-4aaf-96f4-49c410ab2452 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1523 microversion: 2.1 time: 0.156820 Nov 02 15:00:28.948493 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4486/8596] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:28 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:29.973656 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:29.974263 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:29.981218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:29.981710 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:29.982166 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:29.982863 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:29.983359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:29.983797 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:30.118937 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:30.127144 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-daafc05f-a2d1-4ae5-b714-af7cdca866f2 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.158323 Nov 02 15:00:30.127744 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4111/8597] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:29 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:31.023851 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-44072830-3320-4567-8820-e0d22ad11373 req-656fc9bc-5394-4e96-8f20-86c4e8925497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23d5313-bd7b-45b0-b246-e360b2a06214", "tag": "2131d039-363c-4cfc-8ed6-e112841a6dd8"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:00:31.033697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-44072830-3320-4567-8820-e0d22ad11373 req-656fc9bc-5394-4e96-8f20-86c4e8925497 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:31.034186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-44072830-3320-4567-8820-e0d22ad11373 req-656fc9bc-5394-4e96-8f20-86c4e8925497 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:31.034623 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-44072830-3320-4567-8820-e0d22ad11373 req-656fc9bc-5394-4e96-8f20-86c4e8925497 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:31.046543 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-44072830-3320-4567-8820-e0d22ad11373 req-656fc9bc-5394-4e96-8f20-86c4e8925497 service nova] Creating event network-changed:2131d039-363c-4cfc-8ed6-e112841a6dd8 for instance e23d5313-bd7b-45b0-b246-e360b2a06214 on n-h1-858384-19 Nov 02 15:00:31.051850 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-44072830-3320-4567-8820-e0d22ad11373 req-656fc9bc-5394-4e96-8f20-86c4e8925497 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085873 Nov 02 15:00:31.052468 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4487/8598] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 15:00:31.150524 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:31.151183 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:31.158016 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:31.158516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:31.158971 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:31.159793 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:31.160831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:31.161278 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:31.298569 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:31.307780 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-18e7c0a9-cdf4-49c6-a57e-24c89017d343 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.161141 Nov 02 15:00:31.308397 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4112/8599] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:31 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:32.333379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:32.334094 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:32.340344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:32.340832 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:32.341276 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:32.341976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:32.342438 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:32.342873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:32.472693 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:32.480829 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b3eceae8-6467-4b3a-871f-4729b55645bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.153765 Nov 02 15:00:32.481411 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4488/8600] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:32 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:33.504727 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:33.505359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:33.512279 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:33.512775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:33.513231 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:33.513939 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:33.514404 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:33.514844 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:33.649528 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:33.657316 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d0629d53-f55f-4665-bf13-a60ceeead242 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.156671 Nov 02 15:00:33.657894 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4113/8601] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:33 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:34.681379 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:34.682000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:34.688934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:34.689421 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:34.689863 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:34.690567 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:34.691027 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:34.691912 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:34.828550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:34.837002 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b9793a73-714b-4554-adfc-be70bdc24af3 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.159592 Nov 02 15:00:34.837588 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4489/8602] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:34 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:35.860953 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:35.861532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:35.868997 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:35.869500 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:35.869958 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:35.870678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:35.871180 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:35.871633 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:36.008666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:36.016541 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b7397d30-6982-44d1-bc4d-6986f0b09682 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.159646 Nov 02 15:00:36.017116 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4114/8603] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:35 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:37.039970 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:37.040607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:37.047472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:37.047948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:37.048386 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:37.049068 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:37.049516 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:37.049939 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:37.182083 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:37.185685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:37.190783 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-445bb0cf-817d-4ceb-94e6-b85903bca81b tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.154765 Nov 02 15:00:37.192167 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4490/8604] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:37 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:38.214678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:38.215337 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:38.222757 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:38.223285 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:38.223737 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:38.224444 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:38.224913 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:38.225357 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:38.364701 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:38.372522 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-40303ef5-9860-4151-9c62-693cd8fcf2bf tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.161783 Nov 02 15:00:38.373116 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4115/8605] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:38 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:39.396158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:39.396763 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:39.400149 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:39.406449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:39.407092 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:39.407559 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:39.408255 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:39.408706 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:39.409133 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:39.546303 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:39.554353 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0367bbbe-15b5-4227-b6c4-c17faa72be22 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.162647 Nov 02 15:00:39.555224 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4491/8606] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:39 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:40.577675 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:40.578206 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:40.580915 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=31 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:40.586625 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:40.587130 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:40.587591 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:40.588288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:40.588751 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:40.589184 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:40.591760 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=91 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:00:40.721630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:40.730197 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c1584edc-ffe4-482e-b41d-0124190dab76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.156698 Nov 02 15:00:40.730770 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4116/8607] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:40 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:41.754392 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:41.754998 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:41.761864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:41.762494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:41.762934 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:41.763655 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:41.764110 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:41.764563 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:41.897709 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:41.905441 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-66333cb4-9ce7-41a4-ae89-8a653981a63d tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.155174 Nov 02 15:00:41.906014 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4492/8608] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:41 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:42.929521 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:42.930222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:42.937157 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:42.937673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:42.938131 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:42.938853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:42.939355 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:42.939801 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:43.074021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:43.082571 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-120818a8-3883-481e-8011-d944b5feaf76 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.157656 Nov 02 15:00:43.083171 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4117/8609] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:42 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:44.106105 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:44.106710 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:44.113645 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:44.114117 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:44.114549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:44.115263 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:44.115715 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:44.116137 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:44.251857 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:44.260664 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a0675195-f63d-42db-8984-f7b1dcd725bd tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.158763 Nov 02 15:00:44.261279 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4493/8610] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:44 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:44.287764 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7b02e172-406f-4838-8f9d-8c1d4895a271 req-ab943721-99fd-4984-b20e-9101fb9b0e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23d5313-bd7b-45b0-b246-e360b2a06214", "name": "network-vif-plugged", "status": "completed", "tag": "2131d039-363c-4cfc-8ed6-e112841a6dd8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:00:44.298332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7b02e172-406f-4838-8f9d-8c1d4895a271 req-ab943721-99fd-4984-b20e-9101fb9b0e4f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:44.298896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7b02e172-406f-4838-8f9d-8c1d4895a271 req-ab943721-99fd-4984-b20e-9101fb9b0e4f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:44.299386 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7b02e172-406f-4838-8f9d-8c1d4895a271 req-ab943721-99fd-4984-b20e-9101fb9b0e4f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:44.311099 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7b02e172-406f-4838-8f9d-8c1d4895a271 req-ab943721-99fd-4984-b20e-9101fb9b0e4f service nova] Creating event network-vif-plugged:2131d039-363c-4cfc-8ed6-e112841a6dd8 for instance e23d5313-bd7b-45b0-b246-e360b2a06214 on n-h1-858384-19 Nov 02 15:00:44.317004 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7b02e172-406f-4838-8f9d-8c1d4895a271 req-ab943721-99fd-4984-b20e-9101fb9b0e4f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032986 Nov 02 15:00:44.317619 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4118/8611] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:00:45.286229 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:45.286915 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:45.293804 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:45.294290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:45.294738 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:45.295486 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:45.295947 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:45.296381 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:45.426062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:45.433889 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-9e37a1ae-009d-4ad4-88a8-8c907fc95bd5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1579 microversion: 2.1 time: 0.152588 Nov 02 15:00:45.434467 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4494/8612] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:45 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:00:46.459066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:00:46.459804 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:00:46.465897 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:46.466387 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:46.466835 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:46.467567 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:00:46.468032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:00:46.468467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:00:46.601775 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:00:46.609903 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-acd610ef-e90f-464c-8b30-2dd1d04ec1cb tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1566 microversion: 2.1 time: 0.156073 Nov 02 15:00:46.610482 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4119/8613] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:00:46 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:02.972540 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=7 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:02.974099 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=24 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:02.975705 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:02:02.975867 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 15:02:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 (ip 10.222.0.113) !!! Nov 02 15:02:02.979267 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4c0f20f6-e2a8-4915-bbc4-2060fe993ed0 req-83e861ea-feb4-4a24-90f0-f2f0f27df219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e23d5313-bd7b-45b0-b246-e360b2a06214", "tag": "2131d039-363c-4cfc-8ed6-e112841a6dd8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:02.982329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:02.982893 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:02.985455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=7 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:02.987901 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=19 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:02.995975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:02.996466 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:02.996909 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:02.997619 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:02.998075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:02.998504 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:02.999832 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4c0f20f6-e2a8-4915-bbc4-2060fe993ed0 req-83e861ea-feb4-4a24-90f0-f2f0f27df219 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:03.000620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4c0f20f6-e2a8-4915-bbc4-2060fe993ed0 req-83e861ea-feb4-4a24-90f0-f2f0f27df219 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:03.001266 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4c0f20f6-e2a8-4915-bbc4-2060fe993ed0 req-83e861ea-feb4-4a24-90f0-f2f0f27df219 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:03.015050 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4c0f20f6-e2a8-4915-bbc4-2060fe993ed0 req-83e861ea-feb4-4a24-90f0-f2f0f27df219 service nova] Creating event network-changed:2131d039-363c-4cfc-8ed6-e112841a6dd8 for instance e23d5313-bd7b-45b0-b246-e360b2a06214 on n-h1-858384-19 Nov 02 15:02:03.021209 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4c0f20f6-e2a8-4915-bbc4-2060fe993ed0 req-83e861ea-feb4-4a24-90f0-f2f0f27df219 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048737 Nov 02 15:02:03.022459 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4120/8614] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 15:02:03.026624 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 15:02:03.113286 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-1da65571-6a62-47f5-9461-ab9d98a80e25 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "DELETE /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 204 len: 0 microversion: 2.1 time: 0.142489 Nov 02 15:02:03.114122 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4495/8615] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 15:02:02 2022] DELETE /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 15:02:03.123162 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:03.123896 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:03.131091 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:03.131858 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:03.132312 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:03.133031 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:03.133673 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:03.134293 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:03.270648 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:03.278736 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1338e3f7-b0f5-4535-9cc4-132f3ca8b2fa tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.160350 Nov 02 15:02:03.279436 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4121/8616] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:03 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:04.305362 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:04.306075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:04.313935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:04.314425 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:04.314874 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:04.315604 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:04.316067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:04.316501 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:04.496925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:04.505375 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-b84619ae-d87b-4453-b169-e35b531e5ed5 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1572 microversion: 2.1 time: 0.205096 Nov 02 15:02:04.505959 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4496/8617] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:04 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1572 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:05.393638 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-6c60ef8b-bd5f-43b8-b5b8-962d150fc3d5 req-fb0e90c3-3054-4399-abbd-66dc871df437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e23d5313-bd7b-45b0-b246-e360b2a06214", "name": "network-vif-deleted", "tag": "2131d039-363c-4cfc-8ed6-e112841a6dd8"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:05.404730 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6c60ef8b-bd5f-43b8-b5b8-962d150fc3d5 req-fb0e90c3-3054-4399-abbd-66dc871df437 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:05.405222 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6c60ef8b-bd5f-43b8-b5b8-962d150fc3d5 req-fb0e90c3-3054-4399-abbd-66dc871df437 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:05.406243 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-6c60ef8b-bd5f-43b8-b5b8-962d150fc3d5 req-fb0e90c3-3054-4399-abbd-66dc871df437 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:05.417969 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-6c60ef8b-bd5f-43b8-b5b8-962d150fc3d5 req-fb0e90c3-3054-4399-abbd-66dc871df437 service nova] Creating event network-vif-deleted:2131d039-363c-4cfc-8ed6-e112841a6dd8 for instance e23d5313-bd7b-45b0-b246-e360b2a06214 on n-h1-858384-19 Nov 02 15:02:05.424029 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-6c60ef8b-bd5f-43b8-b5b8-962d150fc3d5 req-fb0e90c3-3054-4399-abbd-66dc871df437 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034551 Nov 02 15:02:05.424633 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4122/8618] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:02:05.529609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:05.530223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:05.537596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:05.538091 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:05.538538 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:05.539275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:05.539729 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:05.540156 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:05.603771 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:05.611921 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-06461004-7b85-4e95-9d7f-a3bba78cdf4e tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1223 microversion: 2.1 time: 0.086376 Nov 02 15:02:05.612509 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4497/8619] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:05 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:06.635442 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:06.636165 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:06.643060 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:06.643588 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:06.644045 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:06.644761 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:06.645232 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:06.645677 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:06.712630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:06.721492 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-90b8ec13-9d76-4f42-9c5b-4ee181f910f6 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1223 microversion: 2.1 time: 0.091365 Nov 02 15:02:06.722081 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4123/8620] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:06 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:07.745965 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:07.746596 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:07.754430 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:07.754920 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:07.755394 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:07.756109 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:07.756569 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:07.757001 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:07.828922 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:07.837440 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5f6c6f06-7b30-49d3-9e14-0f4ce4097b63 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1223 microversion: 2.1 time: 0.095244 Nov 02 15:02:07.837912 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4498/8621] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:07 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:08.862678 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:08.864440 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:08.872209 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:08.872949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:08.873856 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:08.875922 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:08.876642 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:08.877819 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:08.949954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:08.958533 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-b0fccc73-c42e-4e9e-9451-777f92882a55 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1223 microversion: 2.1 time: 0.101987 Nov 02 15:02:08.959135 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4124/8622] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:08 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:09.982418 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:09.982990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:09.990625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:09.991145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:09.991597 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:09.992946 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:09.993575 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:09.993846 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:10.027692 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:10.028189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:10.028640 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:10.029096 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.objects.instance [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lazy-loading 'fault' on Instance uuid e23d5313-bd7b-45b0-b246-e360b2a06214 {{(pid=120928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 15:02:10.081062 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f44583a4b346e09a6301e1f405d1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3dfb2b8d0f4798b712bad7edc94410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:10.094578 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-6538c5af-7ff3-426c-be0e-c5e4ad4bb35c tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 200 len: 1228 microversion: 2.1 time: 0.114608 Nov 02 15:02:10.097417 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4499/8623] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:09 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 1228 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:11.121666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:11.122317 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] [instance: e23d5313-bd7b-45b0-b246-e360b2a06214] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:11.130046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:11.130547 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:11.131001 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:11.131745 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:11.132216 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:11.132659 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:11.146526 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] HTTP exception thrown: Instance e23d5313-bd7b-45b0-b246-e360b2a06214 could not be found. Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Request method failure captured: Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 HTTP/1.1 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYoQPQFhPhXPCarySqm8SQ_-bDxr5hoTdjPo4jmn8hj-07weMS_NAgvZQ72UWdDOs0EgeKyNOVjcm8d0FOHRb6j73lC4hglYqPCyUt1o_Eh_XsXvxgg8nNuXlPI3-NzGksD0bg9nOFDFLvC3O8USaIWcdwRW1E2n-nyUNpKBIDh9V6ms Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: 3f3dfb2b8d0f4798b712bad7edc94410 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestShelveInstance-801972837 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f3dfb2b8d0f4798b712bad7edc94410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/3f3dfb2b8d0f4798b712bad7edc94410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_3f3dfb2b8d0f4798b712bad7edc94410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/3f3dfb2b8d0f4798b712bad7edc94410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestShelveInstance-801972837 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: 3f3dfb2b8d0f4798b712bad7edc94410 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestShelveInstance-801972837 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestShelveInstance-801972837-project Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: 69f44583a4b346e09a6301e1f405d1a8 Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestShelveInstance-801972837-project Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance e23d5313-bd7b-45b0-b246-e360b2a06214 could not be found. Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': 'e23d5313-bd7b-45b0-b246-e360b2a06214'} Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e23d5313-bd7b-45b0-b246-e360b2a06214 could not be found. Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e23d5313-bd7b-45b0-b246-e360b2a06214 could not be found. Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:02:11.148235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e23d5313-bd7b-45b0-b246-e360b2a06214 could not be found. Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Returning 404 to user: Instance e23d5313-bd7b-45b0-b246-e360b2a06214 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-168c8d10-5d0a-42a6-93e4-99dccc04b789 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214" status: 404 len: 111 microversion: 2.1 time: 0.032027 Nov 02 15:02:11.153508 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4125/8624] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:11 2022] GET /compute/v2.1/servers/e23d5313-bd7b-45b0-b246-e360b2a06214 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 15:02:11.319704 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-8e5a988d-c798-4bf7-b5cd-7bfbbd7965f1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] Calling method '.version_select at 0x7fe78739edc0>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:11.347950 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-8e5a988d-c798-4bf7-b5cd-7bfbbd7965f1 tempest-TestShelveInstance-801972837 tempest-TestShelveInstance-801972837-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1020357883" status: 202 len: 0 microversion: 2.1 time: 0.032560 Nov 02 15:02:11.348571 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4500/8625] 10.222.0.113 () {58 vars in 1259 bytes} [Wed Nov 2 15:02:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1020357883 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 15:02:29.480709 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=12 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:29.481467 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=24 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:29.712390 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-4b467665-22ec-4cdc-9970-9241fbe09892 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Action: 'create', calling method: .version_select at 0x7fe78fa861f0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1278928886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd4bcMiurdp0hdBvg/vkjjop3iQq0K5WzH+jIQb/mzLF5gF/kriaoZByeNY9mr55ntDYYY+/E3ARD8YaziNOeeZX1T+WWBvZTna2TPcmilFhAgHatKIyP1bjLkq8AUQ1A=="}} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:29.731722 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4b467665-22ec-4cdc-9970-9241fbe09892 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Getting quotas for project a091d04f4cd84e13935eb27c38d09d5c. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:02:29.738193 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.quota [None req-4b467665-22ec-4cdc-9970-9241fbe09892 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Getting quotas for user d4eca8d5f6ff45bb8b99faa3eb86373a and project a091d04f4cd84e13935eb27c38d09d5c. Resources: {'key_pairs'} {{(pid=120929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:02:29.768861 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-4b467665-22ec-4cdc-9970-9241fbe09892 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.293947 Nov 02 15:02:29.775864 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4126/8626] 10.222.0.113 () {60 vars in 1164 bytes} [Wed Nov 2 15:02:29 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:02:30.772719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:30.774508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:30.779808 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1926298550", "imageRef": "c691e80e-3ff7-4224-8e34-80d276ecc1b1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1278928886", "security_groups": [{"name": "tempest-secgroup-smoke-1416534237"}], "networks": [{"uuid": "94381356-b05d-452c-85d9-8c3af7c93614"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:30.902423 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] validate_networks() for [('94381356-b05d-452c-85d9-8c3af7c93614', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 15:02:31.302075 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 15:02:31.302512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 15:02:31.302995 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 15:02:31.303448 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 15:02:31.303873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 15:02:31.313558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:31.314049 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:31.314499 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:31.315264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:31.315757 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:31.316193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:31.334494 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Getting quotas for project a091d04f4cd84e13935eb27c38d09d5c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:02:31.339933 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Getting quotas for user d4eca8d5f6ff45bb8b99faa3eb86373a and project a091d04f4cd84e13935eb27c38d09d5c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:02:31.353898 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 15:02:31.356336 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c691e80e-3ff7-4224-8e34-80d276ecc1b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 15:02:31.406402 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e484e206-66d7-4faa-b287-bfcfc0b2005a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.637314 Nov 02 15:02:31.407338 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4501/8627] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 15:02:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 15:02:31.419359 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e54e0646-0ca1-4946-a967-632b89da1c0d tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:31.419924 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e54e0646-0ca1-4946-a967-632b89da1c0d tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:31.477536 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e54e0646-0ca1-4946-a967-632b89da1c0d tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:31.485083 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e54e0646-0ca1-4946-a967-632b89da1c0d tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1253 microversion: 2.1 time: 0.070786 Nov 02 15:02:31.485671 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4127/8628] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:31 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1253 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:32.522219 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:32.522889 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:32.539875 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:32.540372 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:32.540813 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:32.541533 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:32.542147 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:32.543018 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:32.635827 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:32.646705 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-f9b2c8bd-f889-402b-8cc2-d47865ab8eac tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1305 microversion: 2.1 time: 0.137357 Nov 02 15:02:32.647417 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4502/8629] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:32 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1305 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:33.672556 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:33.673290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:33.680291 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:33.683831 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:33.684388 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:33.685219 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:33.686288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:33.687245 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:33.827288 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:33.836060 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-22c22904-2223-48e3-b94f-889616e5e8ba tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1379 microversion: 2.1 time: 0.167533 Nov 02 15:02:33.836943 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4128/8630] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:33 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1379 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:34.122331 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [req-6aa93790-8652-4834-8f2b-769f1133ee4d req-d07822fc-212f-4dce-9ed3-ecb82c1c6aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6cdc1a6-4bae-4959-93e2-c57a348494cf", "tag": "b4090a2a-1f1c-44d0-99b7-a2852b940d62"}]} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:34.133356 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6aa93790-8652-4834-8f2b-769f1133ee4d req-d07822fc-212f-4dce-9ed3-ecb82c1c6aac service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:34.133957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6aa93790-8652-4834-8f2b-769f1133ee4d req-d07822fc-212f-4dce-9ed3-ecb82c1c6aac service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:34.134443 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [req-6aa93790-8652-4834-8f2b-769f1133ee4d req-d07822fc-212f-4dce-9ed3-ecb82c1c6aac service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:34.149537 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.compute.server_external_events [req-6aa93790-8652-4834-8f2b-769f1133ee4d req-d07822fc-212f-4dce-9ed3-ecb82c1c6aac service nova] Creating event network-changed:b4090a2a-1f1c-44d0-99b7-a2852b940d62 for instance a6cdc1a6-4bae-4959-93e2-c57a348494cf on n-h2-858384-19 Nov 02 15:02:34.155356 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [req-6aa93790-8652-4834-8f2b-769f1133ee4d req-d07822fc-212f-4dce-9ed3-ecb82c1c6aac service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037870 Nov 02 15:02:34.156078 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4503/8631] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:02:34.861780 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:34.862564 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:34.869393 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:34.869890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:34.870342 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:34.871065 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:34.871560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:34.871998 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:35.012169 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:35.020475 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-1cf472a8-047e-48be-aba7-927ca43cc65e tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1379 microversion: 2.1 time: 0.163689 Nov 02 15:02:35.021057 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4129/8632] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:34 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1379 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:36.045653 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:36.046508 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:36.052762 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:36.053256 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:36.053697 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:36.054395 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:36.054850 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:36.055318 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:36.187986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:36.195676 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-95e3c0c3-feb3-440b-aebf-76ee804b8661 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1379 microversion: 2.1 time: 0.155182 Nov 02 15:02:36.196263 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4504/8633] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:36 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1379 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:37.219957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:37.220595 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:37.227630 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:37.228405 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:37.228862 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:37.229587 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:37.230066 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:37.230546 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:37.365290 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:37.373434 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f9827556-aceb-40d1-afef-e00da892afe2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1379 microversion: 2.1 time: 0.158268 Nov 02 15:02:37.374678 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4130/8634] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:37 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1379 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:38.397315 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:38.397864 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:38.404718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:38.405703 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:38.406135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:38.406815 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:38.407291 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:38.407718 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:38.542067 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:38.550035 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-eba78049-9b0c-4ffc-b855-db9f492530c5 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1379 microversion: 2.1 time: 0.156668 Nov 02 15:02:38.550633 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4505/8635] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:38 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1379 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:39.573197 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:39.573830 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:39.581446 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:39.581943 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:39.582397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:39.583105 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:39.583598 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:39.584046 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:39.727102 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:39.736218 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-cd2816fa-9f84-4d1a-956c-feff7c452d96 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1379 microversion: 2.1 time: 0.167021 Nov 02 15:02:39.736813 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4131/8636] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:39 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1379 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:40.760309 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:40.760925 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:40.767240 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:40.767726 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:40.768164 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:40.768867 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:40.769451 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:40.769856 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:40.901479 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-0e4cae2f-e850-4db7-85c2-f75422830173 req-092c72e2-fade-4449-b840-8df71f3c01aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6cdc1a6-4bae-4959-93e2-c57a348494cf", "name": "network-vif-plugged", "status": "completed", "tag": "b4090a2a-1f1c-44d0-99b7-a2852b940d62"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:40.912324 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0e4cae2f-e850-4db7-85c2-f75422830173 req-092c72e2-fade-4449-b840-8df71f3c01aa service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:40.912827 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0e4cae2f-e850-4db7-85c2-f75422830173 req-092c72e2-fade-4449-b840-8df71f3c01aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:40.913275 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-0e4cae2f-e850-4db7-85c2-f75422830173 req-092c72e2-fade-4449-b840-8df71f3c01aa service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:40.918905 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:40.925396 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-0e4cae2f-e850-4db7-85c2-f75422830173 req-092c72e2-fade-4449-b840-8df71f3c01aa service nova] Creating event network-vif-plugged:b4090a2a-1f1c-44d0-99b7-a2852b940d62 for instance a6cdc1a6-4bae-4959-93e2-c57a348494cf on n-h2-858384-19 Nov 02 15:02:40.927952 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e11e7c5a-ec89-4e3d-8432-7cecb4cff8e1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1379 microversion: 2.1 time: 0.171680 Nov 02 15:02:40.928630 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4506/8637] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:40 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1379 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:40.930582 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-0e4cae2f-e850-4db7-85c2-f75422830173 req-092c72e2-fade-4449-b840-8df71f3c01aa service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095903 Nov 02 15:02:40.931282 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4132/8638] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 15:02:41.952557 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:41.953206 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:41.955223 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:41.955890 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:41.962485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:41.962968 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:41.963441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:41.964140 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:41.964610 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:41.965040 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:42.104183 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:42.112138 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0cc5fd17-c51d-4f3e-b435-ca7e0ba667ff tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1379 microversion: 2.1 time: 0.164129 Nov 02 15:02:42.112738 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4507/8639] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:41 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1379 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:43.132373 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=6 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:02:43.138133 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:43.138853 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:43.145932 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:43.146429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:43.146878 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:43.147623 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:43.148092 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:43.148532 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:43.281284 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:43.289266 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-20f3b020-aaa5-4c81-b839-b581877a68a8 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1564 microversion: 2.1 time: 0.157929 Nov 02 15:02:43.289852 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4133/8640] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:43 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:43.312727 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:02:43.313341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:02:43.320158 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:43.320643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:43.321087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:43.321787 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:43.322242 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:43.322678 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:43.454376 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:02:43.462160 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e16f7339-2bf5-4ed9-b5f7-81d1afa0aa5c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1564 microversion: 2.1 time: 0.154070 Nov 02 15:02:43.462753 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4508/8641] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:02:43 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:02:45.145325 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-27e66fdd-b4e5-4235-8a0f-68dc2fad8d0a req-29be89af-2a73-40e1-ab82-5649639cc6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6cdc1a6-4bae-4959-93e2-c57a348494cf", "tag": "b4090a2a-1f1c-44d0-99b7-a2852b940d62"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:02:45.156218 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-27e66fdd-b4e5-4235-8a0f-68dc2fad8d0a req-29be89af-2a73-40e1-ab82-5649639cc6b5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:02:45.156729 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-27e66fdd-b4e5-4235-8a0f-68dc2fad8d0a req-29be89af-2a73-40e1-ab82-5649639cc6b5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:02:45.157185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-27e66fdd-b4e5-4235-8a0f-68dc2fad8d0a req-29be89af-2a73-40e1-ab82-5649639cc6b5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:02:45.168602 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-27e66fdd-b4e5-4235-8a0f-68dc2fad8d0a req-29be89af-2a73-40e1-ab82-5649639cc6b5 service nova] Creating event network-changed:b4090a2a-1f1c-44d0-99b7-a2852b940d62 for instance a6cdc1a6-4bae-4959-93e2-c57a348494cf on n-h2-858384-19 Nov 02 15:02:45.174133 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-27e66fdd-b4e5-4235-8a0f-68dc2fad8d0a req-29be89af-2a73-40e1-ab82-5649639cc6b5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032535 Nov 02 15:02:45.174915 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4134/8642] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:05:21.839849 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:05:21.840990 n-d-858384-19 devstack@n-api.service[120928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] AMQP server on 10.222.0.113:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 02 15:05:21.841582 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:21.842339 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=40 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:21.843484 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:05:21.843695 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 15:05:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf/action (ip 10.222.0.113) !!! Nov 02 15:05:21.845727 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:05:21.845868 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 15:05:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf/action (ip 10.222.0.113) !!! Nov 02 15:05:21.846931 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:05:21.847050 n-d-858384-19 devstack@n-api.service[120928]: Wed Nov 2 15:05:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf/action (ip 10.222.0.113) !!! Nov 02 15:05:21.853780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-54476f40-78bb-4b61-afbd-03fba06f5759 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-259963530"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:05:21.856228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-54476f40-78bb-4b61-afbd-03fba06f5759 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:21.870299 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54476f40-78bb-4b61-afbd-03fba06f5759 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:21.870789 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54476f40-78bb-4b61-afbd-03fba06f5759 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:21.871264 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54476f40-78bb-4b61-afbd-03fba06f5759 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:21.871979 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54476f40-78bb-4b61-afbd-03fba06f5759 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:21.872441 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54476f40-78bb-4b61-afbd-03fba06f5759 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:21.872880 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-54476f40-78bb-4b61-afbd-03fba06f5759 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:22.227958 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-54476f40-78bb-4b61-afbd-03fba06f5759 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "POST /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf/action" status: 202 len: 0 microversion: 2.1 time: 0.389390 Nov 02 15:05:22.228647 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4509/8643] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 15:05:21 2022] POST /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 15:05:29.759340 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:05:29.760354 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:05:29.761080 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:29.762283 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=34 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:29.763345 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:05:29.763502 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 15:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.113) !!! Nov 02 15:05:29.764589 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 15:05:29.764735 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 15:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.113) !!! Nov 02 15:05:29.766313 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 15:05:29.766313 n-d-858384-19 devstack@n-api.service[120929]: Wed Nov 2 15:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.113) !!! Nov 02 15:05:29.773689 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-bd14cbca-8533-4502-a56f-2a07d141c81d req-2565d17e-3b8c-4211-95c4-65be5cc080fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6cdc1a6-4bae-4959-93e2-c57a348494cf", "name": "network-vif-plugged", "status": "completed", "tag": "b4090a2a-1f1c-44d0-99b7-a2852b940d62"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:05:29.787964 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bd14cbca-8533-4502-a56f-2a07d141c81d req-2565d17e-3b8c-4211-95c4-65be5cc080fd service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:29.788468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bd14cbca-8533-4502-a56f-2a07d141c81d req-2565d17e-3b8c-4211-95c4-65be5cc080fd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:29.788908 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-bd14cbca-8533-4502-a56f-2a07d141c81d req-2565d17e-3b8c-4211-95c4-65be5cc080fd service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:29.801957 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-bd14cbca-8533-4502-a56f-2a07d141c81d req-2565d17e-3b8c-4211-95c4-65be5cc080fd service nova] Creating event network-vif-plugged:b4090a2a-1f1c-44d0-99b7-a2852b940d62 for instance a6cdc1a6-4bae-4959-93e2-c57a348494cf on n-h2-858384-19 Nov 02 15:05:29.810426 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-bd14cbca-8533-4502-a56f-2a07d141c81d req-2565d17e-3b8c-4211-95c4-65be5cc080fd service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053468 Nov 02 15:05:29.811706 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4135/8644] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:05:40.922861 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:40.923673 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:40.930058 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-837585084", "imageRef": "16d67a47-0a7a-46cd-a025-9121568b7a82", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1278928886", "security_groups": [{"name": "tempest-secgroup-smoke-1416534237"}], "networks": [{"uuid": "94381356-b05d-452c-85d9-8c3af7c93614"}]}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:05:40.958371 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [a478623a-e324-4ec0-b1c8-bd86b004e522] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 48114. Nov 02 15:05:40.960565 n-d-858384-19 devstack@n-api.service[120928]: INFO oslo.messaging._drivers.impl_rabbit [-] [7cb8e393-5f80-4e43-aafa-d62a93a07cad] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 48112. Nov 02 15:05:41.055957 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.network.neutron [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] validate_networks() for [('94381356-b05d-452c-85d9-8c3af7c93614', None, None, None, None, None)] {{(pid=120928) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 15:05:41.460780 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Flavor limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 15:05:41.461711 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Image limits 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 15:05:41.462193 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Flavor pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 15:05:41.462593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Image pref 0:0:0 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 15:05:41.463000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.virt.hardware [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 15:05:41.471887 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:41.472368 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:41.472803 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:41.473528 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:41.474104 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:41.474527 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:41.492077 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Getting quotas for project a091d04f4cd84e13935eb27c38d09d5c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 15:05:41.497397 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.quota [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Getting quotas for user d4eca8d5f6ff45bb8b99faa3eb86373a and project a091d04f4cd84e13935eb27c38d09d5c. Resources: {'ram', 'instances', 'cores'} {{(pid=120928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 15:05:41.509609 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Going to run 1 instances... {{(pid=120928) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 15:05:41.512098 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='16d67a47-0a7a-46cd-a025-9121568b7a82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 15:05:41.565626 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-edfdae65-0740-4076-bd2d-dcd9d8ebaa97 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.645384 Nov 02 15:05:41.571239 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4510/8645] 10.222.0.113 () {60 vars in 1152 bytes} [Wed Nov 2 15:05:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 15:05:41.579185 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-ecda8719-3514-42e8-8592-5a8855b54c04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:41.580483 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-ecda8719-3514-42e8-8592-5a8855b54c04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:41.584028 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:41.584674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:41.612909 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 48128. Nov 02 15:05:41.614185 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 48130. Nov 02 15:05:41.700451 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-ecda8719-3514-42e8-8592-5a8855b54c04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:41.708256 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-ecda8719-3514-42e8-8592-5a8855b54c04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1252 microversion: 2.1 time: 0.133411 Nov 02 15:05:41.708695 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4136/8646] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:41 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1252 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:42.733186 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:42.733994 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:42.741767 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:42.742900 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:42.743700 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:42.744429 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:42.744906 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:42.745373 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:42.821265 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:42.830092 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4ca30def-b16a-4301-a865-6aafab8f1ca9 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1312 microversion: 2.1 time: 0.102314 Nov 02 15:05:42.830633 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4511/8647] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:42 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:43.816096 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-4fab6051-b7de-47ef-afcf-aa8eeac0251d req-e6519ddb-743d-4069-bdb1-cf284b86b9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6cdc1a6-4bae-4959-93e2-c57a348494cf", "name": "network-vif-unplugged", "status": "completed", "tag": "b4090a2a-1f1c-44d0-99b7-a2852b940d62"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:05:43.839156 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4fab6051-b7de-47ef-afcf-aa8eeac0251d req-e6519ddb-743d-4069-bdb1-cf284b86b9a5 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:43.846875 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4fab6051-b7de-47ef-afcf-aa8eeac0251d req-e6519ddb-743d-4069-bdb1-cf284b86b9a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:43.847520 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-4fab6051-b7de-47ef-afcf-aa8eeac0251d req-e6519ddb-743d-4069-bdb1-cf284b86b9a5 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:43.855699 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:43.856325 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:43.863667 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-4fab6051-b7de-47ef-afcf-aa8eeac0251d req-e6519ddb-743d-4069-bdb1-cf284b86b9a5 service nova] Creating event network-vif-unplugged:b4090a2a-1f1c-44d0-99b7-a2852b940d62 for instance a6cdc1a6-4bae-4959-93e2-c57a348494cf on n-h2-858384-19 Nov 02 15:05:43.874205 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-4fab6051-b7de-47ef-afcf-aa8eeac0251d req-e6519ddb-743d-4069-bdb1-cf284b86b9a5 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061051 Nov 02 15:05:43.875982 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4137/8648] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:05:43.883135 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:43.883777 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:43.889107 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:43.891665 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:43.892166 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:43.892618 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:44.133558 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:44.143866 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-c2dca2a6-c5f5-49bb-b4e2-c8c7be5fea59 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.293699 Nov 02 15:05:44.155287 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4512/8649] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:43 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:45.169629 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:45.170375 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:45.177251 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:45.177758 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:45.178210 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:45.179327 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:45.180628 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:45.181351 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:45.327731 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:45.335668 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-d6437dc3-17ab-4d39-831f-76de72483dbd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.171322 Nov 02 15:05:45.336658 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4138/8650] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:45 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:46.358862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:46.359524 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:46.368093 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:46.368672 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:46.369112 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:46.369830 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:46.370283 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:46.370919 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:46.519681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:46.528403 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-e788907a-f3e3-4bcd-bef5-dd1fd6c9d323 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.173360 Nov 02 15:05:46.529183 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4513/8651] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:46 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:47.552271 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:47.553904 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:47.571666 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:47.572176 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:47.572632 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:47.573370 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:47.573841 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:47.574281 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:47.722957 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:47.732935 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-042b6cef-e988-4fe0-8d7b-282aedc7529a tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.184650 Nov 02 15:05:47.733533 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4139/8652] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:47 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:48.762549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:48.763625 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:48.776402 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:48.777234 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:48.777975 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:48.779189 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:48.779960 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:48.780948 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:48.928020 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:48.936853 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-111c3434-0640-4b24-acc5-96a8d179c41c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.182028 Nov 02 15:05:48.937451 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4514/8653] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:48 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:49.961476 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:49.962354 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:49.969086 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:49.969581 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:49.970032 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:49.970754 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:49.971252 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:49.971692 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:50.126644 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:50.140275 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-614eac94-d5ca-4d5d-86e1-e3a285ecaecd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.183177 Nov 02 15:05:50.141416 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4140/8654] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:49 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:51.174257 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:51.174951 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:51.182512 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:51.183000 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:51.183485 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:51.184316 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:51.184859 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:51.185468 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:51.322472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:51.330630 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-a87b6d3b-0106-4bfa-b4cf-ac49e193e2d2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.160383 Nov 02 15:05:51.331221 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4515/8655] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:51 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:52.356839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:52.357455 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:52.360297 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell0:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:52.366594 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:52.367624 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:52.367794 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:52.368523 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:52.369015 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:52.369669 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:52.512110 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:52.519992 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-aa1e17c5-2067-4998-9fa9-6552141325d6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.169356 Nov 02 15:05:52.520577 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4141/8656] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:52 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:53.544424 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:53.545035 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:53.550839 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:53.552579 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell0:SELECT=6 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:05:53.557217 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:53.557913 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:53.558487 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:53.559474 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:53.560050 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:53.560589 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:53.707546 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:53.716397 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-91e86980-6fef-43cc-8180-6dd6661babcd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.176172 Nov 02 15:05:53.732158 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4516/8657] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:53 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:53.812791 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-47127f5b-b3d1-4167-b7dd-eaf988c2d9b6 req-ba1a6a14-e021-4e9d-ae7a-842b6a97ed2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416b6b07-207e-4d27-a282-41060d593490", "tag": "6226429f-8bed-4d2e-a3dd-56dc68f92181"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:05:53.824002 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-47127f5b-b3d1-4167-b7dd-eaf988c2d9b6 req-ba1a6a14-e021-4e9d-ae7a-842b6a97ed2f service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:53.824494 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-47127f5b-b3d1-4167-b7dd-eaf988c2d9b6 req-ba1a6a14-e021-4e9d-ae7a-842b6a97ed2f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:53.824949 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-47127f5b-b3d1-4167-b7dd-eaf988c2d9b6 req-ba1a6a14-e021-4e9d-ae7a-842b6a97ed2f service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:53.836722 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-47127f5b-b3d1-4167-b7dd-eaf988c2d9b6 req-ba1a6a14-e021-4e9d-ae7a-842b6a97ed2f service nova] Creating event network-changed:6226429f-8bed-4d2e-a3dd-56dc68f92181 for instance 416b6b07-207e-4d27-a282-41060d593490 on n-h1-858384-19 Nov 02 15:05:53.841881 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-47127f5b-b3d1-4167-b7dd-eaf988c2d9b6 req-ba1a6a14-e021-4e9d-ae7a-842b6a97ed2f service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096581 Nov 02 15:05:53.843423 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4142/8658] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:05:54.743095 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:54.743766 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:54.750708 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:54.751231 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:54.751681 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:54.752378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:54.752840 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:54.753275 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:54.883598 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:54.891295 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4e2c7d4a-dc51-410a-b6cd-3509687e5fb2 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.152271 Nov 02 15:05:54.891880 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4517/8659] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:54 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:55.932349 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:55.933138 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:55.949083 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:55.950397 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:55.951316 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:55.954749 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:55.955923 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:55.956738 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:56.111226 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:56.119232 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-acd48acd-897c-449d-a581-21b9789cd72b tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.198188 Nov 02 15:05:56.119852 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4143/8660] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:55 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:57.142593 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:57.143290 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:57.150873 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:57.151378 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:57.151828 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:57.152530 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:57.152992 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:57.153428 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:57.290607 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:57.298331 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-517388f2-7984-422b-ad67-d6dc52f43237 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.159785 Nov 02 15:05:57.298914 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4518/8661] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:57 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:58.321238 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:58.321870 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:58.328945 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:58.329449 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:58.329905 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:58.330620 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:58.331094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:58.331603 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:58.468752 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:58.477458 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-f6d739bb-794c-4d82-a2c3-9369cb24be36 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.160685 Nov 02 15:05:58.478053 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4144/8662] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:58 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:59.500564 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:05:59.501170 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:05:59.508069 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:59.508550 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:59.508991 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:59.509685 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:59.510141 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:59.510572 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:59.641858 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:05:59.650779 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-0c7ef6bf-e3fa-4725-a495-30f3330b3316 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.154249 Nov 02 15:05:59.651402 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4519/8663] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:05:59 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:05:59.915825 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-530b00f4-4c36-4fa0-987e-36f33f650c73 req-637c3f77-9e9f-4068-bf4d-67e10f33c23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416b6b07-207e-4d27-a282-41060d593490", "name": "network-vif-plugged", "status": "completed", "tag": "6226429f-8bed-4d2e-a3dd-56dc68f92181"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:05:59.927021 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-530b00f4-4c36-4fa0-987e-36f33f650c73 req-637c3f77-9e9f-4068-bf4d-67e10f33c23e service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:05:59.927553 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-530b00f4-4c36-4fa0-987e-36f33f650c73 req-637c3f77-9e9f-4068-bf4d-67e10f33c23e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:05:59.928007 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-530b00f4-4c36-4fa0-987e-36f33f650c73 req-637c3f77-9e9f-4068-bf4d-67e10f33c23e service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:05:59.941025 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-530b00f4-4c36-4fa0-987e-36f33f650c73 req-637c3f77-9e9f-4068-bf4d-67e10f33c23e service nova] Creating event network-vif-plugged:6226429f-8bed-4d2e-a3dd-56dc68f92181 for instance 416b6b07-207e-4d27-a282-41060d593490 on n-h1-858384-19 Nov 02 15:05:59.946978 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-530b00f4-4c36-4fa0-987e-36f33f650c73 req-637c3f77-9e9f-4068-bf4d-67e10f33c23e service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036073 Nov 02 15:05:59.947810 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4145/8664] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:06:00.673976 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:00.674600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:00.682078 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:00.682654 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:00.683128 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:00.683826 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:00.684286 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:00.684722 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:00.819643 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:00.828274 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-63907926-9ee2-4547-98e5-02dc22325406 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1378 microversion: 2.1 time: 0.158281 Nov 02 15:06:00.828849 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4520/8665] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:06:00 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1378 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:01.852765 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:01.853490 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:01.859885 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:01.860389 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:01.860846 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:01.861560 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:01.862034 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:01.862480 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:01.996134 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:02.003913 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-eda02fde-b4ec-4564-83c2-d6e75384ac37 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1563 microversion: 2.1 time: 0.157369 Nov 02 15:06:02.004490 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4146/8666] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:06:01 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:02.026990 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:06:02.027631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:06:02.034507 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:02.034985 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:02.035460 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:02.036148 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:02.036600 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:02.037026 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:02.167952 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:06:02.175718 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-4591d9af-c94a-44ee-b7ab-d3d164585e1c tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1563 microversion: 2.1 time: 0.153321 Nov 02 15:06:02.176300 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4521/8667] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:06:02 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:06:04.208059 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-3df53704-4efb-4a91-b2d1-b098221423f4 req-5574ceb6-ad10-49ff-b457-54c1a9b5cc12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416b6b07-207e-4d27-a282-41060d593490", "tag": "6226429f-8bed-4d2e-a3dd-56dc68f92181"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:06:04.217674 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3df53704-4efb-4a91-b2d1-b098221423f4 req-5574ceb6-ad10-49ff-b457-54c1a9b5cc12 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:06:04.218172 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3df53704-4efb-4a91-b2d1-b098221423f4 req-5574ceb6-ad10-49ff-b457-54c1a9b5cc12 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:06:04.218610 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-3df53704-4efb-4a91-b2d1-b098221423f4 req-5574ceb6-ad10-49ff-b457-54c1a9b5cc12 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:06:04.233589 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-3df53704-4efb-4a91-b2d1-b098221423f4 req-5574ceb6-ad10-49ff-b457-54c1a9b5cc12 service nova] Creating event network-changed:6226429f-8bed-4d2e-a3dd-56dc68f92181 for instance 416b6b07-207e-4d27-a282-41060d593490 on n-h1-858384-19 Nov 02 15:06:04.238693 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-3df53704-4efb-4a91-b2d1-b098221423f4 req-5574ceb6-ad10-49ff-b457-54c1a9b5cc12 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090309 Nov 02 15:06:04.239535 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4147/8668] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:08:17.599835 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:17.600580 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=68 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:17.654897 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-3fb98f0d-e258-4ed4-ade2-f517ee6dea04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1315939458"}} {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:08:17.657344 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-3fb98f0d-e258-4ed4-ade2-f517ee6dea04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:17.663398 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb98f0d-e258-4ed4-ade2-f517ee6dea04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:17.663884 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb98f0d-e258-4ed4-ade2-f517ee6dea04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:17.664329 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb98f0d-e258-4ed4-ade2-f517ee6dea04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:17.665025 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb98f0d-e258-4ed4-ade2-f517ee6dea04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:17.665482 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb98f0d-e258-4ed4-ade2-f517ee6dea04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:17.665911 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-3fb98f0d-e258-4ed4-ade2-f517ee6dea04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:17.872575 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-3fb98f0d-e258-4ed4-ade2-f517ee6dea04 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "POST /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490/action" status: 202 len: 0 microversion: 2.1 time: 0.278155 Nov 02 15:08:17.873283 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4522/8669] 10.222.0.113 () {60 vars in 1283 bytes} [Wed Nov 2 15:08:17 2022] POST /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 15:08:24.591259 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] AMQP server on 10.222.0.113:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 15:08:24.592821 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] AMQP server on 10.222.0.113:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 02 15:08:24.593671 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=26 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:24.594592 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=50 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:24.653094 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-14dfa778-542a-4769-a8a4-5e9289ab8931 req-b3abd2db-4f1b-458f-a0fe-20dbf584b20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416b6b07-207e-4d27-a282-41060d593490", "name": "network-vif-plugged", "status": "completed", "tag": "6226429f-8bed-4d2e-a3dd-56dc68f92181"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:08:24.664199 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-14dfa778-542a-4769-a8a4-5e9289ab8931 req-b3abd2db-4f1b-458f-a0fe-20dbf584b20b service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:24.664694 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-14dfa778-542a-4769-a8a4-5e9289ab8931 req-b3abd2db-4f1b-458f-a0fe-20dbf584b20b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:24.665142 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-14dfa778-542a-4769-a8a4-5e9289ab8931 req-b3abd2db-4f1b-458f-a0fe-20dbf584b20b service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:24.678119 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-14dfa778-542a-4769-a8a4-5e9289ab8931 req-b3abd2db-4f1b-458f-a0fe-20dbf584b20b service nova] Creating event network-vif-plugged:6226429f-8bed-4d2e-a3dd-56dc68f92181 for instance 416b6b07-207e-4d27-a282-41060d593490 on n-h1-858384-19 Nov 02 15:08:24.683895 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-14dfa778-542a-4769-a8a4-5e9289ab8931 req-b3abd2db-4f1b-458f-a0fe-20dbf584b20b service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094144 Nov 02 15:08:24.684681 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4148/8670] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:08:36.611883 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_api:SELECT=2 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:36.613111 n-d-858384-19 devstack@n-api.service[120928]: DEBUG dbcounter [-] [120928] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:36.616426 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-cddb74cc-746c-4b66-aa2c-8a273b141dbd req-22a37880-931e-4476-b53e-02f72ef77deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416b6b07-207e-4d27-a282-41060d593490", "tag": "6226429f-8bed-4d2e-a3dd-56dc68f92181"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:08:36.617341 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:36.617935 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:36.624022 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_api:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:36.624889 n-d-858384-19 devstack@n-api.service[120929]: DEBUG dbcounter [-] [120929] Writing DB stats nova_cell1:SELECT=2 {{(pid=120929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 15:08:36.626664 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:36.627130 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:36.627745 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:36.628707 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:36.629235 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:36.629676 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:36.632705 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cddb74cc-746c-4b66-aa2c-8a273b141dbd req-22a37880-931e-4476-b53e-02f72ef77deb service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:36.633200 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cddb74cc-746c-4b66-aa2c-8a273b141dbd req-22a37880-931e-4476-b53e-02f72ef77deb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:36.633646 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-cddb74cc-746c-4b66-aa2c-8a273b141dbd req-22a37880-931e-4476-b53e-02f72ef77deb service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:36.652480 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-cddb74cc-746c-4b66-aa2c-8a273b141dbd req-22a37880-931e-4476-b53e-02f72ef77deb service nova] Creating event network-changed:6226429f-8bed-4d2e-a3dd-56dc68f92181 for instance 416b6b07-207e-4d27-a282-41060d593490 on n-h1-858384-19 Nov 02 15:08:36.658598 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-cddb74cc-746c-4b66-aa2c-8a273b141dbd req-22a37880-931e-4476-b53e-02f72ef77deb service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046372 Nov 02 15:08:36.659244 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4149/8671] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:08:36.662986 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 15:08:36.760570 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-901ad7f6-ea52-474f-af08-cbca46121871 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "DELETE /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 204 len: 0 microversion: 2.1 time: 0.150391 Nov 02 15:08:36.762350 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4523/8672] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 15:08:36 2022] DELETE /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 15:08:36.771738 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc76b2c0-2ca4-425a-8979-00f4f14e4caa] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 48476. Nov 02 15:08:36.777747 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:36.778460 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:36.780958 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [-] [df93a667-61d2-456f-bef0-364cdd4f35c5] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 48474. Nov 02 15:08:36.786195 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:36.786741 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:36.787217 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:36.788141 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:36.788616 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:36.789058 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:36.956182 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:08:36.964147 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-5fe887ad-56d0-404f-aaff-70b681acd9a7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1688 microversion: 2.1 time: 0.196292 Nov 02 15:08:36.964734 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4150/8673] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:08:36 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:08:37.988497 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:37.989406 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:37.996634 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:37.997060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:37.997500 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:37.998199 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:37.998660 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:37.999087 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:38.129959 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:08:38.138499 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-874acfbf-b444-4e05-9d94-8e374cd21cd1 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1688 microversion: 2.1 time: 0.154378 Nov 02 15:08:38.139193 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4524/8674] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:08:37 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:08:38.597296 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-c300b2e8-f17d-4f42-8d78-1ecb64577dd4 req-3c7c5196-5f47-4a87-aba6-e502e496da3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416b6b07-207e-4d27-a282-41060d593490", "name": "network-vif-unplugged", "status": "completed", "tag": "6226429f-8bed-4d2e-a3dd-56dc68f92181"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:08:38.609473 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c300b2e8-f17d-4f42-8d78-1ecb64577dd4 req-3c7c5196-5f47-4a87-aba6-e502e496da3d service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:38.609970 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c300b2e8-f17d-4f42-8d78-1ecb64577dd4 req-3c7c5196-5f47-4a87-aba6-e502e496da3d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:38.610418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-c300b2e8-f17d-4f42-8d78-1ecb64577dd4 req-3c7c5196-5f47-4a87-aba6-e502e496da3d service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:38.622361 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-c300b2e8-f17d-4f42-8d78-1ecb64577dd4 req-3c7c5196-5f47-4a87-aba6-e502e496da3d service nova] Creating event network-vif-unplugged:6226429f-8bed-4d2e-a3dd-56dc68f92181 for instance 416b6b07-207e-4d27-a282-41060d593490 on n-h1-858384-19 Nov 02 15:08:38.627561 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-c300b2e8-f17d-4f42-8d78-1ecb64577dd4 req-3c7c5196-5f47-4a87-aba6-e502e496da3d service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033954 Nov 02 15:08:38.628199 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4151/8675] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:08:39.162031 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:39.162862 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:39.167954 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-7c1fe6fa-902a-42e3-8eab-79bddadc2a97 req-6a4d18f6-ebf0-420f-b190-3796b888af88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416b6b07-207e-4d27-a282-41060d593490", "name": "network-vif-deleted", "tag": "6226429f-8bed-4d2e-a3dd-56dc68f92181"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:08:39.170173 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:39.170812 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:39.171274 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:39.172145 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:39.172754 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:39.173228 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:39.180626 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7c1fe6fa-902a-42e3-8eab-79bddadc2a97 req-6a4d18f6-ebf0-420f-b190-3796b888af88 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:39.181122 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7c1fe6fa-902a-42e3-8eab-79bddadc2a97 req-6a4d18f6-ebf0-420f-b190-3796b888af88 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:39.181597 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-7c1fe6fa-902a-42e3-8eab-79bddadc2a97 req-6a4d18f6-ebf0-420f-b190-3796b888af88 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:39.194956 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-7c1fe6fa-902a-42e3-8eab-79bddadc2a97 req-6a4d18f6-ebf0-420f-b190-3796b888af88 service nova] Creating event network-vif-deleted:6226429f-8bed-4d2e-a3dd-56dc68f92181 for instance 416b6b07-207e-4d27-a282-41060d593490 on n-h1-858384-19 Nov 02 15:08:39.204006 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-7c1fe6fa-902a-42e3-8eab-79bddadc2a97 req-6a4d18f6-ebf0-420f-b190-3796b888af88 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040724 Nov 02 15:08:39.204650 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4152/8676] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 15:08:39.243581 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:08:39.256277 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fdfa4c2f-3e26-4fb4-96d3-f18a25d77605 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 200 len: 1501 microversion: 2.1 time: 0.097907 Nov 02 15:08:39.257302 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4525/8677] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:08:39 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 1501 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:08:40.294465 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:40.295208 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: 416b6b07-207e-4d27-a282-41060d593490] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:40.301468 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:40.301966 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:40.302418 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:40.303135 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:40.303611 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:40.304057 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:40.317297 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.wsgi [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] HTTP exception thrown: Instance 416b6b07-207e-4d27-a282-41060d593490 could not be found. Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Request method failure captured: Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: request: GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 HTTP/1.1 Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: Accept: application/json Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: Accept-Encoding: identity Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: Connection: close Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: Content-Length: 0 Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: Content-Type: application/json Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: Host: 10.222.0.113 Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: Openstack-System-Scope: None Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: User-Agent: python-urllib3/1.26.12 Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Auth-Token: gAAAAABjYoaAeU2GQFQxJMCs6kHKbMQhpZTGVvNry3k_MfevJGxjKrUeJF88T7rCRkUrmVooiXlC_72qOArdFfyWCKS3rDayV2Y_CS02aty0UEpE6HWE3ZxQefnUpwidPkIgPUPKLl8312DhHSm8SPjs-kwuajJFvzQFCAUvzRhEsWWa6gs8HZM Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Id: None Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Domain-Name: None Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Identity-Status: Confirmed Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Is-Admin-Project: True Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Id: default Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Domain-Name: Default Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Id: a091d04f4cd84e13935eb27c38d09d5c Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Project-Name: tempest-TestSnapshotPattern-1195385573 Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Role: member,reader Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Roles: member,reader Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a091d04f4cd84e13935eb27c38d09d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a091d04f4cd84e13935eb27c38d09d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a091d04f4cd84e13935eb27c38d09d5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a091d04f4cd84e13935eb27c38d09d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant: tempest-TestSnapshotPattern-1195385573 Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Id: a091d04f4cd84e13935eb27c38d09d5c Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-Tenant-Name: tempest-TestSnapshotPattern-1195385573 Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-User: tempest-TestSnapshotPattern-1195385573-project Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Id: default Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-User-Domain-Name: Default Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-User-Id: d4eca8d5f6ff45bb8b99faa3eb86373a Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: X-User-Name: tempest-TestSnapshotPattern-1195385573-project Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: method: > Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: exception: Instance 416b6b07-207e-4d27-a282-41060d593490 could not be found. Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: action_args: {'id': '416b6b07-207e-4d27-a282-41060d593490'} Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416b6b07-207e-4d27-a282-41060d593490 could not be found. Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416b6b07-207e-4d27-a282-41060d593490 could not be found. Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:08:40.318907 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416b6b07-207e-4d27-a282-41060d593490 could not be found. Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: ERROR nova.api.openstack.wsgi Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Returning 404 to user: Instance 416b6b07-207e-4d27-a282-41060d593490 could not be found. {{(pid=120929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-181a0891-cce1-4375-bc00-6cef400b5837 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490" status: 404 len: 111 microversion: 2.1 time: 0.031143 Nov 02 15:08:40.325235 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4153/8678] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:08:40 2022] GET /compute/v2.1/servers/416b6b07-207e-4d27-a282-41060d593490 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 15:08:41.978839 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-35c77ac5-779c-4127-9f15-4fde3d38317a req-b8c2b093-ee83-4990-8ddc-5851a5615659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6cdc1a6-4bae-4959-93e2-c57a348494cf", "tag": "b4090a2a-1f1c-44d0-99b7-a2852b940d62"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:08:41.984519 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:41.985029 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:41.991549 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:41.992034 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:41.992472 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:41.993179 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:41.993631 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:41.994057 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:41.997010 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-35c77ac5-779c-4127-9f15-4fde3d38317a req-b8c2b093-ee83-4990-8ddc-5851a5615659 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:41.997163 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-35c77ac5-779c-4127-9f15-4fde3d38317a req-b8c2b093-ee83-4990-8ddc-5851a5615659 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:41.997507 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-35c77ac5-779c-4127-9f15-4fde3d38317a req-b8c2b093-ee83-4990-8ddc-5851a5615659 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:42.008607 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-35c77ac5-779c-4127-9f15-4fde3d38317a req-b8c2b093-ee83-4990-8ddc-5851a5615659 service nova] Creating event network-changed:b4090a2a-1f1c-44d0-99b7-a2852b940d62 for instance a6cdc1a6-4bae-4959-93e2-c57a348494cf on n-h2-858384-19 Nov 02 15:08:42.014056 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-35c77ac5-779c-4127-9f15-4fde3d38317a req-b8c2b093-ee83-4990-8ddc-5851a5615659 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039113 Nov 02 15:08:42.014684 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4154/8679] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:08:42.022015 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Going to try to terminate instance {{(pid=120928) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 15:08:42.114767 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-fa1a6b11-b9d7-4434-8a9c-d2cdd0748a42 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "DELETE /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 204 len: 0 microversion: 2.1 time: 0.143624 Nov 02 15:08:42.115532 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4526/8680] 10.222.0.113 () {58 vars in 1244 bytes} [Wed Nov 2 15:08:41 2022] DELETE /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 15:08:42.125332 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:42.126085 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.compute.api [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120929) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:42.132516 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:42.133018 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:42.133686 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:42.134414 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:42.134890 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:42.135362 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:42.277429 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.policy [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120929) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:08:42.285490 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-e2f05fe6-a47e-492a-b0fe-4ea2302b70a6 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1689 microversion: 2.1 time: 0.165005 Nov 02 15:08:42.286081 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4155/8681] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:08:42 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 15:08:43.309800 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:43.310529 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:43.317961 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:43.318449 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:43.318885 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:43.319611 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:43.320060 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:43.320483 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:43.415459 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.policy [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eca8d5f6ff45bb8b99faa3eb86373a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a091d04f4cd84e13935eb27c38d09d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120928) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 15:08:43.424097 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-7c7e43ad-b143-4f9a-a059-01434368b2d7 tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 200 len: 1502 microversion: 2.1 time: 0.118838 Nov 02 15:08:43.424685 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4527/8682] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:08:43 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 1502 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 15:08:43.454988 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [req-e2a6cc72-fe90-48da-8567-352699c96ca5 req-c80eabef-28b2-4be4-a6b4-7fb91c2c7675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6cdc1a6-4bae-4959-93e2-c57a348494cf", "name": "network-vif-deleted", "tag": "b4090a2a-1f1c-44d0-99b7-a2852b940d62"}]} {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 15:08:43.466540 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e2a6cc72-fe90-48da-8567-352699c96ca5 req-c80eabef-28b2-4be4-a6b4-7fb91c2c7675 service nova] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:43.467036 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e2a6cc72-fe90-48da-8567-352699c96ca5 req-c80eabef-28b2-4be4-a6b4-7fb91c2c7675 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:43.467511 n-d-858384-19 devstack@n-api.service[120929]: DEBUG oslo_concurrency.lockutils [req-e2a6cc72-fe90-48da-8567-352699c96ca5 req-c80eabef-28b2-4be4-a6b4-7fb91c2c7675 service nova] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:43.479487 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.compute.server_external_events [req-e2a6cc72-fe90-48da-8567-352699c96ca5 req-c80eabef-28b2-4be4-a6b4-7fb91c2c7675 service nova] Creating event network-vif-deleted:b4090a2a-1f1c-44d0-99b7-a2852b940d62 for instance a6cdc1a6-4bae-4959-93e2-c57a348494cf on n-h2-858384-19 Nov 02 15:08:43.484587 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [req-e2a6cc72-fe90-48da-8567-352699c96ca5 req-c80eabef-28b2-4be4-a6b4-7fb91c2c7675 service nova] 10.222.0.113 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033521 Nov 02 15:08:43.485225 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4156/8683] 10.222.0.113 () {64 vars in 1322 bytes} [Wed Nov 2 15:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 15:08:44.448115 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '>' {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:44.448886 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.compute.api [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [instance: a6cdc1a6-4bae-4959-93e2-c57a348494cf] Fetching instance by UUID {{(pid=120928) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 15:08:44.455719 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:44.456204 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:44.456646 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:44.457347 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Acquiring lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 15:08:44.457805 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 15:08:44.458236 n-d-858384-19 devstack@n-api.service[120928]: DEBUG oslo_concurrency.lockutils [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Lock "9a7ec9cd-69da-487a-bb46-fb17d9a3c3a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 15:08:44.472493 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.wsgi [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] HTTP exception thrown: Instance a6cdc1a6-4bae-4959-93e2-c57a348494cf could not be found. Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Request method failure captured: Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: request: GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf HTTP/1.1 Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: Accept: application/json Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: Accept-Encoding: identity Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: Connection: close Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: Content-Length: 0 Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: Content-Type: application/json Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: Host: 10.222.0.113 Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: Openstack-System-Scope: None Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: User-Agent: python-urllib3/1.26.12 Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Auth-Token: gAAAAABjYoaAeU2GQFQxJMCs6kHKbMQhpZTGVvNry3k_MfevJGxjKrUeJF88T7rCRkUrmVooiXlC_72qOArdFfyWCKS3rDayV2Y_CS02aty0UEpE6HWE3ZxQefnUpwidPkIgPUPKLl8312DhHSm8SPjs-kwuajJFvzQFCAUvzRhEsWWa6gs8HZM Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Id: None Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Domain-Name: None Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Identity-Status: Confirmed Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Is-Admin-Project: True Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Id: default Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Domain-Name: Default Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Id: a091d04f4cd84e13935eb27c38d09d5c Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Project-Name: tempest-TestSnapshotPattern-1195385573 Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Role: member,reader Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Roles: member,reader Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a091d04f4cd84e13935eb27c38d09d5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/volume/v3/a091d04f4cd84e13935eb27c38d09d5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.113:8080", "publicURL": "http://10.222.0.113:8080/v1/AUTH_a091d04f4cd84e13935eb27c38d09d5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2/a091d04f4cd84e13935eb27c38d09d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.113/compute/v2.1"}]}] Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant: tempest-TestSnapshotPattern-1195385573 Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Id: a091d04f4cd84e13935eb27c38d09d5c Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-Tenant-Name: tempest-TestSnapshotPattern-1195385573 Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-User: tempest-TestSnapshotPattern-1195385573-project Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Id: default Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Domain-Name: Default Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Id: d4eca8d5f6ff45bb8b99faa3eb86373a Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: X-User-Name: tempest-TestSnapshotPattern-1195385573-project Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: method: > Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: exception: Instance a6cdc1a6-4bae-4959-93e2-c57a348494cf could not be found. Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: action_args: {'id': 'a6cdc1a6-4bae-4959-93e2-c57a348494cf'} Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: {{(pid=120928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6cdc1a6-4bae-4959-93e2-c57a348494cf could not be found. Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6cdc1a6-4bae-4959-93e2-c57a348494cf could not be found. Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 15:08:44.474127 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6cdc1a6-4bae-4959-93e2-c57a348494cf could not be found. Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: ERROR nova.api.openstack.wsgi Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: DEBUG nova.api.openstack.wsgi [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Returning 404 to user: Instance a6cdc1a6-4bae-4959-93e2-c57a348494cf could not be found. {{(pid=120928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: INFO nova.api.openstack.requestlog [None req-5b6b087d-dc98-4d31-801f-79a8486791db tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf" status: 404 len: 111 microversion: 2.1 time: 0.031349 Nov 02 15:08:44.478161 n-d-858384-19 devstack@n-api.service[120928]: [pid: 120928|app: 0|req: 4528/8684] 10.222.0.113 () {58 vars in 1241 bytes} [Wed Nov 2 15:08:44 2022] GET /compute/v2.1/servers/a6cdc1a6-4bae-4959-93e2-c57a348494cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 15:08:44.641750 n-d-858384-19 devstack@n-api.service[120929]: DEBUG nova.api.openstack.wsgi [None req-c697ff64-677e-4e71-966d-4dacb48a81dd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] Calling method '.version_select at 0x7fe787664b80>' {{(pid=120929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 15:08:44.646319 n-d-858384-19 devstack@n-api.service[120929]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c697ff64-677e-4e71-966d-4dacb48a81dd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [5634e798-45da-4415-a7fa-7f9b15ccaa68] AMQP server on 10.222.0.113:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 15:08:45.653342 n-d-858384-19 devstack@n-api.service[120929]: INFO oslo.messaging._drivers.impl_rabbit [None req-c697ff64-677e-4e71-966d-4dacb48a81dd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] [5634e798-45da-4415-a7fa-7f9b15ccaa68] Reconnected to AMQP server on 10.222.0.113:5672 via [amqp] client with port 48554. Nov 02 15:08:45.672820 n-d-858384-19 devstack@n-api.service[120929]: INFO nova.api.openstack.requestlog [None req-c697ff64-677e-4e71-966d-4dacb48a81dd tempest-TestSnapshotPattern-1195385573 tempest-TestSnapshotPattern-1195385573-project] 10.222.0.113 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1278928886" status: 202 len: 0 microversion: 2.1 time: 1.037025 Nov 02 15:08:45.673631 n-d-858384-19 devstack@n-api.service[120929]: [pid: 120929|app: 0|req: 4157/8685] 10.222.0.113 () {58 vars in 1262 bytes} [Wed Nov 2 15:08:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1278928886 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)